Text Entry in Virtual Environments using Speech and a Midair Keyboard
Document Type
Article
Publication Date
3-22-2021
Department
Department of Computer Science
Abstract
Entering text in virtual environments can be challenging, especially without auxiliary input devices. We investigate text input in virtual reality using hand-tracking and speech. Our system visualizes users' hands in the virtual environment, allowing typing on an auto-correcting midair keyboard. It also supports speaking a sentence and then correcting errors by selecting alternative words proposed by a speech recognizer. We conducted a user study in which participants wrote sentences with and without speech. Using only the keyboard, users wrote at 11 words-per-minute at a 1.2% error rate. Speaking and correcting sentences was faster and more accurate at 28 words-per-minute and a 0.5% error rate. Participants achieved this performance despite half of sentences containing an uncommon out-of-vocabulary word (e.g. proper name). For sentences with only in-vocabulary words, performance using speech and midair keyboard corrections was faster at 36 words-per-minute with a low 0.3% error rate.
Publication Title
IEEE Transactions on Visualization and Computer Graphics
Recommended Citation
Adhikary, J.,
&
Vertanen, K.
(2021).
Text Entry in Virtual Environments using Speech and a Midair Keyboard.
IEEE Transactions on Visualization and Computer Graphics,
27(5), 2648-2658.
http://doi.org/10.1109/TVCG.2021.3067776
Retrieved from: https://digitalcommons.mtu.edu/michigantech-p/14779