Date of Award

2025

Document Type

Campus Access Dissertation

Degree Name

Doctor of Philosophy in Computer Science (PhD)

Administrative Home Department

Department of Computer Science

Advisor 1

Scott A. Kuhl

Advisor 2

Keith Vertanen

Committee Member 1

Robert Pastel

Committee Member 2

Elizabeth Veinott

Abstract

As virtual and augmented reality (VR/AR) technologies continue to evolve, the demand for more natural and integrated input systems has become increasingly evident. Traditional devices such as keyboards, mice, and touchscreens are often unsuitable for immersive environments due to their reliance on bulky physical hardware and constrained interaction spaces. This work presents an acoustic-based input system that enables ordinary surfaces to function as interactive interfaces by analyzing the propagation of sound generated by finger taps. The system employs sound source localization (SSL) with time difference of arrival (TDoA) algorithms to accurately detect and localize taps on a flat surface. To ensure practical applicability, the system is also designed with a focus on real-time processing and robustness to ambient noise. By addressing key challenges in signal processing and localization accuracy, this work demonstrates a cost-effective and flexible alternative to conventional input methods. The proposed approach has the potential to significantly enhance user interaction in AR/VR environments, offering an adaptable solution for future applications.

Available for download on Saturday, August 01, 2026

Share

COinS