home.md

+# Using Hand Tracking and Voice Commands to Physically Align Virtual Surfaces in AR for Handwriting and Sketching with HoloLens 2
+
+# Abstract
+In this paper, we adapt an existing VR framework for handwriting and sketching on physically aligned virtual surfaces to AR environments using the Microsoft HoloLens 2. We demonstrate a multimodal input metaphor to control the framework’s calibration features using hand tracking and voice commands. Our technical evaluation of fingertip/surface accuracy and precision on physical tables and walls is in line with existing measurements on comparable hardware, albeit considerably lower compared to previous work using controller-based VR devices. We discuss design considerations and the benefits of our unified input metaphor suitable for controller tracking and hand tracking systems. We encourage extensions and replication by providing a publicly available reference implementation (https://go.uniwue.de/hci-otss-hololens).
+
+# Authors
+Florian Kern, Thore Keser, Florian Niebling, Marc Erich Latoschik
+
+# ACM Digital Library
+[https://dl.acm.org/doi/10.1145/3489849.3489940](https://dl.acm.org/doi/10.1145/3489849.3489940)
+
+# Chair’s Homepage
+[https://hci.uni-wuerzburg.de/](https://hci.uni-wuerzburg.de/)
+
+# Project’s Homepage
+[https://vilearn.info/](https://vilearn.info/)
+
+# Citation
+
+Florian Kern, Thore Keser, Florian Niebling, and Marc Erich Latoschik. 2021. Using Hand Tracking and Voice Commands to Physically Align Virtual Surfaces in AR for Handwriting and Sketching with HoloLens 2. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology (VRST '21). Association for Computing Machinery, New York, NY, USA, Article 103, 1–3. DOI: https://doi.org/10.1145/3489849.3489940`
+
+
+# Citation
+```
+@inproceedings{10.1145/3489849.3489940,
+author = {Kern, Florian and Keser, Thore and Niebling, Florian and Latoschik, Marc Erich},
+title = {Using Hand Tracking and Voice Commands to Physically Align Virtual Surfaces in AR for Handwriting and Sketching with HoloLens 2},
+year = {2021},
+isbn = {9781450390927},
+publisher = {Association for Computing Machinery},
+address = {New York, NY, USA},
+url = {https://doi.org/10.1145/3489849.3489940},
+doi = {10.1145/3489849.3489940},
+booktitle = {Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology},
+articleno = {103},
+numpages = {3},
+keywords = {sketching, finger tracking, augmented reality, holoLens, virtual reality, stylus, handwriting, surface alignment},
+location = {Osaka, Japan},
+series = {VRST '21}
+}
+```