Technique-aware Digital Embroidery Simulator with Gaze and Voice Interaction

Stefan Bozov; Elena Zaharieva-Stoyanova

doi:10.55630/dipp.2026.16.12

Authors

Stefan Bozov Technical University of Gabrovo, 4 Hadzhi Dimitar Street, 5300 Gabrovo, Bulgaria
Elena Zaharieva-Stoyanova Technical University of Gabrovo, 4 Hadzhi Dimitar Street, 5300 Gabrovo, Bulgaria

DOI:

https://doi.org/10.55630/dipp.2026.16.12

Keywords:

Cross-stitch Pattern Software, Craft Software, Computer-aided Design (CAD), Gaze-based and Voice-based Interaction, Human-Computer Interaction (HCI), Domestic Handicrafts, Digital Preservation, Cultural Heritage

Abstract

This paper deals with problems related to craft software development oriented to handmade embroidery, created as a simulation of the stitching process by following the needle movement path. The paper focuses on human-computer interaction of the application involving gaze- and voice-based interaction to ensure hands-free control of the embroidery process. This approach allows users with physical disabilities to apply the software on the one side; on the other it speeds up the workflow for users without disabilities. Gaze and voice-based interactions are part of whole system architecture. The presented work demonstrates that interaction technologies can be combined with technique-aware embroidery simulation to support inclusive participation in digital craft environments and to facilitate the preservation and sharing of traditional embroidery knowledge.

References

Bashar, M. R., Mutasim, A. K., Pfeuffer, K., & Batmaz, A. U. (2026). Eyes on Many: Evaluating Gaze, Hand, and Voice for Multi-Object Selection in Extended Reality. In N. Oliver, D. A. Shamma, H. Candello, P. Cesar, P. Lopes, A. Bozzon, T. Kosch, V. Liao, X. Ma, V. Artizzu, F. Draxler, G. Lopez, A. V. Reinschluessel, X. Tong, & P. O. Toups Dugas (Eds.), CHI 2026 - Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems Article 671. Association for Computing Machinery. https://doi.org/10.1145/3772318.3790513

Bozov, S., & Zaharieva-Stoyanova, E. (2025a). Dot-based, dual-view user interface for realistic embroidery simulation in cross-stitch software. In International Conference Automatics and Informatics 2025 (ICAI'25) (pp. 613-617). Varna, Bulgaria: IEEE. https://doi.org/10.1109/ICAI67591.2025.11324900

Bozov, S., & Zaharieva-Stoyanova, E. (2025b). Stitch-agnostic, technical-aware data model for digital embroidery patterns design. In International Conference Automatics and Informatics 2025 (ICAI'25) (pp. 603-607). Varna, Bulgaria: IEEE.

Cross Stitch Saga. (2025, May 11). Cross Stitch Saga. https://crossstitchsaga.ru/

Dimitrova, Z. (2022). Bulgarian embroideries from Ruse region. SoftPress.

FlossCross-Designer. (2026, March 20). FlossCross - free online cross stitch pattern maker. https://flosscross.com/

Ghani, M., Chaudhry, S., Sohail, M., & Nafees Geelani, M. (2014). GazePointer: A real time mouse pointer control implementation based on eye. Journal of Multimedia Processing and Technologies, 5(2), 64-75.

Khan, A. A., Newn, J., Bailey, J., & Velloso, E. (2022). Integrating gaze and speech for enabling implicit interactions. In CHI Conference on Human Factors in Computing Systems (pp. 1-14). New Orleans, LA, USA.

Nasledstvoto. (2026, March 20). Nasledstvoto. https://nasledstvoto.com/page/about-us

Pattern Keeper. (2026, March 20). Pattern Keeper. https://patternkeeper.app/

Pixel-Stitch. (2026, March 20). Pixel-Stitch. https://www.pixel-stitch.net/index.html

StitchFiddle. (n.d.). StitchFiddle. https://www.stitchfiddle.com/en

Victoria and Albert Museum. (2024). Embroidery – a history of needlework samplers. https://www.vam.ac.uk/articles/embroidery-a-history-of-needlework-samplers

Yamini, G., Srivastava, S., Shivam, A., & Siddharth, K. (2025). Vocal gaze mouse controller. International Journal of Latest Technology in Engineering, 808-814.

Zaharieva-Stoyanova, E., & Bozov, S. (2025). Digital modeling and visualization of embroidery techniques. International Conference “Digital Presentation and Preservation of Cultural and Scientific Heritage” (DiPP 2025) (pp. 227-236). Burgas, Bulgaria.

Zhao, D. G., Karikov, N. D., Melnichuk, E. V., Velichkovsky, B. M., & Shishkin, S. L. (2020). Voice as a mouse click: Usability and effectiveness of simplified hands-free gaze-voice selection. Applied Sciences, 10(24), Article 8791. https://doi.org/10.3390/app10248791