International Journal of Creative Interfaces and Computer Graphics (IJCICG)

LS3D: LEGO Search combining Speech and  Stereoscopic 3D

The number of available 3D digital objects has been increasing considerably. As such, searching in large collections has been subject of vast research. However, the main focus has been on algorithms and techniques for classification, indexing and retrieval. While some works have been done on query interfaces and results visualization, they do not explore natural interactions. We propose a speech interface for 3D object retrieval in immersive virtual environments. As a proof of concept, we developed the LS3D prototype, using the context of LEGO blocks to understand how people naturally describe such objects. Through a preliminary study, we found that participants mainly resorted to verbal descriptions. Considering these descriptions and using a low cost visualization device, we developed our solution. We compared it with a commercial application through a user evaluation. Results suggest that LS3D can outperform its contestant, and ensures better performance and results perception than traditional approaches for 3D object retrieval.

Keywords: User Interfaces, 3D Object Retrieval, Voice Search, Immersive Visualization, Speech Recognition, Multimodal Interaction.

Pedro Pascoal, Daniel Mendes, Diogo Henriques, Isabel Trancoso, Alfredo Ferreira, (accepted for publication), LS3D: LEGO Search combining Speech and  Stereoscopic 3D, International Journal of Creative Interfaces and Computer Graphics.

Advertisements