Multi-user interactive system in virtual 3D spaces using the gesture of smartphones:

005.jpg

The structure of the proposed system

001.jpg
002.jpg
3.jpg

The smartphone interface transmitting buttons, accelerometer, and gyroscope data through OSC

Inside of the AlloSphere


    • Developed general-purpose gesture-based smartphone 3D interface (C++).
    • Developed a musical instrument using smartphones' gesture-based interface (C++).

    • Developing a multimodal 3D interface with pattern recognition using signal processing and machine learning. 

pic02.jpg
pic01.jpg
pic03.jpg
006.jpg

Examples of the particles in the virtual 3D space with different configurations