Multi-user interactive system in virtual 3D spaces using the gesture of smartphones:
The structure of the proposed system
The smartphone interface transmitting buttons, accelerometer, and gyroscope data through OSC
Inside of the AlloSphere
• Developed general-purpose gesture-based smartphone 3D interface (C++).
• Developed a musical instrument using smartphones' gesture-based interface (C++).
• Developing a multimodal 3D interface with pattern recognition using signal processing and machine learning.
Examples of the particles in the virtual 3D space with different configurations