top of page
image.png

AI Agent System for Oceanic Data

Exploration and Interactive Eco-Art​

NeurIPS_logo.png

Premiering at NeurIPS 2025, San Diego, California

Sensorium Arc (AI reflects on climate) is a real-time multimodal interactive AI agent system that personifies the ocean as a poetic speaker and guides users through immersive explorations of complex marine data. Built on a modular multi-agent system and retrieval-augmented large language model (LLM) framework, Sensorium enables natural spoken conversations with AI agents that embodies the ocean’s perspective, generating responses that blend scientific insight with ecological poetics. Through keyword detection and semantic parsing, the system dynamically triggers data visualizations and audiovisual playback based on time, location, and thematic cues drawn from the dialogue. Developed in collaboration with the Center for the Study of the Force Majeure and inspired by the eco-aesthetic philosophy of Newton Harrison, Sensorium Arc reimagines ocean data not as an abstract dataset but as a living narrative. The project demonstrates the potential of conversational AI agents to mediate affective, intuitive access to high-dimensional environmental data and proposes a new paradigm for human-machine-ecosystem.

image.png

a) Exemplary setup for the Sensorium Arc exhibition Users engage through a natural gesture, whispering into a seashell as if speaking to the ocean.
b) User interface before activation showing the sensors
c) Activated user interface showing the response from the system.

x2.png

Overall diagram of the Sensorium Arc system

image.png

Screenshots of the different exemplary scenarios

(a) Default globe view before user interaction.

(b) Chlorophyll concentration data visualized on the globe surface.

(c) Water clarity rendered using layers of hyperspectral diffuse attenuation coefficient (Kd) data from NASA's PACE satellite (2024).

(d) Combined visualization of atmospheric CO2 levels and ocean surface wind flow, highlighting interconnected nature

unnamed (2).png
Kuali400.png
bottom of page