Type
Team Project (3 members) × Shanghai Astronomy Museum
Timeline
2024.09 - 2024.12
Technique
Unity & Arduino & TouchDesigner
My Roles
Programmer; Experience Designer; VFX Artist; Game UI Designer
Exhibitions & Awards
2025 MUSE Design Awards - Interaction (Silver Winner)
9th Milan Design Week: China Collegiate Design Competition (Third Prize, National; First Prize, Shanghai)
Description
Interactive Installation / Multimedia / Immersive Exhibition Design
Gravitational Lensing / Astronomical Science Popularization
Gravicam is an immersive, multiplayer installation created for the Shanghai Astronomy Museum, demystifying gravitational lensing through cooperative gameplay. One participant embodies a celestial body while the other becomes an observer. By physically manipulating a lens, players work together to capture a "celestial portrait," vitnessing firsthand how gravity bends light and warps imagery. This experience is powered by a robust technical framework where a bidirectional communication system between Unity, TouchDesigner, and Arduino translates real-world actions into dynamic visual effects, making advanced astrophysics accessible and engaging for all visitors.
Shanghai Astronomy Museum
Shanghai Astronomy Museum is a globally leading platform for astronomy science popularization exhibition. Our team comprising of three students from ShanghaiTech University is honored to have obtained a collaborative opportunity with the museum. We first conducted a research of the exhibits at Shanghai Astronomy Museum.
Gravitational Lensing
To inspire the public to fall in love with astronomy, our team chose Gravitational Lensing as an entry. Deflection of light by gravity was predicted by General Relativity and observationally confirmed in 1919. This led to the idea of a gravitational lens that a matter (the lens) like a galaxy or a clusters of galaxies comes in between the light source and the observer and causes multiple images or ring, or both, of the light source.
Role-play Gameplay
Installation 3D Prototype
The Lens
The lens stands for a cluster of galaxies, with its volume and brightness adjusted to reflect changes in mass.
Light Deflection
The light rays sent by X126 are bent by the lens as they pass through it. The greater the mass, the stronger the light deflection.
Digital Simulation
There is a digital simulation of the lens and light deflection in the game UI.
Face-Celestial Body Image
The celestial body player’s face is transformed into face-celestial body photo. There are three switchable types of Face-Celestial Body Images.
Guest Experience & Game UI
Gravicam is a two-player interactive installation. The two players take on different roles and perform separate interactions. Player1 acts as X126, and Player2 acts as Observer 001 at Leith Observatory.
Multi-Sensor Interaction
TouchDesigner VFX
Unity & TouchDesigner & Arduino
Design Process
