Bodycoaster (2022) 
UNREAL ENGINE • REALITY CAPTURE • SUBSTANCE PAINTER • TOUCHDESIGNER


Bodycoaster (2022) is a live performance I presented in the “Alter Ego” Show at the Garage of 370 Jay street, Brooklyn in December.

This performance centers around introducing Lume, my alter ego.

Lume is an avatar made from the 3D scan of myself using Reality Capture and Mesh to MetaHuman feature in UE5.




Converting 4K footages into realisic 3D model in Reality Capture

Repainted Face Mesh in Substance Painter



Texture Details

Bodycoaster (2022)





The skin texture was re-created in Substance Painter. In order to turn this live performance into a thrilling experience, rollercoaster tracks are placed all over Lume’s body so that the audience can experiencing riding on this “bodycoaster”.




This project uses real-time render from the camera in Unreal to TouchDesigner.

At the meantime, TouchDesiger is analyzing the pitch of the audio to control the camera movement in Unreal.

  
 



Audio Reactive Particle in Unreal



Real-time Render of Unreal Camera in TouchDesigner via Spout



Bi-directional communication between Unreal and TouchDesigner via Off-world Streaming Toolkit



On Stage


Special thanks to Yufan Xie for making the music “Forgive Me”.