Creative Technology
VJ & Audio-Visual
Software Engineer
Collaborated with
musician / artists -
DJ Rebolledo, ASUKA, YY, HACOIRI, Kylie
Manami Sakamoto, Demsky
Performed At
Public Visuals, LVMH Tokyo Summit
WOMB, HVEN, Mitsuki, Circus
Creative Technology
VJ & Audio-Visual
Software Engineer
Collaborated with
musician / artists -
DJ Rebolledo, ASUKA, YY, HACOIRI, Kylie
Manami Sakamoto, Demsky
Performed At
Public Visuals, LVMH Tokyo Summit
WOMB, HVEN, Mitsuki, Circus
May 2024
TouchDesigner
Unreal Engine 5
Phidget
Arduino
Fabrication
My Role: Digital content development (TouchDesigner, UE5, p5.js)
Exhibited at:
- The New York Academy of Science, NY, US
- NYU Neuroscience Institute Buzsaki Lab, NY, US
- NYU ITP/IMA Spring Show 2024, NYU Tisch School of the Arts, NY, US
Press:
Neural Harmony interactive installation explores the concept of Neural Syntax proposed by professor György Buzsáki. Neural Syntax suggests that the brain organizes information and processes sequences through rhythmic brain waves, akin to a language-like syntax that structures neural communication and cognitive functions.
Using the hierarchical relationship of letters, words, and sentences as a metaphor, Neural Harmony illustrates the nested hierarchical Relationship between different brainwaves. When the user turn the knob: letters rearrange within specific words, like the faster neural oscillations nested within slower rhythms. Sentences are like the slowest neural oscillations, controlling and organizing all the faster ones.
Team:
- Interaction Design and Unreal Engine 5 Developer: Lois He
- Product Design and Fabrication: Sofia Shen
- Interaction and Visual Programming: Vio Zhu, Lois He
- Typography Design: Xing Zhang
My technical contribution:
- TouchDesigner, p5.js and UE5 development for the inetractive brain wave and text animation content.
- Connecting Phidget input to control p5.js and UE5 animated experience.
- Syncing animation and interactive experience between p5.js and UE5 via OSC.