Immersive Theater Space of "Collective Resonance": Technical Logic of the Interactive System
《集體共鳴》沉浸式戲劇演出空間：互動系統技術邏輯概覽

---

Immersive Theater Space of "Collective Resonance": Technical Logic of the Interactive System
This work constructs a highly integrated audio-light-image synergy system within the theater space, transforming the actions and voices of both the audience and performers into real-time lighting control and multi-channel visual feedback, creating an immersive sensory theater experience.
Real-Time DMX Lighting Control Logic
Input Signals:
Performer (QingH) performs using Ableton Push, or audience voices are analyzed via MaxMSP to generate MIDI note signals.
Signal Path:

MIDI Signals → Unreal Engine 5
Custom Blueprint System in Unreal Engine 5 receives MIDI data and converts it into lighting control commands, driving virtual DMX lighting behavior.
Unreal Engine 5 → Art-Net/DMX Protocol → Physical Lighting Devices
Lighting parameters (such as color, intensity, dynamics) are mapped in real-time to suspended DMX stage lighting devices using Art-Net or sACN protocols, achieving sound-responsive lighting control.
Practical Application:
A high-altitude lighting truss system is set up in a black box theater for suspending LED PARs, moving pattern lights, spotlight projectors, and other professional stage lighting devices.
Lighting behavior is dynamically linked to audience sound and performer rhythm, creating an immersive spatial light field.
Immersive Multi-Wall Projection Visual Logic
Input Signals:
Synchronized MIDI signals (generated by performers or the audience).
Signal Path:
MIDI → TouchDesigner
Each MIDI signal triggers specific image generation logic and parameter changes in TouchDesigner, creating rhythmic responsive geometric transformations, particle flows, light wave animations, and other visual effects.
TouchDesigner → Multi-Channel Projection Output
Using Spout/NDI/Graphics Card Multi-Port Output, projections are mapped onto five walls.
The projection content is edge-blended and spatially mapped according to the theater's structure, achieving a 360° immersive effect.
Practical Application:
Multiple high-brightness ultra-short-throw projectors are used for immersive visual coverage on the front wall, two side walls, floor, and ceiling (or rear wall).
Combined with sound and lighting, this setup creates a mystical ritualistic atmosphere of "perceptual reset."
System Coordination and Real-Time Engine
All audio input, MIDI generation, visual output, and lighting control are uniformly managed by a real-time coordination algorithm system developed by Li Huaiji’s team.
Ensures low-latency signal transmission and high synchronization, supporting "zero-distance interaction" in the technical dimension of the entire performance.
Recommended Application Scenarios:
Black box theater, multifunctional art space, immersive exhibition hall.
Supports the installation of lighting trusses and surround projection systems.
Recommended configuration: TouchDesigner multi-output setup + Unreal Engine lighting engine control.

《集體共鳴》沉浸式戲劇演出空間：互動系統技術邏輯概覽
本作品在戲劇演出空間中構建一套高度整合的音-光-影協同系統，將觀眾與表演者的動作和聲音轉化為即時燈光控制與多通道投影視覺反饋，實現沉浸式感官劇場體驗。
即時 DMX 燈光控制邏輯
輸入信號：
表演者（QingH）透過 Ableton Push 打擊墊演奏，或觀眾聲音經 MaxMSP 分析後生成 MIDI 音符信號。
信號路徑：
MIDI 信號 → Unreal Engine 5
自訂藍圖系統於 Unreal Engine 5 中接收 MIDI 資料，轉換為燈光控制指令，驅動虛擬 DMX 燈具行為。
Unreal Engine 5 → Art-Net/DMX 協議 → 實體燈光設備。
燈光參數（如顏色、強度、動態）經 Art-Net 或 sACN 協議實時控制懸掛於現場的 DMX 舞台燈具，實現燈光隨音動。
實際應用：
在黑盒子劇場內搭建高空燈架系統，用於懸掛 LED PAR、移動圖案燈、投影聚光燈等專業舞台燈光設備。
燈光行為與觀眾互動聲音和表演節奏即時聯動，形成空間性光場。
沉浸式多面牆投影視覺邏輯
輸入信號：
同步傳輸的 MIDI 信號（由表演或觀眾產生）。
信號路徑：
MIDI → TouchDesigner
每條 MIDI 信號觸發指定的圖像生成邏輯與參數變化，實現節奏響應式的幾何體變換、粒子流動、光波動畫等視覺效果。
TouchDesigner → 多通道投影輸出
透過 Spout / NDI / 顯卡多端口輸出，分別映射至五面牆體。
投影內容依據劇場結構進行邊緣融合與空間映射，實現 360° 沉浸感。
實際應用：
使用多台高亮度超短焦投影儀，完成前牆、兩側牆、地面與天花板（或後牆）的五面視覺包裹。
與聲音和燈光共同營造“感知重啟”的神秘儀式氛圍。
系統調度與即時引擎
所有音頻輸入、MIDI 生成、視覺輸出與燈光控制，均由李懷驥團隊開發的即時協調算法系統統一調度。
確保信號低延遲傳輸與高同步性，支撐整場演出在技術層面的“零距離互動”。
應用場景建議：
黑盒子劇場、多功能藝術空間、沉浸式展廳。
支持搭建燈光桁架與環繞式投影系統。
建議使用 TouchDesigner 顯卡多輸出方案 + Unreal 燈光引擎驅動。

---