Unity + TouchDesigner

Overview

This project explores real-time visual feedback pipelines by sending gameplay data from Unity to TouchDesigner using Spout. The result is a dynamic system where in-game actions can drive generative visuals, data visualizations, or interactive installations.

“What if gameplay data wasn’t just viewed—but performed?”

Tech

Tool Role

Unity Game engine + real-time player input

Spout Frame-sharing between apps (GPU to GPU)

TouchDesigner Real-time visual programming for generative media

What I Built

A working Unity-to-TouchDesigner pipeline using Spout Sender

  1. A Unity scene with interactive movement, color triggers, and score data

  2. A TouchDesigner network that visualizes gameplay events live (e.g., trails, waves, particle bursts)

  3. A YouTube tutorial documenting the setup and process (linked below!)

Design Goals

  1. Test real-time AV pipelines for performative game visuals

  2. Explore how game data (like position, speed, or score) can be mapped to motion graphics or installations

  3. Create a lightweight framework that could be reused for live events, music, or exhibitions

Watch the Process

  1. Test real-time AV pipelines for performative game visuals

  2. Explore how game data (like position, speed, or score) can be mapped to motion graphics or installations

  3. Create a lightweight framework that could be reused for live events, music, or exhibitions