Using audio, visual and artificial intelligence as sensory inputs, the beast can respond and react to an audience as they interact with its environment.

A collaboration between Miles Dunne and myself featuring Robert Rowland as our Intergalactic Zoologist.

ITBOTB is essentially a giant modular synthesizer being controlled by movement, Chat GPT and audio reactivity. Miles programmed the visuals in response to the audio components.

Chat GPT generated melodies and chords based on different audio analysis inputs. All audio was generated within Touchdesigner using oscillators and processing.

We used VR to preview the installation allowing Miles and Robert to immerse themselves within the world and test the interactive components.

Front-person Sam was recorded using a Kinect v2 3D camera and custom volumetric capture module researched and designed for the project.

Data was processed and rendered entirely within Touchdesigner.

Digital components were synced to audio inputs for reactive feedback.

During the editing process visuals were recorded through a CRT TV and re-aligned over the digital footage to give texture and character. CRT distortion was also used for scene transitions.

Using consumer hardware we were able to create a high quality digital output while staying nimble to the needs of the client. Scenes could be adjusted in real-time (not pre-rendered) and the client could be collaborated with over an internet screen share.

Historically this type of content would require high production budgets and a large team of creatives (House of Cards by Radiohead).

By utilizing cutting-edge advances in GPU hardware and 3D sensors, we could create content at a fraction of the cost and time that would otherwise be required.

The techniques and tools developed for this project have been put to use elsewhere and continue to enhance my production workflow, having been adapted for the newer Kinect Azure 3D camera.

ATM001 has been presented at South By Southwest Sydney, Lot Fourteen and Rundle Mall.

Led by Dave Court and James Brown with support from The Australian Institute for Machine Learning.

I coded the interactivity using python scripts embedded into a rather complex touchdesigner project spanning 3 instances and many virtual environments.

Since then ATM001 has received a few upgrades and now runs on GPT4, writes poems and has many personalities for the user to discover!

I had a lot of assistance from collaborator and python legend Shaun Goudy.

Using a Kinect Azure and Oculus Quest 2 I created a system for live camera tracking and volumetric recording which was used to capture performances and intergrate them into the music videos by Dave.

I created the visual world in response to Sam and Lily’s choreography. A ritual of birth, life, and death. Visuals were linked to the lighting and controlled using Q-Lab.

In collaboration with Orlando and the musicians, we created animated, realtime and reactive backgrounds that responded to the compositions performed by the ASQ. I utilised AI image generators, 3D scanning and audio reactivity to build my portion of the show, as well as intergrating content provided by Orlando into the visual landscapes.

Home

I programmed an interactive 3D installation using Touchdesigner that allows users to puppet 3D models created by the artist. This was a challenge as it needed to be responsive, video game-esque, and suitable for fast-moving children.

Utilizing graphic design assets and historical TV commercials, I created visual art pieces to be displayed on LED screens at the Masonic Grand Hall in Adelaide.

Content was displayed real-time using TouchDesigner.

This allowed for a dynamic and evolving visual landscape that complemented dinner, speeches, and a band.