At Neurosity, we’re continually inspired by the creative possibilities of brain-computer interface (BCI) technology. Over the past year, we’ve collaborated with incredible artists, tested boundaries, and built what we believe is a game-changing feature: OSC Perform Mode.

This innovation transforms how creators use real-time brain metrics in performances, art installations, and more. Here’s the story of how OSC Perform Mode came to life, told through the amazing projects that inspired it.

When Grimes took the stage at Ultra 2023, she used the Neurosity Crown with our JavaScript SDK to create an unforgettable, brain-connected performance. The challenge? Relying on the cloud-based SDK for live performances introduced latency and potential connectivity issues in such a dynamic environment.

This ambitious project was spearheaded by Wes, who later went on to found Prophetic AI, pushing the boundaries of creativity and technology even further. Despite the hurdles, the team pulled it off, showing the potential of integrating brainwave data into live art while also highlighting the need for a more reliable, localized solution. This performance planted the seed for what would eventually become OSC Perform Mode.

Watch Grimes at Ultra in March 2023

This collaboration was nothing short of serendipitous. Having attended over 30 Pretty Lights shows across the country since 2014, I could never have imagined that nearly a decade later, the band would organically reach out to Neurosity in 2023 to collaborate. It felt like it was always meant to be.

For their New York performance at The Brooklyn Mirage, we added focus and calm outputs to the existing OSC setup, which was originally streaming raw data. This meant OSC was now outputting focus, calm, and raw simultaneously. During testing, we quickly noted that sending raw data over the local Wi-Fi network caused choppiness, especially as multiple Crowns came online. All we really needed was focus and calm to drive the visuals on the massive 200-foot-wide LED video wall with its stunning 15K ultra-wide resolution.

This experience underscored the need to separate the modes, ensuring raw data wouldn’t be sent unnecessarily—especially with what we had planned next: the Brain Wave Rave.

Watch Pretty Lights at Brooklyn Mirage in October 2023

Special thanks to Derek, Eric, and the entire Pretty Lights squad for their support and creativity and for teaching me so much about TouchDesigner during those amazing three days.

The Brain Wave Rave marked a major milestone for OSC Perform Mode. For the first time, we ran 8 Crowns simultaneously on the same network, driving four separate art pieces using a rolling 16-second average of power by band.

To ensure seamless operation, we prepared an additional 24 Crowns to swap in as backups. This was also the first event where TouchDesigner played a central role in driving the visuals, and it was breathtaking to watch brainwave data come alive.

Watch the Brain Wave Rave Recap Video

Before releasing OSC Perform Mode, we added one final feature: slope, which measures the direction of change for each frequency bin across the 8 EEG channels of the Crown. This addition provides artists and developers with even deeper insights into cognitive activity, enhancing the creative potential of Perform Mode.

One of the key decisions in designing OSC Perform Mode was to avoid sending raw data. Here’s why:

What’s more, you can run both Perform Mode and Raw Mode simultaneously, giving you the flexibility to choose the right data stream for your project.

With OSC Perform Mode, we’re just scratching the surface of what’s possible. We’re excited to see how you—our community of artists, developers, and innovators—push this technology to new heights.

Check out the OSC Perform Mode documentation to learn more, and let us know what you create.