Voice control demo for Ableton Live using Realtime 2 API

A Reddit user shared an experiment using OpenAI's Realtime 2 API to control Ableton Live by voice without using hands. The author says they had tried to make an Ableton MCP work with voice chat for more than a year, but it only worked well after the Realtime 2 model launched. The project is open source, and the author asked whether others are trying similar voice control or Ableton Live MCP experiments.

Key points

  • The demo uses OpenAI's Realtime 2 API for voice control.
  • It controls Ableton Live, a music production app.
  • The author says earlier attempts did not work well until Realtime 2 launched.
  • The project is open source and available on GitHub.
  • The author is looking for others working on voice control or MCP experiments for Ableton Live.

Quick term guide

Realtime 2 API
A tool from OpenAI for adding real-time voice interaction to apps.
Ableton Live
A professional app used to make, edit, and perform music.
open source
Software whose code is available for people to view and often modify.
Solo makers
People who build and launch their own products or services entirely on their own.
code editor
A special program used for writing and editing software instructions.
experimental
Available to try, but not yet proven to be fully stable.
reference
Using a source to find information or confirm facts while working.
production
The live version of a service that real users use.
Read original