Connecting Hermes AI agent to Home Assistant voice

There is demand for connecting a Home Assistant voice assistant to a Hermes AI agent. The goal is to use the contacts and past conversations already available in the Hermes assistant during spoken conversations. The desired setup is simple: speak to the assistant, have Hermes understand the request, and hear a spoken reply back.

A setup outside Home Assistant may be possible, but the main question is whether the existing NABU CASA voice assistant can be used as the bridge. A clear, easy-to-follow working example is not obvious yet.

Key points

  • The goal is to connect Hermes AI agent with Home Assistant voice.
  • The wanted experience is two-way spoken conversation.
  • Contacts and past conversation history are important parts of the desired setup.
  • NABU CASA is the preferred bridge because it is already being used for voice.
  • There does not appear to be a simple public walkthrough yet.

Quick term guide

Home Assistant
Free, open-source software that connects and controls smart home devices from one central dashboard.
Hermes AI agent
An AI helper based on Hermes that can chat and assist with tasks.
AI agent
An AI program that can inspect information and suggest what to do next.
Nabu Casa
A paid cloud service made by the team behind Home Assistant.
tracking
Collecting records of what a user does inside an app.
hermes-agent
A likely name for Nous Research’s agent-style AI tool or service.
integration
The work of connecting one tool or service into another product.
import
To bring a file or folder into a tool so it can use it.
Read original