
Earshot MCP Server: Setup for Claude, Cursor and Other Apps
Lets your coding assistant listen to audio and video: measure loudness, tag sounds, rank candidates and render sound effects.
Earshot gives a coding assistant ears. It runs on your computer on CPU only, using two open audio models plus plain measurements.
It installs from a source checkout rather than from a package, so setup takes a few steps. The first use downloads about 1.1 GB of models.
Good for
- Developers making launch films and demos with an agent
- Video editors who want sound checked against picture
- Creators picking the best sound from many candidates
Works in
12 should work
Tap an app to see how to set it up and any known problems.
Supports local MCP servers.
Supports local MCP servers.
Supports local MCP servers.
Supports local MCP servers.
Supports local MCP servers.
Supports local MCP servers.
Supports local MCP servers.
Supports local MCP servers.
Supports local MCP servers.
Supports local MCP servers.
Supports local MCP servers.
Supports local MCP servers.
Client does not support this transport.
Client does not support this transport.
Install earshot MCP
Claude Code
- 1
Copy this prompt.
Add the earshot MCP server to Claude Code. Run this command: claude mcp add --transport stdio earshot -- /path/to/earshot/.venv/bin/python -m earshot mcp Then check that it loaded and tell me if I need to sign in or restart.
- 2
Paste it into Claude Code. It shows the change and asks before running it.
Requires Python 3.10 or newer, ffmpeg and ffprobe on PATH, A cloned earshot repository with a virtual environment.
Read-only mode: Most tools only read audio. Three write WAV or image files, and llm_critique uploads audio only when you agree.
Earshot installs from a source checkout. Clone the repository, make a virtual environment, install PyTorch for CPU and then the package with its mcp extra, and run python -m earshot doctor --load. You need Python 3.10 or newer and ffmpeg on your PATH. Replace /path/to/earshot with the folder you cloned. The first use downloads two open models of about 1.1 GB. On a slow machine, start Claude Code with MCP_TIMEOUT=60000.
Built from the package data we hold. Not yet tested by us.
Tools
Measures loudness, peaks and timing of a file
Gives exact meter readings such as duration, loudness in LUFS and true peak, without AI models. The README says to trust these numbers.
Try: “How loud is this audio file?”
Read ·
measureSays what a sound is
Gives tags for the source, material, action and character of a sound using two local AI models. The first call takes 20 to 60 seconds while they load.
Try: “What does this sound clip contain?”
Read ·
describeChecks if a sound fits a description
Scores how well one sound matches a text description and gives a verdict. Give alternative wordings so it can say which fits best.
Try: “Does this clip sound like a door slam?”
Read ·
matchRanks many sounds against a description
Sorts candidate files by how well they match a description, to pick the best one.
Try: “Which of these files is the best whoosh?”
Read ·
rankFinds moments inside a long recording
Searches one long recording for segments that match a description and returns start and end times.
Try: “Find where the applause starts in this recording.”
Read ·
findCompares a sound to reference recordings
Finds the nearest references and says how typical the sound is among them.
Try: “Is this kick like my reference kicks?”
Read ·
compareCompares two sounds side by side
Says which of two sounds is closer to a description or a reference set, and how they differ in measured values.
Try: “Is version B better than version A?”
Read ·
abJudges real recording versus synthesized
Estimates whether audio sounds like a real recording or like simple code-made sound.
Try: “Does this sound like a real recording?”
Read ·
realnessListens through a whole soundtrack
Produces a transcript of events with time, level and tags for a soundtrack or film.
Try: “Give me a timeline of the sounds in this film.”
Read ·
timelineDraws a picture of a soundtrack
Makes an annotated image of a soundtrack or film on one time axis, with frames, sections and labelled events, and saves it as a file.
Try: “Draw a sheet of this film's sound.”
Write ·
sheetScores a launch-film soundtrack
Gives a scorecard of loudness, peak, dynamics and spectral balance for a launch film's sound.
Try: “Critique the sound of this launch film.”
Read ·
critiqueChecks the earshot install
Checks packages, ffmpeg and the models, and optionally loads them to time one run.
Try: “Is earshot set up correctly?”
Read ·
doctorSends audio to Gemini for an opinion
Uploads audio to Google Gemini for a written critique. It needs a Gemini key in the server environment and works only after you agree.
Try: “Ask Gemini for a critique of this track.”
Network ·
llm_critiqueLists the shipped sound bank
Lists the sound effects that ship with earshot, with length, peak time and the cue kinds they suit. It uses no AI models.
Try: “What whoosh sounds are in the bank?”
Read ·
sfx_listRenders one bank sound to a WAV file
Renders a sound from the bank to a WAV file, adjusted to the picture, in about a second.
Try: “Render a crisp whoosh of 0.4 seconds to a WAV.”
Write ·
sfx_renderRenders a film's sound kit
Renders the takes for every role in a film's kit.json into WAV files, plus a lock file.
Try: “Render the sound kit for this film.”
Write ·
kit_render
Read from the source code
Permissions
medium risk · 3 things to watch
Medium risk
It reads audio and video files you point it at and can write WAV and image files. Its one network tool uploads audio to Google Gemini, and only after you agree.
What it can do
- Read your data
- Create and change things
- Delete things
- Read-only mode
Watch out for
The llm_critique tool uploads audio to Google Gemini
The llm_critique tool sends audio to Gemini, needs your GEMINI_API_KEY, and asks for your explicit agreement first (a consent flag). Leave the key unset if you never want that. github.com
It writes files to paths you give it
Three tools write WAV or image files to an absolute path. Check where the assistant saves them. github.com
Large first download
The first use downloads about 1.1 GB of models into the repo folder. The README says it never contacts the Hub afterwards. github.com
Security advisories
No published security advisories as of Nov 1, 2026.
Technical details
| Talks to | Hugging Face for the first model download. Google Gemini, only for llm_critique with your consent |
|---|---|
| Sign-in and keys | No sign-in. The optional critique tool reads GEMINI_API_KEY from the environment. |
| Scopes |
|
Questions
Is earshot official?
It is the project's own server, by Leonxlnx. It is not made by an audio or video app vendor.
Does it need a GPU?
No. It runs on CPU only.
How do I install it?
From a cloned repository with a virtual environment, as described in the install box. There is no package to install with npx or uvx.
Does it need an API key?
No, except for the optional llm_critique tool, which needs a Gemini key (GEMINI_API_KEY).
Does it send my audio anywhere?
Only llm_critique does, to Google Gemini, after you agree. Everything else runs on your computer.
Why is the first call slow?
The two models load on the first call, which takes about 20 to 60 seconds. They stay loaded afterwards.
Information
updated Nov 2, 2026
- Publisher
- Community
- Transport
- stdio
- Auth
- None
- License
- MIT
- Last commit
- Oct 22, 2026
- Open issues
- 4
Sources
Docs, issue trackers and discussions this page is built from. Issues, quotes and findings above link to their own source.
Show all 2Hide
- mcp_server.py · github.com
- README.md · github.com