PlugWiki
earshot logo

Earshot MCP Server: Setup for Claude, Cursor and Other Apps

CommunityLocal

Lets your coding assistant listen to audio and video: measure loudness, tag sounds, rank candidates and render sound effects.

Earshot gives a coding assistant ears. It runs on your computer on CPU only, using two open audio models plus plain measurements.

It installs from a source checkout rather than from a package, so setup takes a few steps. The first use downloads about 1.1 GB of models.

Good for

  • Developers making launch films and demos with an agent
  • Video editors who want sound checked against picture
  • Creators picking the best sound from many candidates

Works in

12 should work

Tap an app to see how to set it up and any known problems.

Install earshot MCP

Claude Code

  1. 1

    Copy this prompt.

    Add the earshot MCP server to Claude Code. Run this command:
    
    claude mcp add --transport stdio earshot -- /path/to/earshot/.venv/bin/python -m earshot mcp
    
    Then check that it loaded and tell me if I need to sign in or restart.
  2. 2

    Paste it into Claude Code. It shows the change and asks before running it.

Requires Python 3.10 or newer, ffmpeg and ffprobe on PATH, A cloned earshot repository with a virtual environment.

Read-only mode: Most tools only read audio. Three write WAV or image files, and llm_critique uploads audio only when you agree.

Earshot installs from a source checkout. Clone the repository, make a virtual environment, install PyTorch for CPU and then the package with its mcp extra, and run python -m earshot doctor --load. You need Python 3.10 or newer and ffmpeg on your PATH. Replace /path/to/earshot with the folder you cloned. The first use downloads two open models of about 1.1 GB. On a slow machine, start Claude Code with MCP_TIMEOUT=60000.

Built from the package data we hold. Not yet tested by us.

Tools

  • Measures loudness, peaks and timing of a file

    Gives exact meter readings such as duration, loudness in LUFS and true peak, without AI models. The README says to trust these numbers.

    Try: “How loud is this audio file?”

    Read · measure

  • Says what a sound is

    Gives tags for the source, material, action and character of a sound using two local AI models. The first call takes 20 to 60 seconds while they load.

    Try: “What does this sound clip contain?”

    Read · describe

  • Checks if a sound fits a description

    Scores how well one sound matches a text description and gives a verdict. Give alternative wordings so it can say which fits best.

    Try: “Does this clip sound like a door slam?”

    Read · match

  • Ranks many sounds against a description

    Sorts candidate files by how well they match a description, to pick the best one.

    Try: “Which of these files is the best whoosh?”

    Read · rank

  • Finds moments inside a long recording

    Searches one long recording for segments that match a description and returns start and end times.

    Try: “Find where the applause starts in this recording.”

    Read · find

  • Compares a sound to reference recordings

    Finds the nearest references and says how typical the sound is among them.

    Try: “Is this kick like my reference kicks?”

    Read · compare

  • Compares two sounds side by side

    Says which of two sounds is closer to a description or a reference set, and how they differ in measured values.

    Try: “Is version B better than version A?”

    Read · ab

  • Judges real recording versus synthesized

    Estimates whether audio sounds like a real recording or like simple code-made sound.

    Try: “Does this sound like a real recording?”

    Read · realness

  • Listens through a whole soundtrack

    Produces a transcript of events with time, level and tags for a soundtrack or film.

    Try: “Give me a timeline of the sounds in this film.”

    Read · timeline

  • Draws a picture of a soundtrack

    Makes an annotated image of a soundtrack or film on one time axis, with frames, sections and labelled events, and saves it as a file.

    Try: “Draw a sheet of this film's sound.”

    Write · sheet

  • Scores a launch-film soundtrack

    Gives a scorecard of loudness, peak, dynamics and spectral balance for a launch film's sound.

    Try: “Critique the sound of this launch film.”

    Read · critique

  • Checks the earshot install

    Checks packages, ffmpeg and the models, and optionally loads them to time one run.

    Try: “Is earshot set up correctly?”

    Read · doctor

Read from the source code

Permissions

medium risk · 3 things to watch

Medium risk

It reads audio and video files you point it at and can write WAV and image files. Its one network tool uploads audio to Google Gemini, and only after you agree.

What it can do

  • Read your data
  • Create and change things
  • Delete things
  • Read-only mode

Watch out for

  • The llm_critique tool uploads audio to Google Gemini

    The llm_critique tool sends audio to Gemini, needs your GEMINI_API_KEY, and asks for your explicit agreement first (a consent flag). Leave the key unset if you never want that. github.com

  • It writes files to paths you give it

    Three tools write WAV or image files to an absolute path. Check where the assistant saves them. github.com

  • Large first download

    The first use downloads about 1.1 GB of models into the repo folder. The README says it never contacts the Hub afterwards. github.com

Security advisories

No published security advisories as of Nov 1, 2026.

Technical details
Talks toHugging Face for the first model download. Google Gemini, only for llm_critique with your consent
Sign-in and keysNo sign-in. The optional critique tool reads GEMINI_API_KEY from the environment.
Scopes
  • Files you point it at

Questions

Is earshot official?

It is the project's own server, by Leonxlnx. It is not made by an audio or video app vendor.

Does it need a GPU?

No. It runs on CPU only.

How do I install it?

From a cloned repository with a virtual environment, as described in the install box. There is no package to install with npx or uvx.

Does it need an API key?

No, except for the optional llm_critique tool, which needs a Gemini key (GEMINI_API_KEY).

Does it send my audio anywhere?

Only llm_critique does, to Google Gemini, after you agree. Everything else runs on your computer.

Why is the first call slow?

The two models load on the first call, which takes about 20 to 60 seconds. They stay loaded afterwards.

Information

updated Nov 2, 2026

Publisher
Community
Transport
stdio
Auth
None
License
MIT
Last commit
Oct 22, 2026
Open issues
4

GitHubChangelogIssues

Sources

Docs, issue trackers and discussions this page is built from. Issues, quotes and findings above link to their own source.

Show all 2
  1. mcp_server.py · github.com
  2. README.md · github.com

Facts from the official MCP registry, GitHub, npm, PyPI and the Docker catalog. Updated Nov 2, 2026.