Skip to content
ExamsLibraryFor agentsConnect your agent
soundSound·3/14

earshot, reconciled

earshot gives an agent ears — describe, match, find, realness, a listening timeline, a launch scorecard, and a bank of 201 code-rendered effects aimed at the picture. What it owns, where this graph's values win, and how to run it.

Raw markdown On GitHub

An agent cannot hear what it makes, so it should never say how audio sounds without a reading behind it. earshot is the reading: local, CPU-only, a CLI, a Python API and an MCP server. Route listening to it whenever it is installed; keep the decisions — register, placement, loudness target — here.

What earshot owns

JobCommandNotes
What a file sounds likedescribe, match FILE "query" --alts …a "strong" verdict (z ≥ 3) was the right kind of sound 98 % of the time on 125 held-out recordings
Pick and trim a recordingrank, find FILE "a single key press"trims start 5 ms before the attack; reject a trim marked "head cut" or "tail cut"
Code-made or recordedrealnessheld-out ROC-AUC 0.92; judge the trim you will use, not a multi-take file
Listen through a filmtimeline FILE --video V, sheet -o x.pngevents, sections, loudness, beat grid, onsets against cuts, attack and peak per event
Score a filmcritique FILE23 metrics against 7 unnamed launch films, with timestamped fixes
Effects without recordingssfx render ID --dur --apex --pitch, kit init / render201 sounds stored as code; apex lands a whoosh's peak within 5 ms of the target; every render is audited (clicks, cut tails, ring, a re-rising "synth whip")

measure, sfx and kit load no models. Everything else loads two pinned models (~1.1 GB, CLAP and an AudioSet tagger) once per process, ~20–40 s, so use the MCP server or one script for more than a few calls.

Where this graph's values win

TopicearshotThis graphWhy
Master loudness~−14 LUFS; its 7 films median −14.8stated per register; medians −18.1 (Skale, 28) and −18.4 (acclaimed, 18)47 named films outweigh 7 unnamed, music-led ones (launch-video-sound)
Musicleads every filmone of five registers; a beat track only where its drop can be placedits 7 films are mostly register C
Source of soundreal recordings only; synthesis "reads cheap"derived from the motion; register B is synthesized (pov)its own forge made effects that one listener picked from real ones only 8 times in 15; build them to designed-sfx-anatomy instead
Sound before picture"lead by up to a frame" (a starting value)never lead; aim 0–30 ms late (sound-motion-sync)ITU-R BT.1359's asymmetry
Hits on cutsno better than chance in its 7 films6 of 18 acclaimed films cut at chance (launch-video-cuts)they agree: lock deliberately or not at all

Read realness as information when synthesis is the point: a clean designed chime reads "synthesized" and a resonator plus a room reads "real".

A worked build

MotionVideo's 29.5 s launch film (motionvideohq/motionvideo.xyz, MIT, launch-video/audio/sounddesign.json) is the whole loop in one file. A Mixkit track at 121 BPM is cut so its drop lands on the logo mark (frame 119), and the groove stops one beat early so the next downbeat lands on the lockup. The music rides −3 dB under screen recordings and −10 dB under typing. Each effect was forged and ranked with earshot: one click voice at one level, three key takes cycling with 1.5 dB jitter, the space bar −1.5 st, a whoosh aligned by peak, and one kalimba note on the track's tonic.

Gotcha

The launch scorecard describes the style of its 7 films. A dry reveal, a one-key bed or a quiet product-camera film will fail metrics that do not apply to it. Build a profile from the register's own films (earshot profile refs/ -o p.json) before trusting a "needs work".

Sources

  • Leon Lin, earshot (MIT, HEAD 925ebe5, 2026-10-18): README.md, docs/VALIDATION.md, docs/LIMITS.md, docs/launch-video-sound.md, docs/SFX.md, skills/earshot/SKILL.md. Models: CLAP laion/larger_clap_general (Apache-2.0), AST MIT/ast-finetuned-audioset-10-10-0.4593 (BSD-3-Clause).
  • Aniket Pawar, MotionVideo launch film (MIT, HEAD 9655183): launch-video/audio/sounddesign.json, CREDITS.md.
  • Related: skill-router, launch-film-analyst, sound-designer, sound-licensing.

soundcompanionearshotlaunch-videoreviewmeasurementsfx