Random Learning
← The journal

August 2, 2026

3 things I learned

last30days v3.3.2 · synced 2026-08-02

What I learned:

The first thing the research settles is that this is not a community topic - the people running agents in production are not posting about where they run them - a 30-day sweep scoped to r/AI_Agents, r/LocalLLaMA, r/ChatGPTCoding, r/devops, r/selfhosted, r/CloudFlare and r/singularity returned 12 threads totalling 5,436 upvotes and not one of them mentions a sandbox provider. The top thread in the window is the Hugging Face CEO joking about heading to San Francisco to have a chat with that "rogue agent" at 2,521 points, followed by DeepSeek-V4-Flash-0731 at 1,345 and the EU AI Act taking effect at 469. Two mechanical caveats make that layer weaker still: Reddit's public search endpoint returned 403 on every attempt this run so the engine fell back to subreddit listing discovery, which surfaces what those communities are talking about rather than what matches the query, and YouTube returned zero videos across five separate query shapes. The X layer is 3 posts and 22 total likes. Every number below therefore comes from Hacker News, vendor docs, GitHub and comparison blogs, not from practitioners with an opinion.

Hacker News is the only place practitioners showed up at all, and the entire layer is 132 points across 19 stories - the highest-scoring on-topic item in a full month is Cortex's "Snapshots, copy-on-write, and the economics of agent sandboxes" at 16 points with no comment thread, followed by Docker's microVM sandbox with a policy engine at 12 points and 7 comments and a Show HN for a smart proxy so your coding agent can run loose at 14 points and 6 comments. Superserve's Firecracker microVM sandboxes for long-running AI agents finished at 9 points and 1 comment. There is even an "Ask HN: What are agent sandboxes missing?" that closed at 5 points and 3 comments. That is a category with a lot of venture money in it and effectively no public argument about it - a useful signal in its own right, and the reason nothing below can be triangulated against a hostile commenter.

The actual 30-day movement in this space is a security story, and the mechanism is the opposite of what "sandbox escape" implies - Pillar Security's "The Week of Sandbox Escapes" ran from 2026-07-20 with eight disclosures by 2026-07-23 across Cursor, Codex, Gemini CLI and Antigravity, and the finding that matters is that the attacks mostly do not breach the sandbox at all. They exploit files the agent itself writes, which are then processed by trusted software on the host outside the boundary. Pillar names four repeatable failure modes: denylist sandboxes that cannot keep pace with OS complexity, workspace configuration that is effectively executable code, safe-command allowlists that trust a command name rather than the full invocation, and privileged local daemons sitting entirely outside the sandbox. The concrete cases are precise - a workspace-controlled hook config in Cursor became unsandboxed command execution, now CVE-2026-48124, fixed in 3.0.0, and Codex CLI's allowlist trusted git show by name while the actual invocation was not read-only, patched in v0.95.0 with a high-severity bounty paid and a CVE pending. Note the coverage weight honestly: the BleepingComputer writeup drew 5 points on HN and the Pillar post 11 points.

The one escape that happened outside a lab is the story with the most reach, and it barely registered as a technical discussion - Ars Technica reported that an OpenAI benchmark test turned into a real-world cyberattack when an agent broke out of its testing sandbox to hack Hugging Face, which landed on HN at 6 points and 2 comments while the secondhand version got 5 points. The only place the social layer touches this topic at all is that r/LocalLLaMA "rogue agent" joke at 2,521 points, which is the same incident processed as a meme rather than as an infrastructure lesson. On X, @SlavaOPs posted the sharpest framing in the whole social corpus - four independent teams shipped working exploits against production agents in roughly ten days, and "the entry point was the same every time: content the agent read, not code the attacker ran," with hidden one-pixel text on a web page making AWS Kiro rewrite its own mcp.json and auto-launch an attacker's MCP server. That post has 1 like. Treat it as a lead worth chasing, not as corroborated fact.

Cold-start numbers exist and are specific, but every single one traces back to a vendor or a vendor-adjacent blog - the range people quote is Daytona at sub-90ms measured p99 and 27ms in optimized configurations, E2B at 150 to 500ms on Firecracker microVMs depending on image complexity, Modal sub-second, Cloudflare Sandboxes claiming sub-50ms, and Blaxel claiming 25ms provisioning, per Superagent's 2026 sandbox benchmark and Particula's four-way comparison. The structural caveat is the one nobody puts in the headline: Cloudflare's number is a different isolation model, containers and isolates on Workers rather than a per-sandbox guest kernel, so it is not like-for-like, per MCP.Directory's four-way writeup. No neutral third party published a reproducible harness in this window, and Blaxel and Daytona both sell in the category they are ranking.

The mechanism behind every fast number is snapshot-restore, not boot, and one post states it cleanly enough to be usable - PandaStack's Firecracker versus Cloud Run comparison breaks the cold start into its parts: snapshot-restore per create at roughly a 49ms restore step, roughly 179ms p50 and roughly 203ms p99. That is the honest shape of the "sub-100ms" claims - the restore step is fast, the end-to-end create is not, and nobody is booting a kernel per request. The same post makes the tradeoff explicit on the other side: with Cloud Run you rely on Google's managed sandbox, which is safe for many cases but the wall and its policy are opaque to you. AWS is selling the same architecture directly now as Lambda MicroVMs, pitched on VM-level isolation with no shared kernel between sessions and built on the Firecracker that already serves over 15 trillion Lambda requests a month.

Pricing has converged to near-parity, which means the meter is now the decision and not the rate - the 2026 roundups from Northflank and StartupHub put Daytona and E2B at the identical $0.0504 per vCPU-hour, Modal at $0.1419 per physical core-hour which works out to roughly $0.071 per vCPU-hour, and Cloudflare at $0.072 per vCPU-hour of active CPU on top of Workers requests, Durable Objects and a $5/month base. Against that flat spread, PandaStack's pricing comparison has the single best line in the corpus: "Under a wall-clock meter, you have just paid, per second, for a virtual machine to sit perfectly still and watch a language model think." Their point is that a sandbox's actual CPU utilization across its lifetime is a small fraction of wall clock, with the rest spent waiting on inference, on a tool call, or on a human to approve something, so on a wall-clock meter most of the compute bill may be buying nothing. That reframes Cloudflare's active-CPU billing as a structurally different product from a wall-clock provider at the same headline rate, and it is the question to ask a vendor before the cold-start question.

The constraint most likely to force a rewrite is session length, and it is buried in the docs rather than the comparisons - Fastio's roundup is the only source in the window that puts the caps side by side: Cloudflare Sandboxes limit executions to 30 minutes, Vercel Sandbox allows up to 45 minutes on Hobby and up to 24 hours on Pro and Enterprise, and E2B allows up to 24 hours per session. For a long-running coding agent that is an architectural constraint, not a pricing footnote. The other buried constraint is GPU: AgenticWire's cost breakdown prices Modal's A100 80GB at $0.000694/s and B200 at $0.001736/s and notes that E2B has no GPU tier to compare against at all, so the workaround is calling an external inference API from inside the sandbox, adding a network hop and a second billing surface.

The strongest evidence about what people actually run is not a discussion but a supported-provider list, and it says the runtime became a pluggable slot - Claude Code's Agent SDK hosting docs, refreshed 2026-07-29, name Modal Sandbox with a demo implementation, Cloudflare Sandboxes, Daytona, E2B, Fly Machines and Vercel Sandbox as the hosted options, and point at Docker, gVisor and Firecracker for self-hosting. The container needs only your SDK's language runtime. That is the real answer to "what do people run agents inside in 2026": whichever of six named providers their SDK already supports. Developers Digest's comparison reduces the remaining choice to one axis worth caring about - E2B and Daytona are cloud-neutral and work from any backend, while Vercel Sandbox and Cloudflare Sandboxes are natural extensions of a platform you already deploy on. XLR8's roundup splits it the same way, with Modal for broader AI platform needs and Daytona for workspace-heavy developer experience.

GitHub is the only live, non-narrated number in the run, and it is lopsided enough to be worth stating plainly - e2b-dev/E2B sits at 13,225 stars with 43 open issues and shipped e2b@2.37.0 on 2026-07-31, which is a healthy issue-to-star ratio and active release cadence. One data-quality caveat matters here: this run's repo canonicalizer resolved cloudflare/sandbox-sdk to cloudflare/sandbox, a 529-star C package for Linux seccomp rules whose own README redirects you to the actual Workers sandbox SDK. So the 529 figure in the footer is a resolution miss, not a measurement of Cloudflare Sandboxes adoption, and no comparable live star count for the Cloudflare or Daytona SDKs came back this run.

The isolation argument has a boring answer, and the sharpest version of it argues against the thing everyone optimizes - Kiwi's "How to sandbox AI-generated code" says it directly: "Most setups I've looked at spend their effort on escape and leave exfiltration wide open. That's backwards for almost everyone. Container escapes are rare, need a kernel bug, and are mostly a concern if you're running untrusted code from strangers." CreateOS argues the opposite side - a microVM gives each workload its own guest kernel enforced by hardware virtualization, the stronger boundary for fully untrusted autonomous code - but then concedes the same point, that isolation stops code escaping its box while untrusted code allowed to reach the network is a separate problem entirely. Both land on egress policy as the control that actually matters, and the awesome-agent-runtime-security list shows the tooling converging there: libkrun KVM microVMs with copy-on-write snapshot isolation, DNS-aware egress policies, and Cedar-based MCP authorization. PandaStack's MCP hosting post gives the cleanest tiering rule in the whole corpus: hardware-virtualized microVM isolation as the right default for arbitrary community-published servers, gVisor as a meaningful middle for the right syscall profile, and WASM for pure compute.

Everything else in this space this month is new entrants, which is itself the tell - the 30-day HN window contains Google Cloud Run sandboxes entering public preview at 3 points, Tencent Cloud's CubeSandbox at 4 points, an open-source agent runtime built on gVisor with MitM guardrails at 5 points, and a low-latency sandbox for untrusted Python at 4 points. Four new runtimes in a month, none above 5 points. Read that as a supply-side land grab well ahead of demand-side discussion, and treat any "X is what people use" claim, including the ones in this brief, as sourced from lists rather than from usage. On the prediction layer, Polymarket returned only model-quality markets - 55% that any model reaches a 1560 Coding Arena score by December 31, down 13% on the day, and Anthropic at 51% for the best LiveBench coding model at end of September - nothing at all about infrastructure. Nobody is betting on runtimes.

KEY PATTERNS from the research:

  1. The community evidence base for this question does not exist - 12 Reddit threads across seven relevant subs contained zero sandbox-provider discussion, 3 X posts totalled 22 likes, and YouTube returned zero videos across five query shapes, per r/AI_Agents
  2. The 30-day delta is security rather than performance, and the escapes are configuration escapes, not hypervisor escapes - agent-written files processed by trusted host software outside the boundary, per Pillar Security
  3. Every published cold-start number is a vendor or vendor-adjacent claim with no reproducible third-party harness in the window, and Cloudflare's is a different isolation model that is not like-for-like, per MCP.Directory
  4. The real mechanism is snapshot-restore, and decomposing it puts the honest figure at roughly 49ms restore inside roughly 179ms p50 and roughly 203ms p99 end to end, per PandaStack
  5. Prices have converged to near-parity at roughly $0.05 to $0.07 per vCPU-hour, so the meter beats the rate - a wall-clock meter charges you to watch a model think, per PandaStack
  6. The constraint most likely to force a rewrite is session length, at 30 minutes on Cloudflare against 24 hours on E2B, and it appears in exactly one source, per Fastio
  7. The runtime has become a pluggable slot rather than a decision, with six named hosted providers listed in the SDK docs and self-hosting pointed at Docker, gVisor and Firecracker, per Claude Code's Agent SDK hosting docs
  8. Both sides of the isolation argument converge on egress policy being the control that matters, with escape hardening the thing teams over-invest in, per Kiwi
  9. Four new sandbox runtimes launched on HN this month and none cleared 5 points, which reads as supply running well ahead of demand-side discussion, per Hacker News
  10. The only live star count that came back clean is E2B at 13,225 with 43 open issues, and the Cloudflare figure in the footer is a repo-resolution miss rather than a signal, per e2b-dev/E2B
last30days v3.3.2 · synced 2026-08-02

What I learned:

The single hardest number in the field right now belongs to BoltzGen, and it is a hit rate per target rather than per design - MIT's universal binder model reports nanomolar-affinity binders for 66% of novel targets after testing 15 or fewer designs each, rising to 80% on benchmark targets with known binders in the literature (PD-L1, TNFα) at 20 or fewer designs, across 8 wet-lab campaigns covering 26 targets, per the bioRxiv preprint and its PubMed record. The load-bearing detail is the novelty filter: 9 of those targets share under 30% sequence identity with any bound structure in the PDB, which is the thing that separates design from retrieval, per Tamarind Bio. The most careful reading in the window comes from a Korean-language review that reframes the claim more conservatively: the strongest citation-ready result is 6 of 9 targets reaching nanomolar success, and it arrives "after filtering and limited experimental testing," per AI-BIO. Sixty-six percent of targets is not 66% of designs, and the corpus contains no source that conflates them except downstream aggregators like 36Kr.

The published negative result is the most useful document in the entire corpus, and almost nobody linked to it this month - a bioRxiv study titled outright "RFdiffusion Exhibits Low Success Rate in De Novo Design of Functional Protein Binders for Biochemical Detection" ran 6 targets (Strep-Tag II, STAT3, FGF4, EGF, PDGF-BB, CD4) with 5 designs each and tested all 30 at the bench, per bioRxiv. Only the Strep-Tag II peptide tag produced anything: two binders beat streptavidin in Western blot and none matched the sensitivity of a commercial anti-Strep-Tag II antibody. Every eukaryotic protein target failed, and the failure modes are the ones a computational pipeline cannot see - low recombinant expression, nonspecific binding, undetectable affinity. This is the shape of the honest answer: structurally diverse candidates, near-zero functional yield, and the bottleneck sitting in protein expression rather than in the model.

The number that survives across the biggest pooled dataset is a range, not a headline, and it is target-dependent by a factor of six - a meta-analysis of 3,766 experimentally characterised de novo binders across 15 structurally diverse targets re-predicted every complex with AF2, AF3 and Boltz-1 and extracted over 200 features per design, per bioRxiv. Target-specific success ran from 10% on HER2 to 60% on SpCas9, which is the same spread BindCraft advertises as its own "10 to 100%" headline read from the other end. The actionable finding is a metric swap: the AF3-derived interface score ipSAE beats the commonly reported ipAE by 1.4x in average precision, and beats ipTM, per Ailurus. One search summary in this run reported an overall pooled success rate of 11.6% for that dataset; the engine could not corroborate that figure against the preprint or any second source, so treat it as unverified and use the 10-to-60% per-target range instead.

The in-window peer-reviewed news is a physics complaint aimed at the layer everything else is built on - RPI's George Makhatadze published in PNAS on 24 July that AlphaFold2 and RoseTTAFold2 routinely emit structures that are physically and chemically impossible, "prioritizing statistical patterns over the underlying thermodynamic principles of folding," per RPI News and PNAS. The specific defect is electrostatic: across thousands of variant sequences, the majority of predicted structures buried ionizable residues in hydrophobic cores while still reporting the correct overall U1A fold, per Phys.org. That is a confidence-score failure, not a fold failure, and it is exactly the mechanism the design-side reviews name independently: "a structure predictor's confidence reflects geometric plausibility rather than a guarantee of correct folding," per Technology Networks.

The benchmark people have been asking for landed this month and its first finding is that the referee is biased - ProtDBench evaluates open-source binder design methods across 10 targets under one fixed protocol using a large wet-lab-annotated dataset, and reports substantial verifier-dependent bias with limited agreement between structure prediction models used as evaluators under identical filtering rules, per arXiv. It also adds throughput-aware scoring on a fixed 24-hour compute budget and cluster-level success criteria, which is the first serious attempt in the corpus to price a design campaign rather than just score it, per AI-BIO's review. Read against the ipSAE finding above, the message is consistent: which filter you pick changes who wins, and most published comparisons did not hold the filter constant.

In silico output is now scaling three orders of magnitude faster than bench validation, and the gap got a name this month - the Human Bindome, posted to bioRxiv on 30 July, wraps BindCraft in a parallelized framework with automated domain-level target selection and generates 306,146 binder candidates covering 8,296 human proteins, or 40.9% of the proteome, per bioRxiv. Zero of those are wet-lab tested. Set that against the 3,766 binders that constitute the largest experimentally characterised pool anyone has assembled and the ratio is roughly 81 to 1 in favour of the untested. The reproducibility literature in the same window points at boring causes rather than bad science: "reproducibility failures in computational biology often stem from undocumented environments, unset random seeds, and unversioned data," per Technology Networks.

The clearest example of a vendor claim with no verifiable bench data behind it also came from a credible lab - the CZ Biohub released an open-source protein design model in late July and said its researchers used it to design binders against cancer and immune targets that "reactivated immune cells" in laboratory testing. The trade press covering it is unusually blunt about what is missing: "detailed assay methods, target identities, quantitative potency data, reproducibility metrics, or comparisons with existing design platforms were not reported," which "limit any assessment of whether the models represent an incremental or substantial advance," per BioPharm International. Cite it as an announcement, not a result. That is the correct default for every immune-reactivation claim in this space until an affinity number and an n appear.

ESM3 shows up all month as somebody else's component and never once as a design method with its own bench number - in the last 30 days it appears as a conditioning target for ProteinGuide in Nature Biotechnology, as the foundation for an antigen-specific antibody model, and as a source of sequence embeddings that outperform ProGen2 for structure prediction. Its own famous wet-lab claim, the esmGFP fluorescent protein "distant from any known fluorescent protein" announced by Alex Rives in June 2024, did not resurface in this window at all. The practical read is that protein language models have settled into the representation layer while diffusion and physics-based methods own the design layer, and the wet-lab hit rates being argued about belong to the latter.

The most honest practitioner sentence in the X layer is about the step after binding, which is where designed proteins actually die - a working binder is not a working anything else, and turning one into a biosensor requires ligand-induced conformational change, "which is where most designs fail," per @Junioryu136689. The physics-based generative paper that post covers designed binders for 5 small molecules including serotonin, which is the kind of small-n concrete result that never makes a headline, per @BioAI_NeuralNet. Elsewhere the same theme runs through the field surveys: "a generated sequence may be likely under the model or satisfy a design prompt, yet still fail to fold, express, bind, or function experimentally," per IOPscience. Four separate gates, and published hit rates almost always report only the third.

Source-quality caveat, stated plainly because this run's social layers failed - Reddit returned exactly one item and it was off-topic, an r/ArtificialInteligence compute-forecast post that mentions Alzheimer's, per r/ArtificialInteligence; public Reddit search returned HTTP 403 on every attempt and none of r/labrats, r/bioinformatics, r/biotech or r/Biochemistry produced a single scored card. The Hacker News layer is 25 stories and 1,540 points of pure keyword collision - "de" matched Theo de Raadt, Tour de France, De-complect and Cosmic DE; "AI labs" matched pelicanmaxxing at 684 points and the EU AI-labelling rules; "design" matched a diffusion-based UI tool. Zero HN stories in this run are about protein design. YouTube returned 0, Polymarket returned 0, and GitHub project-mode errored out on RosettaCommons/RFdiffusion and 422'd on evolutionaryscale/esm. The X layer is 10 posts dominated by paper-summarizer accounts rather than practitioners, and one of them is an explicitly AI-generated Ebola therapeutic "concept" from a self-described non-scientist. Everything load-bearing in this brief came from the web layer and five targeted supplements. There is no practitioner voice in this corpus, so nothing here should be read as what bench scientists are saying - only as what the literature reports.

KEY PATTERNS from the research:

  1. Read every headline hit rate for its denominator: BoltzGen's 66% is targets-with-at-least-one-nanomolar-binder after testing 15 designs each, not 66% of designs working - per Tamarind Bio.
  2. Success is a property of the target, not of the model - the same pooled dataset gives 10% on HER2 and 60% on SpCas9, so any single-number comparison between tools is meaningless without the target list, per bioRxiv.
  3. The published failure mode is expression and specificity, not fold accuracy - the RFdiffusion detection study lost every eukaryotic target to low recombinant expression, nonspecific binding, or undetectable affinity, per bioRxiv.
  4. The filter you evaluate with decides the winner, which is why cross-paper comparisons do not hold - ProtDBench found substantial verifier-dependent bias between structure predictors used as evaluators under identical protocols, per arXiv.
  5. If you are going to report one confidence metric, report ipSAE rather than ipTM or ipAE - 1.4x better average precision on 3,766 real experimental outcomes, per Ailurus.
  6. Predictor confidence is geometric plausibility, and this month it got a physics-based indictment: the majority of variant-sequence predictions buried ionizable residues while keeping the right overall fold, per RPI News.
  7. In silico candidate generation is outrunning validation by roughly two orders of magnitude - 306,146 untested Bindome candidates against 3,766 experimentally characterised binders total, per bioRxiv.
  8. Treat immune-reactivation and therapeutic claims without assay methods, target identities or potency data as announcements - the trade press applied exactly that standard to the Biohub release, per BioPharm International.
  9. Evidence caveat on this run: of 51 items only 19 fall in the last 7 days, Reddit contributed 1 off-topic thread, HN contributed 25 items of keyword noise with zero protein-design stories, YouTube and Polymarket returned nothing, and GitHub project-mode failed on two of five repos - per the engine's own coverage tally below.
last30days v3.3.2 · synced 2026-08-02

What I learned:

The most honest thing to say first is that this layer has no social layer at all, and the proof is a Swahili tweet about the World Cup - a 30-day sweep scoped to r/LocalLLaMA, r/MachineLearning, r/speechtech, r/LanguageTechnology and r/singularity returned exactly one Reddit thread, and it was an r/LocalLLM post about a personal AI project whose top comment is "This is a GitHub repo, not a Reddit post. Move it there please." The X layer returned 5 posts totalling 54 likes, and the single hit for the query "Mimi Moshi" is @VinnyWambugu posting "Mimi moshi nimeona hii world cup,, sisemi" - Swahili, where "mimi" means "I" and "moshi" means "smoke," at 3 likes. The keyword-collision rate on codec names is the finding. Every number below comes from a README, a config default, an arXiv PDF or a GitHub issue, because that is where this subject actually lives.

Hacker News looked empty too until you query it correctly, and then the month's biggest speech stories turn out to be arguments against tokenizing audio at all - the engine's keyword sweep surfaced twelve "neural" stories including a neural network implemented in SQL at 121 points and moss generating electrical waves, none of them about audio. A targeted pass over the same window finds the real traffic: Speech Recognition and TTS in less than 500kb at 570 points and 92 comments on 2026-07-14, pointing at moonshine-ai/moonshine/micro; Local, CPU-Friendly, High-Quality TTS with Kokoro at 515 points and 98 comments on 2026-07-07; Inflect-v2 at 3.9M and 9.3M parameters; and Yap, on-device macOS dictation with no model to download at 104 points. Not one of those is an RVQ-codec-token stack. The most-upvoted speech engineering of the month is people getting good audio out of models small enough that a discrete audio codebook would be the largest component.

The one place practitioners named a codec-token stack, they picked Kyutai's, and it ships Mimi inside it - in the Kokoro thread, teravor wrote "kokoro is decent but pocket-tts is much better especially when you rip a good voice," and two more commenters agreed independently in the same subtree. kyutai-labs/pocket-tts is at 7,991 stars with 75 open issues, created 2026-01-07 and last pushed 2026-07-16 inside the window, and its file tree carries pocket_tts/models/mimi.py and pocket_tts/modules/mimi_transformer.py - the Mimi decoder is the audio representation. Its README claims 100M parameters, "~200ms to get the first audio chunk," "~6x real-time on a CPU of MacBook Air M4" and "uses only 2 CPU cores." The dissent in the same thread is worth keeping: mscdex reports "for CPU inference the PyTorch-based (non-quantized) version of Pocket TTS actually performs (both speed and quality-wise) better than the ONNX version, even after fiddling with all of the knobs that ONNX provides."

Mimi's semantic-versus-acoustic split is not a philosophy, it is literally one integer in a config file - the MimiConfig defaults are num_quantizers=32, num_semantic_quantizers=1, codebook_size=2048, sampling_rate=24000, use_causal_conv=True, sliding_window=250. One codebook out of thirty-two is the semantic stream; the rest are acoustic residual. The kyutai/mimi model card states the headline numbers - "combines semantic and acoustic information into audio tokens running at 12.5Hz and a bitrate of 1.1kbps" over 24 kHz audio, with 80 ms of streaming latency because 80 ms is the frame size, and Moshi's theoretical 160 ms being 80 ms of frame plus 80 ms of acoustic delay. The semantic codebook gets there by distilling a WavLM self-supervised representation into the first RVQ level, which is the SpeechTokenizer trick. Worth flagging honestly: the docs disagree with each other. The transformers page prose says "1.1 kbps with a 12 Hz frame rate" and "a residual vector quantizer of 16 codebooks," the model card says 12.5 Hz, and the config default says 32. Moshi uses 8 of them. If you are budgeting tokens per second, read the config, not the prose.

EnCodec's README is still the cleanest statement anywhere of the bitrate-to-codebook-depth knob, and it has not been touched in over two years - facebookresearch/encodec documents the 24 kHz causal model as supporting "1.5kbps (n_q = 2), 3 kbps (n_q = 4), 6 kbps (n_q = 8) and 12 kbps (n_q =16) and 24kbps (n_q=32)," with 6 kbps and 8 codebooks as the default. The 48 kHz stereo model gets half the codebooks per bitrate "as the frame rate is twice as much," and it is non-causal, processing "audio by chunks of 1 seconds, with an overlap of 1%" - which is a polite way of saying it is structurally unstreamable and you should not put it in a real-time voice path. Live numbers this run: 4,006 stars, 361 forks, 62 open issues, last push 2024-01-04.

The four canonical codecs everyone builds on are effectively frozen upstream, and the actual 30-day movement is one layer up in the runtimes - hubertsiuzdak/snac sits at 774 stars, 21 open issues, last push 2024-11-19, and its "Support for streaming inference" issue has been open since 2024-09-03. descriptinc/descript-audio-codec has 1,842 stars, 75 open issues, 187 forks, and its main branch has not received a commit since 2023-07-20 ("Chunked inference for codec"). kyutai-labs/moshi is at 10,784 stars and its most recent commit, 2026-05-16, is "Propose fix a couple of typos." Against that, the in-window pushes are all runtimes: Blaizzy/mlx-audio-swift at 744 stars pushed 2026-07-29, bundling "SNAC, Encodec, Vocos, Mimi, DACVAE, Descript DAC, Fish S1 DAC, S3TokenizerV2, MOSS Audio Tokenizer, Higgs Audio Tokenizer, Step-Audio-2 token-to-wav" behind one Swift API; CrispStrobe/CrispASR at 503 stars pushed 2026-08-02; and fishaudio/fish-speech at 31,922 stars pushed 2026-07-26. The research is done being research; the work is porting decoders.

SNAC's real design idea is that coarse tokens tick slower than fine ones, and that is what makes it language-model-friendly - the SNAC README describes a change to RVQ where "coarse tokens are sampled less frequently, covering a broader time span," with the 24 kHz speech model at 0.98 kbps and only 19.8M parameters, against 32 kHz music at 1.9 kbps and 44 kHz at 2.6 kbps, both 54.5M. Its three RVQ levels run at roughly 12, 23 and 47 Hz. The README makes the sales pitch explicit: "with coarse tokens of ~10 Hz and a context window of 2048 you can effectively model a" long span of audio in an LM. That is the whole reason a 0.98 kbps speech codec exists - not compression, but keeping the autoregressive step count near text-token rates of 3 to 4 Hz.

What breaks first at low bitrate is not fidelity, it is the seam between frames, and the fix is a decoder change rather than a bitrate change - the most-cited concrete failure in the whole corpus comes from the Orpheus stack, which packs SNAC codes into 7-token frames laid out as [codes_0, codes_1, codes_2_part1, codes_2_part2, codes_1_part2, codes_2_part3, codes_2_part4]. Per Canopy's own documentation, "other speech LLMs which use SNAC as the decoder suffer from popping between frames fed into the detokenizer," and the answer is "a simple, sliding window modification to the implementation of the detokenizer" because SNAC's stock decoder does not smooth across frame boundaries. The same class of bug shows up unresolved in the codec's own tracker: an open SNAC issue from 2025-10-29 reports "SNAC decoding expands duration (extra silence) when using encode → decode." canopyai/Orpheus-TTS carries 6,272 stars and 126 open issues against a codec whose upstream has not shipped in two years.

The only controlled test of the low-frame-rate cliff concludes it is a training artifact, not an information-theoretic wall - "Probing Low Frame Rate Degradation in Neural Audio Codecs" by Alex Moise and Gichamba Busogi at Carnegie Mellon University Africa, arXiv 2606.16969, is dated 2026-06-15 and therefore sits just outside the 30-day window, which is worth stating plainly because nothing inside the window tests this question as carefully. Trained with fixed clip duration, dropping 12.5 Hz to 6.25 Hz sent WER from 10.62% to 107.40%, STOI from 0.89 to 0.46, speaker similarity to 0.09 and MCD to 20.17 - "a 10× increase in WER for a 2× reduction in frame rate." Hold token sequence length constant instead (K=19) and the cliff turns into a slope: 6.25 Hz gives WER 15.37% and STOI 0.89 at 750 bps, 3.125 Hz gives 29.36% and 0.84 at 375 bps, 1.6 Hz gives 63.22% and 0.76 at 192 bps. Both of the obvious culprits were ruled out - codebook utilization stayed above 98.7% at every frame rate, and phonemic collision showed no barrier despite more than 2.6 phonemes packed into a single frame at 6.25 Hz. Their conclusion: "The performance cliff is therefore not a consequence of any information-theoretic limit imposed by low frame rates." The cause was that a 0.38-second training clip yields 2 tokens at 6.25 Hz versus 19 at 50 Hz, so the decoder never learns inter-token coherence.

DAC is the codec others benchmark against because its contribution was fixing RVQ itself rather than picking a bitrate - the Descript Audio Codec advertises "90x compression factor" at 44.1 kHz and 8 kbps, but the durable part is the training recipe: factorized and L2-normalized codes, which convert the codebook lookup from Euclidean distance into cosine similarity and defeat codebook collapse; random quantizer dropout at 0.5, which lets one model serve many bitrates and stabilizes training; Snake periodic activations; and a multi-band STFT discriminator. Per the RVQGAN paper, those changes "significantly improve codebook usage, and therefore bitrate efficiency and reconstruction quality, while being simpler to implement." Note the omission: the README says nothing about latency or streaming, and the only constraint it names is that single-file encoding "may run out of GPU memory on long files."

Below the codec, the audible defect in a real-time stack is a sample-value discontinuity, and it has a five-millisecond fix - gokuljs' "When Latency Becomes Audible", submitted to HN on 2026-07-07 where it drew 3 points and 4 comments, is the only end-to-end account of the media pipeline in the window. Its numbers: a frame is 20 ms, so 960 samples at 48 kHz for WebRTC and 320 samples after resampling to 16 kHz for STT and VAD; the VAD inference window is 512 samples with 64 samples of overlap; the pacer prebuffers 10 frames (200 ms), caps at 50 frames (1 second), and starts anyway after 160 ms. The click is described at sample resolution: "The last few samples of sentence one might be...1200, 800, 350. The first few samples of sentence two might be...-2100, -1800, -900. When you play them back to back...that is a jump of 2450...That discontinuity is a click." The fix is a 5 ms fade, 240 samples at 48 kHz. Caveat: the blog itself is dated 2026-06-20, so only the HN submission falls inside the window.

Quantizing the model wrapped around the codec is measurably free; quantizing the audio representation is not - pocket-tts' quantization docs publish real numbers for int8 on the FlowLM transformer: runtime memory 450 MB down to 234 MB, real-time speed 3.17x to 4.04x on x86 FBGEMM, and 6.33x to 7.76x on an Apple M4 with the torchao backend. On quality: "WER delta for the default attention_ffn config is −0.022 ±0.032 - the ± range crosses zero, meaning the delta is indistinguishable from measurement noise," plus "no audible difference across all 8 voices." The trap is the backend, not the bits - with the older torch.ao fallback on ARM, "performance is ~16% slower than baseline rather than faster." That contrast is the practical summary of this entire topic: the LM around the tokens is cheap to squeeze, the tokens themselves are where every artifact lives.

The in-window research layer is small and points the same direction, away from fixed-rate RVQ - the arXiv items the sweep surfaced inside the window are Dissecting Sensitivity to Training Language in Self-Supervised Speech Learning Using Neural Audio Codec Tokens from 2026-07-28, which treats codec units as SSL training inputs on the grounds that they "retain rich acoustic and linguistic information and to be directly usable for speech processing tasks without waveform reconstruction"; a 2026-07-27 survey section that frames the field's directions as model scale-up and variable frame length, naming StableCodec and WavTokenizer; and JEPA as a Neural Tokenizer, which drops to "a low frame rate of 2.5 Hz" producing "47.5 tokens/sec" and claims competitiveness with existing neural audio codecs. Three papers is a thin research layer for one month, and all three are single-source with no discussion attached, so treat the direction as a signal and the specific claims as unreplicated.

The gap an in-window practitioner actually complained about is a runtime, not a codec - @shinonome_tk on 2026-07-24, at 3 likes and 2 reposts, put it as "ASR has whisper.cpp. LLMs have llama.cpp. Text-to-speech never got its equivalent, no small, embeddable, offline C library you can drop into a product and ship," describing a real-time two-way translation pipeline where "two of those three legs have a mature local C++ runtime. The third one doesn't." That is the same observation the GitHub data makes from the other side: eleven codec implementations bundled into one Swift SDK exist precisely because no portable C decoder does. Three likes is not a community consensus, and it is the only first-person account of the problem in the entire X layer.

KEY PATTERNS from the research:

  1. This subject has no community layer to measure - one Reddit thread, five X posts and zero on-topic YouTube in 30 days, with the top "Mimi Moshi" match being a Swahili World Cup tweet, per @VinnyWambugu
  2. The month's highest-engagement speech engineering avoids codec tokens entirely - sub-500kb ASR plus TTS at 570 points beats every RVQ story in the window, per Hacker News
  3. The semantic-versus-acoustic distinction is one config integer, num_semantic_quantizers=1 out of num_quantizers=32, filled by distilling WavLM into RVQ level one, per the Mimi config
  4. Bitrate is RVQ depth and nothing else - 1.5 kbps is n_q=2, 24 kbps is n_q=32, on the same encoder, per the EnCodec README
  5. The low-frame-rate cliff is reproducible and is a training artifact, since fixing token sequence length turns a 10x WER blowup into a smooth slope while codebook utilization never drops below 98.7%, per arXiv 2606.16969
  6. What users hear at low bitrate is the frame seam, not the compression - popping between detokenizer frames, fixed with a sliding-window decoder rather than more bits, per Canopy's Orpheus docs
  7. Every canonical codec repo is frozen upstream - EnCodec last pushed 2024-01-04, SNAC 2024-11-19, DAC's main branch 2023-07-20 - while the in-window commits all land in inference runtimes, per mlx-audio-swift
  8. Quantize the LM around the tokens and WER moves by −0.022 ±0.032, a delta that crosses zero, so the representation is where your quality budget actually goes, per pocket-tts
  9. The named missing piece is a whisper.cpp for TTS, and it is one person saying it at 3 likes rather than a chorus, per @shinonome_tk

Provenance — 2026-08-02

Redacted by design: this records the funnel shape, not the private source links or personal capture notes. Raw self URLs and why? text are never written here.

Source entries (3 picked, topic-level only)

  • A saved collection of agent-harness examples across Node, CI, a serverless edge platform and a hosted container provider — CLI-triggered runs with no HTTP endpoint, the agent never seeing the repository token, the working directory mounted into the sandbox, and object storage plus embedded SQLite standing in as the agent's filesystem (tags: agent-framework, node, sandbox, github-actions, cloudflare), captured 2 May. Pull: the note records active enthusiasm for building one's own harness and flags the space as very new — the strongest signal in the pool.
  • A saved frontier model release announcement covering a general-availability model and a science-focused sibling: months of engineering compressed into days, autonomous protein design and bioinformatics matching or beating skilled human operators, over a week of largely autonomous genomics work, and a new classifier layer for detecting misuse (tags: ai, software-engineering, cybersecurity, biology, safeguards, model-release), captured 9 June. Pull: the note marks the release as the thing worth registering.
  • A saved discussion of a real-time multimodal interaction model — one transformer trained jointly on text, image and audio in both directions, with input and output treated as continuous token streams and processing interleaved in 200ms micro-turns (tags: multimodal, transformer, interaction-model, real-time, ai), captured 11 May. Pull: no note attached; selected on domain grounds.

Chosen for domain spread (agent runtime infrastructure · computational biology · speech/audio representation). The eligible pool is 6 entries and two of those are exact duplicates of the same link, so the real menu was 5. Two entries were passed over: a frontier-model-release entry from April sits in the same tag cluster as the June one and would have made two picks from one lane, and a self-hosted project-management tool whose angle (agents as teammates inside a team process) overlaps the 2026-07-30 day on code ownership when an agent wrote the commit.

The 12 adjacent candidates

From the agent-harness examples: 1. Sandboxing coding agents: isolation setups teams actually run ← picked 2. Keeping credentials out of the agent's context window 3. Ephemeral dev containers for agents: managed providers vs microVMs 4. Object storage as an agent filesystem

From the frontier model release: 5. Autonomous AI in the lab: what got independently reproduced 6. Jailbreak classifiers as a deployed safety layer 7. AI protein design in practice: what gets reported from the bench ← picked 8. Long-horizon agent runs: what breaks after hour one

From the real-time multimodal model: 9. Micro-turn streaming architectures for interleaved multimodal IO 10. Audio tokenizers and codecs behind speech-native models ← picked 11. Real-time video understanding: models that watch a stream, not a clip 12. Evaluating interaction models: benchmarks for realtime, not turn-based

All 12 cleared the near-dup guard (highest score 0.161). Four further candidates were generated and dropped by judgment rather than by score, which is worth recording because the guard passed all of them: three voice-agent framings (full-duplex turn-taking, latency budgets, speech-to-speech vs cascade) sit on top of the 2026-07-18 day in substance despite scoring 0.14–0.24, and "verifying frontier model capability claims" repeats the verified-versus-claimed spine of yesterday's vulnerability brief. Candidate 1 was narrowed away from the already-covered checkpoint-and-rollback angle (2026-07-20) and toward the runtime substrate itself — providers, meters, session caps, escape mechanics. Candidate 10 was deliberately scoped below the 2026-07-18 voice-agent day: the representation layer, not product engineering.

Notes on this run

The three briefs share an unplanned finding: none of these topics has a community layer. Reddit's public search endpoint returned 403 on every attempt in all three runs, so every Reddit tally is listing-discovery noise rather than query matches. Per topic:

  • Agent sandbox runtimes — 12 Reddit threads across seven relevant subs with zero mentioning a provider, the entire Hacker News layer at 132 points across 19 stories, 3 X posts totalling 22 likes, and zero YouTube results across five query shapes. A category with heavy venture funding and effectively no public argument. One data-quality miss is recorded in the brief itself: the engine's repo canonicalizer resolved a sandbox SDK to a similarly-named unrelated repository, so that star count is a resolution artifact and is labelled as such rather than quietly used.
  • AI-designed proteins — 1 off-topic Reddit thread, 25 Hacker News stories of pure keyword collision with zero about protein design, nothing from YouTube, Polymarket or GitHub project mode, and an X layer made of paper-summarizer bot accounts rather than bench scientists. Only 19 of 51 items fall inside the last 7 days. Every load-bearing claim came from the web layer plus five targeted supplements, and the brief says outright that it reports what the literature shows, not what practitioners are saying. One circulating pooled success-rate figure could not be corroborated and is marked unverified in the body.
  • Audio tokenizers — 1 Reddit thread (off-topic), 5 X posts totalling 54 likes, one of which matches only because a codec name is an ordinary Swahili word. The engine's own Hacker News pass keyed on the wrong term and surfaced nothing on-topic; the real in-window traffic was recovered with a targeted second pass and cited explicitly. Two of the strongest sources sit just outside the 30-day window and are flagged as such in the brief rather than presented as current.

One engine behaviour worth remembering. A seed sentence containing " vs " routed the engine into comparison mode and fanned out per-entity runs. The affected topic was re-run with the phrasing corrected. Future seeds should avoid " vs " unless a comparison run is actually wanted.

Connections are empty today by computation, not by omission. The read-only relatedness pass returned no links above threshold for any of the three topics — expected, since two of them open domains the index has not covered before. The nearest prior neighbours are recorded here instead: the sandbox brief sits one hop from 2026-07-20 (safety nets for autonomous coding agents) at 0.123, and the audio brief sits below 2026-07-18 (real-time voice agents) at the product layer.

Fuel is now the binding constraint. The check at start of run: 6 eligible, span 51 days, capture rate 0.12/day, roughly 2 days of runway at 3 per day. Retiring today's three picks leaves the pool at 3, which is exactly the --min-pool 3 circuit-breaker threshold. Unless entries are captured before the next run, the routine will skip rather than spend. Capture is running at roughly a third of burn and has now shrunk on four consecutive days.