Random Learning
← The journal

July 21, 2026

3 things I learned

last30days v3.3.2 · synced 2026-07-21

What I learned:

The demo everyone is actually talking about is a lipogram - the self-fine-tuning claim landed because Thinking Machines Lab shipped a concrete proof-of-concept in the announcement: they asked Inkling to fine-tune itself toward a target behavior that prompting cannot reliably hit - a model that never uses the letter "e" - and it drafted the plan, generated the eval and synthetic training data, ran the job on Tinker, scored the new weights against the base, and hot-swapped the checkpoint. As Prompt Engineer put it in a video literally titled "They Released a 975B Model - Then It Fine-Tuned Itself in 27 Minutes," the loop is buried under a line most labs would never ship: "Inkling is not the strongest overall model available today, open or closed." The interest is the mechanism, not the score.

The verdict is "meaningful capability, not universal breakthrough" - the consensus across coverage reads self-fine-tuning as a real demonstration scoped to enterprise customization rather than the start of runaway self-improvement. The AI Governance Institute frames it as a genuine shift "from a world where human engineers manually monitor loss curves to one where a model can be deployed and evolve its own weights to meet local requirements," but immediately caveats that the whole bet - that post-training lift closes the benchmark gap - can only be tested on an organization's own data. Nobody in the corpus called it AGI-adjacent; the framing is autonomous MLOps, not autonomous intelligence.

Practitioners are cautiously positive but unimpressed by raw capability - independent developer Simon Willison, testing via the Tinker API, called Inkling a viable US open-weights contender to sit alongside NVIDIA Nemotron and Gemma 4 with "a lot to like," while agreeing it is a customization base, not a frontier chatbot. Hands-on YouTube reviewers were blunter: Julian Goldie SEO ran it through his standard tests and reported "it's scoring at six on average out of 10, which means kind of mediocre from what we've tested it so far," ranking it "14 in total out of about 30 different models." The self-tuning trick impresses; the base model does not.

The loudest story is geopolitical, not technical - on r/LocalLLaMA (1,298 upvotes, 270 comments) and Hacker News, the excitement was less about self-tuning and more about who shipped it: the first competitive non-Chinese open-weights release in a while, Apache 2.0, from ex-OpenAI CTO Mira Murati. @BareStack captured the framing: "The ex-OpenAI CTO is building in the open what her old lab ships behind a paywall." Shared Sapience put it as "the frontier stopped being something anyone could own," and one HN thread noted Chinese open models pull 41% of measured Hugging Face downloads - the subtext of the whole launch.

The skeptics went after the business model, not the demo - the sharpest Hacker News skepticism (1,200+ points) was "how does a company that gives its model away survive?" - with the answer landing on Tinker, the hosted fine-tuning business, and a worry that "Models are so expensive to train, you can't be losing the big clients once they get super profitable." The other recurring critique was benchmark hygiene: SWE-bench and Terminal Bench numbers depend on harness choice, and TM uses different harnesses per suite, so the comparison is not apples-to-apples. Notably, few called the self-fine-tuning itself a fake - the doubt is whether owning a specialized model beats a generic frontier one, not whether the loop runs.

KEY PATTERNS from the research: 1. The self-fine-tuning loop is read as autonomous MLOps, not self-improving intelligence - concrete (the lipogram demo), scoped to customization, not open-ended - per Thinking Machines Lab 2. "Not the strongest model" is doing the persuasion - shipping a demo alongside an honest weakness admission is what made it credible rather than hype - per Prompt Engineer 3. Base-model reactions are lukewarm ("6/10, mediocre," "14th of 30") - the trick impresses more than the raw capability - per Julian Goldie SEO 4. The dominant narrative is "American open weights are back," Murati vs her old lab, not the technical mechanism - per @BareStack and r/LocalLLaMA 5. Skepticism targets the give-it-away business model and harness-dependent benchmarks, not the legitimacy of the self-tuning demo itself - per Hacker News

last30days v3.3.2 · synced 2026-07-21

What I learned:

Nvidia still owns roughly three-quarters of the market, and the moat everyone cites is CUDA, not the silicon - the consensus in the last 30 days is that Nvidia's edge is a decade of software habit, not a spec-sheet lead. One widely-shared stat line put it bluntly: "CUDA remains the moat. More than 5 million developers build on it, which keeps training workloads locked to NVIDIA hardware even where AMD matches raw FP8 throughput," per commandlinux.com. Another framing that circulated: "Nvidia's real moat is CUDA, not silicon - a decade of libraries, kernels, and developer habit," per teahose.com. The read is that any challenger's spec sheet should be discounted by the maturity of its compiler stack.

AMD's real story this month was Helios, its first rack-scale system pitched directly against Nvidia - and the community treated it as a make-or-break moment, not incremental. r/hardware ran "AMD's Make-Or-Break Moment: Exclusive Look At Helios, First AI System To Rival Nvidia," and r/AMD_Stock noted AMD launched Helios with the MI455X and 6th-gen EPYC and added Microsoft as a buyer. The shift is that AMD is finally competing at the rack level (MI450/MI455X) rather than the single-chip level, which is where Nvidia's NVL72 integration actually lives - a BNP Paribas note flagged that "AMD's MI450 Could Finally Challenge Nvidia at the Rack Level," per r/AMD_Stock.

The threat that actually scares people is not AMD - it is custom silicon, led by Google's TPU - Hacker News captured the anxiety in one headline: "Google Is Using Nvidia's Playbook to Build a Rival AI Chip Business," per HN. The numbers back the mood: custom AI ASIC shipments are projected to grow 44.6% in 2026 against 16.1% for merchant GPUs, per introl.com, and Google's expanded Anthropic deal now runs to up to a million TPUs and multiple gigawatts, per datacenterdynamics.com. Every hyperscaler is now shipping its own chip - Trainium, Ironwood, Maia, MTIA.

The CUDA moat is cracking at the edges, and the crack is inference plus non-Nvidia training runs - the softest spot is that CUDA lock-in was built for training, and inference is now roughly two-thirds of AI compute spend, which is where custom ASICs win on cost. On the training side, r/LocalLLaMA surfaced the provocative "American AI is locked down and proprietary. It's losing," and HN circulated "China's LongCat-2.0 Becomes the Biggest AI Model Without Nvidia Chips" and "Meituan Trained a 1.6T-Parameter AI Model Without Nvidia GPUs." AMD's own software gap is still the counterweight: "While CUDA works out of the box for most tasks, AMD software requires significant configuration," per aimultiple.com, and ROCm/ROCm still carries 270 open issues on GitHub.

The least-appreciated moat is the supply chain, and it is also the most time-limited - the durable lock-in nobody can quickly copy is Nvidia's grip on packaging and memory: it holds 70%+ of TSMC's advanced CoWoS capacity and priority HBM allocation from all three suppliers, per intuitionlabs.ai. The catch analysts keep noting is that this layer compresses as CoWoS capacity expands - so it buys years, not permanence. Meanwhile the finance angle got its own attention, with HN's "Nvidia Has Become the Bank Behind the AI Boom" capturing unease about how much of the demand Nvidia is itself underwriting.

KEY PATTERNS from the research: 1. The moat is software and habit, not silicon - "5 million developers build on CUDA" is the recurring line, per commandlinux.com 2. AMD moved the fight to the rack with Helios and MI455X, and the community reads it as make-or-break, per r/hardware 3. Custom ASICs, not AMD, are the structural threat - 44.6% ASIC shipment growth vs 16.1% for GPUs in 2026, per introl.com 4. Google's TPU is the sharpest edge, using "Nvidia's playbook" plus a million-chip Anthropic deal, per HN 5. The crack is in inference and non-Nvidia training - LongCat-2.0 and Meituan trained frontier models without Nvidia GPUs, per r/LocalLLaMA 6. AMD's ROCm software gap remains the real handicap - CUDA works out of the box, ROCm needs configuration, per aimultiple.com 7. The supply-chain moat (70%+ of TSMC CoWoS, priority HBM) is the hardest to copy but the most time-limited, per intuitionlabs.ai

last30days v3.3.2 · synced 2026-07-21

What I learned:

The debate now has a hard number, and it is uncomfortable - the loudest thread this month is Anthropic's own randomized trial, which had 52 junior engineers learn the Python library Trio with and without an assistant. The AI group scored 50% on a comprehension quiz about code they had written minutes earlier versus 67% for the hand-coders, a roughly 17% skill-mastery drop, per InfoQ. The Next Web framed the same study bluntly: the largest gap was in debugging, and it coined "never-skilling" - not an expert who rusts, but a novice who never gets good in the first place.

Cognitive offloading is the mechanism people keep pointing at - the recurring claim is that outsourcing mental effort makes the work faster but "slashes opportunities to build knowledge, strengthen reasoning, and practice critical thinking," per Singularity Hub. The most-cited study underneath this is the Microsoft/CMU finding that the more people lean on AI, the less critical thinking they engage - a phenomenon others in the research are calling "Mechanized Convergence," where users accept outputs with minimal scrutiny to save cognitive load.

But how you use it changes the outcome, and that is the optimistic half - the same Anthropic data shows the split is not AI-vs-no-AI, it is asking-vs-delegating. Developers who used the assistant for conceptual inquiry and explanations scored 65%+, while those who delegated wholesale code generation scored below 40%. This is exactly why the "AI that teaches beats AI that thinks for you" camp is gaining ground: Ben Rosche and Evelyn Learning argue that reading a solution feels like progress but productive struggle is what actually sticks, and Socratic-questioning tutors reportedly cut student churn ~40% in higher-ed settings.

Practitioners are converging on "amplifier, not crutch" - the most-shared developer advice is Addy Osmani's: let AI kill the drudgery but keep deliberate practice by periodically doing hard problems the hard way, without the agent, to keep your debugging instincts and system thinking alive. The community mood is not anti-AI - r/LocalLLaMA's top thread this month (3,105 upvotes) was Linus Torvalds telling people to stop attacking others for using AI, with the top comment landing the nuance: "You can use AI on Linux submissions, but god help your soul if you submit slop" (u/RedParaglider, 1,059 upvotes).

"Short leash" is becoming the practitioner's answer to skill loss - a widely-discussed Hacker News piece (196 points, 246 comments) argued for keeping the AI on a tight tether - small, reviewed, understood increments rather than wholesale delegation - which maps directly onto the trial's finding that the people who stayed in the loop kept their comprehension. And the tool vendors have quietly conceded the point: both Claude Code and ChatGPT shipped "learning modes" designed to preserve skill development, an admission that the problem Anthropic documented is not theoretical.

KEY PATTERNS from the research: 1. The delegating-vs-asking split, not AI use itself, predicts skill retention - conceptual questioners scored 65%+, wholesale delegators below 40% - per InfoQ 2. "Never-skilling" is the new sharper framing - juniors never learning to debug is scarier than experts deskilling - per The Next Web 3. Cognitive offloading trades short-term speed for long-term reasoning and critical thinking - per Singularity Hub 4. Socratic "ask, don't answer" tutors that force productive struggle are the leading design fix - per Evelyn Learning 5. The practitioner consensus is "amplifier not crutch" plus deliberate agent-free practice - per Addy Osmani 6. The mature community stance is pro-AI-but-anti-slop - stay in the loop and own your output - per r/LocalLLaMA

Provenance — 2026-07-21

Redacted: source-library rationale is summarized at the topic level; no raw source URLs or private notes are included.

How today's three were chosen

Three seed entries were drawn from the private library, deliberately spread across domains so the day reads as a range, not a rut:

  1. An open-weights multimodal model release — pulled in because a self-directed demo (the model building its own artifact) genuinely delighted the saver. Funnel: open-weights frontier models, self-fine-tuning, MoE efficiency, ex-lab founders.
  2. A "tech leadership shifts over time" trends piece — platform/silicon/framework succession. Funnel: why leaders get displaced, the silicon baton pass, ML-framework generations, developer mass-exodus moments. Chosen for non-AI-infra range.
  3. An LLM-powered tutorial tool — "teach you rather than think for you." Funnel: learning with AI vs offloading to it, cognitive offloading, Socratic tutors, the fate of traditional docs.

The 12 adjacent topics fanned (all cleared the near-dup guard)

From pick 1 (open-weights models): - Models that fine-tune themselves toward a target behavior ✅ picked - The open-weights vs closed frontier gap in 2026 - Mixture-of-Experts efficiency and why active-parameter count matters - Thinking Machines and the ex-OpenAI founder-lab landscape

From pick 2 (tech leadership shifts): - Why dominant developer platforms get displaced (Cloudflare vs Vercel) - The silicon baton pass — how Nvidia overtook and who catches up next ✅ picked - Developer mass-exodus moments and platform trust (the Unity fiasco) - ML framework generations — TensorFlow, PyTorch, JAX and mindshare

From pick 3 (LLM-guided learning): - Learning with AI vs offloading to AI — cognitive offloading and skill atrophy ✅ picked - Do AI tutors actually work — evidence on personalized LLM tutoring - Executable, self-verifying tutorials — docs that run themselves - The decline of traditional docs in the age of LLM question-answering

Narrowing to the final 3

Selected for curiosity, live discussion in the last 30 days, and learnability, with a hard constraint that the three not overlap: one on AI capabilities (self-fine-tuning), one on hardware/markets (the silicon baton pass), one on cognition/learning (offloading vs skill-building). Connections: none of the 129 prior published topics scored above the connection threshold (max ~0.09), so all three are genuinely fresh ground.