Manas Bihani
About

the questions

  1. What is a moat in an AI world?
  2. Why do AI products converge?
  3. What becomes scarce when intelligence becomes cheap?
  4. Does distribution matter more than technology?
  5. Why might human-made things become more valuable?
  6. What happens to expertise when everyone has the same models?
  7. Which parts of an AI startup are actually defensible?
  8. Where does value move when intelligence becomes commoditized?

everything on the desk

  1. The periodic table of the AI stackVisualization
  2. What is a moat when the model isn't yours?Note
  3. The problem-selection premiumNote
  4. Same model, different wiringNote
  5. Selection is the new bottleneckNote
  6. Get friendly with the AI raceEssay
  7. The convergence taxNote
  8. The luxury of realityNote
  9. The non-technical technical advantageNote
  10. The verification economyNote
  11. The bets against the wallVisualization
  12. You can't buy your way outVisualization
  13. How a chatbot writes one wordVisualization
  14. The grid is the last wallVisualization
  15. Who got paidVisualization
  16. Why this paper mattersExplainer
  17. Transformer: Why did transformers replace RNNs?Vaswani et al., NeurIPS 2017
  18. KV cache: Why does a long conversation get slower and cost more than a short one?Shazeer, 2019
  19. Mixture of experts: Why do some AI models have experts?Fedus, Zoph and Shazeer, 2021
  20. FlashAttention: Why is attention slow when the GPU is barely doing any arithmetic?Dao et al., NeurIPS 2022
  21. Mamba: Why does a model reread the whole conversation instead of just remembering it?Gu & Dao, 2023
  22. PagedAttention: Why does a GPU with free memory still refuse new requests?Kwon et al., SOSP 2023
  23. DeepSeek: How did DeepSeek train a frontier model so cheaply?DeepSeek-AI, 2024
  24. Jamba: Why does Jamba matter?Lieber et al., AI21 Labs, 2024
  25. BitNet: Why does BitNet matter?Ma et al., Microsoft Research, 2025
  26. DeepSeek-R1: Can a small AI model learn to reason like a huge one?DeepSeek-AI, 2025
  27. Kimi K2: Why does Kimi K2 matter?Kimi Team, Moonshot AI, 2025
  28. Sliding-window attention: How do models handle huge context windows without the memory bill exploding?Gemma Team, Google DeepMind, 2025
  29. How electricity becomes intelligenceVisualization
  30. This desk, as a datasetDataset
  31. The first version of this roomNote
  32. The aura dividendNote
  33. Distribution is rented attentionNote
  34. The Convergence TestNote
  35. A shelf for thinking about cheap intelligenceCollection
  36. Anatomy of an AI startupNote
  37. Six shocks to expertiseNote
  38. Nineteen Public KeysEssay
  39. The value migration machineModel
  40. AAA-Rated GPUsEssay
  41. Moats, before and afterVisualization
  42. The rhinoceros problemNote
  43. What becomes scarce when intelligence becomes cheap?Essay
  44. AI Has Passed Every Exam. It Has Never Had an Idea.Essay
  45. What Becomes Scarce After Intelligence?Essay
  46. India’s Carbon Markets : A New Test for Global Climate PolicyEssay
  47. Google Wants AI to Become BoringEssay
  48. The Wall That Wasn’t YoursEssay
  49. The Rate-Limiting StepEssay
  50. The Speed of Being WrongEssay
  51. Uber Burned a Year of AI Budget in Four Months. A Rat Catcher in 1902 Knew WhyEssay
  52. Finding a Flat in India Is Broken. We Have the Technology to Fix It. Nobody With Power Wants To.Essay
  53. Why We Can Never Have Good Social MediaEssay
  54. Gen Z Is Going OfflineEssay

rooms

  1. Home
  2. Writing
  3. Projects
  4. Reading & Watching
  5. All the questions
  6. Everything, as a contact sheet
  7. About

Reading & Watching

What's going into my head: books, papers, essays, talks and podcasts, each with one line on why it's here.

on the desk right now

Book · 2002

Technological Revolutions and Financial Capital

Carlota Perez

installation, frenzy, turning point, deployment. where are we?

the shelf

The Work of Art in the Age of Mechanical ReproductionThe Tacit DimensionPerforming Arts: The Economic DilemmaThe Innovator’s DilemmaInformation RulesTechnological Revolutions and Financial CapitalStrategy Letter VAggregation Theory7 PowersAttention Is All You NeedThe Bitter Lesson

the log, newest first

  1. Video

    the clearest picture of attention I have seen

  2. Essay

    The Bitter Lesson ↗

    Rich Sutton, 2019

    general methods plus compute beat cleverness. uncomfortable, mostly right

  3. Video

    the best one-hour map of the territory

  4. Paper

    Attention Is All You Need ↗

    Vaswani et al., 2017

    eleven pages that rearranged an industry

  5. Essay

    Strategy Letter V

    Joel Spolsky, 2002

    “commoditize your complements.” value moves next door

  6. Book

    The Innovator’s Dilemma

    Clayton M. Christensen, 1997

    good-enough from below, except now good-enough is a model

  7. Book

    Information Rules

    Carl Shapiro & Hal R. Varian, 1998

    pricing things that cost nothing to copy, the last time this happened

  8. Book

    7 Powers

    Hamilton Helmer, 2016

    a vocabulary for moats. which of the seven survive?

  9. Essay

    Aggregation Theory

    Ben Thompson, 2015

    when distribution is free, winners own demand

  10. Book

    The Tacit Dimension

    Michael Polanyi, 1966

    “we can know more than we can tell.” the part not in any training set

  11. Essay

    The Work of Art in the Age of Mechanical Reproduction

    Walter Benjamin, 1935

    aura: the thing a copy lacks

  12. Book

    Performing Arts: The Economic Dilemma

    William J. Baumol & William G. Bowen, 1966

    why the string quartet keeps getting relatively more expensive

annotated collections

The Work of Art in the Age of Mechanical ReproductionThe Tacit DimensionPerforming Arts: The Economic DilemmaThe Innovator’s DilemmaInformation RulesTechnological Revolutions and Financial CapitalStrategy Letter VAggregation Theory7 PowersAttention Is All You NeedThe Bitter Lesson

A shelf for thinking about cheap intelligence

reading pile. growing.

Collection · 12 Sept 2026