What Would Happen If AI Became Really Fast

Here is an interesting thought experiment – what would happen if AI were to become fast. AI today has four limiting factors: model capabilities, cost, context windows (how much data an AI can ingest), and speed. Most of our attention goes to the first three – speed has improved, but gets far less attention. EchoHive imagines AI answering at a million tokens per second (today’s AIs are operating at around 100-200 tokens/sec). With this speed, LLMs could code 40 app drafts or write 1,000 story endings in a single second. And it would take AI only three seconds to review 10,000 job candidates. With this amount of raw output, evaluation will quickly become the ultimate bottleneck – add one minute of testing to those 40 app drafts, and 10,000× faster writing makes the whole job only about 132× faster.

Pascal Finette @radical