The Schrodinger's Startup: Useless and Apocalyptic Simultaneously
Welcome to 2024's most delicious contradiction, where the entire AI industrial complex has achieved something truly remarkable: the simultaneous existence of two completely incompatible truths. Most people who actually use AI products find them only modestly useful—essentially a marginally cleverer version of Google Search, the kind of incremental improvement that typically earns a feature release, not a $100 billion valuation. Yet the very people building these systems, along with the venture capitalists funding them to the moon, lose sleep at night convinced that their modestly useful creation could severely damage or destroy humanity itself. This is not nuance. This is not complexity. This is incoherence masquerading as strategic thinking.
The practical implications of this schism are almost incomprehensible. We're meant to believe that a technology which provides modest utility—think: better autocomplete, slightly less hallucination in customer service bots—simultaneously poses an existential threat worthy of regulatory intervention and trillion-dollar defensive spending. The technology, apparently, is too dangerous to ignore and too useful to dismiss, which conveniently justifies both the massive venture capital flows into AI startups and the pearl-clutching op-eds about AI safety. It's the rare product that manages to be simultaneously overhyped for its actual capabilities and undersold for its supposed risks. Users report that ChatGPT is a clever search tool. Founders warn that superintelligence will eliminate us. Both groups are talking about the same software. Somehow.
This contradiction isn't accidental—it's the business model. The venture ecosystem requires that AI be revolutionary enough to justify nine-figure checks and the reallocation of trillions in market value. The safety narrative requires that AI be dangerous enough to justify regulation that incumbents can shape, talent recruitment that emphasizes mission importance, and a kind of moral urgency around funding that normal software companies can only dream of. A product that was merely useful? That stays at Series B. A product that might destroy humanity but currently functions as autocomplete? That goes public at a $500 billion valuation while the founder writes essays about existential risk on X.
The linguistic gymnastics required to maintain both positions are genuinely impressive. When users complain that AI isn't that helpful, investors invoke "emerging capabilities" and "training frontier models"—techspeak for: we haven't found a use case yet, but we're confident something will stick. When existential risk researchers warn about AI safety, the industry nods solemnly and funds another $5 billion into capabilities research, which is to existential safety what building faster cars is to pedestrian safety. The press releases maintain both narratives simultaneously: cutting-edge and mature, revolutionary and stable, dangerous enough to reshape civilization but modest enough that your email drafting just got slightly faster.
History suggests this particular contradiction cannot hold indefinitely. Either AI is genuinely useful enough to justify the valuations and capital deployed (at which point the existential risk narrative becomes harder to maintain without looking like pure marketing), or it's genuinely as modest as users experience it (at which point we've collectively misdirected hundreds of billions into autocomplete). The most likely outcome is that both groups are partially right and partially deluded: the technology is more useful than current users experience but far less dangerous than doom-mongers fear. But admitting that requires giving up on both the venture returns and the moral urgency. Can't have that.
What this moment really reveals is that venture capital has achieved peak absurdity. We've constructed an entire ecosystem where the same company can honestly market itself as both a marginally useful productivity tool and an existential threat to human civilization, and investors will fund it as both. The twilight zone isn't an actual state of technological limbo. It's just what you call the space between the thing you're selling and the justification you're using to sell it. And right now, that space has a $500 billion valuation.
"Emerging Capabilities"