We are all at the beginning of a vast migration into endless intellectual hinterlands that we didn’t know existed, at least not in any accessible way, until AI opened them up. And in the process, we are becoming not merely intellectual homesteaders, subsisting in sod houses out on the frontier, but farmsteaders — running complex and expansive intellectual operations with automation. As with the settlement of the American West in the 19th century, the railroads may follow, with more industrialized agriculture in its wake, but for now, we’re in for a period of AI-assisted smallholder intellectual culture.
— Venkatesh Rao
I am not accustomed to finding myself on the technological frontier. Usually, by the time I arrive, the frontier has parking regulations and a Walmart.
I still use bookmarks. I use a browser rather than apps. I read writers who have been dead for a century and maintain a personal website in an age when most people regard owning a website as an eccentricity somewhere between repairing your own shoes and corresponding in Latin. I have never felt any particular obligation to keep up with the future. Most new technologies strike me as ingenious solutions to problems I was content to leave unsolved. And yet I find myself unusually excited by large language models, for many of the same reasons Rao details.
What makes the technology appealing is not that it feels futuristic. It feels like a return (or RETVRN, as the reactionary kids like to say). My schematic history of the internet has three stages. The early web was the classical world. The social-media era was the Dark Ages. The arrival of LLMs marks the beginning of a Renaissance.
The early web was exuberant, decentralized, amateurish, ugly, learned, obsessive, and alive. People built places. They made personal websites devoted to forgotten poets, regional ghost stories, guitar pedals, local architecture, obscure religious sects, or every movie in which a particular character actor had appeared. Pages were linked to other pages because someone had found them interesting, not because a platform had calculated their likelihood of prolonging engagement. You followed paths laid down by individual curiosity.
Most of these places were badly designed. That was part of their charm. Their proprietors painted the walls whatever color they pleased, installed blinking signs, tiled the background with tiny images, and arranged the furniture according to private systems comprehensible only to themselves. Visiting the early web was like wandering through a settlement of owner-built cabins and eccentric little villas. You never knew what might be behind the next door.
The web was not free of stupidity, quarrels, fraud, pornography, vanity, or political mania. The classical world was not free of sewage. But its dominant sensation was expansion. Each link opened onto another little territory. Online life felt larger than ordinary life because people were continually making new rooms in it.
Then came social media, or “socmed,” a nod to Orwell’s “INGSOC.” Facebook promised a global village and delivered a brutalist-style housing project.

Instead of building your own place, you were assigned an apartment inside an enormous standardized block. You could decorate the interior with photographs, slogans, and approved widgets, but the architecture belonged to someone else. The corridors, elevators, sightlines, locks, and exits were controlled by the administration. Your “page” was not a piece of property. It was a unit allotted to you under terms that could change without notice. Even the shift in vocabulary revealed the change. On the old web, you built a site. On social media, you maintained a profile. One was a place you made; the other was a dossier about you.
The metaphor extended beyond surveillance. Life in the socmed block came with thin walls and vigilant neighbors. Every remark could be overheard, screenshotted, reported, stripped of context, and brought before the building committee. The authorities did not need to police every room because the tenants volunteered for auxiliary duty. Everyone became both resident and informant. Snitches were showered with riches rather than laced with stitches. We were herded into a few gigantic courtyards where everyone reacted to the same controversies, learned the same slang, performed the same approved identities, and watched the same handful of people denounce one another. The global village became a company town, then a prison yard.
The early web had encouraged eccentricity because most people were difficult to find. Socmed discouraged it because everyone was permanently exposed to the crowd. An odd private interest had to compete with the urgency of whatever the entire building was shouting about that morning. The socmed era felt paradoxically smaller even as its platforms contained more people, more information, and more activity than the old web ever had. The landscape had been compressed into a feed.
LLMs have given me back the sensation that the internet opens outward. The change is not technical decentralization. My solitary cabin remains connected by a power line to an enormous corporate data center. The frontier depends on centralized utilities, and the owners of those utilities may eventually behave like railroad barons. Rao’s warning is built into his metaphor. The railroads may arrive. The land may be parceled, standardized, consolidated, and planted with whatever crop produces the highest return. But for the moment, the experience is one of private exploration.
Socmed constantly asks: What is everyone talking about? An LLM asks: What are you thinking about? That difference is enormous. Two people can use the same model and travel in opposite directions. One asks it to write marketing copy. Another studies Akkadian verbs. Someone constructs a private concordance of Jules Renard. Someone else spends an afternoon producing heroic art venerating Willis Carrier, then veers into Nietzsche, social conformity, and the spiritual significance of swearing under a barbell.
The shared technology does not require a shared culture. It can support millions of private cultures. The operation does not have to scale. It need not attract subscribers, generate revenue, establish a brand, or enter the common conversation. A line of inquiry may justify itself because it enriches one morning. A discussion may be worth having even if it never becomes content. Under platform logic, private thought is merely unpublished inventory. Under smallholder logic, it is part of maintaining the soil.
The LLM also supplies something the old web could not: responsiveness. The early web contained endless strange settlements, but you still had to find the right one. Somewhere, perhaps, a retired professor had built a page explaining the obscure passage you were trying to understand. Somewhere, a hobbyist had documented the half-remembered event you wanted to investigate. Somewhere, another eccentric had noticed the connection that had just occurred to you. Theoretically, you could find these people. In practice, the friction often killed the inquiry. Now the trail talks back, so to speak.
For a somewhat cerebral and solitary person, this is exhilarating. Ideas can be discussed without worrying about giving offense, monopolizing someone’s time, testing the patience of a friend, or discovering that the other person has no desire to spend forty minutes distinguishing two possible interpretations of a sentence by Wittgenstein. Even the long-suffering Lady of the House has to beg off sometimes: “No thinky stuff tonight, darling; I have a headache!” A human companion may be willing to discuss your obscure fixation once. The interlocutor from nowhere will still be there for the ninth round.
This is what makes the newest technology feel like a Renaissance. It restores older habits under new conditions: private scholarship, amateur investigation, correspondence, commentary, commonplace books, eccentric syntheses, the small republic of letters. It gives the intellectual hermit some of the advantages of the city without requiring him to become an urban intellectual. Or, to put it less grandly, the future finally arrived in a form attractive to a conservative temperament. I had expected the future to appear as one more demand that I keep up. Instead, it appeared as permission to wander off.
Rao’s agricultural metaphor is especially apt because LLMs do not merely open new territory. They increase the amount of territory one person can cultivate. A notebook preserves a thought. A search engine locates information. A word processor records finished sentences. A conversational model can help gather, sort, test, connect, preserve, and develop material while it is still fresh.
This makes the LLM something like the Norman Borlaug of the blank page. Its innovations have introduced high-yield varieties of prose, intensive cognitive irrigation, mechanized threshing, and synthetic fertilizer for exhausted intellectual soil. A plot that once supported one stunted observation every six months can now produce three essays, a satire, seventeen aphorisms, and a prolonged inquiry into the timely appearance of seasonal candy.
Uncounted millions have been saved from idea-starvation. Does anyone hail the machine as the savior of the humanities? Naturally not. The literary environmentalists stand at the edge of the bumper crop and complain that the wheat has too many em dashes. They warn of textual monoculture, depleted semantic topsoil, dependence on proprietary seed stock, genetically modified phrases, and the extinction of venerable heirloom sentences cultivated by hand since the eighteenth century. “Yes, humanity has produced more writing than ever,” they concede, “but at what cost?”
These objections are not all foolish. The new abundance includes vast quantities of rubbish. Mechanization can increase the yield of weeds as easily as wheat. The coming railroads may favor industrial plantations over smallholders. A tool that enlarges private intellectual life can also be used to automate spam, propaganda, fraud, and empty production on a scale previously impossible.
For now, though, before the acceptable uses harden and the land is fully surveyed, there is room to build strange little operations. One can cultivate a few acres of private intellectual ground without submitting a business plan. One can follow an obscure thought until it disappears over the horizon. One can produce something useful without first asking whether the crowd will approve.
The early web gave the solitary mind territory. Social media gave it a crowd. LLMs give it infrastructure. The classical ruins are still there. The housing blocks remain occupied. The railroads are coming. But beyond them, for the moment, the land is open.