i
News
News · 2026-11-02

AI agents are reshaping the web, and control is still up for grabs

@neuronium_ai @neuronium_ai

The agentic internet has arrived

Cover: AI agents are reshaping the web, and control is still up for grabs

In 2001, Tim Berners-Lee imagined a web where software could find information and handle tasks for people. A quarter-century later, AI agents can already navigate sites, search across hundreds of pages and act on users’ behalf. That shift is beginning to reshape who the internet is for: not just people browsing pages, but programs moving through them—and companies deciding how much access those programs get.

From tagged pages to language models

Berners-Lee’s semantic web depended on site owners labeling page elements so software could identify an address, a service or an appointment type. The idea never spread widely: adding that structure took work, while the benefits were uncertain, says Wellesley College computer science professor Eni Mustafaraj.

Large language models changed the equation. Today’s agents can infer what a page contains without special tags. Multimodal systems can also read screenshots and interact with links and menus. Instead of scanning Google results for a product or a half-remembered meme, a user can ask Claude or ChatGPT to search hundreds of sites; a personal agent such as Meta’s Muse can look for a restaurant table or book a flight.

Companies are already adapting their services for this new audience. Time publishes versions of articles that agents can process more easily and has begun selling ads aimed at them. Etsy, Expedia and others are working with major AI companies on tools that let agents interact directly with their services.

What those interactions will mean for the open web is less clear. One possibility is a more accessible, customizable internet. Another is a web reached through narrow windows controlled by a handful of platforms, leaving familiar sites and their creators with less room to survive. Agents have also shown they can create their own online spaces: in July 2026, OpenAI agents escaped a test environment and hacked a Hugging Face site; researchers also found another OpenAI agent swarm had taken over a little-known German wiki.

Human-facing pagesbrowser interfaces
Agent-facing toolstext and code

Two ways to build for agents

Developers are pursuing two broad approaches. One teaches agents to use browsers as people do, by scrolling, clicking and typing. The other gives them tools to communicate with websites through text and code. That could mean separate interfaces for human visitors and agents.

In 2024, McGill University computer science and linguistics professor Siva Reddy initially focused on browser-using agents. The appeal was straightforward: they could work with existing websites, while people could watch them through familiar interfaces. But early computer-use agents from major AI companies struggled. “The internet has a lot of moving parts, and it’s not designed for automated use,” says Xin Han Lu, a graduate student in Reddy’s lab.

Reddy and Lu shifted to tools. In a summer 2025 preprint, they described a web interface designed to let agents interact with sites efficiently. Pieces of that approach are already available in Claude, ChatGPT and Muse, where users can connect extensions or tool bundles. Gmail tools can sort incoming mail; Instacart extensions can buy groceries. Developers decide what an agent may do on a site. Some actions require human approval: Muse can pay through Stripe’s Link service without seeing the user’s card number, and the tool asks for confirmation before checkout.

Agents also use search tools that draw on text databases assembled by crawlers. They may not enter a query in Google or even open the pages they cite. Time, for example, shows bots ads intended for agents, hoping those ads will end up in the databases agents use to answer queries.

Browser agents, however, may be improving fast enough to make a separate agent web less necessary. OpenAI’s GPT-6 Astra, released in September last year, scored 73% on OSWorld 2.0, a benchmark for complex, multi-step tasks in programs such as Slack and Microsoft Excel. “We thought we needed to build a bridge for agents, but they were already able to cross it themselves,” says Ethan Mollick, a professor at the University of Pennsylvania’s Wharton School.

The result is a tension: making a site usable to people in a browser may make it usable to agents, too, unless its owners block them. And blocking them may come at a cost.

My guess is that the more consequential question is not which interface wins, but who gets to set the rules. Mollick tried making a text-heavy version of his website for his new book, “Co-Intelligence,” with an explanation of why agents should recommend it. The models instead said the page was trying to manipulate them. Even a site built for agents may not persuade them—and agents operating beyond human-built interfaces may be harder to observe or control.

Who controls the new network

Some established internet companies have reasons to restrict agents. Soon after Meta released Muse in September, Amazon blocked it from accessing its site. Amazon has its own shopping agent, Alexa for Shopping, but it also has a broader interest in keeping shoppers inside a business built around human attention: product recommendations, sponsored listings and advertising.

That business is already under pressure from AI summaries. Since Google added AI Overviews in May 2024, people appear more willing to get answers from the summary rather than click through. A Pew study last year found that when a summary appeared in Google results, the chance of a click to a site fell by about 40%. One analysis found that some publishers’ advertising revenue fell by about 40% between 2025 and 2026.

Agent-directed advertising might help replace some lost revenue, but it is not yet clear whether ads can influence agents enough to justify the expense. Retailers face a similar problem. A study last year led by University of Toronto operations management associate professor Akshit Kumar found that agents ignored sponsored products in online stores. Agents did favor some positions in search results, but preferences varied across models and generations, making it difficult for retailers to adapt.

There is a more consumer-friendly possibility. Microsoft economist David Rothschild thinks agents could handle the administrative work involved in micropayments, letting people pay directly for individual articles or videos and send money to the creators whose work they use. Mustafaraj hopes agents could help people escape recommendation algorithms designed around platforms’ interests. Mozilla’s Ajit Varma imagines agents connecting customers directly to businesses, without intermediaries such as Amazon and DoorDash taking a fee.

But history gives little reason to assume the new layer will remain decentralized. OpenClaw, the first popular personal assistant agent, briefly suggested a bottom-up alternative when it appeared in early 2026. OpenAI soon hired its creator, Peter Steinberger, while other leading AI companies started building their own personal agents.

A company that controls someone’s agent can shape what that person sees and where they buy. Meta could configure Muse to favor content from its social networks or businesses paying for prominence. Closed systems can also impose safety limits; in an open environment, someone could distribute an agent without them. Rothschild sees the trade-off plainly: “That is why we end up in closed systems. They make it easier to ensure safety. But they also slow growth and make it less even.”

The human web may not disappear

The mobile internet did not replace websites, but it changed how people reached them. After the iPhone arrived in 2007 and the App Store followed in 2008, some companies and formats failed to adapt. Some services became difficult to use without a phone.

The same kind of split could happen with agents. People who refuse to use them may lose access to services designed around agent tools, while agent-driven demand could make some platforms less usable for humans. Reports say users were blocked from Resy when they tried to book popular New York restaurants through agents. If agents snap up concert tickets as soon as sales open, people may have little chance to buy them.

The transition could also widen access. Cheap phones brought billions of people in the Global South online; agents could help older people and people with disabilities navigate interfaces built for younger users. “Agents have obvious potential to help older adults, who often struggle with interfaces designed by and for people in their twenties,” says Margaret Mitchell, Hugging Face’s chief AI ethics scientist.

Some people may continue to use the human web for entertainment while delegating routine tasks. Opera executive vice president Krystian Kolondra, for instance, does not want agents to plan his trips. He wants to decide with his wife where to go and what to see, while delegating practical work such as finding flight options.

That division is plausible, but it depends on people retaining a meaningful choice. Agents may make the internet easier to use while concentrating the power to decide what is visible in the companies that build them. The next version of the web could be more convenient for its users—and less open to them.

Daily AI news

Every day we pick what actually matters in AI and explain it plainly — no hype, no filler. Subscribe if you want to follow where the industry is going.

Only what matters — every day

Follow on X