All Articles
Published 8 min read

Amazon Blocked Meta's Muse, And robots.txt Had Nothing To Say

Agentic WebAI AgentsAI CrawlersBot ManagementAgentic Commerce
AUTHOR
Slobodan "Sani" Manic

Slobodan "Sani" Manic

No Hacks

CXL-certified conversion specialist and WordPress Core Contributor helping companies optimise websites for both humans and AI agents.

No Hacks runs no sponsorships and is funded by advisory and audit work.

On the night of 20 September 2026, shoppers who sent Meta's shopping agent Muse to amazon.com got a page that said: "Continued access by an unauthorized AI agent violates Amazon's Conditions of Use, to which our customers have agreed." Todd Bishop reported it for GeekWire that night, with Amazon confirming the block.

A website owner who has spotted an automated visitor and wants it gone has a few controls, and Amazon reached for terms of service, the agreement with whoever is logged in.

The second control, robots.txt, had nothing to work with. A rule in that file names a user agent string, the label a piece of software sends when it asks a website for a page, and then states what that software may fetch. Meta's crawler documentation gives none for Muse. Also, robots.txt can't enforce the rule.

The Computer Fraud and Abuse Act (CFAA), the 1986 anti-hacking statute, had got much weaker for Amazon on 4 August 2026. That was the day the Ninth Circuit, a US federal appeals court, threw out a court order Amazon had won against Perplexity and ruled that the shopper, not the agent's vendor, is the one accessing the website.

Amazon's Conditions of Use is an agreement with the human shopper, not with Meta

Conditions of Use is the agreement a shopper accepts when they open an Amazon account, and Meta has nothing to do with it. Amazon gave GeekWire three reasons: Meta never told Amazon that Muse would access its store, the agent "doesn't identify itself when it browses", and it "appears to capture and store customer credentials", which Amazon says could create privacy and security risks. An Amazon spokesperson told GeekWire that third-party applications making purchases on a customer's behalf "should operate openly and respect service provider decisions about whether or not to participate."

All three reasons are complaints about Meta, and the document Amazon is enforcing binds the shopper. Amazon has separately asked Meta to remove Amazon from the Muse experience.

GET WEEKLY WEB STRATEGY TIPS FOR THE AI AGE

Practical strategies for making your website work for AI agents and the humans using AI to find you. Once a week you get the new articles, the latest podcast episode, and a few links worth keeping.

Muse has no user agent string, so Amazon's robots.txt cannot refuse it

Meta's crawler documentation lists five agents and Muse is not among them, so Amazon has no name to put in the rule.

Amazon's robots.txt, fetched from amazon.com/robots.txt on 22 September 2026, declares 101 user agent blocks, 100 of which carry Disallow: /, the line that refuses an agent the entire website. ClaudeBot is listed twice, so those hundred blocks name 99 distinct agents. GPTBot, CCBot, PerplexityBot, ClaudeBot, Google-Extended, GoogleAgent-Mariner and GoogleAgent-Shopping are refused everything.

Meta appears three times in Amazon's robots.txt. meta-externalagent crawls for model training and indexing, meta-externalfetcher fetches individual links at a user's request, and meta-webindexer improves Meta AI search results. All three get Disallow: /, meaning Amazon tells them not to read any pages.

Two of Meta's five documented crawlers are absent from the named blocks, so they fall under the general User-agent: * rules like any crawler Amazon has not named, and those rules instruct crawlers to stay out of the cart, sign-in and account paths while leaving product pages open. FacebookExternalHit is how a shared Amazon link gets its preview inside Meta's apps, and Meta-ExternalAds supports Meta's advertising business.

Meta said that Muse would appear as your own activity

Meta's wording, published on 8 September 2026 in the engineering account of the design that went out the day Muse launched, is that when Muse browses the internet it "will appear as your activity". Meta puts that in a section on data policy, disclosing that how a person uses Muse can influence the ads they see. The agent drives "a real up-to-date Chromium based browser", so the website on the other end records an ordinary customer session. I went through the post at the time. Muse is US only and free with paid tiers, and neither Meta's launch post nor GeekWire gives a number for how many people shop through it. I expect Meta to either proudly share a number soon, or not share one at all.

Twelve days later, on 20 September, Amazon says the agent "doesn't identify itself when it browses". Amazon was able to tell Muse sessions apart from ordinary shoppers, and then served them a different page. Neither Amazon nor GeekWire says how Amazon did this.

Amazon published no evidence for its credential claim

Amazon says Muse "appears to capture and store customer credentials". Meta had published on launch day where Muse stores them. The credentials are held by a background service called authd, inside the virtual machine Meta gives each Muse user, a computer that runs as software on hardware somewhere else. Meta's wording is "stored in your VM, not in centralized Meta infrastructure". The agent itself works only from surrogate tokens, stand-ins for the real credential. Meta's wording is that a component called Sentinel "will replace any surrogate tokens with the real credential, obtained from authd, at the network boundary". On Meta's description the model never sees the credentials, and I have found no independent check of that in the coverage of the block as of 22 September.

So Amazon raised as a concern something Meta had published, and the part Amazon added, that this could create privacy and security risks, came with no captured request, no named endpoint and no disclosure timeline.

Of course Amazon has a shopping agent of its own and an advertising business built on people looking at its pages. Alexa for Shopping launched in May 2026, as GeekWire notes. Amazon made more than 68 billion dollars in ad revenue in 2025, by GeekWire's figure, from a business that "depends on people browsing its pages and seeing sponsored products". And GeekWire records Amazon's point that its other agent, Buy for Me, identifies itself and lets brands opt out, which is the behaviour Amazon is asking of Meta.

Meta had not answered by the time GeekWire published and I have found no response in the coverage since, as of 22 September. Nothing a shopper can run from outside Meta's VM settles the credential claim. Two things would settle it: Meta opening the VM to an independent audit, or Amazon producing whatever their "appears to" rests on.

Amazon already lost this argument against Perplexity, and the court left Muse's case open

Amazon had already tried the courts against Perplexity, and lost. It sued over Comet, a browser that logs into a shopper's Amazon account and buys on their behalf, and in March 2026 it won a court order keeping Perplexity's agent out of the password-protected parts of the store while the case ran. The Ninth Circuit put that order on hold, heard the appeal on 11 June, and threw the order out on 4 August.

Comet runs on the shopper's own computer, so Perplexity's machines never talk to Amazon's. That is where the court started. It ruled that the shopper is the one visiting Amazon, not the company that wrote the software, and quoted a brief from the Electronic Frontier Foundation and four other outside groups: "Perplexity's servers never directly access Amazon's servers." The case is written up in full here.

Amazon asked for the case to be reheard by a larger group of judges, which lawyers call going en banc. In this circuit that is eleven: the Chief Judge and ten drawn by lot, rather than every judge on the bench. On 10 September the court refused, and not one judge asked for a vote on it.

So in this circuit the anti-hacking law is mostly gone as a tool against an agent a person sent, and what the court left Amazon was its own terms of service. Twelve days after Muse launched and ten days after that refusal, Amazon put a Conditions of Use notice in front of its own shoppers.

There is one question the Ninth Circuit did not answer, and it wrote the reservation into the opinion: "We do not address whether, on a different record or new facts, Perplexity may exercise control over the Assistant in such a way as to gain entry to Amazon's servers." That is the case where the software company, not the shopper, is the one running the agent.

Muse does not run on the shopper's machine. Meta's own description is that "you and your Muse share your own dedicated computer in the cloud", an "isolated linux box" reachable from WhatsApp, the Muse apps and muse.ai. Meta names no hosting provider. GeekWire notes that Meta signed a multibillion-dollar deal in April 2026 to run agentic AI workloads on Graviton, the server processors Amazon designs for its own cloud, and neither company has said whether Muse is among those workloads. If Muse is among them, Amazon is blocking an agent that runs on hardware Amazon rents out.

Conditions of Use was the only reason Amazon could put on the page without a name or a lawsuit

Amazon's Conditions of Use reached Muse because the shopper running Muse had already accepted those terms, and neither robots.txt nor the Computer Fraud and Abuse Act had that hold. Terms of service bind your customer, so enforcing them means telling the person who was trying to buy something that the way they chose to shop is not allowed. That is the sentence on Amazon's block page. It's more honest than yelling CFAA, anyway.

Anyone can write that sentence into their own terms. What Amazon has not explained is how it spotted Muse in the first place, and until it does, this is something Amazon did rather than something any website can do.

QUESTIONS ANSWERED

How did Amazon block Meta's Muse?

Amazon served a Conditions of Use notice rather than applying a named technical block. From the night of 20 September 2026, sessions were met with a page saying continued access by an unauthorized AI agent violates terms its customers had already agreed to. Amazon gave GeekWire three reasons and separately asked Meta to remove Amazon from Muse.

Why is Muse not blocked in Amazon's robots.txt?

A robots.txt rule names a user agent string, the label software sends when it asks for a page, and then states what that software may fetch. Meta's crawler documentation lists five agents and Muse is not among them, and Muse arrives inside the customer's own logged-in session. Amazon has no name to put in the rule.

Does robots.txt still matter for AI agents?

Robots.txt governs crawlers that declare themselves and choose to comply. Amazon's own file blanket-refuses 99 named agents, so Amazon is using it heavily. Robots.txt does nothing about software that does not announce a name, which is how Meta's Muse arrives at a store.

Does Meta's Muse capture Amazon customer credentials?

Amazon says Muse "appears to capture and store customer credentials". Meta had already published where Muse stores them, on 8 September 2026: held by a background service called authd inside the shopper's virtual machine, with the agent working from surrogate tokens that a component called Sentinel exchanges for the real credential at the network boundary. Neither has shown anything a third party could check.

Does the Ninth Circuit ruling in Amazon v. Perplexity apply to Muse?

Whether the ruling reaches Muse is unresolved. On 4 August 2026 the Ninth Circuit ruled that the shopper, not the software company, is the one visiting the website, and on 10 September it refused to think again. But that ruling started from Perplexity's Comet running on the shopper's own computer, so Perplexity's machines never talk to Amazon's. Muse runs on a computer in the cloud.

Why did Amazon use its Conditions of Use rather than robots.txt or the anti-hacking statute?

Robots.txt needs a user agent string, the name software sends when asking for a page, and Meta's crawler documentation lists none for Muse. The Computer Fraud and Abuse Act got weaker in the Ninth Circuit when Amazon lost the appeal in Amazon v. Perplexity on 4 August 2026. Conditions of Use is the agreement every Amazon customer accepts, so Amazon could enforce it.