Should You Let AI Shopping Agents Into Your Store?
Agents reach your store through three doors: your pages, your product feeds and your checkout. Each has its own switch, and robots.txt controls less than you think.
In this article
Yes for most DTC stores, with conditions. Let AI search crawlers and user-directed agents read your pages, send clean product data to the AI channels you sell through, and keep agent purchases ending at your own checkout. Block only where bots already cost you money, such as limited drops. Robots.txt will not do that job for you.
Start with scale. Shopify's leadership said on its Q2 2026 earnings call that AI-driven traffic and orders to Shopify stores had tripled year over year, while calling the volume "still small relative to our massive GMV". There is no public figure for what share of a typical store's orders agents place. On Shopify, your own number is under Sales channels > Agentic; look at it before you change anything.
Agents reach your store through three doors
An AI shopping agent touches your store in three separate ways: it reads your public pages, it reads product data you send to AI platforms, and it may build a cart and pay. Each door is controlled from a different place, so a block placed on the wrong door costs you visibility without stopping the agent.
| Door | What happens | The switch that controls it | What blocking costs you |
|---|---|---|---|
| 1. Reading your pages | Search crawlers index pages; user-triggered agents fetch a page when a shopper asks | robots.txt for search crawlers; for user-triggered agents, only a firewall you run in front of the store | Your pages drop out of AI answers and comparisons |
| 2. Product data you send | Feeds and catalogs (Shopify Catalog, Google Merchant Center, OpenAI's product feed) | The channel or feed settings in your admin | Your products cannot be listed or bought inside that AI app |
| 3. Cart and checkout | An agent builds a cart, then either hands the buyer to your checkout or the buyer pays inside the AI app | Per-channel direct checkout (Shopify Agentic), bot protection, fraud rules | Orders from shoppers who delegated the task |
The posts that rank for this question already split access into tiers: integrated.social's "access ladder" by action, Nostra's allow, shape and block by bot type. What they do not do is name the setting that enforces each tier, or check what stores currently tell agents. That is what the rest of this post does.
Door 1: robots.txt does not stop user-triggered agents
OpenAI, Perplexity and Google each say their user-triggered agents may ignore robots.txt. What a block reliably removes is their search crawlers, which decide whether you appear in AI answers. So on door 1, robots.txt is a visibility setting, not a security control, and a blanket block costs more than it keeps out.
OpenAI's crawler overview says of ChatGPT-User: "Because these actions are initiated by a user, robots.txt rules may not apply." Perplexity's crawler documentation says its Perplexity-User fetcher "generally ignores robots.txt rules." Google's user-triggered fetchers page, updated 19 August 2026, lists Google-Agent, used by agents on Google's infrastructure to navigate the web, and says these fetchers "generally ignore robots.txt rules."
Anthropic is the exception. Its crawler help article in the Claude Help Center says that disabling Claude-User "prevents our system from retrieving your content in response to a user query", so for Claude, a robots.txt block does work, and costs you visibility in Claude's answers.
OpenAI and Perplexity also run separate search crawlers, OAI-SearchBot and PerplexityBot, documented on the same pages, which do follow robots.txt. Shopify draws the same line for its own channels: its Catalog and product discovery page says blocking AI crawlers "affects only open-web discoverability", while Catalog keeps sending product data to the channels you have switched on.
This is the training-data reflex in a new form. As I wrote in our ChatGPT recommendation guide: "A surprising number of brands blanket-blocked AI crawlers in 2023–24 when the debate was about training data, and forgot. In 2026 that block also removes you from live retrieval." A store that adds "block AI shopping agents" to robots.txt today repeats that mistake, and ChatGPT, Perplexity and Google's agents may still arrive.
What to allow on door 1: the search crawlers, unless you have a legal reason not to. Training crawlers are a separate choice; OpenAI documents GPTBot as its training crawler, apart from its search crawler. And make sure an agent that does arrive can read the page. As I put it in the same guide: "Several AI crawlers execute little or no JavaScript. If your product details render client-side only, the crawler sees an empty shell."
What 29 Shopify stores already tell agents
Many Shopify merchants have an agent policy they never wrote. On 13 October 2026 we checked the 29 brands Shopify features in its article "DTC Brands: Examples and Strategies to Stand Out". None of the 28 readable robots.txt files blocked any of the nine tokens we tested, and 26 sites published a profile for agents using the Universal Commerce Protocol.
| Check (29 brand domains, 13 October 2026) | Result |
|---|---|
| robots.txt readable | 28 of 29 (one returned a server error) |
| Blocks any of 9 AI crawler or agent tokens for the whole site | 0 of 28 |
| Disallows checkout paths for all bots | 25 of 28 |
| Opens with Shopify's agent instructions header | 16 of 28 |
| Serves an /agents.md file | 22 of 29 |
| Serves a Universal Commerce Protocol profile at /.well-known/ucp | 26 of 29 |
How we checked: each domain's robots.txt, /agents.md, /.well-known/ucp and homepage were fetched once from a cloud server with a browser user agent, and Shopify was detected from homepage and robots.txt markers. The nine tokens were GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User and Google-Extended; "blocks" means a Disallow covering the whole site for that token, so path rules such as the checkout disallow are counted separately. We detected Shopify on 27 of the 29 sites; the 3 without a protocol profile are the site not running Shopify, the site whose files all returned server errors (where Shopify could not be detected), and one Shopify store that serves neither file. A single fetch is a snapshot, and a store behind a bot challenge can answer differently on another day.
Sixteen files, 57% of the readable ones, open with a comment block Shopify writes for agents. It points to the store's /agents.md and protocol endpoint, and in 14 of the 16 it also lists what agents must do, including, in the file Hint serves at drinkhint.com/robots.txt, "Obtain buyer authorization, follow required review steps, and yield to the buyer when a required shopping action is unsupported." Of the other 12, one is the site not running Shopify, and 11 are Shopify stores still serving an older layout without that header. From outside we cannot tell whether that is a rollout still in progress or a robots.txt.liquid template someone edited.
The checkout disallow on 25 files keeps well-behaved crawlers out of checkout. By the platforms' own documentation above, it does not bind user-triggered agents.
One line Shopify added in 2025 is no longer there. In July 2025, Modern Retail reported that Shopify had added this to storefront robots.txt files: "Automated scraping, ‘buy-for-me’ agents, or any end-to-end flow that completes payment without a final review step is not permitted." None of the 28 files we read still carried it. The prohibition has become instructions for how agents should buy.
If you are on Shopify, open /robots.txt and /agents.md on your own domain today. Shopify writes both files for you, so read them before an agent quotes them to a customer.
Door 2: the product data you hand over
Feeds are the door you control most directly: the settings sit in your own admin, channel by channel. Shopify Catalog, Google Merchant Center and OpenAI's product feed decide what an agent knows about price, stock, variants and policies, and switching a feed off removes you from that app's shopping results.
This door has nothing to do with robots.txt, and blocking a crawler never closes it. The decision is per channel, based on where you sell and what the channel's checkout supports. Our Shopify Agentic Storefronts guide walks through eligibility channel by channel, and the ChatGPT product feed guide covers stores that are not on Shopify.
The risk on this door is accuracy. An agent that quotes an old price or a sold-out variant sends the shopper to your checkout expecting something you no longer offer. Keep stock and prices synced, write option names a machine can read ("Medium", not "SZ-02"), and fill in shipping and returns policies so the agent has something true to quote.
Door 3: carts and checkout
Checkout is the only door where an agent can cost you money directly, through a bad order or a bot buying out stock, and there are three paths through it. Protocol agents hand the buyer to your checkout, Shopify's agentic channels can take payment inside the AI app, and browser agents drive the checkout pages a person uses.
Shopify's agent documentation describes the first route. Agents connect through Shopify's implementation of the Universal Commerce Protocol, and "When buyers are ready, convert the cart into a checkout and refer them to the merchant storefront to complete payment." The same page reserves direct checkout completion for agents that Shopify verifies at higher trust tiers. For agents using Shopify's protocol tools, the path ends with your checkout and a buyer who sees the order.
Shopify's own agentic channels work differently. Its Copilot help page says direct checkout, where the buyer pays inside Copilot, is "activated by default for eligible stores", and that you can deactivate it so customers complete the purchase on your online store. That per-channel switch under Sales channels > Agentic is the most concrete door 3 setting every Shopify merchant has; our Agentic Storefronts guide covers which channels offer it.
Browser agents are harder to see. You cannot recognize them by their user-agent string: Simon Willison found that ChatGPT agent's requests present as Chrome, and Engadget reports Amazon's allegation that Perplexity re-enabled Comet's shopping "by disguising Comet's AI bot as a normal Chrome browser." Meta's Muse is the newest example; Awayco reports that Amazon blocked it, "saying it was not told the agent would access its store and did not authorise it."
The reliable signal is a signature. Willison documented that ChatGPT agent's requests carry a Signature-Agent header naming chatgpt.com, backed by a cryptographic signature anyone can check, which he called "a rock-solid way to identify traffic from ChatGPT agent". The method is called Web Bot Auth. Google's fetchers page says Google is also experimenting with the Web Bot Auth protocol, labelled experimental there, and Shopify's Storefront API reference says signed traffic gets higher rate limits than anonymous traffic. Cloudflare's signed-agents documentation adds the caveat to keep: "you may trust the intermediary operator, but not necessarily every end user driving it." A signature tells you who built the software, not that the person behind it is a good customer, so your fraud rules stay on every order.
If you are on Shopify, here is what you can actually switch. Shopify runs the edge in front of your store, so per-agent firewall rules need a proxy you run yourself, such as your own Cloudflare zone, which is more infrastructure than most DTC stores need for this. The checkout control Shopify gives you is bot protection. Shopify's page says it is available only on Shopify Plus, by request to Plus Support, that it blocks known bots from checkout and slows bot activity during flash sales, and that a scheduled event lasts at most 60 minutes. The same page says it is not meant to fight bot-related fraud. On other plans, your levers are your fraud-analysis settings and order review.
Expect agent activity to blur your analytics. A browser agent posing as Chrome will usually land in Shopify analytics and GA4 as an ordinary session, so a run of agent visits that do not buy lowers your conversion rate, and an agent purchase can be credited to direct or to whichever ad the shopper clicked earlier. Orders paid inside Copilot through direct checkout never reach your site, and Shopify's Copilot page says "Google Analytics and custom pixels won't fire" there; our Agentic Storefronts guide covers that tracking gap.
The legal side is still in court. Amazon won a preliminary injunction against Comet in a federal district court, and on 4 August 2026 the Ninth Circuit vacated it; Engadget reports the court found Amazon's Computer Fraud and Abuse Act claim "doesn't hold up to scrutiny." Amazon is defending a marketplace and an ad business. A DTC brand sells its own products and has far less reason to turn a buyer away.
Two stores, two answers
The right setting depends on what bots already cost you, not on how risky agents sound. A brand whose revenue is repeat orders has little to protect at checkout, while a brand selling scarce stock in drops already fights bots. Here are two hypothetical stores run through the three doors.
Store A: a US skincare brand on Shopify's Advanced plan, 40 SKUs, most revenue from repeat orders. Door 1: allow every search crawler and leave user-triggered agents alone. Door 2: keep Shopify Catalog on for the channels it qualifies for and fix variant names and policies. Door 3: leave Shopify's protocol handoff in place, decide per channel whether direct checkout stays on, and keep the usual fraud review. The work is reading its robots.txt and agents.md and checking the Agentic report monthly.
Store B: a streetwear brand on Shopify Plus that sells most of its revenue in timed drops of a few hundred units. Doors 1 and 2: the same as Store A, because visibility before the drop is the point. Door 3 differs. Resale bots are this brand's existing problem, and an unsigned agent racing through checkout at the drop looks like one. It should schedule a bot protection event for each drop window, which Shopify caps at 60 minutes, leave checkout open to agents the rest of the time, and accept that some legitimate agent orders will fail during the drop.
If you are not on Plus and think you are Store B, check first whether bots have actually cost you inventory or chargebacks. Without that evidence, you are Store A.
What to check this week
Six checks cover all three doors. On a Shopify store, the first four need no developer and are mostly reading your own files and feeds; the fifth is a settings decision, and the sixth is a 30-day look at what agents actually did before you tighten anything.
- Read your robots.txt and agents.md. Open both at your domain. Check that no AI search crawler is blocked and that the policies agents will quote are current.
- Remove blanket AI blocks left from 2023 or 2024, unless a lawyer told you to keep them. Keep or drop GPTBot as a separate training decision.
- Check your product pages without JavaScript. Open a product page, right-click and choose View page source (not Inspect), then search for the price and a variant name. If they are not there, agents that do not run JavaScript will not see them.
- Audit the feeds per channel: stock, prices, variant names, shipping and returns policies.
- Set door 3. On Plus with drops, schedule bot protection for drop windows only. On other plans, review your fraud settings and leave agent checkout open.
- Check AI-channel orders for 30 days in Sales channels > Agentic, and note any spike in non-buying sessions in your analytics, then tighten or loosen door 3 based on what you see.
If you want a second pair of eyes on door 1, AI crawler access is part of our GEO service.
Frequently asked questions
Not reliably. OpenAI says robots.txt rules may not apply to ChatGPT-User because a person triggered the visit. What a block does reliably stop is the search crawler, OAI-SearchBot, which removes you from ChatGPT's search answers. Claude-User is the exception among the four platforms covered here: Anthropic says blocking it stops Claude retrieving your pages for users.
An agent order is a real buyer's order placed through software, paid with the buyer's own credentials. Run it through the same fraud rules as any other order. Shopify's own bot protection says it is not designed to fight bot-related fraud, only to stop auto-checkout bots buying up scarce stock, so it does not replace those rules.
Shopify's agent documentation has agents build the cart and then send the buyer to your storefront to pay, and reserves direct checkout completion for agents Shopify verifies at higher trust tiers. A browser agent driving your normal checkout pages is a different case: it clicks through the same checkout a person sees.
Unsettled. The Ninth Circuit vacated Amazon's injunction against Perplexity's Comet on 4 August 2026 and the case continues in the district court, as covered in the checkout section above. Take legal advice before relying on your terms of service to keep agents out.
Read it first. Shopify builds it from your store details and policies, so most errors are fixed at the source in your admin. To change the file itself, Shopify's help page on Catalog and product discovery documents an agents.md.liquid template, which also changes what /llms.txt and /llms-full.txt serve.
Sources
- Overview of OpenAI Crawlers — OpenAI.
- Perplexity Crawlers — Perplexity, Jan 29, 2026.
- Google User-Triggered Fetchers — Google for Developers, Aug 19, 2026.
- Does Anthropic crawl data from the web, and how can site owners block the crawler? — Claude Help Center, Apr 7, 2026.
- Shopify Catalog and product discovery for agentic storefronts — Shopify Help Center.
- Protecting your store from selling to bots — Shopify Help Center.
- Selling on Microsoft Copilot — Shopify Help Center.
- Agents — Shopify Developers.
- Storefront API reference — Shopify Developers.
- Verified bots — Cloudflare Docs, Oct 8, 2026.
- ChatGPT agent's user-agent — Simon Willison's Weblog, Aug 4, 2025.
- Shopify quietly sets boundaries for AI agents on merchant sites — Modern Retail, Jul 14, 2025.
- Perplexity has successfully overturned Amazon's injunction on its AI shopping bot — Engadget, Aug 4, 2026.
- Should retailers let AI shopping agents in? — Awayco, Sep 25, 2026.
- How Shopify is approaching agentic AI so far in 2026 — Digital Commerce 360, Aug 6, 2026.
How this article was made: researched and drafted with AI assistance, built on DeviLabs’ published methods and Dominykas Jankauskas’s own positions, then fact-checked against the primary sources listed above and reviewed before publication. Read the full editorial policy. Spotted an error? Email info@devilab.eu.
Find out what AI says about you
Free 30-minute consultation call. We go through how AI engines pick the brands they name in your category, where the opening is for you, and what it would take to get into those answers.