The Open Web's Ugly Test Case
On July 20, Chief Judge Yvonne Gonzalez Rogers tossed Google's DMCA claims against SerpApi, and the principle underneath the ruling is the right one—even if it showed up wearing the ugliest costume available. SerpApi, a company whose entire business is scraping Google's search results and reselling them through an API, frequently feeds the exact AI companies everyone is nervous about. So no, SerpApi is not a sympathetic plaintiff. Google, a trillion-dollar company that built its empire by crawling the open web and now wants copyright law to stop others from crawling it, is hardly sympathetic either.
This is two heavyweights fighting over who gets to package the web, and the rest of us are watching from the cheap seats. But the judge drew an honest line: a wall around your business model is not a lock on a copyrighted file.
What the Court Actually Said
Google's theory was straightforward: SerpApi broke the law by getting around SearchGuard, its internal anti-bot system designed to identify and block automated traffic. Google argued that beating that bouncer counts as illegal circumvention under the DMCA—the same law that makes it illegal to crack DVD copy protection.
The judge was not convinced. Her reasoning: SearchGuard protects Google's ad revenue, not a copyrighted work, and DMCA anti-circumvention is about copyright. She threw the claim out with prejudice wherever no copyrighted content was involved, and gave Google 21 days to come back with a narrow version about Knowledge Panel images. Good luck with that.
The Irony of Control
There is an unavoidable irony in Google, the company that built a trillion-dollar empire by indexing, crawling, and offering up the entire public web, trying to define crawling as illegal. For over two decades, the open web has functioned on a tacit agreement: you make it public, and search engines crawl it to make it discoverable. Google championed this engine-driven growth. Now, faced with a scraper that treats Google exactly how Google treats the rest of the web, the company is attempting to use the judiciary to pull up the drawbridge.
The judge essentially called out this double standard without explicitly using the word "hypocrisy." If the open web is truly to remain open, it cannot become a walled garden the moment a company finds it inconvenient to be crawled. The logic holds up: if you've spent twenty years perfecting the art of the crawler, you shouldn't be shocked, or legally entitled to compensation, when someone else builds one better.
The People Aren't In This Fight
When the story gets told as SerpApi versus Google, something goes missing: The open web was supposed to be by the people and for the people. Look at this fight and try to find a person in it. The users whose searches and pages and questions make the web worth scraping in the first place are not a party to anything. Two companies brawl over the spoils, a judge draws a line, and everyone else reads about the outcome later.
But the line she drew is the honest one. If it is on the web, it should be reachable by whatever wants to read it. That is a lovely principle when it is someone else's wall coming down. It stings when you remember who owns the biggest crawler on the planet.
What This Means for the Agentic Web
This ruling touches on something much bigger than a spat between a search giant and a scraping firm. It marks a foundational moment for what industry observers are calling the "Agentic Web."
We are moving away from an era where the primary "visitor" to a website is a human sitting at a browser. Today's websites are visited by shopping bots, AI agents comparing prices, answer engines scraping data for citations, and intelligence platforms pulling specs for competitive analysis. This shift illustrates why SEO is losing control of traditional outcomes in AI search, as autonomous agents replace manual search journeys.
In the eyes of the law, these are all, ultimately, automated visitors. By clarifying that anti-bot measures cannot be arbitrarily classified as DMCA-protected gatekeeping, the Rogers ruling provides a much-needed, albeit initial, framework for how these agents interact with public content. The ruling signals that unless a business is protecting actual, copyrighted, intellectual property, they have limited legal recourse to force automated visitors to turn back.
SerpApi is the ugly early test case. Whatever boundary the courts draw around it is the boundary for all of them.
Where You Actually Sit
You are in this too, and you are two things at the same time, and they do not get along.
You are one of the people. Your content gets scraped, resold, and poured into models, and nobody sent you a form to sign. The fight is over your web too, and your seat at the table is the same size as the users': none.
You are also a tiny Google. You would like a say over who takes your content and on what terms, and maybe you would like to get paid for it. This ruling trims the tools for that, because the precedent has nothing to do with Google specifically. An anti-bot wall that guards your revenue instead of a copyrighted work is what most websites are running, and the court said that kind of wall does not buy you DMCA protection.
This is the same frontier the Amazon v. Perplexity case is testing from the opposite end. That one runs on the CFAA and asks whether an AI agent counts as an authorized visitor when it acts on your website. This one runs on the DMCA and asks whether your anti-bot wall counts as copyright protection. Different statutes, same question underneath, and the toolkit for keeping machines out keeps coming up shorter than the people counting on it hoped.
The Takeaway for Website Owners
The takeaway is not a checkbox to go flip. It is where your head should be.
You do not get to feast on the open web for discovery, every scrap of traffic you were ever found, cited, or ranked for, and then clutch your pearls when that same openness lets a machine you do not care for read you too. It is one web, not two. The consistency runs both ways, whether you like the direction or not.
So make the call yourself. Decide what you want open and what you want closed, per crawler, on purpose, using the AI crawler controls your host or CDN already gives you. Learn how Cloudflare's new AI crawler rules are reshaping search visibility, or explore strategically evaluating AI crawler impact to understand what value each bot brings before you block it. Know that the legal ground under "block them" is still moving and might not hold.
Do not outsource that decision to a court refereeing a fight you are not in, and do not outsource it to a plugin that flipped a default you never read. Own it.
Fight for the open web or stop pretending. Whichever you pick, actually pick it. Right now Google and a scraper you have never heard of are making that call for you, and taking it back is the one move in this whole fight that is yours.