搜尋引擎爬蟲為AI爬蟲鋪路

Search engine bots crawled so AI bots could run

Ryan hosts Akamai data scientist Robert Lester on the show to discuss how the growth of AI bots affects internet traffic, the ways these AI bots differ from the original search engine optimization ones, and why you might not want to mitigate AI bots on your websites.

Akamai is a CDN, full-stack cloud computing, and cybersecurity company that keeps experiences closer to users and threats further away using the world’s most distributed compute platform.

Connect with Robert on LinkedIn and check out his AI Pulse blogs.

Today’s shoutout goes to user Evan Phoenix for winning a Populist badge for their answer to llvm ir back to human-readable source language?.

Subscribe to the podcast

Get The Stack Overflow Podcast at your favorite listening service.

What’s new at Stack Overflow: January 2026

A new worst coder has entered the chat: vibe coding without code knowledge

Documents: The architect’s programming language

A look under the hood: How (and why) we built Question Assistant

You need quality engineers to turn AI into ROI

Add to the discussion

Our Stack

Company

Support

Elsewhere