AI bots are consuming approximately 80% of website traffic, primarily for model training purposes, placing a significant strain on server infrastructure.
This surge in bot activity presents a challenge for website owners who must manage these resource demands while simultaneously ensuring that legitimate search engine crawlers can access their content. The issue raises questions about the sustainability of current website operational costs, as owners may be bearing the brunt of the infrastructure expenses associated with AI development.
Website owners are seeking strategies to mitigate the impact of these AI bots without compromising their search engine rankings or user experience. The increasing volume of AI-driven traffic necessitates a re-evaluation of how website resources are allocated and managed in the face of evolving internet usage patterns.
This trend highlights a growing tension between the expansion of AI technologies and the operational realities faced by content creators and website administrators.
Sources and references
Original report
AI Bots Keep Overloading Servers. Should Website Owners Keep Paying? via @sejournal, @martinibuster
Search Engine Journal
Read on Search Engine Journal (opens in a new tab)Ref 00IAFGNC
Follow this story
Get Artificial Intelligence in your inbox — new stories in 40 words or fewer, once a week.
Subscribe