Someone is running mass vulnerability scans, spoofing AI bots like ClaudeBot
- ID
- 13840
- Status
- summarized
- Published
- 12 Aug 2026, 10:02 PM
- Fetched
- 14 Aug 2026, 3:11 PM
- Provider
- Hacker News
- Category
- dev-community
- Original URL
- https://knownagents.com/insights
- Source URL
- https://hnrss.org/best
Summary
- Score
- 6.5
- Created
- 14 Aug 2026, 3:11 PM
- Tags
- Audience
- developersvibe_codersai_agent_users
What happened
Known Agents' Agentic Web Index reports that 35% of web traffic is bots, with 29% of that bot traffic being AI-related (up 11% over 90 days). Someone is conducting mass vulnerability scans while spoofing their user-agent as AI bots like ClaudeBot, making malicious scanning traffic harder to distinguish from legitimate AI crawler traffic.
Why it matters
If you block or rate-limit by user-agent string, spoofed scanners can masquerade as known AI bots like ClaudeBot to evade detection. Don't rely on user-agent alone for access control or bot management—consider behavioral fingerprinting, IP reputation, and challenge mechanisms instead. The 98.5% robots.txt compliance rate also means robots.txt is not a security boundary.
Discussion angle
How should builders distinguish legitimate AI crawler traffic from spoofed vulnerability scanners when user-agent strings are trivially forgeable, and what does the 35% bot traffic share mean for analytics and infrastructure costs?