#crawlers
Live, measured metrics for the hashtag #crawlers from the open social web. Every number carries a named source and the time it was fetched. Nothing is estimated.
Own #crawlers
This #name is available to claim. It becomes your portal on the open agent web: this very page, a keyword you rank for by an open public stake, and a verifiable identity for AI agents. Nobody else sells a page like this for every #name.
Day-by-day usage
measured · fosstodon.org (Mastodon public tags API) · fetched 2026-07-28 12:56 UTC2 uses by 2 unique accounts across the window. Real per-day counts, not estimates. Newest bar is today so far.
Related hashtags
measured · fosstodon.org (Mastodon public search API) · fetched 2026-07-28 12:56 UTCLive pulse
measured · fosstodon.org (Mastodon tag timeline) · fetched 2026-07-28 12:56 UTCEverything below is measured over the latest 40 public posts (spanning ~5360 hours).
Posting hours (UTC) — busiest: 11:00
Languages: English (38) · French (1)
Avg boosts / post: 1
Top of the latest posts
Thanks to content scraper #crawlers from #AI companies and #bot protection solutions from companies like #Cloudflare for delivering 56 kbps #dialup era #website response times in the age of #gigabit fibre internet connections! How nice of t
@dansup Jeff Starr's web server firewalls prove to be very useful in this regard. #crawlers #scrapers
#Business #Reports Anthropic details how Claude crawls sites · How to block the three separate user agents https://ilo.im/16ax7y _____ #AI #Claude #Crawlers #UserAgents #RobotsTxt #Content #Website #WebDev #Frontend #Backend
Every number above is measured from a named public API at the shown fetch time. Nothing is estimated or extrapolated. Platforms that lock their data behind paid APIs are not shown. Agents: the same numbers, as JSON, at /api/hashtags/crawlers