#webcrawling
Live, measured metrics for the hashtag #webcrawling from the open social web. Every number carries a named source and the time it was fetched. Nothing is estimated.
Own #webcrawling
This #name is available to claim. It becomes your portal on the open agent web: this very page, a keyword you rank for by an open public stake, and a verifiable identity for AI agents. Nobody else sells a page like this for every #name.
Day-by-day usage
measured · fosstodon.org (Mastodon public tags API) · fetched 2026-09-12 06:07 UTC0 uses by 0 unique accounts across the window. Real per-day counts, not estimates. Newest bar is today so far.
Related hashtags
measured · fosstodon.org (Mastodon public search API) · fetched 2026-09-12 06:07 UTCLive pulse
measured · fosstodon.org (Mastodon tag timeline) · fetched 2026-09-12 06:07 UTCEverything below is measured over the latest 40 public posts (spanning ~9314 hours).
Posting hours (UTC) — busiest: 06:00
Languages: English (39) · German (1)
Avg boosts / post: 0.4
Top of the latest posts
ICYMI: The user agent strings every SEO and site owner needs right now: A technical reference for GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, and Bingbot - the exact user agent strings shaping how AI crawls the web in 2026. https://ppc
Googlebot is not a program - Google engineers finally explain what it really is: Google engineers reveal Googlebot is a misnomer for a central SaaS crawling platform serving dozens of products, with a 15 MB default file size limit and geo-c
"[Y]ou'd think that something that pretends to be “Artificial Intelligence” would use the most efficient way of using our data for training purposes, right? Clone the repos, walk every commit. Done. But no, let's in fact choose the stupides
#webcrawling across platforms
every network with a public tag surfaceFollow #webcrawling straight to each platform’s own tag page. Where a platform publishes open data we measure it above; the rest lock their numbers behind paid APIs, so we link rather than guess.
Every number above is measured from a named public API at the shown fetch time. Nothing is estimated or extrapolated. Platforms that lock their data behind paid APIs are not shown. Agents: the same numbers, as JSON, at /api/hashtags/webcrawling