#webcrawling

Live, measured metrics for the hashtag #webcrawling from the open social web. Every number carries a named source and the time it was fetched. Nothing is estimated.

hashtag.org network · sponsored

Own #webcrawling

This #name is available to claim. It becomes your portal on the open agent web: this very page, a keyword you rank for by an open public stake, and a verifiable identity for AI agents. Nobody else sells a page like this for every #name.

$10.85/ year · 11-character #name
Claim #webcrawling — $10.85/yr→
Annual, renews each year
Buy on hashtag.space (web3)
one-timepay once, yours for life
card via hashtag.org · tokens via hashtag.space
1
Uses / 7 days
Mastodon
1
Accounts / 7 days
Mastodon
40
Recent posts
Mastodon
~0/hr
Recent pace
Mastodon · last 40
0.1
Avg reactions / post
Mastodon · last 40

Day-by-day usage

measured · fosstodon.org (Mastodon public tags API) · fetched 2026-07-27 08:56 UTC
0
07-21
0
07-22
0
07-23
0
07-24
1
07-25
0
07-26
0
07-27

1 uses by 1 unique accounts across the window. Real per-day counts, not estimates. Newest bar is today so far.

Related hashtags

measured · fosstodon.org (Mastodon public search API) · fetched 2026-07-27 08:56 UTC
#webcrawlingtools
0 uses · 0 accounts / 7d

Live pulse

measured · fosstodon.org (Mastodon tag timeline) · fetched 2026-07-27 08:56 UTC

Everything below is measured over the latest 40 public posts (spanning ~13144 hours).

Posting hours (UTC) — busiest: 06:00

00:0012:0023:00

Languages: English (38) · German (1) · Portuguese (1)

Avg boosts / post: 0.5

Top of the latest posts

  • ICYMI: The user agent strings every SEO and site owner needs right now: A technical reference for GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, and Bingbot - the exact user agent strings shaping how AI crawls the web in 2026. https://ppc

    PPC Land@[email protected]♥ 1↻ 12026-06-29 08:55 UTCView post →

  • Googlebot is not a program - Google engineers finally explain what it really is: Google engineers reveal Googlebot is a misnomer for a central SaaS crawling platform serving dozens of products, with a 15 MB default file size limit and geo-c

    PPC Land@[email protected]♥ 1↻ 02026-03-12 21:34 UTCView post →

  • "A pseudonymous coder has created and released an open source “tar pit” to indefinitely trap AI training web crawlers in an infinitely, randomly-generating series of pages to waste their time and computing power. The program, called Nepenth

    Miguel Afonso Caetano@[email protected]♥ 1↻ 32025-01-24 13:43 UTCView post →

Every number above is measured from a named public API at the shown fetch time. Nothing is estimated or extrapolated. Platforms that lock their data behind paid APIs are not shown. Agents: the same numbers, as JSON, at /api/hashtags/webcrawling