#webcrawler

Live, measured metrics for the hashtag #webcrawler from the open social web. Every number carries a named source and the time it was fetched. Nothing is estimated.

hashtag.org network · sponsored

Own #webcrawler

This #name is available to claim. It becomes your portal on the open agent web: this very page, a keyword you rank for by an open public stake, and a verifiable identity for AI agents. Nobody else sells a page like this for every #name.

$23.52/ year · 10-character #name
Claim #webcrawler — $23.52/yr→Buy on hashtag.space (web3)
card via hashtag.org · tokens via hashtag.space
1
Uses / 7 days
Mastodon
1
Accounts / 7 days
Mastodon
40
Recent posts
Mastodon
~0/hr
Recent pace
Mastodon · last 40
0.1
Avg reactions / post
Mastodon · last 40
—
Reddit posts / month
Reddit search
—
Open-web mentions
hashtag.org Firehose

Day-by-day usage

measured · fosstodon.org (Mastodon public tags API) · fetched 2026-09-11 02:32 UTC
0
09-05
0
09-06
0
09-07
0
09-08
1
09-09
0
09-10
0
09-11

1 uses by 1 unique accounts across the window. Real per-day counts, not estimates. Newest bar is today so far.

Related hashtags

measured · fosstodon.org (Mastodon public search API) · fetched 2026-09-11 02:32 UTC
#webcrawlers
0 uses · 0 accounts / 7d
#1881webcrawler
0 uses · 0 accounts / 7d
#webcrawlergang
0 uses · 0 accounts / 7d
#webcrawlerpolicy
0 uses · 0 accounts / 7d
#webcrawler_search_engine
0 uses · 0 accounts / 7d

Live pulse

measured · fosstodon.org (Mastodon tag timeline) · fetched 2026-09-11 02:32 UTC

Everything below is measured over the latest 40 public posts (spanning ~10769 hours).

Posting hours (UTC) — busiest: 10:00

00:0012:0023:00

Languages: English (31) · German (8) · Japanese (1)

Avg boosts / post: 0.5

Top of the latest posts

  • For everyone who saw "Multics/0.1 (+everyfuckingprojectjulianmade.com)" in your server logs, that was my crawler — we made the final index for 0.1 today :) #multics #indieweb #searchengine #webcrawler #selfhosting #smallweb #opensource #pri

    jstreitb@[email protected]♥ 1↻ 02026-08-11 19:31 UTCView post →

  • Just noticed some of my website was crawled by the useragent "uk-nhs-data/0.0 (internal fraud-research)" That's weird, right? Has anyone else seen this before/has any more info? #uk #nhs #webcrawler #selfhosting #askfedi #askfediuk #cyberse

    Daniel, aka. CactiChameleon9@[email protected]♥ 1↻ 32026-07-26 12:02 UTCView post →

  • Apache Nutch vulnerabilities include CVE-2026-41870, an unauthenticated remote code execution flaw. See affected versions and fixes. #ApacheNutch #RCE #CVE #Vulnerability #InfoSec #WebCrawler #CyberSecurity #PatchNow http://securityonline.i

    Daily CyberSecurity@[email protected]♥ 0↻ 02026-09-09 01:02 UTCView post →

What “webcrawler” means

Wikipedia

A web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web and that is typically operated by search engines for the purpose of Web indexing.

“Web crawler” on Wikipedia (CC BY-SA) →

#webcrawler across platforms

every network with a public tag surface

Follow #webcrawler straight to each platform’s own tag page. Where a platform publishes open data we measure it above; the rest lock their numbers behind paid APIs, so we link rather than guess.

X (Twitter) ↗Instagram ↗TikTok ↗Facebook ↗LinkedIn ↗YouTube ↗Threads ↗Bluesky ↗Mastodon ↗Reddit ↗Pinterest ↗Tumblr ↗

Every number above is measured from a named public API at the shown fetch time. Nothing is estimated or extrapolated. Platforms that lock their data behind paid APIs are not shown. Agents: the same numbers, as JSON, at /api/hashtags/webcrawler