SYS.ONLINE // web crawlers · pump.fun

Autonomous web crawlers for every token.

Each token deployed through Crawler is bound to a dedicated web crawler. The web crawler traverses papers, repositories and datasets, resolves identifiers, and builds a linked knowledge graph for the token. Graph quality is scored as the Mind Index.

Your web crawler0nodes indexed
Threads spun0edges
Mind index0.0of 1000
crawler://$SILK → en.wikipedia.org/wiki/Spider#References depth 3

General and cited references

Deeleman-Reinhold, C. L. (2001). Forest Spiders of South East Asia. Brill. ISBN 978-90-04-11959-8

Foelix, R. F. (2011). Biology of Spiders. Oxford UP. ISBN 978-0-19-973482-5

Vollrath, F. & Knight, D. (2001). Liquid crystalline spinning of spider silk. doi:10.1038/35069000 PMID 11268207

Further reading

Blackledge, T. A. et al. (2009). Reconstructing web evolution. doi:10.1073/pnas.0809782106 PMC 2664144

Garb, J. E. (2006). Silk genes support the single origin of orb webs. doi:10.1126/science.1127254

Hillyard, P. (1994). The Book of the Spider. Random House. ISBN 0-679-40881-1 OCLC 30644276

Eberhard, W. (2020). Spider Webs: Behavior, Function, and Evolution. ISBN 978-0-226-53460-1

External links

arXiv:2104.07801 · github.com/silk-lab/orbweaver · wikidata:Q1357 · gbif.org/species/1496

pages/min 0 frontier 0 visited 0 › init web crawler…
Live web crawlers

Active web crawlers

Each entry is a token and its bound web crawler. The graph shows nodes resolved and edges linked to date.

Sample data · preview build

swipe › more web crawlers

Launch console

Deployment console

Configure token metadata and web crawler parameters. The web crawler initializes when the token is live on-chain.

Image
Source policy Sources the web crawler is permitted to read. Max 4.
3 hops
Higher depth increases coverage and compute cost.
Optional initial buy at deploy.
Est. cost ≈ 0.52 SOL incl. web crawler stake
How it works

Protocol

Crawler emblem: a web crawler resolving DOIs
step 1 · launch

Deploy

Token is created on pump.fun via Crawler with metadata and a source policy that defines what the web crawler may read.

step 2 · crawl

Crawl

The web crawler traverses permitted sources, resolving DOIs, repositories and datasets, and writes edges between related nodes.

step 3 · compound

Index

Verified links raise the Mind Index. Holders can query the web crawler against its indexed graph.

mind_index = 1000 × ( 0.4·coverage + 0.3·link_density + 0.2·freshness + 0.1·source_quality ) // each term normalized 0–1 across all live web crawlers