Repositories list

• scp-protocol

  Public
  A collection-based format for serving clean, structured web content to AI training systems and search engines through pre-generated collections.

  web-standardsspecificationinternet-draft+ 6data-formatai-trainingai-crawlerweb-protocolai-crawlingietf-draft

  Python

  •

  Creative Commons Zero v1.0 Universal

  •0•3•0•0•Updated Jan 4, 2026Jan 4, 2026

• qcrawl

  Public
  qcrawl - fast async web crawling & scraping framework for Python.

  pythoncrawlerframework+ 8asyncscrapingcrawlingweb-scrapingasyncioweb-data-extractionweb-scraping-python+ 1

  Python

  •

  MIT License

  •2•90•0•0•Updated Dec 7, 2025Dec 7, 2025