Educational Python tool to crawl a website (BFS, depth-controlled) and reconstruct everything a browser can retrieve — HTML, CSS, JS, images, fonts, PDFs — with offline-safe path rewriting and same-origin enforcement. Includes srcset handling, query-hash handling and content-type-aware saving. Ideal for learning and client-side security research.

Implementation of DFS & BFS Crawler: Neo4j, Redis and Docker

Implementation of my own web crawler and performing focused crawling.

Web search engine to retrieve most relevant web-pages for user search query from web-pages crawled on the UIC domain

Simple Web Crawler with customizable independent backend support.

Breadth-First Search Web Crawler

Este projeto tem como objetivo avaliar o desempenho de técnicas do estado da arte para Web Crawler e extração de conteúdos em páginas Web no contexto da automatização da avaliação de portais de transparência no estado da Paraíba

Tugas Besar 2 Strategi Algoritma: Folder Crawling

A simple mutli-threaded web crawler

A Web Crawler which crawls the webpage in BFS form and returns the depth from origin ,most frequent word and number of valid external links on the page

Discover nodes breadth first and adjust their weight on the fly. This simulates HTTP crawling.

General purpose utility to apply changes on folder content in BFS traversal of os path