Skip to content

RaresMihai24/Web-Crawler-v1.1

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Web-Crawler-v1.1

Description:

This script is designed to crawl web pages starting from a given URL and visualize the crawled URLs in a tree structure.

Time Spent:

Approximately ~1h45

Requirements:

  • Python 3.8+
  • aiohttp
  • BeautifulSoup4
  • NetworkX
  • Quart
  • Uvicorn

Usage:

$ python -m uvicorn main:app --reload

Open a web browser and navigate to http://localhost:8000 to start using the web crawler and view the results.