2nd year, 2nd semester project This is a polite C++ crawler with an UI made using angular. !!! Make sure to pass full links including protocol and subdomain !!!.
You can either pull the image using
docker pull ccc909/threadedcrawler
or build it from the source using
git clone https://github.com/ccc909/ccrawler.git
cd ccrawler
docker build -t crawler .
and run it using
docker run -p 80:80 -p 9001:9001 -d ccc909/threadedcrawler
or if built from source with
docker run -p 80:80 -p 9001:9001 -d crawler
UI will be accessible on
localhost
The C++ crawler might crash and will not restart on its own, the image must be restarted manually if this happens.