Skip to content

Scrape RFD threads into JSON for feeding into LLMs.

Notifications You must be signed in to change notification settings

smchase/RFD-Scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 

Repository files navigation

RFD Thread Scraper

Scrapes RedFlagDeals forum threads to JSON, including posts, quotes, timestamps, and usernames.

Quick Start

# Setup
python -m venv venv
source venv/bin/activate  # Windows: venv\Scripts\activate
pip install -r requirements.txt
playwright install chromium

# Run
python scraper.py https://forums.redflagdeals.com/example-thread-12345/ -o output.json

About

Scrape RFD threads into JSON for feeding into LLMs.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages