GlassBox - SEC EDGAR Data Ingestion

SEC EDGAR data ingestion system. Processes 580+ companies with automated parsing pipeline.

---

🎯 Overview

GlassBox is a data engineering system that ingests and processes SEC EDGAR filings for financial analysis. The system automates the collection and parsing of regulatory filings.

Key Highlights :

• ✅ Data Ingestion : Automated SEC EDGAR filing collection
• ✅ Parsing Pipeline : HTML → structured JSON conversion
• ✅ Scale : Processes 580+ companies
• ✅ Automation : Fully automated pipeline

---

🛠️ Technologies

• Python 3.11+
• Web Scraping (SEC EDGAR access)
• HTML Parsing (Structured data extraction)
• JSON (Data storage format)

---

📊 Architecture

┌──────────────┐
│  SEC EDGAR   │  (580+ companies)
└──────┬───────┘
       │
┌──────▼───────┐
│  Ingestion   │  (Automated collection)
└──────┬───────┘
       │
┌──────▼───────┐
│  Parsing      │  (HTML → JSON)
└──────┬───────┘
       │
┌──────▼───────┐
│  Storage      │  (Structured JSON)
└──────────────┘

---

🚀 Key Features

1. Data Ingestion

• SEC EDGAR : Automated filing collection
• Scale : 580+ companies processed
• Automation : Fully automated pipeline

2. Parsing Pipeline

• HTML Parsing : Extracts structured data from HTML
• JSON Output : Clean, structured data format
• Reliability : Robust error handling

3. Architecture

• Scalable : Handles large-scale data processing
• Automated : Minimal manual intervention
• Reliable : Error handling and retry logic

---

📈 Results

• Companies Processed : 580+
• Data Quality : Clean, structured JSON output
• Reliability : Automated, robust pipeline

---

📝 Status

Phase : Completed - Functional system

Completed :

• ✅ SEC EDGAR ingestion (580+ companies)
• ✅ HTML parsing pipeline
• ✅ JSON output format
• ✅ Automated processing

---

🔗 Links

• Portfolio : fabienpierret.github.io/projects/glassbox
• Author : Fabien Pierret

---

📄 License

MIT License - See LICENSE file for details

---

Built with ❤️ for demonstrating data engineering capabilities