Releases: Dcup-dev/dcup
v1.1.3-beta
Contributors
Assets 2
v1.1.2-beta
The goal from this version is fixing bugs and tests
i set up e2e tests and make sure all works fine and find many bugs that need to deal with
What's Changed
- set unit tests and test google drive by @aliamerj in #85
- fix login bug by @aliamerj in #86
- fix bug with sending progress when nav to page by @aliamerj in #89
- connection to google drive e2e by @uruken25 in #88
- update google drive e2e test by @uruken25 in #92
- Fix/progress by @aliamerj in #93
- 🚀 Enhanced Stability & Maintainability | Test Suite Expansion + Core Refactoring by @aliamerj in #101
- Testing Dropbox by @aliamerj in #105
- remove google drive from cloud by @aliamerj in #106
- v1.1.2-beta by @aliamerj in #107
- Update and rename deployer_1.1.0-beta.yml to deployer_1.1-beta.yml by @aliamerj in #108
New Contributors
Full Changelog: v1.1.0-beta...v1.1.2-beta
Contributors
Assets 2
v1.1.0-beta
New Features & Integrations
1. AWS S3 Integration: Users can now connect an S3 bucket, browse objects, and ingest files with functionality mirroring Google Drive.
- AWS Authentication: Securely connect using AWS credentials.
- AWS Folder Picker: Browse and select specific buckets or folders for ingestion.
- AWS File Processing: Automatically process and index files from S3 buckets.
2. Dropbox Integration: Users can link their Dropbox accounts to Dcup, enjoying the same capabilities as with Google Drive.
- Dropbox Authentication: Securely connect your Dropbox account.
- Dropbox Folder Picker: Choose specific folders to ingest.
- Dropbox File Processing: Automatically process and index Dropbox files.
3. Direct File Upload Option: A native file upload feature now allows users to upload files directly via the Dcup UI.
- Native Upload Feature: Upload files straight from your device.
- Connection Set for Direct Upload: Organize and manage uploaded files within a connection.
- Add & Delete Files: Easily add new files or remove existing ones from the connection.
- Dashboard Display: Uploaded files are visible and manageable in the Dcup dashboard.
4. Query Page: A new page dedicated to querying data, complete with search and filtering capabilities.
- Search Input: Enter queries effortlessly.
- Filtering Options: Refine results using API-supported filters.
- Results Window: View organized, easy-to-read search results.
5. Comprehensive Ingestion API Endpoints: A full suite of API endpoints to give users complete control over data ingestion.
-
GET Endpoints:
- Retrieve all connections.
- Fetch a specific connection by ID.
- Get all files associated with a connection ID.
- Access specific file chunk data by chunk_id.
-
POST Endpoints:
- Create a new direct upload connection.
- Sync an existing connection by connection_id.
-
PUT Endpoint:
- Update connection details and add new files to direct upload connections.
-
DELETE Endpoints:
- Remove specific files from a connection by connection ID and file name.
- Delete an entire connection by ID.
Improvements
- Code Refactoring
- Extensive updates to the codebase for better performance, scalability, and maintainability.
- Optimized ingestion and retrieval processes to enhance efficiency.
Bug Fixing
- Addressed multiple bugs to improve stability and ensure a smoother user experience across all features.
Final Thoughts
With Dcup v1.1.0-beta, you’ve added incredible flexibility and power, making it easier for users to manage and process their data from multiple sources. The refactoring and bug fixes further solidify its reliability. Great work—this release is a fantastic milestone! Let me know if you’d like to tweak anything in these notes.
What's Changed
- Merge pull request #23 from Dcup-dev/main by @aliamerj in #24
- feature:Direct File Upload Option by @aliamerj in #27
- big refactoring + Direct upload by @aliamerj in #32
- Feature/direct file upload by @aliamerj in #33
- Feature/direct file upload by @aliamerj in #31
- Feature/direct file upload by @aliamerj in #34
- [BUG] File processing progress notification not working #30 by @aliamerj in #36
- api:list all connections and get by connection by id #29 by @aliamerj in #37
- GET: all files by connection ID #29 by @aliamerj in #40
- GET: file chunk data by chunk_id #29 by @aliamerj in #41
- remove connection api and fileProcessors by @aliamerj in #42
- POST: create new direct upload connection by @aliamerj in #43
- POST: Sync connection by connection_id and fix bugs and status api by @aliamerj in #44
- PUT: update connection details and allow for adding new files to conn… by @aliamerj in #45
- PUT: update connection details and allow for adding new files to conn… by @aliamerj in #46
- DELETE: Connection by id by @aliamerj in #47
- change connection/id/update to connection/id for updating by @aliamerj in #48
- implemented the dropbox folder picker and fix some bug by @aliamerj in #49
- Bug/connection name by @aliamerj in #52
- Implement AWS S3 Integration by @aliamerj in #53
- Feat page/query by @aliamerj in #54
- set up Limits by @aliamerj in #56
- Deploy/docker by @aliamerj in #58
- fix workflows by @aliamerj in #59
- fix workflows by @aliamerj in #60
- Deploy/docker by @aliamerj in #63
- Deploy/docker by @aliamerj in #65
- add password to qdrant by @aliamerj in #66
- Deploy/docker by @aliamerj in #67
- set up docker for render by @aliamerj in #68
- V1.1.0 beta by @aliamerj in #70
- Merge pull request #70 from Dcup-dev/v1.1.0-beta by @aliamerj in #71
- Switch PDF‐processing to an internal FastAPI microservice by @aliamerj in #72
- Switch PDF‐processing to an internal FastAPI microservic by @aliamerj in #73
- fix payment + redirect by @aliamerj in #76
- Dropbox OAuth auto-connects to previously authorized account without … by @aliamerj in #79
- Dropbox OAuth auto-connects to previously authorized account without … by @aliamerj in #80
Full Changelog: v1.0.0-beta...v1.1.0-beta
Contributors
Assets 2
Dcup v1.0.0-beta – The Open-Source RAG Platform is Here!
I'm thrilled to announce the beta release of Dcup v1.0.0-beta – your new open-source, self-hostable RAG (Retrieval-Augmented Generation) platform built on top of Qdrant! This release marks the first major milestone on my journey to simplify and empower AI-powered retrieval for developers.
What's New in v1.0.0-beta:
Fully Open Source & Self-Hostable:
Enjoy complete control over your data pipelines with an entirely open-source solution.
Connected RAG:
Easily connect your application to popular data sources like Google Drive with our pre-built integrations – more are coming soon!
Future-Ready Features:
Advanced capabilities such as LLM re-ranking, summary indexing, entity extraction, and hybrid search (leveraging OpenAI embeddings and Qdrant vector storage) deliver highly accurate and scalable retrieval.
Intuitive Retrieval API:
Our well-documented POST /api/retrievals endpoint allows you to seamlessly query your indexed data, complete with optional re-ranking for enhanced precision.
Robust Data Processing:
Dcup automatically handles data ingestion, chunking, and indexing to ensure your documents are always ready for efficient retrieval.
Developer-Friendly:
With easy-to-use APIs and clear documentation, you can have your RAG pipeline up and running in minutes. Dcup is designed with modularity and flexibility in mind, so you can customize and scale as your project grows.
Quick Start Guide:
Self-Host with Docker Compose:
- Clone the repository.
- Update your environment configuration using .env.example.
- Create containers with:
docker compose -f docker-compose.prod.yml --env-file .env upExplore the Retrieval API:
Send POST requests to /api/retrievals to retrieve relevant data chunks. Check out our documentation for full details on request and response formats.
For Developers:
Dcup is modular and open for contributions. Get started by exploring the code, reviewing our contributing guide, and joining the community.