Skip to content

Conversation

@atasoglu
Copy link
Owner

No description provided.

…vironment support

- Introduced command-line arguments for pushing datasets to Hugging Face Hub (`--push-to-hub`, `--repo-id`, `--hf-token`, `--private`)
- Updated generate command to optionally push generated datasets directly to HF Hub
- Added environment variable support for HF token via `.env` file using `python-dotenv`
- Created new `hf_hub.py` module for HF Hub upload implementation
- Enhanced README with example commands for generating and pushing datasets
- Updated `.env.example` to include optional `HF_TOKEN` for HF Hub authentication
… 0.5.0

- Introduces push_to_hub() function for direct dataset uploads
- Supports JSONL files, manifest, and dataset cards with metadata
- Adds CLI flags for repository configuration and privacy options
- Includes optional dependency on huggingface_hub>=0.20.0
- Provides example and test suite for HF Hub functionality
@atasoglu atasoglu self-assigned this Nov 10, 2025
@atasoglu atasoglu merged commit 3d861cb into main Nov 10, 2025
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants