HelloDATA BE Pod Operator Params (OpenSource)

• One time setup
• When coming back...
• Deployment
  • Prerequisites
  • Prod Deployment
• Install Package
• Get Tokens
  • Push Tokens

One time setup

1. Create local Python environment

python -m venv venv

2. Activate environment

# For Linux / MacOS
source venv/bin/activate

# For Windows Powershell
. ./venv/Scripts/Activate.ps1

3. Install dependencies

pip install -r requirements.txt

4. Activate pre-commit hooks

pre-commit install

When coming back...

Make sure to reactivate Pythons venv:

# For Linux / MacOS
source venv/bin/activate

# For Windows Powershell
. ./venv/Scripts/Activate.ps1

Deployment

Prerequisites

Increase version number using bump-my-version (commit all changes beforehand).

# Bump version
# bump-my-version bump <patch|minor|major> <config-files>
bump-my-version bump patch pyproject.toml

Prod Deployment

Push to main branch and see new version on PyPI

The action executes the following commands (can also be executed locally):

pip install -r requirements.txt
python -m build
FILE_NAME=`ls ./dist/ | grep .whl`
curl -F package=@dist/$FILE_NAME https://'${{ secrets.PACKAGE_INDEX_TOKEN }}'@push.fury.io/datenstreambedag/

Install Package

The uploaded package can be installed with the following command:

pip install --index-url https://pypi.fury.io/datenstreambedag/ hellodata_be_airflow_pod_operator_params

Get Tokens

To get the push / deploy tokens, navigate to the according page on Gemfury and create the token you need.

Push Tokens

Push tokens are used to push new packages to the registry.