Skip to content

Asset bundle does not deploy the dependencies for Lakeflow Pipelines correctly #4252

@moattarwork

Description

@moattarwork

Describe the issue

Defining the packages as dependency via configuration tag in yaml is not working. The functionality seems to be correct because when you add the dependency manually via UI, it works but publishing the dependency as part of DAB's pipeline configuration ignores configuration > dependencies entirely.

Configuration

Please provide a minimal reproducible configuration for the issue

Steps to reproduce the behavior

Please list the steps required to reproduce the issue, for example:

  1. Define the dependencies in the yaml configuration for pipeline
  2. Run databricks bundle deploy ...
  3. Navigate to the pipeline configuration
  4. See dependencies are missing
Image

Expected Behavior

the dependency to pip package or via requirements.txt is configured correctly for the pipeline

Actual Behavior

After the deployment, all the configuration is correct for the pipeline except the dependencies that are missing from the pipeline configuration

OS and CLI version

  • Linux
  • CLI Version: 0.257.0

Is this a regression?

No it didn't work from the start and in your api specification, the configuration is tagged as beta

Metadata

Metadata

Assignees

Labels

BugSomething isn't workingDABsDABs related issues

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions