Python for Databricks Asset Bundles extends Databricks Asset Bundles so that you can:
- Define jobs and pipelines as Python code. These jobs can coexist with jobs defined in YAML.
- Dynamically create jobs and pipelines using metadata.
- Modify jobs and pipelines defined in YAML or Python during bundle deployment.
Documentation is available at https://docs.databricks.com/dev-tools/cli/databricks-cli.html.
Reference documentation is available at https://databricks.github.io/cli/python/
To use databricks-bundles, you must first:
-
Install the Databricks CLI, version 0.285.0 or above
-
Authenticate to your Databricks workspace if you have not done so already:
databricks configure
-
To create a new project, initialize a bundle using the
experimental-jobs-as-codetemplate:
databricks bundle init experimental-jobs-as-codeDatabricks CLI use is subject to the Databricks License and Databricks Privacy Notice, including any Usage Data provisions.