Skip to content

Welcome to Kedro-Dagster's documentation

Kedro-Dagster is an integration plugin that lets you deploy Kedro data pipelines on Dagster without modifying your existing project code. It translates your catalog, nodes, and pipelines into Dagster assets, ops, and jobs so you can schedule, monitor, and inspect runs through Dagster's UI and execution backends.

  • Get Started in 5 Minutes


    Install Kedro-Dagster and run your first pipeline in Dagster.

    Getting Started

  • How-to Guides


    Step-by-step instructions.

    How-to Guides

  • Understand the Design


    Learn how Kedro-Dagster maps catalogs, nodes, and pipelines to Dagster assets, ops, and jobs.

    Concepts

  • See It In Action


    Explore a complete example with partitions, MLflow, and more.

    Example Project

  • Reference


    Complete field tables for dagster.yml, all CLI flags, and the Python API.

    Configuration Reference | CLI Reference | API Reference

  • Need Help?


    Find answers to common questions and troubleshooting tips.

    Troubleshooting

Key capabilities

  • No code changes: integrate Dagster without touching your Kedro datasets, catalog, or pipelines.
  • Full orchestration: schedule, monitor, and inspect Kedro pipelines through Dagster's UI, asset lineage tracking, and cloud-native executors.
  • Configuration-driven: define jobs, executors, schedules, and loggers in a dagster.yml per environment.
  • Ecosystem compatibility: works with Kedro hooks, Kedro-MLflow, and all Dagster-supported execution backends (multiprocess, Docker, Kubernetes, Dask, Celery).

Lineage graph of assets involved in the specified jobs Lineage graph of assets involved in the specified jobs

Example of a Dagster Asset Lineage Graph generated from a Kedro project.

License

This project is licensed under the terms of the Apache-2.0 License.

Acknowledgements

This project is maintained by stateful-y, an ML consultancy specializing in MLOps and data science & engineering. If you're interested in collaborating or learning more about our services, please visit our website.

Made by stateful-y