Skip to content

API ReferenceΒΆ

Complete API reference for all Kedro-Dagster classes and functions. Use the search box to filter, or click any name to see full documentation.

The API is organized by module:

  • Translators (translator, catalog, nodes, pipelines, kedro): convert Kedro projects into Dagster definitions
  • Creators (dagster): build Dagster executors, schedules, and loggers from configuration
  • Datasets (datasets): custom dataset types for Dagster partitions and Nothing-typed assets
  • Configuration (config): Pydantic models for dagster.yml sections (jobs, executors, schedules, loggers)
  • Logging (logging): unified Kedro/Dagster logger and formatters
  • CLI (cli): kedro dagster command implementations
  • Utilities (utils): naming, formatting, and helper functions used internally
Name Type Module Description
CatalogTranslatorClasskedro_dagster.catalogTranslate Kedro datasets into Dagster IO managers.
CeleryDockerExecutorOptionsClasskedro_dagster.configOptions for the Celery-based executor which launches tasks as Docker containers.
CeleryExecutorOptionsClasskedro_dagster.configOptions for the Celery-based executor.
CeleryK8sJobExecutorOptionsClasskedro_dagster.configOptions for the Celery-based executor which launches tasks as Kubernetes jobs.
CliContextClasskedro_dagster.utilsRuntime context passed to CLI command handlers.
commandsFunctionkedro_dagster.cliTop-level Kedro-Dagster CLI group.
dagster_colored_formatterFunctionkedro_dagster.loggingCreate a colored formatter for Dagster logging using coloredlogs.
dagster_commandsFunctionkedro_dagster.cliRun project with Dagster.
dagster_json_formatterFunctionkedro_dagster.loggingCreate a JSON formatter for Dagster logging.
dagster_rich_formatterFunctionkedro_dagster.loggingCreate a rich console formatter for Dagster logging.
DagsterCodeLocationClasskedro_dagster.translatorA typed container for all artifacts that make up a Dagster code location.
DagsterNothingDatasetClasskedro_dagster.datasetsA Kedro dataset used to represent placeholder outputs.
DagsterPartitionedDatasetClasskedro_dagster.datasetsKedro dataset that enables Dagster partitioning.
DaskClusterConfigClasskedro_dagster.configConfiguration for the Dask cluster.
DaskExecutorOptionsClasskedro_dagster.configOptions for the Dask executor.
DockerExecutorOptionsClasskedro_dagster.configOptions for the Docker-based executor.
ExecutorCreatorClasskedro_dagster.dagsterCreate Dagster executor definitions from Kedro-Dagster configuration.
find_kedro_projectFunctionkedro_dagster.utilsLocate the Kedro project root starting from ``current_dir``.
format_dataset_nameFunctionkedro_dagster.utilsConvert a dataset name so that it is valid under Dagster's naming convention.
format_node_nameFunctionkedro_dagster.utilsConvert a node name so that it is valid under Dagster's naming convention.
format_partition_keyFunctionkedro_dagster.utilsFormat a partition key into a Dagster-safe suffix (``^[A-Za-z0-9_]+$``).
get_asset_key_from_dataset_nameFunctionkedro_dagster.utilsGet a Dagster AssetKey from a Kedro dataset name and environment.
get_dagster_configFunctionkedro_dagster.configGet the Dagster configuration from the ``dagster.yml`` file.
get_dataset_from_catalogFunctionkedro_dagster.utilsRetrieve a dataset instance from a Kedro catalog across versions.
get_filter_params_dictFunctionkedro_dagster.utilsExtract filter parameters from a pipeline config dict.
get_match_pattern_from_catalog_resolverFunctionkedro_dagster.utilsReturn the matching dataset pattern from a CatalogConfigResolver.
get_mlflow_resource_from_configFunctionkedro_dagster.utilsCreate a Dagster resource definition from MLflow config.
get_mlflow_run_urlFunctionkedro_dagster.utilsReturn a fully functional MLflow UI URL for the currently active run.
get_partition_mappingFunctionkedro_dagster.utilsGet the appropriate partition mapping for an asset based on its downstream datasets.
getLoggerFunctionkedro_dagster.loggingReturn a logger, preferring Dagster's logger when a run is active.
initFunctionkedro_dagster.cliScaffold or refresh Dagster integration files for the current Kedro project.
InProcessExecutorOptionsClasskedro_dagster.configOptions for the in-process executor.
is_mlflow_enabledFunctionkedro_dagster.utilsCheck if MLflow is enabled in the Kedro context.
is_nothing_asset_nameFunctionkedro_dagster.utilsReturn True if the catalog entry is a DagsterNothingDataset.
JobOptionsClasskedro_dagster.configConfiguration options for a Dagster job.
K8sJobConfigClasskedro_dagster.configConfiguration for Kubernetes jobs.
K8sJobExecutorOptionsClasskedro_dagster.configOptions for the Kubernetes-based executor.
KedroDagsterConfigClasskedro_dagster.configMain configuration class representing the ``dagster.yml`` structure.
KedroProjectTranslatorClasskedro_dagster.translatorTranslate a Kedro project into a Dagster code location.
KedroRunTranslatorClasskedro_dagster.kedroTranslator for Kedro run params.
LoggerCreatorClasskedro_dagster.dagsterCreate Dagster logger definitions from Kedro-Dagster configuration.
LoggerOptionsClasskedro_dagster.configOptions for defining Dagster loggers.
MultiprocessExecutorOptionsClasskedro_dagster.configOptions for the multiprocess executor.
NodeTranslatorClasskedro_dagster.nodesTranslate Kedro nodes into Dagster ops and assets.
parse_dagster_definitionFunctionkedro_dagster.datasetsParse and instantiate a partition definition class using a config.
PipelineOptionsClasskedro_dagster.configOptions for filtering and configuring Kedro pipelines within a Dagster job.
PipelineTranslatorClasskedro_dagster.pipelinesTranslator for Kedro pipelines to Dagster jobs.
render_jinja_templateFunctionkedro_dagster.utilsRender a Jinja template from a file or string.
scaffold_dagster_filesFunctionkedro_dagster.cliScaffold or refresh Dagster integration files for the current Kedro project.
ScheduleCreatorClasskedro_dagster.dagsterCreate Dagster schedule definitions from Kedro configuration.
ScheduleOptionsClasskedro_dagster.configOptions for defining Dagster schedules.
unformat_asset_nameFunctionkedro_dagster.utilsConvert a Dagster-formatted asset name back to Kedro's naming convention.
write_jinja_templateFunctionkedro_dagster.utilsRender and write a Jinja template to a destination file.