Building pipelines with components
This feature is considered in a preview stage and is under active development. It can change significantly, or be removed completely. It is not considered ready for production use.
Creating a project with components
After installing dependencies, you can scaffold a components-ready project. In the example below, we scaffold a project called jaffle-platform:
Adding components to your project
To add components to your project, you can instantiate them from the command line, which will create a new directory inside your components/ folder that contains a component.yaml file.
Adding components to your project with Python
In some cases, you may want to add a component to your project with Python rather than a component.yaml file.
Customizing components
You can customize the behavior of a component beyond what is available in the component.yaml file.
Adding attributes to assets in a subdirectory
Attaching and modifying meta information on definitions such as assets is important in Dagster projects. You want to have groups, teams, owners, kinds, tags, and metadata set correctly to organize definitions and ensure that other tools and processes that rely on them correctly function.