Snowflake
Important
This guide is only relevant if you are using MetaKraftwerk's Snowflake integration. If you are only developing ETL patterns, you can skip this page.
Snowflake is a cloud-based data warehouse platform with built-in scalability and support for SQL-based ELT processing.
Uploading Templates from Snowflake
Templates are created as SQL scripts for DDL, transformations, and data loading logic, then uploaded to MetaKraftwerk.
These templates are parameterized using placeholders, which MetaKraftwerk replaces with instance metadata during instantiation.
Creating Template Scripts
Typical files include:
- DDL scripts for tables, views, and stages
- Transformation SQL (INSERT, MERGE, UPDATE)
- Task and stream definitions
Upload Templates to MetaKraftwerk
- Organize your scripts in folders (e.g.
/ddl,/transform,/load). - Use placeholders like
${DATABASE},${SCHEMA},${TABLE},${STAGE_PATH}. - Upload the scripts to the pattern in MetaKraftwerk.