Pattern Development

In this guide, you will learn how to create a pattern in MetaKraftwerk. First, it explains what a pattern is and which target platforms (Integrations) MetaKraftwerk supports, before detailing the actual pattern development process.

The guide is divided into the following subchapters:

What is a Pattern?

First, learn what a pattern is and how it can help you automate your development.

Integrations

With MetaKraftwerk, patterns can be developed for various target platforms. Learn which platforms are supported and how MetaKraftwerk integrates with them.

How to create a Pattern

A guide to creating your first pattern.

Instance Metadata Schema

Patterns define a so-called instance metadata schema. Learn what it is and how you can use it.

File Templates

A pattern usually consists of multiple file templates. This section is an introduction to developing file templates.

Modularity

Learn how to build patterns using reusable expressions in a modular manner.

Pattern Versioning

During pattern development, you can commit the current version at any time, allowing you to work iteratively and revert to previous versions whenever needed.

Further reading

Data Integration Patterns – Explanation & Overview (by snaplogic.com)

Why data pipeline patterns are SnapLogic’s best kept secret (by snaplogic.com)

4 Key Patterns to Load Data Into A Data Warehouse (by startdataengineering.com)

What is a staging area? (by startdataengineering.com)

Data Load Patterns 101: Full Refresh and Incremental (by tobikodata.com)

Warehouse Load Patterns – Part 1 – Requirements and General Patterns (by red-gate.com)

Warehouse Load Patterns – Part 2 – Load Patterns (by red-gate.com)

Data Loading in Data warehouse (by geeksforgeeks.org)

Introduction to Designing Data Load Patterns (by confessionsofadataguy.com)