Thursday, 5 June 2014

Joiner Transformation

Joiner transformation is an active and connected transformation. This can be used to join two sources coming from two different locations or from same locations. For example, to join a flat file and a relational source or to join two flat files  or to join a relational source and XML source.

In order to join two sources, there must be at least one matching port. While joining two sources it is a must to specify one source as master and the other as detail.

The joiner transformation supports the following types of joins:


  • Normal 
  • Master outer
  • Detail outer 
  • Full outer


Normal join discards all the rows of data from the master and detail source that do not match, based on the condition.

Master outer join discards all the unmatched rows from the master source and keeps all the rows from the detail source and the matching rows from the master source.

Detail outer join keeps all the rows of data from the master source and the matching rows from the detail source. It discards the unmatched rows from the detail source.

Full outer join keeps all rows of data from both the master and detail sources.

DBT - Models

Models are where your developers spend most of their time within a dbt environment. Models are primarily written as a select statement and ...