Thursday, 15 May 2014

Workflow Manager

Overview:
In the Workflow Manager, we define a set of instructions called a workflow to execute mappings we build in the Designer. Generally, a workflow contains a session and any other task we may want to perform when you run a session. Tasks can include a session, email notification, or scheduling information. You connect each task with links in the workflow.

We can also create a worklet in the Workflow Manager. A worklet is an object that groups a set of tasks. A worklet is similar to a workflow, but without scheduling information. You can run a batch of worklets inside a workflow.

After We create a workflow, We run the workflow in the Workflow Manager and monitor it in the Workflow Monitor.

Workflow Manager Tools

To create a workflow, we first create tasks such as a session, which contains the mapping you build in the Designer. We can then connect tasks with conditional links to specify the order of execution for the tasks we created. The Workflow Manager consists of three tools to help we develop a workflow:

  • Task Developer. Use the Task Developer to create tasks you want to run in the workflow.
  • Workflow Designer. Use the Workflow Designer to create a workflow by connecting tasks with links. We can also create tasks in the Workflow Designer as we develop the workflow.
  • Worklet Designer. Use the Worklet Designer to create a worklet.

Workflow Tasks
We can create the following types of tasks in the Workflow Manager:

  • Assignment. Assigns a value to a workflow variable.
  • Command. Specifies a shell command to run during the workflow.
  • Control. Stops or aborts the workflow.
  • Decision. Specifies a condition to evaluate.
  • Email. Sends email during the workflow.
  • Event-Raise. Notifies the Event-Wait task that an event has occurred.
  • Event-Wait. Waits for an event to occur before executing the next task.
  • Session. Runs a mapping you create in the Designer.
  • Timer. Waits for a timed event to trigger.

DBT - Models

Models are where your developers spend most of their time within a dbt environment. Models are primarily written as a select statement and ...