transform
A transform step can be used to merge, filter, or reformat data using HCL functions. While you can transform the data "inline", it is often useful to:
- transform the data once and use the transformed data in multiple places
- transform the data through multiple distinct steps to makes it easier to troubleshoot / maintain
- perform conditional logic as part of the data transformation
pipeline "transform_example" {step "http" "whos_in_space" {url = "http://api.open-notify.org/astros"method = "get"}step "transform" "get_spacecraft" {value = distinct(step.http.whos_in_space.response_body.people[*].craft)}step "transform" "get_astros" {value = distinct(step.http.whos_in_space.response_body.people[*].name)}output "astronauts" {value = step.transform.get_astros.value}output "spacecraft" {value = step.transform.get_spacecraft.value}}
Arguments
Argument | Type | Optional? | Description |
---|---|---|---|
value | Any | Required | The step value. Usually, this is the field where you will transform the data |
This step also supports the common step arguments and attributes.