transform

A transform step can be used to merge, filter, or reformat data using HCL functions. While you can transform the data "inline", it is often useful to:

  • transform the data once and use the transformed data in multiple places
  • transform the data through multiple distinct steps to makes it easier to troubleshoot / maintain
  • perform conditional logic as part of the data transformation
pipeline "transform_example" {
step "http" "whos_in_space" {
url = "http://api.open-notify.org/astros"
method = "get"
}
step "transform" "get_spacecraft" {
value = distinct(step.http.whos_in_space.response_body.people[*].craft)
}
step "transform" "get_astros" {
value = distinct(step.http.whos_in_space.response_body.people[*].name)
}
output "astronauts" {
value = step.transform.get_astros.value
}
output "spacecraft" {
value = step.transform.get_spacecraft.value
}
}

Arguments

ArgumentTypeOptional?Description
valueAnyRequiredThe step value. Usually, this is the field where you will transform the data

This step also supports the common step arguments and attributes.