Derive new columns or modify existing columns during ingestion by applying expressions, functions, or logic.
ingestionConfig
. The key part of this is the transformConfigs
, where each transform is defined as a mapping between a column name and an expression.
Here’s a basic structure:
columnName
: The name of the column to be created.transformFunction
: The expression or function that generates the column’s value.courses
), set the type as dimension
with mv(string)
for handling arrays.
created_ts
with the format EPOCH
and granularity SECONDS
.
firstName
and lastName
) into a new column called name
.