monitoringGranularity
is PT1H
. This means ThirdEye will aggregate data into buckets of 1 hour. monitoringGranularity
can be changed to 15 minutes PT15M
or daily P1D
, ThirdEye will generate the corresponding SQL query.
A generated query looks like this:
GROUP BY DATETIMECONVERT(<timeColum>, <timeColumnFormat>, 1:MILLISECONDS:EPOCH, <monitoringGranularity>)
means: take the time column, convert it to milliseconds and group by buckets of <monitoringGranularity>
.
This time transformation can make the query slow, especially when there are a lot of rows in the Pinot table.
To avoid this performance hit, you can add a time column that corresponds to the specifichttps://<your.thirdeye.instance.cloud>/configuration/datasets/all
. You can click on a dataset there to edit it.
Consider this dataset configuration:
PT1H
:
timeColumns
metadata:
PT1H
, ThirdEye will optimize the query using the hourlyBuckets
column. For other configurations, it will use the default time column. You can add as many precomputed time columns as you want.
For time format see timeFormat strings.