Pinot Version | 1.0.0 |
---|---|
Code | startreedata/pinot-recipes/query-by-segment |
jq
to structure the data in the key:payload
structure that Kafka expects:
Column Name | Column Type | Data Type | Description |
---|---|---|---|
$hostName | Dimension | STRING | Name of the server hosting the data |
$segmentName | Dimension | STRING | Name of the segment containing the record |
$docId | Dimension | INT | Document id of the record within the segment |
$segmentName
, which we can use like this to count the number of records in each segment:
$segmentName | count(*) |
---|---|
events__0__142__20230330T1004Z | 100000 |
events__0__27__20230330T1003Z | 100000 |
events__0__123__20230330T1004Z | 100000 |
events__0__15__20230330T1003Z | 100000 |
events__0__185__20230330T1004Z | 100000 |
events__0__96__20230330T1003Z | 100000 |
events__0__169__20230330T1004Z | 100000 |
events__0__160__20230330T1004Z | 100000 |
events__0__77__20230330T1003Z | 100000 |
events__0__71__20230330T1003Z | 100000 |
count | ts | uuid |
---|---|---|
666 | 2023-03-30 10:03:04.498 | 8e4f5bb3-ad5c-45ec-89cb-946acee52625 |
298 | 2023-03-30 10:03:04.498 | f439c3ad-86a1-4043-895e-681d5497cda0 |
128 | 2023-03-30 10:03:04.498 | 9e29317f-c8fd-44d8-8313-aa28a80f1e5e |
40 | 2023-03-30 10:03:04.498 | 697e2dbc-aee5-466e-b24e-763b18aff003 |
659 | 2023-03-30 10:03:04.498 | 8d981789-7e61-4a25-81d1-b62616e877e8 |
436 | 2023-03-30 10:03:04.498 | f4a883f3-3e6a-4169-a7ca-2469a5100ef2 |
408 | 2023-03-30 10:03:04.498 | dc21499e-cdb3-4fae-93c1-0b9bd0233ae0 |
457 | 2023-03-30 10:03:04.498 | 0de9a860-5af3-4155-93c9-d396df3cd0b3 |
197 | 2023-03-30 10:03:04.498 | c4ddd15a-814f-4036-9eee-3121f59783f8 |
362 | 2023-03-30 10:03:04.498 | 11b00463-2587-4838-9f05-089c05ad9fea |