November 5, 2026
From this release, one Data Portal version serves every StarTree Cloud release line. A feature that needs a newer Pinot version turns on only on clusters that have it, and its note below names the minimum StarTree Cloud release.
New Features
-
Proactive query analysis
The Insights tab in Query Insights now sets up and runs proactive query analysis. On a schedule you choose (daily, every 6 hours, or weekly), it picks the slowest queries from the query log, runs them through Query Analyzer, and sends a digest of the recommendations to Slack, email, or both. You can also start a run yourself with Run now. Every run stays in a timeline showing what it analyzed and found, and a Recommendations view lists the open fixes for queries that were slow in the last 7 days. Before setup, the tab checks what’s needed and tells you what’s missing: Query Analyzer with usage consent, query logging, and query fingerprinting on the brokers. See Set Up Proactive Analysis for the steps. -
Slack and email channels for table health alerts
Table health alerts now go to notification channels. A channel is an email address or a Slack incoming webhook, and it covers every table and check or only the ones you pick. Each channel has its own schedule: alerts as they happen (on by default), a digest every 1, 6, 12, or 24 hours, and reminders for checks that keep failing. Existing email recipients carry over as channels and behave as before. -
Kafka Retention health check
Flags realtime tables whose Kafka topic retention isn’t more than twice the segment flush threshold. Without that headroom, a server that falls behind or restarts can ask Kafka for offsets that are already deleted, and those rows never arrive. The fix either lowers the flush threshold, pre-filled per topic, or gives youkafka-configscommands to raise retention. -
Dictionary Cardinality health check
Flags dictionary-encoded columns whose distinct values make up 10% or more of a segment’s rows, by default. At that point the dictionary saves little space and adds a lookup on every read. The fix removes dictionary encoding from the columns you pick and reloads segments. Columns that still need their dictionary, such as those with an inverted or FST index, are listed but locked, with the reason. As with Kafka Retention, tables already in this state start failing on the next health run. Available on StarTree Cloud 0.16 and later. -
Edit schema columns inline and in bulk
In the create-table wizard and on a table’s Schema tab, you can change a column’s field type, data type, multi-value, not-null, max length, and default value directly in its row instead of opening a dialog for each column. Select several columns to set one value on all of them. Search, filter, and sort while you edit, and undo any change or reset everything before you save. -
Bulk apply indexes
On the Indexes tab, select many columns and add or remove an index, or change encoding, in one action. Indexes with settings, such as bloom filter, text, or JSON, open their form once and apply the values to every selected column. Filter by “Has index” or “Missing index” to check coverage before you save. A bulk change applies to all the selected columns or to none; hover a choice first to see which columns it may fail on and why. -
Ingestion charts for realtime tables
The Monitoring tab on realtime tables now has Ingestion and Tasks sub-tabs. Ingestion charts ingestion delay, offset lag, throttling, ingestion rate, and errors from Grafana over a time range you pick. Tasks holds the existing task list. If Grafana isn’t configured on the cluster, the tab says so. Hybrid tables aren’t covered yet. -
Compression stats on the Storage tab
A new Compression sub-tab under Storage shows a table’s uncompressed size, stored size, and compression ratio, with a per-column breakdown by encoding. If the table isn’t recording compression stats yet, Record Compression Stats turns them on, and the figures fill in as segments are measured. Available on StarTree Cloud 0.16 and later, for Pinot tables only (not External Tables).
Enhancements
-
Query Analyzer consent from any Analyze button
Every Analyze button now opens the usage consent dialog in place instead of pointing you to Settings. Accepting it takes you straight into the analysis. -
Fewer repeat table health alerts
A check that flips between failing and passing no longer sends a burst of emails. Data Portal now ignores out-of-date health results from the cluster and waits out a per-check cooldown before alerting on the same check again. -
Clearer Segment Reload and Segment Assignment findings
Both checks now lead with a one-line verdict and summary tiles. More info lists the servers that need a reload and what changed, or the servers added and removed for an assignment change. When servers don’t report, Segment Reload says it couldn’t confirm the result instead of showing a pass or a fail. -
More useful error messages
Errors now ask “Was this helpful?” with a thumbs up or down, in Query Analyzer too. When an AWS call fails, for example an IAM role that can’t be assumed, the details now show the role and principal ARNs and the account ID so you can check them against your trust policy; credentials stay masked. Failed file uploads and previews get a specific error for 13 more cases, such as an unsupported format, a missing file extension, or a read timeout. -
Connection forms match your cluster
Data source types and sign-in options now appear only when your cluster’s Pinot version supports them. On StarTree Cloud 0.15, for example, GCS Data Lake, Unity Catalog, Apache Polaris, Snowflake Open Catalog, and IAM role sign-in for AWS Glue and S3 Tables catalogs are hidden. Saved connections and tables that already use them keep working. -
API token access keys in Security Manager
The API tokens list has a new Access key column, so you can match a token to the key in a request before you revoke it. Legacy service tokens with no roles assigned now appear in the list too. -
6-hour flush threshold for new realtime tables
New realtime tables created in Data Portal default to a 6-hour segment flush threshold instead of 24 hours, matching Pinot’s default, so a topic with 1 day of retention passes the Kafka Retention check. Low-throughput tables will seal up to 4x more segments a day and lean more on merge/rollup or compaction to keep the segment count down. Existing tables keep their threshold.
Bug Fixes
-
Fetch Preview in the column dialog
Fetch Preview in the Add Column and Edit Column dialogs works again on saved tables that use stored credentials, such as a Kafka SASL key and secret. It had been failing authentication. -
Time column in table creation
Changing the default time column to a dimension no longer breaks the preview, and the time column now stays in step with the schema and your choice. -
External Table lag
An External Table is no longer shown as behind when nothing reports its lag, and lag reads correctly on StarTree Cloud 0.16 clusters.
October 14, 2026
Enhancements
-
Table Health Dashboard respects table permissions
Health checks and their actions now depend on what you’re allowed to do on each table, instead of requiring system admin. Readers can see health and manage their own alert subscriptions. Remediation actions need table admin rights. Subscribe, unsubscribe, mute, and unmute buttons now match your current state, and a health check runs again on its own after you act on it from Data Portal. -
Reload impact estimate is back
Reload all and the reload prompts on the Storage tab show the size and duration estimate again on clusters running a Pinot version with the dry-run fix. On older versions you get the plain reload confirmation. -
15 days of Minion task history
Task Monitoring dashboard now displays task plans, tasks, and subtasks, which keeps 15 days of history. Earlier runs stay visible after the controller has dropped them. -
Clearer errors for External Table sync failures
When a sync fails because the catalog rejected your credentials, Data Portal now reports that cause and tells you to re-enter the credentials. Previously, a long stack trace in the failure hid the real cause and you got a generic “try again” error instead. The Sync Status dialog and the sync failure banner show the same classified error. -
Unclassified errors open with details expanded
Errors that don’t map to a specific error code (DPE-0000) now show the technical detail by default, since that’s the only useful information in them. Mapped errors keep the detail collapsed. -
Table preview no longer assumes DefaultTenant
The preview step of table creation now picks from the tenants that exist on your cluster. Previously it failed with a generic error on clusters that had noDefaultTenant. -
Generated table configs drop
replicasPerPartition
New table configs no longer include the deprecatedsegmentsConfig.replicasPerPartition. Replication is set bysegmentsConfig.replicationalone. Existing tables aren’t changed.
Bug Fixes
-
Tenant rebalance with many tables
Rebalancing a tenant with hundreds of selected tables no longer fails with HTTP 431. The table list is now sent in the request body instead of the URL. -
Connection dialog feedback
Testing a connection without a name now shows an error and scrolls to the missing field instead of failing silently. A failed test or create now shows one toast instead of two.
September 22, 2026
New Features
-
Actionable error messages across Data Portal
Errors now follow a single contract: a stable error code, a plain-language title, the specific cause, suggested remediation steps, and a correlation ID you can paste into a support ticket. Raw technical detail is preserved but collapsed by default, and the innermost cause is no longer dropped when an error is wrapped — so an S3 region redirect or an Iceberg authorization failure reads as exactly that instead of a generic indexing failure. Every error code maps to a published troubleshooting guide in the error code reference, so you can look up what a code means and how to resolve it without opening a ticket. -
Query Insights
A new view over the cluster’s query log shows total queries, error count and error rate, and p50/p95/p99 latency for a selected time window, filterable by table and query engine. Top slow and top expensive queries are grouped by query template so parameterized queries collapse into a single row, errors break down by class — timeouts, execution failures, planning failures, quota rejections — and any logged query can be sent straight to Query Analyzer. A dedicated tab lists the queries currently running on the cluster. Available when Query Logger is enabled on the cluster.
Coming soon: AI Insights. An AI-powered proactive query analyzer will review the queries run on this cluster in the background and surface meaningful insights, such as recurring slow patterns, missing indexes, and tuning opportunities across your workload, without you having to pick a query first. This has since shipped as proactive query analysis.
- GA for Connection Lifecycle Management
Editing and deleting saved connections is now enabled for everyone rather than sitting behind a feature flag. Connection details also list every table using a connection, instead of showing only the first.
Enhancements
-
Query History with usage statistics
Query History now summarizes what has been running — volume, success and failure counts, and latency — rather than listing raw entries, making it faster to spot a regression in your own query workload. -
Reload checks explain why a reload is needed
Table health now reports the specific reasons a reload check is failing and what a reload would change, instead of only flagging that one is required. -
Star-tree index size and tiered storage in Segment Analyzer
Segment metadata now reports star-tree index size, and segments on tiered storage report their index information instead of showing gaps. -
Tasks moved under Monitoring
Tasks has moved from the Data & AI group to the Monitoring group in the main navigation, next to the other operational views. -
Cleaner state after table deletion
Deleting a table now clears its health check state and saved preferences, so a table recreated with the same name starts clean.
Bug Fixes
-
Table preview on mixed-type JSON columns
Schema inference now widens the inferred type across sampled values instead of locking to the type of the first one, fixing intermittent 500s when previewing JSON data with mixed types. -
Empty and duplicated error toasts
An error with no matching handler now renders a cause, a details control, and a reference instead of an empty toast, and Query History no longer shows a raw 403 toast on top of the in-page permission notice or renders failed statistics as zeros.
August 27, 2026
New Features
- Overview tab on the Table Health Dashboard
The Table Health Dashboard now opens on an Overview tab summarizing the state of each component at a glance, so you can see where to look before drilling into individual tables and checks.
Enhancements
-
Better compression by default in generated table configs
Table configs generated during onboarding now default RAW (no dictionary) dimension columns to ZSTANDARD compression, which compresses variable-width strings, JSON, and bytes payloads materially better than the previous default — a direct win for logging-style tables and tiered storage. -
Storage Breakdown with no indexes
The storage breakdown now shows a “no index found” message instead of breaking when a table has no indexes.
Bug Fixes
-
IAM role details and sync status for External Table connections
Fixed connection lifecycle gaps where the IAM node role and ARN were not populated, and where associated-table lookups misreported External Table sync status. -
StarTree indexes on timestamp index derived columns
Table configs that reference timestamp-index derived columns in the StarTree index or in query expression overrides now save from Data Portal, instead of failing validation and forcing a REST API workaround.
August 11, 2026
New Features
-
Monitoring dashboard for External Tables
Table details now open with a Monitoring tab and an at-a-glance ingestion summary under the table title: sync status, data-synced progress, data synced till, files pending, records synced, and the next scheduled run, auto-refreshing every 15 seconds. External Tables get a clear sync-state model — healthy, lagging, running, initial sync, or failed — showing exactly how far queryable data trails the upstream catalog, with one-click Sync Now or Retry Sync and a “not ready to query” indicator until the first snapshot lands. -
Apache Polaris, Snowflake Open Catalog, and Horizon Catalog support for External Tables
External Table onboarding now supports Apache Polaris, Snowflake Polaris (Open Catalog), and Snowflake Horizon Catalog as first-class Iceberg REST catalog options, with no manual API workarounds. -
Segment-level storage drill-down
Building on Table Storage Usage from earlier releases, the table details page now includes segment and server instance views, so you can drill into which segments and indexes consume how much storage — and where they live — right from the Storage section. -
IAM role–based access for External Table metastore and storage
Configure metastore and storage access for External Tables using IAM roles across all AWS-backed catalogs and S3 data lake sources, instead of static credentials. Setup screens now display the External ID, StarTree account ID, and cluster node role you need when creating the trust policy. -
PromQL support in Query Console
Query Console now supports PromQL alongside SQL, and time-series query results render as interactive graphs — so you can explore metrics-style data visually without leaving Data Portal. -
In-product documentation for External Tables
The documentation panels opens inline in the External Table creation flow, so you can read about each step without leaving the UI. The panels include links to the full documentation for deeper dives.
Enhancements
-
Query History and Running Queries in the main navigation
Query History and Running Queries have moved out of the Query Console’s inner tabs into the primary navigation under Query, making it much quicker to check query volume, success rates, and slow queries. -
Query Analyzer effort modes
Choose between Low and High effort when analyzing a query — Low for fast feedback, High for deeper analysis with query rewrites, rewrite repair, and scope reduction. -
More index types for External Tables
External Tables now support configuring FST, IFST, StarTree, and Timestamp indexes from the UI, extending the index coverage added in recent releases. -
Storage usage for External Tables
Table storage usage is now available for External Tables, following performance optimizations to the underlying storage-usage API. -
Full detail view for saved connections
Existing Connections now offers a per-connection details view listing every configured parameter with copy buttons and a JSON view. Credentials stay masked until you explicitly reveal them. -
Better-guided External Table onboarding
Building on last release’s onboarding cleanup, setup screens now surface provider-side context such as AWS Glue database descriptions, documentation links appear throughout the creation flow, and system schemas likeinformation_schemano longer clutter the namespace dropdown. -
Task failure causes surfaced first
Task details now open on the generation logs tab by default, so root causes like disk-usage breaches or segment-count limits are visible immediately instead of buried behind the task list.
Bug Fixes
-
Easier way to configure Cluster config keys
Adding and removing keys from the cluster configuration in Data Portal is now more intuitive, with a single Add button and a Remove icon for each key instead of a confusing two-step process. -
Grafana charts match task execution time
Grafana charts for completed tasks now show the task’s actual execution window instead of the current time range. -
Faster, more reliable sign-in
Fixed an authentication issue where loading auth details could stall for over two minutes or return empty configuration, causing “Unable to authenticate” errors and retry loops at login. -
Delta Lake ingestion no longer fails with Delta Kernel enabled
Fixed a NullPointerException during Delta Lake ingestion when the Delta Kernel reader is enabled. -
Warnings instead of errors for valid queries
Syntactically correct queries no longer display a misleading error message before running — they now show a warning where relevant.
July 20, 2026
New Features
-
Unity Catalog support for External Tables
External Tables can now connect to Databricks Unity Catalog — including Delta Lake tables exposed through it — broadening catalog coverage beyond the existing Iceberg REST, Glue, and S3 Tables options. -
GCS Parquet External Tables
Create External Tables over raw Parquet files in Google Cloud Storage, alongside the existing Amazon S3 data lake support. -
OAuth2 authentication for Iceberg REST catalogs
Connect to Iceberg REST catalogs like Databricks Unity Catalog, Polaris using OAuth2 client credentials, for least-privilege, service-principal access instead of static keys.
Enhancements
-
Glue and S3 Tables promoted to top-level catalog options
When creating an External Table, AWS Glue and Amazon S3 Tables now appear as top-level catalog choices instead of being nested under a generic Iceberg REST grouping, matching how you actually think about them. -
Cleaner External Table onboarding
Building on the onboarding cleanup from recent releases, terminology and labels have been tidied throughout the flow, and the bucket name and prefix fields now include placeholders that make the expected input format clear. -
Index hints in Query Console
Query Console now flags queries that run against tables with no indexes, or that scan a large share of rows, and points you to add indexes or run Query Analyzer for AI-powered recommendations. -
More accurate External Table ingestion progress
For Iceberg External Tables, ingestion progress and the last synced checkpoint are now derived from Pinot’s byte-based lag signal for a truer progress reading.
Bug Fixes
- Query Analyzer no longer discards in-progress analysis
Closing the query editor while an analysis is still running now prompts for confirmation first, so you don’t lose results you’re waiting on.
July 10, 2026
New Features
-
Table Health Dashboard & Alerting
A new real-time health check dashboard shows every table’s pass/fail status at a glance, with drill-down into which checks are failing and why, plus one-click remediation where available. Subscribe an email address to alerts for check failures and recoveries, scoped as broadly as every table or as narrowly as a single check. -
Query history in Query Console
Query Console now shows the historical run list for every query you’ve executed. Query Analyzer draws on that same history to surface slow or problematic queries automatically, without any extra instrumentation. -
Workspace-level control over AI features
Workspace and system admins can now enable or disable AI-powered features — including Query Analyzer — for an entire workspace, instead of relying on a single global switch. -
StarTree Index support in Data Portal
StarTree Index is now available as a configuration option when creating or editing an External Table, alongside other index types. -
AWS Glue Schema Registry Avro decoder
Real-time tables consuming Avro-encoded Kafka or Amazon MSK messages can now resolve schemas from the AWS Glue Schema Registry, with transparent handling of schema evolution across producer versions.
Enhancements
- Sharper Query Analyzer findings Building on last release’s accuracy improvements, Query Analyzer findings are now more human-readable and factor in your cluster’s actual topology (segment spread, server sizing). Suggested query rewrites are validated and repaired against the live cluster before being surfaced, and a new safety backstop automatically reduces query scope under resource pressure.
-
Step-by-step in-product guides
Building on the in-product documentation introduced last release, Data Portal now includes step-by-step guided walkthroughs for key workflows, and the left navigation automatically collapses or expands to make room for them. -
Security Manager moved into Settings
Security Manager is no longer a separate top-level nav item — it now lives inside the new Settings page alongside notification preferences and other account-level configuration.
Bug Fixes
-
Consistent search filtering
Search filters across Data Portal no longer intermittently fail to filter results. -
Nested column names render in Query Console
Query results with nested column names now display correctly instead of failing to render. -
Kafka connection sampling no longer times out
Fixed a timeout error when sampling a Kafka stream without credentials during connection setup.
July 1, 2026
New Features
-
Task status summary in the task manager
The task manager displays a count of tasks in each state — total, completed, running, waiting, error, and others — so operators can assess cluster-wide ingestion health at a glance. -
Trigger Purge and File Ingestion tasks from Data Portal
Run Purge and File Ingestion tasks directly from Data Portal, with progress tracking, failure highlighting, and minion resource usage linked to Grafana.
Enhancements
- Locked-down data modeling for External tables
For External table-related workflows, the Data Modeling step no longer allows editing columns, adding transformations, or editing the ingestion configuration once a table is created, preventing changes that External tables don’t support.
Bug Fixes
-
Clearer RBAC policy error messages
Deleting or updating a policy that’s still attached to roles now returns the actual reason for the conflict instead of a generic “Request failed” error. -
Readable errors in Query Console
Query Console errors no longer get buried under long query text, making the actual error message easier to find. -
Complete, scrollable connection error messages
Errors when creating a new connection now display in full and are scrollable, instead of being cut off.
June 12, 2026
New Features
-
In-product documentation and tooltips
Tooltips and inline guidance have been added across Data Portal pages and actions, explaining key fields and workflows without leaving the UI. - Dictionary-encoded indexes on External Tables External Tables now support the full range of Pinot indexes — including dictionary-encoded types — and you can add and configure all of them on UI.
-
More power to Query Analyzer
The Query Analyzer now prioritizes query correctness and draws on richer context — your SQL, table schema, execution plan, and many more guidance — to deliver sharper, more specific suggestions with every analysis.
Enhancements
-
Richer External Table detail view
The External Table detail view now shows the next scheduled ingestion run and the underlying connection details (data source and catalog), alongside existing status and progress indicators. -
Preload enabled by default for tiered External Tables
Tiered storage for External Tables now enables preload by default, improving query performance on cold-tier data without manual configuration after table creation. -
StarTree index hidden for upsert tables
The StarTree index option is no longer shown for upsert tables, where it is not supported. -
Clearer Query Analyzer responses
Query Analyzer output is less verbose, focusing on actionable optimization suggestions rather than excessive model detail. -
Analyze Query scoped to highlighted text
Analyze Query in the Query Console now runs only on highlighted text in the editor, so you can analyze a specific statement without sending the entire query buffer.
Bug Fixes
- Cluster Manager config panels load for all cluster names
Fixed instance configuration panels returning 404 when the Helix cluster name was notpinot.
May 6, 2026
New Features
-
IAM role authentication for External Tables
External Table setup now supports IAM role authentication, so you can connect to AWS data sources using instance or cross-account roles without embedding long-lived credentials in the workflow. -
RBAC-aware Data Portal
Data Portal now enforces RBAC permissions across table creation and listing, table metadata views (schema, indexing, connections, and additional config), and Query Console (SQL editor and table list). Users only see and can act on resources their role allows.
Enhancements
-
Streamlined navigation for non-admin users
Security Manager, Pinot Components, and Zookeeper are hidden for non-admin users. Data Portal Swagger API docs are now accessible to all users. -
Manual segment reload after configuration changes
Data Portal no longer automatically reloads segments after every schema, config, or index change. Rapid concurrent reloads could cause race conditions and failed segment reloads; after making changes, reload segments manually when ready. The UI prompts you to reload once all changes are complete. -
Clearer authentication error messages
Authentication failures now show actionable guidance instead of opaque errors. The auth service retries up to three times on transient failures before surfacing a message.
Bug Fixes
- Chronological sorting for timestamps
Fixed time-based sorting across Data Portal — including the Segment Reload Status popup — so entries sort in true chronological order.
April 20, 2026
New Features
-
Scheduling for External Table ingestion
Building on Run Now and Pause Ingestion from the previous release, External Table tasks now support configurable ingestion schedules via the minion task schedule API. Pause and resume ingestion by adding or removing the cron schedule from the task configuration. - Visibility into Table Storage Usage The interface displays table size, segment count, and historical growth patterns, helping operators monitor capacity and understand how tables are growing. This makes it easier to identify tables consuming significant storage and plan for capacity needs.
Enhancements
-
Input guardrails for External Table configurations
Added validation guardrails to protect against bad inputs and parameters during External Table setup, reducing the risk of misconfiguration. Includes safety checks for user parameters, detection of bad schemas or unsupported datasets, credential validation, and proper error codes with response messages. -
RBAC: GetTenant added to default roles
TheGetTenantpermission is now included in default RBAC roles, resolving an issue where table creation could fail at the final step due to missing tenant access. -
RBAC: GetRunningQuery permission missing from default read policy
Fixed an issue where users with read-data permissions could not view running queries due to a missingGetRunningQuerypermission in the default policy. The authentication check now includes the workspace in the resource identifier as per the allow rule.
Bug Fixes
- Unsaved changes lost during table creation
Fixed a bug where pending schema or configuration changes were silently discarded if not explicitly applied before proceeding to the next step in the table creation wizard.
March 25, 2026
New Features
-
Query Analyzer integrated into the Query Console
The Query Analyzer is now embedded directly in the Data Portal Query Console. Click Analyze Query on any query to get AI-powered insights — optimization suggestions, stage-level execution details, and plan analysis — without leaving the console. This is a beta feature and is disabled by default. Contact your StarTree account team to have it enabled for your environment. -
Share saved queries via a reference URL
Saved queries can now be shared with teammates using a shareable reference URL. The query detail view also tracks and displays who created and last modified the query. -
Default instance role authentication for S3 Data Lake source
When an S3 bucket is in the same AWS account as the cluster and the cluster role already has direct access, you no longer need to configure explicit IAM keys or a cross-account IAM role. A new default authentication mode automatically falls back to the cluster’s instance role, reducing setup overhead for same-account S3 configurations.
Enhancements
-
Ingestion observability for External Tables
The External Table detail view now surfaces rich ingestion state: status (RUNNING,COMPLETED,FAILED,IDLE), next scheduled run, ingestion progress (segments generated vs. total discovered files), the last synced file checkpoint, and any error messages. This makes it significantly easier to monitor and debug External Table ingestion without external tooling. -
Addition of StreamNative Kafka connector support
The StreamNative Kafka connector has been added to the Data Portal, allowing users to connect to Kafka clusters and ingest data into Pinot tables. -
Clearer error messages when task details are unavailable
When task details for a specific table cannot be found (for example, when no active task exists), the task manager now shows a meaningful, user-friendly message instead of surfacing a raw 404 error.
March 11, 2026
New Features
-
Raw S3 Parquet data lake support (Beta, enabled on demand)
Data Portal can now help connect Pinot Query Engine to S3 Parquet datasets as a S3 data lake source. Point to an S3 location and query it using Pinot Query Engine. -
Iceberg REST catalog support — AWS Glue and S3Tables (Beta, enabled on demand)
Query Iceberg tables using Pinot Query Engine. Data Portal now supports connecting to Iceberg REST catalogs backed by AWS Glue and AWS S3Tables, using REST endpoints with AWS SigV4 authentication.
Enhancements
-
Dark mode
Data Portal now supports dark mode, improving usability in low-light environments and for those who prefer a darker UI. -
Swagger UI for Data Portal APIs
The Data Portal Swagger UI is now exposed alongside Pinot’s Swagger, giving you a single place to browse and test Data Manager APIs. You can now use this to manage connections to your data sources. -
Deleted segments no longer appear in Data Portal
Fixed a discrepancy where segments deleted from an offline table could still appear in Data Portal. Data Portal now correctly reflects the empty state after deletions.
February 18, 2026
New Features
-
Configure tiered storage directly in Data Portal
Introduced support for configuring Pinot tiered storage from Data Portal. Users can enable or disable tiered storage, configure tiers following documented best practices, and rely on sensible defaults where appropriate. -
Broker and server tenant configuration in the UI
Added the ability to configure broker and server tenants for tables directly from Data Portal, removing the need for manual edits to accomplish cluster-level configuration. -
Retention time configuration
Introduced controls to set and adjust table retention time (defaulting to 10 years), giving users direct control over data lifecycle policies without leaving the UI. -
MAP data type — end-to-end support
Added full support for the PinotMAPdata type across the stack. The Data Modeling UI lets users define MAP fields with key/value specs, validation rules, and index constraints (JSON index supported; some index types restricted). Query Console renders MAP column values as JSON for easier inspection.
Enhancements
-
Saved queries no longer auto-run on click
Saved queries are no longer executed automatically when clicked. Users can now open a saved query to review or edit it before choosing to run it, reducing accidental execution of heavy queries. -
Support for newer Kafka consumer implementation
Updated the default Kafka consumer implementation in Data Portal to use the newerKafkaFactoryclass from Apache Pinot. This aligns with current best practices and improves compatibility with newer Kafka and Pinot deployments.
Bug Fixes
-
Long double values no longer show as “Invalid Number”
Fixed an issue where certain long double values (for example,97.60000000000001) were incorrectly displayed as “Invalid Number” in query results. These values now render correctly. -
Stale ingestion status in the Data Portal UI
The table ingestion status could appear outdated even while ingestion was running. The table details view now refreshes more frequently, giving users an accurate, up-to-date status. -
Pinot Preview API hanging on S3 files
Resolved an issue where the Pinot Preview API could hang when previewing data from S3. The preview experience for S3-based sources is now more reliable. -
Clearer permission error for running queries
Improved error handling in Query Console when a user is missing thegetRunningQueriespermission. Queries continue to run successfully with clearer, less disruptive messaging instead of a confusing 403 popup.
January 15, 2026
New Features
-
Protobuf descriptor file support for real-time tables
When creating real-time tables with Protobuf data, users can now point to a descriptor file (for example, a file on S3) instead of requiring a schema registry URL. This aligns Data Portal with common Protobuf deployment patterns and removes the need for manual overrides. -
Cancel queries from the editor
The query editor now attaches a unique client query ID to each execution, enabling cancellation of that specific query mid-flight without going through a separate API call.
Enhancements
- Text index support in index configuration
Extended index configuration to include text index options via Pinot APIs, improving query performance and search flexibility on free-text fields.
January 9, 2026
New Features
- Query observability
Operators can now see all running queries alongside their metadata and total runtime via Pinot’s query APIs, filling a key gap for managing long-running or expensive queries.
Enhancements
-
Richer Table List view
The Table List now surfaces operational details at a glance: ingestion status with a clear definition of “healthy”, disabled table indicators, data source details (bucket, topic, or saved connection name), table size, and segment count. Real-time tables that have no scheduled next run show “N/A” rather than a misleading value. -
Inline IAM setup guidance for S3 and Kinesis
The S3/Kinesis connection flow now includes sample IAM and trust policies with placeholders for StarTree and bucket details, plus a link to the full IAM role setup guide. Users get step-by-step guidance without leaving Data Portal. -
Group claims visible in the user menu
When RBAC is enabled, the user menu now shows the group claims from the authentication token alongside the user’s email. A summary of groups is shown by default with an option to expand all. When RBAC is off or the token carries no group claims, the UI handles this gracefully. -
Stale error messages cleared on retry
When a user retries an action after a failure, the previous error toast is now dismissed before the new attempt resolves. This prevents stale errors from lingering and makes the outcome of each retry clear.
December 17, 2025
New Features
-
Visual query execution stats and EXPLAIN PLAN
Building on the stage-level stats introduced in the previous release, Query Console now surfaces EXPLAIN plan visualizations alongside execution stats for all query types, making performance debugging significantly easier. -
Cleaner execution details with a dedicated JSON tab
Execution details are now organized into tabs, with raw JSON in its own tab and the table widget standardized across the app. -
Type-ahead search in all dropdowns
Every dropdown in Data Portal now supports inline filtering — type a few characters to narrow a long list of options. Loading indicators appear inside the dropdown while data is being fetched.
Bug Fixes
-
Transformation rules consistently enforced across views
Fixed an inconsistency where transformation functions could be applied to existing fields in JSON View even though Table View blocked it. Validation is now enforced at the API level regardless of which view is used. -
Query execution metadata no longer returns empty values
Resolved an issue where the Query Console SQL API sometimes returned zero or empty values for query timings and stats.
December 10, 2025
New Features
- Stage-level stats for multi-stage engine queries
Query Console now includesstageStatsin the JSON response and a visual representation of the stage stats when running queries with the multi-stage engine. This gives users detailed per-stage execution stats for performance tuning and troubleshooting without needing a separate tool.
Enhancements
-
Smarter segment builder defaults based on schema width
Data Portal now automatically setscolumnMajorSegmentBuilderEnabledbased on table schema width — disabled for tables with fewer than 40 columns, enabled for wider schemas. Commit-time compaction defaults to off, with the option to enable it when turning on Upsert during table creation. This avoids a one-size-fits-all configuration and improves out-of-the-box performance. -
Consistent default indexes across all ingestion flows
The Upload File ingestion flow now applies the same default index configuration logic used in other ingestion paths. Tables created from uploaded files get sensible indexes automatically, reducing the need for manual tuning after setup. -
JSON and text columns default to no-dictionary
JSON and text columns are now marked as “no dictionary” by default, with JSON index enabled where appropriate. This prevents the segment bloat that occurred when these column types were incorrectly assigned a dictionary, and aligns default behavior with best practices for JSON and text workloads.
December 4, 2025
New Features
-
Folder selection for batch sources
When adding a batch source in Data Portal, you can now browse and select folders directly using a folder picker instead of typing paths manually. This makes source configuration faster and reduces the chance of path errors. -
Partial results in Query Console
When some segments are unavailable, Query Console now displays the partial results alongside a clear error message, rather than showing only an error.
Enhancements
-
Ingestion type renamed from “Standard” to “Append”
In the Additional Config section for real-time tables, the ingestion type previously labeled “Standard” is now called “Append”. The new label better describes how the mode works and reduces confusion when choosing between Append, Upsert, and Dedupe. -
Ingestion failures surface explicitly
Ingestion flows now default to
"continueOnError": false, so failures are surfaced immediately instead of being silently skipped. This makes it easier to catch and act on ingestion issues early. -
More reliable file pattern handling
The ingestion backend now correctly prioritizesincludeFilePatternswhen present, ensuring ingestion follows the configured patterns and avoids picking up unintended files.
November 11, 2025
New Features
-
Tableau available as a dedicated client
Tableau is now listed as a first-class client in the Clients page, with a tailored connection URL generation flow. This removes the need for manual URL construction when connecting Tableau to StarTree. -
Clients section moved into Data Portal
Client connection management has moved from MyApps into Data Portal, so all client setup and configuration is accessible from one place within the main UI.

