| elasticsearch |
Documentation |
Document how to reindex a TSDB datastream |
Critical |
Open |
Need documentation for TSDB reindexing |
| elasticsearch |
Enhancement |
Add an option to treat non-metric fields as a dimension by default |
Critical |
Open |
Currently WIP. |
| elasticsearch |
Bug |
Old timestamp documents being dropped |
Critical |
Closed |
Elasticsearch provided ability to configure look_back_time. Long term issue captured separately. |
| elasticsearch |
Bug |
Old timestamp documents being dropped |
Medium |
Open |
Long term issue tracking delayed document arrival issue. |
| elasticsearch |
Enhancement |
Adding metric names to TSID |
Medium |
Open |
Long term issue. |
| elasticsearch |
Enhancement |
Add an option to treat non-metric fields as a dimension by default |
Critical |
Open |
Long term issue, more applicable for OTel documents ingestion. |
| elasticsearch |
Bug |
Improve error handing via documentation for custom dashboard being broken |
Critical |
Validation WIP |
8.10 elasticsearch updated to support all counter aggregations. Back ported to 8.92. being tested here. |
| elasticsearch |
Bug |
Certain type of counter aggregations are not supported |
Critical |
Open |
There are certain counter aggr. currently not supported. detailed provided, used by k8/aws package |
| elasticsearch |
Bug |
scaled_float fields are not searchable. Related issue |
Critical |
Closed |
Issue with released system package, 8.10 fixed elasticsearch team |
| integrations |
Bug |
GCP metrics are not grouped by labels |
Critical |
Open |
Bug fix expected to resume |
| kibana |
Bug |
Pie visualisation issue for non-tsdb and tsdb data combined. |
Medium |
Open |
Discussions on-going and we are sharing details on the field mapping. |
| elasticsearch |
Bug |
Numbers that are mapped as keyword are not validated correctly at routing time |
Medium |
Open |
Discussion on-going. |
| elasticsearch |
Critical |
Custom dashboard failing aggregation |
Critical |
Validation TBD |
8.10 elasticsearch updated to support all counter aggregations. Earlier thread. Duplicate older issue. |
| elasticsearch |
Doc |
Facing issue while reindexing a TSDB enabled data stream |
Medium |
Open |
Captured separately, only document change needed. elastic/elasticsearch#99176 |
| elasticsearch |
Enhancement |
Support GCP delta metrics |
Medium |
Open |
Map to gauge for now. |
| elasticsearch |
Bug |
Issue enabling TSDB on nested fields |
Critical |
Open |
Need confirmation if ES issue |
| elasticsearch |
Bug |
Provide a mechanism for users to go back to old working custom dashboards |
Critical |
Closed |
Duplicate of issue. Testcase to reproduce. Shard errors coming in the TSDB mode. Should there be better error message? |
| elasticsearch |
Bug |
Text fields in data stream has error |
Medium |
Open |
Exploring the mapping suggestion for stored field |
| elastic-package |
Enhancement |
Documentation annotate fields that are dimensions and metric types |
Medium |
Open |
Low priority for now. |
| Fleet |
Enhancement |
Need manual dev tools based steps for tsdb toggle on/of |
Critical |
Closed |
Manual TSDB disable has been confirmed to work. Need official docs to be released, so that manual TSDB disable can be enabled. |
| kibana |
Bug |
Discover fields UI does not change icons counter/gauge field after package upgrade to TSDB |
Critical |
Open |
Not TSDB related. User need to open new browser windows after package upgrade as an work-around. |
| kibana |
Enhancement |
Counter filed show- Analysis not available in discover |
Medium |
Closed |
Kibana team is working on replacing this current message with a better message suitable for counter fields. |
| elastic-package |
Bug |
Support fields validation when synthetic source is used |
Critical |
Open |
Not many packages are impacted |
| ECS |
Enhancement |
ECS centralisation of common dimension fields |
Critical |
Open |
Definition of common dimension fields(#5193). ECS stage 0 merged. Recent updates done. |
| k8 package |
Enhancement |
Certain aggregation functions for counters in k8 package needs to be updated |
Critical |
Open |
Since we have earlier used sum() aggr functions for some of the counter type fields, in k8 package dashboard. These need to be updated, as sum is not supported for counters in TSDB. |
| elasticsearch |
Bug |
Certain aggregation functions not working for counters |
Critical |
Partially fixed |
The gating ones fixed. Still some functions(median/avg) not supported. Need to close with ES team what is the overall plan for the counter aggregation functions. |
| elasticsearch |
Bug |
Dimension limit override settings blocking the build |
Medium |
Closed |
Only for packages with kibana.version <8.6, No issue if package version of made => 8.6. This impacts InfluxDB and may be few other prometheus type packages. Closing this as not applicable anymore. |
| Kibana |
Enhancement |
Need UI indicators for dimension fields when TSDB is enabled |
Medium |
Open |
Kibana team to plan. |
| Kibana |
Enhancement |
Display the current write index when timeseries mode is enabled |
Medium |
Open |
Kibana team to plan. |
| elasticsearch |
Bug |
Histograms in TSDS mode don’t include zero counts |
Medium |
Closed |
The conclusion is that no tool changes needed and the behaviour should not impact user in way. Only documentation to be updated. |
| kibana |
Bug |
Counter fields don’t show in Visualisation. Duplicate issue |
Blocker |
Closed |
8.7 the issue exist and kibana team is targeting 8.8 fix. Nginx and MSSQL & k8 packages verified in 8.8 snapshot to show counter fields in visualisation. |
| elasticsearch |
Bug |
IP is not supported as dimension field |
Medium |
Closed |
Verified. 8.8.0-SNAPSHOT |
| Fleet |
Bug |
Fields having type byte, short, integer, long, unsigned_long are not mapped correctly as dimension fields |
Medium |
Closed |
Verified. 8.8.0-SNAPSHOT |
| elasticsearch |
Bug |
Enablement of TSDB fails for package with fields having flattened type |
Critical |
Fixed |
Verified to work 8.8 snapshot. Now dependant packages can be committed with 8.8 stack version. |
| elasticsearch |
Bug |
Immediately upgrading a downgraded tsdb data stream fails |
Critical |
Not an issue |
4 hours gap needed. Not an issue for now |
| Fleet |
Bug |
Does not allow package upgrade to disable TSDB |
Blocker |
Closed |
This has been fixed in latest snapshot. Separate PR for fixing rollover has been verified to work |
| Fleet |
Bug |
Mapping does not reflect the fields definition in package |
Critical |
Closed |
Double field definition, closed. |
| Fleet |
Enhancement |
Need metric_type mapping for dynamic templates |
Critical |
Closed |
Closed This impacts migration of multiple Prometheus style packages. Fixed from 8.9 |
Migration summary
Important resources:
Spreadsheet listing package prioritisation (private link)
Packages are being migrated dataset wise, following the generic guideline here. The scope of the migration is to cover both addition of dimensions and metric types.
Mandatory ECS fields: [ECS] [TSDB] Centralisation of Dimension Fields #5193 (comment)
Testing the migration: https://github.com/elastic/TSDB-migration-test-kit
Packages ongoing
Completed packages
Blocked packages
User reported issues
Internal o11y issues found
scaled_floatfields are not searchable. Related issue