[index management] Component template api performance fixes#228709
Merged
[index management] Component template api performance fixes#228709
Conversation
mattkime
added
Feature:Kibana Management
Contributor
|
Pinging @elastic/kibana-management (Team:Kibana Management) |
mattkime
added
bug
Contributor
💚 Build Succeeded
Metrics [docs]
cc @mattkime |
SoniaSanzV
approved these changes
Jul 21, 2025
Contributor
SoniaSanzV
left a comment
SoniaSanzV
left a comment
There was a problem hiding this comment.
Thank you for fixing this. Tested locally and it is significantly faster. LGTM.
Contributor
|
Starting backport for target branches: 8.17, 8.18, 8.19, 9.0, 9.1 |
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Jul 21, 2025
…228709) ## Summary This implements two performance improvements - first, firing both requests in parallel instead of in sequence. The second one, doing the real work - for each component template the list of index templates was being transformed via `map`. If you have hundreds of one and thousands of another it gets VERY slow. 30s on my machine but up to a minute for a customer. After this change the performance went from 30s to 500ms. Python script for generating necessary set of component and index templates - [new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt) Run the above script against main and open the component template tab - it will be VERY slow. Now do it against this branch. Hopefully you notice a significant speed increase. Closes elastic#228267 --- Release note Index Management component template tab speed increase (cherry picked from commit 8f5825c)
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Jul 21, 2025
…228709) ## Summary This implements two performance improvements - first, firing both requests in parallel instead of in sequence. The second one, doing the real work - for each component template the list of index templates was being transformed via `map`. If you have hundreds of one and thousands of another it gets VERY slow. 30s on my machine but up to a minute for a customer. After this change the performance went from 30s to 500ms. Python script for generating necessary set of component and index templates - [new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt) Run the above script against main and open the component template tab - it will be VERY slow. Now do it against this branch. Hopefully you notice a significant speed increase. Closes elastic#228267 --- Release note Index Management component template tab speed increase (cherry picked from commit 8f5825c)
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Jul 21, 2025
…228709) ## Summary This implements two performance improvements - first, firing both requests in parallel instead of in sequence. The second one, doing the real work - for each component template the list of index templates was being transformed via `map`. If you have hundreds of one and thousands of another it gets VERY slow. 30s on my machine but up to a minute for a customer. After this change the performance went from 30s to 500ms. Python script for generating necessary set of component and index templates - [new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt) Run the above script against main and open the component template tab - it will be VERY slow. Now do it against this branch. Hopefully you notice a significant speed increase. Closes elastic#228267 --- Release note Index Management component template tab speed increase (cherry picked from commit 8f5825c)
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Jul 21, 2025
…228709) ## Summary This implements two performance improvements - first, firing both requests in parallel instead of in sequence. The second one, doing the real work - for each component template the list of index templates was being transformed via `map`. If you have hundreds of one and thousands of another it gets VERY slow. 30s on my machine but up to a minute for a customer. After this change the performance went from 30s to 500ms. Python script for generating necessary set of component and index templates - [new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt) Run the above script against main and open the component template tab - it will be VERY slow. Now do it against this branch. Hopefully you notice a significant speed increase. Closes elastic#228267 --- Release note Index Management component template tab speed increase (cherry picked from commit 8f5825c)
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Jul 21, 2025
…228709) ## Summary This implements two performance improvements - first, firing both requests in parallel instead of in sequence. The second one, doing the real work - for each component template the list of index templates was being transformed via `map`. If you have hundreds of one and thousands of another it gets VERY slow. 30s on my machine but up to a minute for a customer. After this change the performance went from 30s to 500ms. Python script for generating necessary set of component and index templates - [new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt) Run the above script against main and open the component template tab - it will be VERY slow. Now do it against this branch. Hopefully you notice a significant speed increase. Closes elastic#228267 --- Release note Index Management component template tab speed increase (cherry picked from commit 8f5825c)
Contributor
💚 All backports created successfully
Note: Successful backport PRs will be merged automatically after passing CI. Questions ?Please refer to the Backport tool documentation |
kibanamachine
added a commit
that referenced
this pull request
Jul 21, 2025
…28709) (#228761) # Backport This will backport the following commits from `main` to `9.1`: - [[index management] Component template api performance fixes (#228709)](#228709) <!--- Backport version: 9.6.6 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Matthew Kime","email":"matt@mattki.me"},"sourceCommit":{"committedDate":"2025-07-21T11:30:07Z","message":"[index management] Component template api performance fixes (#228709)\n\n## Summary\n\nThis implements two performance improvements - first, firing both\nrequests in parallel instead of in sequence. The second one, doing the\nreal work - for each component template the list of index templates was\nbeing transformed via `map`. If you have hundreds of one and thousands\nof another it gets VERY slow. 30s on my machine but up to a minute for a\ncustomer.\n\nAfter this change the performance went from 30s to 500ms.\n\nPython script for generating necessary set of component and index\ntemplates -\n\n[new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt)\n\nRun the above script against main and open the component template tab -\nit will be VERY slow. Now do it against this branch. Hopefully you\nnotice a significant speed increase.\n\nCloses https://github.com/elastic/kibana/issues/228267\n\n---\n\nRelease note\n\nIndex Management component template tab speed increase","sha":"8f5825c80584cb10109fa83b034ad46bbebab61e","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["bug","release_note:fix","Feature:Kibana Management","Team:Kibana Management","backport:all-open","v9.2.0"],"title":"[index management] Component template api performance fixes","number":228709,"url":"https://github.com/elastic/kibana/pull/228709","mergeCommit":{"message":"[index management] Component template api performance fixes (#228709)\n\n## Summary\n\nThis implements two performance improvements - first, firing both\nrequests in parallel instead of in sequence. The second one, doing the\nreal work - for each component template the list of index templates was\nbeing transformed via `map`. If you have hundreds of one and thousands\nof another it gets VERY slow. 30s on my machine but up to a minute for a\ncustomer.\n\nAfter this change the performance went from 30s to 500ms.\n\nPython script for generating necessary set of component and index\ntemplates -\n\n[new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt)\n\nRun the above script against main and open the component template tab -\nit will be VERY slow. Now do it against this branch. Hopefully you\nnotice a significant speed increase.\n\nCloses https://github.com/elastic/kibana/issues/228267\n\n---\n\nRelease note\n\nIndex Management component template tab speed increase","sha":"8f5825c80584cb10109fa83b034ad46bbebab61e"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/228709","number":228709,"mergeCommit":{"message":"[index management] Component template api performance fixes (#228709)\n\n## Summary\n\nThis implements two performance improvements - first, firing both\nrequests in parallel instead of in sequence. The second one, doing the\nreal work - for each component template the list of index templates was\nbeing transformed via `map`. If you have hundreds of one and thousands\nof another it gets VERY slow. 30s on my machine but up to a minute for a\ncustomer.\n\nAfter this change the performance went from 30s to 500ms.\n\nPython script for generating necessary set of component and index\ntemplates -\n\n[new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt)\n\nRun the above script against main and open the component template tab -\nit will be VERY slow. Now do it against this branch. Hopefully you\nnotice a significant speed increase.\n\nCloses https://github.com/elastic/kibana/issues/228267\n\n---\n\nRelease note\n\nIndex Management component template tab speed increase","sha":"8f5825c80584cb10109fa83b034ad46bbebab61e"}}]}] BACKPORT--> Co-authored-by: Matthew Kime <matt@mattki.me>
kibanamachine
added a commit
that referenced
this pull request
Jul 21, 2025
…228709) (#228757) # Backport This will backport the following commits from `main` to `8.17`: - [[index management] Component template api performance fixes (#228709)](#228709) <!--- Backport version: 9.6.6 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Matthew Kime","email":"matt@mattki.me"},"sourceCommit":{"committedDate":"2025-07-21T11:30:07Z","message":"[index management] Component template api performance fixes (#228709)\n\n## Summary\n\nThis implements two performance improvements - first, firing both\nrequests in parallel instead of in sequence. The second one, doing the\nreal work - for each component template the list of index templates was\nbeing transformed via `map`. If you have hundreds of one and thousands\nof another it gets VERY slow. 30s on my machine but up to a minute for a\ncustomer.\n\nAfter this change the performance went from 30s to 500ms.\n\nPython script for generating necessary set of component and index\ntemplates -\n\n[new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt)\n\nRun the above script against main and open the component template tab -\nit will be VERY slow. Now do it against this branch. Hopefully you\nnotice a significant speed increase.\n\nCloses https://github.com/elastic/kibana/issues/228267\n\n---\n\nRelease note\n\nIndex Management component template tab speed increase","sha":"8f5825c80584cb10109fa83b034ad46bbebab61e","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["bug","release_note:fix","Feature:Kibana Management","Team:Kibana Management","backport:all-open","v9.2.0"],"title":"[index management] Component template api performance fixes","number":228709,"url":"https://github.com/elastic/kibana/pull/228709","mergeCommit":{"message":"[index management] Component template api performance fixes (#228709)\n\n## Summary\n\nThis implements two performance improvements - first, firing both\nrequests in parallel instead of in sequence. The second one, doing the\nreal work - for each component template the list of index templates was\nbeing transformed via `map`. If you have hundreds of one and thousands\nof another it gets VERY slow. 30s on my machine but up to a minute for a\ncustomer.\n\nAfter this change the performance went from 30s to 500ms.\n\nPython script for generating necessary set of component and index\ntemplates -\n\n[new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt)\n\nRun the above script against main and open the component template tab -\nit will be VERY slow. Now do it against this branch. Hopefully you\nnotice a significant speed increase.\n\nCloses https://github.com/elastic/kibana/issues/228267\n\n---\n\nRelease note\n\nIndex Management component template tab speed increase","sha":"8f5825c80584cb10109fa83b034ad46bbebab61e"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/228709","number":228709,"mergeCommit":{"message":"[index management] Component template api performance fixes (#228709)\n\n## Summary\n\nThis implements two performance improvements - first, firing both\nrequests in parallel instead of in sequence. The second one, doing the\nreal work - for each component template the list of index templates was\nbeing transformed via `map`. If you have hundreds of one and thousands\nof another it gets VERY slow. 30s on my machine but up to a minute for a\ncustomer.\n\nAfter this change the performance went from 30s to 500ms.\n\nPython script for generating necessary set of component and index\ntemplates -\n\n[new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt)\n\nRun the above script against main and open the component template tab -\nit will be VERY slow. Now do it against this branch. Hopefully you\nnotice a significant speed increase.\n\nCloses https://github.com/elastic/kibana/issues/228267\n\n---\n\nRelease note\n\nIndex Management component template tab speed increase","sha":"8f5825c80584cb10109fa83b034ad46bbebab61e"}}]}] BACKPORT--> Co-authored-by: Matthew Kime <matt@mattki.me>
This was referenced Jul 21, 2025
Bluefinger
pushed a commit
to Bluefinger/kibana
that referenced
this pull request
Jul 22, 2025
…228709) ## Summary This implements two performance improvements - first, firing both requests in parallel instead of in sequence. The second one, doing the real work - for each component template the list of index templates was being transformed via `map`. If you have hundreds of one and thousands of another it gets VERY slow. 30s on my machine but up to a minute for a customer. After this change the performance went from 30s to 500ms. Python script for generating necessary set of component and index templates - [new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt) Run the above script against main and open the component template tab - it will be VERY slow. Now do it against this branch. Hopefully you notice a significant speed increase. Closes elastic#228267 --- Release note Index Management component template tab speed increase
kibanamachine
added a commit
that referenced
this pull request
Jul 22, 2025
…28709) (#228760) # Backport This will backport the following commits from `main` to `9.0`: - [[index management] Component template api performance fixes (#228709)](#228709) <!--- Backport version: 9.6.6 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Matthew Kime","email":"matt@mattki.me"},"sourceCommit":{"committedDate":"2025-07-21T11:30:07Z","message":"[index management] Component template api performance fixes (#228709)\n\n## Summary\n\nThis implements two performance improvements - first, firing both\nrequests in parallel instead of in sequence. The second one, doing the\nreal work - for each component template the list of index templates was\nbeing transformed via `map`. If you have hundreds of one and thousands\nof another it gets VERY slow. 30s on my machine but up to a minute for a\ncustomer.\n\nAfter this change the performance went from 30s to 500ms.\n\nPython script for generating necessary set of component and index\ntemplates -\n\n[new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt)\n\nRun the above script against main and open the component template tab -\nit will be VERY slow. Now do it against this branch. Hopefully you\nnotice a significant speed increase.\n\nCloses https://github.com/elastic/kibana/issues/228267\n\n---\n\nRelease note\n\nIndex Management component template tab speed increase","sha":"8f5825c80584cb10109fa83b034ad46bbebab61e","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["bug","release_note:fix","Feature:Kibana Management","Team:Kibana Management","backport:all-open","v9.2.0"],"title":"[index management] Component template api performance fixes","number":228709,"url":"https://github.com/elastic/kibana/pull/228709","mergeCommit":{"message":"[index management] Component template api performance fixes (#228709)\n\n## Summary\n\nThis implements two performance improvements - first, firing both\nrequests in parallel instead of in sequence. The second one, doing the\nreal work - for each component template the list of index templates was\nbeing transformed via `map`. If you have hundreds of one and thousands\nof another it gets VERY slow. 30s on my machine but up to a minute for a\ncustomer.\n\nAfter this change the performance went from 30s to 500ms.\n\nPython script for generating necessary set of component and index\ntemplates -\n\n[new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt)\n\nRun the above script against main and open the component template tab -\nit will be VERY slow. Now do it against this branch. Hopefully you\nnotice a significant speed increase.\n\nCloses https://github.com/elastic/kibana/issues/228267\n\n---\n\nRelease note\n\nIndex Management component template tab speed increase","sha":"8f5825c80584cb10109fa83b034ad46bbebab61e"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/228709","number":228709,"mergeCommit":{"message":"[index management] Component template api performance fixes (#228709)\n\n## Summary\n\nThis implements two performance improvements - first, firing both\nrequests in parallel instead of in sequence. The second one, doing the\nreal work - for each component template the list of index templates was\nbeing transformed via `map`. If you have hundreds of one and thousands\nof another it gets VERY slow. 30s on my machine but up to a minute for a\ncustomer.\n\nAfter this change the performance went from 30s to 500ms.\n\nPython script for generating necessary set of component and index\ntemplates -\n\n[new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt)\n\nRun the above script against main and open the component template tab -\nit will be VERY slow. Now do it against this branch. Hopefully you\nnotice a significant speed increase.\n\nCloses https://github.com/elastic/kibana/issues/228267\n\n---\n\nRelease note\n\nIndex Management component template tab speed increase","sha":"8f5825c80584cb10109fa83b034ad46bbebab61e"}}]}] BACKPORT--> Co-authored-by: Matthew Kime <matt@mattki.me>
kibanamachine
added a commit
that referenced
this pull request
Jul 22, 2025
…228709) (#228759) # Backport This will backport the following commits from `main` to `8.19`: - [[index management] Component template api performance fixes (#228709)](#228709) <!--- Backport version: 9.6.6 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Matthew Kime","email":"matt@mattki.me"},"sourceCommit":{"committedDate":"2025-07-21T11:30:07Z","message":"[index management] Component template api performance fixes (#228709)\n\n## Summary\n\nThis implements two performance improvements - first, firing both\nrequests in parallel instead of in sequence. The second one, doing the\nreal work - for each component template the list of index templates was\nbeing transformed via `map`. If you have hundreds of one and thousands\nof another it gets VERY slow. 30s on my machine but up to a minute for a\ncustomer.\n\nAfter this change the performance went from 30s to 500ms.\n\nPython script for generating necessary set of component and index\ntemplates -\n\n[new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt)\n\nRun the above script against main and open the component template tab -\nit will be VERY slow. Now do it against this branch. Hopefully you\nnotice a significant speed increase.\n\nCloses https://github.com/elastic/kibana/issues/228267\n\n---\n\nRelease note\n\nIndex Management component template tab speed increase","sha":"8f5825c80584cb10109fa83b034ad46bbebab61e","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["bug","release_note:fix","Feature:Kibana Management","Team:Kibana Management","backport:all-open","v9.2.0"],"title":"[index management] Component template api performance fixes","number":228709,"url":"https://github.com/elastic/kibana/pull/228709","mergeCommit":{"message":"[index management] Component template api performance fixes (#228709)\n\n## Summary\n\nThis implements two performance improvements - first, firing both\nrequests in parallel instead of in sequence. The second one, doing the\nreal work - for each component template the list of index templates was\nbeing transformed via `map`. If you have hundreds of one and thousands\nof another it gets VERY slow. 30s on my machine but up to a minute for a\ncustomer.\n\nAfter this change the performance went from 30s to 500ms.\n\nPython script for generating necessary set of component and index\ntemplates -\n\n[new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt)\n\nRun the above script against main and open the component template tab -\nit will be VERY slow. Now do it against this branch. Hopefully you\nnotice a significant speed increase.\n\nCloses https://github.com/elastic/kibana/issues/228267\n\n---\n\nRelease note\n\nIndex Management component template tab speed increase","sha":"8f5825c80584cb10109fa83b034ad46bbebab61e"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/228709","number":228709,"mergeCommit":{"message":"[index management] Component template api performance fixes (#228709)\n\n## Summary\n\nThis implements two performance improvements - first, firing both\nrequests in parallel instead of in sequence. The second one, doing the\nreal work - for each component template the list of index templates was\nbeing transformed via `map`. If you have hundreds of one and thousands\nof another it gets VERY slow. 30s on my machine but up to a minute for a\ncustomer.\n\nAfter this change the performance went from 30s to 500ms.\n\nPython script for generating necessary set of component and index\ntemplates -\n\n[new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt)\n\nRun the above script against main and open the component template tab -\nit will be VERY slow. Now do it against this branch. Hopefully you\nnotice a significant speed increase.\n\nCloses https://github.com/elastic/kibana/issues/228267\n\n---\n\nRelease note\n\nIndex Management component template tab speed increase","sha":"8f5825c80584cb10109fa83b034ad46bbebab61e"}}]}] BACKPORT--> Co-authored-by: Matthew Kime <matt@mattki.me>
Contributor
|
This PR didn't make it on time into the latest v9.0.5 BC. Updating the labels. |
kibanamachine
added a commit
that referenced
this pull request
Jul 22, 2025
…228709) (#228758) # Backport This will backport the following commits from `main` to `8.18`: - [[index management] Component template api performance fixes (#228709)](#228709) <!--- Backport version: 9.6.6 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Matthew Kime","email":"matt@mattki.me"},"sourceCommit":{"committedDate":"2025-07-21T11:30:07Z","message":"[index management] Component template api performance fixes (#228709)\n\n## Summary\n\nThis implements two performance improvements - first, firing both\nrequests in parallel instead of in sequence. The second one, doing the\nreal work - for each component template the list of index templates was\nbeing transformed via `map`. If you have hundreds of one and thousands\nof another it gets VERY slow. 30s on my machine but up to a minute for a\ncustomer.\n\nAfter this change the performance went from 30s to 500ms.\n\nPython script for generating necessary set of component and index\ntemplates -\n\n[new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt)\n\nRun the above script against main and open the component template tab -\nit will be VERY slow. Now do it against this branch. Hopefully you\nnotice a significant speed increase.\n\nCloses https://github.com/elastic/kibana/issues/228267\n\n---\n\nRelease note\n\nIndex Management component template tab speed increase","sha":"8f5825c80584cb10109fa83b034ad46bbebab61e","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["bug","release_note:fix","Feature:Kibana Management","Team:Kibana Management","backport:all-open","v9.2.0"],"title":"[index management] Component template api performance fixes","number":228709,"url":"https://github.com/elastic/kibana/pull/228709","mergeCommit":{"message":"[index management] Component template api performance fixes (#228709)\n\n## Summary\n\nThis implements two performance improvements - first, firing both\nrequests in parallel instead of in sequence. The second one, doing the\nreal work - for each component template the list of index templates was\nbeing transformed via `map`. If you have hundreds of one and thousands\nof another it gets VERY slow. 30s on my machine but up to a minute for a\ncustomer.\n\nAfter this change the performance went from 30s to 500ms.\n\nPython script for generating necessary set of component and index\ntemplates -\n\n[new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt)\n\nRun the above script against main and open the component template tab -\nit will be VERY slow. Now do it against this branch. Hopefully you\nnotice a significant speed increase.\n\nCloses https://github.com/elastic/kibana/issues/228267\n\n---\n\nRelease note\n\nIndex Management component template tab speed increase","sha":"8f5825c80584cb10109fa83b034ad46bbebab61e"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/228709","number":228709,"mergeCommit":{"message":"[index management] Component template api performance fixes (#228709)\n\n## Summary\n\nThis implements two performance improvements - first, firing both\nrequests in parallel instead of in sequence. The second one, doing the\nreal work - for each component template the list of index templates was\nbeing transformed via `map`. If you have hundreds of one and thousands\nof another it gets VERY slow. 30s on my machine but up to a minute for a\ncustomer.\n\nAfter this change the performance went from 30s to 500ms.\n\nPython script for generating necessary set of component and index\ntemplates -\n\n[new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt)\n\nRun the above script against main and open the component template tab -\nit will be VERY slow. Now do it against this branch. Hopefully you\nnotice a significant speed increase.\n\nCloses https://github.com/elastic/kibana/issues/228267\n\n---\n\nRelease note\n\nIndex Management component template tab speed increase","sha":"8f5825c80584cb10109fa83b034ad46bbebab61e"}}]}] BACKPORT--> Co-authored-by: Matthew Kime <matt@mattki.me>
Contributor
Author
|
@mistic It might be worth reviewing your label updates. If this didn't make 9.0.5 then it would be in 9.0.6. Not sure if this made 8.18.5 either |
kertal
pushed a commit
to kertal/kibana
that referenced
this pull request
Jul 25, 2025
…228709) ## Summary This implements two performance improvements - first, firing both requests in parallel instead of in sequence. The second one, doing the real work - for each component template the list of index templates was being transformed via `map`. If you have hundreds of one and thousands of another it gets VERY slow. 30s on my machine but up to a minute for a customer. After this change the performance went from 30s to 500ms. Python script for generating necessary set of component and index templates - [new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt) Run the above script against main and open the component template tab - it will be VERY slow. Now do it against this branch. Hopefully you notice a significant speed increase. Closes elastic#228267 --- Release note Index Management component template tab speed increase
crespocarlos
pushed a commit
to crespocarlos/kibana
that referenced
this pull request
Jul 25, 2025
…228709) ## Summary This implements two performance improvements - first, firing both requests in parallel instead of in sequence. The second one, doing the real work - for each component template the list of index templates was being transformed via `map`. If you have hundreds of one and thousands of another it gets VERY slow. 30s on my machine but up to a minute for a customer. After this change the performance went from 30s to 500ms. Python script for generating necessary set of component and index templates - [new_import.py.txt](https://github.com/user-attachments/files/21340591/new_import.py.txt) Run the above script against main and open the component template tab - it will be VERY slow. Now do it against this branch. Hopefully you notice a significant speed increase. Closes elastic#228267 --- Release note Index Management component template tab speed increase
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
5 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This implements two performance improvements - first, firing both requests in parallel instead of in sequence. The second one, doing the real work - for each component template the list of index templates was being transformed via
map. If you have hundreds of one and thousands of another it gets VERY slow. 30s on my machine but up to a minute for a customer.After this change the performance went from 30s to 500ms.
Python script for generating necessary set of component and index templates -
new_import.py.txt
Run the above script against main and open the component template tab - it will be VERY slow. Now do it against this branch. Hopefully you notice a significant speed increase.
Closes #228267
Release note
Index Management component template tab speed increase