Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A number of improvement to improve downsampling performance #124450

Draft
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

martijnvg
Copy link
Member

@martijnvg martijnvg commented Mar 9, 2025

Number of changes:

All changes result into lowering downsample latency:

  • For the tsdb downsampling benchmark track, the 1 minute interval downsample operation latency dropped by ~30%
  • For the tsdb downsampling benchmark track, the 1 hour interval downsample operation latency dropped by ~50%

@martijnvg martijnvg added the :StorageEngine/Downsampling Downsampling (replacement for rollups) - Turn fine-grained time-based data into coarser-grained data label Mar 9, 2025
@martijnvg martijnvg force-pushed the make_downsampling_faster branch from 23ec581 to 04603cd Compare March 9, 2025 19:34
@martijnvg martijnvg force-pushed the make_downsampling_faster branch from 04603cd to 0100b0a Compare March 9, 2025 22:13
@martijnvg martijnvg removed the v9.1.0 label Mar 9, 2025
@martijnvg martijnvg changed the title Make downsampling faster by buffering docids and bulk processing A number of improvement to improve downsampling performance Mar 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:StorageEngine/Downsampling Downsampling (replacement for rollups) - Turn fine-grained time-based data into coarser-grained data
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants