Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Timestamp Pinning in Remote Store] Changes in remote store restore flow to restore data at given timestamp #15066

Closed
sachinpkale opened this issue Aug 1, 2024 · 0 comments
Assignees
Labels
enhancement Enhancement or improvement to existing feature or request Storage:Remote

Comments

@sachinpkale
Copy link
Member

sachinpkale commented Aug 1, 2024

Is your feature request related to a problem? Please describe

As part of shallow snapshot optimisations, we are introducing timestamp based implicit locking support. This feature will be called Timestamp Pinning in remote backed storage. When a timestamp is pinned, remote store garbage collectors will skip deleting data corresponding to the timestamp. We need to make changes to restore flow as well to restore data against the given pinned timestamp.

Describe the solution you'd like

  • Currently, remote store restore only supports restoring to last successful write operation for a given shard.
  • With pinned timestamp support, we will make changes to restore flow which will download segment and translog data for the given timestamp.

Related component

Storage:Remote

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Enhancement or improvement to existing feature or request Storage:Remote
Projects
Status: ✅ Done
Development

No branches or pull requests

2 participants