Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement same cleanup jobs as Scicat provides #24

Closed
Tracked by #27 ...
phwissmann opened this issue Mar 6, 2024 · 1 comment
Closed
Tracked by #27 ...

Implement same cleanup jobs as Scicat provides #24

phwissmann opened this issue Mar 6, 2024 · 1 comment
Assignees
Milestone

Comments

@phwissmann
Copy link
Collaborator

phwissmann commented Mar 6, 2024

Scicat defines some cleanup jobs in case of e.g. archival failure ("reset"). These need to be understand and an API to trigger these jobs needs to be implemented

@phwissmann phwissmann self-assigned this Mar 6, 2024
This was referenced Mar 6, 2024
@phwissmann
Copy link
Collaborator Author

Scicat provides:

  • a "reset" admin job that tries to copy the datablocks again to the LTS, potentially under a different path in order to not fail if a datablock is already present. Here, the split into two sub flows already provides strong preconditions such that an archive job could just be submitted again and the datablock creation could be skipped and the copying to LTS step will be executed again without any datablock being present in the LTS.
  • a "delete" adming job that deletes partially archived (?) data. Not relevant due to stronger post conditions on the archiving jobs

@phwissmann phwissmann added this to the v1.0-alpha milestone May 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant