Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Append TES Tasks to a JSONL file #361

Open
MattMcL4475 opened this issue Aug 12, 2023 · 0 comments
Open

Append TES Tasks to a JSONL file #361

MattMcL4475 opened this issue Aug 12, 2023 · 0 comments
Labels
enhancement New feature or request TES Priority: P3 Groomed to a Priority 3 issue Troubleshooting Enable users to identify and debug errors
Milestone

Comments

@MattMcL4475
Copy link
Collaborator

Problem:
TES Task data is difficult to retrieve for end users

Solution:
Serialize each TES task when it reaches a terminal state to JSON, add a newline to the end, and append it to a blob in tes-internal called "testasks0.jsonl". Once that blob reaches 50K blocks, use "testasks1.jsonl" etc.

@MattMcL4475 MattMcL4475 added the enhancement New feature or request label Aug 12, 2023
@ngambani ngambani added Troubleshooting Enable users to identify and debug errors tobegroomed Add this label while creating new issues to get issues prioritized on the backlog labels Oct 5, 2023
@MattMcL4475 MattMcL4475 added the TES Priority: P3 Groomed to a Priority 3 issue label Dec 11, 2023
@BMurri BMurri removed the tobegroomed Add this label while creating new issues to get issues prioritized on the backlog label Apr 20, 2024
@BMurri BMurri added this to the TES Backlog milestone Feb 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request TES Priority: P3 Groomed to a Priority 3 issue Troubleshooting Enable users to identify and debug errors
Projects
None yet
Development

No branches or pull requests

3 participants