Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add liveness check for workers #5886

Merged
merged 3 commits into from
Mar 27, 2023

Conversation

shubhwip
Copy link
Contributor

@shubhwip shubhwip commented Jan 24, 2023

closes #5885

liveness check is based on
rq info command returns monitoring status of redash workers and other status checks
Sample Output

redash@redash-adhocworker-778fc5dbb6-jpscq:/app$ rq info --url $REDASH_REDIS_URL -R
queries      | 0
default      | 2
periodic     |██████████████████ 748
emails       | 0
schemas      | 0
5 queues, 750 jobs total

queries:  1a6d953d53984424ab775d3647427e7b (idle), 29dbf1ec1f774bacbd91ca36ccef6e43 (idle)
default:  –
periodic: –
emails:   –
schemas:  –
2 workers, 5 queues

What type of PR is this?

  • Refactor
  • Feature
  • Bug Fix
  • New Query Runner (Data Source)
  • New Alert Destination
  • Other

Description

How is this tested?

  • Unit tests (pytest, jest)
  • E2E Tests (Cypress)
  • Manually
  • N/A

I have run rq info command in k8s pods and based on that test i have written a healthcheck.

Related Tickets & Documents

Similar Reported Issues Reference :
getredash/contrib-helm-chart#124
getredash/contrib-helm-chart#72
#5801

Mobile & Desktop Screenshots/Recordings (if there are UI changes)

Additional Comments

After this is merged, next change is in helm charts repo
getredash/contrib-helm-chart#140

@lucasfcnunes
Copy link
Member

@shubhwip Can you trigger the CI to test if there still are failings?

@shubhwip shubhwip force-pushed the feature/worker_healthcheck_5885 branch from e0c50ea to a10b1ce Compare March 5, 2023 22:43
@shubhwip
Copy link
Contributor Author

@lucasfcnunes Can I draw your attention on this as this issue is faced by many people and myself everyday ?

@shubhwip shubhwip force-pushed the feature/worker_healthcheck_5885 branch from a10b1ce to 7d8dec9 Compare March 23, 2023 20:34
@shubhwip shubhwip changed the title Add healthcheck for workers Add liveness check for workers Mar 23, 2023
@shubhwip shubhwip requested a review from arikfr March 24, 2023 22:02
@lucasfcnunes lucasfcnunes requested review from lucasfcnunes and removed request for arikfr March 26, 2023 19:45
@shubhwip shubhwip force-pushed the feature/worker_healthcheck_5885 branch from 9be0f6e to baf196d Compare March 27, 2023 08:40
@arikfr arikfr merged commit 5b9fd40 into getredash:master Mar 27, 2023
@arikfr
Copy link
Member

arikfr commented Mar 27, 2023

Thanks, @shubhwip ! Note that I renamed the health check name.

AkaashK pushed a commit to tharzeez/redash that referenced this pull request Jul 18, 2023
* Add liveness check script for workers

closes getredash#5885

* delete extra script

* Rename worker_healthcheck -> workers_healthcheck

---------

Co-authored-by: Arik Fraimovich <[email protected]>
harveyrendell pushed a commit to pushpay/redash that referenced this pull request Jan 8, 2025
* Add liveness check script for workers

closes getredash#5885

* delete extra script

* Rename worker_healthcheck -> workers_healthcheck

---------

Co-authored-by: Arik Fraimovich <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Redash Workers Becomes Inactive Automatically
3 participants