Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enabler: guardrails component design #94

Closed
akotyla opened this issue Oct 14, 2024 · 2 comments · Fixed by #169
Closed

enabler: guardrails component design #94

akotyla opened this issue Oct 14, 2024 · 2 comments · Fixed by #169
Assignees
Labels
enabler This enables development of other issue
Milestone

Comments

@akotyla
Copy link
Collaborator

akotyla commented Oct 14, 2024

We should think about introducing a guardrails component to manage multiple validation checks within the system. We should focus on user input.

All checkers should be stackable and run asynchronously.

Guardrails can include for example: safety checker to filter harmful or inappropriate content and relevance checker to verify if the user’s question aligns with the system's purpose and scope.

https://platform.openai.com/docs/models/moderation
https://github.com/unitaryai/detoxify

@akotyla akotyla added this to ragbits Oct 14, 2024
@akotyla akotyla converted this from a draft issue Oct 14, 2024
@akotyla akotyla added the enabler This enables development of other issue label Oct 14, 2024
@akotyla akotyla self-assigned this Oct 14, 2024
@akotyla akotyla moved this from Backlog to Ready in ragbits Oct 14, 2024
@micpst
Copy link
Collaborator

micpst commented Oct 14, 2024

@akotyla akotyla removed their assignment Oct 14, 2024
@mhordynski mhordynski added this to the Ragbits 0.5 milestone Oct 14, 2024
@micpst
Copy link
Collaborator

micpst commented Oct 14, 2024

Maybe we should also consider using an LLM proxy for this - https://docs.litellm.ai/docs/simple_proxy

@mhordynski mhordynski modified the milestones: Ragbits 0.5, Ragbits 0.4 Oct 23, 2024
@konrad-czarnota-ds konrad-czarnota-ds self-assigned this Oct 29, 2024
@konrad-czarnota-ds konrad-czarnota-ds linked a pull request Nov 4, 2024 that will close this issue
@github-project-automation github-project-automation bot moved this from In review to Done in ragbits Nov 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enabler This enables development of other issue
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

4 participants