You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Not for this PR, but I think we'll have to break down the logits processor into library-specific ones. On top of this we'll soon have methods in outlines-core to mask on-device that see optimized for torch, MLX and NumPy. We can already open an issue for that.
The justification for this proposed change is that libraries providing local models (transformers, mlxlm, lamma.cpp...) use different object types and shapes to represent logits.
The text was updated successfully, but these errors were encountered:
First suggested in #1444:
The justification for this proposed change is that libraries providing local models (transformers, mlxlm, lamma.cpp...) use different object types and shapes to represent logits.
The text was updated successfully, but these errors were encountered: