You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The thinking process in DeepSeek-derived models can often be longer than the final result, but the user has no way to anticipate this, which often leads to just an incomplete thinking process with no final answer.
It would be very nice to include an option where the model can "think" as much as needed (or within a separately defined limit) without counting those tokens toward the finalMax Output. This would allow the reasoning phase to function more independently since it’s not necessarily intended for the user to see or directly use it.
From my attempt to somewhat circumvent this I would also like to know: is there currently a way to define (via arguments) the initial Max Output size? Or the effective range available in the ui slider? I know you can manually type values above 512, but a way to set it like you can --contextsize would be welcomed as well.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
The thinking process in DeepSeek-derived models can often be longer than the final result, but the user has no way to anticipate this, which often leads to just an incomplete thinking process with no final answer.
It would be very nice to include an option where the model can "think" as much as needed (or within a separately defined limit) without counting those tokens toward the final
Max Output
. This would allow the reasoning phase to function more independently since it’s not necessarily intended for the user to see or directly use it.From my attempt to somewhat circumvent this I would also like to know: is there currently a way to define (via arguments) the initial Max Output size? Or the effective range available in the ui slider? I know you can manually type values above 512, but a way to set it like you can
--contextsize
would be welcomed as well.Beta Was this translation helpful? Give feedback.
All reactions