Bug in Deepseek 0324 (and maybe all other models): Stop tokens aren't implemented correctly
complete
M
Max Loh
I passed in "[" and " [" as stop tokens to Deepseek 0324 but it still produced them. I tried the same thing with other providers in Open Router using Deepseek 0324 with an identical request, and they all stopped before the bracket. Only Parasail still outputs the bracket. This issue is specific to Parasail but might affect all models under the API.
Z T
complete
Z T
Thanks for the feedback. It should be fixed after our latest upgrade.
M.R.
Thanks for this, we are looking into this!