regex stopping condition

[jancervenka]

Motivation

Hi @merrymercy! I am interested in contributing to the SGLang project so I gave this issue a shot: #2007 Is this a sensible approach? I am a very new to the project so any pointers are welcomed.

I will add tests and update the docs once the change looks ok to you. I am actually having troubles getting the project running on my machine so I haven't been able to test it yet.

Checklist

• Format your code according to the Contributor Guide.
• Add unit tests as outlined in the Contributor Guide.
• Update documentation as needed, including docstrings or example tutorials.

[merrymercy]

1. It is better to implement it here

   sglang/python/sglang/srt/managers/schedule_batch.py

   Line 325 in a10d530

   def check_finished(self):

2. Can you add a new argument for this stop condition, so we do not make the old simple string match slower? You can add a new field at SamplingParameters

   sglang/python/sglang/srt/sampling/sampling_params.py

   Line 23 in a10d530

   class SamplingParams:

[jancervenka]

thank you @merrymercy. In Req.check_finished, is it ok to ignore tail_str and just check decoded_text? Because we don't know ho many tokens to decode to get a regex match.