vllm provider for guided generation

[yangyaofei]

Plugin Submission Form

1. Submission Type

• New plugin submission
• Version update for existing plugin

2. Description

vllm-openai dify provider plugin to support guided generate.

The vllm openAI compatible server
can make CFG(Classifier-Free Guidance) with outlines or
lm-format-enforcer with Extra Parameters like guided_json, guided_regex.
The openai compatible provider in Dify can not do this, but like gpt-4o can do same thing with json flag.

This plugin provide a vllm-openai provider upon Dify's openai compatible provider with guided_json, guided_regex, guided_grammar.

3. Checklist

• I have read and followed the Publish to Dify Marketplace guidelines
• I have read and comply with the Plugin Developer Agreement
• I confirm my plugin works properly on both Dify Community Edition and Cloud Version
• I confirm my plugin has been thoroughly tested for completeness and functionality
• My plugin brings new value to Dify

4. Documentation Checklist

Please confirm that your plugin README includes all necessary information:

• Step-by-step setup instructions
• Detailed usage instructions
• All required APIs and credentials are clearly listed
• Connection requirements and configuration details

5. Privacy Protection Information

Based on Dify Plugin Privacy Protection Guidelines:

Data Collection

No data collection

Privacy Policy

• I confirm that I have prepared and included a privacy policy in my plugin package based on the Plugin Privacy Protection Guidelines