Skip to content

Recommended query format for supported models #504

@pocman

Description

@pocman

Feature request

Add a section in the readme of "Supported Models" to highlight the recommended inputs format for each model.

For example, for Qwen2, should we use the Instruct: {task_description}\nQuery: {query}' format or just query ?

Motivation

In the readme, the list of supported models is really clear and helpful.
However, when it comes to querying the model once the endpoint is deployed, a doubt remains on the format of the string that should be used in the http query.

Your contribution

I'm having the doubt on the best format to query Qwen2 so I can't really help here.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions