Skip to content

Support for conversion of falcon-rw-1b to gguf format #4580

Closed
@Govind-S-B

Description

@Govind-S-B

Hey , so I was trying to convert this model ericzzz/falcon-rw-1b-chat into gguf format using the convert script in the repo and was having a bunch of KeyErrors with values not available in the config file for the model . I was not sure how to exactly resolve this.
I tried reading into the conversion script and have no idea what will break what and tinkering with it gave me no result.

Read these issues as well regarding support for the falcon-rw-1b models and it seems unresolved still can someone shed light on this I got confused with these chains of referenced issues.

#2868
#2887
#2914

@akawrykow @KerfuffleV2 (Noticed you two guys were having discussions regarding this, sorry in advance if this is unrelated)

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions