How to evaluate glue lora?

[sorobedio]

Could you please provide an example of how to load a model, instantiate it, and apply a LoRA (Low-Rank Adaptation) using Hugging Face? Specifically, I'm interested in seeing how to download the LoRA and integrate it with a model instance, similar to the examples provided by Hugging Face

I would like to reproduce the glue datasets performance by just doing inference to see with my own eyes.

thank you for the great job