FIX [Gemma / CI] Make sure our runners have access to the model

[younesbelkada]

What does this PR do?

As discussed offline cc @ydshieh @sanchit-gandhi @ArthurZucker

[ydshieh]

I think it's fine to just put token as a top module variable. Kind a bit strange to has a class attribute as token.

Thanks for the quick fix.

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[ArthurZucker]

Should the token not work as long as it's set with export HF_HUB_READ_TOKEN=$GIT_SECRET

[ydshieh]

Anyone wants to run the corresponding tests have to do

export HF_HUB_READ_TOKEN= ...(their own token, not the token stored on github as secret) ...

For CI, it will work fine as the secret is stored on Github Actions.

[ArthurZucker]

Thanks @Wauplin , after offline talks, seems that we should have something like:

def require_read_token(fn):
    token = os.getenv("HF_HUB_READ_TOKEN")

    @wraps(fn)
    def _inner(*args, **kwargs):
        with patch(huggingface_hub.utils._headers, "get_token", return_value=token):
            return fn(*args, **kwargs)

    return _inner

Users who want to test locally are usually logged in, so if they don't pass a token (False) it should still be alright

[ArthurZucker]

LGTM otherwise