Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Approved, but unable to download weights #41

Closed
delip opened this issue Mar 2, 2023 · 63 comments
Closed

Approved, but unable to download weights #41

delip opened this issue Mar 2, 2023 · 63 comments
Assignees
Labels
download-install Download and installation issues

Comments

@delip
Copy link

delip commented Mar 2, 2023

When I run the download.sh I see this.
image

And I don't see any *.pth files in the download directory.

image

Any suggestions?

@dafraile
Copy link

dafraile commented Mar 2, 2023

I had the same issue downloading locally (Mac Os Monterey) but seems to be working fine in AWS (ubuntu)

@ramithuh
Copy link

ramithuh commented Mar 2, 2023

I edited the code to handle that exception in dictionary defining on mac.

# Copyright (c) Meta Platforms, Inc. and affiliates.
# This software may be used and distributed according to the terms of the GNU General Public License version 3.

PRESIGNED_URL=""             # replace with presigned url from email
MODEL_SIZE="7"  # edit this list with the model sizes you wish to download
TARGET_FOLDER="download"             # where all files should end up

declare -A N_SHARD_DICT

N_SHARD_DICT["7"]="0"
N_SHARD_DICT["13"]="1"
N_SHARD_DICT["30"]="3"
N_SHARD_DICT["65"]="7"

echo "Downloading tokenizer"
wget ${PRESIGNED_URL/'*'/"tokenizer.model"} -O ${TARGET_FOLDER}"/tokenizer.model"
wget ${PRESIGNED_URL/'*'/"tokenizer_checklist.chk"} -O ${TARGET_FOLDER}"/tokenizer_checklist.chk"

(cd ${TARGET_FOLDER} && md5 tokenizer_checklist.chk)

for i in ${MODEL_SIZE//,/ }
do
    echo "Downloading ${i}B"
    mkdir -p ${TARGET_FOLDER}"/${i}B"
    for s in $(seq -f "0%g" 0 ${N_SHARD_DICT[$i]})
    do
        echo "Downloading shard ${s}"
        wget ${PRESIGNED_URL/'*'/"${i}B/consolidated.${s}.pth"} -O ${TARGET_FOLDER}"/${i}B/consolidated.${s}.pth"
    done
    wget ${PRESIGNED_URL/'*'/"${i}B/params.json"} -O ${TARGET_FOLDER}"/${i}B/params.json"
    wget ${PRESIGNED_URL/'*'/"${i}B/checklist.chk"} -O ${TARGET_FOLDER}"/${i}B/checklist.chk"
    echo "Checking checksums"
    (cd ${TARGET_FOLDER}"/${i}B" && md5 checklist.chk)
done

@sumukshashidhar
Copy link

I end up getting either an Error 400: Bad Request, or a 403 when I replace the link. Just to confirm, it is a cloudfront link right?

Screenshot 2023-03-01 at 10 49 47 PM

@Hannibal046
Copy link

Same problem on macOS. besides, I got the extra error:

download.sh: line 9: declare: -A: invalid option

@ramithuh
Copy link

ramithuh commented Mar 2, 2023

@sumukshashidhar it's a cloudfront link. Curious why yours show a urldefence.com link.. maybe the network is blocking ?

@sumukshashidhar
Copy link

I end up getting either an Error 400: Bad Request, or a 403 when I replace the link. Just to confirm, it is a cloudfront link right?

Screenshot 2023-03-01 at 10 49 47 PM

Fixed it. Institution replaces all links with a urldefense link.

I was able to resolve it by opening the link in a web browser, and copying the new link after I see the XML.

@arqamrp
Copy link

arqamrp commented Mar 2, 2023

@Hannibal046 I had got the same error message, solved it by installing wget and md5sum (coreutils).

@Hannibal046
Copy link

@arqamrp got it! Thanks

@sapphire008
Copy link

For the error

download.sh: line 9: declare: -A: invalid option

I used

brew install bash

to install brew v5 and then use the bash installed by brew to download (in my case /opt/homebrew/Cellar/bash/5.2.15/bin/bash download.sh).

@yanzhangnlp
Copy link

Screenshot 2023-03-02 at 1 19 36 PM

Anyone else got this error?

@basujindal
Copy link

I am getting a 403 forbidden error:

HTTP request sent, awaiting response... 403 Forbidden
2023-03-02 05:39:58 ERROR 403: Forbidden.

Any suggestion would be appreciated? : /

@tekspirit
Copy link

I am getting a 403 forbidden error:

HTTP request sent, awaiting response... 403 Forbidden
2023-03-02 05:39:58 ERROR 403: Forbidden.

Any suggestion would be appreciated? : /

you cannot use curl or wget directly.

@basujindal
Copy link

I am getting a 403 forbidden error:

HTTP request sent, awaiting response... 403 Forbidden
2023-03-02 05:39:58 ERROR 403: Forbidden.

Any suggestion would be appreciated? : /

you cannot use curl or wget directly.

Hi, thanks for the reply, I used the download.sh file with the received link (even removed the url defence) but I am still getting the error on Ubuntu 22

@tekspirit
Copy link

I am getting a 403 forbidden error:

HTTP request sent, awaiting response... 403 Forbidden
2023-03-02 05:39:58 ERROR 403: Forbidden.

Any suggestion would be appreciated? : /

you cannot use curl or wget directly.

Hi, thanks for the reply, I used the download.sh file with the received link (even removed the url defence) but I am still getting the error on Ubuntu 22

did you use bash? bash download.sh

@basujindal
Copy link

I am getting a 403 forbidden error:

HTTP request sent, awaiting response... 403 Forbidden
2023-03-02 05:39:58 ERROR 403: Forbidden.

Any suggestion would be appreciated? : /

you cannot use curl or wget directly.

Hi, thanks for the reply, I used the download.sh file with the received link (even removed the url defence) but I am still getting the error on Ubuntu 22

did you use bash? bash download.sh

Yes, I did

@tekspirit
Copy link

I'm getting the checklist.chk and the params.json but the consolidated.xx.pth files are not coming down or do not exist. Any ideas about this?

@G-U-N
Copy link

G-U-N commented Mar 2, 2023

I tried to download it through mobaxterm on windows 10, and got the same error. I fixed the error by installing coreutils.

apt install coreutils

@zhongtao93
Copy link

Using aria2 instead of wget

@harrywang
Copy link

I edited the code to handle that exception in dictionary defining on mac.

# Copyright (c) Meta Platforms, Inc. and affiliates.
# This software may be used and distributed according to the terms of the GNU General Public License version 3.

PRESIGNED_URL=""             # replace with presigned url from email
MODEL_SIZE="7"  # edit this list with the model sizes you wish to download
TARGET_FOLDER="download"             # where all files should end up

declare -A N_SHARD_DICT

N_SHARD_DICT["7"]="0"
N_SHARD_DICT["13"]="1"
N_SHARD_DICT["30"]="3"
N_SHARD_DICT["65"]="7"

echo "Downloading tokenizer"
wget ${PRESIGNED_URL/'*'/"tokenizer.model"} -O ${TARGET_FOLDER}"/tokenizer.model"
wget ${PRESIGNED_URL/'*'/"tokenizer_checklist.chk"} -O ${TARGET_FOLDER}"/tokenizer_checklist.chk"

(cd ${TARGET_FOLDER} && md5 tokenizer_checklist.chk)

for i in ${MODEL_SIZE//,/ }
do
    echo "Downloading ${i}B"
    mkdir -p ${TARGET_FOLDER}"/${i}B"
    for s in $(seq -f "0%g" 0 ${N_SHARD_DICT[$i]})
    do
        echo "Downloading shard ${s}"
        wget ${PRESIGNED_URL/'*'/"${i}B/consolidated.${s}.pth"} -O ${TARGET_FOLDER}"/${i}B/consolidated.${s}.pth"
    done
    wget ${PRESIGNED_URL/'*'/"${i}B/params.json"} -O ${TARGET_FOLDER}"/${i}B/params.json"
    wget ${PRESIGNED_URL/'*'/"${i}B/checklist.chk"} -O ${TARGET_FOLDER}"/${i}B/checklist.chk"
    echo "Checking checksums"
    (cd ${TARGET_FOLDER}"/${i}B" && md5 checklist.chk)
done

I had the same problem and this works! Thanks @ramithuh

@drewgillson
Copy link

Here is a version of download.sh that works with /bin/zsh (zsh 5.8.1 (x86_64-apple-darwin22.0)

# Copyright (c) Meta Platforms, Inc. and affiliates.
# This software may be used and distributed according to the terms of the GNU General Public License version 3.

PRESIGNED_URL=""             # replace with presigned url from email
MODEL_SIZE="X7B,X13B,X30B,X65B"  # edit this list with the model sizes you wish to download
TARGET_FOLDER="."             # where all files should end up

declare -a N_SHARD_DICT

N_SHARD_DICT["X7B"]="0"
N_SHARD_DICT["X13B"]="1"
N_SHARD_DICT["X30B"]="3"
N_SHARD_DICT["X65B"]="7"

echo "Downloading tokenizer"
wget ${PRESIGNED_URL/'*'/"tokenizer.model"} -O ${TARGET_FOLDER}"/tokenizer.model"
wget ${PRESIGNED_URL/'*'/"tokenizer_checklist.chk"} -O ${TARGET_FOLDER}"/tokenizer_checklist.chk"

(cd ${TARGET_FOLDER} && md5 -r tokenizer_checklist.chk)

for i in ${MODEL_SIZE//,/ }
do
    m="${i:1}" # remove preceding X
    echo "Downloading ${m}"
    mkdir -p ${TARGET_FOLDER}"/${m}"
    for s in $(seq -f "0%g" 0 ${N_SHARD_DICT[$i]})
    do
        echo ${PRESIGNED_URL/'*'/"${m}/consolidated.${s}.pth"} -O ${TARGET_FOLDER}"/${m}/consolidated.${s}.pth"
        wget ${PRESIGNED_URL/'*'/"${m}/consolidated.${s}.pth"} -O ${TARGET_FOLDER}"/${m}/consolidated.${s}.pth"
    done
    wget ${PRESIGNED_URL/'*'/"${m}/params.json"} -O ${TARGET_FOLDER}"/${m}/params.json"
    wget ${PRESIGNED_URL/'*'/"${m}/checklist.chk"} -O ${TARGET_FOLDER}"/${m}/checklist.chk"
    echo "Checking checksums"
    (cd ${TARGET_FOLDER}"/${m}" && md5 -r checklist.chk)
done

@kli017
Copy link

kli017 commented Mar 3, 2023

Connecting to dobf1k6cxlizq.cloudfront.net|13.33.45.217|:443... connected.
ERROR: cannot verify dobf1k6cxlizq.cloudfront.net's certificate, issued by `/C=US/O=Amazon/CN=Amazon RSA 2048 M01':

Hello anyone meet this error?

@definev
Copy link

definev commented Mar 3, 2023

How to run in mac M1? Did anyone try it?

@riskyhomo
Copy link

i got approved but unable to download the 7B weight , now please tell what steps should be followed in order to access the 7B weight i have installed all the tools required for it , thanking you

@tekspirit
Copy link

i got approved but unable to download the 7B weight , now please tell what steps should be followed in order to access the 7B weight i have installed all the tools required for it , thanking you

If you on mac, there is a script here in the issues you can use that works.

@trekrollercoaster
Copy link

trekrollercoaster commented Mar 6, 2023

I end up getting either an Error 400: Bad Request, or a 403 when I replace the link. Just to confirm, it is a cloudfront link right?

Screenshot 2023-03-01 at 10 49 47 PM

#57 (comment)

This seems to be a problem of the network region. Set the proxy to JP or US to solve this problem

@Vitaly-Protasov
Copy link

Vitaly-Protasov commented Mar 6, 2023

Still getting ERROR 403: Forbidden.. How to fix it?
Tried to change region to US - no luck.

@borisalmonacid
Copy link

borisalmonacid commented Apr 19, 2023

same 403 forbidden error both in Mac and Linux in Singapore

@Luxios22 @BarkaviSJ @sacrrie maybe with VPN?

anyway, I used this code in the python version (curl download)

> for i, n in enumerate(models):
>     logging.info(f"[{i}/{len(models)}]Downloding {n}...")
>     curl_str = f"curl {PRESIGNED_URL(n)} -o {TARGET_FOLDER(n)}"
>     print("---- RULE: ", curl_str)
>     if args.dryrun:
>         logging.debug(f"-- {curl_str}")
>     else:
>         if not args.check_only:
>             subprocess.run(curl_str.split(' '))

@Luxios22
Copy link

same 403 forbidden error both in Mac and Linux in Singapore

@Luxios22 @BarkaviSJ maybe with VPN?

You mean VPN of which place?

@borisalmonacid
Copy link

same 403 forbidden error both in Mac and Linux in Singapore

@Luxios22 @BarkaviSJ maybe with VPN?

You mean VPN of which place?

@Luxios22 yes, I simple test for discard, but, I had different problems, and finally the version of python with curl worked for me in a 5G connection

@Luxios22
Copy link

same 403 forbidden error both in Mac and Linux in Singapore

@Luxios22 @BarkaviSJ maybe with VPN?

You mean VPN of which place?

@Luxios22 yes, I simple test for discard, but, I had different problems, and finally the version of python with curl worked for me in a 5G connection

Curl version python code did help on Mac, but this time I got Access Denied shown in params.json, which is really weird. I am using the link LLaMA sent to me.
Anyway thanks, I may try to contact the LLaMA team.

@BarkaviSJ
Copy link

same 403 forbidden error both in Mac and Linux in Singapore

@Luxios22 @BarkaviSJ @sacrrie maybe with VPN?

anyway, I used this code in the python version (curl download)

> for i, n in enumerate(models):
>     logging.info(f"[{i}/{len(models)}]Downloding {n}...")
>     curl_str = f"curl {PRESIGNED_URL(n)} -o {TARGET_FOLDER(n)}"
>     print("---- RULE: ", curl_str)
>     if args.dryrun:
>         logging.debug(f"-- {curl_str}")
>     else:
>         if not args.check_only:
>             subprocess.run(curl_str.split(' '))

@borisalmonacid Thank you for this suggestion. 403 Forbidden is solved. Looks like the download is taking longer, even for the 7B model. Any rough estimate as to how long the download takes?

                             Dload  Upload   Total   Spent    Left  Speed

100 110 100 110 0 0 1095 0 --:--:-- --:--:-- --:--:-- 1100
INFO:root:[0/1] Checking Model 7B...

@sergiotasconmorales
Copy link

anyway, I used this code in the python version (curl download)

> for i, n in enumerate(models):
>     logging.info(f"[{i}/{len(models)}]Downloding {n}...")
>     curl_str = f"curl {PRESIGNED_URL(n)} -o {TARGET_FOLDER(n)}"
>     print("---- RULE: ", curl_str)
>     if args.dryrun:
>         logging.debug(f"-- {curl_str}")
>     else:
>         if not args.check_only:
>             subprocess.run(curl_str.split(' '))

@borisalmonacid Thank you for this suggestion. 403 Forbidden is solved. Looks like the download is taking longer, even for the 7B model. Any rough estimate as to how long the download takes?

                             Dload  Upload   Total   Spent    Left  Speed

100 110 100 110 0 0 1095 0 --:--:-- --:--:-- --:--:-- 1100 INFO:root:[0/1] Checking Model 7B...

@BarkaviSJ did that work for you on Mac or Linux? I tried it on Linux but it didn't solve the problem.

@BarkaviSJ
Copy link

BarkaviSJ commented Apr 19, 2023

anyway, I used this code in the python version (curl download)

> for i, n in enumerate(models):
>     logging.info(f"[{i}/{len(models)}]Downloding {n}...")
>     curl_str = f"curl {PRESIGNED_URL(n)} -o {TARGET_FOLDER(n)}"
>     print("---- RULE: ", curl_str)
>     if args.dryrun:
>         logging.debug(f"-- {curl_str}")
>     else:
>         if not args.check_only:
>             subprocess.run(curl_str.split(' '))

@borisalmonacid Thank you for this suggestion. 403 Forbidden is solved. Looks like the download is taking longer, even for the 7B model. Any rough estimate as to how long the download takes?

                             Dload  Upload   Total   Spent    Left  Speed

100 110 100 110 0 0 1095 0 --:--:-- --:--:-- --:--:-- 1100 INFO:root:[0/1] Checking Model 7B...

@BarkaviSJ did that work for you on Mac or Linux? I tried it on Linux but it didn't solve the problem.

That worked for me (curl for 403 forbidden alone) in MAC. But, I still have the same issue as mentioned by @Luxios22. Access Denied shown in params.json

I installed brew install md5sha1sum yet it is NOT working.

@davidreber
Copy link

I am getting the same 403 error on Ubuntu; the python code does not resolve it. Adjusting to the curl snippet produces the same error as @Luxios22: Access Denied shown in params.json.

@aaanh
Copy link

aaanh commented Apr 20, 2023

I'm also having the same 403 forbidden error.
My machine is running:

  • OS: Red Hat Enterprise Linux 9.1 (Plow) x86_64
  • Kernel: 5.14.0-162.22.2.el9_1.x86_64
  • Packages:
    • curl.x86_64: 7.76.1-19.el9_1.2
    • wget.x86_64: 1.21.1-7.el9
    • Python 3.9.14

I've tried:

  • updating everything using dnf, reinstalling wget, curl, and coreutils
  • VPN tunneled to a data center in the US (I'm based in Canada)
  • Both the originally provided download.sh, the download.py ones above
  • All of the above but on Ubuntu Desktop 22.10 (native, not VM) and macOS Ventura (macOS 13.3.1 22E261 arm64, kernel 22.4.0)

No luck so far 😅

@borisalmonacid
Copy link

same 403 forbidden error both in Mac and Linux in Singapore

@Luxios22 @BarkaviSJ @sacrrie maybe with VPN?
anyway, I used this code in the python version (curl download)

> for i, n in enumerate(models):
>     logging.info(f"[{i}/{len(models)}]Downloding {n}...")
>     curl_str = f"curl {PRESIGNED_URL(n)} -o {TARGET_FOLDER(n)}"
>     print("---- RULE: ", curl_str)
>     if args.dryrun:
>         logging.debug(f"-- {curl_str}")
>     else:
>         if not args.check_only:
>             subprocess.run(curl_str.split(' '))

@borisalmonacid Thank you for this suggestion. 403 Forbidden is solved. Looks like the download is taking longer, even for the 7B model. Any rough estimate as to how long the download takes?

                             Dload  Upload   Total   Spent    Left  Speed

100 110 100 110 0 0 1095 0 --:--:-- --:--:-- --:--:-- 1100 INFO:root:[0/1] Checking Model 7B...

@BarkaviSJ 10-15 minutes in 5G phone,.

@borisalmonacid
Copy link

anyway, I used this code in the python version (curl download)

> for i, n in enumerate(models):
>     logging.info(f"[{i}/{len(models)}]Downloding {n}...")
>     curl_str = f"curl {PRESIGNED_URL(n)} -o {TARGET_FOLDER(n)}"
>     print("---- RULE: ", curl_str)
>     if args.dryrun:
>         logging.debug(f"-- {curl_str}")
>     else:
>         if not args.check_only:
>             subprocess.run(curl_str.split(' '))

@borisalmonacid Thank you for this suggestion. 403 Forbidden is solved. Looks like the download is taking longer, even for the 7B model. Any rough estimate as to how long the download takes?

                             Dload  Upload   Total   Spent    Left  Speed

100 110 100 110 0 0 1095 0 --:--:-- --:--:-- --:--:-- 1100 INFO:root:[0/1] Checking Model 7B...

@BarkaviSJ did that work for you on Mac or Linux? I tried it on Linux but it didn't solve the problem.

That worked for me (curl for 403 forbidden alone) in MAC. But, I still have the same issue as mentioned by @Luxios22. Access Denied shown in params.json

I installed brew install md5sha1sum yet it is NOT working.

@BarkaviSJ you must use an independent md5 software for the check, specifically for your operating system/distribution.
In fact, I did the md5-sum in Windows 10 in a manual way.

image

@mgagvani
Copy link

I'm getting the same error, using both download.sh and the Python script commented above by @mpskex. I'm using WSL2 with Python 3.10.6 and wget 1.21.2.

@amnank
Copy link

amnank commented Apr 24, 2023

image

Anyone else getting this issue?

@VladimirVincan
Copy link

Doesn't work, I also tried to change the -O flag with aria2's -o flag.

@jsriram9
Copy link

jsriram9 commented Apr 25, 2023

same 403 forbidden error both in Mac and Linux in Singapore

@Luxios22 @BarkaviSJ maybe with VPN?

You mean VPN of which place?

@Luxios22 yes, I simple test for discard, but, I had different problems, and finally the version of python with curl worked for me in a 5G connection

How did u solve the signature, key-value pair and md5 problem in windows?

@montyhall
Copy link

i just got a new presigned URL and ran FAIR's own download.sh and it is working.

@yskolnick
Copy link

same 403 forbidden error both in Mac and Linux in Singapore

@Luxios22 @BarkaviSJ maybe with VPN?

You mean VPN of which place?

@Luxios22 yes, I simple test for discard, but, I had different problems, and finally the version of python with curl worked for me in a 5G connection

How did u solve the signature, key-value pair and md5 problem in windows?

image

Anyone else getting this issue?

choco install wget
got rid of the wget issue if you have: (https://chocolatey.org/install)
I can't solve the md5 yet

@abalhomaid
Copy link

abalhomaid commented Apr 30, 2023

I added #!/bin/bash at the first line and chmod +x download.sh for it to work. Also, make sure your shell window can call wget command

@vkp2020
Copy link

vkp2020 commented May 5, 2023

Finally I managed to fix all issues and download the model weights thanks to the comments from this group. I am writing this to help others investigate and fix it systematically:

Step-1: Read the output. If you see this error
--- download.sh: line 9: declare: -A: invalid option ---
Then do
brew install bash
to install brew v5 and then use the bash installed by brew to download latest version of bash (the problem is that the version of bash that ships with Mac doesn't have option -A)
and then run this (make sure to replace the version digits if your version is different than this)

/opt/homebrew/Cellar/bash/5.2.15/bin/bash download.sh

Step-2: If you see wget not found or checksum not found errors it means that these tools are not installed, install them:

brew install wget
brew install md5sha1sum

and run the download.sh as described above

Step-3: If you get 403 Forbidden error it means that you are messing up with settings. Make sure that you have copy pasted the 'exact' url as you received (it has a * sign in it which is replaced by elected model) do not change anything in the url. and for model selection just keep your selected option from the list. e.g.

MODEL_SIZE="7B" # edit this list with the model sizes you wish to download
or
MODEL_SIZE="13B" # edit this list with the model sizes you wish to download
like this.
DO NOT Change anything else, just write the name of the folder where you want to store model weights. bash will create the folder if it does not exist.

ENJOY...

@soumakmo
Copy link

soumakmo commented May 9, 2023

The script only downloads consolidated.00.pth and consolidated.01.pth files for every model. Anyone else facing this problem?

@vamgan
Copy link

vamgan commented May 24, 2023

I was getting a 403 error with the bash script but I was able to successfully start downloading through the python script. Thanks a lot.

@VidarSolutions
Copy link

#!/bin/bash

drewgillson's new script posted mar 2 2023 worked for me.
Thanks Drew!!!
I had to make sure the wget commands were all on one line somehow copy and pasting from the browser to the terminal windows added a carriage return and thus had an issue with the output files not existing instead of creating them. once I made all the wget commands were a single line the script ran perfectly and downloaded them files.

was
wget ${PRESIGNED_URL/'*'/"tokenizer.model"} -O

${TARGET_FOLDER}"/tokenizer.model"
wget ${PRESIGNED_URL/'*'/"tokenizer_checklist.chk"} -O

${TARGET_FOLDER}"/tokenizer_checklist.chk"

should have been:

wget ${PRESIGNED_URL/'*'/"tokenizer.model"} -O ${TARGET_FOLDER}"/tokenizer.model"

wget ${PRESIGNED_URL/'*'/"tokenizer_checklist.chk"} -O ${TARGET_FOLDER}"/tokenizer_checklist.chk"

@resperic
Copy link

resperic commented May 31, 2023

Ubuntu 22.04

I inserted the link into the .sh file, and tried to run it:

sudo bash download.sh

This resulted in the following:

Downloading tokenizer
--2023-05-31 16:00:16-- https://dobf1k6cxlizq.cloudfront.net/tokenizer.model?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.121, 18.164.153.91, 18.164.153.94, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.121|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:16 ERROR 403: Forbidden.

--2023-05-31 16:00:16-- https://dobf1k6cxlizq.cloudfront.net/tokenizer_checklist.chk?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.91, 18.164.153.27, 18.164.153.121, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.91|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:16 ERROR 403: Forbidden.

md5sum: tokenizer_checklist.chk: No such file or directory
Downloading 7B
--2023-05-31 16:00:16-- https://dobf1k6cxlizq.cloudfront.net/7B/consolidated.00.pth?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.91, 18.164.153.27, 18.164.153.121, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.91|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:16 ERROR 403: Forbidden.

--2023-05-31 16:00:16-- https://dobf1k6cxlizq.cloudfront.net/7B/params.json?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.91, 18.164.153.121, 18.164.153.27, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.91|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:16 ERROR 403: Forbidden.

--2023-05-31 16:00:16-- https://dobf1k6cxlizq.cloudfront.net/7B/checklist.chk?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.121, 18.164.153.94, 18.164.153.91, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.121|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:16 ERROR 403: Forbidden.

Checking checksums
md5sum: checklist.chk: no properly formatted MD5 checksum lines found
Downloading 13B
--2023-05-31 16:00:16-- https://dobf1k6cxlizq.cloudfront.net/13B/consolidated.00.pth?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.121, 18.164.153.94, 18.164.153.91, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.121|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:16 ERROR 403: Forbidden.

--2023-05-31 16:00:16-- https://dobf1k6cxlizq.cloudfront.net/13B/consolidated.01.pth?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.121, 18.164.153.94, 18.164.153.27, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.121|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:16 ERROR 403: Forbidden.

--2023-05-31 16:00:16-- https://dobf1k6cxlizq.cloudfront.net/13B/params.json?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.94, 18.164.153.91, 18.164.153.121, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.94|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:16 ERROR 403: Forbidden.

--2023-05-31 16:00:16-- https://dobf1k6cxlizq.cloudfront.net/13B/checklist.chk?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.27, 18.164.153.121, 18.164.153.91, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.27|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:17 ERROR 403: Forbidden.

Checking checksums
md5sum: checklist.chk: no properly formatted MD5 checksum lines found
Downloading 30B
--2023-05-31 16:00:17-- https://dobf1k6cxlizq.cloudfront.net/30B/consolidated.00.pth?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.94, 18.164.153.27, 18.164.153.91, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.94|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:17 ERROR 403: Forbidden.

--2023-05-31 16:00:17-- https://dobf1k6cxlizq.cloudfront.net/30B/consolidated.01.pth?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.121, 18.164.153.94, 18.164.153.91, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.121|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:17 ERROR 403: Forbidden.

--2023-05-31 16:00:17-- https://dobf1k6cxlizq.cloudfront.net/30B/consolidated.02.pth?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.94, 18.164.153.121, 18.164.153.91, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.94|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:17 ERROR 403: Forbidden.

--2023-05-31 16:00:17-- https://dobf1k6cxlizq.cloudfront.net/30B/consolidated.03.pth?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.91, 18.164.153.121, 18.164.153.27, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.91|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:17 ERROR 403: Forbidden.

--2023-05-31 16:00:17-- https://dobf1k6cxlizq.cloudfront.net/30B/params.json?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.121, 18.164.153.94, 18.164.153.27, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.121|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:17 ERROR 403: Forbidden.

--2023-05-31 16:00:17-- https://dobf1k6cxlizq.cloudfront.net/30B/checklist.chk?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.91, 18.164.153.121, 18.164.153.27, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.91|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:17 ERROR 403: Forbidden.

Checking checksums
md5sum: checklist.chk: no properly formatted MD5 checksum lines found
Downloading 65B
--2023-05-31 16:00:17-- https://dobf1k6cxlizq.cloudfront.net/65B/consolidated.00.pth?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.27, 18.164.153.121, 18.164.153.91, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.27|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:17 ERROR 403: Forbidden.

--2023-05-31 16:00:17-- https://dobf1k6cxlizq.cloudfront.net/65B/consolidated.01.pth?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.91, 18.164.153.27, 18.164.153.94, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.91|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:17 ERROR 403: Forbidden.

--2023-05-31 16:00:17-- https://dobf1k6cxlizq.cloudfront.net/65B/consolidated.02.pth?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.121, 18.164.153.91, 18.164.153.94, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.121|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:17 ERROR 403: Forbidden.

--2023-05-31 16:00:17-- https://dobf1k6cxlizq.cloudfront.net/65B/consolidated.03.pth?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.27, 18.164.153.91, 18.164.153.121, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.27|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:18 ERROR 403: Forbidden.

--2023-05-31 16:00:18-- https://dobf1k6cxlizq.cloudfront.net/65B/consolidated.04.pth?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.94, 18.164.153.121, 18.164.153.91, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.94|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:18 ERROR 403: Forbidden.

--2023-05-31 16:00:18-- https://dobf1k6cxlizq.cloudfront.net/65B/consolidated.05.pth?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.94, 18.164.153.91, 18.164.153.121, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.94|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:18 ERROR 403: Forbidden.

--2023-05-31 16:00:18-- https://dobf1k6cxlizq.cloudfront.net/65B/consolidated.06.pth?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.91, 18.164.153.121, 18.164.153.27, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.91|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:18 ERROR 403: Forbidden.

--2023-05-31 16:00:18-- https://dobf1k6cxlizq.cloudfront.net/65B/consolidated.07.pth?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.94, 18.164.153.121, 18.164.153.91, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.94|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:18 ERROR 403: Forbidden.

--2023-05-31 16:00:18-- https://dobf1k6cxlizq.cloudfront.net/65B/params.json?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.94, 18.164.153.91, 18.164.153.27, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.94|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:18 ERROR 403: Forbidden.

--2023-05-31 16:00:18-- https://dobf1k6cxlizq.cloudfront.net/65B/checklist.chk?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kb2JmMWs2Y3hsaXpxLmNsb3VkZnJvbnQubmV0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE2ODU0NjEzMTh9fX1dfQ__&Signature=rWAxLZ3yHoYf7aSnB8nwac~lWZqRJZe92nfj53dVLD-ppD2qkpl87iEr9V~PSxXcGxAuufi~SQriQM5jAaFXfoPPcXRNUG5UFXFGK8kQ5hk3xWMcPiROVUJj3cd5u6Fj2Wfy85ivFfRlfaXCs-C3u8VOdxrjBUSx5F3mr3rL6989sJu9Zv5jNndI9Wu6Ni92piE5~w956WMc0NatCcEnr-WXEtZPPcfGDoPafIauEfb-lN~TDahEEo7igcuvzGgt3usK9C9NB~uiR07qLn2AJCuqQcfCzxqwuvaI~5pgu0MZIhaYDqd0pgSByINJvqnJavGS-eKtkxEYz7yROqdV8w__&Key-Pair-Id=K231VYXPC1TA1R
Resolving dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)... 18.164.153.91, 18.164.153.27, 18.164.153.121, ...
Connecting to dobf1k6cxlizq.cloudfront.net (dobf1k6cxlizq.cloudfront.net)|18.164.153.91|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-05-31 16:00:18 ERROR 403: Forbidden.

Checking checksums
md5sum: checklist.chk: no properly formatted MD5 checksum lines found

@iamlajoya21
Copy link

I edited the code to handle that exception in dictionary defining on mac.

# Copyright (c) Meta Platforms, Inc. and affiliates.
# This software may be used and distributed according to the terms of the GNU General Public License version 3.

PRESIGNED_URL=""             # replace with presigned url from email
MODEL_SIZE="7"  # edit this list with the model sizes you wish to download
TARGET_FOLDER="download"             # where all files should end up

declare -A N_SHARD_DICT

N_SHARD_DICT["7"]="0"
N_SHARD_DICT["13"]="1"
N_SHARD_DICT["30"]="3"
N_SHARD_DICT["65"]="7"

echo "Downloading tokenizer"
wget ${PRESIGNED_URL/'*'/"tokenizer.model"} -O ${TARGET_FOLDER}"/tokenizer.model"
wget ${PRESIGNED_URL/'*'/"tokenizer_checklist.chk"} -O ${TARGET_FOLDER}"/tokenizer_checklist.chk"

(cd ${TARGET_FOLDER} && md5 tokenizer_checklist.chk)

for i in ${MODEL_SIZE//,/ }
do
    echo "Downloading ${i}B"
    mkdir -p ${TARGET_FOLDER}"/${i}B"
    for s in $(seq -f "0%g" 0 ${N_SHARD_DICT[$i]})
    do
        echo "Downloading shard ${s}"
        wget ${PRESIGNED_URL/'*'/"${i}B/consolidated.${s}.pth"} -O ${TARGET_FOLDER}"/${i}B/consolidated.${s}.pth"
    done
    wget ${PRESIGNED_URL/'*'/"${i}B/params.json"} -O ${TARGET_FOLDER}"/${i}B/params.json"
    wget ${PRESIGNED_URL/'*'/"${i}B/checklist.chk"} -O ${TARGET_FOLDER}"/${i}B/checklist.chk"
    echo "Checking checksums"
    (cd ${TARGET_FOLDER}"/${i}B" && md5 checklist.chk)
done

this works - thanks a bunch

@anubop anubop added the download-install Download and installation issues label Sep 5, 2023
@jspisak jspisak self-assigned this Sep 6, 2023
@jspisak
Copy link
Contributor

jspisak commented Sep 6, 2023

Closing this issue but cc'ing @samuelselvan for FYI and future script updates..

@jspisak jspisak closed this as completed Sep 6, 2023
@Iazzetta
Copy link

Don't need update download.sh, just install:

brew install wget rhash coreutils

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
download-install Download and installation issues
Projects
None yet
Development

No branches or pull requests