How to? (install models)

[dnelyubenko]

Hi, i can't find the models
Can u tell me, how i can install?
(ls ./models 65B etc is not working)
*sorry, my english isn't good)

[thezolon]

Those have to either be requested from Meta via their project sign up, or from leaked sources. They do not ship with the project.

Once you have the modules downloaded, and there is a github that has a script to help with that, you will need to put them in a folder called 'models', and then run the two commands in the main readme.md of this repository that will convert and quantinize the files to work with this project.

[dnelyubenko]

I can't find, cuz I'm in the region under sanctions
And my VPN doesn't work now :(

[tmzncty]

Hi, i can't find the models Can u tell me, how i can install? (ls ./models 65B etc is not working) *sorry, my english isn't good)

如果你来自中国，请使用链接：https://pan.baidu.com/s/1Y7YWdFWX1Yzy2Yuujp8Tqg?pwd=1p5n
提取码：1p5n
--来自百度网盘超级会员V4的分享
如果你来自其他国家，我还没上传到onedrive等，谷歌云盘暂时作为备份，不分享。
If you come from CHINA, please use this 链接：https://pan.baidu.com/s/1Y7YWdFWX1Yzy2Yuujp8Tqg?pwd=1p5n
提取码：1p5n
--来自百度网盘超级会员V4的分享
If you come from another contury ,please wait me upland.

[tmzncty]

Hi, i can't find the models Can u tell me, how i can install? (ls ./models 65B etc is not working) *sorry, my english isn't good)

如果你来自中国，请使用链接：https://pan.baidu.com/s/1Y7YWdFWX1Yzy2Yuujp8Tqg?pwd=1p5n 提取码：1p5n --来自百度网盘超级会员V4的分享 如果你来自其他国家，我还没上传到onedrive等，谷歌云盘暂时作为备份，不分享。 If you come from CHINA, please use this 链接：https://pan.baidu.com/s/1Y7YWdFWX1Yzy2Yuujp8Tqg?pwd=1p5n 提取码：1p5n --来自百度网盘超级会员V4的分享 If you come from another contury ,please wait me upland.

注意，这里都是原模型，非转换后的。
Notion: The models is real, not change.

[xiliuya]

https://huggingface.co/datasets/nyanko7/LLaMA-65B/tree/main

[tmzncty]

在传了在传了

[tmzncty]

[mikewii]

what you do with .pth files? llama executable requires .bin model

[tmzncty]

what you do with .pth files? llama executable requires .bin model

Use convert-pth-to-ggml.py
May be you can read this https://www.bilibili.com/read/cv22434771
Or this #103
.pth is real LLAMA, need to change to .bin
I am uploading them.
https://zl86n-my.sharepoint.com/:f:/g/personal/ticrawler_tmzn_top/EosXk2cjaGNKu_LdygSz7uMBQT8GHMWO14Y-0EqWhxphxw?e=7LdG9i

[tmzncty]

There are changed models.

[dnelyubenko]

Hi, i can't find the models Can u tell me, how i can install? (ls ./models 65B etc is not working) *sorry, my english isn't good)

如果你来自中国，请使用链接：https://pan.baidu.com/s/1Y7YWdFWX1Yzy2Yuujp8Tqg?pwd=1p5n 提取码：1p5n --来自百度网盘超级会员V4的分享 如果你来自其他国家，我还没上传到onedrive等，谷歌云盘暂时作为备份，不分享。 If you come from CHINA, please use this 链接：https://pan.baidu.com/s/1Y7YWdFWX1Yzy2Yuujp8Tqg?pwd=1p5n 提取码：1p5n --来自百度网盘超级会员V4的分享 If you come from another contury ,please wait me upland.

I from Crimea and I'll be very grateful if u can upload through another service

UPD: tnx, files downloaded

[tmzncty]

Hi, i can't find the models Can u tell me, how i can install? (ls ./models 65B etc is not working) *sorry, my english isn't good)

如果你来自中国，请使用链接：https://pan.baidu.com/s/1Y7YWdFWX1Yzy2Yuujp8Tqg?pwd=1p5n 提取码：1p5n --来自百度网盘超级会员V4的分享 如果你来自其他国家，我还没上传到onedrive等，谷歌云盘暂时作为备份，不分享。 If you come from CHINA, please use this 链接：https://pan.baidu.com/s/1Y7YWdFWX1Yzy2Yuujp8Tqg?pwd=1p5n 提取码：1p5n --来自百度网盘超级会员V4的分享 If you come from another contury ,please wait me upland.

I from Crimea and I'll be very grateful if u can upload through another service

UPD: tnx, files downloaded

https://zl86n-my.sharepoint.com/:f:/g/personal/ticrawler_tmzn_top/EosXk2cjaGNKu_LdygSz7uMBQT8GHMWO14Y-0EqWhxphxw?e
If you can't download, please tell me.

[pjq]

Actually, we can download the models with aria2

• Save bandwidth by using a torrent to distribute more efficiently meta-llama/llama#73
  For download 7B:

aria2c --select-file 21-23,25,26 'magnet:?xt=urn:btih:b8287ebfa04f879b048d4d4404108cf3e8014352&dn=LLaMA'

[tmzncty]

YES, I want to let him download fasterly.

…

------------------ 原始邮件 ------------------ 发件人: "Jianqing ***@***.***>; 发送时间: 2023年3月16日(星期四) 晚上6:24 收件人: ***@***.***>; 抄送: ***@***.***>; ***@***.***>; 主题: Re: [ggerganov/llama.cpp] How to? (install models) (Issue #188) Actually, we can download the models with aria2 meta-llama/llama#73 For download 7B: aria2c --select-file 21-23,25,26 'magnet:?xt=urn:btih:b8287ebfa04f879b048d4d4404108cf3e8014352&dn=LLaMA' — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: ***@***.***>

[jart]

You can access the LLaMA model files by filling out the following form https://docs.google.com/forms/d/e/1FAIpQLSfqNECQnMkycAp2jP4Z9TFX0cGR4uf7b_fBxjY_OjhJILlKGA/viewform to request Meta's permission to use it. That is the primary source of the primary materials. Please do not post links to alternative sources on this issue tracker. This issue tracker is for bugs and feature requests. Thank you!