Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Eval bug: fail to load model in MacOS #10585

Closed
Animaxx opened this issue Nov 29, 2024 · 3 comments
Closed

Eval bug: fail to load model in MacOS #10585

Animaxx opened this issue Nov 29, 2024 · 3 comments

Comments

@Animaxx
Copy link

Animaxx commented Nov 29, 2024

Name and Version

5931c1f (ggml : add support for dynamic loading of backends) this commit causing model loading error in MacOS

in llama.cpp, make_cpu_buft_list function

   // add extra buffer types
   auto * cpu_dev = ggml_backend_dev_by_type(GGML_BACKEND_DEVICE_TYPE_CPU);
   auto * cpu_reg = ggml_backend_dev_backend_reg(cpu_dev);

cpu_dev is NULL and ggml_backend_dev_backend_reg(cpu_dev) give EXC_BAD_ACCESS

Operating systems

Mac

GGML backends

Metal

Hardware

Mac M1

Models

No response

Problem description & steps to reproduce

Load this commit, build in MacOS and load any model.

First Bad Commit

#10469

Relevant log output

"exception" : {"codes":"0x0000000000000001, 0x0000000000000078","rawCodes":[1,120],"type":"EXC_BAD_ACCESS","signal":"SIGSEGV","subtype":"KERN_INVALID_ADDRESS at 0x0000000000000078"},
  "termination" : {"flags":0,"code":11,"namespace":"SIGNAL","indicator":"Segmentation fault: 11","byProc":"exc handler","byPid":3547},
  "vmregioninfo" : "0x78 is not in any region.  Bytes before following region: 4308057992\n      REGION TYPE                    START - END         [ VSIZE] PRT\/MAX SHRMOD  REGION DETAIL\n      UNUSED SPACE AT START\n--->
@slaren
Copy link
Collaborator

slaren commented Nov 29, 2024

That's not enough information to reproduce the issue.

@Animaxx
Copy link
Author

Animaxx commented Nov 29, 2024

hmm let me create a demo project

@Animaxx
Copy link
Author

Animaxx commented Nov 30, 2024

the issue related to my project cache, thank you for replying @slaren. I am going to close this one

@Animaxx Animaxx closed this as completed Nov 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants