Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Book 3 (advanced loading + hub) #263

Merged
merged 10 commits into from
Aug 9, 2023
Merged

Book 3 (advanced loading + hub) #263

merged 10 commits into from
Aug 9, 2023

Conversation

Narsil
Copy link
Collaborator

@Narsil Narsil commented Jul 28, 2023

Purposefully ignoring VarBuilder. It's not a good abstraction yet, and is not necessary
in a tutorial IMO. Linking to the actual example currently leads to VarBuilder
but will automatically be fixed. once we fix it.

The current BACKTRACE is also not very readable in external code atm (but it does contain the actual useful information).

@Narsil Narsil marked this pull request as draft July 28, 2023 10:10
@Narsil Narsil force-pushed the book_3 branch 2 times, most recently from c3e8403 to def0e5a Compare August 1, 2023 13:04
@Narsil Narsil changed the title 3rd phase. Book 3 (Using the hub + advanced loading with safetensors) Aug 1, 2023
@Narsil Narsil marked this pull request as ready for review August 1, 2023 15:28
@Narsil Narsil changed the title Book 3 (Using the hub + advanced loading with safetensors) Book 3 (advanced loading + hub) Aug 2, 2023
@Narsil Narsil requested a review from LaurentMazare August 2, 2023 07:21
Narsil added 8 commits August 2, 2023 18:40
- Loading with memmap
- Loading a sharded tensor
- Moved some snippets to `candle-examples/src/lib.rs` This is because
managing book specific dependencies is a pain rust-lang/mdBook#706
- This causes a non aligned inclusion  rust-lang/mdBook#1856 which we have
to ignore fmt to remove.

mdbook might need some more love :)
@@ -1 +1,3 @@
# Serialization

Once you have a r
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Missing some content here?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Possibly. :)

I'll remove that file

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should be good now

@Narsil
Copy link
Collaborator Author

Narsil commented Aug 2, 2023

Modified so now the push to the book happens only when we merge.

@Narsil Narsil requested a review from LaurentMazare August 2, 2023 17:41
@Narsil Narsil merged commit dece0b8 into main Aug 9, 2023
@LaurentMazare LaurentMazare deleted the book_3 branch August 15, 2023 20:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants