Enhance PyTorchRecorder to pass top-level key to extract state_dict

[antimora]

This is needed for Whisper weight pt files.

Pull Request Template

Checklist

• Confirmed that run-checks all script has been executed.
• Made sure the book is up to date with changes in this PR.

Related Issues/PRs

1. Enhanced pickle support for state_dict retrieval from nested dictionaries in .pth files huggingface/candle#1671
2. Chore: Use Candle's published crate version instead of git source code #1299

Changes

1. Enhanced PyTorchRecorder to accept top level key to tract state_dict
2. Updated the book
3. Added new test
4. Using Candle core head version at a specific revision. Filed Chore: Use Candle's published crate version instead of git source code #1299 to revert once we are about to release.

Testing

Added a new unit test.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 85.56%. Comparing base (4efc683) to head (9fb220b).

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1300      +/-   ##
==========================================
+ Coverage   85.44%   85.56%   +0.11%     
==========================================
  Files         593      594       +1     
  Lines       67966    67997      +31     
==========================================
+ Hits        58076    58180     +104     
+ Misses       9890     9817      -73     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[laggui]

Thank you for the fix! I'm sure this will be really helpful 🙂

Overall LGTM! Just some minor typos and an open discussion regarding the name of the new method 👍

[nathanielsimard]

Agree with @laggui comments, otherwise LGTM.

[antimora]

We are waiting till a new Candle release. The PR implementation uses Git's version from Candle's main.