Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Heavily improve automatic model card generation + Patch XLM-R #28

Merged
merged 95 commits into from
Sep 29, 2023
Merged

Heavily improve automatic model card generation + Patch XLM-R #28

merged 95 commits into from
Sep 29, 2023

Commits on Aug 16, 2023

  1. Uncomment pushing to the Hub

    @tomaarsen
    tomaarsen committed Aug 16, 2023
    Configuration menu
    Copy the full SHA
    b413172 View commit details
    Browse the repository at this point in the history

  2. Initial version to improve automatic model card generation

    @tomaarsen
    tomaarsen committed Aug 16, 2023
    Configuration menu
    Copy the full SHA
    bd036b6 View commit details
    Browse the repository at this point in the history

  3. Simplify label normalization

    @tomaarsen
    tomaarsen committed Aug 16, 2023
    Configuration menu
    Copy the full SHA
    782c1d2 View commit details
    Browse the repository at this point in the history

  4. Automatically select some eval sentences for the widget

    @tomaarsen
    tomaarsen committed Aug 16, 2023
    Configuration menu
    Copy the full SHA
    648c505 View commit details
    Browse the repository at this point in the history

  5. Improve language card

    @tomaarsen
    tomaarsen committed Aug 16, 2023
    Configuration menu
    Copy the full SHA
    12a04bc View commit details
    Browse the repository at this point in the history

  6. Add automatic evaluation results

    @tomaarsen
    tomaarsen committed Aug 16, 2023
    Configuration menu
    Copy the full SHA
    23ca683 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2023

  1. Use dash instead of underscore in model name

    @tomaarsen
    tomaarsen committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    c762433 View commit details
    Browse the repository at this point in the history

  2. Add extra TODOs

    @tomaarsen
    tomaarsen committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    4c7d402 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2023

  1. model.predict text as the first example

    @tomaarsen
    tomaarsen committed Aug 26, 2023
    Configuration menu
    Copy the full SHA
    cbdcdac View commit details
    Browse the repository at this point in the history

  2. Automatically set model name based on encoder & dataset

    @tomaarsen
    tomaarsen committed Aug 26, 2023
    Configuration menu
    Copy the full SHA
    4c33537 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2023

  1. Remove accidental Dataset import

    @tomaarsen
    tomaarsen committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    b9c5d4e View commit details
    Browse the repository at this point in the history

  2. Rename examples to widget examples

    @tomaarsen
    tomaarsen committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    d7dc4ac View commit details
    Browse the repository at this point in the history

  3. Add table with label examples 

    Also use fields instead of __dict__
    @tomaarsen
    tomaarsen committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    a6d5e1e View commit details
    Browse the repository at this point in the history

  4. Ensure complete metadata

    @tomaarsen
    tomaarsen committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    ccd136b View commit details
    Browse the repository at this point in the history

  5. Add tokenizer warning if punct must be split from words

    @tomaarsen
    tomaarsen committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    28c67a7 View commit details
    Browse the repository at this point in the history

  6. Remove dead code

    @tomaarsen
    tomaarsen committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    c016e4d View commit details
    Browse the repository at this point in the history

  7. Rename poor variable names

    @tomaarsen
    tomaarsen committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    7e2e800 View commit details
    Browse the repository at this point in the history

  8. Fix incorrect warning

    @tomaarsen
    tomaarsen committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    c1d6967 View commit details
    Browse the repository at this point in the history

  9. Add " in the model labels

    @tomaarsen
    tomaarsen committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    f9fe787 View commit details
    Browse the repository at this point in the history

  10. Set model_id based on args if possible

    @tomaarsen
    tomaarsen committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    118e695 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2023

  1. Add training set metrics

    @tomaarsen
    tomaarsen committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    e2cb59a View commit details
    Browse the repository at this point in the history

  2. Randomly select 100 samples for the widget examples 

    Instead of taking the first 100
    @tomaarsen
    tomaarsen committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    ab4476f View commit details
    Browse the repository at this point in the history

  3. Prevent duplicate widget examples

    @tomaarsen
    tomaarsen committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    7f44cb9 View commit details
    Browse the repository at this point in the history

  4. Remove completed TODO

    @tomaarsen
    tomaarsen committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    e693018 View commit details
    Browse the repository at this point in the history

  5. Use title case throughout model card

    @tomaarsen
    tomaarsen committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    41589c8 View commit details
    Browse the repository at this point in the history

  6. Add useful comments if values not provided 

    Also prevent crash if dataset_id is not provided
    @tomaarsen
    tomaarsen committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    c2a06a0 View commit details
    Browse the repository at this point in the history

  7. Add environmental impact with codecarbon

    @tomaarsen
    tomaarsen committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    6dd0a84 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2023

  1. Merge branch 'main' of https://github.com/tomaarsen/SpanMarkerNER int… 

    …o feat/improved_model_cards
    @tomaarsen
    tomaarsen committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    6188d8e View commit details
    Browse the repository at this point in the history

  2. Ensure that the model card template is included in the install

    @tomaarsen
    tomaarsen committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    19f7c3c View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. Add training hardware section

    @tomaarsen
    tomaarsen committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    caf09ba View commit details
    Browse the repository at this point in the history

  2. Add Python version

    @tomaarsen
    tomaarsen committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    56861e9 View commit details
    Browse the repository at this point in the history

  3. Make everything title case

    @tomaarsen
    tomaarsen committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    fdf9ecf View commit details
    Browse the repository at this point in the history

  4. Add missing docstring

    @tomaarsen
    tomaarsen committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    be11866 View commit details
    Browse the repository at this point in the history

  5. Add docstring for SpanMarkerModelCardData

    @tomaarsen
    tomaarsen committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    d7848ac View commit details
    Browse the repository at this point in the history

  6. Update CHANGELOG

    @tomaarsen
    tomaarsen committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    aecb6f4 View commit details
    Browse the repository at this point in the history

  7. Add SpanMarkerModelCardData to dunder init

    @tomaarsen
    tomaarsen committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    6d15a37 View commit details
    Browse the repository at this point in the history

  8. Add SpanMarkerModelCardData to snippets

    @tomaarsen
    tomaarsen committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    a5d6b50 View commit details
    Browse the repository at this point in the history

  9. Resolve breaking error if hub_model_id is set

    @tomaarsen
    tomaarsen committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    aaf0545 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2023

  1. gpu_model -> hardware_used 

    To better match what HF expects
    @tomaarsen
    tomaarsen committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    e7e0a43 View commit details
    Browse the repository at this point in the history

  2. Add "base_model" to metadata

    @tomaarsen
    tomaarsen committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    8fd4c1b View commit details
    Browse the repository at this point in the history

  3. Increment datasets min version to 2.14.0 

    Required for sorting on multiple columns at once
    @tomaarsen
    tomaarsen committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    151b3cf View commit details
    Browse the repository at this point in the history

  4. Update trainer evaluate tests

    @tomaarsen
    tomaarsen committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    5e6bf4d View commit details
    Browse the repository at this point in the history

  5. Skip old model card test for now

    @tomaarsen
    tomaarsen committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    aa5153e View commit details
    Browse the repository at this point in the history

  6. Fix edge case: less than 5 examples

    @tomaarsen
    tomaarsen committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    280b601 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2023

  1. pytest.skip -> pytest.mark.skip

    @tomaarsen
    tomaarsen committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    b71f96d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/tomaarsen/SpanMarkerNER int… 

    …o feat/improved_model_cards
    @tomaarsen
    tomaarsen committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    92b9de1 View commit details
    Browse the repository at this point in the history

  3. Try to infer the language from the dataset

    @tomaarsen
    tomaarsen committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    b64119c View commit details
    Browse the repository at this point in the history

  4. Add citations and hidden sections

    @tomaarsen
    tomaarsen committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    179971f View commit details
    Browse the repository at this point in the history

  5. Refactor inferring language

    @tomaarsen
    tomaarsen committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    5db7f8a View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2023

  1. Merge branch 'main' of https://github.com/tomaarsen/SpanMarkerNER int… 

    …o feat/improved_model_cards
    @tomaarsen
    tomaarsen committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    ff5db00 View commit details
    Browse the repository at this point in the history

  2. Remove unused import

    @tomaarsen
    tomaarsen committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    0b3ec56 View commit details
    Browse the repository at this point in the history

  3. Add comment explaining version

    @tomaarsen
    tomaarsen committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    e6d517a View commit details
    Browse the repository at this point in the history

  4. Override default Trainer create_model_card

    @tomaarsen
    tomaarsen committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    73b13ef View commit details
    Browse the repository at this point in the history

  5. Update model card template slightly

    @tomaarsen
    tomaarsen committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    9de5d24 View commit details
    Browse the repository at this point in the history

  6. Add newline to model card template

    @tomaarsen
    tomaarsen committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    6daf082 View commit details
    Browse the repository at this point in the history

  7. Remove incorrect space

    @tomaarsen
    tomaarsen committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    edf6015 View commit details
    Browse the repository at this point in the history

  8. Add model card tests

    @tomaarsen
    tomaarsen committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    d301225 View commit details
    Browse the repository at this point in the history

  9. Improve Trainer tests regarding model card

    @tomaarsen
    tomaarsen committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    f708afe View commit details
    Browse the repository at this point in the history

  10. Remove commented out breakpoint

    @tomaarsen
    tomaarsen committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    f0d11fa View commit details
    Browse the repository at this point in the history

  11. Add codecarbon to CI

    @tomaarsen
    tomaarsen committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    b271eb6 View commit details
    Browse the repository at this point in the history

  12. Rename integration extra to codecarbon

    @tomaarsen
    tomaarsen committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    c91f17f View commit details
    Browse the repository at this point in the history

  13. Make hardware_used optional (if no GPU present)

    @tomaarsen
    tomaarsen committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    0b56d28 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2023

  1. Apply suggestions to model_card_template 

    Co-authored-by: Daniel van Strien <davanstrien@users.noreply.github.com>
    @tomaarsen @davanstrien
    tomaarsen and davanstrien authored Sep 14, 2023
    Configuration menu
    Copy the full SHA
    3e46869 View commit details
    Browse the repository at this point in the history

  2. Update model card test pattern alongside template changes

    @tomaarsen
    tomaarsen committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    ef0ea18 View commit details
    Browse the repository at this point in the history

  3. Don't include hardware_used when no GPU present

    @tomaarsen
    tomaarsen committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    f6e730a View commit details
    Browse the repository at this point in the history

  4. Set "No GPU used" for GPU Model if hardware_used is None

    @tomaarsen
    tomaarsen committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    32617c6 View commit details
    Browse the repository at this point in the history

  5. Don't store None in yaml

    @tomaarsen
    tomaarsen committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    7dc4acd View commit details
    Browse the repository at this point in the history

  6. Ensure that emissions is a regular float

    @tomaarsen
    tomaarsen committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    a6c5689 View commit details
    Browse the repository at this point in the history

  7. kgs to g

    @tomaarsen
    tomaarsen committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    6ed39b5 View commit details
    Browse the repository at this point in the history

  8. support e-05 notation

    @tomaarsen
    tomaarsen committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    53c7321 View commit details
    Browse the repository at this point in the history

  9. Add small test case for model cards

    @tomaarsen
    tomaarsen committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    1a1480d View commit details
    Browse the repository at this point in the history

  10. Update model tables in docs

    @tomaarsen
    tomaarsen committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    9ddcdd9 View commit details
    Browse the repository at this point in the history

  11. Link to the spaCy integration in the tokenizer warning

    @tomaarsen
    tomaarsen committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    96ec42b View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2023

  1. Update README snippet

    @tomaarsen
    tomaarsen committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    3126200 View commit details
    Browse the repository at this point in the history

  2. Update outdated docs: entity_max_length default is 8

    @tomaarsen
    tomaarsen committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    5619fcc View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2023

  1. Remove /models from URL, caused 404s

    @tomaarsen
    tomaarsen committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    40154e4 View commit details
    Browse the repository at this point in the history

  2. Fix outdated type hint

    @tomaarsen
    tomaarsen committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    bd838b0 View commit details
    Browse the repository at this point in the history

  3. 🎉 Apply XLM-R patch

    @tomaarsen
    tomaarsen committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    f2edd06 View commit details
    Browse the repository at this point in the history

  4. Remove /models from test

    @tomaarsen
    tomaarsen committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    084e2d0 View commit details
    Browse the repository at this point in the history

  5. Remove tokenizer warning after patch

    @tomaarsen
    tomaarsen committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    c5f72a5 View commit details
    Browse the repository at this point in the history

  6. Update training docs with model card data etc.

    @tomaarsen
    tomaarsen committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    eea3880 View commit details
    Browse the repository at this point in the history

  7. Pad token embeddings to multiple of 8 

    Removes a warning since transformers 4.32.0
    @tomaarsen
    tomaarsen committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    4a70e18 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2023

  1. Always attach list directly to header

    @tomaarsen
    tomaarsen committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    ec90a80 View commit details
    Browse the repository at this point in the history

  2. Tackle edge case where dataset card has no metadata

    @tomaarsen
    tomaarsen committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    457d75e View commit details
    Browse the repository at this point in the history

  3. Allow installing nltk for detokenizing model card examples

    @tomaarsen
    tomaarsen committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    adb0de6 View commit details
    Browse the repository at this point in the history

  4. Add model card docs

    @tomaarsen
    tomaarsen committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    35b43c4 View commit details
    Browse the repository at this point in the history

  5. Mention codecarbon install in docstring

    @tomaarsen
    tomaarsen committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    93f1689 View commit details
    Browse the repository at this point in the history

  6. overwrite the default codecarbon log level to "error"

    @tomaarsen
    tomaarsen committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    4e02a16 View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2023

  1. Update CHANGELOG

    @tomaarsen
    tomaarsen committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    aebb4aa View commit details
    Browse the repository at this point in the history

  2. Fix issue with inference example containing full quotes

    @tomaarsen
    tomaarsen committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    08000f8 View commit details
    Browse the repository at this point in the history

  3. Update CHANGELOG

    @tomaarsen
    tomaarsen committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    cfb7577 View commit details
    Browse the repository at this point in the history

  4. Never print a model when printing SpanMarkerModelCardData

    @tomaarsen
    tomaarsen committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    e5911bf View commit details
    Browse the repository at this point in the history

  5. Try to infer the dataset_id from the training set 

    Thanks @cakiki
    @tomaarsen
    tomaarsen committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    7d1fa8b View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2023

  1. Merge branch 'main' into feat/improved_model_cards

    @tomaarsen
    tomaarsen committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    9321361 View commit details
    Browse the repository at this point in the history

  2. Update the main docs landing page

    @tomaarsen
    tomaarsen committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    2f753e5 View commit details
    Browse the repository at this point in the history