HiTZ zentroa

All

15 repositories

arena
Public
Hizkuntza-Eredu Handiak ebaluatzeko arena
0•0•0•0•Updated Nov 20, 2024Nov 20, 2024
accelerate
Public
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
Python
•
Apache License 2.0
•970•0•0•0•Updated Nov 1, 2024Nov 1, 2024
eval-MCG-COLING-2025
Public
Jupyter Notebook
•
Apache License 2.0
•0•0•0•0•Updated Oct 31, 2024Oct 31, 2024
GoLLIE
Public
Guideline following Large Language Model for Information Extraction
training inference text-generation information-extraction transformer named-entity-recognition llama guidelines event-extraction relation-extraction
Python
•
Apache License 2.0
•21•313•2•1•Updated Oct 27, 2024Oct 27, 2024
cn-eval
Public
Jupyter Notebook
•
Apache License 2.0
•0•1•0•0•Updated Oct 16, 2024Oct 16, 2024
critical_questions_generation
Public
Python
•0•0•0•0•Updated Oct 10, 2024Oct 10, 2024
ses-lemma
Public
Evaluating Shortest Edit Script Methods for Contextual Lemmatization
Python
•
Apache License 2.0
•0•0•0•0•Updated Jul 18, 2024Jul 18, 2024
xnli-eu
Public
XNLIeu: a dataset for cross-lingual NLI in Basque
nlp translation machine-translation natural-language-inference basque euskara nli xnli human-translation
Jupyter Notebook
•0•0•0•0•Updated Jul 1, 2024Jul 1, 2024
latxa
Public
Latxa: An Open Language Model and Evaluation Suite for Basque
evaluation language-model basque huggingface gpt-neox llm lm-evaluation latxa
Shell
•
MIT License
•1•25•1•0•Updated Jun 11, 2024Jun 11, 2024
This-is-not-a-Dataset
Public
We introduce a large semi-automatically generated dataset of ~400,000 descriptive sentences about commonsense knowledge that can be true or false in which negation is present in about 2/3 of the corpus in different forms that we use to evaluate LLMs
benchmark decoder transformer llama scorer negation common-sense commonsense huggingface llm
Python
•
Apache License 2.0
•1•11•0•0•Updated May 13, 2024May 13, 2024
multilingual-abstrct
Public
1•0•0•0•Updated May 6, 2024May 6, 2024
lm-contamination
Public
The LM Contamination Index is a manually created database of contamination evidences for LMs.
lm language-model contamination large-language-models llm chatgpt
Python
•4•76•0•0•Updated Apr 11, 2024Apr 11, 2024
MedExpQA
Public
Python
•
Apache License 2.0
•0•1•0•0•Updated Apr 8, 2024Apr 8, 2024
lm-evaluation-harness
Public
A framework for few-shot evaluation of autoregressive language models.
Python
•
MIT License
•1.9k•0•0•0•Updated Oct 5, 2023Oct 5, 2023
eustagger-lite
Public
Eustagger Lite
C++
•
GNU General Public License v3.0
•0•2•1•0•Updated Feb 3, 2022Feb 3, 2022