You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm Running into this problem on a Mac M3 Sonoma 15.5 and python 3.10.14
When trying to execute the simple example from the documentation for finetuning a model :
fromragatouilleimportRAGTrainerfromragatouille.utilsimportget_wikipedia_pageif__name__=="__main__":
pairs= [
("What is the meaning of life ?", "The meaning of life is 42"),
("What is Neural Search?", "Neural Search is a terms referring to a family of ..."),
# You need many more pairs to train! Check the examples for more details!
...
]
my_full_corpus= [get_wikipedia_page("Hayao_Miyazaki"), get_wikipedia_page("Studio_Ghibli")]
trainer=RAGTrainer(model_name="MyFineTunedColBERT",
pretrained_model_name="colbert-ir/colbertv2.0") # In this example, we run fine-tuning# This step handles all the data processing, check the examples for more details!trainer.prepare_training_data(raw_data=pairs,
data_out_path="./data/",
all_documents=my_full_corpus)
trainer.train(batch_size=32) # Train with the default hyperparams
it's returning the following error :
ValueError: Default process group has not been initialized, please make sure to call init_process_group.
Seems to be an error due to paralling training but nothing that I'm sure of.
The text was updated successfully, but these errors were encountered:
I'm Running into this problem on a Mac M3 Sonoma 15.5 and python 3.10.14
When trying to execute the simple example from the documentation for finetuning a model :
it's returning the following error :
Seems to be an error due to paralling training but nothing that I'm sure of.
The text was updated successfully, but these errors were encountered: