Sementic Search with Transformers and PEFT

This repository houses the code for the sementic search

Dependencies

Ensure you have the following dependencies installed before running the code:

GPU config
- accelerate lauch
Training
- python contrastive_train/peft_lora_constrastive_learning.py --dataset_path "./dataset" --model_name_or_path "BAAI/bge-large-en" --output_dir "./sementic_search_outs" --use_peft --with_tracking --report_to all
Evaluation
- python contrastive_train/test_with_hnsw.py --dataset_path "./dataset" --model_name_or_path "BAAI/bge-large-en" --peft_model_path "./sementic_search_outs"

Name		Name	Last commit message	Last commit date
Latest commit History 10 Commits
contrastive_train		contrastive_train
preprocessing		preprocessing
wandb		wandb
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
chec_data.py		chec_data.py