BPE Models

Here are the BPE models that you can use for your project.

How to Use BPE Models

1. Download the BPE model file from the provided source.
2. Install the necessary dependencies for using BPE models in your project.
3. Tokenize your text using the BPE model to obtain subword units.
4. Use the subword units for further processing or analysis in your project.

Example

You can install subword-nmt using pip. Open your terminal and run the following command:

pip install subword-nmt

echo "your text here" | subword-nmt apply-bpe -c path_to_your_model.model

The ctranslate2 model is available in HuggingFace

Here are the models for different language pairs:

• English to Galician (en-gl)
• Spanish to Galician (es-gl)
• Basque to Galician (eu-gl)
• Catalan to Galician (ca-gl)

To download and use these models, follow these steps:

1. Open the respective link for the desired language pair.
2. Download or clone the repository.
3. Install the necessary dependencies for using the models in your project.
4. Load the downloaded model using the ctranslate2 API as explained in the HuggingFace repository.
5. Use the loaded model for translation or other language-related tasks in your project (see documentation in HuggingFace).