by
Tobias H. Olsen
Antibodies with similar amino acid sequences, especially across their complementary-determining regions, often share properties. Finding that an antibody of interest has a similar sequence to naturally expressed antibodies in healthy or diseased repertoires is a powerful approach for the prediction of antibody properties, such as immunogenicity or antigen specificity. However, as the number of available antibody sequences is now in the billions and continuing to grow, repertoire mining for similar sequences has become increasingly computationally expensive. Existing approaches are limited by either being low-throughput, non-exhaustive, not antibody-specific, or only searching against entire chain sequences. Therefore, there is a need for a specialized tool, optimized for a rapid and exhaustive search of any antibody region against all known antibodies, to better utilize the full breadth of available repertoire sequences.
We introduce Known Antibody Search (KA-Search), a tool that allows for rapid search of billions of antibody sequences by sequence identity across either the whole chain, the CDRs, or a user defined antibody region. We show KA-Search in operation on the ~2.4 billion antibody sequences available in the OAS database. KA-Search can be used to find the most similar sequences from OAS within 30 minutes using 5 CPUs. We give examples of how KA-Search can be used to obtain new insights about an antibody of interest. KA-Search is freely available at https://github.com/oxpig/kasearch.
KA-Search is freely available python package.
The latest stable version can be installed with pip.
pip install kasearchand the latest updated version directly from github.
pip install -U git+https://github.com/oxpig/kasearchNB: You need to manually install a version of ANARCI in the same environment. ANARCI can also be installed using bioconda; however, this version is maintained by a third party.
conda install -c bioconda anarciThe following list contains the download links for the paper version of the pre-aligned OAS and any future releases, ready for KA-Search.
NB: Some of the datasets are quite large, you should therefore ensure you have enough space before trying to download them.
NB: For convenience, OAS-aligned-small and OAS-aligned-tiny can be downloaded automatically when initiating KA-Search.
| Dataset | Size | Date | Comments |
|---|---|---|---|
| OAS-aligned (Paper version) | 63GB | January 2023 | A pre-aligned version of OAS with 2.4 billion sequences |
| OAS-aligned-small (Paper version) | 2.8GB | January 2023 | A pre-aligned version of OAS with 86 million sequences |
| OAS-aligned-tiny (Paper version) | 260MB | January 2023 | A pre-aligned version of OAS with 10 million sequences |
After downloading, extract the pre-aligned dataset with "tar -xf downloaded_file.tar". Give the extacted dataset path when initiating KA-Search to search against it. See how to do this by following the KA-Search notebook guide below.
KA-Search is designed to be downloaded and run locally.
NB: Out of the box, KA-Search requires an internet connection to retrieve meta data; see below for how to use KA-Search offline.
As a demo, we have set up a reduced version of KA-Search on a Colab notebook that can be run remotely. KA-Search, as setup on the Colab, uses the OAS-aligned-tiny version of OAS to reduce the time and memory required to download the database. The Colab demo is composed of two parts:
-
Quick and easy use of KA-Search: Here we allow the user to try out KA-Search with minimal configuration, simply paste your antibody variable domain sequence in and try it out!!
-
KA-Search with more configuration: Here we expose the KA-Search API and go through a more in depth tutorial of how it can be set up for your particular usecase. We explain how to preprocess the query sequence, the possible search configurations, how to extract the metadata after finding the most identical sequences and how to preprocess your own database so it can be used with KA-Search.
If the user want to follow this tutorial locally, we also provide a Jupyter notebook showcasing KA-Search. The content of the Jupyter notebook is the same as what is in the "KA-Search with more configuration" section of the Colab. By running it locally you can also search against the whole of OAS-aligned.
The returned output from KA-Search contains all columns and metadata in the pre-aligned datasets searched as well as a column named "Identity", which contains the calculated sequence identity. The returned output is always sorted by highest identity.
For the OAS-aligned datasets these columns are;
- Each column from AIRR's rearrangement schema (see here for exact description).
- Additional sequence specific information derived by OAS processing, i.e. nucleotides for the constant region if present, ANARCI numbering and ANARCI status. For more information see the OAS paper.
- Metadata from the OAS data unit the sequence was derived from, i.e. author, species, experimental run and unique sequences in run. For more information see the OAS help page.
- Lastly, the column "Identity", which contains the calculated sequence identity between the query and target sequence.
NB: Some returned columns contain NaNs. These columns could not be populated when the data was originally processed, and it is therefore not a side-effect of KA-Search. The only column populated by KA-Search, is the "Identity" column.
The main arguments for your search are;
- database_path: Path to the database to search. If not specified, the OAS-aligned-tiny (~260MB of 10m human heavy chain sequences) dataset will be downloaded and searched against.
- allowed_chain: Which chain to search, either only heavy (Heavy), only light (Light) or any chain (Any)
- allowed_species Which species to search against (this depends on what species are in the used pre-aligned data). For OAS-aligned this includes, Human, Mouse, Camel and Humanized.
- regions: Which specific region to search against. A list of regions to search, either the provided ones ('whole', 'cdrs' or 'cdr3'), or user-defined ones. An example of a user-defined one is ['111 ', '111A', '112A', '112 '].
- length_matched: A list of false and true for whether to only compare sequences where the length of the region to search match. Example: [False, True, True]
- local_oas_path: For offline use, the path to a local version of OAS.
NB: The length of regions list and length_matched list needs to be the same.
NB: For offline use, a local version of OAS is needed the the metadata extraction. OAS currently takes up ~1.1T. It is therefore recommended to run KA-Search locally, but with internet access.
In this example, we search for similar human heavy chains across the whole variable domain, while also allowing sequences which might differ in length.
raw_queries = [
'VKLLEQSGAEVKKPGASVKVSCKASGYSFTSYGLHWVRQAPGQRLEWMGWISAGTGNTKYSQKFRGRVTFTRDTSATTAYMGLSSLRPEDTAVYYCARDPYGGGKSEFDYWGQGTLVTVSS',
]
results = EasySearch(
raw_queries,
allowed_chain='Heavy',
allowed_species='Human',
regions=['whole'],
length_matched=[False],
)2. Example of searching for similar CDRH3s from any species, but only return CDRH3s with an exact length match.
In this example, we search for sequences with an exact length CDRH3 from any species. If one is interested in finding sequences with CDR3 lengths that differ in length, the length_match argument should be set to False.
raw_queries = [
'VKLLEQSGAEVKKPGASVKVSCKASGYSFTSYGLHWVRQAPGQRLEWMGWISAGTGNTKYSQKFRGRVTFTRDTSATTAYMGLSSLRPEDTAVYYCARDPYGGGKSEFDYWGQGTLVTVSS',
]
results = EasySearch(
raw_queries,
allowed_chain='Heavy',
allowed_species='Any',
regions=['cdr3'],
length_matched=[True],
)In this example, we search for sequences with a similar paratope. The positions of the paratope needs to follow the IMGT numbering scheme and be one of the 200 allowed positions in the canonical alignment introduced in the KA-Search paper.
raw_queries = [
'VKLLEQSGAEVKKPGASVKVSCKASGYSFTSYGLHWVRQAPGQRLEWMGWISAGTGNTKYSQKFRGRVTFTRDTSATTAYMGLSSLRPEDTAVYYCARDPYGGGKSEFDYWGQGTLVTVSS',
]
paratope = ["107 ", "108 ","111C", "114 ","115 "]
results = EasySearch(
raw_queries,
allowed_chain='Heavy',
allowed_species='Any',
regions=[paratope],
length_matched=[True],
)In this example, we specify the path to a local version of OAS. This allows us to extract metadata for the returned sequences offline.
raw_queries = [
'VKLLEQSGAEVKKPGASVKVSCKASGYSFTSYGLHWVRQAPGQRLEWMGWISAGTGNTKYSQKFRGRVTFTRDTSATTAYMGLSSLRPEDTAVYYCARDPYGGGKSEFDYWGQGTLVTVSS',
]
results = EasySearch(
raw_queries,
allowed_chain='Heavy',
allowed_species='Any',
regions=['cdr3'],
length_matched=[True],
local_oas_path='/path/to/local/oas/'
)In this example, we pre-align a set of custom sequences, and subsequently search them with KA-Search.
First we format the data as an OAS data unit file. The minimal format requires an empty metadata and a single column with the variable domain of the antibody sequence, but can contain as many additional columns with sequence specific information as desired. This extra information will be retrieved when extracting metadata.
import json, os, shutil
import pandas as pd
custom_data_file = "custom-data-examples.csv"
seq_df = pd.DataFrame([
["EVQLVESGGGLAKPGGSLRLHCAASGFAFSSYWMNWVRQAPGKRLEWVSAINLGGGLTYYAASVKGRFTISRDNSKNTLSLQMNSLRAEDTAVYYCATDYCSSTYCSPVGDYWGQGVLVTVSS"],
["EVQLVQSGAEVKRPGESLKISCKTSGYSFTSYWISWVRQMPGKGLEWMGAIDPSDSDTRYNPSFQGQVTISADKSISTAYLQWSRLKASDTATYYCAIKKYCTGSGCRRWYFDLWGPGT"],
['QVQLQQSGAELARPGASVKLSCKASGYTFTSYWMQWVKQRPGQGLEWIGAIYPGDGDTRYTQKFKGKATLTADKSSSTAYMQLSSLASEDSAVYYCARGEPRYDYAWFAYWGQGTLVTVS'],
['QVQLQQSGAELARPGASVKLSCKASGYTFTSYWMQWVKQRPGQGLEWIGAIYPGDGDTRYTQKFKGKATLTADKSSSTAYMQLSSLASEDSAVYYCARGPATAWFAYWGQGTLVTVS'],
['QVQLQQSGAELARPGASVKLSCKASGYTFTSYWMQWVKQRPGQGLEWIGAIYPGDGDTRYTQKFKGKATLTADKSSSTAYMQLSSLASEDSAVYYCARSAWFAYWGQGTLVTVS'],
['QVQLQQSGAELARPGASVKLSCKASGYTFTSYWMQWVKQRPGQGLEWIGAIYPGDGDTRYTQKFKGKATLTADKSSSTAYMQLSSLASEDSAVYYCARGGYWGQGTTLTVSS'],
['QVQLQQSGAELARPGASVKLSCKASGYTFTSYWMQWVKQRPGQGLEWIGAIYPGDGDTRYTQKFKGKATLTADKSSSTAYMQLSSLASEDSAVYYCARGGLRRGAWFAYWGQGTLVTVS']
], columns = ['heavy_sequences'])
meta_data = pd.Series(name=json.dumps({"Species":"Human", "Chain":"Heavy"}), dtype='object')
meta_data.to_csv(custom_data_file, index=False)
seq_df.to_csv(custom_data_file, index=False, mode='a')After each custom_data_file has been created, each file needs to be pre-aligned and formatted into a single dataset.
path_to_custom_db = "my_kasearch_db"
many_custom_data_files = [custom_data_file]
customDB = PrepareDB(db_path=path_to_custom_db, n_jobs=2, from_scratch=True)
for num, data_file in enumerate(many_custom_data_files):
customDB.prepare_sequences(
data_file,
file_id=num,
chain='Heavy', # This needs to change depending on the custom data file
species='Human', # This needs to change depending on the custom data file
seq_column_name = 'heavy_sequences', # This needs to change depending on the custom data file
)
shutil.copy(data_file, os.path.join(path_to_custom_db, 'extra_data'))
customDB.finalize_prepared_files()Finally, the pre-aligned custom dataset can be searched by providing its path when initiating the search.
raw_queries = [
'VKLLEQSGAEVKKPGASVKVSCKASGYSFTSYGLHWVRQAPGQRLEWMGWISAGTGNTKYSQKFRGRVTFTRDTSATTAYMGLSSLRPEDTAVYYCARDPYGGGKSEFDYWGQGTLVTVSS',
]
results = EasySearch(
raw_queries,
database_path=path_to_custom_db,
allowed_chain='Any',
allowed_species='Any',
regions=['whole'],
length_matched=[False],
)@article{Olsen2023,
title={KA-Search, a method for rapid and exhaustive sequence identity search of known antibodies},
author={Tobias H. Olsen, Brennan A. Kenyon, Iain H. Moal and Charlotte M. Deane},
journal={Scientific Reports},
doi={10.1038/s41598-023-38108-7},
year={2023}
}