Fast, secure, efficient backup program
-
Updated
Dec 9, 2024 - Go
#
deduplication
Entity resolution (also known as data matching, data linkage, record linkage, and many other terms) is the task of finding entities in a dataset that refer to the same entity across different data sources (e.g., data files, books, websites, and databases). Entity resolution is necessary when joining different data sets based on entities that may or may not share a common identifier (e.g., database key, URI, National identification number), which may be due to differences in record shape, storage location, or curator style or preference.
Here are 428 public repositories matching this topic...
Deduplicating archiver with compression and authenticated encryption.
-
Updated
Dec 16, 2024 - Python
Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.
-
Updated
Dec 21, 2024 - Go
Prometheus Alertmanager
-
Updated
Dec 21, 2024 - Go
A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.
c nlp machine-learning natural-language-processing record-linkage address address-parser international deduplication deduping
-
Updated
Aug 14, 2024 - C
A fast high compression read-only file system for Linux, Windows and macOS
windows macos linux fuse compression cpp filesystem archiving flac zstd lzma fuse-filesystem zpaq deduplication squashfs macfuse winfsp gpl-license lrzip dwarfs
-
Updated
Dec 19, 2024 - C++
rustic - fast, encrypted, and deduplicated backups powered by Rust
-
Updated
Dec 10, 2024 - Rust
Extremely fast tool to remove duplicates and other lint from your filesystem
-
Updated
Dec 16, 2024 - C
Simple, configuration-driven backup software for servers and workstations
mysql python backup mongodb sqlite postgresql zabbix mariadb cronitor borg borgbackup pagerduty loki healthchecks servers deduplication ntfy apprise cronhub upitme-kuma
-
Updated
Dec 21, 2024 - Python
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
data-science spark record-linkage entity-resolution fuzzy-matching deduplication em-algorithm data-matching deduplicate-data duckdb uk-gov-data-science
-
Updated
Dec 21, 2024 - Python
Config driven, easy backup cli for restic.
-
Updated
Nov 14, 2024 - Go
A powerful and modular toolkit for record linkage and duplicate detection in Python
python machine-learning privacy dedupe record-linkage python-library entity-resolution similarity string-distance deduplication data-matching utrecht-university
-
Updated
Feb 21, 2024 - Python
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
identity data-science identity-resolution spark etl analytics dedupe entity-resolution data-transformation ml fuzzy-matching deduplication datalake masterdata dataengineering fuzzymatch dataquality analytics-engineering data-transformations modern-data-stack
-
Updated
Dec 22, 2024 - Java
Data deduplication engine, supporting optional compression and public key encryption.
-
Updated
Aug 25, 2022 - Rust
Straightforward fuzzy matching, information retrieval and NLP building blocks for JavaScript.
machine-learning natural-language-processing information-retrieval clustering record-linkage fuzzy-matching deduplication
-
Updated
Jun 23, 2024 - JavaScript
Scalable data pre processing and curation toolkit for LLMs
python data data-processing data-preparation deduplication data-quality data-curation data-prep fine-tuning fast-data-processing data-processing-pipelines datacuration large-language-models llm llmapps large-scale-data-processing datarecipes semantic-deduplication llm-data-quality
-
Updated
Dec 21, 2024 - Jupyter Notebook
Коллекция готовых SQL запросов для PostgreSQL по часто возникающим задачам (получение и модификация данных, ускорение запросов, обслуживание БД)
syntax recipes postgres csv parse validation sql detect howto email phone function postgresql update batch check ddl gender deduplication determine
-
Updated
Dec 22, 2024 - PLpgSQL
Open source project for data preparation of LLM application builders
python data spark malware code-quality data-preprocessing ray data-preparation deduplication data-prep finetuning data-preprocessing-pipelines datacuration large-language-models llm llmapps large-scale-data-processing datarecipes
-
Updated
Dec 20, 2024 - Python
A list of free data matching and record linkage software.
open-source machine-learning awesome record-linkage entity-resolution fuzzy-matching software awesome-list deduplication data-matching
-
Updated
Feb 21, 2024
Created by Halbert L. Dunn
Released 1946
- Followers
- 38 followers
- Organization
- entity-resolution
- Wikipedia
- Wikipedia