An open source project from Data to AI Lab at MIT.
- License: MIT
- Development Status: Pre-Alpha
- Documentation: https://sdv-dev.github.io/Copulas
- Homepage: https://github.com/sdv-dev/Copulas
Copulas is a Python library for modeling multivariate distributions and sampling from them using copula functions. Given a table containing numerical data, we can use Copulas to learn the distribution and later on generate new synthetic rows following the same statistical properties.
Some of the features provided by this library include:
- A variety of distributions for modeling univariate data.
- Multiple Archimedean copulas for modeling bivariate data.
- Gaussian and Vine copulas for modeling multivariate data.
- Automatic selection of univariate distributions and bivariate copulas.
- Gaussian
- Student T
- Beta
- Gamma
- Gaussian KDE
- Truncated Gaussian
- Clayton
- Frank
- Gumbel
- Gaussian
- D-Vine
- C-Vine
- R-Vine
Copulas has been developed and tested on Python 3.5, 3.6 and 3.7
Also, although it is not strictly required, the usage of a virtualenv is highly recommended in order to avoid interfering with other software installed in the system where Copulas is run.
The easiest and recommended way to install Copulas is using pip:
pip install copulas
This will pull and install the latest stable release from PyPi.
If you want to install from source or contribute to the project please read the Contributing Guide.
Copulas can also be installed using conda:
conda install -c sdv-dev copulas
This will pull and install the latest stable release from Anaconda.
In this short quickstart, we show how to model a multivariate dataset and then generate synthetic data that resembles it.
import warnings
warnings.filterwarnings('ignore')
from copulas.datasets import sample_trivariate_xyz
from copulas.multivariate import GaussianMultivariate
from copulas.visualization import compare_3d
# Load a dataset with 3 columns that are not independent
real_data = sample_trivariate_xyz()
# Fit a gaussian copula to the data
copula = GaussianMultivariate()
copula.fit(real_data)
# Sample synthetic data
synthetic_data = copula.sample(len(real_data))
# Plot the real and the synthetic data to compare
compare_3d(real_data, synthetic_data)
The output will be a figure with two plots, showing what both the real and the synthetic data that you just generated look like:
For more details about Copulas and all its possibilities and features, please check the documentation site.
There you can learn more about how to contribute to Copulas in order to help us developing new features or cool ideas.
Copulas is an open source project from the Data to AI Lab at MIT which has been built and maintained over the years by the following team:
- Manuel Alvarez manuel@pythiac.com
- Carles Sala carles@pythiac.com
- José David Pérez jose@pythiac.com
- (Alicia)Yi Sun yis@mit.edu
- Andrew Montanez amontane@mit.edu
- Kalyan Veeramachaneni kalyan@csail.mit.edu
- paulolimac paulolimac@gmail.com
- Kevin Alex Zhang kevz@mit.edu
- Gabriele Bonomi gbonomib@gmail.com
SDV, for Synthetic Data Vault, is the end-user library for synthesizing data in development under the HDI Project. SDV allows you to easily model and sample relational datasets using Copulas thought a simple API. Other features include anonymization of Personal Identifiable Information (PII) and preserving relational integrity on sampled records.
CTGAN is a GAN based model for synthesizing tabular data. It's also developed by the MIT's Data to AI Lab and is under active development.