Software Copyright License for non-commercial scientific research purposes. Please read carefully the terms and conditions and any accompanying documentation before you download and/or use the SMPL-X/SMPLify-X model, data and software, (the "Model & Software"), including 3D meshes, blend weights, blend shapes, textures, software, scripts, and animations. By downloading and/or using the Model & Software (including downloading, cloning, installing, and any other use of this github repository), you acknowledge that you have read these terms and conditions, understand them, and agree to be bound by them. If you do not agree with these terms and conditions, you must not download and/or use the Model & Software. Any infringement of the terms of this agreement will automatically terminate your rights under this License.
The repository contains code for converting model parameters of one model to another. Never copy parameters between the models. You will not get the same poses. SMPL, SMPL+H and SMPL-X shape spaces are NOT compatible, since each model is the result of a different training process. A more detailed explanation on how we extract correspondences between the models and the loss function used to estimate the parameters can be found here.
- Install mesh
- Start by cloning the SMPL-X repo:
git clone https://github.com/vchoutas/smplx.git- Run the following command to install all necessary requirements
pip install -r requirements.txt- Install the Torch Trust Region optimizer by following the instructions here
- Install loguru
- Install open3d
- Install omegaconf
Register on the SMPL-X website, go to the
downloads section to get the correspondences and sample data,
by clicking on the Model correspondences button.
Create a folder
named transfer_data and extract the downloaded zip there. You should have the
following folder structure now:
transfer_data
├── meshes
│ ├── smpl
│ ├── smplx
├── smpl2smplh_def_transfer.pkl
├── smpl2smplx_deftrafo_setup.pkl
├── smplh2smpl_def_transfer.pkl
├── smplh2smplx_deftrafo_setup.pkl
├── smplx2smpl_deftrafo_setup.pkl
├── smplx2smplh_deftrafo_setup.pkl
├── smplx_mask_ids.npyFirst, break the motion into a set of pose .obj files. Depending on how the
SMPL-* parameters are stored this code will differ. For the example AMASS data
in this repository you can use the example code here:
python write_obj.py --model-folder ../models/ --motion-file ../transfer_data/support_data/github_data/amass_sample.npz --output-folder ../transfer_data/meshes/amass_sample/
To run the transfer_model utility you will require a .yaml config file,
which can point to the location the output .obj files have been saved. Use the
templates in config_files in the root of this repository. To convert the
sample AMASS code to SMPL-X:
python -m transfer_model --exp-cfg config_files/smplh2smplx_as.yaml
Finally, the output .obj files have to be merged into a single motion
sequence. Example code to do this in a way that matches SMPL-X AMASS archives
can be found in merge_output.py and run as follows:
python merge_output.py --gender neutral ../output
Debug notes describing common problems encountered during this can be found here. Problems are also discussed in two issues.
To run the code to convert SMPL meshes to SMPL-X parameters use the following command:
python -m transfer_model --exp-cfg config_files/smpl2smplx.yamlThis should be run from the top directory of the repository.
The file smpl2smplx.yaml contains a sample configuration that reads meshes from a folder, processes them and returns pkl files with SMPL-X parameters. To run on your own data create a folder with SMPL meshes, in either ply or obj format, change the path in the config file and run the code.
To run the code to convert SMPL-X meshes to SMPL parameters use the following command:
python main.py --exp-cfg config_files/smplx2smpl.yamlThe file smplx2smpl.yaml contains a sample configuration that reads meshes from a folder, processes them and returns pkl files with SMPL parameters. To run on your own data create a folder with SMPL-X meshes, in either ply or obj format, change the path in the config file and run the code. When creating the SMPL-X meshes, do not use the hand and face parameters. Naturally, you will lose all hand and face information if you choose this, since SMPL cannot model them.
To run the code to convert SMPL+H meshes to SMPL parameters use the following command from the root smplx directory:
python -m transfer_model --exp-cfg config_files/smplh2smpl.yamlThis should be run from the top directory of the repository.
The file smplh2smpl.yaml contains a sample configuration that reads meshes from a folder, processes them and returns pkl files with SMPL parameters. To run on your own data create a folder with SMPL+H meshes, in either ply or obj format, change the path in the config file and run the code. Note that using this direction means that you will lose information on the hands.
To run the code to convert SMPL meshes to SMPL+H parameters use the following command:
python -m transfer_model --exp-cfg config_files/smpl2smplh.yamlThis should be run from the top directory of the repository.
The file smpl2smplh.yaml contains a sample configuration that reads meshes from a folder, processes them and returns pkl files with SMPL parameters. To run on your own data create a folder with SMPL meshes, in either ply or obj format, change the path in the config file and run the code.
To run the code to convert SMPL+H meshes to SMPL-X parameters use the following command:
python -m transfer_model --exp-cfg config_files/smplh2smplx.yamlThis should be run from the top directory of the repository.
The file smplh2smplx.yaml contains a sample configuration that reads meshes from a folder, processes them and returns pkl files with SMPL-X parameters. To run on your own data create a folder with SMPL+H meshes, in either ply or obj format, change the path in the config file and run the code.
To run the code to convert SMPL-X meshes to SMPL+H parameters use the following command:
python -m transfer_model --exp-cfg config_files/smplx2smplh.yamlThis should be run from the top directory of the repository.
The file smplx2smpl.yaml contains a sample configuration that reads meshes from a folder, processes them and returns pkl files with SMPL+H parameters. To run on your own data create a folder with SMPL-X meshes, in either ply or obj format, change the path in the config file and run the code. Make sure that you do not use the jaw pose and expression parameters to generate the meshes.
To visualize correspondences:
python vis_correspondences.py --exp-cfg configs/smpl2smplx.yaml --exp-opts colors_path PATH_TO_SMPL_COLORSYou should then see the following image. Points with similar color are in
correspondence.
Depending on which model is loaded for your project, i.e. SMPL-X or SMPL+H or SMPL, please cite the most relevant work:
@article{SMPL:2015,
author = {Loper, Matthew and Mahmood, Naureen and Romero, Javier and Pons-Moll, Gerard and Black, Michael J.},
title = {{SMPL}: A Skinned Multi-Person Linear Model},
journal = {ACM Transactions on Graphics, (Proc. SIGGRAPH Asia)},
month = oct,
number = {6},
pages = {248:1--248:16},
publisher = {ACM},
volume = {34},
year = {2015}
}
@article{MANO:SIGGRAPHASIA:2017,
title = {Embodied Hands: Modeling and Capturing Hands and Bodies Together},
author = {Romero, Javier and Tzionas, Dimitrios and Black, Michael J.},
journal = {ACM Transactions on Graphics, (Proc. SIGGRAPH Asia)},
volume = {36},
number = {6},
pages = {245:1--245:17},
series = {245:1--245:17},
publisher = {ACM},
month = nov,
year = {2017},
url = {http://doi.acm.org/10.1145/3130800.3130883},
month_numeric = {11}
}
@inproceedings{SMPL-X:2019,
title = {Expressive Body Capture: 3D Hands, Face, and Body from a Single Image},
author = {Pavlakos, Georgios and Choutas, Vasileios and Ghorbani, Nima and Bolkart, Timo and Osman, Ahmed A. A. and Tzionas, Dimitrios and Black, Michael J.},
booktitle = {Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR)},
year = {2019}
}
The code of this repository was implemented by Vassilis Choutas, based on a Chumpy implementation from Timo Bolkart.
For questions, please contact smplx@tue.mpg.de.