Simulated garment dataset for virtual try-on

This repository contains the dataset used in the following papers:

• Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On (CVPR 2021) [Project website] [Video]

• Learning-Based Animation of Clothing for Virtual Try-On (Eurographics 2019) [Project website] [Video]

Dataset

The data is generated used a modified version of ARCSim and sequences from the CMU Motion Capture Database converted to SMPL format in SURREAL. Each simulated sequence is stored as a .pkl file that contains the following data:

Key	Description	Dimension
shapes	SMPL shape coefficients	[num_frames, 10]
poses	SMPL pose coefficients	[num_frames, 75]
vertices	Vertices of the simulated garment	[num_frames, num_vertices, 3]
faces	Faces of the garment	[num_faces, 3]
sequence	Sequence identifier
subject	Subject identifier
conf	ARCSim configuration

Sequences

The dataset contains a diverse selection of motions:

Motion	Sequence ID
Walking	07_02, 91_62, 91_33, 91_36, 91_19, 91_12, 76_11, 73_09, 46_01, 111_14, 105_05, 104_17
Running	128_02, 128_03, 128_04, 128_05, 128_06, 128_07, 108_11, 108_12, 108_27, 104_04, 104_53, 104_54
Jumping	01_01, 91_61, 91_38, 49_04, 108_16, 108_17, 108_18, 108_20, 13_13, 02_04
Arm movements	55_27, 54_24, 40_12, 144_26, 144_30, 135_09, 132_54, 111_20, 111_37, 02_05
Torso movements	63_25, 144_28, 111_02, 108_22, 26_11, 135_07
Dancing	05_20, 55_12, 131_03, 111_05
Others	76_05, 104_11

Extract meshes

Requirements: python3, numpy-1.21.3

To extract the simulated garment meshes as .obj run the following script:

python extract_meshes.py tshirt/simulations/tshirt_shape00_01_01.pkl

Same for the dress:

python extract_meshes.py dress/simulations/dress_shape00_01_01.pkl

Citation

If you find this dataset useful please cite our work:

@article {santesteban2021garmentcollisions,
    journal = {IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
    title = {{Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On}},
    author = {Santesteban, Igor and Thuerey, Nils and Otaduy, Miguel A and Casas, Dan},
    year = {2021}
}

@article {santesteban2019virtualtryon,
    journal = {Computer Graphics Forum (Proc. Eurographics)},
    title = {{Learning-Based Animation of Clothing for Virtual Try-On}},
    author = {Santesteban, Igor and Otaduy, Miguel A. and Casas, Dan},
    year = {2019},
    ISSN = {1467-8659},
    DOI = {10.1111/cgf.13643}
}