Generating Synthetic Data with preset Animation

[lyndon.chan]

Hello,

I’ve worked through the Replicator Composer and Synthetic Data Generator tutorials and they work fine for recording synthetic data annotations of assets without animations. However, I would like to record annotations of synthetic humans doing everyday tasks (like the animations/actions captured by omni.anim.people or even just the static animations in NVIDIA/Assets/Isaac/2022.2.1/NVIDIA/Assets/Characters/Reallusion/Worker/Props).

Here’s an example of what I tried. I opened the full_warehouse_worker_and_anim_cameras.usd stage (from NVIDIA/Assets/Isaac/2022.2.1/Isaac/Samples/Replicator/Stage). The worker animation (from NVIDIA/Assets/Isaac/2022.2.1/NVIDIA/Assets/Characters/Reallusion/Worker/Props) plays as expected when I press the play button, but once I press the start button in Synthetic Data Recorder, the worker animation is clearly not recorded in the recorded frames (the worker is stationary). The exact same thing happens when I run the tutorial for omni.anim.people - the human assets are still doing T-poses (see images below).

Is it possible to get the Synthetic Data Recorder and/or omni.anim.people working with such a preset animation? If not, how about Replicator Composer?

Thank you,
Lyndon

[pcallender]

Hi @lyndon.chan I’ve moved this post to the isaacsim forum where I think you’ll have people who have more expertise in your question.

[ahaidu]

Hi there,

the sd recorder will capture every render frame in the editor. By checking theControl Timeline box, the recorder will start/stop the timeline from the recorder as well. Meaning the animations should be playing as well. If the checkbox is not check, you will need to manually hit the Play button to include the animations in the recording.

For more specific recording cases (e.g. record every X frames, or at Y event) one would need to write a script (in the Script Editor or as a Standalone App).

Best,
Andrei