Skip to content

RuntimeError: vk::PhysicalDevice::createDeviceUnique: ErrorExtensionNotPresent #3

@cheng-haha

Description

@cheng-haha

I am conducting evaluations on a server without a display, but I keep encountering the error mentioned above. Currently, I have tried creating a virtual display based on https://github.com/simpler-env/SimplerEnv/issues/18, but it doesn't seem to work. Have you encountered this issue before, and how can it be resolved?

Full error message:

(simpler_env) [root:SimplerEnv-OpenVLA]$ bash scripts/run_spatialvla.sh
🚀 running bridge.sh ...
2025-02-07 02:50:32.635028: I tensorflow/core/util/port.cc:113] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable TF_ENABLE_ONEDNN_OPTS=0.
2025-02-07 02:50:32.676287: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2025-02-07 02:50:32.676340: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2025-02-07 02:50:32.677505: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2025-02-07 02:50:32.684244: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 AVX512F AVX512_VNNI AVX512_BF16 AVX_VNNI AMX_TILE AMX_INT8 AMX_BF16 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2025-02-07 02:50:33.397145: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
Octo is not correctly imported.
No module named 'octo'
2025-02-07 02:50:35.765549: W tensorflow/core/common_runtime/gpu/gpu_device.cc:2256] Cannot dlopen some GPU libraries. Please make sure the missing libraries mentioned above are installed properly if you would like to use GPU. Follow the guide at https://www.tensorflow.org/install/gpu for how to download and setup the required libraries for your platform.
Skipping registering GPU devices...
**** spatialvla ****
*** policy_setup: widowx_bridge, unnorm_key: bridge_orig/1.0.0 ***
Some kwargs in processor config are unused and will not have any effect: num_obs_steps, intrinsic_config, bin_policy, obs_delta, statistics, action_config, action_chunk_size.
scale intrinsic of bridge_orig/1.0.0 from [[623.588, 0, 319.501], [0, 623.588, 239.545], [0, 0, 1]] to tensor([[218.2558, 0.0000, 111.8253],
[ 0.0000, 291.0078, 111.7877],
[ 0.0000, 0.0000, 1.0000]]) ...
scale intrinsic of default from [[623.588, 0, 319.501], [0, 623.588, 239.545], [0, 0, 1]] to tensor([[218.2558, 0.0000, 111.8253],
[ 0.0000, 291.0078, 111.7877],
[ 0.0000, 0.0000, 1.0000]]) ...
Add 0 TRANSLATION TOKENS, tokenizer vocab size 257152 / 265347
Add 0 ROTATION TOKENS to tokenizer, tokenizer vocab size 257152 / 265347
Add 0 GRIPPER TOKENS to tokenizer, tokenizer vocab size 257152 / 265347
🔥 init from default configurations ... None
Loading checkpoint shards: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:00<00:00, 2.60it/s]
Control mode: arm_pd_ee_target_delta_pose_align2_gripper_pd_joint_pos
[2025-02-07 02:50:50.967] [svulkan2] [error] GLFW error: X11: Failed to open display
[2025-02-07 02:50:50.967] [svulkan2] [warning] Continue without GLFW.
Traceback (most recent call last):
File "/inspire/hdd/ws-f4d69b29-e0a5-44e6-bd92-acf4de9990f0/public-project/chengdongzhou-240108390137/vla_projects/SimplerEnv-OpenVLA/simpler_env/main_inference.py", line 85, in
success_arr = maniskill2_evaluator(model, args)
File "/inspire/hdd/ws-f4d69b29-e0a5-44e6-bd92-acf4de9990f0/public-project/chengdongzhou-240108390137/vla_projects/SimplerEnv-OpenVLA/simpler_env/evaluation/maniskill2_evaluator.py", line 227, in maniskill2_evaluator
run_maniskill2_eval_single_episode(
File "/inspire/hdd/ws-f4d69b29-e0a5-44e6-bd92-acf4de9990f0/public-project/chengdongzhou-240108390137/vla_projects/SimplerEnv-OpenVLA/simpler_env/evaluation/maniskill2_evaluator.py", line 62, in run_maniskill2_eval_single_episode
env = build_maniskill2_env(
File "/inspire/hdd/ws-f4d69b29-e0a5-44e6-bd92-acf4de9990f0/public-project/chengdongzhou-240108390137/vla_projects/SimplerEnv-OpenVLA/simpler_env/utils/env/env_builder.py", line 16, in build_maniskill2_env
env = gym.make(env_name, **kwargs)
File "/opt/conda/envs/simpler_env/lib/python3.10/site-packages/gymnasium/envs/registration.py", line 740, in make
env = env_creator(**env_spec_kwargs)
File "/inspire/hdd/ws-f4d69b29-e0a5-44e6-bd92-acf4de9990f0/public-project/chengdongzhou-240108390137/vla_projects/SimplerEnv-OpenVLA/ManiSkill2_real2sim/mani_skill2_real2sim/utils/registration.py", line 92, in make
env = env_spec.make(kwargs)
File "/inspire/hdd/ws-f4d69b29-e0a5-44e6-bd92-acf4de9990f0/public-project/chengdongzhou-240108390137/vla_projects/SimplerEnv-OpenVLA/ManiSkill2_real2sim/mani_skill2_real2sim/utils/registration.py", line 34, in make
return self.cls(
_kwargs)
File "/inspire/hdd/ws-f4d69b29-e0a5-44e6-bd92-acf4de9990f0/public-project/chengdongzhou-240108390137/vla_projects/SimplerEnv-OpenVLA/ManiSkill2_real2sim/mani_skill2_real2sim/envs/custom_scenes/put_on_in_scene.py", line 310, in init
super().init(
File "/inspire/hdd/ws-f4d69b29-e0a5-44e6-bd92-acf4de9990f0/public-project/chengdongzhou-240108390137/vla_projects/SimplerEnv-OpenVLA/ManiSkill2_real2sim/mani_skill2_real2sim/envs/custom_scenes/put_on_in_scene.py", line 162, in init
super().init(**kwargs)
File "/inspire/hdd/ws-f4d69b29-e0a5-44e6-bd92-acf4de9990f0/public-project/chengdongzhou-240108390137/vla_projects/SimplerEnv-OpenVLA/ManiSkill2_real2sim/mani_skill2_real2sim/envs/custom_scenes/move_near_in_scene.py", line 58, in init
super().init(**kwargs)
File "/inspire/hdd/ws-f4d69b29-e0a5-44e6-bd92-acf4de9990f0/public-project/chengdongzhou-240108390137/vla_projects/SimplerEnv-OpenVLA/ManiSkill2_real2sim/mani_skill2_real2sim/envs/custom_scenes/base_env.py", line 134, in init
super().init(**kwargs)
File "/inspire/hdd/ws-f4d69b29-e0a5-44e6-bd92-acf4de9990f0/public-project/chengdongzhou-240108390137/vla_projects/SimplerEnv-OpenVLA/ManiSkill2_real2sim/mani_skill2_real2sim/envs/sapien_env.py", line 107, in init
self._renderer = sapien.SapienRenderer(**renderer_kwargs)
RuntimeError: vk::PhysicalDevice::createDeviceUnique: ErrorExtensionNotPresent
2025-02-07 02:50:52.858202: I tensorflow/core/util/port.cc:113] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable TF_ENABLE_ONEDNN_OPTS=0.
2025-02-07 02:50:52.900385: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2025-02-07 02:50:52.900434: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2025-02-07 02:50:52.901635: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2025-02-07 02:50:52.908447: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 AVX512F AVX512_VNNI AVX512_BF16 AVX_VNNI AMX_TILE AMX_INT8 AMX_BF16 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions