-
Notifications
You must be signed in to change notification settings - Fork 1.5k
test_auto3dseg_ensemble torch 1.9.1 #6390
Copy link
Copy link
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
Describe the bug
[2023-04-18T16:07:21.134Z] ======================================================================
[2023-04-18T16:07:21.134Z] ERROR: test_get_history (tests.test_auto3dseg_hpo.TestHPO)
[2023-04-18T16:07:21.134Z] ----------------------------------------------------------------------
[2023-04-18T16:07:21.134Z] Traceback (most recent call last):
[2023-04-18T16:07:21.134Z] File "/home/jenkins/agent/workspace/Monai-pytorch-versions/tests/test_auto3dseg_hpo.py", line 134, in setUp
[2023-04-18T16:07:21.134Z] bundle_generator.generate(work_dir, num_fold=1)
[2023-04-18T16:07:21.134Z] File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/apps/auto3dseg/bundle_gen.py", line 569, in generate
[2023-04-18T16:07:21.134Z] gen_algo.export_to_disk(output_folder, name, fold=f_id)
[2023-04-18T16:07:21.134Z] File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/apps/auto3dseg/bundle_gen.py", line 160, in export_to_disk
[2023-04-18T16:07:21.134Z] self.fill_records = self.fill_template_config(self.data_stats_files, self.output_path, **kwargs)
[2023-04-18T16:07:21.134Z] File "/tmp/tmp7sdlj1x3/workdir/algorithm_templates/dints/scripts/algo.py", line 119, in fill_template_config
[2023-04-18T16:07:21.134Z] mem = get_mem_from_visible_gpus()
[2023-04-18T16:07:21.134Z] File "/tmp/tmp7sdlj1x3/workdir/algorithm_templates/dints/scripts/algo.py", line 31, in get_mem_from_visible_gpus
[2023-04-18T16:07:21.134Z] available_mem_visible_gpus.append(torch.cuda.mem_get_info(device=d)[0])
[2023-04-18T16:07:21.134Z] AttributeError: module 'torch.cuda' has no attribute 'mem_get_info'
[2023-04-18T16:07:21.134Z]
[2023-04-18T16:07:21.134Z] ======================================================================
[2023-04-18T16:07:21.134Z] ERROR: test_run_algo (tests.test_auto3dseg_hpo.TestHPO)
[2023-04-18T16:07:21.134Z] ----------------------------------------------------------------------
[2023-04-18T16:07:21.134Z] Traceback (most recent call last):
[2023-04-18T16:07:21.134Z] File "/home/jenkins/agent/workspace/Monai-pytorch-versions/tests/test_auto3dseg_hpo.py", line 134, in setUp
[2023-04-18T16:07:21.134Z] bundle_generator.generate(work_dir, num_fold=1)
[2023-04-18T16:07:21.134Z] File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/apps/auto3dseg/bundle_gen.py", line 569, in generate
[2023-04-18T16:07:21.134Z] gen_algo.export_to_disk(output_folder, name, fold=f_id)
[2023-04-18T16:07:21.134Z] File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/apps/auto3dseg/bundle_gen.py", line 160, in export_to_disk
[2023-04-18T16:07:21.134Z] self.fill_records = self.fill_template_config(self.data_stats_files, self.output_path, **kwargs)
[2023-04-18T16:07:21.134Z] File "/tmp/tmp7sdlj1x3/workdir/algorithm_templates/dints/scripts/algo.py", line 119, in fill_template_config
[2023-04-18T16:07:21.134Z] mem = get_mem_from_visible_gpus()
[2023-04-18T16:07:21.134Z] File "/tmp/tmp7sdlj1x3/workdir/algorithm_templates/dints/scripts/algo.py", line 31, in get_mem_from_visible_gpus
[2023-04-18T16:07:21.134Z] available_mem_visible_gpus.append(torch.cuda.mem_get_info(device=d)[0])
[2023-04-18T16:07:21.134Z] AttributeError: module 'torch.cuda' has no attribute 'mem_get_info'
[2023-04-18T16:07:21.134Z]
[2023-04-18T16:07:21.134Z] ======================================================================
[2023-04-18T16:07:21.134Z] ERROR: test_run_optuna (tests.test_auto3dseg_hpo.TestHPO)
[2023-04-18T16:07:21.134Z] ----------------------------------------------------------------------
[2023-04-18T16:07:21.134Z] Traceback (most recent call last):
[2023-04-18T16:07:21.134Z] File "/home/jenkins/agent/workspace/Monai-pytorch-versions/tests/test_auto3dseg_hpo.py", line 134, in setUp
[2023-04-18T16:07:21.134Z] bundle_generator.generate(work_dir, num_fold=1)
[2023-04-18T16:07:21.134Z] File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/apps/auto3dseg/bundle_gen.py", line 569, in generate
[2023-04-18T16:07:21.134Z] gen_algo.export_to_disk(output_folder, name, fold=f_id)
[2023-04-18T16:07:21.134Z] File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/apps/auto3dseg/bundle_gen.py", line 160, in export_to_disk
[2023-04-18T16:07:21.134Z] self.fill_records = self.fill_template_config(self.data_stats_files, self.output_path, **kwargs)
[2023-04-18T16:07:21.134Z] File "/tmp/tmp7sdlj1x3/workdir/algorithm_templates/dints/scripts/algo.py", line 119, in fill_template_config
[2023-04-18T16:07:21.134Z] mem = get_mem_from_visible_gpus()
[2023-04-18T16:07:21.134Z] File "/tmp/tmp7sdlj1x3/workdir/algorithm_templates/dints/scripts/algo.py", line 31, in get_mem_from_visible_gpus
[2023-04-18T16:07:21.134Z] available_mem_visible_gpus.append(torch.cuda.mem_get_info(device=d)[0])
[2023-04-18T16:07:21.134Z] AttributeError: module 'torch.cuda' has no attribute 'mem_get_info'
[2023-04-18T16:07:21.134Z]
[2023-04-18T16:07:21.134Z] ======================================================================
[2023-04-18T16:07:21.134Z] ERROR: test_ensemble (tests.test_auto3dseg_ensemble.TestEnsembleBuilder)
[2023-04-18T16:07:21.134Z] ----------------------------------------------------------------------
[2023-04-18T16:07:21.134Z] Traceback (most recent call last):
[2023-04-18T16:07:21.134Z] File "/home/jenkins/agent/workspace/Monai-pytorch-versions/tests/test_auto3dseg_ensemble.py", line 140, in test_ensemble
[2023-04-18T16:07:21.134Z] bundle_generator.generate(work_dir, num_fold=1)
[2023-04-18T16:07:21.134Z] File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/apps/auto3dseg/bundle_gen.py", line 569, in generate
[2023-04-18T16:07:21.134Z] gen_algo.export_to_disk(output_folder, name, fold=f_id)
[2023-04-18T16:07:21.134Z] File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/apps/auto3dseg/bundle_gen.py", line 160, in export_to_disk
[2023-04-18T16:07:21.134Z] self.fill_records = self.fill_template_config(self.data_stats_files, self.output_path, **kwargs)
[2023-04-18T16:07:21.134Z] File "/tmp/tmp7sdlj1x3/workdir/algorithm_templates/dints/scripts/algo.py", line 119, in fill_template_config
[2023-04-18T16:07:21.134Z] mem = get_mem_from_visible_gpus()
[2023-04-18T16:07:21.134Z] File "/tmp/tmp7sdlj1x3/workdir/algorithm_templates/dints/scripts/algo.py", line 31, in get_mem_from_visible_gpus
[2023-04-18T16:07:21.134Z] available_mem_visible_gpus.append(torch.cuda.mem_get_info(device=d)[0])
[2023-04-18T16:07:21.134Z] AttributeError: module 'torch.cuda' has no attribute 'mem_get_info'
[2023-04-18T16:07:21.134Z]
[2023-04-18T16:07:21.134Z] ----------------------------------------------------------------------
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working