Skip to content

test_auto3dseg_ensemble torch 1.9.1 #6390

@wyli

Description

@wyli

Describe the bug

[2023-04-18T16:07:21.134Z] ======================================================================
[2023-04-18T16:07:21.134Z] ERROR: test_get_history (tests.test_auto3dseg_hpo.TestHPO)
[2023-04-18T16:07:21.134Z] ----------------------------------------------------------------------
[2023-04-18T16:07:21.134Z] Traceback (most recent call last):
[2023-04-18T16:07:21.134Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/tests/test_auto3dseg_hpo.py", line 134, in setUp
[2023-04-18T16:07:21.134Z]     bundle_generator.generate(work_dir, num_fold=1)
[2023-04-18T16:07:21.134Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/apps/auto3dseg/bundle_gen.py", line 569, in generate
[2023-04-18T16:07:21.134Z]     gen_algo.export_to_disk(output_folder, name, fold=f_id)
[2023-04-18T16:07:21.134Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/apps/auto3dseg/bundle_gen.py", line 160, in export_to_disk
[2023-04-18T16:07:21.134Z]     self.fill_records = self.fill_template_config(self.data_stats_files, self.output_path, **kwargs)
[2023-04-18T16:07:21.134Z]   File "/tmp/tmp7sdlj1x3/workdir/algorithm_templates/dints/scripts/algo.py", line 119, in fill_template_config
[2023-04-18T16:07:21.134Z]     mem = get_mem_from_visible_gpus()
[2023-04-18T16:07:21.134Z]   File "/tmp/tmp7sdlj1x3/workdir/algorithm_templates/dints/scripts/algo.py", line 31, in get_mem_from_visible_gpus
[2023-04-18T16:07:21.134Z]     available_mem_visible_gpus.append(torch.cuda.mem_get_info(device=d)[0])
[2023-04-18T16:07:21.134Z] AttributeError: module 'torch.cuda' has no attribute 'mem_get_info'
[2023-04-18T16:07:21.134Z] 
[2023-04-18T16:07:21.134Z] ======================================================================
[2023-04-18T16:07:21.134Z] ERROR: test_run_algo (tests.test_auto3dseg_hpo.TestHPO)
[2023-04-18T16:07:21.134Z] ----------------------------------------------------------------------
[2023-04-18T16:07:21.134Z] Traceback (most recent call last):
[2023-04-18T16:07:21.134Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/tests/test_auto3dseg_hpo.py", line 134, in setUp
[2023-04-18T16:07:21.134Z]     bundle_generator.generate(work_dir, num_fold=1)
[2023-04-18T16:07:21.134Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/apps/auto3dseg/bundle_gen.py", line 569, in generate
[2023-04-18T16:07:21.134Z]     gen_algo.export_to_disk(output_folder, name, fold=f_id)
[2023-04-18T16:07:21.134Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/apps/auto3dseg/bundle_gen.py", line 160, in export_to_disk
[2023-04-18T16:07:21.134Z]     self.fill_records = self.fill_template_config(self.data_stats_files, self.output_path, **kwargs)
[2023-04-18T16:07:21.134Z]   File "/tmp/tmp7sdlj1x3/workdir/algorithm_templates/dints/scripts/algo.py", line 119, in fill_template_config
[2023-04-18T16:07:21.134Z]     mem = get_mem_from_visible_gpus()
[2023-04-18T16:07:21.134Z]   File "/tmp/tmp7sdlj1x3/workdir/algorithm_templates/dints/scripts/algo.py", line 31, in get_mem_from_visible_gpus
[2023-04-18T16:07:21.134Z]     available_mem_visible_gpus.append(torch.cuda.mem_get_info(device=d)[0])
[2023-04-18T16:07:21.134Z] AttributeError: module 'torch.cuda' has no attribute 'mem_get_info'
[2023-04-18T16:07:21.134Z] 
[2023-04-18T16:07:21.134Z] ======================================================================
[2023-04-18T16:07:21.134Z] ERROR: test_run_optuna (tests.test_auto3dseg_hpo.TestHPO)
[2023-04-18T16:07:21.134Z] ----------------------------------------------------------------------
[2023-04-18T16:07:21.134Z] Traceback (most recent call last):
[2023-04-18T16:07:21.134Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/tests/test_auto3dseg_hpo.py", line 134, in setUp
[2023-04-18T16:07:21.134Z]     bundle_generator.generate(work_dir, num_fold=1)
[2023-04-18T16:07:21.134Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/apps/auto3dseg/bundle_gen.py", line 569, in generate
[2023-04-18T16:07:21.134Z]     gen_algo.export_to_disk(output_folder, name, fold=f_id)
[2023-04-18T16:07:21.134Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/apps/auto3dseg/bundle_gen.py", line 160, in export_to_disk
[2023-04-18T16:07:21.134Z]     self.fill_records = self.fill_template_config(self.data_stats_files, self.output_path, **kwargs)
[2023-04-18T16:07:21.134Z]   File "/tmp/tmp7sdlj1x3/workdir/algorithm_templates/dints/scripts/algo.py", line 119, in fill_template_config
[2023-04-18T16:07:21.134Z]     mem = get_mem_from_visible_gpus()
[2023-04-18T16:07:21.134Z]   File "/tmp/tmp7sdlj1x3/workdir/algorithm_templates/dints/scripts/algo.py", line 31, in get_mem_from_visible_gpus
[2023-04-18T16:07:21.134Z]     available_mem_visible_gpus.append(torch.cuda.mem_get_info(device=d)[0])
[2023-04-18T16:07:21.134Z] AttributeError: module 'torch.cuda' has no attribute 'mem_get_info'
[2023-04-18T16:07:21.134Z] 
[2023-04-18T16:07:21.134Z] ======================================================================
[2023-04-18T16:07:21.134Z] ERROR: test_ensemble (tests.test_auto3dseg_ensemble.TestEnsembleBuilder)
[2023-04-18T16:07:21.134Z] ----------------------------------------------------------------------
[2023-04-18T16:07:21.134Z] Traceback (most recent call last):
[2023-04-18T16:07:21.134Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/tests/test_auto3dseg_ensemble.py", line 140, in test_ensemble
[2023-04-18T16:07:21.134Z]     bundle_generator.generate(work_dir, num_fold=1)
[2023-04-18T16:07:21.134Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/apps/auto3dseg/bundle_gen.py", line 569, in generate
[2023-04-18T16:07:21.134Z]     gen_algo.export_to_disk(output_folder, name, fold=f_id)
[2023-04-18T16:07:21.134Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/apps/auto3dseg/bundle_gen.py", line 160, in export_to_disk
[2023-04-18T16:07:21.134Z]     self.fill_records = self.fill_template_config(self.data_stats_files, self.output_path, **kwargs)
[2023-04-18T16:07:21.134Z]   File "/tmp/tmp7sdlj1x3/workdir/algorithm_templates/dints/scripts/algo.py", line 119, in fill_template_config
[2023-04-18T16:07:21.134Z]     mem = get_mem_from_visible_gpus()
[2023-04-18T16:07:21.134Z]   File "/tmp/tmp7sdlj1x3/workdir/algorithm_templates/dints/scripts/algo.py", line 31, in get_mem_from_visible_gpus
[2023-04-18T16:07:21.134Z]     available_mem_visible_gpus.append(torch.cuda.mem_get_info(device=d)[0])
[2023-04-18T16:07:21.134Z] AttributeError: module 'torch.cuda' has no attribute 'mem_get_info'
[2023-04-18T16:07:21.134Z] 
[2023-04-18T16:07:21.134Z] ----------------------------------------------------------------------

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions