Skip to content

test_multiprocessing_spawn fails on x86 Windows7 3.7 buildbot #78694

Closed

Description

@pablogsal
BPO 34513
Nosy @pfmoore, @vstinner, @tjguk, @zware, @zooba, @pablogsal

Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.

Show more details

GitHub fields:

assignee = None
closed_at = <Date 2019-09-24.10:37:25.188>
created_at = <Date 2018-08-27.00:40:23.267>
labels = ['3.7', 'type-bug', 'tests', 'OS-windows']
title = 'test_multiprocessing_spawn fails on x86 Windows7 3.7 buildbot'
updated_at = <Date 2019-09-24.10:37:25.186>
user = 'https://github.com/pablogsal'

bugs.python.org fields:

activity = <Date 2019-09-24.10:37:25.186>
actor = 'vstinner'
assignee = 'none'
closed = True
closed_date = <Date 2019-09-24.10:37:25.188>
closer = 'vstinner'
components = ['Tests', 'Windows']
creation = <Date 2018-08-27.00:40:23.267>
creator = 'pablogsal'
dependencies = []
files = []
hgrepos = []
issue_num = 34513
keywords = []
message_count = 4.0
messages = ['324137', '324749', '324751', '353065']
nosy_count = 6.0
nosy_names = ['paul.moore', 'vstinner', 'tim.golden', 'zach.ware', 'steve.dower', 'pablogsal']
pr_nums = []
priority = 'normal'
resolution = 'out of date'
stage = 'resolved'
status = 'closed'
superseder = None
type = 'behavior'
url = 'https://bugs.python.org/issue34513'
versions = ['Python 3.7']

Activity

  1. pablogsal commented on Aug 27, 2018

    @pablogsal
    MemberAuthor

    test_multiprocessing_spawn fails on x86 Windows7 3.7 buildbot:

    https://buildbot.python.org/all/#/builders/111/builds/500

    Timeout (0:15:00)!
    Thread 0x00000c64 (most recent call first):
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\connection.py", line 306 in _recv_bytes
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\connection.py", line 250 in recv
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\pool.py", line 470 in _handle_results
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\threading.py", line 865 in run
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\threading.py", line 917 in _bootstrap_inner
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\threading.py", line 885 in _bootstrap
    Thread 0x000000b4 (most recent call first):
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\pool.py", line 422 in _handle_tasks
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\threading.py", line 865 in run
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\threading.py", line 917 in _bootstrap_inner
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\threading.py", line 885 in _bootstrap
    Thread 0x000008d4 (most recent call first):
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\pool.py", line 413 in _handle_workers
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\threading.py", line 865 in run
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\threading.py", line 917 in _bootstrap_inner
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\threading.py", line 885 in _bootstrap
    Thread 0x00000b88 (most recent call first):
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\threading.py", line 296 in wait
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\threading.py", line 552 in wait
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\pool.py", line 648 in wait
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\pool.py", line 651 in get
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\pool.py", line 261 in apply
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\_test_multiprocessing.py", line 2224 in test_apply
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\unittest\case.py", line 615 in run
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\unittest\case.py", line 663 in __call__
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\unittest\suite.py", line 122 in run
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\unittest\suite.py", line 84 in __call__
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\unittest\suite.py", line 122 in run
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\unittest\suite.py", line 84 in __call__
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\unittest\suite.py", line 122 in run
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\unittest\suite.py", line 84 in __call__
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\unittest\runner.py", line 176 in run
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\support\__init__.py", line 1882 in _run_suite
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\support\__init__.py", line 1972 in run_unittest
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\libregrtest\runtest.py", line 175 in test_runner
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\libregrtest\runtest.py", line 179 in runtest_inner
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\libregrtest\runtest.py", line 140 in runtest
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\libregrtest\main.py", line 286 in rerun_failed_tests
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\libregrtest\main.py", line 570 in _main
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\libregrtest\main.py", line 531 in main
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\libregrtest\main.py", line 584 in main
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\__main__.py", line 2 in <module>
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\runpy.py", line 85 in _run_code
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\runpy.py", line 193 in _run_module_as_main
    Process SpawnPoolWorker-184:
    Traceback (most recent call last):
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\pool.py", line 127, in worker
        put((job, i, result))
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\queues.py", line 361, in put
        self._writer.send_bytes(obj)
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\connection.py", line 200, in send_bytes
        self._send_bytes(m[offset:offset + size])
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\connection.py", line 280, in _send_bytes
        ov, err = _winapi.WriteFile(self._handle, buf, overlapped=True)
    BrokenPipeError: [WinError 232] The pipe is being closed
    During handling of the above exception, another exception occurred:
    Traceback (most recent call last):
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\process.py", line 297, in _bootstrap
        self.run()
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\process.py", line 99, in run
        self._target(*self._args, **self._kwargs)
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\pool.py", line 132, in worker
        put((job, i, (False, wrapped)))
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\queues.py", line 361, in put
        self._writer.send_bytes(obj)
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\connection.py", line 200, in send_bytes
        self._send_bytes(m[offset:offset + size])
      File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\multiprocessing\connection.py", line 280, in _send_bytes
        ov, err = _winapi.WriteFile(self._handle, buf, overlapped=True)
    BrokenPipeError: [WinError 232] The pipe is being closed
    program finished with exit code 1
    elapsedTime=4600.317000
  2. pablogsal commented on Sep 7, 2018

    @pablogsal
    MemberAuthor

    New failure on x86 Windows7 3.x: https://buildbot.python.org/all/#/builders/58/builds/1295/steps/3/logs/stdio

    test_no_import_lock_contention (test.test_multiprocessing_spawn.WithProcessesTestQueue) ... ok
    Timeout (0:15:00)!
    Thread 0x00000f10 (most recent call first):
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 296 in wait
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\multiprocessing\queues.py", line 224 in _feed
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 865 in run
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 917 in _bootstrap_inner
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 885 in _bootstrap
    Thread 0x00000ea0 (most recent call first):
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\multiprocessing\queues.py", line 82 in put
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\_test_multiprocessing.py", line 163 in __call__
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\case.py", line 173 in handle
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\case.py", line 738 in assertRaises
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\_test_multiprocessing.py", line 862 in test_put
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\case.py", line 610 in run
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\case.py", line 658 in __call__
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 122 in run
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 84 in __call__
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 122 in run
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 84 in __call__
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 122 in run
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 84 in __call__
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\runner.py", line 176 in run
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\support\__init__.py", line 1900 in _run_suite
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\support\__init__.py", line 1990 in run_unittest
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\runtest.py", line 175 in test_runner
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\runtest.py", line 179 in runtest_inner
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\runtest.py", line 140 in runtest
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\main.py", line 286 in rerun_failed_tests
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\main.py", line 570 in _main
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\main.py", line 531 in main
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\main.py", line 584 in main
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\__main__.py", line 2 in <module>
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\runpy.py", line 85 in _run_code
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\runpy.py", line 193 in _run_module_as_main
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\multiprocessing\spawn.py", line 117, in spawn_main
        exitcode = _main(fd)
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\multiprocessing\spawn.py", line 127, in _main
        self = reduction.pickle.load(from_parent)
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\multiprocessing\connection.py", line 951, in rebuild_pipe_connection
        handle = dh.detach()
      File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\multiprocessing\reduction.py", line 133, in detach
        self._access, False, _winapi.DUPLICATE_CLOSE_SOURCE)
    PermissionError: [WinError 5] Access is denied
    program finished with exit code 1
  3. vstinner commented on Sep 24, 2019

    @vstinner
    Member

    File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\multiprocessing\reduction.py", line 133, in detach
    self._access, False, _winapi.DUPLICATE_CLOSE_SOURCE)
    PermissionError: [WinError 5] Access is denied

    I created bpo-38263 "[Windows] multiprocessing: DupHandle.detach() race condition on DuplicateHandle(DUPLICATE_CLOSE_SOURCE)" for this bug.

    I close this issue as outdated.

  4. transferred this issue fromon Apr 10, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    3.7 (EOL)end of lifeOS-windowstestsTests in the Lib/test dirtype-bugAn unexpected behavior, bug, or error

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions