Skip to content

crawl_permissions takes too long to run on a large workspace #380

@dmoore247

Description

@dmoore247

In testing the assessment job on a large (3000+ user workspace) crawl_permissions takes over 8 hours to run. This job has not run to completion for this workspace, starting with ucx 0.2.0, also on ucx 0.3.0

Suggest...
a. make it run faster (more threads)
b. do less work
c. make it do save checkpoints and re-start from where it last failed.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestmigrate/groupsCorresponds to Migrate Groups Step of go/uc/upgradestep/assessmentgo/uc/upgrade - Assessment StepwontfixThis will not be worked on

    Type

    No type

    Projects

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions