Skip to content

feat: explicitly select only required columns in all Pregel-based impls #696

@SemyonSinchenko

Description

@SemyonSinchenko

Is your feature request related to a problem? Please describe.
After I added persist to the Pregel it give us a big performance boost. Unfortunately, there is a risk of slow down in case the input Graph contains too much attributes because we are not filtering them explicitly.

Describe the solution you would like
Explicitly select only required columns before persisting.

Component

  • Scala Core Internal
  • Scala API
  • Spark Connect Plugin
  • Infrastructure
  • PySpark Classic
  • PySpark Connect

Additional context

Are you planning on creating a PR?

  • I'm willing to make a pull-request

Metadata

Metadata

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions