Skip to content

Conversation

@SemyonSinchenko
Copy link
Collaborator

What changes were proposed in this pull request?

  • graphs are not cached on creation
  • GraphFrames unpersist GraphX objects after conversion
  • No more memory leaks

Why are the changes needed?

Close #686
Close #360

@SemyonSinchenko SemyonSinchenko self-assigned this Sep 15, 2025
@SemyonSinchenko SemyonSinchenko added scala graphx Anything related to GraphX labels Sep 15, 2025
@SemyonSinchenko
Copy link
Collaborator Author

cc: @SauronShepherd this one is fixing issue from #360

@SemyonSinchenko SemyonSinchenko merged commit d72ef0f into graphframes:master Sep 15, 2025
5 checks passed
@SemyonSinchenko SemyonSinchenko deleted the 686-memory-graphx branch September 15, 2025 19:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

graphx Anything related to GraphX scala

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat: improve memory management in GraphX bug: Graphframes with Structured Streaming results in OOM even with very low data volumes

2 participants