Skip to content

PARQUET-164: Add warning when scaling row group sizes.#119

Closed
rdblue wants to merge 1 commit intoapache:masterfrom
rdblue:PARQUET-164-add-memory-manager-warning
Closed

PARQUET-164: Add warning when scaling row group sizes.#119
rdblue wants to merge 1 commit intoapache:masterfrom
rdblue:PARQUET-164-add-memory-manager-warning

Conversation

@rdblue
Copy link
Contributor

@rdblue rdblue commented Feb 10, 2015

No description provided.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure we want this to show up in the case where the memory manager does not do anything special (scale == 1).
It will add noise for user that have only one writer.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good point, especially when the warning I added when the allocation is changed now includes this information. I've changed this back to debug.

@julienledem
Copy link
Member

Just one comment otherwise, this looks good to me.

@rdblue rdblue force-pushed the PARQUET-164-add-memory-manager-warning branch from a1b9a2d to 241144f Compare February 10, 2015 07:06
@asfgit asfgit closed this in f48bca0 Feb 10, 2015
rdblue added a commit to rdblue/parquet-mr that referenced this pull request Mar 9, 2015
Author: Ryan Blue <[email protected]>

Closes apache#119 from rdblue/PARQUET-164-add-memory-manager-warning and squashes the following commits:

241144f [Ryan Blue] PARQUET-164: Add warning when scaling row group sizes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants