Skip to content

Tips For Large Files

Sal edited this page Oct 5, 2025 · 16 revisions

Here are some tips on how to deal with larger Parquet files.

Load only fields you care about

By default the application will try to load all the fields within the Parquet file. This might be okay for smaller files but when dealing with larger files selecting all the fields might not be very efficient

Reducing the amount of fields to load will decrease load times and reduce memory usage, allowing more records to be loaded into memory for display.

View your file in smaller chunks

If your Parquet file has too many records it might not be possible to load all of them into memory.

Instead you could set the Record Count value to something your PC can handle:

record count screenshot

And then utilize the Record Offset field to navigate the file instead:

record offset screenshot

Clone this wiki locally