-
Notifications
You must be signed in to change notification settings - Fork 126
Closed
Labels
api: bigqueryIssues related to the googleapis/python-bigquery-pandas API.Issues related to the googleapis/python-bigquery-pandas API.type: processA process-related concern. May include testing, release, or the like.A process-related concern. May include testing, release, or the like.
Description
The backend made some improvements to the performance of time-to-first-byte for query results. I'm working on implementing these changes here: googleapis/python-bigquery#362
pandas-gbq will not be able to take advantage of many of these performance improvements unless it uses the return value from QueryJob.result() or even QueryJob.to_dataframe() directly.
- Use
QueryJob.to_dataframe()(remove any manuallist_rows()on destination table calls if still present). - Use
Client.load_table_from_dataframe()(Done in feat:to_gbquses Parquet by default, useapi_method="load_csv"for old behavior #413)
Related: #149
max-sixty, gilangardya and AdityaSoni19031997
Metadata
Metadata
Assignees
Labels
api: bigqueryIssues related to the googleapis/python-bigquery-pandas API.Issues related to the googleapis/python-bigquery-pandas API.type: processA process-related concern. May include testing, release, or the like.A process-related concern. May include testing, release, or the like.