Repository navigation
ValueError: Please install the 'db-dtypes' package to use this function. #2537
Description
Expected Behavior
If I install feast with the [gcp] extra, I should be able to use BigQueryRetrievalJob.to_bigquery() without problems.
Current Behavior
When feast is installed with the [gcp] extra, it installs google-cloud-bigquery as per this line. It does not use the pandas extra, which means nothing triggers the installation of the db-dtypes package.
When bigquery.py uses to_dataframe() on the result of a BQ query as done here, it triggers a verification of imports available, which causes the exception here.
Steps to reproduce
Install feast[gcp] and use BigQueryRetrievalJob.to_bigquery().
Specifications
- Version:
feast[gcp]==0.16.1 - Platform: OSX
- Subsystem: Not sure what this is referring to
Possible Solution
Use google-cloud-bigquery[pandas] for the [gcp] extra.
Reacted by zabop, V Mota, adam_jura-czarnecki and Daniel Montes
Activity
felixwang9817 commentedon Apr 15, 2022
Hey @chhabrakadabra, thanks for reporting this issue. What version of
google-cloud-bigquerydo you have? I suspect the issue is thatgoogle-cloud-bigqueryrecently released v3.0.0 which had thedb-dtypesbreaking change. See this release and this migration guide for more details. Can you try reverting togoogle-cloud-bigquery<3.0.0and seeing if this error still persists? I'm on2.34.1and it works fine for me.I'll keep this issue open to track an upgrade to v3.0.0.
felixwang9817 commentedon Apr 15, 2022
I believe #2554 should have resolved this issue, so I'll close it now. If for some reason the bug persists, please feel to reopen it @chhabrakadabra!
michaelzolo commentedon May 30, 2022
For me this bug still persists. I'm using
google-cloud-bigquery3.0.1jerinscaria commentedon Jun 7, 2022
Issue persists google-cloud-bigquery version 3.1.0
felixwang9817 commentedon Jun 7, 2022
hey @michaelzolo and @jerinscaria, we still haven't upgraded to support bigquery >=3.0.0, so I would recommend using bigquery <3 for now
Switch to `google-cloud-bigquery[pandas]`.
Switch to `google-cloud-bigquery[pandas]`.
chore: Widen dependencies (#2928)