chore(backend): added logging to chunking#336
Conversation
Codecov Report
@@ Coverage Diff @@
## main #336 +/- ##
==========================================
- Coverage 86.35% 86.34% -0.01%
==========================================
Files 150 150
Lines 8487 8490 +3
Branches 957 957
==========================================
+ Hits 7329 7331 +2
- Misses 1147 1148 +1
Partials 11 11
📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more |
|
@shauryr This LGTM, but do you have a sense of why this is happening? Was it just something that came up in your debugging? I don't think it should ever happen unless there is a bug on the front end, since the frontend knows all the file paths and passes them to the backend. |
@gjreda when I ran the ingest command, the It maybe an issue because I have configured the project incorrectly. Am I doing something wrong here? |
This sounds like it is related to your environment variables. The application passes the env variables on each call to the sidecar (here), whereas if you are running just the python cli app, it will be using whatever env variables you have set. |
sometimes the backend is not able to chunk the full text from the pdfs because of file not found errors.