I have a large document. during my test with Pinecone. i found that i needed to split the document into chunk, and put into json format during the API Call to embedding with text-embedding-ada-002. ( i have few 800 words document, no split. i found that everytime i query the Pinecone, it always r…

Chunk & Embedding ( OpenAI + Pinecone )

SomebodySysop June 4, 2024, 4:23am 3

Topic		Replies	Views
How to Optimize Text Chunking for Improved Embedding Vectorization? API vector-db , semantic-search	6	10276	December 15, 2023
Automating Chunking for Customized GPT Knowledge in Vector Databases API embeddings , vector-db	2	1305	April 27, 2024
Embedding Longer Texts API	8	14700	December 25, 2023
Summarizing and extracting structured data from long text Prompting gpt-4 , api , token , limitations	14	12324	February 19, 2024
Is there any sample code to split a json file into smaller chunks? API	11	12734	October 26, 2023