-
Since the Document object's reference to the
embeddingis deprecated and will be removed, the VectorStore implementations require a way to store the embedding of the corresponding Document objects-
One way to fix this is, to have the EmbeddingModel#embed to return the embeddings in the same order as that of the Documents passed to it.
- Since both the Document and embedding collections use the List object, their iteration operation will make sure to keep them in line with the same order.
- A fix is required to preserve the order when batching strategy is applied.
- Updated the Javadoc for BatchingStrategy -
- Fixed the Document List order in TokenCountBatchingStrategy
- Since both the Document and embedding collections use the List object, their iteration operation will make sure to keep them in line with the same order.
-
Refactored the vector store implementations to update this change
-
Resolves #GH-1826
Comment From: tzolov
rebased, cleaned, squashed and merged at : ebd29e0959086ea950d505a8aefb9e32ca7732a7