langchain embedding

[zwilch]

I see you try to add langchain memory and usind embedding for documents.

On my local running LLM i have not running embedding API endpoint.
What do you plan to use for embedding?

May with my other sugesstion #36 (comment) to add more API Endpoints, we can run on one Port llama.cpp with ./server --embedding API ?

[10cl]

here is a example: https://chatdev.toscl.com/s/1705304737vU2BfkeXl9.

Embedding based on wasm's transformers in browser env(https://huggingface.co/Xenova/all-MiniLM-L6-v2/), embedding a pdf in a browser env is too time consuming, and I am working on ways to provide a config entry for other Embedding API.

[zwilch]

I hope that will work may without web assembly
https://huggingface.co/docs/transformers.js/index