Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Add support for llama.cpp and Weaviate #41

Closed
zbruceli opened this issue Apr 29, 2023 · 6 comments
Closed

[FEATURE] Add support for llama.cpp and Weaviate #41

zbruceli opened this issue Apr 29, 2023 · 6 comments

Comments

@zbruceli
Copy link

Describe the feature you'd like
Could you please add support for

  • llama.cpp embedding
  • llama.cpp llm
  • Weaviate vector DB

Additional context
I got LangChain + OpenAI + Pinecone working for conversational Q&A retrieval against enterprise knowledge base, but would like to use open source and locally run alternative components (llama.cpp for embedding and LLM, Weaviate for vector DB). Thus my enterprise data will be on premise. Thank you.

@HenryHengZJ
Copy link
Contributor

Thanks for the suggestion!

As this project is built on top of LangChainJS, llama.cpp is still not yet supported for now. It is also requested here: langchain-ai/langchainjs#710

We can definitely add Weaviate DB soon. For now, Supabase, Chroma are open source which you can run locally as well

@heresandyboy
Copy link

Weaviate was recently added to LangChainJS, same interface as the other VectorStores. Also perhaps have a look at https://github.com/go-skynet/LocalAI it's a way of running open models locally with an API that is compatible with OpenAIs API interfaces. Should be a great stopgap while there is no llama.cpp

@HenryHengZJ
Copy link
Contributor

Weaviate is now added to Flowise - #45

@HenryHengZJ
Copy link
Contributor

Closing this as you can now use LocalAI #123 to run local LLMs and embeddings. So far this is the only viable solution for JS/TS based project

@Initonedeb
Copy link

Weaviate is now added to Flowise - #45

Im desperate in need of a tutorial to use it with flowise,

@ovizii
Copy link

ovizii commented Apr 3, 2024

Weaviate is now added to Flowise - #45

Seems to be still not listed in the docs. Any particular reason or just an oversight?
=> https://docs.flowiseai.com/integrations/langchain/vector-stores

JohnBQuinn pushed a commit to JohnBQuinn/Flowise that referenced this issue Jun 7, 2024
* feat:自定义历史聊天标题

* Update chat.ts

* perf:自定义聊天标题

* feat: google auth

* perf:将修改标题移入右键菜单

* perf:updatetitle

---------

Co-authored-by: archer <[email protected]>
JohnBQuinn pushed a commit to JohnBQuinn/Flowise that referenced this issue Jun 7, 2024
* move components to web package (FlowiseAI#37)

* move components

* fix

* fix: cq connection

* fix pagination (FlowiseAI#41)

* doc

* openapi config

* fix team share app lose (FlowiseAI#42)

* fix: ts

* doc

* doc

---------

Co-authored-by: heheer <[email protected]>
Co-authored-by: yst <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants