-
Notifications
You must be signed in to change notification settings - Fork 7.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: added Cloudflare llm provider #1340
base: main
Are you sure you want to change the base?
Conversation
Good, make sure you get proper results, as I see that there are just low parameter models in your list at the moment. 7B is to less in my view to work with bolt. |
@leex279 Dynamically pulling the models from Cloudflare now, and you're right, many of them don't work well. |
Let me know when it is ready to review. Make sure you add a proper description first ;) |
This is ready for review, but even with the largest of models (such as Llama 70b) the results are terrible. |
@leex279 can you add creds in .env file and re try .. it worked for me |
No description provided.