Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(scope): Can you add Groq API? #116

Open
3 tasks done
zinwelzl opened this issue Jun 24, 2024 · 1 comment
Open
3 tasks done

feat(scope): Can you add Groq API? #116

zinwelzl opened this issue Jun 24, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@zinwelzl
Copy link

zinwelzl commented Jun 24, 2024

Expected feature

Hi.

Like I said, tested 2.0.6 and 2.1.0 this weekend, and both work great.
No problem!

Now about LLM.
ollama is very slow on VPS, no GPU.

Can you add Groq API?
https://console.groq.com/docs/models
https://console.groq.com/docs/api-reference#chat
It is free for now, only need registration.

Thanks for great project!

Alternative solutions

No response

Anything else?

No response

Acknowledgements

  • This issue is not a duplicate of an existing bug report.
  • I have chosen an appropriate title.
  • All requested information has been provided properly.
@zinwelzl zinwelzl added the enhancement New feature or request label Jun 24, 2024
@psyray
Copy link
Contributor

psyray commented Jun 24, 2024

Like I said, tested 2.0.6 and 2.1.0 this weekend, and both work great. No problem!

Glad to hear that 😉

Now about LLM. ollama is very slow on VPS, no GPU.

Can you add Groq API? https://console.groq.com/docs/models https://console.groq.com/docs/api-reference#chat It is free for now, only need registration.

At the moment our goal is to stabilize reNgine-ng, but we add your request to the backlog
We will respond to you later

If you think you are able to do this and submit a PR, go for it !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants