Go LLM SDK for streaming, tool-calling AI backends (plus frontend React lib)

jnstrdm05

Very nice! Thanks for putting this out there

champagnepapi

I’m curious to know if this was architected/designed by an actual human or is this just AI slop? These days I am very very cautious about the quality of packages. I’ve become a lot more reluctant/hesitant (which is not to say prior I was in favor of just adding packages left and right). I was still conservative, but these days I’ve become much much more conservative when it comes to adding a package to a production system. I will review this later and report back for the community

gregfurman

This looks great! Wonder how it compares to https://github.com/genkit-ai/genkit since they also offer similar SDKs and support for different model providers.

throwaway894345

I wonder how these LLM SDKs compare. Is this in the same category as Google’s ADK? Or maybe ADK is a higher level (agents are a higher level than models)?

zknill

This is a backend written in go that's wire-protocol compatible with the (catchy named) Vercel AI UI SDK; which is an SDK for helping to build AI chat apps. The original Vercel AI SDK backend is in typescript. I think they really missed the opportunity to add in resumable streaming after a dropped SSE connection, or multi-device support. Because these SDKs are easy to drop-in to your applications, but hard once you actually try and build resilient systems on top of them. Systems that can heal from dropped connections, or support multiple users or multiple devices.

iJohnDoe

Can someone explain the purpose of this? What are the advantages or use-cases? What type of project would I use this with? If I was going to write a Go application to utilize the OpenAI API, is there a reason to use this vs. just making calls directly to the OpenAI API? Genuine questions so I can understand and learn more.

Merkur

I don’t understand - Why did they write this? It seems to add nothing to the domain?

helsinki

I've been building github.com/fugue-labs/gollem for five months.