S
Sales & Marketing
Merged in a post:
Custom OpenAI Endpoints Allowing For Custom AI Providers , Tools, & Cost Savings
N
Network Administrator
Allows for self hosting & utilizing inferencing services for models like LLama, Deepseek, Grok, Claude, etc. Billing should be adjusted on million / tokens to user defined allowing you to charge the rate your paying or even up-charge.
EXTREMELY EASY IMPLEMENTATION:
Just allow the user to set the OpenAI Base URL to the endpoint location. Here is a doc showing you how to use Together.ai's endpoint: https://docs.together.ai/docs/openai-api-compatibility
PS: Open Source your code base and I would have done this myself. I am available to help implement this as we have our AI agents we want to implement inside of GHL.
M
Mike Roberts
It would be nice to have the ability to use a custom API endpoint for a different model. I would like this to be a feature for API and customized from the agency and proscribed to sub accounts, not something that everyone can see and access, only designated "pro-sumers".
T
Todd Ross
As in, create a custom LLM in GHL that all other LLMs could feed into.