Hey HN,After migrating to an inference gateway to serve internal usage across an organization, problems have started to pop up. Once you detach from a managed ecosystem such as OpenAI or Anthropic you lose governance capabilities that makes the transition difficult.- Losing access to a central plugin hub for delivering MCPs, skills, etc. A gateway can sort of do this but has low compatibility beyond skills, different harnesses, and version ranges- Inability to deliver managed config (model defaults, etc). Can sort of be done with MDM/Jamf but doesn't reach contractors and doesn't follow employees to other machines- Gateway configuration is awkward for devs transitioning from SSO and API keys sit in plain text on their machinesThe gateway transition facilitates new model families (Kimi, Deepseek, etc) which are best utilized with new harnesses beyond Codex or Claude Code. Managing these additional tools multiplies the governance problems.Lastly, attempting to deliver an attribution prog...
Want to discover more AI signals like this?
Explore Steek