Inference on AWS Bedrock for OpenAI models has been very slow and glitchy the last few days with today being the worst. Very long latency of over 5 minutes to first token. What's going on? Comments URL: https://news.ycombinator.com/item?id=49719474 Points: 2 # Comments: 1
Want to discover more AI signals like this?
Explore Steek