I'm just a hobbyist that has ran LLM models locally and follow a lot of content about it. Hope we have a few AI researchers here on HN to clarify this.When using Opus or Codex vs. a chinese or Open source model, it feels like its reasoning capabilities are basically the same.The difference is typically in coding. It looks like OpenAI and Anthropic invest a lot in pre-training (paying Mercor and the like).Also a lot in creating synthetic data, I believe this has bigger AI research involvement and techniques.This ends up creating the perspective that it is smart, after all, it has been trained with what you want to do, so it can do that for you.But overall, is there really much AI research being done on those companies, or are the AI researchers mostly fine-tuning small aspects of the model, akin to what Google engineers used to do for Google search?Of course, there's the RLHF loop that developers using Anthropic/OpenAI products as well, which provides probably very good data.I ask this ...
Want to discover more AI signals like this?
Explore Steek