Google: "We have no moat, and neither does OpenAI". Allegedly leaked internal Google document.
"We aren't positioned to win this arms race and neither is OpenAI. While we've been squabbling, a third faction has been quietly eating our lunch."
"I'm talking, of course, about open source. Plainly put, they are lapping us. Things we consider 'major open problems' are solved and in people's hands today. Just to name a few:"
"LLMs on a Phone: People are running foundation models on a Pixel 6 at 5 tokens / sec."
"Scalable Personal AI: You can finetune a personalized AI on your laptop in an evening."
"Responsible Release: This one isn't 'solved' so much as 'obviated'. There are entire websites full of art models with no restrictions whatsoever, and text is not far behind."
"Multimodality: The current multimodal ScienceQA SOTA was trained in an hour."
"While our models still hold a slight edge in terms of quality, the gap is closing astonishingly quickly."
