The Medium post goes over various flavors of distillation, including response-based distillation, feature-based distillation and relation-based distillation. It also covers two fundamentally different modes of distillation – off-line and online distillation.
White House AI czar David Sacks says, “There’s substantial evidence that DeepSeek distilled knowledge from OpenAI models.”
ChatGPT maker says it will need extra protection from US government, following emergence of Chinese rival, DeepSeek.
Microsoft and OpenAI are probing if data output from the ChatGPT maker's technology was obtained in an unauthorized manner by a group linked to Chinese artificial intelligence (AI) startup DeepSeek, Bloomberg News reported on Tuesday.
Did the upstart Chinese tech company DeepSeek copy ChatGPT to make the artificial intelligence technology that shook Wall Street this week?
David Sacks, Trump's crypto czar, said former President Biden's executive order on Artificial Intelligence has hamstrung American AI companies.
Microsoft is bringing OpenAI’s o1 reasoning model to all Copilot users this week. You won’t need to subscribe to a $20 monthly Copilot Pro or ChatGPT Plus plan to get it either, as Microsoft is making it free for all users of Copilot.
DeepSeek supposedly achieved similar results training up its model to OpenAi’s ChatGPT for around 6% of the cost of its US competitor. The news wiped more than US$1 trillion in value from the AI chipmaker NVIDIA’s market cap, along with sending several tech stocks south, and suddenly left US tech gods looking like they had feet of clay.
The AI world is fretting about the emergence of a low-cost LLM developed by an obscure Chinese firm that may have copied OpenAI.
In its own research, DeepSeek said it had “distilled” models from its R1 system based on other open-source systems. Unlike OpenAI’s closed systems, some models such as Meta’s Llama are open-source and freely available for use.
OpenAI has claimed it has evidence that its Chinese competitor, DeepSeek, has used the US technology firm's AI model ChatGPT, to train its system. According to a Bloomberg News report, Microsoft, one of OpenAI’s key investors,