DeepSeek's R1 model release and OpenAI's new Deep Research product will push companies to use techniques like distillation, supervised fine-tuning (SFT), reinforcement learning (RL), and ...

DeepSeek’s success learning from bigger AI models raises questions about the billions being spent on the most advanced ...

The Microsoft piece also goes over various flavors of distillation, including response-based distillation, feature-based ...

AI-driven knowledge distillation is gaining attention. LLMs are teaching SLMs. Expect this trend to increase. Here's the ...

DeepSeek arrived out of nowhere and upended the entire AI market. We round up the biggest happenings of the past 10 days.

AI agents today struggle with efficiently mastering multiple tasks due to their heavy reliance on prompts. The traditional ...

David Sacks says OpenAI has evidence that Chinese company DeepSeek used a technique called "distillation" to build a rival ...

Experts say AI model distillation is likely widespread and hard to detect, but DeepSeek has not admitted to using it on its ...

Researchers from Stanford and Washington developed an AI model for $50, rivaling top models like OpenAI's o1 and DeepSeek.

OpenAI believes DeepSeek used a process called “distillation,” which helps make smaller AI models perform better by learning ...

After DeepSeek AI shocked the world and tanked the market, OpenAI says it has evidence that ChatGPT distillation was used to ...

One of the key takeaways from this research is the role that DeepSeek’s cost-efficient training approach may have played in ...