Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
mathstodon.xyz is one of the many independent Mastodon servers you can use to participate in the fediverse.
A Mastodon instance for maths people. We have LaTeX rendering in the web interface!

Administered by:

Server stats:

2.8K
active users

mathstodon.xyz: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.8

#mixtureofexperts

0 posts0 participants0 posts today
Public
LavX News

Revolutionizing Language Models: Mixture of Tunable Experts Enhances DeepSeek-R1's Capabilities

A groundbreaking approach in AI model architecture, Mixture of Tunable Experts (MoTE) allows for dynamic tuning of expert behavior in DeepSeek-R1, enhancing its response capabilities and even switchin...

news.lavx.hu/article/revolutio

Revolutionizing Language Models: Mixture of Tunable Experts Enhances DeepSeek-R1's Capabilities
#news#tech#DeepSeek
Public
WetHat💦

DeepSeek R1: All you need to know 🐳

The article covers various aspects of the model, from its architecture to training methodologies and practical applications. The explanations are mostly clear and detailed, making complex concepts like Mixture of Experts (#MoE) and reinforcement learning easy to understand.

fireworks.ai/blog/deepseek-r1-

DeepSeek R1: All you need to know 🐳DeepSeek R1: All you need to know 🐳
#DeepSeekR1#AI#MachineLearning
Public
WetHat💦

Brief analysis of DeepSeek R1 and its implications for Generative AI:
➡️ DeepSeek R1 exhibits powerful reasoning behaviors, achieved through scalable Group Relative Policy Optimization (GRPO).
➡️Emergent self-reflection and Chain-of-Thought (CoT) patterns improve reasoning performance.
➡️Distillation of larger models into smaller, efficient ones demonstrates significant performance improvements.

arxiv.org/abs/2502.02523v2?for

arXiv logo
arXiv.orgBrief analysis of DeepSeek R1 and its implications for Generative AIIn late January 2025, DeepSeek released their new reasoning model (DeepSeek R1); which was developed at a fraction of the cost yet remains competitive with OpenAI's models, despite the US's GPU export ban. This report discusses the model, and what its release means for the field of Generative AI more widely. We briefly discuss other models released from China in recent weeks, their similarities; innovative use of Mixture of Experts (MoE), Reinforcement Learning (RL) and clever engineering appear to be key factors in the capabilities of these models. This think piece has been written to a tight timescale, providing broad coverage of the topic, and serves as introductory material for those looking to understand the model's technical advancements, as well as its place in the ecosystem. Several further areas of research are identified.
#DeepSeekR1#GenerativeAI#MachineLearning
SearchLive feeds
About