|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Cryptocurrency News Articles
These diffusion models maintain performance faster than or comparable to similarly sized conventional models
Feb 28, 2025 at 05:14 am
LLaDA's researchers report their 8 billion parameter model performs similarly to LLaMA3 8B across various benchmarks

Large language models (LLMs) are typically bottlenecked by speed, especially when compared to smaller models. However, new diffusion-based models have reportedly achieved performance faster than or comparable to similarly sized conventional models while also being significantly faster.
LLaDA, a 7-billion parameter language model from researchers at the University of Science and Technology of China, performs similarly to LLaMA3 8B across various benchmarks.
According to Inception, an AI startup focused on efficient deep learning, LLaDA achieves competitive results on tasks like MMLU, ARC, and GSM8K.
But when comparing the speed of an 8-billion parameter LLaDA model to an 8-billion parameter LLaMA3 model, LLaDA generates 1,024 tokens per second on an Nvidia H100, whereas LLaMA3 generates about 60 tokens per second. This difference in throughput is roughly 17x.
LLaDA's researchers claim this level of performance is possible with models as small as 3 billion parameters.
Compared to GPT-4o Mini, which operates at 59 tokens per second, Mercury Coder Mini scores 88.0 percent on HumanEval and 77.1 percent on MBPP—comparable to GPT-4o Mini—while reportedly operating at 1,109 tokens per second. This represents an 18x speed advantage over GPT-4o Mini.
Mercury's documentation states its models run "at over 1,000 tokens/sec on Nvidia H100s, a speed previously possible only using custom chips" from specialized hardware providers like Groq, Cerebras, and SambaNova. When compared to other speed-optimized models, the claimed advantage remains significant—Mercury Coder Mini is reportedly about 5.5x faster than Gemini 2.0 Flash-Lite (201 tokens/second) and 18x faster than Claude 3.5 Haiku (61 tokens/second).
According to Inception, Mercury Coder Mini also outperforms smaller models from GPT-3.5 series and PaLM 2 series at comparable speed.
At 1,024 tokens per second, LLaDA is faster than smaller models from GPT-3.5 series and PaLM 2 series at comparable speed. At 201 tokens per second, Gemini 2.0 Flash-Lite has better performance at HumanEval and worse performance at MBPP than Mercury Coder Mini. At 61 tokens per second, Claude 3.5 Haiku has better performance at both HumanEval and MBPP than Mercury Coder Mini.
Opening a potential new frontier in LLMs
Diffusion models do involve some trade-offs. They typically need multiple forward passes through the network to generate a complete response, unlike traditional models that need just one pass per token. However, because diffusion models process all tokens in parallel, they achieve higher throughput despite this overhead.
Inception thinks the speed advantages could impact code completion tools where instant response may affect developer productivity, conversational AI applications, resource-limited environments like mobile applications, and AI agents that need to respond quickly.
If diffusion-based language models maintain quality while improving speed, they might change how AI text generation develops. So far, AI researchers have been open to new approaches.
Independent AI researcher Simon Willison told Ars Technica, "I love that people are experimenting with alternative architectures to transformers, it's yet another illustration of how much of the space of LLMs we haven't even started to explore yet."
On X, former OpenAI researcher Andrej Karpathy wrote about Inception, "This model has the potential to be different, and possibly showcase new, unique psychology, or new strengths and weaknesses. I encourage people to try it out!"
Questions remain about whether larger diffusion models can match the performance of models like GPT-4o and Claude 3.7 Sonnet, and if the approach can handle increasingly complex simulated reasoning tasks. For now, these models offer an alternative for smaller AI language models that doesn't seem to sacrifice capability for speed.
You can try Mercury Coder yourself on Inception's demo site, and you can download code for LLaDA or try a demo on Hugging Face.
Disclaimer:info@kdj.com
The information provided is not trading advice. kdj.com does not assume any responsibility for any investments made based on the information provided in this article. Cryptocurrencies are highly volatile and it is highly recommended that you invest with caution after thorough research!
If you believe that the content used on this website infringes your copyright, please contact us immediately (info@kdj.com) and we will delete it promptly.
-
-
-
- DTCC Embraces Multichain Future: What It Means for Solana and the XRP Ledger
- Nov 16, 2026 at 04:05 am
- DTCC is expanding its tokenization strategy across multiple blockchain networks, with Solana securing a key integration. This multichain approach reshapes the landscape for digital assets, prompting questions about the XRP Ledger's role in this evolving financial infrastructure.
-
- Sui Network, Toncoin, TRON: Navigating the Evolving Crypto Landscape
- Nov 14, 2026 at 11:55 pm
- Amidst market shifts, Sui Network, Toncoin, and TRON reveal distinct paths for growth and challenges. This report dissects their latest movements, from TRON's account surge to Sui's ecosystem adjustments and Toncoin's Telegram integration, offering insights for the discerning investor.
-
- OKX Europe Boosts Fast Redemption Limits for VIP Liquid Staking, Setting Industry Pace
- Nov 14, 2026 at 03:45 pm
- OKX Europe elevates daily fast redemption limits for VIP liquid staking token holders (BETH and OKSOL), enhancing liquidity access and user experience, while the broader liquid staking landscape sees innovations like Faroo's stPROS.
-
-
- Pyth Network, Douro Labs, and CFTC Regulation: Shaping the Future of Crypto Market Integrity
- Nov 14, 2026 at 08:05 am
- Douro Labs, a key contributor to Pyth Network, is actively engaging with CFTC on crypto market rules, advocating for multi-source pricing and robust oracle evaluation to prevent market manipulation and protect investors.
-
-

































