Market Cap: $2.184T 0.31%
Volume(24h): $69.2158B -38.77%
  • Market Cap: $2.184T 0.31%
  • Volume(24h): $69.2158B -38.77%
  • Fear & Greed Index:
  • Market Cap: $2.184T 0.31%
Cryptos
Topics
Cryptospedia
News
CryptosTopics
Videos
Top News
Cryptos
Topics
Cryptospedia
News
CryptosTopics
Videos
bitcoin
bitcoin

$64566.812908 USD

0.23%

ethereum
ethereum

$1810.474514 USD

0.98%

tether
tether

$0.999022 USD

-0.03%

bnb
bnb

$590.524043 USD

0.06%

usd-coin
usd-coin

$0.999830 USD

0.01%

xrp
xrp

$0.951385 USD

-0.53%

solana
solana

$70.791567 USD

0.57%

tron
tron

$0.302344 USD

-1.59%

hyperliquid
hyperliquid

$66.043751 USD

0.99%

zcash
zcash

$884.280716 USD

-1.46%

dogecoin
dogecoin

$0.058467 USD

0.99%

monero
monero

$482.505734 USD

-1.49%

unus-sed-leo
unus-sed-leo

$9.190973 USD

0.78%

chainlink
chainlink

$9.081451 USD

-0.25%

cardano
cardano

$0.151877 USD

0.97%

Cryptocurrency News Articles

These diffusion models maintain performance faster than or comparable to similarly sized conventional models

Feb 28, 2025 at 05:14 am

LLaDA's researchers report their 8 billion parameter model performs similarly to LLaMA3 8B across various benchmarks

These diffusion models maintain performance faster than or comparable to similarly sized conventional models

Large language models (LLMs) are typically bottlenecked by speed, especially when compared to smaller models. However, new diffusion-based models have reportedly achieved performance faster than or comparable to similarly sized conventional models while also being significantly faster.

LLaDA, a 7-billion parameter language model from researchers at the University of Science and Technology of China, performs similarly to LLaMA3 8B across various benchmarks.

According to Inception, an AI startup focused on efficient deep learning, LLaDA achieves competitive results on tasks like MMLU, ARC, and GSM8K.

But when comparing the speed of an 8-billion parameter LLaDA model to an 8-billion parameter LLaMA3 model, LLaDA generates 1,024 tokens per second on an Nvidia H100, whereas LLaMA3 generates about 60 tokens per second. This difference in throughput is roughly 17x.

LLaDA's researchers claim this level of performance is possible with models as small as 3 billion parameters.

Compared to GPT-4o Mini, which operates at 59 tokens per second, Mercury Coder Mini scores 88.0 percent on HumanEval and 77.1 percent on MBPP—comparable to GPT-4o Mini—while reportedly operating at 1,109 tokens per second. This represents an 18x speed advantage over GPT-4o Mini.

Mercury's documentation states its models run "at over 1,000 tokens/sec on Nvidia H100s, a speed previously possible only using custom chips" from specialized hardware providers like Groq, Cerebras, and SambaNova. When compared to other speed-optimized models, the claimed advantage remains significant—Mercury Coder Mini is reportedly about 5.5x faster than Gemini 2.0 Flash-Lite (201 tokens/second) and 18x faster than Claude 3.5 Haiku (61 tokens/second).

According to Inception, Mercury Coder Mini also outperforms smaller models from GPT-3.5 series and PaLM 2 series at comparable speed.

At 1,024 tokens per second, LLaDA is faster than smaller models from GPT-3.5 series and PaLM 2 series at comparable speed. At 201 tokens per second, Gemini 2.0 Flash-Lite has better performance at HumanEval and worse performance at MBPP than Mercury Coder Mini. At 61 tokens per second, Claude 3.5 Haiku has better performance at both HumanEval and MBPP than Mercury Coder Mini.

Opening a potential new frontier in LLMs

Diffusion models do involve some trade-offs. They typically need multiple forward passes through the network to generate a complete response, unlike traditional models that need just one pass per token. However, because diffusion models process all tokens in parallel, they achieve higher throughput despite this overhead.

Inception thinks the speed advantages could impact code completion tools where instant response may affect developer productivity, conversational AI applications, resource-limited environments like mobile applications, and AI agents that need to respond quickly.

If diffusion-based language models maintain quality while improving speed, they might change how AI text generation develops. So far, AI researchers have been open to new approaches.

Independent AI researcher Simon Willison told Ars Technica, "I love that people are experimenting with alternative architectures to transformers, it's yet another illustration of how much of the space of LLMs we haven't even started to explore yet."

On X, former OpenAI researcher Andrej Karpathy wrote about Inception, "This model has the potential to be different, and possibly showcase new, unique psychology, or new strengths and weaknesses. I encourage people to try it out!"

Questions remain about whether larger diffusion models can match the performance of models like GPT-4o and Claude 3.7 Sonnet, and if the approach can handle increasingly complex simulated reasoning tasks. For now, these models offer an alternative for smaller AI language models that doesn't seem to sacrifice capability for speed.

You can try Mercury Coder yourself on Inception's demo site, and you can download code for LLaDA or try a demo on Hugging Face.

Original source:arstechnica

Disclaimer:info@kdj.com

The information provided is not trading advice. kdj.com does not assume any responsibility for any investments made based on the information provided in this article. Cryptocurrencies are highly volatile and it is highly recommended that you invest with caution after thorough research!

If you believe that the content used on this website infringes your copyright, please contact us immediately (info@kdj.com) and we will delete it promptly.

Other articles published on Nov 16, 2026