市值: $2.1169T -2.34%
體積(24小時): $82.6304B 15.78%
  • 市值: $2.1169T -2.34%
  • 體積(24小時): $82.6304B 15.78%
  • 恐懼與貪婪指數:
  • 市值: $2.1169T -2.34%
加密
主題
加密植物
資訊
加密術
影片
頭號新聞
加密
主題
加密植物
資訊
加密術
影片
bitcoin
bitcoin

$61605.656648 USD

-3.04%

ethereum
ethereum

$1741.712974 USD

-3.34%

tether
tether

$0.999452 USD

0.06%

bnb
bnb

$569.840001 USD

-3.10%

usd-coin
usd-coin

$1.000291 USD

0.05%

xrp
xrp

$0.962638 USD

-1.69%

solana
solana

$72.392737 USD

-3.10%

tron
tron

$0.309467 USD

-1.00%

hyperliquid
hyperliquid

$65.780663 USD

-3.44%

zcash
zcash

$850.819478 USD

-9.16%

monero
monero

$479.362672 USD

-4.57%

dogecoin
dogecoin

$0.057347 USD

-3.31%

unus-sed-leo
unus-sed-leo

$9.228306 USD

-1.21%

chainlink
chainlink

$8.839656 USD

-3.37%

cardano
cardano

$0.149404 USD

-2.68%

加密貨幣新聞文章

DigitalOcean、AMD 和 Character.ai 將 AI 推理性能提升一倍,重新定義雲 AI

2026/01/13 23:32

DigitalOcean、AMD 和 Character.ai 攜手實現了 AI 推理吞吐量的 2 倍顯著提升,大幅降低了成本,並為大規模、低延遲的 AI 應用樹立了新標準。

DigitalOcean、AMD 和 Character.ai 將 AI 推理性能提升一倍,重新定義雲 AI

A Quantum Leap in AI Efficiency

人工智能效率的巨大飛躍

In a landscape where AI innovation is moving at warp speed, the efficiency of inference—the process by which AI models make predictions—is paramount. DigitalOcean, a leading cloud provider, has teamed up with semiconductor giant AMD and AI entertainment platform Character.ai to deliver a significant breakthrough. Their joint effort has resulted in a staggering twofold increase in production inference throughput for Character.ai’s applications, all while substantially reducing operational costs.

在人工智能創新飛速發展的背景下,推理效率(人工智能模型進行預測的過程)至關重要。領先的雲提供商 DigitalOcean 與半導體巨頭 AMD 和人工智能娛樂平台 Character.ai 合作,實現了重大突破。他們的共同努力使 Character.ai 應用程序的生產推理吞吐量實現了驚人的兩倍增長,同時大幅降低了運營成本。

Character.ai, serving approximately 20 million users globally, faced the quintessential challenge of scaling AI with demanding low-latency requirements. Their quest for optimized GPU performance and cost efficiency led them to DigitalOcean and AMD. What ensued was a deep, multi-team technical collaboration that harnessed the raw power of AMD Instinct™ MI300X and MI325X GPU platforms hosted on DigitalOcean's robust infrastructure.

Character.ai 為全球約 2000 萬用戶提供服務,面臨著擴展 AI 並滿足低延遲要求的典型挑戰。他們對優化 GPU 性能和成本效率的追求促使他們選擇了 DigitalOcean 和 AMD。隨之而來的是深入的多團隊技術合作,利用了在 DigitalOcean 強大的基礎設施上託管的 AMD Instinct™ MI300X 和 MI325X GPU 平台的原始能力。

The Art of Optimization: A Technical Deep Dive

優化的藝術:技術深入探討

Achieving this 2x performance gain wasn't merely a matter of throwing more hardware at the problem. It was a testament to sophisticated engineering and a meticulous approach to software-hardware co-design. The teams focused on platform-level optimizations, including:

實現 2 倍的性能提升並不僅僅是投入更多硬件來解決問題。它證明了複雜的工程和細緻的軟硬件協同設計方法。這些團隊專注於平台級優化,包括:

  • Clever parallelization strategies tailored for large Mixture-of-Experts (MoE) models, a technique critical for handling complex AI architectures.
  • The implementation of efficient FP8 execution paths, leveraging AMD Instinct GPUs’ native support for this precision to reduce VRAM usage by approximately 50% and enhance throughput.
  • The integration of optimized kernels through AITER (AI Tensor Engine for ROCm), AMD's high-performance AI operator library, ensuring peak hardware efficiency.
  • Topology-aware GPU allocation and production-ready Kubernetes orchestration via DigitalOcean Kubernetes (DOKS), simplifying deployment and management of intensive GPU workloads.

Specifically, the optimization of the Qwen3-235B Instruct FP8 model saw a transition from generic, non-optimized setups to advanced vLLM recipes like DP2 / TP4 / EP4 configurations. This nuanced approach, balancing distributed serving, tensor parallelism, and expert parallelism, proved to be about 91% more efficient in throughput compared to prior, less optimized deployments, directly translating to a substantial reduction in cost-per-token.

具體來說,Qwen3-235B Instruct FP8 模型的優化實現了從通用、非優化設置到高級 vLLM 配方(如 DP2 / TP4 / EP4 配置)的轉變。這種微妙的方法平衡了分佈式服務、張量並行性和專家並行性,事實證明,與之前優化程度較低的部署相比,吞吐量效率提高了約 91%,這直接導致了每個代幣成本的大幅降低。

Beyond Benchmarks: The New AI Systems Paradigm

超越基準:新的人工智能係統範式

This collaboration underscores a crucial evolution in AI infrastructure. The findings highlight a "New AI Systems Paradigm" where success hinges on several foundational shifts:

此次合作凸顯了人工智能基礎設施的重要演變。研究結果強調了“新人工智能係統範式”,其中成功取決於幾個基本轉變:

  • Multi-Dimensional Optimization: Performance now demands a delicate balance across cost, latency, throughput, and concurrency, with strategic architectural choices driving down expenses while boosting capabilities.
  • Hardware-Software Co-Design: Peak efficiency isn't accidental. It requires a precise alignment between low-level system architecture—GPU interconnects, memory bandwidth, FLOPs utilization—and the AI model serving stack. The detailed work on vLLM configurations and AITER is a prime example of this synergy.
  • Infrastructure Reinvention: Deploying large-scale models in data centers is a distinct challenge from traditional web services. It necessitates a "full-stack" re-evaluation of deployment strategies, from managed Kubernetes (like DOKS, which now offers pre-baked GPU drivers and device plugins) to smart caching solutions for massive model weights.

For Character.ai, this optimized infrastructure means predictable scaling without increased operational burden, a factor so compelling it led to a multi-year, eight-figure annual agreement with DigitalOcean for GPU services. It's a win-win, proving that cutting-edge AI doesn't have to break the bank or strain engineering teams.

對於 Character.ai 來說,這種優化的基礎設施意味著可預測的擴展,而不會增加運營負擔,這一因素非常引人注目,以至於與 DigitalOcean 就 GPU 服務達成了為期多年、八位數的年度協議。這是雙贏的結果,證明尖端人工智能不必傾家蕩產或給工程團隊帶來壓力。

The Future Looks Bright (and Fast)

未來看起來光明(而且快速)

As DigitalOcean continues to build out its inference cloud, partnerships like these with industry titans AMD and innovative platforms like Character.ai are charting a course for the future of AI. The message is clear: deep technical collaboration, meticulous optimization, and a holistic view of the AI stack can unlock extraordinary performance. It seems the digital ocean is getting both deeper and a good deal faster, making complex AI tasks feel as breezy as a walk through Central Park. We're all for it.

隨著 DigitalOcean 繼續構建其推理雲,與行業巨頭 AMD 和 Character.ai 等創新平台的合作正在為人工智能的未來製定路線。傳達的信息很明確:深入的技術協作、細緻的優化以及人工智能堆棧的整體視圖可以釋放非凡的性能。數字海洋似乎變得越來越深,速度也越來越快,使得複雜的人工智能任務感覺就像在中央公園散步一樣輕鬆。我們都支持它。

原始來源:character

免責聲明:info@kdj.com

所提供的資訊並非交易建議。 kDJ.com對任何基於本文提供的資訊進行的投資不承擔任何責任。加密貨幣波動性較大,建議您充分研究後謹慎投資!

如果您認為本網站使用的內容侵犯了您的版權,請立即聯絡我們(info@kdj.com),我們將及時刪除。

2026年11月20日 其他文章發表於