随着 Gradient 和 Crusoe 将 Llama-3 的“上下文窗口”扩展到 100 万个代币，开源长上下文 LLM 的竞争愈演愈烈

在最近的一次合作中，人工智能初创公司 Gradient 和云计算平台 Crusoe 将 Llama-3 模型的“上下文窗口”扩展到 100 万个代币。上下文窗口决定大型语言模型 (LLM) 可以处理的输入和输出标记的数量。

VentureBeat Transform 2024 will feature leaders from OpenAI, Chevron, Nvidia, Kaiser Permanente, and Capital One. This three-day event will provide attendees with the opportunity to gain essential insights about GenAI and expand their network.

VentureBeat Transform 2024 将邀请来自 OpenAI、Chevron、Nvidia、Kaiser Permanente 和 Capital One 的领导者参加。这次为期三天的活动将为与会者提供获得有关 GenAI 的重要见解并扩展他们的网络的机会。

In a recent collaboration, Gradient and Crusoe extended the context window of Llama-3 models to 1 million tokens. The context window determines the number of input and output tokens a large language model (LLM) can process.

在最近的一次合作中，Gradient 和 Crusoe 将 Llama-3 模型的上下文窗口扩展到 100 万个令牌。上下文窗口决定大型语言模型 (LLM) 可以处理的输入和输出标记的数量。

Big tech companies and frontier AI labs are competing to extend the context windows of their LLMs. In a few months, models have gone from supporting a few thousand tokens to more than a million in less than a year. However, LLMs with very long context windows are mostly limited to private models such as Anthropic Claude (200k tokens), OpenAI GPT-4 (128k tokens), and Google Gemini (1 million tokens).

大型科技公司和前沿人工智能实验室正在竞相扩展其法学硕士的背景窗口。在几个月的时间里，模型在不到一年的时间内就从支持几千个代币增加到超过一百万个。然而，具有很长上下文窗口的法学硕士大多局限于私有模型，例如 Anthropic Claude（200k 代币）、OpenAI GPT-4（128k 代币）和 Google Gemini（100 万代币）。

The race to create open-source models with long context windows could reshuffle the LLM market and unlock applications that are not possible with private models.

创建具有长上下文窗口的开源模型的竞赛可能会重新洗牌 LLM 市场，并解锁私有模型无法实现的应用程序。

Gradient works with enterprise customers who want to integrate LLMs into their workflows. Even before Llama-3 came out, the company was facing context pain points in projects they were working on for their customers.

Gradient 与希望将 LLM 集成到其工作流程中的企业客户合作。甚至在 Llama-3 推出之前，该公司就在为客户开发的项目中面临着环境痛点。