Cerebras
Inference
The world’s fastest inference -
70x faster than GPU clouds,
128K context, 16-bit precision.
Cerebras Sets a New Record in
Molecular
Dynamics
Cerebras CS-2 achieves 1 million simulation steps/s –
700x faster than the world’s #1 supercomputer
Cerebras Delivers Record-Breaking Performance with Meta's Llama 3.1-405B Model
Cerebras Systems today announced that it has set a new performance record for Llama 3.1-405B – a leading frontier model released by Meta AI. Cerebras Inference generated 969 output tokens per second. Data from third party benchmark firm Artificial Analysis shows Cerebras up to 75 times faster than GPU based offerings from hyperscalers. Cerebras Inference is running multiple customer workloads on Llama’s 405B model at 128K full context length and 16-bit precision.
Cerebras Sets New World Record in Molecular Dynamics at 1.1 Million Simulations per Second — 748X Faster than the World’s #1 Supercomputer ‘Frontier’
Cerebras Systems, the pioneer in accelerating generative AI, in collaboration with researchers from Sandia, Lawrence Livermore, and Los Alamos National Laboratories, have set another world record and important breakthrough in molecular dynamics (MD) simulations. For the first time in the history of the field, researchers achieved more than 1 million simulation steps per second. A single Cerebras Wafer Scale Engine achieved over 1.1 million steps per second, which is 748x faster than what is possible on the world’s leading supercomputer ‘Frontier’.
Cerebras Delivers Record-Breaking Performance with Meta's Llama 3.1-405B Model
Llama 3.1 405B now runs at 969 tokens/s on Cerebras Inference: Frontier AI now runs at instant speed. Last week we ran a customer workload on Llama 3.1 405B at 969 tokens/s – a new record for Meta’s frontier model. Llama 3.1 405B on Cerebras is by far the fastest frontier model in the world – 12x faster than GPT-4o and 18x faster than Claude 3.5 Sonnet. In addition, we achieved the highest performance at 128K context length and shortest time-to-first-token latency, as measured by Artificial Analysis.
Award Winning Technology
Cerebras continues to be recognized for pushing the boundaries of AI
TIME
TIME
FORBES
FORTUNE
ai model services
You bring the data, we'll train the model
Whether you want to build a multi-lingual chatbot or predict DNA sequences, our team of AI scientists and engineers will work with you and your data to build state-of-the-art models leveraging the latest AI techniques.
high performance computing
The fastest HPC
accelerator on earth
With 900,000 cores and 44 GB of on-chip memory, the CS-3 completely redefines the performance envelope of HPC systems. From Monte Carlo Particle Transport to Seismic Processing, the CS-3 routinely outperforms entire supercomputing installations.
Models on Cerebras
The Cerebras platform has trained a huge assortment of models from multi-lingual LLMs to healthcare chatbots. We help customers train their own foundation models or fine-tune open source models like Llama 2. Best of all, the majority of our work is open source.
Latest Blog Posts
“Mayo Clinic selected Cerebras as its first generative AI collaborator for its large-scale, domain-specific AI expertise to accelerate breakthrough insights for the benefit of patients.”
Matthew Callstrom, MD, PhD
Medical Director for Strategy, Chair - Department of Radiology
"The Cerebras CS-2 is a critical component that allows GSK to train language models using biological datasets at a scale and size previously unattainable. These foundational models form the basis of many of our AI systems and play a vital role in the discovery of transformational medicines."
Kim Branson
SVP Global Head of AI and ML, GlaxoSmithKline
"Training which historically took over 2 weeks to run on a large cluster of GPUs was accomplished in just over 2 days — 52hrs to be exact — on a single CS-1. This could allow us to iterate more frequently and get much more accurate answers, orders of magnitude faster."
Nick Brown
Head of AI & Data Science, AstraZeneca
"Working with the Cerebras ML team we were able to train a new state-of-the-art large language model that outperforms models twice its size in a matter of weeks. Their AI expertise is second to none."
OpenTensor
The OpenTensor Foundation
"Cerebras allowed us to reduce the experiment turnaround time on our cancer prediction models by 300x, ultimately enabling us to explore questions that previously would have taken years, in mere months."
