Empirical Upper Bounds for Unstructured Sparsity in Compute-Efficient Language Modeling

Large language models have driven significant progress in…


Self-Data Distillation for Recovering Quality in Pruned Large Language Models

Large language models have driven significant progress in…


Bilingual Adaptation of Monolingual Foundation Models

We present an efficient method for adapting a monolingual…


Bilingual Adaptation of Monolingual Foundation Models

We present an efficient method for adapting a monolingual…


Efficient Algorithms for Monte Carlo Particle Transport on AI Accelerator Hardware

The recent trend toward deep learning has led to the…


Position Interpolation Improves ALiBi Extrapolation

Linear position interpolation helps pre-trained models…


BTLM-3B-8K: 7B Parameter Performance in a 3B Parameter Model

We introduce the Bittensor Language Model, called…


GenSLMs: Genome-scale language models reveal SARS-CoV-2 evolutionary dynamics

Our work seeks to transform how new and emergent variants…


Meet the nominees for the 2022 VentureBeat Women in AI Awards!

Two Cerebras Systems engineers are finalists for…


Age Checks, Theft Prevention, Minecraft AI, Autism, Responsible AI

Discussion of last week's big AI news -- including Cerebras…


Cerebras trains 20 billion parameter AI model on a single system, sets new record

US semiconductor startup Cerebras claims that it has…


Training a 20–Billion Parameter AI Model on a Single Processor

Cerebras has shown off the capabilities of its…


Cerebras breaks record for largest AI models trained on a single device

Cerebras said it can reduce the engineering time to run…


Why The Cerebras CS-2 Machine is a Big Deal

In my first video talking about AI Hardware on this…


Cerebras Systems Thinks Forward on AI Chips as it Claims Performance Win

Cerebras Systems makes the largest chip in the world, but…


Cerebras Systems sets record for largest AI models ever trained on one device

Cerebras Systems said it has set the record for the largest…


Cerebras just built a big chip that could democratize AI

Chip startup Cerebras has developed a foot-wide piece of…


#77 – VITALIY CHILEY (Cerebras)

Cerebras engineer Vitaliy Chiley joins Machine Learning…


Eine neue Maschine für KI und HPC

Die Anforderungen an die Hardware steigen in KI und beim…


NCSA Deploys Cerebras CS-2 in New HOLL-I Supercomputer for Large-Scale AI

Cerebras Systems, the pioneer in high performance…


Leading Supercomputer Sites Choose Cerebras for AI Acceleration

Cerebras Systems, the pioneer in high performance…


LRZ Adds Mega AI System as It Stacks up on Future Computing Systems

A European supercomputing hub near Munich, called the…


HPE, Cerebras build AI supercomputer for scientific research

Wafer madness hits the LRZ in HPE Superdome supercomputer…


HPE is building a rapid AI supercomputer powered by the world’s largest CPU

Hewlett Packard Enterprise (HPE) has announced it is…


Bio-IT World Judges, Community Honor Six Outstanding New Products

The Cerebras CS-2 system was awarded a Best of Show award…


Argonne Talks AI Accelerators for COVID Research

As the pandemic swept across the world, virtually every…


Accelerating insights in large scale AI projects

Leading research institutes are choosing HPE Superdome Flex…


Cerebras, TotalEnergies Announce Stencil Algorithm Leap

Cerebras—in collaboration with French multinational…


The World’s Largest Chip Just Received A Major Machine Learning-Flavored Upgrade

Cerebras Systems, makers of the world’s largest chip, has…


A Big Chip for Big Science: Watching the COVID-19 Virus in Action

It’s hard to imagine a better example of “AI for good” than…