Habana Labs and AWS Provide Alternative to GPU in Machine-Learning Training Workloads

Subscribe To Read This Insight

By Lian Jye Su | 4Q 2021 | IN-6347


Habana Labs' Gaudi Now Available on AWS


In October 2021, AWS announced the availability of Amazon EC2 DL1 instances or virtual server services powered by Gaudi accelerators from Habana Labs. Founded in 2016 and acquired by Intel in 2019 for US$2 billion, Israel-based Habana Labs designs programmable Machine-Learning (ML) accelerators for model inference and training in the data center and cloud. Intended for ML training, Amazon’s EC2 DL1 instances feature eight Gaudi accelerators with 32 Gigabytes (GB) of High Bandwidth Memory (HBM) per accelerator, 768 gibibytes of system memory, 400 Gigabits per second (Gbps) of networking throughput, and four terabytes of local nonvolatile memory express storage.

In terms of software, developers can develop their ML models on Habana’s Synapse AI Software Development Kit (SDK). The SDK features a graph compiler and run time, kernel library, firmware, drivers, and tools. Most importantly, the Synapse AI SDK is integrated with TensorFlow and PyTorch, the leading ML frameworks, ensuring migration from existing Graphics Processing Unit (GPU)–services with minima…

You must be a subscriber to view this ABI Insight.
To find out more about subscribing contact a representative about purchasing options.