NVIDIA® GPUs

Powered by NVIDIA Turing Tensor Cores, T4 provides multi-precision inference performance to accelerate the diverse applications of modern AI. T4 supports all AI frameworks and provides comprehensive tooling and integrations to the deployment of advanced AI.

Based on the Ada Lovelace GPU architecture, the L40 features third-generation RT Cores that enhance real-time ray tracing capabilities, and fourth-generation Tensor Cores with support for the FP8 data format to deliver over a petaflop of inferencing performance.

NVIDIA H100 Tensor Core GPU accelerates exascale scale workloads with a dedicated Transformer Engine for trillion parameter language models. For small jobs, H100 can be partitioned down to right-sized Multi-Instance GPU (MIG) partitions. The NVIDIA™ Hopper architecture with the Transformer Engine, accelerates in an order of magnitude speedup over the prior generation.

The A30X combines the NVIDIA A30 Tensor Core GPU with the BlueField-2 DPU. Deliver maximum performance and enhanced security for I/O intensive GPU accelerated workloads, from the data center to the edge.

The NVIDIA A2 Tensor Core GPU provides entry-level inference with low power (40-60 watt), a small footprint (low profile PCIe Gen4), and high performance for intelligent video analytics (IVA) or NVIDIA® AI at the edge. Servers accelerated with A2 GPUs deliver up to 20X higher inference performance versus CPUs and 1.3x more efficient IVA deployments — all at an entry-level price point.

Built on the latest NVIDIA Ampere architecture, the NVIDIA A10 Tensor Core GPU combines second-generation RT Cores, third-generation Tensor Cores, and new streaming microprocessors with 24 gigabytes (GB) of GDDR6 memory – all in a 150W power envelope – for versatile graphics, rendering, AI, and compute performance.

The NVIDIA L40S GPU, based on the Ada Lovelace architecture, is the most powerful universal GPU for the data center, delivering breakthrough multi-workload acceleration for large language model (LLM) inference and training, graphics, and video applications. As the premier platform for multi-modal generative AI, the L40S GPU provides end-to-end acceleration for inference, training, graphics, and video workflows to power the next generation of AI-enabled audio, speech, 2D, video, and 3D applications.

L4 is optimized for video and inference at scale for a broad range of AI applications, including recommendations, voice-based AI avatar assistants, generative AI, visual search, and contact center automation. Servers equipped with L4 enable up to 120X higher AI Video performance over CPU solutions, while providing 2.7X more generative AI performance, and over 4X more graphics performance versus the previous generation.

Built on the NVIDIA Ampere architecture, the A40 combines the latest generation RT Cores, Tensor Cores, and CUDA Cores with 48GB of graphics memory for unprecedented graphics in advanced technologies such as real-time ray tracing, AI, compute, simulation, and VR are common across industries.

With NVIDIA Ampere architecture Tensor Cores and Multi-Instance GPU (MIG), NVIDIA A30 delivers speedups securely across diverse workloads, including AI inference and training at scale and high-performance computing (HPC) applications.

Take remote work to the next level with NVIDIA A16, the ideal GPU for high-density, graphics rich VDI. NVIDIA A16 has 4x the encoder throughput versus NVIDIA T4 to provide the best user experience on a single board. Based on the latest NVIDIA Ampere architecture, A16 is purpose-built to achieve the highest user density, with up to 64 concurrent users per board in a dual slot form factor.