GTC FALL 2020 FINANCIAL ANALYST EVENT
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
GTC FALL 2020 FINANCIAL ANALYST EVENT
Forward Looking Statements Except for the historical information contained herein, certain matters in this presentation including, but not limited to, statements as to: our expanding ecosystem and the estimated number of AI and autonomous systems developers adopting NVIDIA AI; artificial intelligence as the most powerful technology force of our time; data center workload growing exponentially; our strategies, growth, position, opportunities, and continued expansion; the performance and benefits of our products and technologies, including the NVIDIA Bluefield-2 DPU, NVIDIA DOCA, the EGX Edge AI platform, NVIDIA Clara Discovery, and the Cambridge-1 AI supercomputer; the NVIDIA DPU roadmap; the impact of NVIDIA accelerated computing on VMware cloud foundation; the impact of GSK’s partnership with NVIDIA to build an AI drug discovery lab; our TAM; and other predictions and estimates are forward-looking statements within the meaning of the Private Securities Litigation Reform Act of 1995. These forward-looking statements and any other forward-looking statements that go beyond historical facts that are made in this presentation are subject to risks and uncertainties that may cause actual results to differ materially. Important factors that could cause actual results to differ materially include: global economic conditions; our reliance on third parties to manufacture, assemble, package and test our products; the impact of technological development and competition; development of new products and technologies or enhancements to our existing product and technologies; market acceptance of our products or our partners’ products; design, manufacturing or software defects; changes in consumer preferences and demands; changes in industry standards and interfaces; unexpected loss of performance of our products or technologies when integrated into systems and other factors. For a complete discussion of factors that could materially affect our financial results and operations, please refer to the reports we file from time to time with the SEC, including our Annual Reports on Form 10-K and our Quarterly Reports on Form 10-Q. Copies of reports we file with the SEC are posted on our website and are available from NVIDIA without charge. These forward-looking statements are not guarantees of future performance and speak only as of October 5, 2020, based on information currently available to us. Except as required by law, NVIDIA disclaims any obligation to update these forward- looking statements to reflect future events or circumstances. © 2020 NVIDIA Corporation. All rights reserved. NVIDIA and the NVIDIA logo are trademarks and/or registered trademarks of NVIDIA Corporation in the U.S. and/or other countries. Other company and product names may be trademarks of the respective companies with which they are associated. Features, pricing, availability, and specifications are subject to change without notice.
HERE WITH YOU TODAY
AGENDA
Computing for the Age of AI
NVIDIA AI
NVIDIA Enterprise AI Jensen Huang Colette Kress
Founder & CEO EVP & CFO
NVIDIA Edge AI
NVIDIA Healthcare
GTC Fall 2020
Paresh Kharya Manuvir Das Justin Boitano Kimberly Powell
AI Computing Enterprise Computing Edge Computing Healthcare
COMPUTING FOR THE AGE OF AI
EXPANDING NVIDIA ECOSYSTEM
AI and Autonomous Systems Developers Adopt NVIDIA AI
80 2.3M
New SDKs Developers
6M
DLSS 2.1
CUDA Downloads in 2020;
RTX DI 20M downloads to date
OptiX 7.2
AERIAL
HPC SDK 20.9 RTX HPC RAPIDS AI CLARA METRO DRIVE ISAAC
5G
1,800
RAPIDS 0.16
Parabricks 3.5
DeepStream 5.0
GPU-Accelerated Applications
NSIGHT 2020.5
cuDNN 8.03 CUDA-X
TensorRT 7.2
CUDA 11.1 CUDA
6,500
NCCL 2.7.8 AI Startups
MAGNUM IO
GPUDirect Storage
2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020
EST
NVIDIA AI
INFERENCE LEADERSHIP
Paresh Kharya
ARTIFICIAL INTELLIGENCE —
THE MOST POWERFUL TECHNOLOGY FORCE OF OUR TIME
EXPLODING MODEL COMPLEXITY
30,000X in 5 Years | Now Doubling Every 2 Months
1.E+04 GPT-3
HUMAN-LEVEL HUMAN-LIKE DRONE
1.E+03 READING COMPREHENSION CHATBOTS DELIVERIES
Megatron-BERT 24% Better than Avg Human Half of Users Preferred AI 6X Safer Landings
Megatron-GPT2 NVIDIA Megatron BERT Facebook BlenderBot Caltech Neural Lander
1.E+02 Turing NLG
Petaflop/s - Days
GPT-2
1.E+01
BERT
1.E+00
ResNet
1.E-01
AlexNet
1.E-02
FIGHTING DRUG ALL-TERRAIN
CORONAVIRUS DISCOVERY WALKING ROBOT
1.E-03 Mapping Millions of Proteins 1,000X Faster Simulations On the Fly Surface Adaptation
2012 2014 2017 2020 Technical U. of Munich NLPs Caltech OrbNet NVIDIA RL Controller
A100 TAKES OFF
Fastest GPU Ramp Ever
May ‘20 June ‘20 July ‘20 Aug ‘20 Sept ‘20
3 PILLARS OF NVIDIA AI
DATA ANAYTICS & TRAINING INFERENCE APPLICATION FRAMEWORKS
PRE-TRAINED MODELS TRITON
SOTA Models Inference Serving
Conversational AI
Computer Vision Query
Frameworks TIS
Recommendations
Result
Reinforcement Learning
TRANSFER LEARNING TOOLKIT TensorRT 7.2
Zero Coding | Speech, Vision, & NLU
Pre-Trained
Model Customized
TLT Model TRT
Data
ACCELERATING ADOPTION OF NVIDIA AI INFERENCE
Celebrating 10 Years of NVIDIA GPU in the Cloud
7TH GENERATION TensorRT ACCELERATED ADOPTION TOTAL CLOUD AI INFERENCE COMPUTE CAPACITY
(Inference Compiler) OF NVIDIA GPU (PETA OPS)
(EXA OPS)
166 1,000,000
2000+ Optimizations 100,000
TensorFlow, PyTorch, ONNX
10,000
Total Total
1.3M Downloads GPU
1,000 CPU
16,000 Companies
100
10
25 1
TRT
TRT
2NVIDIA AI INFERENCE CUSTOMERS MICROSOFT OFFICE AMERICAN EXPRESS TENCENT PCG GRAMMAR CORRECTION FRAUD PREVENTION RECOMMENDATIONS Half a Trillion Queries per Year Over $1 Trillion in Transactions | 115M Credit Cards Videos, News, Music, Apps 200ms Inference Response 2ms Latency Enables Real-Time Fraud Detection Hundreds of Billions Queries per day 1/3rd Lower Cost Than CPU Up to 6% Higher Accuracy in Specific Segments GPU Inference In Production
NVIDIA AI INFERENCE CUSTOMERS AUTO CONSUMER INTERNET CSP ROBOTICS MEDICAL RETAIL & FSI INDUSTRIAL
NVIDIA ENTERPRISE AI
DATA CENTER IS THE NEW UNIT OF COMPUTING
Manuvir DasMODERN DATA CENTERS ARE SOFTWARE-DEFINED
Moving from Fixed-Function Appliances to Software Services on Servers
Manual Infrastructure
Management
CPU
VMs Containers
Security Appliances
Infrastructure Management Software-defined Security
Software-defined Storage Software-defined Networking
Storage Systems
NVIDIA NIC
Acceleration Engines
Static NetworksDATA CENTER WORKLOAD GROWING EXPONENTIALLY
Microservices
CPU
VMs Containers
East-West Traffic
Infrastructure Management Software-defined Security
Software-defined Storage Software-defined Networking
Storage Access
NVIDIA NIC
Acceleration Engines
Zero Trust SecurityINTRODUCING THE DATA PROCESSING UNIT (DPU)
Software-defined Data Center Infrastructure-on-a-Chip
TRADITIONAL SERVER DPU-ACCELERATED SERVER
CPU CPU
VMs Containers
Infrastructure Management Software-defined Security
Software-defined Storage Software-defined Networking VMs Containers
NVIDIA NIC NVIDIA DPU with Arm Cores & Accelerators
Acceleration Engines
Infrastructure Management Software-defined Security
Software-defined Storage Software-defined Networking
Acceleration EnginesNVIDIA BLUEFIELD-2 DPU
Data Center Infrastructure-on-a-Chip
Combines 8 64-bit A72 Arm Cores,
2 VLIW Acceleration Engines, and Mellanox Out-of-Band Management
ConnectX-6 Dx NIC
Accelerated Security: Isolation,
Root of Trust, Crypto, Key Management,
Regular Expression Engine
Accelerated Networking: RDMA/RoCE,
GPU Direct, SDN/NFV
Accelerated Storage: NVMe-oF, Elastic Block
Storage, Data Integrity, De-Dup, Compression
2x 100Gb/s Ethernet
PCIe Gen 4.0
and InfiniBandINFRASTRUCTURE APPLICATIONS
Infrastructure Software-defined
Software-defined Storage Software-defined Security
Management Networking
NVIDIA DOCA
Data Center Infrastructure-on-a-Chip
Architecture DOCA
SDK for BlueField DPUs Storage Security Networking
SPDK / Kernel DPDK / Kernel P4 / DPDK / Kernel
Open APIs – DPDK, SPDK, P4 Telemetry Management
Certified Reference Apps & Third-Party Solutions SNAP ASAP2 CRYPTO RoT RDMA1000X
BlueField-4
1000 SPECINT
400 TOPS
400 Gbps
NVIDIA DPU ROADMAP 100X
Programmable Data Center BlueField-3X
BlueField-2X 350 SPECINT
Infrastructure-on-a-Chip 70 SPECINT 75 TOPS AI
60 TOPS AI 400 Gbps
200 Gbps
10X
BlueField-3
350 SPECINT
1.5 TOPS
400 Gbps
BlueField-2
70 SPECINT 1X
0.7 TOPS
200 Gbps
DOCA — One Architecture
2021 2022 2023NVIDIA ACCELERATED COMPUTING ON VMWARE CLOUD FOUNDATION Bringing AI to Every Enterprise, Enabling Next-Gen Hybrid Cloud
NVIDIA EDGE AI
A TRILLION THINGS – THE NEXT INTERNET
Justin BoitanoTHE AGE OF AI — A TRILLION CONNECTED THINGS
2M 13M 570M
Factories Stores Farms
5M 40M 10T
Call Center Miles of Road Miles Driven
Agents per Year
Edge Data Centers
Millions of Edge DC
Each with Thousands of NodesANNOUNCING
EGX EDGE AI PLATFORM
NVIDIA BlueField-2 NVIDIA Ampere Architecture GPU
8x Arm Cores
3rd generation Tensor Core
Dual 100 Gb/s Ethernet or InfiniBand
New Security Engine for Confidential AI
Line-speed TLS/IPSec Crypto Engine
Secure, Authenticated Boot
Time Triggered Transmission Tech for Telco (5T for 5G)
ASAP2 SR-IOV and VirtualIO OffloadEGX EDGE AI PLATFORM
EGX EDGE AI PLATFORM
NVIDIA CLARA
COMPUTATIONAL DRUG DISCOVERY
Kimberly PowellNVIDIA CLARA DISCOVERY
$1.25T Pharmaceutical Industry | $2B R&D Per Drug | 12 ½ Years To Market | 90% Failure Rate
SEARCH
O(1060)
Chemical Compounds
RAPIDS
O(109)
GENOMICS STRUCTURE DOCKING SIMULATION IMAGING
Biological Drug
Target O(102) Candidate
Schrodinger
Clara Parabricks CryoSPARC, Relion AutoDock Clara Imaging
NAMD, VMD, OpenMM
RAPIDS AlphaFold RAPIDS MELD MONAI
NLP
Literature Real World Data
Biomegatron, BioBERTCAMBRIDGE-1 AI SUPERCOMPUTER
80 NVIDIA DGX A100 | 400 PETAFLOPS AI COMPUTE | 20 TERABYTES/SEC INFINIBAND | 2PB NVME | 500KW
HEALTHCARE & LARGE-SCALE AI & COLLABORATION WITH UK INDUSTRY, EDUCATE FUTURE
LIFE SCIENCE RESEARCH DATA SCIENCE RESEARCH UNIVERSITIES, STARTUPS AI PRACTITIONERSGSK PARTNERS WITH NVIDIA TO BUILD AI DRUG DISCOVERY LAB
AI MOMENT IN HEALTHCARE
Accelerated Computing | Data Science & Machine Learning | Deep Learning | NLP Language Models
30X 30X BIOMEDICAL NLP
Named Entity
20X Recognition
15X Vocabulary BioMegatron
Relation Extraction
e.g. COVID 345M Param
7X 6.1B Words
6X 6X Q&A
PubMeb
Genomics Structure Screening Docking Simulation Imaging NLP Data AI Model AI Skill
16X SPEEDUP ACROSS DOMAINS | FULL STACK ACCELERATION NVIDIA BIOMEGATRON ACHIEVES STATE OF THE ART
GPU Accelerated Applications vs CPU | GPU Optimizes Training Frameworks vs Open Source Biomedical Literature | Clinical Notes | Claims Data | Digital HealthGTC Fall 2020 Colette Kress
GTC FALL 2020
NVIDIA AI GAINING MOMENTUM
20M CUDA downloads/6M in last year | Most shipped AI inference cloud compute capacity in the world
NVIDIA POWERS ENTERPRISE COMPUTING
NVIDIA AI integrated into VMware & Cloudera | NVIDIA DPUs “Data Center on a Chip Architecture"
NVIDIA EDGE AI FOR THE INTERNET OF A TRILLION THINGS
EGX Edge AI + FleetCommand recurring revenue service
NVIDIA HEALTHCARE NEAR A TIPPING POINT
NVIDIA Clara for Computational Drug Discovery | Cambridge-1 | GSK
BROADENING ECOSYSTEM & CUSTOMER ADOPTION
Every Server & Storage OEM | Hundreds of ISVs | Thousands of Enterprises | 2.3M DevelopersCOMPUTING FOR THE AGE OF AI
NVIDIA RTX NVIDIA HPC NVIDIA AI NVIDIA ENTERPRISE AI NVIDIA EDGE AI
$8B $10B $45B $30B $15B
2020 Revenue* Data Center Target Addressable Market by 2024
18% Trailing 5-year CAGR
*Trailing 4-quarters through F3Q 2021 outlook for
Gaming and Professional Visualization market platforms NVIDIA AI includes estimated Total Addressable Market for accelerated computing platforms used in Hyperscale/Cloud.
Source: NVIDIA estimates, incorporating data from Counterpoint, Dell’Oro, Gartner, IDC, IHS, Hyperion and Strategy AnalyticsQ&A Jensen Huang & Colette Kress
You can also read
