GIGABYTE GPU Platform Solutions - SIE

48
GIGABYTE GPU Platform Solutions Jonathan Lo

Transcript of GIGABYTE GPU Platform Solutions - SIE

GIGABYTE GPU Platform Solutions

Jonathan Lo

NCBU Milestone

Future1998

2000

Commenced

operations

2001

Won ODM contract for

Hitachi’s Xeon DP

server line-up

Design-in supplier to

Google’s greenfield DC2002

2006

Awarded Gold in

Taiwan Excellence

Awards 2006

Merged with MCE BU

Closer co-operation

with Microsoft2007

Merge d with PC-ODM BU,

leading to volume

production & price control

economies of scale2008

Established a separate portal

at b2b.gigabyte.com2011

Released the first 2U

HPC server supporting

8 computing cards2012

Announced world wide first

ARM64 server MB with Applied

Micro ARM64 and new server

family based on Cavium’s

ARM-based SoCs2013

Enlisted as an industrial member

of the OCP and Openstack Taiwan2014

Released Cavium

ThunderX server to

market

Became an OpenPOWER

Foundation member2016

Released AMD EPYC

server to market.2017

2018

Released Qualcomm

Centriq2400 server to

market (Plan)

GIGABYTE Manufactures

From AI, Machine Learning to Deep Learning

Deep Learning

Deep Learning

GPU-Accelerated Applications in HPC

Petroleum FinanceIndustrial

ManufacturingLife

SciencesDigitalMedia

Public Government

Seismic Processing

Oil Simulation

Insurance Analysis

Investment Analysis

Statistics Analysis

Mechatronic Engineering

Process Simulation

FEA

DNA & ProteinAnalysis

Genetic Engineering

Medical Image

Bandwidth Simulation

DMR

Online Game

Simulations of Stars

Environment Science

Weather Forecast

GIGABYTE High Performance including…

X86 / AMD / ARM Servers

OEM Interconnects

Storages

Cabling

Integration, Configuration and Testing

Delivery, On-sit setup and support

Servers

Storages

Operating Systems

Service

GIGABYTE Server System

Affordable and

expandable

server

rackmounts,

offering ease-of-

use, low power

consumption

and quiet

operation

R-Series

Compact and

scalable systems

providing higher

density

computing

power in a

smaller footprint

for cloud, and

large scale-out

computing

applications

H-Series

Design-

optimized

storage server

providing higher

data density for

cold storage

S-Series

Versatile and

scalable high

performance

computing with

leading

efficiency and

performance.

Ideal for

datacenters

G-Series

A datacenter

solution simple in

design, but also

highly efficient in

power

consumption,

computing power

and configuration

RACKLUTION

Product Portfolio

INTEL SOLUTION

Intel Purley Evolution

Grantley/ Broadwell Purley/ Skylake

CPU:E5-2600 v4 (Socket R3) 14 nm TickUp to 22 CoresTDP Up to 160W

CPU:Xeon Platinum / Gold / Silver / Bronze (Socket P) 14 nm TockUp to 28 Cores TDP Up to 205W

PCH: WellsburgUp to 10 x SATAIII (6Gb/s) Up to 6 x USB3.0 & 8 x USB2.0

PCH: Lewisburg (7 SKU)Up to 14 x SATAIII (6Gb/s) Up to 10 x USB3.0

Memory: DDR44 channels Up to 3 RDIMMs or 3LRDIMMs per channelSpeed up to 2400 MT/s

Memory: DDR4 / Apache Pass6 channels Up to 2 RDIMMs or 2 LRDIMMs per channelSpeed up to 2666 MT/s

PCIe Lane: 40 (PCIe3.0 at 8GT/s) PCIe Lane: 48 (PCIe3.0 at 8GT/s)

LAN: I210 (1G), I350 (1G), X540 (10G)82599 (10G SFP+), XL710 (40G QSFP+)

LAN: I210 (1G), I350 (1G), X550 (10G)82599 (10G SFP+), XL710 (40G QSFP+)

Intel Rackmount Series

Server System Product Line

Grantley 1USystem

R130-134 (MD60)E5-2600 v3/v4, DP

16 DIMM, S-PSU2x1G (i350)

R160-S34 (MD50)E5-2600 v3/v4, DP

8 DIMM, S-PSU4x1G (i210)

R180-F34E5-2600 v3/v4, DP

24 DIMM, R-PSU2x1G (i350)

R180-F28 / F2AE5-2600 v3/v4, DP

24 DIMM, R-PSU2x1G (i350)

R260-R3C (MD50)E5-2600 v3/v4, DP

8 DIMM, R-PSU4x1G (i210)

R270-R3C (MD70)E5-2600 v3/v4, DP

16 DIMM, R-PSU2x10G (X540)

R280-A3C / F3CE5-2600 v3/v4, DP

24 DIMM, R-PSU2x1G (i350)

R280-F2OE5-2600 v3/v4, DP

24 DIMM, R-PSU2x1G (i350)

NVMe NVMe

NVMe

Grantley 2USystem

Server System Product Line

Purley 2USystem

Purley 1USystem R181-N20/ NA0

Scalable Processor, DP24 DIMM, R-PSU

2x1G (i350)2xU.2/ 10xU.2

R181-340/ 2A0Scalable Processor, DP

24 DIMM, R-PSU2x1G (i350)

NVMe

R281-N40/ NO0Scalable Processor, DP

24 DIMM, R-PSU2x1G (i350)

4xU.2/ 24xU.2

R281-3C0/ 2O0Scalable Processor, DP

24 DIMM, R-PSU2x1G (i350)

NVMe

R281-G30Scalable Processor, DP

24 DIMM, R-PSU2x1G (i350)

3xGPU

R181-NA0 1U Flagship All-Flash Server

R281-NO0 2U Flagship All-Flash Server

W281-G40 Workstation

Intel GPGPU Series

GPU Server System Product Line

Grantley GPUSystem

Grantley GPUSystem G150-B10 (MB10)

Broadwell-DE 15414 DIMM, S-PSU

2x1G (i210)2x10G SFP+ (X552)

G211-H4GE3-1200 v5/v6, 2 DIMM, R-PSU

2x1G (i210)

G190-H44E5-2600 v3/v4, DP

24 DIMM, R-PSU2x1G (i350)

G250 SeriesE5-2600 v3/v4, DP

24 DIMM, R-PSU2x1G/ 10G

NVMe

G180-G00E5-1600/ 2600 v3/v4,

2 DIMM, R-PSU2x1G (i210)

R280-G2OE5-2600 v3/v4,

24 DIMM, R-PSU2x1G (i350)

G450-G2OE5-2600 v3/v4, 4 DIMM, R-PSU

2x1G (i210)

G190-H44 1U with 4 GPU Cards2 x 2000W redundant PSUs

80 PLUS Platinum

2 x Full-Height Low-Profile Slots1 x PCIe x8 in x16 Slot1 x PCIe x8 in x8 Slot

2 x 2.5” Hot-Swappable BaysSATA III 6Gb/s 8 x Double Slots GPU Cards

G250 Series 2U Highest GPU Density

G211-H4G 2U with 4 GPU Cards

MB: MX11E3-1200 v5/ v62 x DDR4 UDIMM2 x 1G LAN (i210)

1 x GPGPUTDP up to 225W

2 x 1600W Platinum

4 x 2.5” SATA HDD4 x 40mm FAN

GPU Server System Product Line

Purley GPUSystem

Purley GPUSystem

G291 SeriesScalable, DP

24 DIMM, R-PSU2x10G (x550)

NVMe

G481-HA0Scalable, DP

24 DIMM, R-PSU2x10G (x550)

NVMe

R281-G30Scalable, DP

24 DIMM, R-PSU2x1G (i350)

H231-H60/ G20Scalable, DP

16 DIMM, R-PSU2x10G (x550)/ None

NVMe

R281-3G0 with 3 GPU Support

G291-280 2U Highest GPU Density

G291-280 New Feature

G481-HA0 4U Up To 10 GPGPU

12 x 3.5” Hot-swap SAS/ SATA HDD

10 x 2.5” Hot-swap HDDSKU1: 10 x U.2SKU2: 8 x U.2 + 2 x SAS/ SATA

6 x 1200mm Redundant Hot-swap FAN

Up to 10 x GPGPU CardsSKU1: 10 x GPGPUSKU2: 8 x GPGPU + 1 x PCIe LP Slot +

2 x 10G Ports (X550)

2+1 x 2200W PlatiumOption to 2600W/ 3000W in MP

2 x 1G (i350)

Intel Omni-Path Option

G481-HA0 Rear View

5 x PCIe x16 Slot 5 x PCIe x16 Slot

4 x GPGPU

1 x GPGPU or Network I/O 1 x GPGPU or Network I/O

4 x GPGPU

PCIe x16 LP Slot

2+1 x 2200W PlatiumOption to 2600W/

3000W in MP

MLAN

2 x 10G Base-T (x550)

NVLink SXM2

Why NVLink

Bandwidth

Intel QPI (Grantley) 76.8 GB/ s

Intel UPI (Purley) 124.8 GB/s

PCIe 3.0 x16 32 GB/s

PCIe 4.0 x16 (Power 9) 192 GB/s

NVLink 1.0 (P100) 160 GB/s

NVLink 2.0 (V100) 300 GB/s

GPU Server System Product Line

Purley GPUSystemSXM2

Grantley GPUSystemSXM2 G190-G30

E5-2600 v3/v4, DP16 DIMM, R-PSU

2x1G (i350)

G481-S80Scalable, DP

16 DIMM, R-PSU2x1G (i350)

G190-G30 1U with 4 SXM2 GPU Support

G481-S80 4U with 8 SXM2 GPU

10 x 2.5” Hot-swap HDD2 x SATA + 6 x SATA/ U.2 + 2 x U.2

6 x 60mm Redundant Hot-swap Rotor FAN

3 + 1 x 2200W Platinum PSU

2 x Omni-Path Connector

2 x 1G (i350)

1 x PCIe x8 Slot

G481-S80 Rear View

4 x PCIe x16 MD2 Slot

3 + 1 x 2200W Platinum PSU

1 x OCP Slot

Intel High Density Series

Server System Product Line

Purley High

Density System

Grantly High Density System

NVMeNVMe

H23N-H60 / R4OE5-2600 v3/v4, DP,

8 DIMM, R-PSU2x1G, Rear Access

H270-H70 / F4GE5-2600 v3/v4, DP

16 DIMM, R-PSU2x1G (H70)

1xQSFP+ (F4G)

H230-R4C / R4GE5-2600 v3/v4, DP,

8 DIMM, R-PSU2x1G, Rear Access

H27N-R4GE5-2600 v3/v4, DP

16 DIMM, R-PSU2x1G, Front Access

NVMe NVMe NVMe

H281-PE0Scalable Processor, DP

24 DIMM, R-PSU,2x10G, Front Access

H261-3C0 / N80Scalable Processor, DP

16 DIMM, R-PSU,2x10G, Rear Access

H231-G20Scalable Processor, DP

16 DIMM, R-PSU,2x10G, Rear Access

GIGABYTE Features: Dense Add-On Slot Design

GIGABYTE delivers best-in-class comprehensive add-on slot options:

Onboard server management SoC for:

Remote ManagementRemote ImagingRemote DiagnosticsIP based KVM control

GIGABYTE Features: Multi-Node Management

Multi-Node Control (Simultaneous)CMC (Central Management Control) Function for Easy Node Management and Less ToR (Top of Rack)Cabling

Aspeed CMC (with LAN connector ) connects with Aspeed BMC on each node

Reduces cabling to only 2 ports connection – allowing cost down of switch node (ToR). Daisy Chain will not be broken even if one 2U, 4 Node rack system shuts down.

GIGABYTE Features: Less ToR Cabling

H231/H261

Top of Rack Switch

H231/H261

..Other 2U4N Servers

H231/H261

H231/H261

Token Ring (Support iKVM)

H230/N

ToR

H230/N

H230/N H230/N

H231-G20 2U2N High Density GPU Server

24 x 2.5" Hot-swap HDD (12 x HDD per Node)(Default 10 x SATA3 and 2 x U.2 per Node)

8 x 8038 Fan

2 Node Rear-accesswith MH61-HD3

Redundant 2200W 80+ Platinum

2 Trays for GPGPU Card

12Gb/s Expander for 10 port (Per node)

H281-PE0 2U4N FA High Density Server

H281-PE0 Front Access Server Node

AMD EPYC PLATFORM

AMD EPYC vs Purley

Purley/ Skylake EPYC/ NaplesCPU: Xeon Socket P, 14 nmUp to 28 Cores TDP Up to 205W

CPU: Naples, 14nmUp to 16-32 Zen Cores TDP Up to 120-180WSoC (Socket Type)

Memory: DDR4 / Apache Pass6 channels Up to 2 RDIMMs or 2 LRDIMMs per channelSpeed up to 2666 MT/s

Memory: DDR4 with ECC8 channels Up to 2 RDIMMs, LRDIMMs per channelSpeed up to 2666 MT/s

PCIe Lane: 48 (PCIe3.0 at 8GT/s) PCIe Lane: Max 128 (PCIe3.0 at 8GT/s)

LAN: I210 (1G), I350 (1G), X550 (10G)82599 (10G SFP+), XL710 (40G QSFP+)

LAN: Not integrated in SoC

PCH: WellsburgUp to 10 x SATAIII (6Gb/s)

Storage: Max 32 x SATAIII (6Gb/s) (These function are in lieu of PCIe on those ports)

GIGABYTE EPYC System Solution

Server System Product Line

EPYC DPSystem

EPYC UPSystem

R151-Z30 (MZ31)Naples, UP

16 DIMM, R-PSU2 x 10G SFP+

R181-Z90Naples, DP

32 DIMM, R-PSU2 x 10G (i350)

R271-Z31 (MZ31)Naples, UP

16 DIMM, R-PSU2 x 10G SFP+

R281-Z91/ Z92Naples, DP

32 DIMM, R-PSU2 x 1G (i350)

(Z92) 24 x U.2

G221-Z30 (MZ31)Naples, UP

16 DIMM, R-PSU2 x 10G SFP+

G291-Z20 (MZ21)Naples, UP

8 DIMM, R-PSU2 x 1G (i350)

GIGABYTE HPC SolutionsBest Efficiency For Broad Application Scaling HPC

Hyperscale HPC Deep Learning, Supercomputer