Data Center Product Information

This page shall provide detailed information about our Data Center Products.

Select the product(s) you are interested in:

ADM-PCIE-9V3ADM-PCIE-8K5ADM-PCIE-KU3ADM-PCIE-7V3

Card Form Factor

Most Data Center products are half length, low profile PCI Express Card format. The other form factor implemented is half length, full height as in the case of the ADM-PCIE-8K5-FH board.

Product Dimensions

Products

Height

Width

Depth

Weight

ADM-PCIE-9H768.9????mm174????mm17.45????mm230????g
ADM-PCIE-9V368.9mm174mm17.45mm230g
ADM-PCIE-8V368.9mm174mm17.45mm230g
ADM-PCIE-8K568.9mm173mm17.5mm200g
ADM-PCIE-8K5-FHmmmmmmg
ADM-PCIE-KU368.9mm174mm32.5mm220g
ADM-PCIE-KU3X868.9mm174mm32.5mm220g
ADM-PCIE-7V368.9mm174.5mm32.5mm120g

Note(s)

ADM-PCIE-KU3: If the board requires the fan then it needs the adjacent slot to be empty to accommodate the extra width taken up by the fan.
ADM-PCIE-KU3X8: If the board requires the fan then it needs the adjacent slot to be empty to accommodate the extra width taken up by the fan.
ADM-PCIE-7V3: If the board requires the fan then it needs the adjacent slot to be empty to accommodate the extra width taken up by the fan.

PCI Express Interfaces

All Alpha Data Data Center products are PCI Express based. Requiring either an 8 or 16 lane PCI Express slot on the systems motherboard.

Product

PCI Express Interfaces

PCI Express Modes

ADM-PCIE-9H716x Gen3,4
Gen4 x8 or Gen3 x16 (CCIX Capable)
ADM-PCIE-9V316x Gen3
Gen3 x16
ADM-PCIE-8V316x Gen3
Dual[1] Gen3 x8
ADM-PCIE-8K58x Gen3
Gen3 x8
ADM-PCIE-8K5-FH8x Gen3
Gen3 x8
ADM-PCIE-KU316x Gen3
Dual[1] Gen3 x8
ADM-PCIE-KU3X88x Gen3
Gen3 x8
ADM-PCIE-7V38x Gen3
Gen3 x8

[1] - Dual PCIE is only possible in a system that is capable of bifurcating a x16 slot into two x8 interfaces.


FPGA Target Devices

The following table shows the FPGA devices fitted to the various Data Center Products.

Product(s)

FPGA Family

FPGA Device Code

ADM-PCIE-9H7Xilinx Virtex UltraScale+XCVU37P-2
XCVU35P-2
ADM-PCIE-9V3Xilinx Virtex UltraScale+XCVU3P-2
ADM-PCIE-8V3Xilinx Virtex UltraScaleXCVU095-2
ADM-PCIE-8K5Xilinx Kintex UltraScaleXCKU115-2
ADM-PCIE-8K5-FHXilinx Kintex UltraScaleXCKU115-2
ADM-PCIE-KU3Xilinx Kintex UltraScaleXCKU060-2
ADM-PCIE-KU3X8Xilinx Kintex UltraScaleXCKU060-2
ADM-PCIE-7V3Xilinx Virtex-7XC7VX690T-2

The following table compares the FPGA Resources.

Product(s)

FPGA Device

FFs

LUTs

BRAM

URAM

DSPs

TOP/s

ADM-PCIE-9H7XCVU37P-22607k1304k70.9Mb270.0Mb902428.1 INT8 DSP
XCVU35P-21743k87247.3Mb180.0Mb5952-
ADM-PCIE-9V3XCVU3P-2788k394k25.3 Mb90.0 Mb22807.1 INT8 DSP
ADM-PCIE-8V3XCVU095-2
ADM-PCIE-8K5XCKU115-21326k663k75.9Mb-5520-
ADM-PCIE-8K5-FHXCKU115-21326k663k75.9Mb-5520-
ADM-PCIE-KU3XCKU060-2663k221k38.0Mb-2760-
ADM-PCIE-KU3X8XCKU060-2663k221k38.0Mb-2760-
ADM-PCIE-7V3XC7VX690T-2886k693k52.9Mb-3600-

Onboard Memory Specifications

The following table shows the memory types and sizes for all the Data Center Products

Product

Memory Type

No. Banks

Memory Size
(per bank)

Memory Part

ADM-PCIE-9H7on FPGA Substrate24GB
DDR4-2666 - up to 460GB/s (over 32 AXI Interfaces)
Xilinx High Bandwidth Memory (HBM Gen2)
ADM-PCIE-9V3FBGA-SDRAM21G x 72 (8GiB)
DDR4-2400
Micron MT40A1G8PM-083E or
Samsung K4A8G085WB-BCRC
FBGA-SDRAM22G x 72 (16GiB)
DDR4-1866
Micron MT40A2G8PM-093E
ADM-PCIE-8V3FBGA-SDRAM21G x 72 (8GiB)
DDR4-2400
Micron MT40A1G8PM-083E or
Samsung K4A8G085WB-BCRC
FBGA-SDRAM22G x 72 (16GiB)
DDR4-1866
Micron MT40A2G8PM-093E
ADM-PCIE-8K5FBGA-SDRAM21G x 72 (8GiB)
DDR4-2400
Micron MT40A1G8PM-083E or
Samsung K4A8G085WB-BCRC
FBGA-SDRAM22G x 72 (16GiB)
DDR4-1866
Micron MT40A2G8PM-093E
ADM-PCIE-8K5-FHFBGA-SDRAM21G x 72 (8GiB)
DDR4-2400
Micron MT40A1G8PM-083E or
Samsung K4A8G085WB-BCRC
FBGA-SDRAM22G x 72 (16GiB)
DDR4-1866
Micron MT40A2G8PM-093E
ADM-PCIE-KU3ECC-SODIMMs21G x 72 (8GiB)
DDR3-1600
DDR3 SDRAM ECC-SODIMMs
ADM-PCIE-KU3X8ECC-SODIMMs21G x 72 (8GiB)
DDR3-1600
DDR3 SDRAM ECC-SODIMMs
ADM-PCIE-7V3ECC-SODIMMs21G x 72 (8GiB)
DDR3-1333
DDR3 SDRAM ECC-SODIMMs

Check with Alpha Data for the latest configuration files for generating the Memory Interfaces in Vivado.


Other Onboard Memory

Other onboard memory available on selected Data Center products:

ProductOther Onboard Memory Description(s)
ADM-PCIE-9H72kb I2C EEPROM - Non-volatile data storage for the user design (i.e. storing MAC addresses)????
ADM-PCIE-9V32kb I2C EEPROM - Non-volatile data storage for the user design (i.e. storing MAC addresses)
ADM-PCIE-8V32kb I2C EEPROM - Non-volatile data storage for the user design (i.e. storing MAC addresses)
ADM-PCIE-8K52kb I2C EEPROM - Non-volatile data storage for the user design (i.e. storing MAC addresses)
ADM-PCIE-8K5-FH2kb I2C EEPROM - Non-volatile data storage for the user design (i.e. storing MAC addresses)
ADM-PCIE-KU3-
ADM-PCIE-KU3X8-
ADM-PCIE-7V3-

FPGA Configuration

All Alpha Data Data Center products configure from on board FLASH at power on. All products have multiple design load options (there is always a default load option which configures a minimal design to allow the user to check the board and upload their design to the FLASH).

KU3 Photo

All Alpha Data Data Center products configure from on board FLASH at power on. All products have multiple design load options (there is always a default load option which configures a minimal design to allow the user to check the board and upload their design to the FLASH).


Flash Configuration

All products have on board Flash memory that configures the FPGA upon power up. Each product has at least two programmable regions with region 0 designated as the failsafe configuration. The failsafe configuration is loaded if the the boards system monitor detects problems with the board (i.e. the FPGA running hot). The Flash is programmed via the JTAG interface or through the FPGA over PCI Express using provided utility software.

Products

Flash Size

No. config regions

ADM-PCIE-9H72GBit4???? each of 64MiB????
ADM-PCIE-9V31GBit2 each of 64MiB
ADM-PCIE-8V31GBit2 each of 64MiB
ADM-PCIE-8K51GBit2 each of 64MiB
ADM-PCIE-8K5-FH1GBit2 each of 64MiB
ADM-PCIE-KU31GBit4 each of 32MiB
ADM-PCIE-KU3X81GBit4 each of 32MiB
ADM-PCIE-7V31GBit4 each of 32MiB

JTAG Interface

The more mature Data Center products have direct access to the JTAG interface connecting both to the FPGA and to the on board FLASH memory. This allows the user to configure the FPGA directly or store the BIT file within the FLASH so that upon boot up the FPGA is configured immediately.

Xilinx JTAG Adaptor JTAG Socket on KU3 Jtag to front panel extender

The socket is at the top of the board behind the external sync socket.

With a full height front panel an adaptor connector can connect this socket to a panel mounted socket for non-intrusive access to the card from the outside of the server case.

The products that the user shall require a Xilinx Platform USB II JTAG cable for are:

JTAG Only
Product(s)
ADM-PCIE-KU3ADM-PCIE-KU3X8ADM-PCIE-7V3

USB Interface (JTAG Interface)

The most recent Data Center products provide a USB interface to the board management interface. This interface also drives the JTAG for the FPGA and the onboard FLASH memory and is compatible with the Xilinx Hardware Manager so no extra interface or cabling (other than the micro-USB cable) required to configure the FPGA directly from the Xilinx vivado Hardware Manager software.

USB port on front panel 8K5 USB port on front panel 8V3
USB Capable
Product(s)
ADM-PCIE-9H7ADM-PCIE-9V3ADM-PCIE-8V3ADM-PCIE-8K5ADM-PCIE-8K5-FH

Board Cooling

As the FPGA design increases in size, complexity and operating frequency it creates a significant amount of waste heat which needs to be dissipated in order to keep the board from shutting down (see system monitoring). All Data Center products are delivered with large heatsinks to provide as large a heat dissipating surface as possible, the heatsinks only work if the server chassis provides sufficient airflow around/across the board. Insufficient airflow will result in heat build up on the board and triggering of the automatic thermal shutdown process.

If the chassis cannot provide sufficient airflow then attaching a fan to the heatsink can provide an increase in airflow. There are issues with attaching a fan on the earlier Data Center Products as they require a spare slot beside the board as the fan overlaps the adjacent slot. For later products the fan is fitted at the rear of the board requiring the chassis to have space beyond the board to accommodate the extra length the fan adds.

Fan for the ADM-PCIE-8K5Fan for the ADM-PCIE-KU3Fan for the ADM-PCIE-7V3

System Monitoring

All Data Center products provide system monitoring functionality. This consists of power rail monitoring and board and FPGA temperature monitoring.

The on board monitor monitors the FPGA silicon temperature and when this reaches a predefined value the FPGA is reprogrammed with the default/safe design to ensure the FPGA is not harmed by going over temperature.

If the design stops functioning then this is the first place to be checked to ensure the board is not overheating in the host system.


Communications Interfaces

All products provide high speed communication interfaces via either SFP+ or QSFP cages on their front panels. The choice of copper or fiber interfaces is left to the user. The following table outlines the network capabilities of the products available at present.


Product

Interface Type

Qty

Lanes
per Interface

Data Rate
per lane

Protocol Capability

ADM-PCIE-9H7QSFP28x4428Gbps100G Ethernet
Ultraport SlimSASx2825GbpsOpenCAPI
Firefly Interfacesx8428GbpsPCIe, Fibre Channel, Infiniband, Ethernet, Aurora
ADM-PCIE-9V3QSFP28x2428Gbps100G Ethernet
Ultraport SlimSASx1825GbpsOpenCAPI
ADM-PCIE-8V3QSFP28x2428Gbps100G Ethernet
Firefly Connectorx2428GbpsPCIe, Fibre Channel, Infiniband, Ethernet, Aurora
ADM-PCIE-8K5SFP+x2116Gbps10G Ethernet
Firefly Connectorx2416GbpsPCIe, Fibre Channel, Infiniband, Ethernet, Aurora
ADM-PCIE-8K5-FHSFP+x2116Gbps10G Ethernet
Firefly Connectorx2416GbpsPCIe, Fibre Channel, Infiniband, Ethernet, Aurora
ADM-PCIE-KU3QSFPx2410Gbps40G Ethernet
ADM-PCIE-KU3X8QSFPx2410Gbps40G Ethernet
SATA Connectorx216GbpsSATA Hard drive
ADM-PCIE-7V3SFP+x2114Gbps10G Ethernet

Note: Alpha Data does not provide RTL interface solutions for the network interfaces, the interfaces are verified in manufacturing using serial bit error rate testing firmware (iBERT). These can be obtained from either Xilinx or from Network IP providers.

OpenCAPI Socket on the 9V3 SFP+ Cages on the 8K5 QSFP28 Cages on the 8V3 Firefly sockets on the 9H7 SATA sockets on the KU3

Other board Interfaces

As well as network interface(s) each Data Center Product can have other interfaces available to the user design.


Table of other interfaces for each products:

Product

Other Interfaces

ADM-PCIE-9H7customizable GPIO
ADM-PCIE-9V3USB board management (built-in JTAG)
customizable GPIO
ADM-PCIE-8V3USB board management (built-in JTAG)
customizable GPIO
ADM-PCIE-8K5USB board management (built-in JTAG)
ADM-PCIE-8K5-FHUSB board management (built-in JTAG)
ADM-PCIE-KU3Dual SATA Interfaces (6Gbps)
External Sync (PPS) interface
ADM-PCIE-KU3X8External Sync (PPS) interface
ADM-PCIE-7V3Dual Sata Interfaces (6Gbps)

On board Switches

Each Data Center Product has configuration switches on board. There are switches which select which FLASH region to configure the FPGA from. Other functions include FLASH Lockdown, Failsafe Configure FPGA and user function control.

ADM-PCIE-9H7
NameFactory DefaultFunctionOff StateOn State
****SW1-1OFFUser Switch 0Pin AV27 = '1'Pin AV27 = '0'
****SW1-2OFFUser Switch 1Pin AW27 = '1'Pin AW27 = '0'
****SW1-3OFFService ModeRegular OperationFirmware update service mode
****SW1-4OFFJTAG SourceJTAG to FPGA from USBJTAG to FPGA from debug header
ADM-PCIE-9V3
NameFactory DefaultFunctionOff StateOn State
SW1-1OFFUser Switch 0Pin AV27 = '1'Pin AV27 = '0'
SW1-2OFFUser Switch 1Pin AW27 = '1'Pin AW27 = '0'
SW1-3OFFService ModeRegular OperationFirmware update service mode
SW1-4OFFJTAG SourceJTAG to FPGA from USBJTAG to FPGA from debug header
SW2-1ONHOST_I2-C_ENSysmon over PCIe I2CSysmon isolated
SW2-2ONCAPI_VP-D_ENOpenCAPI VPD availableOpenCAPI VPD isolated
SW2-3ONCAPI_VP-D_WPCAPI VPD is write protectedCAPI VPD is writable
SW2-4ONReservedReservedReserved
ADM-PCIE-8V3
NameFactory DefaultFunctionOff StateOn State
SW1-1OFFUser SwitchPin AV27 = '1'Pin AV27 = '0'
SW1-2OFFFlash LockdownFlash block Lockdown enabledFlash block Lockdown disabled
SW1-3OFFService ModeRegular OperationFirmware update service mode
SW1-4OFFPCIe Edge JTAGJTAG to FPGA from USBJTAG to FPGA from PCIe Edge
ADM-PCIE-8K5
NameFactory DefaultFunctionOff StateOn State
SW1-1OFFUser SwitchPin AV18 = '1'Pin AV18 = '0'
SW1-2OFFFlash LockdownFlash block Lockdown enabledFlash block Lockdown disabled
SW1-3OFFService ModeRegular OperationFirmware update service mode
SW1-4OFFPCIe Edge JTAGJTAG to FPGA from USBJTAG to FPGA from PCIe Edge
ADM-PCIE-8K5-FH
NameFactory DefaultFunctionOff StateOn State
SW1-1OFFUser SwitchPin AV18 = '1'Pin AV18 = '0'
SW1-2OFFFlash LockdownFlash block Lockdown enabledFlash block Lockdown disabled
SW1-3OFFService ModeRegular OperationFirmware update service mode
SW1-4OFFPCIe Edge JTAGJTAG to FPGA from USBJTAG to FPGA from PCIe Edge
ADM-PCIE-KU3
NameFactory DefaultFunctionOff StateOn State
SW1-1OFFUser SwitchPin AH12 = '1'Pin AH12 = '0'
SW1-2ONFlash LockdownFlash block Lockdown enabledFlash block Lockdown disabled
SW1-3OFFXilinx/AD ModeConfigure from Alpha Data regionConfigure from Xilinx region
SW1-4ONFailsafe/DefaultConfigure from failsafe regionConfigure from default region
ADM-PCIE-KU3X8
NameFactory DefaultFunctionOff StateOn State
SW1-1OFFUser SwitchPin AH12 = '1'Pin AH12 = '0'
SW1-2ONFlash LockdownFlash block Lockdown enabledFlash block Lockdown disabled
SW1-3OFFXilinx/AD ModeConfigure from Alpha Data regionConfigure from Xilinx region
SW1-4ONFailsafe/DefaultConfigure from failsafe regionConfigure from default region
ADM-PCIE-7V3
NameFactory DefaultFunctionOff StateOn State
SW1-1OFFXilinx/AD ModeConfigure from Alpha Data regionConfigure from Xilinx region
SW1-2ONFlash LockdownFlash block Lockdown enabledFlash block Lockdown disabled
SW1-3ONFailsafe/DefaultConfigure from failsafe regionConfigure from default region
SW1-4OFFUser SwitchPin AB30 = '1'Pin AB30 = '0'

Switches for the ADM-PCIE-9V3Switches for the ADM-PCIE-8K5Switches for the ADM-PCIE-KU3Switches for the ADM-PCIE-7V3

On board LEDs

ADM-PCIE-9H7

LED ID

Color

Indicates

On State

Off State

****D4greenDONEFPGA is ConfiguredFPGA is Not configured
****D8greenUSER_LED_G0User Pin AT27 '0' User Pin AT27 '1'
****D2greenUSER_LED_G1User Pin AU27 '0' User Pin AU27 '1'
****D7redUSER_LED_RUser Pin AU23 '0' User Pin AU23 '1'
****D5greenStatus 0See Status Table-
****D6redStatus 1See Status Table-
ADM-PCIE-9V3

LED ID

Color

Indicates

On State

Off State

D4greenDONEFPGA is ConfiguredFPGA is Not configured
D8greenUSER_LED_G0User Pin AT27 '0' User Pin AT27 '1'
D2greenUSER_LED_G1User Pin AU27 '0' User Pin AU27 '1'
D7redUSER_LED_RUser Pin AU23 '0' User Pin AU23 '1'
D5greenStatus 0See Status Table-
D6redStatus 1See Status Table-
D9greenFront_LED_0User Pin AH24 '1'User Pin AH24 '0'
D10greenFront_LED_1User Pin AJ23 '1'User Pin AJ23 '0'
ADM-PCIE-8V3

LED ID

Color

Indicates

On State

Off State

D4greenDONEFPGA is configuredFPGA is not configured
D8greenUSER_LED_G0User defined '0' pin AT27User defined '1' pin AT27
D2greenUSER_LED_G1User defined '0' pin AU27User defined '1' pin AU27
D7redUSER_LED_RUser defined '0' pin AU23User defined '1' pin AU23
D5greenStatus 0See Status LED Definitions-
D6redStatus 1See Status LED Definitions-
ADM-PCIE-8K5

LED ID

Color

Indicates

On State

Off State

D4greenDONEFPGA is configuredFPGA is not configured
D2greenUSER_LED_G0User defined '0' pin AT19User defined '1' pin AT19
D8greenUSER_LED_G1User defined '0' pin AU19User defined '1' pin AU19
D7redUSER_LED_RUser defined '0' pin AU20User defined '1' pin AU20
D5greenStatus 0See Status LED Definitions-
D6redStatus 1See Status LED Definitions-
ADM-PCIE-8K5-FH

LED ID

Color

Indicates

On State

Off State

ADM-PCIE-KU3

LED ID

Color

Indicates

On State

Off State

D1greenDONEFPGA is configuredFPGA is not configured
D2redCLOCK_LOSClocks not operating normallyClocks operating normally
D3greenUSR_LED0User defined '0' pin AE12User defined '1' pin AE12
D4greenUSR_LED1User defined '0' pin AF12User defined '1' pin AF12
D5redUSR_LED2User defined '0' pin AD11User defined '1' pin AD11
D6redSYS_FaultTemperature or voltage warning/faultSystem monitor OK
D7greenSYS_OKTemperature and voltage within toleranceTemperature or voltage out of tolerance
ADM-PCIE-KU3X8

LED ID

Color

Indicates

On State

Off State

ADM-PCIE-7V3

LED ID

Color

Indicates

On State

Off State

D1greenDONEFPGA is configuredFPGA is not configured
D2greenUSR_LED0User defined '1' pin AC33User defined '0' pin AC33
D3greenUSR_LED1User defined '1' pin V32User defined '0' pin V32
D4greenUSR_LED2User defined '1' pin V33User defined '0' pin V33
D5redUSR_LED5User defined '1' pin U30User defined '0' pin U30
D6redUSR_LED4User defined '1' pin AB32User defined '0' pin AB32
D7greenUSR_LED3User defined '1' pin AB31User defined '0' pin AB31
D8redINIT_BError during configurationNo error during configuration
D9greenPOK_SFPSFP+ power supply OKSFP+ power supply OFF or out of range
D10greenSYS_POKAll FPGA power rails OKOne or more FPGA power rails out of range
D12greenPOK_DRAMSODIMM power supply OKSODIMM power supply OFF or out of range
D16redCLOCK_LOSClocks not operating normallyClocks operating normally

Status LED Definition Table

Status 0

Status 1 (red)

Indicates

onoffrunning and no alarms
ononStandby (Powered off)
FlashingFlashing (together)Attention - critical alarm active
FlashingFlashing (alternating)Service Mode
offonMissing application firmware or invalid firmware
offflashingFPGA configuration cleared to protect board

LEDs for the ADM-PCIE-9V3LEDs for the ADM-PCIE-9V3LEDs for the ADM-PCIE-8K5LEDs for the ADM-PCIE-KU3LEDs for the ADM-PCIE-7V3

Support and Development Kit(s) (Provided as part of the Associated Reference Design

There are specific SDK downloads for the following Data Center Products:

Note: an account is required for access to certain content on the Alpha Data Support site.


Data Center Products reference designs and SDAccel/CAPI support information.

Product

SDAccel Ready

Reference Design

OpenPOWER Ready

CAPI Ref Design

ADM-PCIE-9H7TBCTBCTBC-
ADM-PCIE-9V3TBCTBCTBC-
ADM-PCIE-8V3TBCRD-8V3NO-
ADM-PCIE-8K5YESRD-8K5YesRD-CAPI-8K5
ADM-PCIE-8K5-FHYESRD-8K5YesRD-CAPI-8K5
ADM-PCIE-KU3YESRD-KU3YesRD-CAPI-KU3
ADM-PCIE-KU3X8YESRD-KU3YesRD-CAPI-KU3
ADM-PCIE-7V3YESRD-7V3YesRD-CAPI-7V3

Available Files

Each of the Data Center Products have a collection of associated design files:

Top level Pinout information for the FPGAs.

ProductAssociated Pinout Files
ADM-PCIE-9V3

ADM-PCIE-9V3 Pinout Version 1.0 Created on 9 September 2016 - copy of ADM-PCIE-8V3 constriants ADM-PCIE-9V3 Pinout Version 2.0 Created on 1 May 2017 - Major changes in flash interface Removed Firefly interface, added CAPI interface

adm-pcie-9v3_pinout_v2_0.csv

ADM-PCIE-8K5

ADM-PCIE-8k5 Pinout Version 1.0

adm-pcie-8k5_pinout_v1_0.csv

ADM-PCIE-KU3

ADM-PCIE-KU3 Pinout Version 1.0 Created on 30 March 2016

adm-pcie-ku3_pinout_v1_0.csv

ADM-PCIE-7V3

ADM-PCIE-7V3 Pinout Version 1.0

adm-pcie-7v3_pinout_v1_0.csv

Other data files - MIG models for the onboard memory interface configuration.

ProductAssociated Model Files
ADM-PCIE-9V3

adm-pcie-9v3_custom_parts_2133.csv

adm-pcie-9v3_custom_parts_2400.csv

ADM-PCIE-8K5

adm-pcie-8k5_custom_parts_2133.csv

adm-pcie-8k5_custom_parts_2400.csv






©2017 Alpha Data Parallel Systems - All rights reserved