PCIe adapter placement rules and slot priorities for the 8247-42L
Find information about the placement rules and slot priorities for the Peripheral Component Interconnect (PCI) Express (PCIe) adapters that are supported for the 8247-42L system.
PCIe slot descriptions for the 8247-42L
The 8247-42L system provides PCIe generation 3 slots. Table 1 provides information about the PCIe slots in the 8247-42L system that offers both a single POWER8® processor module or two POWER8 processor modules. The PCIe slots are enabled to support the PCIe3 cable adapter (FC EJ08) that is used to attach the EMX0 PCIe Gen3 I/O expansion drawer.
Slot | Adapter size | Slot availability | ||
---|---|---|---|---|
8247-42L no GPU adapter (1 processor) |
8247-42L no GPU adapter (2 processors) |
8247-42L with GPU adapter (2 processors) |
||
PCIe3 x16 | Full-height, full-length | 2 slots (P1-C6 and P1-C7) | 4 slots (P1-C3, P1-C5, P1-C6, and P1-C7) | 4 slots (P1-C3, P1-C5, P1-C6, and P1-C7) |
PCIe3 x8 | Full-height, half-length or short (low-profile) | 5 slots (P1-C8, P1-C9, P1-C10, P1-C11, and P1-C12) | 7 slots (P1-C2, P1-C4, P1-C8, P1-C9, P1-C10, P1-C11, and P1-C12) | 6 slots (P1-C2, P1-C4, P1-C8, P1-C9, P1-C11, and P1-C12) |
- PCIe slots
- Embedded PCIe local area network (LAN) controller
- PCIe3 internal SAS controller
- PCIe3 USB controller
- PCIe3 Switch 1 that provides PCIe buses from Processor Module 1, Chip-0.
- PCIe3 Switch 2 that provides PCIe buses from Processor Module 1, Chip-1.
Features provided | PCIe3 Switch 1 | PCIe3 Switch 2 |
---|---|---|
Lanes and ports | 32-lane, 8-ports PCIe Gen3 | 48-lane, 12-ports PCIe Gen3 |
With integrated 8.0 gigatransfers per second (GTps) Serializer/Deserializer (SerDes) speed negotiation, for each port | ||
Lane and polarity reversal | Supported | Supported |
All ports support concurrent maintenance through I2C bus | Yes | Yes |
End-to-end cyclic redundancy check (CRC) and Poison bit error checking | Supported | Supported |
Data path parity | Supported | Supported |
Memory error correction | Supported | Supported |
Advanced error reporting | Supported | Supported |
Aggregate full duplex bandwidth | 512 GT/s | 768 GT/s |
Designate any port as the Upstream port | Yes | Yes |
27x27 mm, 676-pin FCBGA package | Yes | Yes |
Power consumption |
|
|
Figure 1 shows the rear view of the system with the location codes for the PCIe adapter slots.
Table 3 lists the PCIe adapter slot locations and details for the 8247-42L system.
Slot | Location code |
Description | PHB | Adapter size |
Slot capabilities | Slot availability | |||||
---|---|---|---|---|---|---|---|---|---|---|---|
CAPI | SR-IOV | Dynamic direct memory access (DMA) window | I/O adapter enlarged capacity assign order | 8247-42L no GPU adapter (1 processor) |
8247-42L no GPU adapter (2 processors) |
8247-42L with GPU adapter (2 processors) |
|||||
Slot 1 | P1-C21, 6 | PCIe3, x8 | Processor Module 2, Chip-1, PHB1 | Full-height, half-length or short (low-profile) | No | Yes | Yes | 5 | No | Yes | Yes |
Slot 2 | P1-C31 | PCIe3, x16 | Processor Module 2, Chip-1, PHB0 | Full-height, full-length | Yes | Yes | Yes | 9 | No | Yes | Dedicated slot for the second GPU adapter3 |
Slot 3 | P1-C41, 6 | PCIe3, x8 | Processor Module 2, Chip-0, PHB1 | Full-height, half-length or short (low-profile) | No | Yes | Yes | 6 | No | Yes | Not available if a GPU adapter is in slot 3 (P1-C3) |
Slot 4 | P1-C51 | PCIe3, x16 | Processor Module 2, Chip-0, PHB0 | Full-height, full-length | Yes | Yes | Yes | 11 | No | Yes | Yes |
Slot 5 | P1-C61 | PCIe3, x16 | Processor Module 1, Chip-1, PHB0 | Full-height, full-length | Yes | Yes | Yes | Default | Yes | Yes | Dedicated slot for the first GPU adapter |
Slot 6 | P1-C71 | PCIe3, x16 | Processor Module 1, Chip-0, PHB0 | Full-height, full-length | Yes | Yes | Yes | Default | Yes | Yes | Not available because the GPU adapter is in slot 5 (P1-C6) |
Slot 7 | P1-C82 | PCIe3, x8 | PCIe3 Switch 2, S2P16 | Full-height, half-length or short (low-profile) | No | No | Yes | 5, 104 | Yes | Yes | Yes |
Slot 8 | P1-C92 | PCIe3, x8 | PCIe3 Switch 2, S2P17 | Full-height, half-length or short (low-profile) | No | No | Yes | 6, 85 | Yes | Yes | Yes |
Slot 9 | P1-C102, 6 | PCIe3, x8 | PCIe3 Switch 2, S1P9 | Full-height, half-length or short (low-profile) | No | Yes | Yes | Default | Dedicated slot for the LAN adapter | ||
Slot 10 | P1-C112 | PCIe3, x8 | PCIe3 Switch 1, S0P1 | Full-height, half-length or short (low-profile) | No | No | Yes | 7 | Yes | Yes | Yes |
Slot 11 | P1-C122, 6 | PCIe3, x8 | PCIe3 Switch 1, S1P9 | Full-height, half-length or short (low-profile) | No | Yes | Yes | Default | Yes | Yes | Yes |
1Slot is a direct slot from the Processor Module and is a high-performance slot. The connectors in these slots are differently colored than the slots from the PCIe3 switches. 2Slot connected by the PCIe3 switches. 3One PCIe gen3 x16 graphics processing unit (GPU) adapter (FC EC47 or EC4B) is preinstalled in slot 5 (P1-C6). The GPU adapter requires two slot space for accommodating the air baffle. 4The I/O Adapter Enlarged Capacity assignment order value is 5 for one processor or 10 for two processors. 5The I/O Adapter Enlarged Capacity assignment order value is 6 for one processor or 8 for two processors. 6For platforms with less than 64GB of total system memory, SR-IOV should not be configured in these slots as performance may be severely impacted.
|
PCIe adapters placement rules
- IBM Manufacturing requires that slot P1-C10 hold a local area network (LAN) adapter to install and test the server. One LAN feature code (FC) 5899, EN0W, EL55, or EN0S should be selected for this purpose. IBM ships the LAN adapter in the P1-C10 slot. If needed, the client can move the LAN adapter to a different slot allowing other PCIe adapters to be placed in P1-C10. The following tables assume that the LAN adapter remains in the P1-C10 slot.
- The PCIe3 cable adapter (FC EJ08) is supported in slots P1-C3, P1-C6, P1-C5, and P1-C7 on 8247-42L systems that do not have a GPU adapter installed.
- Slots P1-C3, P1-C5, P1-C6, and P1-C7, are x16 slots with busses direct from the Processor Modules and can be used to install high-performance PCIe adapters. For these full-height, full-length slots, first priority must be given to GPU adapters followed by PCIe x16 adapters, CAPI adapters, Single Root IO Virtualization (SR-IOV) capable adapters, FC EJ12 (FPGA Accelerator), high-performance adapters, ending with all other supported adapters.
- CAPI accelerator adapters are supported in slots P1-C6, P1-C7, P1-C3, and P1-C5.
- Slots P1-C2 and P1-C4 are x8 slots with busses direct from the Processor Modules and can be used to install high-performance PCIe adapters.
- Slots P1-C2, P1-C3, P1-C4, P1-C5, P1-C6, and P1-C7 are slots with busses direct from the Processor Modules and can be used to install high-performance PCIe adapters that support the Single Root IO Virtualization (SR-IOV) function.
- PCIe internal slots P1-C14 and P1-C15 are used to install the SAS RAID adapter FC EJ0S and the internal SAS RAID adapter (CCIN 57D8).
- When the internal SAS RAID adapter (CCIN 57D8) is installed in an expanded function system and if FC EJ0Z is installed in the PCIe slot P1-C11, slot P1-C11 is not available for installing any other PCIe adapter.
Verify whether the adapter is supported for your system. For details about the supported adapters, see PCI adapter information by feature type for the 8247-42L, 8286-41A, or 8286-42A.
Feature code | Description | 8247-42L no GPU adapter (1 processor) |
8247-42L no GPU adapter (2 processors) |
8247-42L with GPU adapter (2 processors)1 |
|||
---|---|---|---|---|---|---|---|
Slot priorities | Maximum number of adapters supported | Slot priorities | Maximum number of adapters supported | Slot priorities | Maximum number of adapters supported | ||
5748 | POWER® GXT145 PCI Express Graphics Accelerator (FC
5748; CCIN 5748); Adapter FRU number: 10N7756
|
102, 8, 5, 6 | 4 | 102, 8, 1, 3, 2, 4, 5, 6 | 8 | Not supported | Not supported |
5785 | 4-port Async EIA-232
PCIe Adapter (FC 5785; CCIN 57D2); Adapter FRU number: 46K6734
OS support: Linux operating system |
102, 8, 5, 6 | 4 | 102, 8, 1, 3, 2, 4, 5, 6 | 8 | Not supported | Not supported |
5899 | PCIe2
4-port 1 GbE Adapter (FC 5899; CCIN 576F); Adapter FRU number: 74Y4064
OS support: Linux operating system |
9, 11, 10, 8, 7, 6, 5 | 7 | 9, 2, 11, 3, 10, 8, 7, 6, 5, 4 | 10 | Not supported | Not supported |
EC42 | PCIe2 3D Graphics Adapter
x1 (FC EC42); Adapter FRU number: 00E3980
|
11, 10, 8, 7, 6, 5 | 6 | 1, 11, 3, 10, 8, 7, 6, 2, 5, 4 | 10 | Not supported | Not supported |
EC46 | PCIe2
4-port USB 3.0 Adapter (FC EC46; CCIN 58F9); Adapter FRU number: 00E2932
|
11, 10, 8, 7, 6, 5 | 6 | 1, 11, 3, 10, 8, 7, 6, 2, 5, 4 | 10 | Not supported | Not supported |
EC47 | PCIe
gen3 x16 GPU Adapter (FC EC47; CCIN 2CE8); Adapter FRU number: 01AF012
|
Not supported | Not supported | Not supported | Not supported | 5-6, 2-3 | 21 |
EC55 | PCIe3 1.6 TB NVMe Flash Adapter (FC EC54 and EC55; CCIN
58CB); Adapter FRU number: 00MH991
|
5, 6, 7, 102, 8, 11 | 6 | 1, 2, 3, 4, 5, 6, 7, 10 | 8 | Not supported | Not supported |
EC57 | PCIe3 3.2 TB NVMe Flash Adapter
(FC EC56 and EC57; CCIN 58CC); Adapter FRU number: 00MH993
|
5, 6, 7, 102, 8, 11 | 6 | 1, 2, 3, 4, 5, 6, 7, 10 | 8 | Not supported | Not supported |
EC3B | PCIe3 2-Port 40 GbE NIC RoCE QSFP+ Adapter (FC
EC3B; CCIN 57BD); Adapter FRU number: 00FW105
|
5, 6, 7, 8, 10, 11 | 6 | 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 10 | Not supported | Not supported |
EC3F | PCIe3 2-port 100 Gb EDR IB Adapter x16 (FC
EC3E and EC3F; CCIN 2CEA); Adapter FRU number:
00WT075
|
5, 6 | 2 | 5, 2, 6, 4 | 4 | 5, 2, 6, 4 | 2 |
EC3U | PCIe3 1-port 100 Gb EDR
Infiniband Adapter x16 (FC EC3U; CCIN 2CEB) Adapter FRU number: 00WT013
|
5, 6 | 2 | 5, 2, 6, 4 | 4 | 5, 2, 6, 4 | 2 |
EC3M | PCIe3
2-port 100 GbE (NIC and RoCE) QSFP28 Adapter (FC EC3L and EC3M; CCIN 2CEC); Adapter FRU
number: 00WT078
|
5, 6 | 2 | 5, 2, 6, 4 | 4 | 5, 2, 6, 4 | 2 |
EC4B | PCIe gen3 x16 GPU Adapter (FC
EC4B; CCIN 2CE9); Adapter FRU number: 00RR999
|
Not supported | Not supported | Not supported | Not supported | 5-6, 2-3 | 21 |
EJ08 | PCIe3 cable adapter that
is used to connect your system to the EMX0 PCIe3 expansion drawer (FC EJ08; CCIN
2CE2); Adapter FRU number: 041T9901
|
5, 6 | 2 | 5, 2, 6, 4 | 4 | Not supported | Not supported |
EJ0L | PCIe3 12 GB Cache RAID
SAS quad-port 6 Gb Adapter (FC EJ0L; CCIN 57CE); Adapter
FRU number: 00FX840
|
5, 6, 7, 8, 10, 11 | 6 | 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 10 | Not supported | Not supported |
EJ0Z | SAS ports and cabling for dual
IOA backplane
|
10 | 1 | 10 | 1 | Not supported | Not supported |
EJ12 | PCIe3 FPGA Compression Accelerator Adapter (FC EJ12; CCIN
59AB); Adapter FRU number: 000NK006
|
6, 5 | 2 | 6, 2, 5, 4 | 4 | Not supported | Not supported |
EJ14 | PCIe3
12 GB Cache RAID PLUS SAS Adapter Quad-port 6 Gb x8 (FC EJ14; CCIN
57B1); Adapter FRU number 01DH742
|
5, 6, 7, 8, 10, 11 | 6 | 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 10 | Not supported | Not supported |
EJ1A | CAPI Compression Accelerator Adapter (FC EJ1A and EJ1B; CCIN
2CF0); Adapter FRU number: 00WT173
|
5, 6 | 1 | 5, 2, 6, 4 | 2 | 4 | 1 |
EJ1P | PCIe1 SAS Tape/DVD Dual-port 3 Gb x8 Adapter (FC EJ1P and
EJ1N; CCIN 57B3); Adapter FRU:44V4852
|
6, 5 | 2 | 6, 2, 5, 4 | 4 | Not supported | Not supported |
EJ32 | PCIe
2-port Async EIA-232 Adapter (FC EN27; CCIN 57D4); Adapter FRU number:
000ND487
|
11, 10, 8, 7, 6, 5 | 6 | 11, 8, 10, 7, 3, 1, 5, 6, 2, 5 | 10 | Not supported | Not supported |
EL4L | PCIe2 4-port 1 GbE Adapter
(FC EL4L and EL4M; CCIN 576F); Adapter FRU number: 74Y4064
|
9, 11, 10, 8, 7, 6, 5 | 7 | 9, 1, 11, 3, 10, 8, 7, 6, 5, 4 | 10 | Not supported | Not supported |
EL50 | PCIe3 2-port 56 Gb FDR
IB Adapter x16 (FC EL50; CCIN 2CE7); Adapter FRU number: 00RX852
|
5, 6 | 2 | 5, 2, 6, 4 | 4 | 5, 2, 6, 4 | 2 |
EL53 | PCIe3
2-port 10 GbE NIC and RoCE SFP+ Copper Adapter (FC EL53; CCIN 57BC);
Adapter FRU number: 00RX859; Low-profile tailstock: 00RX856
|
5, 6, 7, 8, 10, 11 | 6 | 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 10 | Not supported | Not supported |
EL54 | PCIe3 2-port 10 GbE
NIC and RoCE SR adapter (FC EL54; CCIN 57BE); Adapter FRU
number: 00RX875
|
5, 6, 7, 8, 10, 11 | 6 | 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 10 | Not supported | Not supported |
EL55 | PCIe2 2-port 10 GbE
BaseT RJ45 Adapter (FC EL55; CCIN 2CC4); Adapter FRU number: 00E2714
|
9, 5, 6, 7, 8, 10, 11 | 7 | 9, 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 11 | 9, 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 2 |
EL56 | PCIe2 4-port (2x10 Gb
FCoE, 2x1 GbE) SFP+ Adapter (FC EL56, CCIN 2B93); Adapter
FRU number: 00E3498
|
9, 5, 6, 7, 8, 10, 11 | 7 | 9, 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 11 | Not supported | Not supported |
EL57 | PCIe2
4-port (10 Gb FCoE and 1 GbE) Copper and RJ45 Adapter (FC EL57; CCIN
2CC1); Adapter FRU number: 00E8140
|
9, 5, 6, 7, 8, 10, 11 | 7 | 9, 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 11 | Not supported | Not supported |
EL58 | 8 Gb PCI Express Dual-port Fibre Channel
Adapter (FC EL58; CCIN 577D); Adapter FRU number: 10N9824
|
11, 10, 8, 7, 6, 5 | 6 | 1, 11, 3, 10, 8, 7, 6, 2, 5, 4 | 10 | Not supported | Not supported |
EL59 | PCIe3
RAID SAS quad-port 6 Gb Adapter (FC EL59; CCIN 57B4); Adapter FRU
number: 000E9284
|
5, 6, 7, 8, 10, 11 | 6 | 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 10 | Not supported | Not supported |
EL5B | PCIe3 16 Gb 2-port Fibre
Channel Adapter (FC EL5B; CCIN 577F); Adapter FRU number: 00E3496
|
5, 6, 7, 8, 10, 11 | 6 | 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 10 | Not supported | Not supported |
EL5Z | PCIe2 8 Gb 2-Port Fibre Channel Adapter (FC EL5Y and EL5Z;
CCIN 578D); Adapter FRU number: 00WT111
|
5, 6, 8, 10, 11 | 5 | 5, 2, 6, 4, 1, 8, 10, 11 | 8 | Not supported | Not supported |
EL65 | PCIe3
RAID SAS quad-port 6 Gb Adapter (FC EL59; CCIN 57B4); Adapter FRU
number: 000E9284
|
5, 6, 7, 8, 10, 11 | 6 | 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 10 | Not supported | Not supported |
EN0G | PCIe2 8Gb 2-Port Fibre Channel
Adapter (FC EN0F and EN0G; CCIN 578D); Adapter FRU number: 00WT111
|
5, 6, 8, 10, 11 | 5 | 5, 2, 6, 4, 1, 8, 10, 11 | 8 | Not supported | Not supported |
EN0S | PCIe2 4-port (10 Gb + 1 GbE)
SR+RJ45 Adapter (FC EN0S; CCIN 2CC3); Adapter FRU number: 00E2715;
Part number (Full-height tailstock): 00E2863; Part number (Low-profile
tailstock): 00E2720
|
9, 5, 6, 7, 8, 10, 11 | 7 | 9, 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 11 | 9, 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 2 |
EN0W | PCIe2
2-port 10 GbE BaseT RJ45 Adapter (FC EN0W; CCIN 2CC4); Adapter FRU number: 00E2714
|
Not supported | Not supported | Not supported | Not supported | 9, 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 2 |
EN12 | PCIe2 FH 4-port 8 Gb Fibre Channel Adapter (FC
EN12; CCIN EN0Y); Adapter FRU number 00WT107
|
11, 10, 8, 7, 6, 5 | 6 | 1, 11, 3, 10, 8, 7, 6, 2, 5, 4 | 10 | Not supported | Not supported |
EN15 | PCIe3
4-port 10 GbE SR Adapter (FC EN15; CCIN 2CE3); Adapter FRU number:
00ND466; full-height tailstock: 00ND462
|
9, 5, 6, 7, 8, 10, 11 | 7 | 9, 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 11 | Not supported | Not supported |
EN17 | PCIe3
4-port 10 GbE SFP+ Copper Adapter (FC EN17, CCIN 2CE4); Adapter FRU
number: 00ND463; full-height tailstock part number: 00ND465
|
9, 5, 6, 7, 8, 10, 11 | 7 | 9, 5, 2, 6, 4, 7, 1, 8, 3, 10, 11 | 11 | Not supported | Not supported |
EN27 | PCIe
2-port Async EIA-232 Adapter (FC EN27; CCIN 57D4); Adapter FRU number:
000ND487
|
11, 10, 8, 7, 6, 5 | 6 | 1, 11, 3, 10, 8, 7, 6, 2, 5, 4 | 10 | Not supported | Not supported |
1No mixing of GPU adapter FC EC47 and EC4B. 2The slot is not available to install other adapters in the expanded function system with FC EJ0P and EJ0Z installed in this slot. |