Lenovo ThinkSystem SR650 Series Setup Manual

Hide thumbs Also See for ThinkSystem SR650 Series:

Maintenance manual (244 pages)

Product manual (87 pages)

Quick start manual (14 pages)

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

141

142

143

144

145

146

147

148

149

150

151

152

153

154

155

156

157

158

159

160

161

162

163

164

165

166

167

168

169

170

171

172

173

174

175

176

177

178

179

180

181

182

183

184

185

186

187

188

189

190

191

192

193

194

195

196

197

198

199

200

201

202

203

204

205

206

207

208

209

210

211

212

213

214

215

216

217

218

219

220

221

222

223

224

225

226

page of 226

/ 226
Contents
Table of Contents
Bookmarks

Table of Contents

Quick Links

ThinkSystem SR650

Setup Guide

Machine Types: 7X05 and 7X06

Table of Contents

Chapters

Table of Contents

Summary of Contents for Lenovo ThinkSystem SR650 Series

Page 1 ThinkSystem SR650 Setup Guide Machine Types: 7X05 and 7X06...
Page 2 Before using this information and the product it supports, be sure to read and understand the safety information and the safety instructions, which are available at: http://thinksystem.lenovofiles.com/help/topic/safety_documentation/pdf_files.html In addition, be sure that you are familiar with the terms and conditions of the Lenovo warranty for your server, which can be found at: http://datacentersupport.lenovo.com/warrantylookup Ninth Edition (February 2020) ©...
Page 3: Table Of Contents
Power cords ....124 Set the network connection for the Lenovo XClarity Controller ....197 Chapter 3.
Page 4 ThinkSystem SR650 Setup Guide...
Page 5: Chapter 1. Introduction
Identifying your server When you contact Lenovo for help, the machine type and serial number information helps support technicians to identify your server and provide faster service. The machine type and serial number are on the ID label on the right rack latch in the front of the server.
Page 6 Scan the QR code with a mobile device and a QR code reader application to get quick access to the Lenovo Service web site for this server. The Lenovo Service Information Web site provides additional information for parts installation and replacement videos, and error codes for server support.
Page 7: Server Package Contents
Your server implements the following features and technologies: • Lenovo XClarity Controller (XCC) The Lenovo XClarity Controller is the common management controller for Lenovo Lenovo ThinkSystem server hardware. The Lenovo XClarity Controller consolidates multiple management functions in a single chip on the server system board.
Page 8 The server provides a QR code on the system service label, which is on the cover of the server, that you can scan using a QR code reader and scanner with a mobile device to get quick access to the Lenovo Service Information website.
Page 9: Specifications
• Redundant networking connection The Lenovo XClarity Controller provides failover capability to a redundant Ethernet connection with the applicable application installed. If a problem occurs with the primary Ethernet connection, all Ethernet traffic that is associated with the primary connection is automatically switched to the optional redundant Ethernet connection.
Page 10 – Scalable up to 28 cores – Thermal Design Power (TDP): up to 205 watts For a list of supported processors, see: https://static.lenovo.com/us/en/serverproven/index.shtml Notes: • Intel Xeon 6137, 6242R, 6246R, 6248R, 6250, 6256, or 6258R processor is supported only when the following requirements are met: –...
Page 11 • Operating speed and total memory capacity depend on the processor model and UEFI settings. • For a list of supported memory modules, see: https://static.lenovo.com/us/en/serverproven/index.shtml Internal drives The supported drives vary by models. • Up to eight 3.5-inch hot-swap SAS/SATA drives •...
Page 12 Table 1. Server specifications (continued) Specification Description • Up to twenty-four 2.5-inch hot-swap SAS/SATA/NVMe drives (NVMe drives are supported in drive bays 4–7, bays 12–15, and bays 20–23) • Up to twenty-four 2.5-inch NVMe drives (NVMe drives are supported in drive bays 0–23) •...
Page 13 Table 1. Server specifications (continued) Specification Description Graphics processing unit Your server supports the following GPUs or processing adapters: (GPU) • Full-height, full-length, double-slot GPUs or processing adapters: AMD MI25, ® AMD V340, NVIDIA M10, NVIDIA M60, NVIDIA P40, NVIDIA P100, NVIDIA P6000, NVIDIA RTX5000, NVIDIA V100, and NVIDIA V100S •...
Page 14 Table 1. Server specifications (continued) Specification Description – Five NVIDIA T4 or Cambricon MLU270-S4 GPUs are supported only for server models installed with two CPUs, and installed in slot 1, slot 2, slot 3, slot 5, and slot 6. – If NVIDIA P600, NVIDIA P620, NVIDIA P4000, NVIDIA RTX4000, NVIDIA P6000, or NVIDIA RTX5000 GPU is installed, the fan redundancy function is not supported.
Page 15 Table 1. Server specifications (continued) Specification Description Note: If 730-8i-2G Cache SAS/SATA adapter is installed, 730-8i-1G or 930-8i SAS/ SATA adapter cannot be installed. System fans • One processor: five hot-swap fans (including one redundant fan) • Two processors: six hot-swap fans (including one redundant fan) Notes: •...
Page 16 Table 1. Server specifications (continued) Specification Description Acoustical noise emissions • Sound power levels, idle – 4.9 bels, minimum – 5.1 bels, typical – 6.1 bels, maximum • Sound power levels, operating – 5.1 bels, minimum – 5.1 bels, typical –...
Page 17 Table 1. Server specifications (continued) Specification Description • PCIe flash adapter not installed • ThinkSystem QLogic QL41134 PCIe 10Gb 4-Port Base-T Ethernet Card not installed • Mellanox ConnectX-6 and Innova-2 FPGA not installed. • 240 GB or 480 GB M.2 drives not installed •...
Page 18: Management Options
Management options Several management interfaces are available for managing your server. The management options described in this section are provided to support the direct management of Lenovo servers. ThinkSystem SR650 Setup Guide...
Page 19 UEFI updates only. Firmware updates for optional devices, such as adapters, are not supported. 4. The server UEFI settings for option ROM must be set to Auto or UEFI to update firmware using Lenovo XClarity Administrator or Lenovo XClarity Essentials.
Page 20 Configuration settings (such as local storage, I/O adapters, boot settings, firmware, ports, and Lenovo XClarity Controller and UEFI settings) are saved as a server pattern that can be applied to one or more managed servers. When the server patterns are updated, the changes are automatically deployed to the applied servers.
Page 21 Windows, Linux, or VMware ESXi operating systems and associated device drivers. Note: When you start a server and press F1, the Lenovo XClarity Provisioning Manager interface is displayed by default. However, the text-based interface to system configuration (the Setup Utility) is also available.
Page 22 • Cloning. Use this function to clone settings in one server to other similarly configured Lenovo servers. – Export: Export UEFI, RAID, and BMC settings for the current server to files respectively and save the files to a USB storage drive or a shared network folder.
Page 23 Lenovo XClarity Controller Lenovo XClarity Controller is the management processor for the server. It is the third generation of the Integrated Management Module (IMM) service processor that consolidates the service processor functionality, super I/O, video controller, and remote presence capabilities into a single chip on the server system board.
Page 24 Lenovo Business Vantage Lenovo Business Vantage is a security software tool suite designed to work with the Trusted Cryptographic Module (TCM) adapter for enhanced security, to keep user data safe, and to erase confidential data completely from a hard disk drive.
Page 25: Chapter 2. Server Components
• The chassis for sixteen 2.5-inch-drive bays cannot be upgraded to the chassis for twenty-four 2.5-inch- drive bays. Figure 4. Front view of server models with eight 2.5-inch drive bays (0–7) Figure 5. Front view of server models with sixteen 2.5-inch drive bays (0–15) © Copyright Lenovo 2017, 2020...
Page 26 Figure 6. Front view of server models with twenty 2.5-inch drive bays (0–19) Figure 7. Front view of server models with twenty-four 2.5-inch drive bays (0–23) Figure 8. Front view of server models with eight 3.5-inch drive bays (0–7) Figure 9. Front view of server models with twelve 3.5-inch drive bays (0–11) ThinkSystem SR650 Setup Guide...
Page 27 Table 2. Components on the front of server models with 2.5-inch drives Callout Callout Pull-out information tab Front I/O assembly Drive bays Rack latch (right) Rack latch (left) VGA connector (available on some models) Drive activity LED Drive status LED Drive bay filler Pull-out information tab The XClarity Controller network access label is attached on the top side of the pull-out information tab.
Page 28: Front I/O Assembly
Drive LED Status Description Blinking yellow (blinking rapidly, about four The RAID adapter is locating the drive. flashes per second) Drive bay filler The drive bay filler is used to cover vacant drive bays. Front I/O assembly The front I/O assembly of the server provides controls, connectors, and LEDs. The front I/O assembly varies by model.
Page 29 • If the connector is set to have both functions, you can press the system ID button for three seconds to switch between the two functions. For more information, see “Set the network connection for the Lenovo XClarity Controller” on page 197. USB 3.0 connector Used to attach a device that requires a USB 2.0 or 3.0 connection, such as a keyboard, a mouse, or a USB...
Page 30: Rear View
Each time you press the system ID button, the state of both the system ID LEDs changes. The LEDs can be changed to on, blinking, or off. You can also use the Lenovo XClarity Controller or a remote management program to change the state of the system ID LEDs to assist in visually locating the server among other servers.
Page 31 Figure 12. Rear view of server models with six PCIe slots Figure 13. Rear view of server models with two rear 3.5-inch drive bays (12/13 or 24/25) and three PCIe slots Table 4. Components on the rear of the server Callout Callout Ethernet connectors on the LOM adapter (available on...
Page 32 The hot-swap redundant power supplies help you avoid significant interruption to the operation of the system when a power supply fails. You can purchase a power supply option from Lenovo and install the power supply to provide power redundancy without turning off the server.
Page 33: Rear View Leds
– Slot 2: Not available – Slot 3: PCIe x16 (x8, x4, x1), full-height, half-length • Type 4 – Slot 1: PCIe x16 (x8, x4, x1), full-height, half-length/full-height, full-length – Slot 2: Not available – Slot 3: ML2 x16 (x16, x8, x4, x1), full-height, half-length •...
Page 34 Each time you press the system ID button, the state of both the system ID LEDs changes. The LEDs can be changed to on, blinking, or off. You can also use the Lenovo XClarity Controller or a remote management program to change the state of the system ID LEDs to assist in visually locating the server among other servers.
Page 35 Description Power input LED • Green: The power supply is connected to the ac power source. • Off: The power supply is disconnected from the ac power source or a power problem occurs. Power output LED • Green: The server is on and the power supply is working normally. •...
Page 36: System Board Components
System board components The illustration in this section shows the component locations on the system board. Figure 15. System board components Table 6. Components on the system board Callout Callout Riser 2 slot Serial-port-module connector PCIe slot 4 RAID adapter slot Riser 1 slot BIOS ROM programming connector LOM adapter connector...
Page 37: System Board Leds
Table 6. Components on the system board (continued) Callout Callout System fan 5 connector System fan 6 connector Backplane power connector 1 NVMe 2–3 connector NVMe 0–1 connector GPU power connector 1 CMOS battery M.2 module slot (SATA / PCIe slot 8) Notes: •...
Page 38 Each time you press the system ID button, the state of both the system ID LEDs changes. The LEDs can be changed to on, blinking, or off. You can also use the Lenovo XClarity Controller or a remote management program to change the state of the system ID LEDs to assist in visually locating the server among other servers.
Page 39: Internal Cable Routing
Internal cable routing Some of the components in the server have internal cables and cable connectors. To connect cables, observe the following guidelines: • Turn off the server before you connect or disconnect any internal cables. • See the documentation that comes with any external devices for additional cabling instructions. It might be easier for you to route cables before you connect the devices to the server.
Page 40 Server models with up to two GPUs Figure 17. Cable routing for server models with up to two GPUs Cable From GPU power cable Power connector on the GPU GPU power connector 1 on the installed in PCIe slot 5 system board GPU power cable Power connector on the GPU...
Page 41 Server models with up to three GPUs Figure 18. Cable routing for server models with up to three GPUs Cable From GPU power cable Power connectors on the GPUs GPU power connector 1 on the installed in PCIe slots 5 and 6 system board GPU power cable Power connector on the GPU...
Page 42 Server models with two Cambricon MLU100-C3 processing adapters Figure 19. Cable routing for server models with two Cambricon MLU100-C3 processing adapters Cable From GPU power cable Power connectors on the adapters GPU power connector 1 on the installed in PCIe slots 5 and 6 system board ThinkSystem SR650 Setup Guide...
Page 43 Server models with four Cambricon MLU100-C3 processing adapters Figure 20. Cable routing for server models with four Cambricon MLU100-C3 processing adapters From Cable GPU power cable Power connectors on the adapters GPU power connector 1 on the installed in PCIe slots 5 and 6 system board Power connectors on the adapters GPU power cable...
Page 44: Backplane
Backplane Use the section to understand the cable routing for backplanes. This topic contains the following information: • “Server models with eight 2.5-inch drives” on page 42 • “Server models with sixteen 2.5-inch drives” on page 53 • “Server models with twenty 2.5-inch drives” on page 72 •...
Page 45 Chapter 2 Server components...
Page 46 Server models with eight 2.5-inch drives Use this section to understand the cable routing for server models with eight 2.5-inch drives. Server model: eight 2.5-inch SAS/SATA drives, the rear hot-swap drive assembly, one 16i RAID adapter Note: The cable routing illustration is based on the scenario that the rear hot-swap drive assembly is installed.
Page 47 Cable From Power cable for front backplane Power connector on front backplane Backplane power connector 1 on the system board SAS signal cable for front SAS 0 and SAS 1 connectors on front C0 and C1 connectors on the 16i backplane backplane RAID adapter installed on the RAID...
Page 48 Server model: eight 2.5-inch SAS/SATA drives, the rear hot-swap drive assembly, one 24i RAID adapter Note: The cable routing illustration is based on the scenario that the rear hot-swap drive assembly is installed. Depending on the model, the rear hot-swap drive assembly and the cable might not be available on your server.
Page 49 Server model: eight 2.5-inch SAS/SATA drives, the rear hot-swap drive assembly, two 8i RAID adapters Note: The cable routing illustration is based on the scenario that the rear hot-swap drive assembly is installed. Depending on the model, the rear hot-swap drive assembly and the 8i RAID adapter in PCIe slot 4 might not be available on your server.
Page 50 Server model: eight 2.5-inch SAS/SATA drives, one 730-8i 4G Flash SAS/SATA RAID adapter with CacheCade Note: This configuration is available for some models only. Figure 24. Cable routing for server models with eight 2.5-inch SAS/SATA drives, and one 730-8i 4G Flash SAS/SATA RAID adapter with CacheCade Cable From...
Page 51 Server model: eight 2.5-inch SAS/SATA drives, Intel Xeon 6137, 6242R, 6246R, 6248R, 6250, 6256, or 6258R processors, one 8i RAID adapter Figure 25. Cable routing for server models with eight 2.5-inch SAS/SATA drives, Intel Xeon 6137, 6242R, 6246R, 6248R, 6250, 6256, or 6258R processors, and one 8i RAID adapter Cable From SAS signal cable for front...
Page 52 Server model: four 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, the rear hot-swap drive assembly, two 8i RAID adapters Note: The cable routing illustration is based on the scenario that the rear hot-swap drive assembly is installed. Depending on the model, the rear hot-swap drive assembly and the 8i RAID adapter in PCIe slot 4 might not be available on your server.
Page 53 Cable From NVMe signal cable for front NVMe 0, NVMe 1, NVMe 2, and NVMe 0–1 and NVMe 2–3 connectors backplane NVMe 3 connectors on front on the system board backplane SAS signal cable for the rear hot- Signal connector on the rear hot- C0 connector on the 8i RAID adapter swap drive assembly swap drive assembly...
Page 54 Cable From Power cable for front backplane Power connector on front backplane Backplane power connector 1 on the system board SAS signal cable for front SAS 0 and SAS 1 connectors on front C0 and C1 connectors on the 16i backplane backplane RAID adapter installed on the RAID...
Page 55 Server model: four 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, the rear hot-swap drive assembly, one 24i RAID adapter Note: The cable routing illustration is based on the scenario that the rear hot-swap drive assembly is installed. Depending on the model, the rear hot-swap drive assembly and the cable might not be available on your server.
Page 56 Server model: four 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, Intel Xeon 6137, 6242R, 6246R, 6248R, 6250, 6256, or 6258R processors, one 8i RAID adapter Figure 29. Cable routing for server models with four 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, Intel Xeon 6137, 6242R, 6246R, 6248R, 6250, 6256, or 6258R processors, and one 8i RAID adapter Cable From...
Page 57 Server models with sixteen 2.5-inch drives Use this section to understand the cable routing for server models with sixteen 2.5-inch drives. Server model: sixteen 2.5-inch SAS/SATA drives, one 16i RAID adapter Figure 30. Cable routing for server models with sixteen 2.5-inch SAS/SATA drives and one 16i RAID adapter Cable From Power cable for front backplane 1...
Page 58 Cable From SAS signal cable for front SAS 0 and SAS 1 connectors on front C2 and C3 connectors on the 16i backplane 2 backplane 2 RAID adapter installed on the RAID adapter slot Power cable for front backplane 2 Power connector on front backplane Backplane power connector 2 on the system board...
Page 59 Server model: sixteen 2.5-inch SAS/SATA drives, the rear hot-swap drive assembly, one 8i RAID adapter, one 16i RAID adapter Figure 31. Cable routing for server models with sixteen 2.5-inch SAS/SATA drives, the rear hot-swap drive assembly, one 8i RAID adapter, and one 16i RAID adapter Cable From Power cable for front backplane 1...
Page 60 Server model: sixteen 2.5-inch SAS/SATA drives, the rear hot-swap drive assembly, one 24i RAID adapter Note: The cable routing illustration is based on the scenario that the rear hot-swap drive assembly is installed. Depending on the model, the rear hot-swap drive assembly and the cable might not be available on your server.
Page 61 Cable From Power cable for front backplane 2 Power connector on front backplane Backplane power connector 2 on the system board SAS signal cable for the rear hot- Signal connector on the rear hot- C4 connector on the 24i RAID swap drive assembly swap drive assembly adapter installed in PCIe slot 5...
Page 62 Server model: sixteen 2.5-inch SAS/SATA drives, the rear hot-swap drive assembly, three 8i RAID adapters Note: The cable routing illustration is based on the scenario that the rear hot-swap drive assembly is installed. Depending on the model, the rear hot-swap drive assembly and the 8i RAID adapter in PCIe slot 5 might not be available on your server.
Page 63 Cable From Power cable for front backplane 2 Power connector on front backplane Backplane power connector 2 on the system board SAS signal cable for the rear hot- Signal connector on the rear hot- C0 connector on the 8i RAID adapter swap drive assembly swap drive assembly installed in PCIe slot 5...
Page 64 Server model: twelve 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, one 16i RAID adapter Figure 34. Cable routing for server models with twelve 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, and one 16i RAID adapter Cable From Power cable for front backplane 1 Power connector on backplane 1 Backplane power connector 1 on the system board...
Page 65 Server model: twelve 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, one 24i RAID adapter Figure 35. Cable routing for server models with twelve 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, and one 24i RAID adapter Cable From Power cable for front backplane 1 Power connector on backplane 1 Backplane power connector 1 on the system board...
Page 66 Server model: twelve 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, the rear hot- swap drive assembly, one 8i RAID adapter, one 16i RAID adapter Figure 36. Cable routing for server models with twelve 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, the rear hot-swap drive assembly, one 8i RAID adapter, and one 16i RAID adapter Cable From...
Page 67 Server model: twelve 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, the rear hot- swap drive assembly, one 24i RAID adapter Figure 37. Cable routing for server models with twelve 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, the rear hot-swap drive assembly, and one 24i RAID adapter Cable From Power cable for front backplane 1...
Page 68 Server model: eight 2.5-inch SAS/SATA drives, eight 2.5-inch SAS/SATA/NVMe drives, one 16i RAID adapter, one NVMe switch adapter Note: The cable routing illustration is based on the scenario that the NVMe switch adapter is installed in PCIe slot 1. If the NVMe switch adapter is installed in PCIe slot 5 or PCIe slot 6, route the NVMe signal cable for front backplane 2 along the left side of the chassis.
Page 69 Cable From Power cable for front backplane 2 Power connector on front backplane Backplane power connector 2 on the system board NVMe signal cable for front NVMe 0, NVMe 1, NVMe 2, and C0, C1, C2, and C3 connectors on backplane 2 NVMe 3 connectors on front the NVMe switch adapter installed in...
Page 70 Cable From SAS signal cable for front SAS 0 and SAS 1 connectors on front C0 and C1 connectors on the 16i backplane 2 backplane 2 RAID adapter installed in PCIe slot 4 Backplane power connector 2 on the Power cable for front backplane 2 Power connector on front backplane system board SAS signal cable for the rear hot-...
Page 71 Server model: eight 2.5-inch SAS/SATA drives, eight 2.5-inch SAS/SATA/NVMe drives, the rear hot- swap drive assembly, three 8i RAID adapters, one NVMe switch adapter Notes: • The cable routing illustration is based on the scenario that the rear hot-swap drive assembly is installed. Depending on the model, the rear hot-swap drive assembly and the 8i RAID adapter in PCIe slot 6 might not be available on your server.
Page 72 Cable From SAS signal cable for front SAS 0 and SAS 1 connectors on front C0 and C1 connectors on the 8i RAID backplane 2 backplane 2 adapter installed in PCIe slot 4 Backplane power connector 2 on the Power cable for front backplane 2 Power connector on front backplane system board SAS signal cable for the rear hot-...
Page 73 Server model: eight 2.5-inch SAS/SATA drives, eight 2.5-inch SAS/SATA/NVMe drives, the rear hot- swap drive assembly, one 24i RAID adapter, one NVMe switch adapter Note: The cable routing illustration is based on the scenario that the rear hot-swap drive assembly is installed.
Page 74 Cable From Power cable for front backplane 2 Power connector on front backplane Backplane power connector 2 on the system board SAS signal cable for the rear hot- Signal connector on the rear hot- C4 connector on the 24i RAID swap drive assembly swap drive assembly adapter installed in PCIe slot 6...
Page 75 Server model: sixteen 2.5-inch NVMe drives, two NVMe 810-4P switch adapters, two NVMe 1610-4P switch adapters Figure 42. Cable routing for server models with sixteen 2.5-inch NVMe drives, two NVMe 810-4P switch adapters, and two NVMe 1610-4P switch adapters Cable From Power cable for front backplane 1 Power connector on front backplane...
Page 76 Server models with twenty 2.5-inch drives Use this section to understand the cable routing for server models with twenty 2.5-inch drives. Server model: twenty 2.5-inch NVMe drives, two NVMe 810-4P switch adapters, three NVMe 1610-4P switch adapters Figure 43. Cable routing for server models with twenty 2.5-inch NVMe drives, two NVMe 810-4P switch adapters, and three NVMe 1610-4P switch adapters Cable From...
Page 77: Power Cable For Front Backplane
Cable From NVMe signal cable for front NVMe 3 connector on front C0 and C1 connectors on the NVMe backplane 2 backplane 2 810-4P switch adapter installed in RAID adapter slot on the system board Power cable for front backplane 3 Power connector on front backplane Backplane power connector 3 on the system board...
Page 78 Cable From SAS signal cable for front SAS 0 and SAS 1 connectors on front C0 and C1 connectors on the 16i backplane 2 backplane 2 RAID adapter installed in PCIe slot 4 Backplane power connector 2 on the Power cable for front backplane 2 Power connector on front backplane system board Backplane power connector 3 on the...
Page 79 Server model: twenty-four 2.5-inch SAS/SATA drives, one 24i RAID adapter Figure 45. Cable routing for server models with twenty-four 2.5-inch SAS/SATA drives and one 24i RAID adapter From Cable Power cable for front backplane 1 Power connector on front backplane Backplane power connector 1 on the system board SAS signal cable for front...
Page 80 Cable From Power cable for front backplane 3 Power connector on front backplane Backplane power connector 3 on the system board SAS signal cable for front SAS 0 and SAS 1 connectors on front C4 and C5 connectors on the 24i backplane 3 backplane 3 RAID adapter installed on riser 1...
Page 81 Server model: twenty-four 2.5-inch SAS/SATA drives, the rear hot-swap drive assembly, four 8i RAID adapters Note: The cable routing illustration is based on the scenario that the rear hot-swap drive assembly is installed. Depending on the model, the rear hot-swap drive assembly and the 8i RAID adapter in PCIe slot 6 might not be available on your server.
Page 82: Sas Signal Cable For The Rear Hot- Swap Drive Assembly
Cable From SAS signal cable for front SAS 0 and SAS 1 connectors on front C0 and C1 connectors on the 8i RAID backplane 3 backplane 3 adapter installed in PCIe slot 5 SAS signal cable for the rear hot- Signal connector on the rear hot- C0 connector on the 8i RAID adapter swap drive assembly...
Page 83 Server model: twenty-four 2.5-inch SAS/SATA drives, the rear hot-swap drive assembly, two 8i RAID adapters, one 16i RAID adapter Figure 47. Cable routing for server models with twenty-four 2.5-inch SAS/SATA drives, the rear hot-swap drive assembly, two 8i RAID adapters, and one 16i RAID adapter Cable From Power cable for front backplane 1...
Page 84: Backplane Power Connector 1 On The
Server model: twenty-four 2.5-inch SAS/SATA drives, the rear hot-swap drive assembly, one 8i RAID adapter, one 24i RAID adapter Figure 48. Cable routing for server models with twenty-four 2.5-inch SAS/SATA drives, the rear hot-swap drive assembly, one 8i RAID adapter, and one 24i RAID adapter Cable From Backplane power connector 1 on the...
Page 85 Cable From SAS signal cable for front SAS 0 and SAS 1 connectors on front C4 and C5 connectors on the 24i backplane 3 backplane 3 RAID adapter installed in PCIe slot 5 SAS signal cable for the rear hot- Signal connector on the rear hot- C0 connector on the 8i RAID adapter swap drive assembly...
Page 86: Adapter Installed In Pcie Slot 4
Server model: twenty-four 2.5-inch SAS/SATA drives, the rear hot-swap drive assembly, two 16i RAID adapters Figure 49. Cable routing for server models with twenty-four 2.5-inch SAS/SATA drives, the rear hot-swap drive assembly, and two 16i RAID adapters Cable From Power cable for front backplane 1 Power connector on front backplane Backplane power connector 1 on the system board...
Page 87 Server model: twenty 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, one 8i RAID adapter, one 16i RAID adapter Figure 50. Cable routing for server models with twenty 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, one 8i RAID adapter, and one 16i RAID adapter Cable From Power cable for front backplane 1...
Page 88 Server model: twenty 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, one 24i RAID adapter Figure 51. Cable routing for server models with twenty 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, and one 24i RAID adapter Cable From Power cable for front backplane 1 Power connector on front backplane Backplane power connector 1 on the system board...
Page 89 Cable From Power cable for front backplane 3 Power connector on front backplane Backplane power connector 3 on the system board SAS signal cable for front SAS 0 and SAS 1 connectors on front C4 and C5 connectors on the 24i backplane 3 backplane 3 RAID adapter installed on riser 1...
Page 90 Server model: twenty 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, the rear hot- swap drive assembly, four 8i RAID adapters Note: The cable routing illustration is based on the scenario that the rear hot-swap drive assembly is installed. Depending on the model, the rear hot-swap drive assembly and the 8i RAID adapter in PCIe slot 6 might not be available on your server.
Page 91 Cable From SAS signal cable for front SAS 0 and SAS 1 connectors on front C0 and C1 connectors on the 8i RAID backplane 3 backplane 3 adapter installed in PCIe slot 5 SAS signal cable for the rear hot- Signal connector on the rear hot- C0 connector on the 8i RAID adapter swap drive assembly...
Page 92 Server model: twenty 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, the rear hot- swap drive assembly, two 8i RAID adapters, one 16i RAID adapter Figure 53. Cable routing for server models with twenty 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, the rear hot-swap drive assembly, two 8i RAID adapters, and one 16i RAID adapter Cable From...
Page 93 Cable From SAS signal cable for front SAS 0 and SAS 1 connectors on front C0 and C1 connectors on the 16i backplane 3 backplane 3 RAID adapter installed in PCIe slot 5 SAS signal cable for the rear hot- Signal connector on the rear hot- C2 connector on the 16i RAID swap drive assembly...
Page 94 Server model: twenty 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, the rear hot- swap drive assembly, one 8i RAID adapter, one 24i RAID adapter Figure 54. Cable routing for server models with twenty 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, the rear hot-swap drive assembly, one 8i RAID adapter, and one 24i RAID adapter Cable From...
Page 95 Cable From SAS signal cable for front SAS 0 and SAS 1 connectors on front C4 and C5 connectors on the 24i backplane 3 backplane 3 RAID adapter installed in PCIe slot 5 SAS signal cable for the rear hot- Signal connector on the rear hot- C0 connector on the 8i RAID adapter swap drive assembly...
Page 96 Server model: twenty 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, the rear hot- swap drive assembly, two 16i RAID adapters Figure 55. Cable routing for server models with twenty 2.5-inch SAS/SATA drives, four 2.5-inch SAS/SATA/NVMe drives, the rear hot-swap drive assembly, and two 16i RAID adapters Cable From Power cable for front backplane 1...
Page 97 Cable From SAS signal cable for front SAS 0 and SAS 1 connectors on front C0 and C1 connectors on the 16i backplane 3 backplane 3 RAID adapter installed in PCIe slot 4 SAS signal cable for the rear hot- Signal connector on the rear hot- C2 connector on the 16i RAID swap drive assembly...
Page 98 Server model: sixteen 2.5-inch SAS/SATA drives, eight 2.5-inch SAS/SATA/NVMe drives, one 24i RAID adapter, one NVMe switch adapter Figure 56. Cable routing for server models with sixteen 2.5-inch SAS/SATA drives, eight 2.5-inch SAS/SATA/NVMe drives, one 24i RAID adapter, and one NVMe switch adapter From Cable Power cable for front backplane 1...
Page 99 Cable From Power cable for front backplane 3 Power connector on front backplane Backplane power connector 3 on the system board SAS signal cable for front SAS 0 and SAS 1 connectors on front C4 and C5 connectors on the 24i backplane 3 backplane 3 RAID adapter installed on an...
Page 100 Server model: sixteen 2.5-inch SAS/SATA drives, eight 2.5-inch SAS/SATA/NVMe drives, the rear hot- swap drive assembly, one 8i RAID adapter, one 24i RAID adapter, one NVMe switch adapter Figure 57. Cable routing for server models with sixteen 2.5-inch SAS/SATA drives, eight 2.5-inch SAS/SATA/NVMe drives, the rear hot-swap drive assembly, one 8i RAID adapter, one 24i RAID adapter, and one NVMe switch adapter Cable From...
Page 101 Cable From SAS signal cable for front SAS 0 and SAS 1 connectors on front C4 and C5 connectors on the 24i backplane 3 backplane 3 RAID adapter installed in PCIe slot 6 SAS signal cable for the rear hot- Signal connector on the rear hot- C0 connector on the 8i RAID adapter swap drive assembly...
Page 102 Server model: sixteen 2.5-inch SAS/SATA drives, eight 2.5-inch SAS/SATA/NVMe drives, the rear hot- swap drive assembly, two 16i RAID adapters, one NVMe switch adapter Figure 58. Cable routing for server models with sixteen 2.5-inch SAS/SATA drives, eight 2.5-inch SAS/SATA/NVMe drives, the rear hot-swap drive assembly, two 16i RAID adapters, and one NVMe switch adapter Cable From Power cable for front backplane 1...
Page 103 Cable From Power cable for front backplane 3 Power connector on front backplane Backplane power connector 3 on the system board SAS signal cable for front SAS 0 and SAS 1 connectors on front C0 and C1 connectors on the 16i backplane 3 backplane 3 RAID adapter installed in PCIe slot 4...
Page 104 Server model: sixteen 2.5-inch SAS/SATA drives, eight 2.5-inch SAS/SATA/NVMe drives, the rear hot- swap drive assembly, two 8i RAID adapters, one 16i RAID adapter, one NVMe switch adapter Note: The cable routing illustration is based on the scenario that the rear hot-swap drive assembly is installed.
Page 105 Cable From SAS signal cable for front SAS 0 and SAS 1 connectors on front C0 and C1 connectors on the 8i RAID backplane 2 backplane 2 adapter installed in PCIe slot 4 NVMe 0, NVMe 1, NVMe 2, and NVMe signal cable for front C0, C1, C2, and C3 connectors on backplane 2...
Page 106 Server model: twelve 2.5-inch SAS/SATA drives, twelve 2.5-inch SAS/SATA/NVMe drives, one 24i RAID adapter, two NVMe switch adapters Figure 60. Cable routing for server models with twelve 2.5-inch SAS/SATA drives, twelve 2.5-inch SAS/SATA/NVMe drives, one 24i RAID adapter, and two NVMe switch adapters Cable From Power cable for front backplane 1...
Page 107 Cable From Power cable for front backplane 3 Power connector on front backplane Backplane power connector 3 on the system board NVMe signal cable for front NVMe 0, NVMe 1, NVMe 2, and C0, C1, C2, and C3 connectors on backplane 3 NVMe 3 connectors on front the NVMe switch adapter installed in...
Page 108 Server model: twelve 2.5-inch SAS/SATA drives, twelve 2.5-inch SAS/SATA/NVMe drives, three 8i RAID adapters, two NVMe switch adapters Figure 61. Cable routing for server models with twelve 2.5-inch SAS/SATA drives, twelve 2.5-inch SAS/SATA/NVMe drives, three 8i RAID adapters, and two NVMe switch adapters Cable From Power cable for front backplane 1...
Page 109 Cable From NVMe signal cable for front NVMe 0, NVMe 1, NVMe 2, and C0, C1, C2, and C3 connectors on backplane 2 NVMe 3 connectors on front the NVMe switch adapter installed in backplane 2 PCIe slot 5 Power cable for front backplane 2 Power connector on front backplane Backplane power connector 2 on the system board...
Page 110 Server model: twelve 2.5-inch SAS/SATA drives, twelve 2.5-inch SAS/SATA/NVMe drives, one 8i RAID adapter, one 16i RAID adapters, two NVMe switch adapters Figure 62. Cable routing for server models with twelve 2.5-inch SAS/SATA drives, twelve 2.5-inch SAS/SATA/NVMe drives, one 8i RAID adapter, one 16i RAID adapters, and two NVMe switch adapters Cable From Backplane power connector 1 on the...
Page 111 Cable From NVMe signal cable for front NVMe 0, NVMe 1, NVMe 2, and C0, C1, C2, and C3 connectors on backplane 2 NVMe 3 connectors on front the NVMe switch adapter installed in backplane 2 PCIe slot 5 Power cable for front backplane 2 Power connector on front backplane Backplane power connector 2 on the system board...
Page 112 Server model: sixteen 2.5-inch NVMe drives, eight SAS/SATA drives, two NVMe 810-4P switch adapters, two NVMe 1610-4P switch adapters, one 8i RAID adapter Figure 63. Cable routing for server models with sixteen 2.5-inch NVMe drives, eight SAS/SATA drives, two NVMe 810-4P switch adapters, two NVMe 1610-4P switch adapters and one 8i RAID adapter Cable From...
Page 113 Cable From Power cable for front backplane 3 Power connector on front backplane Backplane power connector 3 on the system board SAS signal cable for front SAS 0 and SAS 1 connectors on front C0 and C1 connectors on the 8i RAID backplane 3 backplane 3 adapter installed in PCIe slot 3...
Page 114 Server model: twenty-four 2.5-inch NVMe drives, four NVMe 810-4P switch adapters, one NVMe 1610- 8P switch adapter Figure 64. Cable routing for server models with twenty-four 2.5-inch NVMe drives, four NVMe 810-4P switch adapters, and one NVMe 1610-8P switch adapter Cable From Power cable for front backplane 1...
Page 115 Cable From Power cable for front backplane 3 Power connector on front backplane Backplane power connector 3 on the system board NVMe signal cable for front NVMe 0 and NVMe 1 connectors on C0, C1, C2, and C3 connectors on backplane 3 front backplane 3 the NVMe 810-4P switch adapter...
Page 116 Server models with eight 3.5-inch drives Use this section to understand the cable routing for server models with eight 3.5-inch SAS/SATA drives. Server model: eight 3.5-inch SAS/SATA drives, the rear hot-swap drive assembly, two 8i RAID adapters Note: The cable routing illustration is based on the scenario that the rear hot-swap drive assembly is installed.
Page 117 Cable From Power cable Power connector on the backplane Backplane power connector 1 on the system board SAS signal cable SAS 0 and SAS 1 connectors on the C0 and C1 connectors on the 8i RAID backplane adapter installed on the RAID adapter slot SAS signal cable for the rear hot- Signal connector on the rear hot-...
Page 118 Server model: eight 3.5-inch SAS/SATA drives, the rear hot-swap drive assembly, one 16i RAID adapter Figure 66. Cable routing for server models with eight 3.5-inch SAS/SATA drives, the rear hot-swap drive assembly, and one 16i RAID adapter From Cable Power cable Power connector on the backplane Backplane power connector 1 on the system board...
Page 119 Server models with twelve 3.5-inch drives Use this section to understand the cable routing for server models with twelve 3.5-inch drives. Server model: twelve 3.5-inch SAS/SATA drives, the rear hot-swap drive assembly, one 16i RAID adapter Note: The cable routing illustration is based on the scenario that the rear hot-swap drive assembly is installed.
Page 120 Cable From Power cable Power 2 connector on the front Backplane power connector 2 on the backplane system board SAS signal cable for the rear hot- Signal connector on the rear hot- C3 connector on the 16i RAID swap drive assembly swap drive assembly adapter installed on the RAID adapter slot...
Page 121 Server model: twelve 3.5-inch SAS/SATA drives, the rear hot-swap drive assembly, one 8i RAID adapter, one 16i RAID adapter Note: The cable routing illustration is based on the scenario that the rear hot-swap drive assembly is installed. Depending on the model, the rear hot-swap drive assembly and the 8i RAID adapter might not be available on your server.
Page 122 Cable From Power cable Power 2 connector on the front Backplane power connector 2 on the backplane system board SAS signal cable for the rear hot- Signal connector on the rear hot- C0 connector on the 8i RAID adapter swap drive assembly swap drive assembly installed in PCIe slot 4 ThinkSystem SR650 Setup Guide...
Page 123 Server model: eight 3.5-inch SAS/SATA drives, four 3.5-inch SAS/SATA/NVMe drives, the rear hot- swap drive assembly, one 16i RAID adapter Note: The cable routing illustration is based on the scenario that the rear hot-swap drive assembly is installed. Depending on the model, the rear hot-swap drive assembly might not be available on your server. Figure 69.
Page 124 Server model: eight 3.5-inch SAS/SATA drives, four 3.5-inch NVMe drives, one 8i RAID adapter Figure 70. Cable routing for server models with eight 3.5-inch SAS/SATA drives, four 3.5-inch NVMe drives, and one 8i RAID adapter Cable From Power cable Power 1 connector on the backplane Backplane power connector 1 on the system board SAS signal cable...
Page 125: Parts List
Use the parts list to identify each of the components that are available for your server. For more information about ordering the parts shown in Figure 71 “Server components” on page 121: http://datacentersupport.lenovo.com/us/en/products/servers/thinksystem/sr650/7x05/parts Note: Depending on the model, your server might look slightly different from the illustration.
Page 126 Tier 1 CRU at your request with no service agreement, you will be charged for the installation. • Tier 2 customer replaceable unit: You may install a Tier 2 CRU yourself or request Lenovo to install it, at no additional charge, under the type of warranty service that is designated for your server.
Page 127 Table 8. Parts listing (continued) Consumable Description Index Tier 1 CRU Tier 2 CRU Structural parts Left rack latch, with VGA connector √ Right rack latch, without front I/O √ assembly Left rack latch, without VGA connector √ Chassis √ Security bezel √...
Page 128: Power Cords
Several power cords are available, depending on the country and region where the server is installed. To view the power cords that are available for the server: 1. Go to: http://dcsc.lenovo.com/#/ 2. Click Preconfigured Model or Configure to order. 3. Enter the machine type and model for your server to display the configurator page.
Page 129: Chapter 3. Server Hardware Setup
Validate that the server hardware was set up successfully. See “Validate server setup” on page 194. 3. Configure the system. a. Connect the Lenovo XClarity Controller to the management network. See “Set the network connection for the Lenovo XClarity Controller” on page 197.
Page 130: Installation Guidelines
• Make sure the components you are installing are supported by the server. For a list of supported optional components for the server, see https://static.lenovo.com/us/en/serverproven/index.shtml • When you install a new server, download and apply the latest firmware. This will help ensure that any known issues are addressed, and that your server is ready to work with optimal performance.
Page 131: System Reliability Guidelines
Note: See the system specific instructions for removing or installing a hot-swap drive for any additional procedures that you might need to perform before you remove or install the drive. • After finishing working on the server, make sure you reinstall all safety shields, guards, labels, and ground wires.
Page 132: Install Server Hardware Options
• Make sure the components you are installing are supported by the server. For a list of supported optional components for the server, see https://static.lenovo.com/us/en/serverproven/index.shtml • Always download and apply the latest firmware. This will help ensure that any known issues are addressed, and that your server is ready to work with optimal performance.
Page 133: Remove The Top Cover
Watch the procedure. A video of the removal process is available: • Youtube: https://www.youtube.com/playlist?list=PLYV5R7hVcs-A25P7vBoGa_wn7D7XTgDS_ • Youku: http://list.youku.com/albumlist/show/id_50483444 Step 1. Use the key to unlock the security bezel to the open position. Figure 72. Unlocking the security bezel Step 2. Press the release latch and pivot the security bezel outward to remove it from the chassis.
Page 134 “Read the “Power off “ATTENTION: installation the server for Static Sensitive Device Guidelines” on this task” on Ground package before opening” page 126 page 194 on page 127 S033 CAUTION: Hazardous energy present. Voltages with hazardous energy might cause heating when shorted with metal, which might result in spattered metal, burns, or both.
Page 135: Remove The Air Baffle
Figure 74. Top cover removal Step 1. Use a screwdriver to turn the cover lock to the unlocked position as shown. Step 2. Press the release button on the cover latch and then fully open the cover latch. Step 3. Slide the top cover to the rear until it is disengaged from the chassis.
Page 136 CAUTION: Hazardous energy present. Voltages with hazardous energy might cause heating when shorted with metal, which might result in spattered metal, burns, or both. S017 CAUTION: Hazardous moving fan blades nearby. Before removing the air baffle, if there is a RAID super capacitor module installed on top of the air baffle, remove the RAID super capacitor module first.
Page 137: Remove The System Fan Cage
Figure 76. Removal of the large-size air baffle Remove the system fan cage The system fan cage might impede your access to some connectors. You must remove the system fan cage before you route cables. “Read the “Power off “ATTENTION: installation the server for Static Sensitive Device...
Page 138: Install A Processor-Heat-Sink Module
Figure 77. System fan cage removal Step 1. Rotate the levers of the system fan cage to the rear of the server. Step 2. Lift the system fan cage straight up and out of the chassis. After removing the system fan cage, begin installing any options that you have purchased. Install a processor-heat-sink module This task has instructions for installing an assembled processor and heat sink, known as a processor-heat- sink module (PHM), a processor, and a heat sink.
Page 139 • See for a list of processors supported for your https://static.lenovo.com/us/en/serverproven/index.shtml server. All processors on the system board must have the same speed, number of cores, and frequency. • Before you install a new PHM or replacement processor, update your system firmware to the latest level.
Page 140: Install A Memory Module
Step 2. Install the processor-heat-sink module on the system board. Figure 78. Installing a PHM Align the triangular marks and guide pins on the processor socket with the PHM; then, insert the PHM into the processor socket. Attention: To prevent damage to components, make sure that you follow the indicated tightening sequence.
Page 141 “Read the “Power off “ATTENTION: installation the server for Static Sensitive Device Guidelines” on this task” on Ground package before opening” page 126 page 194 on page 127 Attention: • Disconnect all power cords for this task. • memory modules are sensitive to static discharge and require special handling. In addition to the standard guidelines for Handling static-sensitive devices: –...
Page 142 Figure 79. memory module installation Step 1. Open the retaining clips on each end of the memory module slot. Attention: To avoid breaking the retaining clips or damaging the memory module slots, open and close the clips gently. Step 2. Align the memory module with the slot, and gently place the memory module on the slot with both hands.
Page 143 • All the DRAM DIMMs that are installed must be of the same type, rank, and capacity with minimum capacity of 16 GB. It is recommended to use Lenovo DRAM DIMMs of the same part number. 3. Refer to “DCPMM and DRAM DIMM installation order” on page 145 to determine the most suitable combination and the following: •...
Page 144 9. Make sure the DCPMM firmware is the latest version. If not, update it to the latest version (see https:// sysmgt.lenovofiles.com/help/topic/com.lenovo.lxca.doc/update_fw.html 10. Configure DCPMMs so that the capacity is available for use (refer to “Configure DC Persistent Memory Module (DCPMM)” on page 202).
Page 145 • If there are three identical memory modules to be installed for Processor 1, and the three memory modules have the same Lenovo part number, move the memory module to be installed in slot 8 to slot 1. • If there are ten identical memory modules to be installed for Processor 1, and the ten memory modules have the same Lenovo part number, move the memory module to be installed in slot 6 to slot 12.
Page 146 • If there are three identical memory modules to be installed for Processor 1, and the three memory modules have the same Lenovo part number, move the memory module to be installed in slot 8 to slot 1. • If there are three identical memory modules to be installed for Processor 2, and the three memory modules have the same Lenovo part number, move the memory module to be installed in slot 20 to slot •...
Page 147 Table 10. Independent mode with two processors (continued) Total Processor 2 Processor 1 Total DIMMs 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 1 DIMMs 18 17 16 15 18 17 16 15 22 21 20 19 18 17 16 15 22 21 20 19 18 17 16 15 18 17 16 15 14 13...
Page 148 Table 12. Mirroring mode with two processors Total Processor 2 Processor 1 Total DIMMs 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 1 DIMMs 22 21 20 19 18 17 16 15 22 21 20 19 18 17 16 15 22 21 20 19 18 17 16 15 18 17 16 15 14 13 22 21 20 19 18 17 16 15...
Page 149 Note: The only exception to this rule is Intel Xeon Silver 4215, which also supports DCPMM. • DCPMMs are supported only by Intel Xeon SP Gen 2. For a list of supported processors and memory modules, see http://www.lenovo.com/us/en/serverproven/ Chapter 3 Server hardware setup...
Page 150 • When you install two or more DCPMMs, all DCPMMs must have the same Lenovo part number. • All DRAM memory modules installed must have the same Lenovo part number. • 16 GB RDIMM has two different types: 16 GB 1Rx4 and 16 GB 2Rx8. The part number of the two types are different.
Page 151 Table 16. App Direct Mode with one processor D1–D4: Refer to Four categories of DIMM table. P: Only Data Center Persistent Memory Module (DCPMM) can be installed on the corresponding DIMM slots. Processor 1 Configuration 1 DCPMM and 6 DIMMs 2 DCPMMs and 4 DIMMs 2 DCPMMs and...
Page 152 Notes: 1. Supported DIMM capacity is up to 32 GB. 2. Supported DIMM capacity is up to 64 GB. App Direct Mode with two processors Note: When adding one or more DCPMMs and DIMMs during a memory upgrade, you might need to move other DCPMMs and DIMMs that are already installed to new locations.
Page 153 Table 19. Supported DCPMM capacity in App Direct Mode with two processors (continued) Other √ √ √ √ √ √ √ √ √ √ Other √ √ √ √ √ Other √ √ √ √ √ √ √ Other Notes: 1.
Page 154 Table 21. Memory Mode with one processor (continued) 4 DCPMMs and 6 DIMMs 6 DCPMMs and 6 DIMMs Table 22. Supported DCPMM capacity in Memory Mode with one processor Total Total Processor Family DCPM- 128 GB DCPMM 256 GB DCPMM 512 GB DCPMM DIMMs √...
Page 155 Table 23. Memory Mode with two processors (continued) P D2 P P D2 P D2 D2 P D2 P P D2 P D2 8 DCPMMs and 12 DIMMs D2 P D- P D2 P P D2 P D2 P D2 P D2 P D2 P P D2 P D2 P D2 12 DCPMMs and 12 DIMMs...
Page 156 Following are all the combinations that are supported in this solution. Mixed Memory Mode with one processor Note: When adding one or more DCPMMs and DIMMs during a memory upgrade, you might need to move other DIMMs that are already installed to new locations. Table 26.
Page 157: Install The 2.5-Inch-Drive Backplane
Mixed Memory Mode with two processors Table 28. Mixed Memory Mode with two processors D1–D4: Refer to Four categories of DIMM table. P: Only Data Center Persistent Memory Module (DCPMM) can be installed on the corresponding DIMM slots. Processor 2 Processor 1 Configuration 24 23 22 21 20 19...
Page 158 “Read the “Power off “ATTENTION: installation the server for Static Sensitive Device Guidelines” on this task” on Ground package before opening” page 126 page 194 on page 127 Note: Your server supports three types of 2.5-inch-drive backplanes: SATA/SAS 8-bay backplane (eight SATA/SAS drive bays), AnyBay 8-bay backplane (four SATA/SAS drive bays and four NVMe drive bays), and NVMe 8- bay backplane.
Page 159 Step 3. Insert the bottom of the backplane into the slots on the bottom of the chassis. Then, rotate the backplane to vertical position and align the holes in the backplane with the pins on the chassis and press the backplane into position. The release tabs will secure the backplane in place. Figure 82.
Page 160: Install The 3.5-Inch-Drive Backplane
Apply this label to drive bays 12–15 if an AnyBay 8-bay backplane is installed to drive bays 8–15. • 0-15 (NVMe) Apply this label to drive bays 0–15 if two NVMe 8-bay backplanes are installed to drive bays 0– • 16-19 (NVMe) Apply this label to drive bays 16–19 if a NVMe 8-bay backplane is installed to drive bays 16–19.
Page 161 Figure 84. 3.5-inch-drive backplane installation Step 1. Connect the cables to the backplane. Step 2. Align the backplane with the chassis and lower it into the chassis. Then, put the backplane into place with it leaning backward slightly. Step 3. Rotate the backplane to vertical position to ensure that the four hooks on the chassis pass through the corresponding holes in the backplane.
Page 162: Install The Rear Hot-Swap Drive Assembly
The following illustration shows the location for applying the drive bay label to the server models with a 12-bay backplane installed. The location is the same for applying the drive bay label to server models with an 8-bay backplane or an AnyBay 12-bay backplane installed. Ensure that the drive bay label is stuck in the correct location.
Page 163: Install The Raid Adapter
Step 1. Align the mounting stud on the system board with the corresponding hole in the rear hot-swap drive assembly. Meanwhile, align the rear of the rear hot-swap drive assembly with the corresponding rail guides in the rear of the chassis. Then, carefully press the rear hot-swap drive assembly straight down into the chassis until it is fully seated.
Page 164: Install The M.2 Backplane And M.2 Drive
• The following procedure is based on the scenario that the RAID adapter will be installed in the RAID adapter slot on the system board. For the procedure about installing the RAID adapter in PCIe slot 4 or a PCIe slot on the riser assembly, see “Install a PCIe adapter” on page 168 •...
Page 165 Before installing the M.2 backplane and M.2 drive: 1. Touch the static-protective package that contains the new M.2 backplane and M.2 drive to any unpainted surface on the outside of the server. Then, take the new M.2 backplane and M.2 drive out of the package and place them on a static-protective surface.
Page 166 Step 3. Slide the retainer forward (toward the connector) to secure the M.2 drive into place. Attention: When sliding the retainer forward, ensure that the two nubs on the retainer enter the small holes on the M.2 backplane. Once they enter the holes, you will hear a soft “click” sound. Figure 90.
Page 167 Step 4. Align the blue plastic supports at each end of the M.2 backplane with the guide pins on the system board. Then, insert the M.2 backplane into the M.2 slot on the system board and press it down to fully seat it.
Page 168 1. If you are installing the 480 GB M.2 drives and there is no PCIe adapter installed on PCIe slot 6, install the M.2 drive air baffle for proper airflow. Figure 92. M.2 drive air baffle installation 2. Use the Lenovo XClarity Provisioning Manager to configure the RAID. For more information, see: http://sysmgt.lenovofiles.com/help/topic/LXPM/RAID_setup.html Adjust the retainer on the M.2 backplane Use this information to adjust the retainer on the M.2 backplane.
Page 169: Install A Gpu With The Gpu Thermal Kit
Figure 93. M.2 retainer adjustment Step 1. Press both sides of the retainer Step 2. Move the retainer forward until it is in the large opening of the keyhole. Step 3. Take the retainer out of the keyhole. Step 4. Insert the retainer into the correct keyhole.
Page 170 Step 1. If your server is installed with 2U heat sinks, replace the 2U heat sinks with the 1U heat sinks that came with the GPU thermal kit. For detailed instructions on how to replace the heat sink, see http:// thinksystem.lenovofiles.com/help/topic/7X05/microprocessor_replacement.html Step 2.
Page 171 • For NVIDIA P4 GPU, install the P4 GPU air baffle (also called the P4 GPU air duct). Figure 96. P4 GPU air baffle installation Step 4. Locate the appropriate PCIe slot for the GPU. Note: For server models with one processor, you can install one GPU in PCIe slot 1. For server models with two processors, you can install up to two GPUs in PCIe slot 1 and PCIe slot 5, or up to three GPUs in PCIe slots 1, 5 and 6.
Page 172: Install A Pcie Adapter
Step 8. If you are installing a NVIDIA FHHL V100 GPU, do the following: 1. One V100 GPU air baffle supports up to two FHHL V100 GPUs installed. If you are installing two FHHL V100 GPUs, remove the middle plate from the V100 GPU air baffle. If you are installing one FHHL V100 GPU, go to the next step.
Page 173 Observe the following PCIe slot selection priority when installing a PCIe adapter: • For NVMe switch adapter: Number of installed processors PCIe slot selection priority One processor Two processors 1, 5, 6 – For server models with sixteen/twenty/twenty-four NVMe drives (with two processors installed): Server models PCIe slot selection Sixteen NVMe drives...
Page 174 • ThinkSystem Mellanox ConnectX-6 HDR/200GbE QSFP56 1-port PCIe adapter is supported only when the following requirements are met: – The server chassis is the eight 3.5-inch-drive bays chassis, eight 2.5-inch-drive bays chassis, sixteen 2.5- inch- drive bays chassis, or twenty 2.5- inch-drive bays chassis. –...
Page 175 Step 2. Pivot the PCIe adapter retention latch to the closed position. Figure 100. Closing the PCIe adapter retention latch After installing the PCIe adapter on the riser assembly: 1. Connect cables to the PCIe adapter. See “Internal cable routing” on page 35. 2.
Page 176 • To install the riser 1 assembly, align the mounting stud on the system board with the corresponding hole in the riser bracket. Meanwhile, align the rear of the riser 1 assembly with the corresponding rail guides in the rear of the chassis. Then, carefully press the riser 1 assembly straight down into the chassis until it is fully seated.
Page 177 • To install the riser 2 assembly, align the rear of the riser 2 assembly with the corresponding rail guides in the rear of the chassis. Then, carefully press the riser 2 assembly straight down into the chassis until it is fully seated. Figure 102.
Page 178: Install The Lom Adapter
Before installing the PCIe adapter on the system board: 1. Touch the static-protective package that contains the new PCIe adapter to any unpainted surface on the outside of the server. Then, take the new PCIe adapter out of the package and place it on a static- protective surface.
Page 179: Install The Serial Port Module
“Read the “Power off “ATTENTION: installation the server for Static Sensitive Device Guidelines” on this task” on Ground package before opening” page 126 page 194 on page 127 Before installing the LOM adapter: 1. If the server comes with a LOM adapter slot bracket, remove it with a tool first. Store the bracket in case that you later remove the LOM adapter and need the bracket to cover the place.
Page 180 Before installing the serial port module: 1. If the slot is covered with a slot bracket, open the retention latch and remove the slot bracket from the chassis. Store the bracket in case that you later remove the serial port module and need the bracket to cover the place.
Page 181: Install The System Fan Cage
Install the system fan cage Use this information to install the system fan cage. “Read the “Power off “ATTENTION: installation the server for Static Sensitive Device Guidelines” on this task” on Ground package before opening” page 126 page 194 on page 127 To install the system fan cage, complete the following steps: Watch the procedure.
Page 182 S033 CAUTION: Hazardous energy present. Voltages with hazardous energy might cause heating when shorted with metal, which might result in spattered metal, burns, or both. S017 CAUTION: Hazardous moving fan blades nearby. To install a system fan, complete the following steps: Watch the procedure.
Page 183: Install The U.2 24-Bay/20-Bay Upgrade Kit
Step 2. Position the system fan above the system fan cage. The system fan connector on the bottom of the system fan should face the rear of the chassis. Press the system fan straight down until it is seated into place. Figure 107.
Page 184: Power Off
Table 30. PCIe switch adapters and the corresponding PCIe slots Type of PCIe switch adapter PCIe slot selection 810-4P NVMe switch adapter (with the 2U bracket Slot 4 on the system board installed) 810-4P NVMe switch adapter RAID adapter slot on the system board 1610-4P NVMe switch adapter Slot 1 on riser card 1 1610-4P NVMe switch adapter...
Page 185: Install A Hot-Swap Power Supply
Table 31. PCIe switch adapters and the corresponding PCIe slots Type of PCIe switch adapter PCIe slot selection 810-4P NVMe switch adapter (with the 3U bracket Slot 2 on riser card 1 installed) 810-4P NVMe switch adapter (with the 2U bracket Slot 4 on the system board installed) 810-4P NVMe switch adapter (with the 3U bracket...
Page 186 • Ensure that the devices that you are installing are supported. For a list of supported optional devices for the server, go to: https://static.lenovo.com/us/en/serverproven/index.shtml Notes: • Ensure that the two power supplies installed on the server have the same wattage.
Page 187 DANGER Electrical current from power, telephone, and communication cables is hazardous. To avoid a shock hazard: • Do not connect or disconnect any cables or perform installation, maintenance, or reconfiguration of this product during an electrical storm. • Connect all power cords to a properly wired and grounded electrical outlet. •...
Page 188 S035 CAUTION: Never remove the cover on a power supply or any part that has this label attached. Hazardous voltage, current, and energy levels are present inside any component that has this label attached. There are no serviceable parts inside these components. If you suspect a problem with one of these parts, contact a service technician.
Page 189 To Connect: To Disconnect: 1. Turn OFF all power sources and equipment that is to 1. Turn OFF all power sources and equipment that is to be attached to this product. be attached to this product. 2. Attach signal cables to the product. •...
Page 190: Install The Air Baffle
Step 2. Slide the new hot-swap power supply into the bay until it snaps into position. Figure 110. Hot-swap power supply installation Install the air baffle Use this information to install the air baffle. “Read the “Power off the installation server for this Guidelines”...
Page 191 Before installing the air baffle: 1. Ensure that no tools or loose screws are left inside your server. 2. Ensure that all components have been reassembled correctly. 3. Ensure that all cables inside the server have been properly routed and they will not interfere with installing the air baffle.
Page 192: Install The Raid Super Capacitor Module
Figure 112. Installation of the large-size air baffle After installing the air baffle, install any RAID super capacitor modules that you removed. Install the RAID super capacitor module Use this information to install the RAID super capacitor module. “Read the “Power off “ATTENTION: installation...
Page 193: Install The Top Cover
Figure 113. RAID super capacitor module installation Step 1. Gently press and hold the tab on the air baffle as shown. Step 2. Insert the RAID super capacitor module into the holder on the air baffle. Step 3. Press down the RAID super capacitor module to install it into the holder. After installing the RAID super capacitor module, connect the RAID super capacitor module to a RAID adapter with the extension cable that comes with the RAID super capacitor module.
Page 194: Install A Hot-Swap Drive
Figure 114. Top cover installation Note: Before you slide the top cover forward, ensure that all the tabs on the top cover engage the chassis correctly. If the tabs do not engage the chassis correctly, it will be very difficult to remove the top cover later. Step 1.
Page 195 – SAS/SATA HDD For a list of supported drives, see: https://static.lenovo.com/us/en/serverproven/index.shtml • The drive bays are numbered to indicate the installation order (starting from number “0”). Follow the installation order when you install a drive. See “Front view” on page 21.
Page 196 2. Pinch the two tabs to remove the drive filler. Keep the drive filler in a safe place for future use. Figure 115. 2.5-inch drive filler removal Figure 116. 3.5-inch drive filler removal 3. Touch the static-protective package that contains the new drive to any unpainted surface on the outside of the server.
Page 197 To install a hot-swap drive, complete the following steps: Watch the procedure. A video of the installation process is available: • Youtube: https://www.youtube.com/playlist?list=PLYV5R7hVcs-A25P7vBoGa_wn7D7XTgDS_ • Youku: http://list.youku.com/albumlist/show/id_50483444 Figure 117. 2.5-inch hot-swap drive installation Figure 118. 3.5-inch hot-swap drive installation Step 1. Ensure that the drive tray handle is in the open position.
Page 198: Install The Server In A Rack
Turn off the server The server remains in a standby state when it is connected to a power source, allowing the Lenovo XClarity Controller to respond to remote power-on requests. To remove all power from the server (power status LED off), you must disconnect all power cables.
Page 199 When in a standby state, the server can respond to remote power-on requests sent to the Lenovo XClarity Controller. For information about powering on the server, see “Turn on the server” on page 194. Chapter 3 Server hardware setup...
Page 200 ThinkSystem SR650 Setup Guide...
Page 201: Chapter 4. System Configuration
The following methods are available to set the network connection for the Lenovo XClarity Controller if you are not using DHCP: • If a monitor is attached to the server, you can use Lenovo XClarity Controller to set the network connection.
Page 202: Update The Firmware
Machine-type-specific firmware-only UXSPs are also available. See the following table to determine the best Lenovo tool to use for installing and setting up the firmware: Note: The server UEFI settings for option ROM must be set to Auto or UEFI to update firmware using Lenovo XClarity Administrator or Lenovo XClarity Essentials.
Page 203 The latest firmware can be found at the following site: http://datacentersupport.lenovo.com/products/servers/thinksystem/sr650/7X05/downloads • Lenovo XClarity Provisioning Manager From Lenovo XClarity Provisioning Manager, you can update the Lenovo XClarity Controller firmware, the UEFI firmware, and the Lenovo XClarity Provisioning Manager software. Chapter 4...
Page 204 Additional information about using Lenovo XClarity Provisioning Manager to update firmware is available http://sysmgt.lenovofiles.com/help/topic/LXPM/platform_update.html • Lenovo XClarity Controller If you need to install a specific update, you can use the Lenovo XClarity Controller interface for a specific server. Notes: – To perform an in-band update through Windows or Linux, the operating system driver must be installed and the Ethernet-over-USB (sometimes called LAN over USB) interface must be enabled.
Page 205: Configure The Firmware
Several options are available to install and set up the firmware for the server. Important: Do not configure option ROMs to be set to Legacy unless directed to do so by Lenovo Support. This setting prevents UEFI drivers for the slot devices from loading, which can cause negative side effects for Lenovo software, such as Lenovo XClarity Administrator and Lenovo XClarity Essentials OneCLI, and to the Lenovo XClarity Controller.
Page 206: Memory Configuration
Memory configuration Memory performance depends on several variables, such as memory mode, memory speed, memory ranks, memory population and processor. More information about optimizing memory performance and configuring memory is available at the Lenovo Press website: https://lenovopress.com/servers/options/memory In addition, you can take advantage of a memory configurator, which is available at the following site: http://1config.lenovo.com/#/memory_configuration...
Page 207 Go to System Configuration and Boot Management ➙ System Settings ➙ Intel Optane DCPMMs to configure and manage DCPMMs. • Lenovo XClarity Essentials OneCLI Some management options are available in commands that are executed in the path of Lenovo XClarity Essentials OneCLI in the operating system. See https://sysmgt.lenovofiles.com/help/topic/toolsctr_cli_ to learn how to download and use Lenovo XClarity Essentials lenovo/onecli_t_download_use_tcscli.html...
Page 208 These values are selectable options for DCPMM settings, and do not represent the current DCPMM status. In addition, you can take advantage of a memory configurator, which is available at the following site: http://1config.lenovo.com/#/memory_configuration Alternatively, set DCPMM Goals with the following commands in OneCLI: 1. Set create goal status.
Page 209 Where 20 stands for the percentage of capacity that is invested in system volatile memory. 3. Set the DCPMM mode. onecli.exe config set IntelOptaneDCPMM.PersistentMemoryType "App Direct" --imm USERID:PASSW0RD@10.104.195.86 Where App Direct stands for the DCPMM mode. – Persistent Memory Type In App Direct Mode and Mixed Memory Mode, the DCPMMs that are connected to the same processor are by default interleaved (displayed as App Direct), while memory banks are used in turns.
Page 210 In the case the passphrases are lost or forgotten, the stored data cannot be backed up or restored, but you can contact Lenovo service for administrative secure erase. • After three failed unlocking attempts, the corresponding DCPMMs enter “exceeded” state with a system warning message, and the DCPMM unit can only be unlocked after the system is rebooted.
Page 211: Raid Configuration
Several options are available to install an operating system on the server. • Lenovo XClarity Administrator If you are managing your server using Lenovo XClarity Administrator, you can use it to deploy operating- system images to up to 28 managed servers concurrently. For more information about using Lenovo XClarity Administrator to deploy operating system images, see: http://sysmgt.lenovofiles.com/help/topic/com.lenovo.lxca.doc/compute_node_image_deployment.html...
Page 212: Back Up The Server Configuration
Alternatively, you can use the s s a a v v e e command from Lenovo XClarity Essentials OneCLI to create a backup of all configuration settings. For more information about the s s a a v v e e command, see: http://sysmgt.lenovofiles.com/help/topic/toolsctr_cli_lenovo/onecli_r_save_command.html...
Page 213: Chapter 5. Resolving Installation Issues
• “Displayed system memory less than installed physical memory” on page 211 • “A Lenovo optional device that was just installed does not work.” on page 212 • “Voltage system board fault is displayed in the event log” on page 212...
Page 214 • Replace the affected backplane signal cable. • Replace the affected backplane. 8. Run the diagnostics tests for the hard disk drives. When you start a server and press F1, the Lenovo XClarity Provisioning Manager interface is displayed by default. You can perform hard disk drive diagnostics from this interface.
Page 215 • If a memory module was disabled by the user or by POST, reseat the memory module; then, run the Setup utility and enable the memory module. 4. Run memory diagnostics. Power on the system and press F1 when the logo screen appears, the Lenovo XClarity Provisioning Manager interface will start. Perform memory diagnostics with this interface. Go to Diagnostics ➙...
Page 216 7. (Trained technician only) Install the failing memory module into a memory module connector for processor 2 (if installed) to verify that the problem is not the processor or the memory module connector. A Lenovo optional device that was just installed does not work. 1. Make sure that: •...
Page 217: Appendix A. Getting Help And Technical Assistance
Appendix A. Getting help and technical assistance If you need help, service, or technical assistance or just want more information about Lenovo products, you will find a wide variety of sources available from Lenovo to assist you. On the World Wide Web, up-to-date information about Lenovo systems, optional devices, services, and support are available at: http://datacentersupport.lenovo.com...
Page 218: Collecting Service Data
Collecting service data To clearly identify the root cause of a server issue or at the request of Lenovo Support, you might need collect service data that can be used for further analysis. Service data includes information such as event logs and hardware inventory.
Page 219: Contacting Support
• Lenovo XClarity Essentials OneCLI Lenovo XClarity Essentials OneCLI can be run in-band from the operating system. In addition to the hardware service data, Lenovo XClarity Essentials OneCLI can collect information about the operating system, such as the operating system event log.
Page 220 ThinkSystem SR650 Setup Guide...
Page 221: Appendix B. Trademarks
Appendix B. Trademarks LENOVO, THINKSYSTEM, and XCLARITY are trademarks of Lenovo. Intel, Optane, and Xeon are trademarks of Intel Corporation in the United States, other countries, or both. AMD is a registered trademark of Advanced Micro Devices, Inc. NVIDIA is a trademark and/or registered trademarks of NVIDIA Corporation in the U.S.
Page 222 ThinkSystem SR650 Setup Guide...
Page 223: Index
Lenovo Capacity Planner Lenovo XClarity Administrator installing Lenovo XClarity Controller fan error LED Lenovo XClarity Energy Manager features Lenovo XClarity Essentials front I/O assembly 21, 24 Lenovo XClarity Integrator front view Lenovo XClarity Provisioning Manager © Copyright Lenovo 2017, 2020...
Page 224 LOM adapter removing installing air baffle security bezel system fan cage top cover retainer on M.2 backplane adjusting M.2 backplane and M.2 drive installing management options memory 138–139, 202 memory configuration 202, 207 memory module security bezel installing removing memory module error LED serial port module memory module installation order 146, 149, 151...

This manual is also suitable for:

Thinksystem sr650 7x05 Thinksystem sr650 7x06

Lenovo ThinkSystem SR650 Series Setup Manual

Table of Contents

Chapter 1. Introduction

Chapter 2. Server Components

Table of Contents

Chapter 3. Server Hardware Setup

Install the Serial Port Module

Chapter 4. System Configuration

Chapter 5. Resolving Installation Issues

Appendix A. Getting Help and Technical Assistance

Appendix B. Trademarks

Quick Links

Chapters

Related Manuals for Lenovo ThinkSystem SR650 Series

Summary of Contents for Lenovo ThinkSystem SR650 Series

This manual is also suitable for:

Table of Contents