IBM RS/6000 SP User Manual

RS/6000 SPSP Switch Service GuideGA22-7443-04IBM

viii RS/6000 SP: SP Switch Service Guide

Multi-switch frame (F/C 2030/1)5-10 RS/6000 SP: SP Switch Service Guide

Table 5-5. Multi-switch frame (F/C 2030/1)AssemblyindexPart number Units Description1 SPS Switch Assembly2 54G3281 16 Screw, Phil Pan Hd M5 x 123 93G1

5-12 RS/6000 SP: SP Switch Service Guide

NoticesThis information was developed for products and services offered in the U.S.A.IBM may not offer the products, services, or features discussed i

Electronic emissions noticesFederal Communications Commission (FCC) statementThis equipment has been tested and found to comply with the limits for a

For installations in Japan:The following is a summary of the VCCI Japanese statement in the box above. This is a Class A productbased on the standard

A-4 RS/6000 SP: SP Switch Service Guide

IndexNumerics0375867 5-1104H9469 5-1108J5557 5-1111J3975 5-811J3976 5-811J3977 5-811J3978 5-811J3979 5-811J3980 5-811J3981 5-811J3982 5-811J5189 5-111

frame locations 2-3, 2-5, 2-6frame naming standard 2-1frame supervisor verification 3-5front chassis cable, SPS 1-8front view of 49-inch frame locatio

SPS assembly, placing into service position 3-9SPS assembly, removing 4-2SPS assembly, replacing 4-2SPS assembly, replacing from service position 3-9S

Safety and environmental noticesFor general information concerning safety, refer toElectrical Safety for IBM Customer Engineers,S229-8124. For a copy

X-4 RS/6000 SP: SP Switch Service Guide

Reader’s comments – We’d like to hear from youRS/6000 SPSP Switch Service GuidePublication No. GA22-7443-04Overall, how satisfied are you with the inf

Readers’ Comments — We’d Like to Hear from YouGA22-7443-04GA22-7443-04IBMCut or FoldAlong LineCut or FoldAlong LineFold and Tape Please do not staple

IBMGA22-7443-04

DANGERBefore you connect the power cable of this product to ac power, verify that the power receptacleis correctly grounded and has the correct voltag

DANGERThe remaining steps of the procedure contain measurements that are taken with power on.Remember that hazardous voltages are present. (SPSFD013)D

CAUTION:The covers are to be closed at all times except for service by trained service personnel.(SPSFC003)CAUTION:When the unit is being serviced, th

CAUTION:v When moving frames into position, team members should work together. Using one person oneach corner of the frame can prevent strain.v In rai

This product might contain nickel-cadmium or lithium batteries in communication adapters. The batteriesmust be recycled or disposed of properly. Recyc

About this bookThis book is part of the RS/6000®SP™hardware service library and applies to the RS/6000 SP Switch.Use this book to assist you in perfor

How to send your commentsYour feedback is important in helping to provide the most accurate and highest quality information. If youhave any comments a

Summary of changesGA22-7443-04This edition contains replaces GA22-7443-03 and any update versions made to that level and makes themobsolete. This edit

xviii RS/6000 SP: SP Switch Service Guide

Chapter 1. Maintenance Analysis Procedures (MAPs)This chapter provides information for identifying problems and guides you to the most likely failed F

FRUs include: Fans, circuit breaker/LED card, switch supervisor card, switch power card(s),inner chassis cable, front chassis cable, complete assembly

There are two LEDs on the front of each SP Switch. For quick reference, their definitions are as follows:Environment (Yellow)Off No environmental prob

Table 1-1. Switch problem diagnosticsPriority Message or condition Action1(1 of 3)Environmental problemsv Errpt: “Failure...”v Log: “Shutdown: Voltage

SP Switch environment (MAP 0600)Purpose of this MAPThis MAP provides diagnostic information for switch problems that are related to the operatingenvir

Step 0600-004Perspectives indicated a shutdown condition and Table 1-2 on page 1-5 directed you to this step.1. One or more of the following condition

3. Is the measured resistance now within the acceptable range?v If yes, go to “Step 0600-017” on page 1-10 to verify fix.v If no, go to “Step 0600-008

Table 1-4. Fan failure diagnosticsPriority Component Action1(1 of 5)Fan 1, 2, 3, 4 or 5a. Check specified fans for blockages or loose cableconnections

6. Check the Environmental (yellow) LED for an ON or FLASHING condition.7. Is the Environmental (yellow) LED ON or FLASHING?v If the Environmental LED

RS/6000 SPSP Switch Service GuideGA22-7443-04IBM

2. Remove blockage.3. If required, put the switch into service position (refer to “Service position procedures” on page 3-9).4. With all cables replug

2. Remove the switch supervisor card (refer to “Removing the switch supervisor card” on page 4-4).3. Using a digital multimeter, measure resistance at

Step 0600-025You have a PS1Fail problem1. Replace power supply card PS1.2. Reinstall the SPS front panel assembly, being careful to align the guide pi

Step 0600-029You have a PSFuseGood problem that did not go away when you removed power supply PS1.1. Put the circuit breaker in the Off (‘0’) position

Step 0610-001A message in Perspectives indicated that you have a power problem and Table 1-1 on page 1-4 orTable 1-2 on page 1-5 directed you to this

Step 0610-005When you put the circuit breaker into the On (‘1’) position, the circuit breaker tripped into the Off (‘0’)position.1. Have the customer

v If yes:a. Have the customer remove the SP Switch from the active configuration and power off the SPSwitch.b. Go to “Step 0610-010”.v If no:a. Fix an

a. Replace the front chassis cable.b. Return to “Step 0610-004” on page 1-14 to verify the replacement cable.v If no:a. Replace the circuit breaker.b.

splstdata -n | pg5. From the system file server, log into “primary” processor node as root using the telnet command:telnetPrimaryNodename6. Check errp

Table 1-7. SP Switch error conditionsError # Message/condition Description and action2(SPS)Initialized Description: Initialization detected a wrapped

Note!Before using this information and the product it supports, read the information in “Safety and environmental notices” onpage ix and “Notices” on

Table 1-7. SP Switch error conditions (continued)Error # Message/condition Description and action−3(SPS)Device status: Device has beenremoved from net

Table 1-7. SP Switch error conditions (continued)Error # Message/condition Description and action−8(SPS)Device status: Device has beenremoved from net

Refer to notes at beginning of “SP Switch function (MAP 0620)” on page 1-17 for more informationon cable connections and logical-to-physical frame tra

1. Make sure a wrap plug is properly installed on the connector. Refer to Figure 1-2 on page 1-4 for viewsof the switch wrap plugs.2. Have customer ch

v If yes:a. An SRN was obtained from diagnostics.b. Use the following SRN table (Table 1-9) to continue service.c. After using Table 1-9, go to “Step

Table 1-9. Service Request Number (SRN) table for SP Switch adapters (continued)Service Request NumberSRNsource Failing component(s) Description763-20

Table 1-9. Service Request Number (SRN) table for SP Switch adapters (continued)Service Request NumberSRNsource Failing component(s) Description764-2A

Table 1-10. Switch problem priority listingPriority Failing component Action1(1 of 7)Software a. Have customer verify that the software is configureda

Step 0620-013An SRN listed in Table 1-9 on page 1-24 indicated that you have a switch clock problem and Priority 2 inTable 1-10 on page 1-27 directed

Step 0620-019Since the diagnostics did not return an SRN, no problem was detected.1. Have you just reseated, repaired, or replaced a component?v If ye

ContentsFigures ...vTables ...viiSafety and environmental notices ...

Note: When unplugging the two ends of the suspect cable, check /var/adm/SPlogs/css/out.top toverify only two (2) ports were lost. If four (4) ports we

v If yes, go to “Step 0620-027”.v If no:a. The problem switch is providing the master clock for the system.b. Have customer use the Eclock command to

v S00-BH-J95. Disconnect the switch data cable at the tailgate of the frame containing the processor node.6. Connect the end of the processor node dat

Step 0620-033All ground straps connecting the frames make adequate contact at both ends.1. Disconnect clock source data cable at S00-BH-J3, J5, J7, or

5. Set the switch clock selections on the “problem” switches (refer to “Selecting appropriate switch clocks”on page 3-6).6. Run advanced diagnostics o

5. Look for an SRN indicating a clock problem, such as “External clock” being listed as one of the failingcomponents.6. Do the “css0” diagnostics fail

2. Put the SP Switch’s circuit breaker into the On (‘1’) position.3. Go to “Step 0620-043” to verify fix.Step 0620-043You have replaced switch compone

Chapter 2. LocationsNaming standard for RS/6000 SP components ...2-1Format structure ...2-1Example of fo

– 01 - 99 for frames 1-99 (specific to that frame)Notes:1. E01 designates RS/6000 SP physical frame 12. L00 designates any/all RS/6000 SP logical fram

Front and rear views of RS/6000 SP frameFigure 2-1 shows a front view of the RS/6000 SP frame locations. “Frame (FRA)” on page 2-6 describesthe assemb

Selecting the switch clock source ...3-6Determining the correct switch clock source ...3-6Removing and restori

Figure 2-2 shows a front view of the RS/6000 SP multi-switch frame.Figure 2-3 on page 2-5 shows a front view of the Model 3AX (49-inch) frame.Main Pow

Figure notes:1. Wide processor nodes take up an entire shelf position (two thin processor node slots). They areidentified by the odd numbered position

Note: See notes under Figure 2-1 on page 2-3 for processor node/switch assembly numbering.Frame locationsFigure 2-1 on page 2-3 shows a front view of

G6: Front door groundG7: Rear door groundG8: GroundSW: Power-on switchLD: LED cardFC: Front coverRC: Rear coverExample: E01-FRA-G1Chapter 2. Locations

Switch assembly locationsFan 5P6 P4P5Fan 4 Fan 3Fan 2 Fan 1CB & LED CardJ1 J2Switch PlanarPowerSupply 2SupervisorCardPowerSupply 1Supervisor Bus

Connector detailsFigure 2-6 shows RS/6000 SP component connector details.Cable routingFigure 2-7 on page 2-10 and Figure 2-8 on page 2-10 show back vi

Note: When attaching exterior and interior cables to a POWER3 SMP High Node allow for enough cablefor a 2-foot service loop for node movement into ser

Table 2-1 shows external cable routing in a RS/6000 SP frame populated with 16 processor nodes. (Referto “Cable routing” on page 2-9 to see the routin

Figure 2-9. Frame cable routing paths in rear of RS/6000 SP multi-switch frame (F/C 2030/1) — 1.93 m frameFigure 2-10. Frame cable routing paths in re

Switch data cablesSPS data cablesTable 2-2 describes the attachment locations and routing for the internal SPS Switch data cables:Table 2-2. SPS Switc

Figures1-1. SP Switch high-level diagram...1-21-2. SP Switch wrap plugs ...1-41-3. SP Switch inner chass

2-14 RS/6000 SP: SP Switch Service Guide

Chapter 3. Service proceduresPersonal ESD requirements ...3-1Tools and files overview...3-1Using t

Table 3-1. Service procedure toolsUtility (see note) Runs on Descriptionfault_service_Worm_RTG All nodes Monitors the switch for faults. It restarts t

Table 3-3. Tuning output files (continued)File (see note) Location Descriptiondaemon.stderr Primary A record of which nodes were not initialized.out.t

The files ending in .out are produced by running the appropriate command to dump internal (in memory)trace information or dump data to a file. The com

2. In the Node pane, click the icon of the node you want to verify3. Click the ″Notebook″ icon on the tool barv When the Notebook window opens, make c

v ″Yes″ displayed in a red box indicates that the switch supervisor has failed and it is notresponding to the frame supervisor.Note: Clicking ″Help″ i

1 Input 1 (BH-J3 for SPS)2 Input 2 (BH-J4 for SPS)3 Input 3 (BH-J5 for SPS)Table 3-4. Setting switch clock sourcesModelNumber of LogicalFramesMaster C

6. The customer can re-initialize the switch using the Estart command. The frame and processor nodeswhich were removed in this procedure will appear i

Efence of primary and primary backup nodesBy design, Efence of primary and primary backup nodes is not allowed.If you attempt to fence either of these

vi RS/6000 SP: SP Switch Service Guide

d. Choose “Normal Mode”e. Choose “Display Current Bootlist”This will display the current bootlist.2. Power down the node, service it, and hook it back

The following 3 adapters require functional microcode to be installed:Adapter PackageESCON®Control Unit Adapters Feature 2756 ESCONBLKMUX S/370™Contro

To complete the microcode update, it is usually necessary to remove and then replace the device from theconfiguration. The most reliable method to do

Chapter 4. FRU removals and replacementsHandling static-sensitive devices ...4-1Procedures for switch assemblies ...

Procedures for switch assembliesCAUTION:The unit weight exceeds 18 Kg (40 lbs) and requires two service personnel to lift.(SPSFC002)Attention: Compone

Removing the switch fansNote: Refer to “Handling static-sensitive devices” on page 4-1 before removing or installing ESD sensitivedevices.Perform thes

Perform these procedures to remove the fan control cable from an SP Switch assembly:1. Perform “Placing a switch assembly into service position” on pa

Replacing the switch supervisor cardPerform these procedures to replace the supervisor card in an SP Switch assembly:1. Insert supervisor card.2. Rota

Replacing the switch inner chassis cablePerform these procedures to replace the supervisor power cable from an SP Switch assembly:1. Plug connectors P

4. Remove power supply card.Replacing the switch power cardsPerform these procedures to replace the switch power cards) in an SP Switch assembly:1. In

Tables1-1. Switch problem diagnostics ...1-41-2. Environmental messages for switches ...1-51-3. Switch connect

4-8 RS/6000 SP: SP Switch Service Guide

Chapter 5. Parts catalogSPS, SPS-8 Switch assembly (feature) (view 1) ...5-2SPS, SPS-8 Switch assembly (feature) (view 2) ...

SPS, SPS-8 Switch assembly (feature) (view 1)5-2 RS/6000 SP: SP Switch Service Guide

Table 5-1. SPS, SPS-8 Switch assembly (feature) (view 1)AssemblyindexPart number Units DescriptionSPS Switch assembly (reference only)SPS-8 Switch ass

SPS, SPS-8 Switch assembly (feature) (view 2)5-4 RS/6000 SP: SP Switch Service Guide

Table 5-2. SPS, SPS-8 Switch assembly (feature) (view 2)AssemblyindexPart number Units DescriptionSPS Switch assembly (reference only)SPS-8 Switch ass

SPS, SPS-8 Switch assembly (feature) (view 3)87654321Air flow5-6 RS/6000 SP: SP Switch Service Guide

Table 5-3. SPS, SPS-8 Switch assembly (feature) (view 3)AssemblyindexPart number Units DescriptionSPS switch assembly (reference only)SPS-8 switch ass

Switch cables (feature)Table 5-4. Switch cables (feature)AssemblyindexPart number Units DescriptionSP Switch data cables (SPS)11J6091 AR Cable, Switch

Chapter 5. Parts catalog 5-9