Ibm TotalStorage DS6000 Series User Manual

ibm.com/redbooksFront coverThe IBM TotalStorage DS6000 Series: Concepts and ArchitectureCathy WarrickOlivier AlluisWerner BauerHeinz BlaschekAndre Fou

viii DS6000 Series: Concepts and Architecture8.3.3 Remote Mirror and Copy functions (RMC) . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

76 DS6000 Series: Concepts and Architecturecreated and determines the LSS that it is associated with. The 256 possible logical volumes associated wit

Chapter 4. Virtualization concepts 774.2.7 Address groupsAddress groups are created automatically when the first LSS associated with the address gro

78 DS6000 Series: Concepts and ArchitectureHost attachmentHBAs are identified to the DS6000 in a host attachment construct that specifies the HBA&apo

Chapter 4. Virtualization concepts 79Figure 4-10 Host attachments and volume groupsFigure 4-10 shows the relationships between host attachments and

80 DS6000 Series: Concepts and ArchitectureFigure 4-11 Virtualization hierarchy4.2.10 Placement of dataAs explained in the previous chapters, ther

Chapter 4. Virtualization concepts 81Figure 4-12 Optimal distribution of data4.3 Benefits of virtualizationThe DS6000 physical and logical archite

82 DS6000 Series: Concepts and Architecture– Dynamically add/remove volumes򐂰 Virtualization reduces storage management requirements.

© Copyright IBM Corp. 2004. All rights reserved. 83Chapter 5. IBM TotalStorage DS6000 model overviewThis chapter provides an overview of the IBM Total

84 DS6000 Series: Concepts and Architecture5.1 DS6000 highlightsThe DS6000 is a member of the DS product family that offers high reliability and ent

Chapter 5. IBM TotalStorage DS6000 model overview 85򐂰 Front-end connectivity with two to eight Fibre Channel host ports which auto negotiate to eithe

Contents ix10.3 Supported environments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19710.4 Instal

86 DS6000 Series: Concepts and ArchitectureThe DS6800 Model 1750-EX1 is also a 3 Electrical Industries Association (EIA) self-contained unit, as is t

Chapter 5. IBM TotalStorage DS6000 model overview 87The DS6800 server enclosure can have from 8 up to 16 DDMs and can connect 7 expansion enclosures.

88 DS6000 Series: Concepts and ArchitectureFigure 5-5 DS6800 switched disk expansionWhen you add new DDMs into an enclosure or attach additional en

© Copyright IBM Corp. 2004. All rights reserved. 89Chapter 6. Copy ServicesIn this chapter, we describe the architecture and functions of Copy Service

90 DS6000 Series: Concepts and Architecture6.1 Introduction to Copy ServicesCopy Services is a collection of functions that provides disaster recove

Chapter 6. Copy Services 91Figure 6-1 FlashCopy conceptsWhen a FlashCopy operation is invoked, the process of establishing the FlashCopy pair and c

92 DS6000 Series: Concepts and ArchitectureThe background copy may have a slight impact on your application because the real-copy needs some storage

Chapter 6. Copy Services 93Figure 6-2 Incremental FlashCopyIn the Incremental FlashCopy operations:1. At first, you issue full FlashCopy with the c

94 DS6000 Series: Concepts and ArchitectureFigure 6-3 Data Set FlashCopyMultiple Relationship FlashCopyMultiple Relationship FlashCopy allows a sou

Chapter 6. Copy Services 95Consistency Group FlashCopyConsistency Group FlashCopy allows you to freeze (temporarily queue) I/O activity to a LUN or v

x DS6000 Series: Concepts and Architecture12.2.1 Scalability support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

96 DS6000 Series: Concepts and ArchitectureA more detailed discussion of the concept of data consistency and how to manage the Consistency Group oper

Chapter 6. Copy Services 97Persistent FlashCopyPersistent FlashCopy allows the FlashCopy relationship to remain even after the copy operation complet

98 DS6000 Series: Concepts and ArchitectureFigure 6-7 Metro MirrorGlobal Copy (PPRC-XD)Global Copy copies data non-synchronously and over longer di

Chapter 6. Copy Services 99Figure 6-8 Global CopyGlobal Mirror (Asynchronous PPRC)Global Mirror provides a long-distance remote copy feature across

100 DS6000 Series: Concepts and Architecture򐂰 Efficient synchronization of the local and remote sites with support for failover and failback modes, h

Chapter 6. Copy Services 101Figure 6-10 How Global Mirror worksThe A volumes at the local site are the production volumes; they are used as Global

102 DS6000 Series: Concepts and ArchitectureThe data at the remote site is current within 3 to 5 seconds, but this recovery point (RPO) depends on th

Chapter 6. Copy Services 103Figure 6-11 z/OS Global Mirror (DS6000 is used as secondary system)6.2.4 Comparison of the Remote Mirror and Copy func

104 DS6000 Series: Concepts and ArchitectureGlobal Copy (PPRC-XD)򐂰 DescriptionGlobal Copy is a function for continuous copy without data consistency.

Chapter 6. Copy Services 105򐂰ConsiderationsWhen the link bandwidth capability is exceeded with a heavy workload, the RPO might grow.6.2.5 What is Co

Contents xiChapter 15. Data migration in the open systems environment. . . . . . . . . . . . . . . . . . 28915.1 Introduction . . . . . . . . . .

106 DS6000 Series: Concepts and ArchitectureIn order for the data to be consistent, the deposit of the paycheck must be applied before the withdrawal

Chapter 6. Copy Services 107Because of the time lag for Consistency Group operations, some volumes in some LSSs are in an extended long busy state an

108 DS6000 Series: Concepts and ArchitectureFigure 6-14 Consistency Group: Example 3In this case, the copy created by Consistency Group operation r

Chapter 6. Copy Services 109MC communicates with each server in the storage units via the Ethernet network. Therefore, the MC is a key component to c

110 DS6000 Series: Concepts and Architecture6.3.4 DS open application programming interface (API)The DS open application programming interface (API)

Chapter 6. Copy Services 1116.4 Interoperability with ESSCopy Services also supports the IBM Enterprise Storage Server Model 800 (ESS 800) and the E

112 DS6000 Series: Concepts and Architecture

© Copyright IBM Corp. 2004. All rights reserved. 113Part 3 Planning and configurationIn this part we present an overview of the planning and configura

114 DS6000 Series: Concepts and Architecture

© Copyright IBM Corp. 2004. All rights reserved. 115Chapter 7. Installation planningThis chapter discusses planning for the physical installation of a

xii DS6000 Series: Concepts and ArchitectureMultipath. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

116 DS6000 Series: Concepts and Architecture7.1 General considerationsThe successful installation of a DS6000 requires careful planning. The main co

Chapter 7. Installation planning 1173. Ensure that the floor area provides enough stability to support the weight of the fully configured DS6000 seri

118 DS6000 Series: Concepts and ArchitectureUse the following steps to calculate the required space for your storage units:1. Determine the dimension

Chapter 7. Installation planning 119The DS6000 should be maintained within an operating temperature range of 20 to 25 degrees Celsius (68 to 77 degre

120 DS6000 Series: Concepts and ArchitectureThe DS Storage Manager can be accessed from any location that has network access to the DS management con

Chapter 7. Installation planning 1217.4 Network settingsTo install a DS6000 in your environment you have to plan for the Ethernet infrastructure tha

122 DS6000 Series: Concepts and Architecture7.5 SAN requirements and considerationsThe DS6000 series provides a variety of host attachments so that

Chapter 7. Installation planning 1237.5.1 Attaching to an Open System hostFibre Channel technology supports increased performance, scalability, avai

124 DS6000 Series: Concepts and Architecture7.6 Software requirementsTo see current information on servers, operating systems, host adapters, and co

© Copyright IBM Corp. 2004. All rights reserved. 125Chapter 8. Configuration planningThis chapter discusses configuration planning considerations when

© Copyright IBM Corp. 2004. All rights reserved. xiiiNoticesThis information was developed for products and services offered in the U.S.A. IBM may not

126 DS6000 Series: Concepts and Architecture8.1 Configuration planning considerationsWhen installing a DS6000 disk system, various physical requirem

Chapter 8. Configuration planning 127The Management Console is supported on the following operating systems:򐂰 Microsoft Windows 2000򐂰 Microsoft Windo

128 DS6000 Series: Concepts and Architecturenew or un-configured DS6000 and apply the configuration. The following tasks may be performed when operat

Chapter 8. Configuration planning 1298.2.2 DS Management Console connectivityConnectivity to the DS6000 series from the DS Management Console is nee

130 DS6000 Series: Concepts and Architecture򐂰 The DS6000 Storage Manager indicates the condition of the system after service.Should the user require

Chapter 8. Configuration planning 131Figure 8-3 DS6000 series configured for remote support8.2.6 Call homeThe DS6000 has the capability to enable

132 DS6000 Series: Concepts and Architecture8.3.1 Operating Environment License (OEL) - required featureThe user must order an operating environment

Chapter 8. Configuration planning 133The deactivation of an activated licensed function, or a lateral change or reduction in the licensed scope, is a

134 DS6000 Series: Concepts and Architecture8.3.4 Parallel Access Volumes (PAV)The Parallel Access Volumes model and features establish the extent o

Chapter 8. Configuration planning 135CKD volumes will be FlashCopied, then you only need to purchase a license for 5 TB PTC and not the full 20 TB. T

xiv DS6000 Series: Concepts and ArchitectureTrademarksThe following terms are trademarks of the International Business Machines Corporation in the Un

136 DS6000 Series: Concepts and ArchitectureFigure 8-5 User authorized to FlashCopy 45 TB of data with a license scope of ALLFor PTC and RMC, you m

Chapter 8. Configuration planning 137Figure 8-6 Remote Mirror and CopyGlobal Mirror requires both RMC and PTC functions. Both primary and secondary

138 DS6000 Series: Concepts and ArchitectureThe high-level steps for storage feature activation are:򐂰 Have machine-related information available; tha

Chapter 8. Configuration planning 139Figure 8-7 Example of connecting several expansion enclosures8.4.2 Logical configurationsThe capacity of the

140 DS6000 Series: Concepts and ArchitectureThe following figures are for an 8 DDMs array. The user can also select a 4 DDMs array configuration.Figu

Chapter 8. Configuration planning 141Figure 8-9 FB RAID rank capacity (8 DDMs array)For example, if you configure a RAID-5 8 DDM rank with 146 GB D

142 DS6000 Series: Concepts and ArchitectureSee Figure 8-10 and Figure 8-11 on page 143. These figures are simple examples for 64 DDM configurations

Chapter 8. Configuration planning 143Figure 8-11 Sparing example 2 (RAID-10)Configuration with different types of DDMsIf you attach other types of

144 DS6000 Series: Concepts and ArchitectureFigure 8-12 Sparing example 3 (add larger capacity DDMs)See Figure 8-13 on page 145. This is an example

Chapter 8. Configuration planning 145Figure 8-13 Sparing example 4 (add faster DDMs)8.5 Data migration planningWhen migrating data, the migration

© Copyright IBM Corp. 2004. All rights reserved. xvSummary of changesThis section describes the technical changes made in this edition of the book and

146 DS6000 Series: Concepts and Architecture8.5.1 Operating system mirroringLogical volume mirroring (LVM) and Veritas Volume Manager have little or

Chapter 8. Configuration planning 147The advantages of remote copy technologies are:򐂰 Other than z/OS Global Mirror, they are operating system indepe

148 DS6000 Series: Concepts and ArchitectureFigure 8-14 Different data migration methodsSee Chapter 13, “Data Migration in zSeries environments” on

Chapter 8. Configuration planning 149covering several time intervals, and should include peak I/O rate, peak R/T, and peak (read and write) MB/sec th

150 DS6000 Series: Concepts and Architecture8.6.7 Hot spot avoidanceWorkload activity concentrated on a limited number of RAID ranks will saturate t

© Copyright IBM Corp. 2004. All rights reserved. 151Chapter 9. The DS Storage Manager: Logical configurationIn this chapter, the following topics are

152 DS6000 Series: Concepts and Architecture9.1 Configuration hierarchy, terminology, and conceptsThe DS Storage Manager provides a powerful, flexib

Chapter 9. The DS Storage Manager: Logical configuration 153Figure 9-1 Diagram of hosts and host attachment groups򐂰 In Figure 9-1 we show three pSe

154 DS6000 Series: Concepts and ArchitectureDDMA Disk Drive Module (DDM) is a customer-replaceable unit that consists of a single disk drive and its

Chapter 9. The DS Storage Manager: Logical configuration 155Figure 9-2 Diagram of an extent pool containing 3 volumesIn Figure 9-2, there is an exa

xvi DS6000 Series: Concepts and Architecture

156 DS6000 Series: Concepts and Architecture򐂰 Any extent can be used to make a logical volume.򐂰 There are thresholds that warn you when you are neari

Chapter 9. The DS Storage Manager: Logical configuration 157Volume groups can be thought of as LUN groups. Do not confuse the term volume group here

158 DS6000 Series: Concepts and ArchitectureFigure 9-4 Example of Volume Group, LUNs and host attachment definitionIn Figure 9-4 we show three host

Chapter 9. The DS Storage Manager: Logical configuration 159Figure 9-5 shows an example of the relationship between LSSs, extent pools, and volume gr

160 DS6000 Series: Concepts and Architecture– CKD LSSs definitions are configured during the LCU creation.– FB LSSs definitions are configured during

Chapter 9. The DS Storage Manager: Logical configuration 1619.1.2 Summary of the DS Storage Manager logical configuration stepsIt is our recommendat

162 DS6000 Series: Concepts and ArchitectureRaw or physical DDM layerAt the very top, you can see the raw DDMs. There are four DDMs in a group called

Chapter 9. The DS Storage Manager: Logical configuration 163Figure 9-9 Recommended Logical Configuration steps9.2 Introducing the GUI and logical

164 DS6000 Series: Concepts and ArchitectureFigure 9-10 Entering the URL using the TCP/IP address for the SMCIn Figure 9-10, we show the TCP/IP add

Chapter 9. The DS Storage Manager: Logical configuration 165Once the GUI is started and the user has successfully logged on, the Welcome panel will d

© Copyright IBM Corp. 2004. All rights reserved. xviiPrefaceThis IBM Redbook describes the IBM TotalStorage® DS6000 storage server series, its archite

166 DS6000 Series: Concepts and ArchitectureFigure 9-13 View of the fully expanded Real-time Manager menu choices– Copy Services You can use the Co

Chapter 9. The DS Storage Manager: Logical configuration 167Figure 9-14 View of the fully expanded Simulated Manager menu choices򐂰 Express configur

168 DS6000 Series: Concepts and Architecture򐂰 Create and define the users and passwordsSelect User administration → Add user and click Go, as shown i

Chapter 9. The DS Storage Manager: Logical configuration 169To use the information center, click the question mark (?) icon shown in Figure 9-17. Fig

170 DS6000 Series: Concepts and ArchitectureWith reference to the numbers shown in Figure 9-18, the icons shown have the following meanings:1. Click

Chapter 9. The DS Storage Manager: Logical configuration 171Figure 9-20 View of the Storage Complexes sectionThe buttons displayed on the Storage c

172 DS6000 Series: Concepts and ArchitectureFigure 9-22 View of radio buttons and check boxes in the host attachment panelIn the example shown in F

Chapter 9. The DS Storage Manager: Logical configuration 173Figure 9-24 View of the Define properties panel, with the Nickname definedDo not click

174 DS6000 Series: Concepts and ArchitectureFigure 9-25 View of the General storage unit information panelAs illustrated in Figure 9-25, fill in th

Chapter 9. The DS Storage Manager: Logical configuration 175Figure 9-26 View of Specify DDM packs panel, with the Quantity and DDM type addedClick

xviii DS6000 Series: Concepts and ArchitectureDWDM technology, CWDM technology). His areas of interest include storage remote copy on long-distance c

176 DS6000 Series: Concepts and ArchitectureFollow the steps specified on the panel shown in Figure 9-27. The next panel, shown in Figure 9-28, requi

Chapter 9. The DS Storage Manager: Logical configuration 177Figure 9-30 View of Host Systems panel, with the Go button selectedClick the Select Sto

178 DS6000 Series: Concepts and ArchitectureFigure 9-32 View of Define Host Systems panelEnter the appropriate information in the Define host ports

Chapter 9. The DS Storage Manager: Logical configuration 179Click Next, and the screen will advance to the Select storage units panel shown in Figure

180 DS6000 Series: Concepts and ArchitectureFigure 9-35 View of the Specify storage units parameters panelUnder the Specify storage units parameter

Chapter 9. The DS Storage Manager: Logical configuration 181Figure 9-36 View of the Definition method panelFrom the Definition method panel, if you

182 DS6000 Series: Concepts and ArchitectureEnter the appropriate information for the quantity of the arrays and the RAID type.Click Next to advance

Chapter 9. The DS Storage Manager: Logical configuration 183Figure 9-39 View of creating custom arrays from four disk array sites.At this point you

184 DS6000 Series: Concepts and ArchitectureFigure 9-40 View of the second array-site selection panelFrom this panel you can select the array sites

Chapter 9. The DS Storage Manager: Logical configuration 185The extent pools will take on either a server 0 or server 1 affinity at this point, as sh

Preface xixfor tuning and optimizing storage environments. She has written several papers about ESS Copy Services and disaster recovery solutions in

186 DS6000 Series: Concepts and ArchitectureFigure 9-43 View of the Select extent pool panelTo determine the quantity and size of the volumes, use

Chapter 9. The DS Storage Manager: Logical configuration 187You can give the volume a unique name and number that may help you manage the volumes, as

188 DS6000 Series: Concepts and ArchitectureFigure 9-46 The Define volume group properties filled outSelect the host attachment you wish to associa

Chapter 9. The DS Storage Manager: Logical configuration 189Select the volumes for the group panel, as shown in Figure 9-48.Figure 9-48 The Select

190 DS6000 Series: Concepts and Architecture4. Click Go.5. Click OK.9.3.10 Creating CKD LCUsUnder Simulated Manager, zSeries, perform the following

Chapter 9. The DS Storage Manager: Logical configuration 19112.Under the Define alias assignments panel, do the following:a. Click the check box next

192 DS6000 Series: Concepts and Architecture9.3.13 Displaying the storage units WWNN in the DS Storage Manager GUIUnder Simulated manager, perform t

Chapter 9. The DS Storage Manager: Logical configuration 193Figure 9-52 View of the WWNN in the General panelThe WWNN number is displayed as shown

194 DS6000 Series: Concepts and Architecture

© Copyright IBM Corp. 2004. All rights reserved. 195Chapter 10. DS CLIThis chapter provides an introduction to the DS Command-Line Interface (DS CLI),

xx DS6000 Series: Concepts and ArchitectureFigure 0-1 Front row - Cathy, Torsten R, Torsten K, Andre, Toni, Werner, Tetsuroh. Back row - Roland, Ol

196 DS6000 Series: Concepts and Architecture10.1 IntroductionThe IBM TotalStorage DS Command-Line Interface (the DS CLI) is a software package that

Chapter 10. DS CLI 197򐂰Manage host access to volumes򐂰 Configure host adapter portsThe DS CLI can be used to invoke the following Copy Services functi

198 DS6000 Series: Concepts and Architectureand then follows the prompts. If using a GUI, the user navigates to the CD root directory and clicks on t

Chapter 10. DS CLI 199Figure 10-1 Command flow for ESS 800 Copy Services commandsA CS server is now able to manage up to eight F20s and ESS 800s. T

200 DS6000 Series: Concepts and ArchitectureFigure 10-2 DS CLI Copy Services command flowDS8000 split networkOne thing that you may notice about Fi

Chapter 10. DS CLI 201Figure 10-3 Command flow for the DS6000For the DS6000, it is possible to install a second network interface card within the D

202 DS6000 Series: Concepts and ArchitectureFigure 10-4 CLI co-existenceStorage managementESS CLI commands that are used to perform storage managem

Chapter 10. DS CLI 20310.6 User securityThe DS CLI software must authenticate with the DS MC or CS Server before commands can be issued. An initial

204 DS6000 Series: Concepts and Architectureexit status of dscli = 0C:\Program Files\IBM\dscli>It is also possible to include single commands in a

Chapter 10. DS CLI 205a single instance of the DS CLI interpreter. Comments can be placed in the script if they are prefixed by a hash (#). A simple

Preface xxiDari DurnasIBM TampaLinda Benhase, Jerry Boyle, Helen Burton, John Elliott, Kenneth Hallam, Lloyd Johnson, Carl Jones, Arik Kol, Rob Kubo

206 DS6000 Series: Concepts and ArchitectureExample 10-8 Use of the help -l commanddscli> help -l mkflashmkflash [ { -help|-h|-? } ] [-fullid] [

Chapter 10. DS CLI 207echo A DS CLI application error occurred.goto end:level5echo An authentication error occurred. Check the userid and password.go

208 DS6000 Series: Concepts and Architecture# The following command checks the status of the rankslsrank -dev IBM.2107-9999999# The following command

Chapter 10. DS CLI 209Migration considerationsIf your environment is currently using the ESS CS CLI to manage Copy Services on your model 800s, you c

210 DS6000 Series: Concepts and ArchitectureFigure 10-6 A portion of the tasks listed by using the GUIIn Example 10-12, the list task command is us

Chapter 10. DS CLI 211Figure 10-7 Using the GUI to get the contents of a FlashCopy taskIt makes more sense, however, to use the ESS CLI show task c

212 DS6000 Series: Concepts and ArchitectureTable 10-3 Converting a FlashCopy task to DS CLISo to create the DS CLI command, simply read down the t

Chapter 10. DS CLI 213You can also confirm the status of the FlashCopy by using the Web Copy Services GUI, as shown in Figure 10-8.Figure 10-8 Flas

214 DS6000 Series: Concepts and ArchitectureHaving added the userid called csadmin, the password has been saved in an encrypted file called security.

Chapter 10. DS CLI 215# Default target Storage Image IDdevid: IBM.2105-23953An example of a command where the password is entered in plain text is sh

xxii DS6000 Series: Concepts and Architecture

216 DS6000 Series: Concepts and Architecture10.11 SummaryThis chapter has provided some important information about the DS CLI. This new CLI allows

© Copyright IBM Corp. 2004. All rights reserved. 217Part 4 Implementation and management in the z/OS environmentIn this part we discuss considerations

218 DS6000 Series: Concepts and Architecture

© Copyright IBM Corp. 2004. All rights reserved. 219Chapter 11. Performance considerationsThis chapter discusses early performance considerations rega

220 DS6000 Series: Concepts and Architecture11.1 What is the challenge?In recent years we have seen an increasing speed in developing new storage se

Chapter 11. Performance considerations 221Figure 11-1 Host server and storage server comparison: Balanced throughput challengeThe challenge is obvi

222 DS6000 Series: Concepts and Architecture11.2.1 SSA backend interconnectionThe Storage Serial Architecture (SSA) connectivity with the SSA loops

Chapter 11. Performance considerations 223relatively small logical volumes, we ran out of device numbers to address an entire LSS. This happens even

224 DS6000 Series: Concepts and ArchitectureFigure 11-2 Switched FC-AL disk subsystemPerformance is enhanced as both DAs connect to the switched Fi

Chapter 11. Performance considerations 225Figure 11-3 High availability and increased bandwidth connecting both DA to two logical loopsThese two sw

© Copyright IBM Corp. 2004. All rights reserved. 1Part 1 IntroductionIn this part we introduce the IBM TotalStorage DS6000 series and its key features

226 DS6000 Series: Concepts and ArchitectureThis just outlines the physical structure. A virtualization approach built on top of the high performance

Chapter 11. Performance considerations 227With two sets of HA chip sets the DS6000 series can configure up to eight FICON or FCP ports.Figure 11-5

228 DS6000 Series: Concepts and ArchitectureFigure 11-6 Standard PowerPC processor complexes for DS6800-511The next figure, Figure 11-7, provides a

Chapter 11. Performance considerations 229Figure 11-8 DS6800 with one DS6000 expansion enclosureNote that each Fibre Channel switch in the disk sub

230 DS6000 Series: Concepts and ArchitectureFigure 11-9 DS6000 interconnects to expansion enclosures and scales very wellFigure 11-9 outlines how e

Chapter 11. Performance considerations 23111.4.2 Data placement in the DS6000Once you have determined the disk subsystem throughput, the disk space

232 DS6000 Series: Concepts and ArchitectureFigure 11-10 Spreading data across ranksThe stripe sizeEach striped logical volume that is created by t

Chapter 11. Performance considerations 23311.4.5 Determining the number of paths to a LUNWhen configuring the IBM DS6000 for an open systems host, a

234 DS6000 Series: Concepts and Architecture11.5.1 Connect to zSeries hostsFigure 11-11 displays a configuration fragment on how to connect a DS6800

Chapter 11. Performance considerations 23513,600 I/Os per second with the conservative numbers. These numbers vary depending on the server type used.

2 DS6000 Series: Concepts and Architecture

236 DS6000 Series: Concepts and Architecture򐂰 0.2% cache to backstore ratio for high performance open systems򐂰 0.2% for z/OS for standard performance

Chapter 11. Performance considerations 237With 15K RPM DDMs you need the equivalent of three 8 packs to satisfy the I/O load from the host for this e

238 DS6000 Series: Concepts and Architecturecontrol the placement of each single volume and where it ends up in the disk subsystem. For the DS6000 th

Chapter 11. Performance considerations 239Minimize the number of extent poolsThe other extreme is to create just two extent pools when the DS6000 is

240 DS6000 Series: Concepts and ArchitectureFigure 11-14 Mix of extent poolsCreate two general extent pools for all the average workload and the ma

Chapter 11. Performance considerations 241128DDMs. Depending on the DDM size this reaches a total of up to 67.2 TB. Just the base enclosure provides

242 DS6000 Series: Concepts and Architecture

© Copyright IBM Corp. 2004. All rights reserved. 243Chapter 12. zSeries software enhancementsThis chapter discusses z/OS, z/VM, z/VSE™, and Transactio

244 DS6000 Series: Concepts and Architecture12.1 Software enhancements for the DS6000A number of enhancements have been introduced into the z/OS, z/

Chapter 12. zSeries software enhancements 245well with a DS6000 that has the capability to scale up to 8192 devices. With the current support, we may

© Copyright IBM Corp. 2004. All rights reserved. 3Chapter 1. Introducing the IBM TotalStorage DS6000 seriesThis chapter provides an overview of the fe

246 DS6000 Series: Concepts and ArchitectureToday control unit single point of failure information is specified in a table and must be updated for ea

Chapter 12. zSeries software enhancements 247򐂰ICKDSF 򐂰 DFSORT 򐂰 EREP12.2.7 New performance statisticsThere are two new sets of performance statistic

248 DS6000 Series: Concepts and Architecturesections: Extent Pool Statistics and Rank Statistics. These statistics are generated from SMF record 74 s

Chapter 12. zSeries software enhancements 249Figure 12-3 D M=DEV command output12.2.10 Migration considerationsA DS6000 will be supported as an IB

250 DS6000 Series: Concepts and Architecture򐂰 VSE/ESA 2.7 and higher.The PSP information can be found at:http://www-1.ibm.com/servers/resourcelink/sv

© Copyright IBM Corp. 2004. All rights reserved. 251Chapter 13. Data Migration in zSeries environmentsThis chapter describes several methods for migra

252 DS6000 Series: Concepts and Architecture13.1 Define migration objectives in z/OS environmentsData migration is an important activity that needs

Chapter 13. Data Migration in zSeries environments 2538-packs. The allocation of a volume happens in extents or increments of the size of an IBM 3390

254 DS6000 Series: Concepts and Architecturesource storage subsystems to one or fewer target storage servers. A second migration layer might be to co

Chapter 13. Data Migration in zSeries environments 255volume are not available to the application in order to keep data consistency between when the

4 DS6000 Series: Concepts and Architecture1.1 The DS6000 series, a member of the TotalStorage DS FamilyIBM has a wide range of product offerings tha

256 DS6000 Series: Concepts and ArchitectureFigure 13-2 Piper for z/OS environment configurationCurrently this server is a Mulitprise 3000, which c

Chapter 13. Data Migration in zSeries environments 257Most of these benefits also apply to migration efforts controlled by the customer when utilizin

258 DS6000 Series: Concepts and Architecturetarget volumes in the new disk storage server. It can restart immediately to connect to the new disk stor

Chapter 13. Data Migration in zSeries environments 259Figure 13-4 Intermediate ESS 800 used to migrate data with PPRC over ESCONTo utilize the adva

260 DS6000 Series: Concepts and ArchitectureFigure 13-5 Metro Mirror or Global Copy from ESS 750 or ESS 800 to DS6800Metro Mirror (Synchronous PPRC

Chapter 13. Data Migration in zSeries environments 261Figure 13-6 Check with Global Copy whether all data was replicated to the new volumeThis appr

262 DS6000 Series: Concepts and ArchitectureExample 13-2 All data is replicated PPRCOPY DDNAME(DD02) QUERY

Chapter 13. Data Migration in zSeries environments 263* PRIMARY... 5005076300C09621 2.4.01.0062 * * SECONDARY.1 50050763

264 DS6000 Series: Concepts and ArchitectureThe following software products and components support logical data migration:򐂰 DFSMS allocation manageme

Chapter 13. Data Migration in zSeries environments 265selection filters, to copy all data sets onto cartridges (ABACKUP) and then restore the aggrega

Chapter 1. Introducing the IBM TotalStorage DS6000 series 5Storage Manager for Data Retention, are designed to help you automatically preserve critic

266 DS6000 Series: Concepts and ArchitectureFigure 13-8 Utilize SMS SG and Volume status to direct all new allocation to new volumesWhen both the o

Chapter 13. Data Migration in zSeries environments 267 3. Alter - Alter a Storage Group 4. Volume

268 DS6000 Series: Concepts and Architecture MCECEBC ===> ENABLE MZBCVS2 ===> ENABLE DISALL, DISNEW, ===>

Chapter 13. Data Migration in zSeries environments 269 ===> Use ENTER to

270 DS6000 Series: Concepts and Architecture//SYSIN DD * COPY STORGRP(SG1)

Chapter 13. Data Migration in zSeries environments 271EXTVTOC, which requires you to delete and rebuild the VTOC index using EXTINDEX in the REFORMAT

272 DS6000 Series: Concepts and Architecture13.6 Summary of data migrationThe route which an installation takes to migrate data to one or more DS680

© Copyright IBM Corp. 2004. All rights reserved. 273Part 5 Implementation and management in the open systems environmentIn this part we discuss consid

274 DS6000 Series: Concepts and Architecture

© Copyright IBM Corp. 2004. All rights reserved. 275Chapter 14. Open systems support and softwareIn this chapter we describe how the DS6000 fits into

International Technical Support OrganizationThe IBM TotalStorage DS6000 Series:Concepts and ArchitectureMarch 2005SG24-6471-00

6 DS6000 Series: Concepts and Architecture1.2.1 Hardware overviewThe DS6000 series consists of the DS6800, Model 1750-511, which has dual Fibre Chan

276 DS6000 Series: Concepts and Architecture14.1 Open systems supportThe scope of open systems support of the new DS6000 model is based on that of t

Chapter 14. Open systems support and software 27714.1.2 Where to look for updated and detailed informationThis section provides a list of online res

278 DS6000 Series: Concepts and ArchitectureQLogic CorporationThe Qlogic web site can be found at:http://www.qlogic.comQLogic maintains a page that l

Chapter 14. Open systems support and software 279򐂰There is no support for IBM TotalStorage SAN Volume Controller Storage Software for Cisco MDS9000 (

280 DS6000 Series: Concepts and Architecture14.2 Subsystem Device DriverTo ensure maximum availability most customers choose to connect their open s

Chapter 14. Open systems support and software 281When you click the Subsystem Device Driver downloads link, you will be presented a list of all opera

282 DS6000 Series: Concepts and ArchitectureThe DS CLI allows you to invoke and manage logical storage configuration tasks and Copy Services function

Chapter 14. Open systems support and software 283Figure 14-1 IBM TotalStorage Productivity CenterTPC is the integration point for storage and fabri

284 DS6000 Series: Concepts and ArchitectureFigure 14-2 MDM main panelFor more information about the IBM TotalStorage Multiple Device Manager refer

Chapter 14. Open systems support and software 285configuration. Devices that are not SMI-S compliant are not supported. The DM also interacts and pro

Chapter 1. Introducing the IBM TotalStorage DS6000 series 7The disk drivesThe DS6800 controller unit can be equipped with up to 16 internal FC-AL dis

286 DS6000 Series: Concepts and ArchitectureTPC for Disk collects data from IBM or non-IBM networked storage devices that implement SMI-S. A performa

Chapter 14. Open systems support and software 28714.5.3 TPC for ReplicationTPC for Replication, formerly known as MDM Replication Manager, provides

288 DS6000 Series: Concepts and Architecture14.7 Enterprise Remote Copy Management Facility (eRCMF)eRCMF is a multi-site disaster recovery solution,

© Copyright IBM Corp. 2004. All rights reserved. 289Chapter 15. Data migration in the open systems environmentIn this chapter we discuss important con

290 DS6000 Series: Concepts and Architecture15.1 IntroductionThe term data migration has a very diverse scope. We use it here solely to describe the

Chapter 15. Data migration in the open systems environment 291Once it is decided which method (or methods) to use, the migration process starts with

292 DS6000 Series: Concepts and Architecture򐂰 Strong involvement of the system administrator is necessary.Today the majority of data migration tasks

Chapter 15. Data migration in the open systems environment 293Online copy and synchronization with rsyncrsync is an open source tool that is availabl

294 DS6000 Series: Concepts and ArchitectureUsually the process is to set up a mirror of the data on the old disks to the new LUNs, wait until it is

Chapter 15. Data migration in the open systems environment 295Figure 15-5 Migration using backup and restoreThe major disadvantage is again the dis

8 DS6000 Series: Concepts and ArchitectureDS6000 expansion enclosure (Model 1750-EX1)The size and the front look of the DS6000 expansion enclosure (1

296 DS6000 Series: Concepts and ArchitectureMetro Mirror and Global CopyFrom a local data migration point of view both methods are on par with each o

Chapter 15. Data migration in the open systems environment 29715.2.3 IBM Piper migrationPiper is a hardware and software solution to move data betwe

298 DS6000 Series: Concepts and Architecture15.2.4 Other migration applicationsThere are a number of applications available from other vendors that

© Copyright IBM Corp. 2004. All rights reserved. 299Appendix A. Operating systems specificsIn this appendix, we describe the particular issues of some

300 DS6000 Series: Concepts and ArchitectureGeneral considerationsIn this section we cover some topics that are not specific to a single operating sy

Appendix A. Operating systems specifics 301the data, even if this pool spans several ranks. If possible, the extents for one logical volume are taken

302 DS6000 Series: Concepts and ArchitectureThe output reports the following:򐂰 The %tm_act column indicates the percentage of the measured interval t

Appendix A. Operating systems specifics 303Example: A-3 SAR Sample Output# sar -u 2 5AIX aixtest 3 4 001750154C00 2/5/0317:58:15 %usr %sys %wio %id

304 DS6000 Series: Concepts and ArchitectureOther publicationsApart from the DS6000 Host Systems Attachment Guide, GC26-7680, there are two redbooks

Appendix A. Operating systems specifics 305 Device Specific.(ZB)...C2D3.91A1 Device Specific.(YL)...U1.13-P1-I1/Q1You can also

Chapter 1. Introducing the IBM TotalStorage DS6000 series 9from any location that has network access to the DS management console using a Web browser

306 DS6000 Series: Concepts and Architecture==========================================================================Path# Adapter/Hard Disk

Appendix A. Operating systems specifics 307The management of MPIO devices is described in the “Managing MPIO-Capable Devices” section of the System M

308 DS6000 Series: Concepts and ArchitectureLVM configurationIn AIX all storage is managed by the AIX Logical Volume Manager (LVM). It virtualizes ph

Appendix A. Operating systems specifics 309Direct I/OAn alternative I/O technique called Direct I/O bypasses the Virtual Memory Manager (VMM) altoget

310 DS6000 Series: Concepts and Architecture򐂰 0611 Direct Attach 2 Gigabit Fibre Channel PCI򐂰 0625 Direct Attach 2 Gigabit Fibre Channel PCI-XIt is a

Appendix A. Operating systems specifics 311 #MBs #opns #rds #wrs file volume:inode----------------------------------------

312 DS6000 Series: Concepts and Architecture seek dist (%tot blks):init 27.84031, avg 13.97180 min 0.00004 max 57.54421 sdev

Appendix A. Operating systems specifics 313Existing reference materialThere is a lot of information available that helps you set up your Linux server

314 DS6000 Series: Concepts and ArchitectureThe zSeries connectivity support page lists all supported storage devices and SAN components that can be

Appendix A. Operating systems specifics 315Table A-2 Minor numbers, partitions and special device filesMissing device filesThe Linux distributors d

10 DS6000 Series: Concepts and Architecture1.2.5 Business continuance functionsAs data and storage capacity are growing faster year by year most cus

316 DS6000 Series: Concepts and Architecturecommands, all special device files for SCSI disks have the same permissions. If an application requires d

Appendix A. Operating systems specifics 317RedHat Enterprise Linux (RH-EL) multiple LUN supportRH-EL by default is not configured for multiple LUN su

318 DS6000 Series: Concepts and Architecturescsi_hostadapter3 qla2300options scsi_mod max_scsi_luns=128Adding FC disks dynamicallyThe commonly used w

Appendix A. Operating systems specifics 319/dev/sdc - 2nd DS6000 volume, seen by HBA 0/dev/sdd - 1st DS6000 volume, seen by HBA 1/dev/sde - 2nd DS600

320 DS6000 Series: Concepts and ArchitectureMore information on running Linux in an iSeries partition can be found in the iSeries Information Center

Appendix A. Operating systems specifics 321Request Queue count= 128, Response Queue count= 512 . .Login retry count = 012Commands retried with drop

322 DS6000 Series: Concepts and ArchitectureDS6000 supports FC attachment to Microsoft Windows 2000/2003 servers. For details regarding operating sys

Appendix A. Operating systems specifics 323– If you reboot a system with adapters while the primary path is in a failed state, you must manually disa

324 DS6000 Series: Concepts and Architectureinformation and manage LUNs. See the IBM TotalStorage DS Open Application Programming Interface Reference

Appendix A. Operating systems specifics 325You must dedicate storage ports for only the OpenVMS host type. Multiple OpenVMS systems can access the sa

Chapter 1. Introducing the IBM TotalStorage DS6000 series 11Incremental FlashCopyIncremental FlashCopy provides the capability to refresh a LUN or vo

326 DS6000 Series: Concepts and Architecture򐂰 If the volume is planned for MSCP serving, then the UDID range is limited to 0–9999 (by operating syste

Appendix A. Operating systems specifics 327However, there is no forced error indicator in the SCSI architecture, and the revector operation is nonato

328 DS6000 Series: Concepts and Architecture

© Copyright IBM Corp. 2004. All rights reserved. 329Appendix B. Using the DS6000 with iSeriesIn this appendix, the following topics are discussed:򐂰 Su

330 DS6000 Series: Concepts and ArchitectureSupported environmentNot all hardware and software combinations for OS/400 support the DS6000. This secti

Appendix B. Using the DS6000 with iSeries 331When creating the logical volumes for use with OS/400, you will see that in almost every case, the OS/40

332 DS6000 Series: Concepts and ArchitectureAdding volumes to iSeries configurationOnce the logical volumes have been created and assigned to the hos

Appendix B. Using the DS6000 with iSeries 333Figure B-2 Work with Disk Units menu4. When adding disk units to a configuration, you can add them as

334 DS6000 Series: Concepts and ArchitectureFigure B-4 Specify ASPs to Add Units to6. The Confirm Add Units panel will appear for review as shown i

Appendix B. Using the DS6000 with iSeries 335Figure B-6 iSeries Navigator initial panel2. Expand the iSeries to which you wish to add the logical v

12 DS6000 Series: Concepts and ArchitectureGlobal CopyThis is a non-synchronous long distance copy option for data migration and backup.Global Copy w

336 DS6000 Series: Concepts and ArchitectureFigure B-8 iSeries Navigator Disk Units4. You will be asked to sign on to SST as shown in Figure B-9. E

Appendix B. Using the DS6000 with iSeries 337Figure B-10 Create a new disk pool6. The New Disk Pool wizard appears as shown in Figure B-11. Click N

338 DS6000 Series: Concepts and Architecture7. On the New Disk Pool dialog shown in Figure B-12, select Primary from the pull-down for the Type of di

Appendix B. Using the DS6000 with iSeries 339Figure B-14 Add disks to Disk Pool10.A list of non-configured units similar to that shown in Figure B-

340 DS6000 Series: Concepts and ArchitectureFigure B-16 Confirm disks to be added to Disk Pool12.A summary of the Disk Pool configuration similar t

Appendix B. Using the DS6000 with iSeries 341Figure B-18 New Disk Pool Status14.When complete, click OK on the information panel shown in Figure B-

342 DS6000 Series: Concepts and ArchitectureFigure B-21 New logical volume shown on iSeries NavigatorMultipathMultipath support was added for exter

Appendix B. Using the DS6000 with iSeries 343Prior to multipath being available, some customers used OS/400 mirroring to two sets of disks, either in

344 DS6000 Series: Concepts and ArchitectureFigure B-23 Multipath removes single points of failureUnlike other systems, which may only support two

Appendix B. Using the DS6000 with iSeries 345Figure B-24 Example of multipath with iSeriesFigure B-24 shows an example where 48 logical volumes are

Chapter 1. Introducing the IBM TotalStorage DS6000 series 13large zSeries resiliency requirements. The DS6000 series systems can only be used as a ta

346 DS6000 Series: Concepts and ArchitectureFigure B-25 Adding multipath volumes to an ASP5. You will then be presented with a confirmation screen

Appendix B. Using the DS6000 with iSeries 347When you get to the point where you will select the volumes to be added, you will see a panel similar to

348 DS6000 Series: Concepts and ArchitectureWhen you have completed these steps, the new Disk Pool can be seen on iSeries Navigator Disk Pools in Fig

Appendix B. Using the DS6000 with iSeries 349Managing multipath volumes using iSeries NavigatorAll units are initially created with a prefix of DD. A

350 DS6000 Series: Concepts and ArchitectureTo see the other connections to a logical unit, right click the unit and select Properties, as shown in F

Appendix B. Using the DS6000 with iSeries 351You will then see the General Properties tab for the selected unit, as in Figure B-32. The first path is

352 DS6000 Series: Concepts and ArchitectureTo see the other paths to this unit, click the Connections tab, as shown in Figure B-33, where you can se

Appendix B. Using the DS6000 with iSeries 353Disk unit connections might be missing for a variety of reasons, but especially if one of the preceding

354 DS6000 Series: Concepts and ArchitectureFigure B-34 Process for sizing external storagePlanning for arrays and DDMsIn general, although it is p

Appendix B. Using the DS6000 with iSeries 355Number of iSeries Fibre Channel adaptersThe most important factor to take into consideration when calcul

14 DS6000 Series: Concepts and ArchitectureLight Path Diagnostics and controls are available for easy failure determination, component identification

356 DS6000 Series: Concepts and ArchitectureWhen considering the number of ranks, take into account the maximum disk operations per second per rank a

Appendix B. Using the DS6000 with iSeries 357Based on available measurements and experiences with the ESS 800 we recommend you should plan no more th

358 DS6000 Series: Concepts and ArchitectureFigure B-35 Using Metro Mirror to migrate from ESS to the DS6000The same setup can also be used if the

Appendix B. Using the DS6000 with iSeries 359You can then use the OS/400 command STRASPBAL TYPE(*ENDALC) to mark the units to be removed from the con

360 DS6000 Series: Concepts and ArchitectureCopy Services for iSeriesDue to OS/400 having a single level storage, it is not possible to copy some dis

Appendix B. Using the DS6000 with iSeries 361storage) being copied, only the application resides in an IASP and in the event of a disaster, the targe

362 DS6000 Series: Concepts and ArchitectureFor more information on running AIX in an i5 partition, refer to the i5 Information Center at:򐂰 http://pu

© Copyright IBM Corp. 2004. All rights reserved. 363Appendix C. Service and support offeringsThis appendix provides information about the service offe

364 DS6000 Series: Concepts and ArchitectureIBM Web sites for service offeringsIBM Global Services (IGS) and the IBM Systems Group can offer comprehe

Appendix C. Service and support offerings 365The IBM Piper hardware assisted migration in the zSeries environment is described in this redbook in “Da

Chapter 1. Introducing the IBM TotalStorage DS6000 series 15On an ESS there was a predefined association of arrays to Logical Subsystems. This caused

366 DS6000 Series: Concepts and ArchitectureIt simplifies the disaster recovery implementation and concept. Once eRCMF is configured in the customer

Appendix C. Service and support offerings 367Figure 15-9 Example of the Supported Product List (SPL) from the IBM Support Line

368 DS6000 Series: Concepts and Architecture

© Copyright IBM Corp. 2004. All rights reserved. 369Related publicationsThe publications listed in this section are considered particularly suitable f

370 DS6000 Series: Concepts and Architecture򐂰 Device Support Facilities: User’s Guide and Reference, GC35-0033򐂰 z/OS Advanced Copy Services, SC35-024

Related publications 371򐂰CNT:http://www.cnt.com/ibm/򐂰 Nortel: http://www.nortelnetworks.com/򐂰 ADVA: http://www.advaoptical.com/How to get IBM Redboo

372 DS6000 Series: Concepts and Architecture

© Copyright IBM Corp. 2004. All rights reserved. 373IndexSymbols 39, 52, 66, 146, 196, 230, 232, 271, 330, 357Aaddress groups 77, 158AIXaccess me

374 DS6000 Series: Concepts and Architectureinstallation methods 197migration 208migration example 209mixed device environments 208return cod

Index 375controller enclosure 6controller RAS 46Ethernet cables 42FICON 50host connection 49interoperability 13major features 7microco

© Copyright International Business Machines Corporation 2004. All rights reserved.Note to U.S. Government Users Restricted Rights -- Use, duplication

16 DS6000 Series: Concepts and Architectureattachments, along with the flexibility to easily partition the DS6000 series storage capacity among the a

376 DS6000 Series: Concepts and ArchitectureIncremental FlashCopy 11, 92Independent Auxiliary Storage Pool see IASPindicatorsCRU endpoint 60DA po

Index 377microcodemaintaining 62updates 62Microsoft Windows 2000/2003 321HBA and operating system settings 322SDD 322MPIO 306multipathin

378 DS6000 Series: Concepts and ArchitectureSequential prefetching in Adaptive Replacement Cache see SARCserial port 35server attachment license

(0.5” spine)0.475”<->0.873”250 <-> 459 pagesDS6000 Series: Concepts and ArchitectureDS6000 Series: Concepts and ArchitectureDS6000 Series:

DS6000 Series: Concepts and ArchitectureDS6000 Series: Concepts and Architecture

®SG24-6471-00 ISBN INTERNATIONAL TECHNICALSUPPORTORGANIZATIONBUILDING TECHNICAL INFORMATION BASED ON PRACTICAL EXPERIENCEIBM Redbooks are developed by

Chapter 1. Introducing the IBM TotalStorage DS6000 series 17high cache hit rate, your cache hit rate on the DS6800 will drop down. This is because of

18 DS6000 Series: Concepts and Architecture1.3.4 Use with other virtualization productsIBM TotalStorage SAN Volume Controller is designed to increas

Chapter 1. Introducing the IBM TotalStorage DS6000 series 19pending Sequential prefetching in Adaptive Replacement Cache (SARC) places data in cache

20 DS6000 Series: Concepts and Architecture

© Copyright IBM Corp. 2004. All rights reserved. 21Part 2 ArchitectureIn this part we describe various aspects of the DS6000 series architecture. Thes

22 DS6000 Series: Concepts and Architecture

© Copyright IBM Corp. 2004. All rights reserved. 23Chapter 2. ComponentsThis chapter details the hardware components of the DS6000. Here you can read

24 DS6000 Series: Concepts and Architecture2.1 Server enclosureThe entire DS6800 including disks, controllers, and power supplies, is contained in a

Chapter 2. Components 252.2 Expansion enclosureThe DS6000 expansion enclosure is used to add capacity to an existing DS6800 server enclosure. From t

iii

26 DS6000 Series: Concepts and Architecturethe data is written to volatile memory on one controller and persistent memory on the other controller. Th

Chapter 2. Components 27If you can view Figure 2-4 on page 26 in color, you can use the colors as indicators of how the DS6000 hardware is shared bet

28 DS6000 Series: Concepts and Architectureis not feasible in real-life systems), SARC uses prefetching for sequential workloads. Sequential access p

Chapter 2. Components 29cache space and delivers greater throughput and faster response times for a given cache size.Additionally, the algorithm modi

30 DS6000 Series: Concepts and ArchitectureFigure 2-7 Industry standard FC-AL disk enclosureThe main problems with standard FC-AL access to DDMs ar

Chapter 2. Components 31Figure 2-8 Disk enclosureWhen a connection is made between the device adapter and a disk, the connection is a switched conn

32 DS6000 Series: Concepts and ArchitectureFigure 2-10 Switched disk expansionDDMsEach DDM is hot plugable and has two indicators. The green indica

Chapter 2. Components 33spare. So at least two spares are created per loop, which will serve up to four enclosures, depending on the disk intermix.2.

34 DS6000 Series: Concepts and Architecturein Figure 2-10 on page 32 (with loop 0 going upwards and loop 1 going in the downwards direction).You add

Chapter 2. Components 35Figure 2-12 SFP hot-plugable fibre port with LC connector fiber cableEthernet and serial portsEach controller card has a 10

iv DS6000 Series: Concepts and Architecture

36 DS6000 Series: Concepts and ArchitectureFigure 2-13 DS6000 expansion enclosure SBOD controller cardIndicatorsOn the right-hand side, contained i

Chapter 2. Components 37these cables are pictured in orange and green (which appear darker if viewed in black and white). In each case cables run fro

38 DS6000 Series: Concepts and ArchitectureTable 2-1 summarizes the purpose of each indicator.Table 2-1 DS6000 front panel indicators2.8 Rear pane

Chapter 2. Components 39Figure 2-17 DS6000 rear panelTable 2-2 DS6000 rear panel push buttons Enclosure ID indicatorThe rear display also has an

40 DS6000 Series: Concepts and Architecture2.9 Power subsystemThe power subsystem of the DS6800 consists of two redundant power supplies and two bat

Chapter 2. Components 412.9.1 Battery backup unitsEach DS6800 RAID controller has a battery backup unit (BBU) to provide DC power to that controller

42 DS6000 Series: Concepts and Architecture2.10 System service cardThe system service card which ships with the DS6800 can be placed in a cavity bel

Chapter 2. Components 432.13 SummaryThis chapter has described the various components that make up a DS6000. For additional information, there is do

44 DS6000 Series: Concepts and Architecture

© Copyright IBM Corp. 2004. All rights reserved. 45Chapter 3. RASThis chapter describes the RAS (reliability, availability and serviceability) charact

© Copyright IBM Corp. 2004. All rights reserved. vContentsNotices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

46 DS6000 Series: Concepts and Architecture3.1 Controller RASThe DS6800 design is built upon IBM’s highly redundant storage architecture. It has the

Chapter 3. RAS 47Figure 3-1 DS6800 normal data flowFigure 3-1 illustrates how the cache memory of controller 0 is used for all logical volumes that

48 DS6000 Series: Concepts and ArchitectureFigure 3-2 Controller failoverThis entire process is known as a failover. After failover, controller 1 n

Chapter 3. RAS 49input power, the DS6800 controller cards would detect that they were now running on batteries and immediately shut down. The BBUs ar

50 DS6000 Series: Concepts and ArchitectureFigure 3-3 A host with a single path to the DS6800For best reliability and performance, it is recommende

Chapter 3. RAS 51A logic or power failure in a SAN switch can interrupt communication between hosts and the DS6800. We recommend that more than one S

52 DS6000 Series: Concepts and ArchitectureA physical FICON path is established when the DS6800 port sees light on the FICON fiber (for example, a ca

Chapter 3. RAS 53array site (where the S stands for spare). A four disk array also effectively uses 1 disk for parity, so it is referred to as a 3+P

54 DS6000 Series: Concepts and ArchitectureIf two array sites are used to make a RAID-10 array and the array sites contain spares, then six DDMs are

Chapter 3. RAS 55DDM, then approximately half of the 146 GB DDM would be wasted since that space is not needed. The problem here is that the failed 7

vi DS6000 Series: Concepts and Architecture2.5.1 Technical details . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

56 DS6000 Series: Concepts and Architecturepaths) since two paths to the expansion controller would be available for the remaining controller.Figure

Chapter 3. RAS 57Redundant coolingThe DS6000 gets its cooling from the two fan assemblies in each power supply. Provided one power supply is working

58 DS6000 Series: Concepts and ArchitectureFigure 3-6 Failed power supplyIf a power supply failure is indicated, the user could then follow this pr

Chapter 3. RAS 59Figure 3-7 Power supply replacement via the GUI2. Upon arrival of the replacement supply, the user physically removes the faulty p

60 DS6000 Series: Concepts and Architecture3.5.3 System indicatorsThe DS6000 uses several simple indicators to allow a user to quickly determine the

Chapter 3. RAS 61additional guidance on the CRU replacement procedure is required. This includes a situation in which it is unclear which CRU has fai

62 DS6000 Series: Concepts and Architecture3.6 Microcode updatesThe DS6000 contains several discrete redundant components. Most of these components

Chapter 3. RAS 63progress using the DS Management Console GUI. Clearly a multipathing driver (such as SDD) is required for this process to be concurr

64 DS6000 Series: Concepts and Architecture

© Copyright IBM Corp. 2004. All rights reserved. 65Chapter 4. Virtualization conceptsThis chapter describes the virtualization concepts for the DS6000

Contents vii5.1 DS6000 highlights . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 845.1.1

66 DS6000 Series: Concepts and Architecture4.1 Virtualization definitionIn our fast changing world, where you have to react quickly to changing busi

Chapter 4. Virtualization concepts 67Figure 4-1 Physical layer as the base for virtualizationWhen you compare this with the ESS design, where there

68 DS6000 Series: Concepts and ArchitectureFigure 4-2 Array sitesArray sites are the building blocks used to define arrays.4.2.2 ArraysArrays are

Chapter 4. Virtualization concepts 69Figure 4-3 Creation of an arraySo, an array is formed using one or two array sites, and while the array could

70 DS6000 Series: Concepts and Architectureand a Model 1 has 1113 cylinders, which is about 0.94 GB. The extent size of a CKD rank therefore was chos

Chapter 4. Virtualization concepts 71The DS Storage Manager GUI guides the user to use the same RAID types in an extent pool. As such, when an extent

72 DS6000 Series: Concepts and Architecture4.2.5 Logical volumesA logical volume is composed of a set of extents from one extent pool. On a DS6000 u

Chapter 4. Virtualization concepts 73Figure 4-6 Allocation of a CKD logical volumeFigure 4-6 shows how a logical volume is allocated with a CKD vol

74 DS6000 Series: Concepts and ArchitectureFigure 4-7 Creation of an FB LUNiSeries LUNsiSeries LUNs are also composed of fixed block 1 GB extents.

Chapter 4. Virtualization concepts 75algorithm exists, the user may want to consider putting one rank per extent pool to control the allocation of lo