Navigation Bar

Enterprise Storage Selection

An enterprise subsystem can be defined as one that supports all the major operating systems; z/OS, Unix variants, Linux variants, Windows and Netware. The major enterprise vendors are discussed below.

The first section discusses the enterprise products from the five big enterprise vendors; EMC, HDS, IBM, SUN and HP. The second section is a table that compares their products.

EMC

History

EMC started out producing cache memory and developed solid state disks, memory devices that emulated spinning disks, but with much faster performance. These solid state disks were usually re-badged and sold by StorageTek.

Around 1988, EMC entered the storage market in its own name, selling symmetrix disk subsystems with what at that time was a very large, 256MB cache fronting 24GB of RAID 1 storage. Their mosaic architecture was the first to map IBM CKD mainframe disk format to standard FBA open system backend disks, and as such, could claim to be the first big user of storage virtualisation. In those days, EMC developed a reputation for delivering best performance, but at a price.

EMC introduced their latest addition to the symmetrix range, the DMX-4, in July 2007. The underlying mosaic, or direct matrix architecture with static cache mapping is still the same as the original symm. from 25 years ago. EMC are now price compatible with the other vendors.

Architecture

The DMX series uses the Direct Matrix architecture, now called Enginuity. The principle behind Direct Matrix is that all IO comes into the box the front-end directors. These are connected to memory cache modules, which are in turn connected to back-end directors that drive the IO down to the physical disks. This connectivity is all done by a directly connected, point-to-point fibre-channel matrix. There is no switching or bus arbitration involved. Each DMX-4 data path runs at 4GB/s, and there are 128 concurrent data paths. In 2008, EMC became the first to use flash storage in an enterprise subsystem, for high performance applications.

Models

The DMX800 is a rack mounted, entry level fibre channel storage subsystem that will support up to 120 drives. These can be 500GB LC-FC, so the maximum raw capacity is 60TB. It is mainframe capable, but with FICON connectivity only.

The DMX-3 range was intended for large scale storage consolidation. It comes as a minimum of two cabinets, one being the system bay and the other the storage bay. It can be extended with another nine storage bays. Each storage bay holds 240 disk drives, so the maximum drive capacity is 2,400, and will hold just over 1 petabyte of data on 500GB LC-FC drives (in theory. Does anyone actually do this?).

The Symmetrix DMX-4 became generally available in August 2007 and it comes in two models.
The DMX-4 950 is a one or two cabinet entry level subsystem with a maximum capacity of 179TB raw and a maximum cache capacity of 128GB. It now supports mainframes with FICON connectivity, and has the same software facilities as the larger box, but has smaller power requirements and heat specifications than DMX-4 .
The larger box, the DMX-4 is very scalable, from 96-2,400 drives, or up to 1 petabyte. It now supports 1 TB SATAII drives. Internally, it can now support 4Gb/s communications end to end, with 4 Gb/s support for FICON or Fibre Channel host connections, internal connectivity and Fibre Channel Drives. The new backend architecture is a point-to-point.

New versions of Enginuity algorithms have improved performance in many areas. EMC quotes up to 30% improvement in sequential read performance, up to 25% improvement in RAID 5 and RAID 6 performance, 33% increase in SRDF/S remote replication performance and a 10x reduction in time to perform some TimeFinder/Clone operations. If you have bought a DMX-3, then you can also get these performance improvements as the new version is a free upgrade.

Software

DMX software includes EMC Control Centre for management, the Time Finder products for in-subsystem and PIT replication, and SRDF for remote replication. SRDF can now run in full PPRC compatibility mode, and can also replicate to three sites in a star configuration.

Openness

The DMX in general is not an Open implementation. SRDF, for example, will only work between EMC devices, and even then, not with all of them. EMC Open Replicator has the ability to take PIT copies from selected non-EMC subsystems to DMX, or to copy from DMX to selected non-EMC devices.

HDS

History

Hitachi Data Systems was always known as the company that manufactured disks that were exactly compatible with IBM, but worked a little faster and cost a little less. HDS broke that mould when they introduced the 'Lightning' range of subsystems in 2000, which was a merging of telephony cross-bar technology and storage subsystem technology. They extended and developed that architecture further with the USP (Universal Storage Platform), released in September 2004.

Architecture

The USP architecture is based on cross-bar switch connectivity, in-subsystem virtualisation, the ability to partition a subsystem into component LPARS and to ability to replicate data to externally attached subsystems.
The USP components are Disk Adaptor modules, Front End Director modules and Cache modules. These are connected by a set of massively parallel cross-bar switches called a Hierarchical Star Network (HSN). The 'massively parallel' bit means that each switch has a dedicated fibre link to every input and output component, so the switch can set up multiple and parallel paths between devices. This makes the architecture non-blocking. The USP also has two HSNs, one for the physical data, and one for the control data.
The USP supports subsystem based virtualisation, with the ability to attach OEM devices behind the subsystem and virtualise them. This means that the USP can replicate and transparently migrate data internally, and also to externally attached subsystems
The USP can also be partitioned into 32 LPARs or Virtual Private Storage Machines which can be used to isolate workloads. These LPARS can consist of a mixture of internal USP storage and externally attached storage. It is not possible to replicate data between LPARS, and all z/OS data must be kept in the base LPAR.

Models

The enterprise USP comes in four models, with an entry level NSC55 device. Hardware wise, the newer USPV looks the same as a USP1100. The USP models are all cabinet mounted and differ in maximum cache size, number of array frames and so number of internal disks supported and number of cross-bar switches. The older USP devices can connect up to 32 Petabytes of external storage, at least in theory, while the USPV can connect up to 247 PB externally. It is possible to upgrade between USP models without requiring an outage.

Model Frames Cache size Internal disk drives Internal capacity Number of cross-bar switches
USP100 1+1 64 GB 256 76 TB 2
USP600 1+2 128 GB 512 153 TB 4
USPV / USP1100 1+4 256 GB 1,152 332 TB 4
NSC55 1+3 racks 64 GB 240 72 TB 2

Software

The USP uses HiCommand to manage both disk and virtualisation configuration.

Replication software is provided under an umbrella product called Business Continuity Manager. This is integrated into the HiCommand product which means that z/OS and Open Systems replication can all be managed and monitored from one point. The actual replication software includes ShadowImage (FlashCopy compatible) for in-subsystem replication, TrueCopy for remote synchronous and asynchronous replication and Universal Replicator for remote asynchronous replication.

Openness

The USP is an open architecture, in that it works with disks from many other vendors and virtualises the data. The list of supported vendors includes EMC, HP, IBM and SUN, as well as older HDS devices. In general, the USP will support the hardware, but replaces the OEM replication software with its own.

IBM

History

The original IBM hard drive, the RAMAC 350, was manufactured in 1956, had a 24 inch (609mm) platter, and held 5 MB. The subsystem also weighed about 1 ton. That was a bit before my time, but when I joined IT 23 years ago, the storage market was dominated by IBM, the mainframe was king, and the standard disk type was the IBM 3380 model K which contained 1.89 GB. IBM lost their market leader position to EMC sometime in the 1990s.

IBM introduced their latest subsystem family, the DSxxxx series, in late 2004 in response to competition from EMC and HDS. They updated their internal bus architecture to increase the internal transfer speed by 200% plus over the ESxxx series, and also abandoned their SSA disk architecture for a switched FC-AL standard. The DS8300 is essentially a follow-on from the ESS disk series, and re-uses much of the ESS microcode.

Architecture

The DS8000 architecture effectively consists of two processor complexes called servers that are connected to hosts using host adaptors, and disks using device adaptors.
The processor complex consists of 2-way or 4-way p-570 servers containing two types of cache, volatile and persistent memory. Every write IO is written to volatile memory in one processor, and non-volatile in the other before the write is acknowledged as complete. The subsystem effectively works internally as two separate units, but one server can run the whole subsystem if the other fails.
The subsystem can also be split logically into two completely independent, but equally sized LPARS. The servers are connected to the device adaptors with RI0-G connectors, the same as is used internally in the p-series servers. These links can run at a 2 GB per second sustained bandwidth and permit the sharing of host adapters between servers. The device adaptors are essentially RAID controllers. The device adaptors are connected to the disks using Switched FC-AL, but they are not in an FC-AL loop.
The disks are allocated FC-AL addresses to allow the switching to work, but once the connection is made, communications are point-to-point Fibre Channel.

For more detail, try http://www.redbooks.ibm.com/redpieces/pdfs/sg246786.pdf

Models

The top range DS8300 is a cabinet mounted subsystem that can support a maximum of 640 disk drives and will hold a maximum of 320 TB raw capacity using 500GB FATA disks, or 192 TB using 300GB FC disks. The base cabinet holds 128 disk drives, up to two expansion cabinets can be added, each holding 256 disk drives. The raw disks are supplied in blocks of sixteen, but are configured in groups of eight, with each group being called an array group. All the disks in an array group must have identical size and rotation speed. The DS8300 uses two four-way p-570 servers

The DS8100 spec. is similar to the DS8300, except that it will only support one expansion frame, contains a maximum of 384 drives, and has a maximum raw capacity of 192 TB. The internal processor specification is also lower, at two dual processor p-570 servers.

The DS8000 series currently has three Turbo models available: the DS8100 Turbo Model 931, and the DS8300 Turbo Models 932 and 9B2. The 931 and 932 models do not support LPARS, and have 2-way or 4-way processors respectively. The 9B2 model does support LPARS and has 4-way processors.

The DS6800 is rack mounted, and supports up to 16 disk drives in the base unit. With seven expansion units, it can hold up to 128 drives, giving a maximum raw capacity of 38.4 TB with 300GB drives.

Software

The DS software includes Flashcopy for internal subsystem point-in-time data copies, IBM Total Storage DS Manager for configuration and Metro/Global mirror for continuous inter-subsystem data replication.

The older ESS subsystems supported two kinds of z/OS Flashcopy, a basic version that just copied disks, and an advanced version that copied disks and files. DS only supports the advanced Flashcopy.
Flashcopy versions include; multi-relationship, will support up to 12 targets;
Incremental, can refresh an old Flashcopy to bring the data to a new point-in-time without needing to recopy unchanged data;
Remote Mirror Flashcopy, permits dataset flash operations to a primary mirrored disk; Inband Flashcopy commands, permits the transmission of flashcopy commands to a remote site through a Metro Mirror link;
Consistency Groups, flash a group of volumes to a consistent point-in-time. A consistency group can span multiple disk subsystems.

Remote mirroring versions include;
Metro Mirror, synchronous remote mirroring up to 300km, was PPRC; Global Copy, asynchronous remote data copy intended for data migration or backup, was PPRC-XD;
Global Mirror, asynchronous remote mirroring;
Metro/Global Mirror, three site remote replication, two sites being synchronous and the third asynchronous;
z/OS Global Mirror, z/OS host based asynchronous remote mirror, was called XRC;
Z/OS Metro/Global Mirror, three site remote replication, two sites being synchronous and quite close together, the third asynchronous and remote.

Openness

The DS subsystem series is self contained and does not interface with any other vendor's storage subsystem. For Open Systems data, IBM does support mirroring and copying to other vendor's subsystems if they are fronted with SVC virtualisation.

Futures

IBM promised a lot of enhancements to the DS series when they were first announced, and has delivered SATA drive support, space efficient Flashcopy, 4Gb FICON and virtual LUN space support so far.
The DS Subsystem LPARing is currently restricted to two LPARS both of which must be the same size. IBM propose to increase the number of LPARs, allow them to be different sizes and allow them to support different microcode levels in future

HP

History

I've always viewed HP as a major Intel player, but not a supplier with much of a presence in the mainframe market. I'm willing to change that view if someone can share their experiences. HP has been a Hitachi reseller for some time, but while they buy USP hardware from Hitachi, HP supplies its own software. They also modify the hardware slightly so it can support more communications channels.

Architecture

Because the HP XP12000 is a re-badged Hitachi USP, it has the same basic architecture. The difference is that the HP device supports an extra CHIP set and so provides more connectivity; 192 fibre channels. This makes the XP12000 more attractive in the Intel world.

Models

HP has elected to supply one USP type model, the XP12000, which can be configured as any of the HDS USP models. The XP10000 is the equivalent of the NCS55.

Software

For mainframe solutions, HP seems to supply standard HDS software. For Open Systems solutions, HP supplies its own software. This includes

  • Storageworks Continuous Access which provides synchronous data mirroring between subsystems
  • Storageworks Business Copy which provides full volume copy within the subsystem. This looks similar to EMC Timefinder rather than IBM FlashCopy
  • Storageworks Virtualization system, an internal and external virtualisation manager, can be used for data migration and replication
  • Storageworks LUN configuration and Security manager which is used to configure the XP12000, to define paths, array groups, volumes and LUNs
  • StorageWorks Performance Advisor which monitors performance within the XP subsystem

Openness

The XP12000 has the same open architecture as the HDS USP and supports the same range of OEM devices, plus it supports HP MSA devices.

SUN

History

Until recently, I've always considered SUN to be a midrange company that supplied storage for its server devices. While they have been Hitachi resellers for some time, they were never big in the enterprise market. However, SUN bought out StorageTek in June 2005 and StorageTek was an enterprise player. StorageTek was the first major company to put solid state cache in front of disks to make them perform better. In the late 1990s they brought out the Iceberg product. From an architectural perspective this box should have cleaned up the market with its innovative design and data management facilities. However even with IBM backing it was unable to really compete with the EMC 8xxx series and HDS 77xx series.
For the enterprise market, SUN still sells STK V2X devices and also resells the Hitachi USP as a re-badged SUN device.

Architecture

As it is the same device, the SUN 9990 architecture is identical to the HDS USP.

Models

SUN has opted to resell the USP range as a single product, called the SUN Storedge 9990. They resell the NSC55 as the SUN Storedge 9985

Software

The SUN Storedge 9990 runs the same HDS software as the USP

Openness

As the SUN 9990 is a re-badged HDS, it shares the same open architecture.

Netapps

NetApps is becoming one of the major Open Systems vendors. They specialise in the Intel market (Windows, Netware, Linux) and should be considered 'one to watch', rather than a current enterprise storage contender.

Their hardware range includes the Network Appliance series, of which the FAS6070 is expandable up to 500TB.

Their software range includes various SnapMirror and SnapClone products for inter subsystem and intra subsystem data copying. They have MSSQL, Oracle and Exchange agents.

Storage Subsystem Features table

The various suppliers of mainframe disks are contrasted in the tables below. The first row explains why the factor might be important, the second row just presents the facts, which were correct at time of writing, February 2008.

Manufacturer IBM EMC HDS SUN HP
Device DS8300 -932 DMX-4 Platform V
(SUN SE9990)
9980V FlexLine V2X2/F XP12000
Architecture See the previous page for an explanation of the various types of disk architecture
PCI BUS Direct Matrix Switch Bus / Log Structured File Switch
Maximum, and maximum effective capacity How much data can you cram into the box? The maximum configured capacity will be less than the rated capacity, partly due to RAID overhead, and partly due to 3390 emulation overhead. The configured figures are for Mainframe emulation, Open Systems emulation will be higher. The maximum EFFECTIVE capacity for a mainframe workload running IO intensive TP systems can be as little as 33% of the maximum capacity, if you want adequate performance.
192TB, Effective TP workload capacity is 30TB Using 1920*1 TB drives, 1,894 TB raw or 1,600TB usable with RAID7+1 on z/OS
Using 1920*146 GB drives, 243TB raw or 246TB usable with RAID7+1 on Open Systems. (EMC quote for 2,400 volumes to get the capacity over 1PB,but this is a special configuration)
332TB raw maximum, RAID1 usable capacities
165 Tb; Open Systems
143 TB; z/OS
147.5TB with 146GB drives, 119TB usable with RAID5 V2XF, 23.2 TB; V2X2, 11.6TB both assuming 4:1 data compression 332TB raw maximum,
165 Tb usable; Open Systems
143 TB usable; z/OS
Connectivity What kind of cables you can plug into the box. A good box will support both FICON and Fibre at 4Gb/s and maybe 8Gb/s Ethernet. All boxes should support ESCON and iSCSI. The number of channels available is also important as that determines the overall throughput.
128 4Gb FICON or FC,
64 ESCON
Up to
64 ESCON
48*4Gb FICON
64*4Gb fibre
48 iSCSI
8 *1Gb Ethernet
96 ESCON
96 FICON
192 FC (Platform V, 224 FC with 1024 virtual channels per physical port)
32 iSCSI
Up to 64 channels in total, a combination of 48 ESCON, 32 FICON or 64 Fibre V2X2, Up to 32 ESCON, or 16 Fibre;
V2XF, Up to 16 FICON
112 ESCON
112 FICON
224 FC
32 iSCSI
Internal Bandwidth How fast can data move inside the box? The numbers quoted are marketing figures, you won't really see these numbers in practice. See the Architecture section for more information.
16 Gb/s 128 Gb/s 68 Gb/s 10.6 Gb/s 4 Gb/s 68 Gb/s
Disk Connectivity See the previous page for details of disk connectivity.
Switched FC-AL FC-AL FC-AL FC-AL FC-AL FC-AL
Cache size In theory, the bigger the cache, the better the performance, as you will get a better read-hit ratio, and big writes should not flood the cache. If the cache is segmented, it is more resilient, and has more data paths through it
32-256 GB 32-512 GB mirrored, which makes the maximum effective capacity 256 GB. Up to 32 concurrent data paths, up to 32 independent regions 256 GB
192 concurrent control cache operations
64 concurrent data cache operations
32 GB 96 concurrent operations, mirrored 96 GB (virtual size) 256 GB
192 concurrent control cache operations
64 concurrent data cache operations
3380/90 emulation 3380 drives are older legacy technology and most sites have now converted to 3390. 3390 comes in multiple sizes, a 3390-3 will hold 2.8 GB. The newest model is the 3390-54.
All models 3380-K,
3390-1,2,3,9,27,54
All models, supports up to 65,536 logical devices (the older USPs just support 16,384 Open Systems devices) All models 3380-J/E/K (maximum 4096 devices)
3390-1/2/3 (maximum 4096 devices); 3390-9 (maximum 2730 devices); 3390-27 (maximum 834 devices)
All models, supports up to 65,536 logical devices (or 16,384 Open Systems devices)
RAID levels supported See the RAID section for details
5,10 0,1,5 (3+1 or 7+1),6,10 1/0 1,5,6,10 1,5,10 6+ 1,5,6,10
Physical disk size How big are the real, spinning disks. The bigger the disks, the less you pay for a terabyte, but bigger disks might be performance bottlenecks. If you have really large disks, then there should be fewer of them on an FC-AL loop
73, 146, 300 GB and 500 GB SATA 73, 146, 400 GB FC; 500 GB LC-FC, 1TB SATAII 73, 146,300,750 GB 73, 146 GB 73 GB 73, 146,300 GB
Disk speed The faster the better, especially for big disks
72/146/300 GB disks; all 15,000 rpm;
500GB disks, 7,500 rpm
72GB and 146 Gb disks;
15,000 or 10,000 rpm;
300 GB disks, 10,000 rpm
500 GB disks, 7,200 rpm
73GB 15,000 rpm. 146GB disks, 10,000 or 15,000 rpm; 750GB, 7,200 rpm 73Gb disks, 15,000 rpm; 146GB disks, 10,000or 15,000 rpm 15,000 rpm 73GB and 146GB disks, 10,000 or 15,000 rpm; 300GB, 7,200 rpm
remote copy Do you mirror data between two sites? If so you need this. There are basically two flavours of mirroring, SRDF from EMC, and PPRC from IBM. SRDF is arguably the better solution technically, but it locks you into EMC disks. PPRC is used by everyone. The remote mirroring section has more details.
Global Mirror, asynchronous
Metro Mirror (PPRC), synchronous
Synchronous(SRDF/S) and asynchronous(SRDF/A) data replication between subsystems.
SRDF/DM will migrate data between subsystems.
SRDF/AR works with TimeFinder to create remote data replicas.
SRDF products are all EMC to EMC
Hitachi true copy, PPRC compatible and synchronous;
Hitachi Universal Replicator, asynchronous copy.
Power PPRC, compressed data Storageworks Continuous Access, synchronous
Storageworks cluster extension for clustered servers
Hitachi True Copy for mainframe, synchronous
GDPS support for automated site failover See the GDPS pages for details
Yes Yes Yes Yes no info Yes
Instant copy 'Instant Copy' of volumes or datasets. Can be used for instant backups, or to create test data. Some implementations require a complete new disk, and so double the storage. Some implementations work on pointers, and just need a little more storage.
Flashcopy at volume and dataset level Timefinder at volume or dataset level. BCV version requires a complete volume be supplied, newer 'snap' version just uses pointers.
EMC Compatible Flash (FlashCopy)

Shadow Image at volume level

Copy on write snapshot

Snapshot copy at both volume and dataset level, uses pointers Storageworks Business Copy, full volume copy, looks similar to EMC Timefinder.
The FlashCopy version provides mainframe copies.
PAV and MA support Parallel Access Volume and Multiple Allegiance. See the implementation tips section for details. Used to permit multi-tasking to logical devices
Yes Yes (COMPAV) Yes Yes V2XF only Yes (Hitachi PAV)
LPAR Capable Can the storage subsystem be split logically, so it appears to be several separate systems, perhaps running different levels of microcode?
Yes (2 LPARS, 50/50 split only) No Yes (32 LPARS, Z/OS data in single LPAR only) No No Yes (32 LPARS, Z/OS data in single LPAR only)
Storage Virtualisation Server Can the storage subsystem act as a virtualisation engine in conjunction with a SAN? This enables lots of disparate storage to be controlled from one central point, including mirroring between different vendor's devices.
No No Yes No No Yes
Manufacturer IBM EMC HDS SUN HP
Device DS8300 DMX-4 USP1100
SUN SE9990
9980V V2X2/F XP12000

Price is usually very negotiable, but be sure to make sure that the vendor quotes for a complete solution with no hidden extras. Also, make sure that you get capped capacity upgrade prices, including increased software charges as software is usually charged by capacity tiers.

back to top


By entering and using this site, you accept the conditions and limitations of use

 

 

 

Advertising banner for Lasconet