Enabling Technologies for High-Performance Computing

INTRODUCTION

STUDY BACKGROUND

GOALS AND OBJECTIVES

INTENDED AUDIENCE

SCOPE OF REPORT

METHODOLOGY AND INFORMATION SOURCES

ANALYST CREDENTIALS

RELATED BCC RESEARCH

BCC ONLINE SERVICES

DISCLAIMER

EXECUTIVE SUMMARY

SUMMARY TABLE GLOBAL MARKET PROJECTIONS FOR KEY HPC

TECHNOLOGIES, THROUGH 2012 ($ MILLIONS)

SUMMARY FIGURE PROJECTED TRENDS IN KEY HPC HARDWARE

GLOBAL MARKET SHARES, 2006 AND 2012 (% OF TOTAL

HARDWARE SALES)

OVERVIEW

DEFINITIONS

SCOPE OF HIGH-PERFORMANCE COMPUTING

Measuring HPC Performance

LINPACK

NAS Parallel Benchmarks

HPC Challenge Benchmarks

SUPERCOMPUTERS: A SUBSET OF HPC

HPC VS HIGH-PERFORMANCE TECHNICAL COMPUTING

HPC VS HIGH THROUGHPUT COMPUTING

TABLE 1 HPC VS. HTC

HISTORY OF HPC

TABLE 2 MAJOR HPC MILESTONES

TABLE 2 (CONTINUED)

HPC ARCHITECTURES

VECTOR PROCESSING

PARALLEL PROCESSING

Symmetric Multiprocessing

Massively Parallel Processing

Clustering

Beowulf Clusters

Constellations

SPECIALLY DESIGNED SYSTEMS

HIGH-PERFORMANCE COMPUTING APPLICATIONS

MARKET FOR HIGH-PERFORMANCE COMPUTERS

MARKET SIZE AND GROWTH TRENDS

TABLE 3 GLOBAL MARKET PROJECTION FOR HPC SYSTEMS AND SOFTWARE, THROUGH 2012 ($ MILLIONS)

FIGURE 1 PROJECTED TRENDS IN THE GLOBAL HPC SYSTEMS AND SOFTWARE MARKET, 2006-2012 ($ MILLIONS)

MARKET SEGMENTATION

Architecture Segments

TABLE 4 GLOBAL HPC HARDWARE SALES PROJECTIONS BY TYPE OF ARCHITECTURE, THROUGH 2012* ($ MILLIONS)

FIGURE 2 GLOBAL MARKET PROJECTIONS FOR HPC ARCHITECTURE BY SEGMENT, 2006-2012 (% OF TOTAL HPC EXPENDITURES)

Operating System Segments

FIGURE 3 TOP 500 SUPERCOMPUTERS BY OPERATING SYSTEMS (% OF TOP 500 SUPERCOMPUTERS)

FIGURE 3 (CONTINUED)

End-User Segments

FIGURE 4 HPC END-USER SEGMENTS, 2006 (% OF TOTAL EXPENDITURES)

FIGURE 4 (CONTINUED)

Vendors

FIGURE 5 HPC VENDOR MARKET SEGMENTS, 2006 (% OF TOTAL EXPENDITURES)

FIGURE 5 (CONTINUED)

Geography

FIGURE 6 HPC GEOGRAPHICAL MARKET SEGMENTS, 2006 (% OF TOP 500 SUPERCOMPUTER SITES)

FIGURE 6 (CONTINUED)

ENABLING TECHNOLOGIES FOR HPC

KEY ENABLING TECHNOLOGIES

High-performance Microprocessors

Memory

Storage

Interconnects

Thermal Management

Software

MARKET FOR KEY HPC ENABLING TECHNOLOGIES

TABLE 5 GLOBAL MARKET PROJECTIONS FOR KEY HPC ENABLING TECHNOLOGIES, THROUGH 2012 ($ MILLIONS)

FIGURE 7 GLOBAL MARKET TREND PROJECTIONS FOR KEY HPC ENABLING TECHNOLOGIES, 2006-2012 ($ MILLIONS)

HPC Hardware

TABLE 6 GLOBAL MARKET PROJECTIONS FOR KEY HPC ENABLING HARDWARE TECHNOLOGIES, THROUGH 2012 ($ MILLIONS)

FIGURE 8 GLOBAL MARKET SHARE PROJECTIONS FOR KEY HPC ENABLING HARDWARE TECHNOLOGIES, 2006-2012 (% OF TOTAL HPC ENABLING HARDWARE MARKET)

HPC PROCESSOR TECHNOLOGIES

INTRODUCTION

HPC PROCESSOR PERFORMANCE

EQUIREMENTS/PARAMETERS

FLOATING POINT PERFORMANCE

MEMORY PERFORMANCE

SCALABILITY

POWER CONSUMPTION

CURRENT/FUTURE TECHNOLOGIES

VECTOR PROCESSORS

Cray X1E Multi-Streaming Processor

NEC-SX-8

RISC PROCESSORS

PA-RISC

DEC Alpha

MIPS

SPARC

POWER Processors

COMMERCIAL OFF-THE-SHELF PROCESSORS

AMD

Opteron

INTEL

Itanium

Xeon

NEW TECHNOLOGIES

Cell

FGPAs

FGPAs (Continued)

Processing in Memory

Heterogeneous Processing

Co-Processors

GPU Co-Processors

CPU and GPU on the Same Chip

GPU Co-Processor and CPU Chip Directly

Connected

GPU Co-Processor Bus-Connected with CPU

Cell Processor as Co-Processor

Other Types of HPC Co-Processors

SUPPLIERS

TABLE 7 HPC PROCESSOR AND COPROCESSOR SUPPLIERS

FIGURE 9 HPC PROCESSOR GLOBAL MARKET SHARES, 2006 (%)

PATENT ANALYSIS

FIGURE 10 U.S. HPC PROCESSOR PATENTS BY TYPE OF TECHNOLOGY (% OF PATENTS ISSUED THROUGH JULY 15, 2007)

FIGURE 11 U.S. HPC PROCESSOR PATENTS BY ASSIGNEE (% OF PATENTS ISSUED THROUGH JULY 15, 2007)

MARKET

TABLE 8 GLOBAL HPC PROCESSOR MARKET PROJECTIONS, THROUGH 2012 ($ MILLIONS)

FIGURE 12 HPC PROCESSOR MARKET SEGMENTATION, 2006 (%)

FIGURE 13 GLOBAL HPC PROCESSOR MARKET SHARE PROJECTIONS, 2006-2012 (% OF TOTAL HPC PROCESSOR SALES)

HPC MEMORY TECHNOLOGIES

INTRODUCTION

HPC MEMORY PERFORMANCE REQUIREMENTS/PARAMETERS

LATENCY

BANDWIDTH

POWER CONSUMPTION

HEAT OUTPUT

CURRENT/FUTURE TECHNOLOGIES

HPC MEMORY ARCHITECTURES

Shared Memory

Distributed Shared Memory

TYPES OF RANDOM ACCESS MEMORY USED IN HPC

SDRAM

RDRAM

DDR-SDRAM

Future Developments in RAM Technology with Potential

HPC Applications

Magnetoresistive Random Access Memory

Nanoscale Random Access Memory

SUPPLIERS

TABLE 9 DRAM SUPPLIERS

PATENT ANALYSIS

FIGURE 14 U.S. PATENTS RELATING TO SELECTED RAM TECHNOLOGIES (% OF PATENTS ISSUED SINCE 1975)

FIGURE 15 U.S. RAM PATENT HOLDERS (% OF TOTAL)

MARKET

TABLE 10 GLOBAL HPC RAM MARKET PROJECTIONS, THROUGH 2012 ($ MILLIONS)

HPC INTERCONNECT TECHNOLOGIES

INTRODUCTION

HPC INTERCONNECT PERFORMANCE PARAMETERS

BANDWIDTH AND LATENCY

SCALABILITY

RELIABILITY

PRICE/PERFORMANCE

CURRENT AND FUTURE TECHNOLOGIES

SHARED BUS ARCHITECTURES

Ethernet

SWITCHED FABRIC ARCHITECTURES

Fibre Channel

Myrinet

QsNet

InfiniBand

Other Interconnect Technologies

SUPPLIERS

TABLE 11 INTERCONNECT SUPPLIERS

PATENT ANALYSIS

FIGURE 16 U.S. PATENTS RELATING TO HPC INTERCONNECT TECHNOLOGIES (% OF PATENTS ISSUED SINCE 1975)

FIGURE 17 U.S. HPC INTERCONNECT PATENT HOLDERS (% OF ALL U.S. RAM PATENTS)

MARKETS

FIGURE 18 HPC INTERCONNECT MARKET SEGMENTS, 2006 (% OF TOTAL INTERCONNECT SALES)

TABLE 12 GLOBAL HPC INTERCONNECT SALES PROJECTIONS, THROUGH 2012 ($ MILLIONS)

FIGURE 19 GLOBAL HPC INTERCONNECT SALES TRENDS PROJECTIONS, 2006-2012 ($ MILLIONS)

STORAGE TECHNOLOGIES

INTRODUCTION

HPC STORAGE REQUIREMENTS/PERFORMANCE PARAMETERS

TRANSPARENT DATA ACCESS

COLLABORATIVE DATA ACCESS

SEAMLESS INTEGRATION

RESILIENCY AND AVAILABILITY

CENTRALIZED MANAGEMENT

QUALITY OF SERVICE

INTEGRATED DATA SERVICES

TECHNOLOGIES

STORAGE ARCHITECTURES

Local Storage

Network Storage

STORAGE INFRASTRUCTURE

Controllers, Switches, and Other Interface Devices

NAS Devices

Fibre Channel Devices

ISCSI Hardware

Storage Media

Raid Drives

RAID Implementations

Controllers and Interfaces

Developments in Storage Technologies

Storage Disks

FIGURE 20 INCREASE IN HARD DISK DRIVE AREAL DENSITY OVER TIME

Perpendicular Recording

Holographic Storage

Read-Write Heads

Read-Write Head Technology Trends

SUPPLIERS

TABLE 13 SUPPLIERS OF DATA STORAGE INFRASTRUCTURE AND MEDIA FOR HPC

TABLE 13 (CONTINUED)

PATENT ANALYSIS

FIGURE 21 HPC STORAGE-RELATED PATENTS BY TYPE OF ARCHITECTURE (% OF ALL HPC STORAGE-RELATED PATENTS ISSUED THROUGH JULY 1, 2007)

FIGURE 21 (CONTINUED)

FIGURE 22 HPC STORAGE-RELATED PATENTS BY ASSIGNEE (% OF ALL HPC STORAGE-RELATED PATENTS ISSUED THROUGH JULY 1, 2007)

FIGURE 22 (CONTINUED)

MARKET

FIGURE 23 HPC STORAGE MARKET PRODUCT SEGMENTS, 2006 (% OF TOTAL SALES)

TABLE 14 GLOBAL HPC STORAGE MARKET PROJECTIONS, THROUGH 2012 ($ MILLIONS)

FIGURE 24 TRENDS IN HPC STORAGE GLOBAL MARKET, 2006-2012 ($ MILLIONS)

TABLE 15 GLOBAL HPC HARD DISK DRIVE MARKET PROJECTIONS BY TYPE OF TECHNOLOGY, THROUGH 2012 ($ MILLIONS)

FIGURE 25 GLOBAL HPC HARD DISK DRIVE TECHNOLOGY MARKET PROJECTIONS BY SEGMENT, 2006-2012 ($ MILLIONS)

THERMAL MANAGEMENT

INTRODUCTION

FIGURE 26 MAJOR CAUSES OF ELECTRONIC FAILURE (% OF OCCURRENCES)

THERMAL MANAGEMENT PERFORMANCE REQUIREMENTS/

PARAMETERS

THERMAL TOLERANCES

THERMAL PERFORMANCE

HOT SPOTS

RELIABILITY

NOISE LEVELS

CURRENT/FUTURE TECHNOLOGIES

LIQUID COOLING

Closed vs. Open Loop Airflow Systems

Water-Chilled Doors

SprayCool

Non-Water Liquid Cooling Systems

Chip-Based Cooling Systems

Other Liquid Cooling Technologies

Heat Pipes

Cold Plates

FORCED AIR COOLING

HEAT SINKS

THERMOELECTRIC COOLERS

SUPPLIERS

TABLE 16 SUPPLIERS OF THERMAL MANAGEMENT SOLUTIONS FOR HPC

PATENT ANALYSIS

FIGURE 27 U.S. THERMAL MANAGEMENT PATENTS WITH HPC APPLICATIONS BY TYPE OF TECHNOLOGY (% OF HPC THERMAL MANAGEMENT PATENTS ISSUED THROUGH 7/1/2007)

FIGURE 28 U.S. THERMAL MANAGEMENT PATENTS WITH HPC APPLICATIONS BY ASSIGNEE (% OF HPC THERMAL MANAGEMENT PATENTS ISSUED THROUGH 7/1/2007)

MARKETS

FIGURE 29 HPC COOLING HARDWARE MARKET SHARES BY TYPE OF TECHNOLOGY, 2006 (% OF TOTAL HPC THERMAL MANAGEMENT HARDWARE SALES)

TABLE 17 GLOBAL HPC COOLING HARDWARE MARKET PROJECTIONS, THROUGH 2012 ($ MILLIONS)

FIGURE 30 GLOBAL HPC COOLING HARDWARE MARKET SHARE PROJECTIONS, 2006-2012 (% OF TOTAL HPC COOLING HARDWARE SALES)

HPC SOFTWARE

INTRODUCTION

HPC SOFTWARE PERFORMANCE

REQUIREMENTS/PARAMETERS

SCALABILITY

PORTABILITY

RELIABILITY

SOFTWARE DEVELOPMENT PRODUCTIVITY

CURRENT/FUTURE TECHNOLOGIES

PARALLEL APPLICATIONS

FIGURE 31 NUMBER OF PROCESSORS USED BY TYPICAL HPC APPLICATONS FOR SINGLE JOBS

PARALLEL PROGRAMMING

Open MP

Message Passing Interface

Hybrid OpenMP-MPI

DEBUGGING

HPC Software Debuggers

Memory Debuggers

DEVELOPERS/VENDORS

TABLE 18 HPC SOFTWARE DEVELOPERS AND VENDORS

PATENTS

FIGURE 32 U.S. PARALLEL SOFTWARE AND PARALLEL SOFTWARE DEVELOPMENT PATENTS BY TYPE OF TECHNOLOGY (% OF TOTAL PATENTS ISSUED THROUGH 7/1/2007)

FIGURE 33 U.S. PARALLEL SOFTWARE AND PARALLEL SOFTWARE DEVELOPMENT PATENTS BY ASSIGNEE (% OF ALL PATENTS ISSUED THROUGH 7/1/2007)

MARKETS

FIGURE 34 HPC SOFTWARE SOURCES (% OF HPC APPLICATIONS DEVELOPED)

TABLE 19 GLOBAL COMMERCIAL HPC SOFTWARE SALE PROJECTIONS, THROUGH 2012 ($ MILLIONS)

FIGURE 35 PROJECTED TRENDS IN GLOBAL COMMERCIAL HPC SOFTWARE SALES, 2006-2012 ($ MILLIONS)

MARKETS (CONTINUED)

COMPANY PROFILES

ABSOFT CORP.

ACUSIM SOFTWARE, INC.

ADVANCED MICRO DEVICES

AGEIA

ALLINEA SOFTWARE

ALTAIR ENGINEERING, INC

ALTERA CORP.

BROCADE COMMUNICATIONS SYSTEMS, INC.

BULL RUE JEAN JAURES

CELOXICA, LTD.

CLEARSPEED TECHNOLOGY, INC

COLOSSAL STORAGE CORP.

COMPUTATIONAL ENGINEERING INT’L

CRAY, INC.

CROSSWALK, INC

DATA DIRECT NETWORKS, INC.

DOT HILL SYSTEMS CORP.

DRC COMPUTER CORP

ELPIDA MEMORY, INC.

EVERGRID, INC

EXANET, LTD.

EMC CORP

FREESCALE SEMICONDUCTOR, INC.

FUJITSU, LTD

HEWLETT PACKARD CO

HITACHI DATA SYSTEMS CORP

HITACHI GLOBAL STORAGE TECHNOLOGIES

INTERNATIONAL BUSINESS MACHINES CORP.

INTEL CORP.

ISILON SYSTEMS, INC

KNÜRR AG

LIEBERT CORP

MAPLESOFT

THE MATHWORKS

MELLANOX TECHNOLOGIES, LTD

MERCURY COMPUTER SYSTEMS, INC.

MIPS TECHNOLOGIES, INC

MITRIONICS AB

MYRICOM, INC

NANTERO, INC

NEC CORP.

NETWORK APPLIANCE, INC.

NVIDIA CORP.

PANASAS, INC

PEAKSTREAM, INC.

THE PORTLAND GROUP, INC.

QLOGIC CORP.

QUADRICS, LTD

RAMBUS, INC.

RITTAL GMBH & CO. KG

SAMSUNG ELECTRONICS CO., LTD.

SCALI, INC.

SEAGATE TECHNOLOGY, LLC

SILICON GRAPHICS, INC.

SPRAYCOOL, INC

SUN MICROSYSTEMS, INC.

THERMACORE

TOSHIBA CORP.

TOTALVIEW TECHNOLOGIES

VOLTAIRE, INC.

XILINX, INC.

XIRANET GMBH

XTREMEDATA, INC.

XYRATEX TECHNOLOGY, LTD

LIST OF TABLES

SUMMARY TABLE GLOBAL MARKET PROJECTIONS FOR KEY HPC

TECHNOLOGIES, THROUGH 2012 ($ MILLIONS)

TABLE 1 HPC VS. HTC

TABLE 2 MAJOR HPC MILESTONES

TABLE 3 GLOBAL MARKET PROJECTION FOR HPC SYSTEMS AND

SOFTWARE, THROUGH 2012 ($ MILLIONS)

TABLE 4 GLOBAL HPC HARDWARE SALES PROJECTIONS BY TYPE

OF ARCHITECTURE, THROUGH 2012* ($ MILLIONS)

TABLE 5 GLOBAL MARKET PROJECTIONS FOR KEY HPC ENABLING

TECHNOLOGIES, THROUGH 2012 ($ MILLIONS)

TABLE 6 GLOBAL MARKET PROJECTIONS FOR KEY HPC ENABLING

HARDWARE TECHNOLOGIES, THROUGH 2012 ($ MILLIONS)

TABLE 7 HPC PROCESSOR AND COPROCESSOR SUPPLIERS

TABLE 8 GLOBAL HPC PROCESSOR MARKET

PROJECTIONS, THROUGH 2012 ($ MILLIONS)

TABLE 9 DRAM SUPPLIERS

TABLE 10 GLOBAL HPC RAM MARKET PROJECTIONS, THROUGH

2012 ($ MILLIONS)

TABLE 11 INTERCONNECT SUPPLIERS

TABLE 12 GLOBAL HPC INTERCONNECT SALES PROJECTIONS,

THROUGH 2012 ($ MILLIONS)

TABLE 13 SUPPLIERS OF DATA STORAGE INFRASTRUCTURE AND

MEDIA FOR HPC

TABLE 14 GLOBAL HPC STORAGE MARKET PROJECTIONS,

THROUGH 2012 ($ MILLIONS)

TABLE 15 GLOBAL HPC HARD DISK DRIVE MARKET PROJECTIONS

BY TYPE OF TECHNOLOGY, THROUGH 2012 ($ MILLIONS)

TABLE 16 SUPPLIERS OF THERMAL MANAGEMENT SOLUTIONS FOR

HPC

TABLE 17 GLOBAL HPC COOLING HARDWARE MARKET

PROJECTIONS, THROUGH 2012 ($ MILLIONS)

TABLE 18 HPC SOFTWARE DEVELOPERS AND VENDORS

TABLE 19 GLOBAL COMMERCIAL HPC SOFTWARE SALE

PROJECTIONS, THROUGH 2012 ($ MILLIONS)

LIST OF FIGURES

SUMMARY FIGURE PROJECTED TRENDS IN KEY HPC HARDWARE

GLOBAL MARKET SHARES, 2006 AND 2012 (% OF TOTAL

HARDWARE SALES)

FIGURE 1 PROJECTED TRENDS IN THE GLOBAL HPC SYSTEMS AND

SOFTWARE MARKET, 2006-2012 ($ MILLIONS)

FIGURE 2 GLOBAL MARKET PROJECTIONS FOR HPC

ARCHITECTURE BY SEGMENT, 2006-2012 (% OF TOTAL HPC

EXPENDITURES)

FIGURE 3 TOP 500 SUPERCOMPUTERS BY OPERATING SYSTEMS (%

OF TOP 500 SUPERCOMPUTERS)

FIGURE 4 HPC END-USER SEGMENTS, 2006 (% OF TOTAL

EXPENDITURES)

FIGURE 5 HPC VENDOR MARKET SEGMENTS, 2006 (% OF TOTAL

EXPENDITURES)

FIGURE 6 HPC GEOGRAPHICAL MARKET SEGMENTS, 2006 (% OF TOP

500 SUPERCOMPUTER SITES)

FIGURE 6 (CONTINUED)

FIGURE 7 GLOBAL MARKET TREND PROJECTIONS FOR KEY HPC

ENABLING TECHNOLOGIES, 2006-2012 ($ MILLIONS)

FIGURE 8 GLOBAL MARKET SHARE PROJECTIONS FOR KEY HPC

ENABLING HARDWARE TECHNOLOGIES, 2006-2012 (% OF TOTAL

HPC ENABLING HARDWARE MARKET)

FIGURE 9 HPC PROCESSOR GLOBAL MARKET SHARES, 2006 (%)

FIGURE 10 U.S. HPC PROCESSOR PATENTS BY TYPE OF

TECHNOLOGY (% OF PATENTS ISSUED THROUGH JULY 15, 2007)

FIGURE 11 U.S. HPC PROCESSOR PATENTS BY ASSIGNEE (% OF

PATENTS ISSUED THROUGH JULY 15, 2007)

FIGURE 12 HPC PROCESSOR MARKET SEGMENTATION, 2006 (%)

FIGURE 13 GLOBAL HPC PROCESSOR MARKET SHARE

PROJECTIONS, 2006-2012 (% OF TOTAL HPC PROCESSOR SALES)

FIGURE 14 U.S. PATENTS RELATING TO SELECTED RAM

TECHNOLOGIES (% OF PATENTS ISSUED SINCE 1975)

FIGURE 15 U.S. RAM PATENT HOLDERS (% OF TOTAL)

FIGURE 16 U.S. PATENTS RELATING TO HPC INTERCONNECT

TECHNOLOGIES (% OF PATENTS ISSUED SINCE 1975)

FIGURE 17 U.S. HPC INTERCONNECT PATENT HOLDERS (% OF ALL

U.S. RAM PATENTS)

FIGURE 18 HPC INTERCONNECT MARKET SEGMENTS, 2006 (% OF

TOTAL INTERCONNECT SALES)

FIGURE 19 GLOBAL HPC INTERCONNECT SALES TRENDS

PROJECTIONS, 2006-2012 ($ MILLIONS)

FIGURE 20 INCREASE IN HARD DISK DRIVE AREAL DENSITY OVER

TIME

FIGURE 21 HPC STORAGE-RELATED PATENTS BY TYPE OF

ARCHITECTURE (% OF ALL HPC STORAGE-RELATED PATENTS

ISSUED THROUGH JULY 1, 2007)

FIGURE 22 HPC STORAGE-RELATED PATENTS BY ASSIGNEE (% OF

ALL HPC STORAGE-RELATED PATENTS ISSUED THROUGH JULY 1,

2007)

FIGURE 23 HPC STORAGE MARKET PRODUCT SEGMENTS, 2006 (%

OF TOTAL SALES)

FIGURE 24 TRENDS IN HPC STORAGE GLOBAL MARKET, 2006-2012 ($ MILLIONS)

FIGURE 25 GLOBAL HPC HARD DISK DRIVE TECHNOLOGY MARKET

PROJECTIONS BY SEGMENT, 2006-2012 ($ MILLIONS)

FIGURE 26 MAJOR CAUSES OF ELECTRONIC FAILURE (% OF

OCCURRENCES)

FIGURE 27 U.S. THERMAL MANAGEMENT PATENTS WITH HPC

APPLICATIONS BY TYPE OF TECHNOLOGY (% OF HPC THERMAL

MANAGEMENT PATENTS ISSUED THROUGH 7/1/2007)

FIGURE 28 U.S. THERMAL MANAGEMENT PATENTS WITH HPC

APPLICATIONS BY ASSIGNEE (% OF HPC THERMAL

MANAGEMENT PATENTS ISSUED THROUGH 7/1/2007)

FIGURE 29 HPC COOLING HARDWARE MARKET SHARES BY TYPE OF

TECHNOLOGY, 2006 (% OF TOTAL HPC THERMAL MANAGEMENT

HARDWARE SALES)

FIGURE 30 GLOBAL HPC COOLING HARDWARE MARKET SHARE

PROJECTIONS, 2006-2012 (% OF TOTAL HPC COOLING HARDWARE

SALES)

FIGURE 31 NUMBER OF PROCESSORS USED BY TYPICAL HPC

APPLICATONS FOR SINGLE JOBS

FIGURE 32 U.S. PARALLEL SOFTWARE AND PARALLEL SOFTWARE

DEVELOPMENT PATENTS BY TYPE OF TECHNOLOGY (% OF

TOTAL PATENTS ISSUED THROUGH 7/1/2007)

FIGURE 33 U.S. PARALLEL SOFTWARE AND PARALLEL SOFTWARE

DEVELOPMENT PATENTS BY ASSIGNEE (% OF ALL PATENTS

ISSUED THROUGH 7/1/2007)

FIGURE 34 HPC SOFTWARE SOURCES (% OF HPC APPLICATIONS

DEVELOPED)

FIGURE 35 PROJECTED TRENDS IN GLOBAL COMMERCIAL HPC

SOFTWARE SALES, 2006-2012 ($ MILLIONS)