[Reference Design 9]

2
910 kW, Tier 3, Chilled Water, 15400 ft

DESIGN OVERVIEW INTRODUCTION

The planning process of most projects can be iterative and thereby
Data Center IT Capacity
expensive. Data center projects are burdened with these challenges and can
910 kW
benefit greatly from simplification and time savings. Schneider Electric’s data
Adaptable from 200 kW to 2730 kW
center reference designs help customers optimize the planning process by
providing them with validated, proven, and documented data center physical
Target Availability
infrastructure designs. The use of these designs has a positive impact on not
Tier 3 just the project itself, but also on the performance, reliability, and efficiency of
the data center over its lifetime.
Annualized PUE at 100% Load
1.49 in Miami, FL USA
1.62 in Montreal, Canada Reference Design 9 includes design information for three spaces: IT space,
1.40 in St. Louis, MO USA facility power, and facility cooling. Combined together, they comprise the
integrated power, cooling and structural systems required to meet the
design’s specifications published in this overview document.
Total Racks and Average Density
140 racks at 6.5 kW/rack

IT & Facility Floor Space

2
15400 ft

Regional Voltage and Frequency

480V, 60Hz

ABOUT THIS DESIGN

 Water-cooled chiller with cooling

tower architecture

 Integrated row-based air

distribution

 Energy savings through water-

side economizer during favorable
outdoor conditions

 Highly redundant design for

increased availability and
concurrent maintenance

 Highly scalable and adaptable

 [Reference Design 9] 2

Facility Power
The facility power system supplies power to all of the critical and non-critical
components within the data center. The architecture used in this electrical
design is a dual path with 2N UPS and N+1 generators. Switching between
generator power and utility is achieved using a programmable logic controller
(PLC). A 3200 amp bus feeds PZ4 electrical and mechanical switchboards. In
the electrical room, UPSs are configured down-stream of the switchboards.
Two Symmetra MW units configured to 2N redundancy provide 1200 kW of
critical power to the IT room with 6 minutes of runtime. Valve regulated lead
acid (VRLA) batteries are housed in an isolated battery room. Two Galaxy 5000
UPS units configured to 2N redundancy provide 72 kW of power to the pumps in
DESIGN OPTIONS
the facility cooling system. Additional low-voltage transformers are included in
This reference design can be modified as
the design to support lighting and other building loads. The power distribution
follows without a significant effect on the architecture from the electrical room to the IT space utilizes a combination of LV
design’s performance attributes: panels and InfraStruxure power distribution units (PDUs). The facility power
system is designed to support additional peripheral devices like fire panels,
 Add StruxureWare Power Monitoring access control systems, and environmental monitoring and control devices.
Expert Power meters in the electrical path monitor power quality and allow for
 Provision for load bank predictive maintenance & diagnostics of the system. These meters also
 Change UPS batteries integrate with StruxureWare Power Monitoring Expert.
 Add/change standby generator options: Every component in this design is built and tested to the applicable ANSI,
 Location NEMA, UL or IEEE standards.
 Tank size Further design details and schematics are available in the engineering package.
 Fuel type

FACILITY POWER BLOCK DIAGRAM

FACILITY POWER ATTRIBUTES
G G

Utility
3200A, 480V, 65kA
Name Value Unit
Utility
AC AC
Total amps (main bus) 3200 A
3200A, 480V, 65kA 3200A, 480V, 65kA
Input voltage (main bus) 480 V
2000A, 480V, 65kA 2000A, 480V, 65kA
Switchboard kAIC 65 kA
72 kW 1200kW
Symmetra SSW
72 kW 1200kW
Symmetra SSW
Power path Dual
Galaxy Galaxy
5000 MW 1200kW 5000 MW 1200kW
400A, LOAD 400A, LOAD Generator redundancy N+1
480V, BANK 480V, BANK
65kA 2000A, 480V, 65kA 65kA 2000A, 480V, 65kA
IT space UPS capacity 1200 kW
IT space UPS redundancy 2N
© 2013 Schneider Electric. All rights reserved.
4x CHW Pumps
14x PDU Feeds
to IT Space
4x CHW Pumps 14x PDU Feeds
to IT Space
IT space UPS runtime @ rated load 6 minutes

1200A, 480V, 65kA 1200A, 480V, 65kA

IT space UPS output voltage 480 V
Facility cooling UPS capacity 72 kW
2x 4x Cond. Mech. Panel 2x 4x Cond. Mech. Panel
Cooling Chiller Water (CRAHs, Cooling Chiller Water (CRAHs, Facility cooling UPS redundancy 2N
Tower Pump AHUs) Tower Pump AHUs)

Facility cooling UPS runtime @ rated load 12 minutes

Schneider Electric www.schneider-electric.com

Document Number RD09DS Revision 1
[Reference Design 9] 3

Facility Cooling
The mechanical design utilizes chilled water as the primary medium for heat
dissipation. The architecture consists of dual chilled water loops. The cooling
system contains two 1196 kW water-cooled chillers in a 2N redundant
configuration. Water-side economization is achieved with a plate & frame heat
exchanger to save energy during favorable outdoor conditions.
In order to extend availability of chilled water during a power outage, redundant
7000 gallon water storage tanks provides 7 minutes of continuous cooling.
The piping architecture of the mechanical system feeds row-based InRow RC
CRAHs in the IT space. It also feeds room-based CRAHs in the electrical and
battery rooms. More information on the cooling configuration is provided in the
IT space section of this document.
DESIGN OPTIONS This design is instrumented to work with StruxureWare Cooling Monitoring
Expert.
This reference design can be modified as
Further design details such as dimensions, equipment placement, temperature
follows without a significant effect on the
set points, pipe sizing, flow rates, and pressure drops are available in the
design’s performance attributes:
engineering package.
 Add StruxureWare Cooling
Monitoring Expert

FACILITY COOLING ATTRIBUTES

FACILITY COOLING BLOCK DIAGRAM
Piping detail inside IT space
Name Value Unit
Total cooling capacity 1196 kW
Input voltage 480 V
InRow InRow InRow
RC RC RC
… 76 units 300mm...
CW supply 300
mm
300
mm
300
mm Heat rejection medium Chilled water
CW return
Mechanical redundancy 2N
Water-cooled chiller
Outdoor heat exchange
with cooling tower
CW supply
Coolant supply temperature 46 F
CW return
InRow InRow InRow
RC
300
RC
300
RC
300
Coolant return temperature 56 F
mm mm mm

Storage tank size 7000 gallons

Ride-through time 7 minutes
Tower Tower
Secondary loop
pumps
Economizer type Water-side
VFD
Thermal Storage

CW supply
© 2013 Schneider Electric. All rights reserved.
Primary loop pumps VFD to IT space
VFD System
VFD Dirt/air
Strainers bypass
separator

Chiller
VFD
VFD

Heat
Exchanger

Expansion
Tower Tower
tank Secondary loop
City Water
pumps
VFD
Thermal Storage

CW supply
Primary loop pumps VFD to IT space
VFD System
VFD Dirt/air
Strainers bypass
separator

Chiller
VFD
VFD

Heat
Exchanger

Schneider Electric www.schneider-electric.com

Document Number RD09DS Revision 1
 [Reference Design 9] 4

IT Space
The IT capacity of this design is 910 kW. The design is highly scalable and
adaptable; it can be configured to support IT loads within a range. Smaller
starting loads as low as 200 kW can be supported by making adjustments such
as reducing the number of IT pods or decreasing the quantity of UPS modules.
Likewise, this design can be used as a baseline for larger loads as high as 2730
kW by using a step and repeat approach to the design. This flexibility drives
efficiency and defers capital expenditure until needed.
The IT space design specifies all of the physical infrastructure systems, as well
as their physical arrangement/spacing, required to meet the overall design’s
performance attributes. This includes racks, PDUs, rack power distribution,
DESIGN OPTIONS cooling units, and airflow management systems.
This reference design can be modified as Each pair of rows (pod) within the IT space can be “stepped and repeated” in a
follows without a significant effect on the standardized and predictable manner. This enables right-sizing of power and
design’s performance attributes: cooling that scales with IT growth. Each pod supports an average power
density of 6.5 kW per rack. All the pods are outfitted with integrated power and
 Add environmental and security cooling distribution.
management Each pod is powered by floor mount factory-configured power distribution units
 Change rack options (tall, (PDUs). Every rack is configured with a metered rack-mount PDU to enable
wide, deep)
remote monitoring of the units for efficiency and capacity management.
 Change power distribution options
 Rack PDU type (basic, Each pod is cooled by N+1 redundant chilled water-based InRow RC CRAHs
switched) that control the supply of cool air by monitoring temperature variation at the rack
 Add StruxureWare Data Center level.
Expert
The security of the room is maintained at multiple points. At the rack level,
access is controlled by a door lock and sensor. At the room level, security
cameras are utilized for monitoring.

Row A Row B
P R C R C R R C R R C R R C R R C R R C R C R P
P/A-2/Z1 R/A-3/Z1 C/
A-4/
Z1
R/A-5/Z1 C/
A-6/
Z1
R/A-7/Z1 R/A-8/Z1 C/
A-9/
Z1
R/A-10/Z1 R/A-11/Z1 C/
A-
12/
Z1
R/A-13/Z1 R/B-1/Z2 C/
B-2/
Z2
R/B-3/Z2 R/B-4/Z2 C/
B-5/
Z2
R/B-6/Z2 R/B-7/Z2 C/
B-8/
Z2
R/B-9/Z2 C/
B-
10/
Z2
R/B-11/Z2 P/B-12/Z2

IT ROOM ATTRIBUTES
G
Gap

Row C Row D
R C R R C R R C R C R R C R C R R C R R C R
R/C-1/Z1 C/
C-2/
Z1
R/C-3/Z1 R/C-4/Z1 C/
C-5/
Z1
R/C-6/Z1 R/C-7/Z1 C/
C-8/
Z1
R/C-9/Z1 C/
C-
10/
Z1
R/C-11/Z1 P
P/C-12/Z1
P
P/D-1/Z2
R/D-2/Z2 C/
D-3/
Z2
R/D-4/Z2 C/
D-5/
Z2
R/D-6/Z2 R/D-7/Z2 C/
D-8/
Z2
R/D-9/Z2 R/D-10/Z2 C/
D-
11/
Z2
R/D-12/Z2

Name Value Unit

Row E
P R C R C R R C R R C R
Row F
R C R R C R R C R C R P
IT load 910 kW
P/E-2/Z4 R/E-3/Z4 C/ R/E-5/Z4 C/ R/E-7/Z4 R/E-8/Z4 C/ R/E-10/Z4 R/E-11/Z4 C/ R/E-13/Z4 R/F-1/Z3 C/F- R/F-3/Z3 R/F-4/Z3 C/F- R/F-6/Z3 R/F-7/Z3 C/F- R/F-9/Z3 C/F- R/F-11/Z3 P/F-12/Z3
E-4/ E-6/ E-9/ E- 2/ 5/ 8/ 10/
Z4 Z4 Z4 12/ Z3 Z3 Z3 Z3
Z4

Row G
G
Gap

Row H
Input voltage 480 V
R C R R C R R C R C R R C R C R R C R R C R
P P
Supply voltage to IT 120 / 208 V
R/G-1/Z4 C/ R/G-3/Z4 R/G-4/Z4 C/ R/G-6/Z4 R/G-7/Z4 C/ R/G-9/Z4 C/ R/G-11/Z4 R/H-2/Z3 C/ R/H-4/Z3 C/ R/H-6/Z3 R/H-7/Z3 C/ R/H-9/Z3 R/H-10/Z3 C/ R/H-12/Z3
G-2/ G-5/ G-8/ G- P/G-12/Z4 P/H-1/Z3 H-3/ H-5/ H-8/ H-
Z4 Z4 Z4 10/ Z3 Z3 Z3 11/
Z4 Z3

Row J
P
P/J-2/Z5
R
R/J-3/Z5
C
C/J-
R
R/J-5/Z5
C
C/J-
R
R/J-7/Z5
R
R/J-8/Z5
C
C/J-
R
R/J-10/Z5
R
R/J-11/Z5
C
C/J-
R
R/J-13/Z5
Row K
R
R/K-1/Z6
C
C/
R
R/K-3/Z6
R
R/K-4/Z6
C
C/
R
R/K-6/Z6
R
R/K-7/Z6
C
C/
R
R/K-9/Z6
C
C/
R
R/K-11/Z6
P
P/K-12/Z6
Average density 6.5 kW/rack
4/ 6/ 9/ 12/ K-2/ K-5/ K-8/ K-
Z5 Z5 Z5 Z5 Z6 Z6 Z6 10/
Z6

Row L
G
Gap

Row M
Number of racks 140 racks
R C R R C R R C R C R R C R C R R C R R C R
R/L-1/Z5 C/L- R/L-3/Z5 R/L-4/Z5 C/L- R/L-6/Z5 R/L-7/Z5 C/L- R/L-9/Z5 C/L- R/L-11/Z5 P P R/M-2/Z6 C/ R/M-4/Z6 C/ R/M-6/Z6 R/M-7/Z6 C/ R/M-9/Z6 R/M-10/Z6 C/ R/M-12/Z6
2
IT floor space 6700
2/ 5/ 8/ 10/ M- M- M- M-
P/L-12/Z5 P/M-1/Z6
© 2013 Schneider Electric. All rights reserved.
ft
Z5 Z5 Z5 Z5 3/ 5/ 8/ 11/
Z6 Z6 Z6 Z6

Row N Row P
P
P/N-2/Z9
R
R/N-3/Z9
C
C/
N-4/
R
R/N-5/Z9
C
C/
N-6/
R
R/N-7/Z9
R
R/N-8/Z9
C
C/
N-9/
R
R/N-10/Z9
R
R/N-11/Z9
C
C/
N-
R
R/N-13/Z9
R
R/P-1/Z10
C
C/
P-2/
R
R/P-3/Z10
R
R/P-4/Z10
C
C/
P-5/
R
R/P-6/Z10
R
R/P-7/Z10
C
C/
P-8/
R
R/P-9/Z10
C
C/
P-
R
R/P-11/
Z10
P
P/P-12/Z10
Single or dual cord Dual
Z9 Z9 Z9 12/ Z10 Z10 Z10 10/
Z9 Z10

Row Q
G
Gap

Row R Heat rejection medium Chilled water

R C R R C R R C R C R R C R C R R C R R C R
R/Q-1/Z9 C/ R/Q-3/Z9 R/Q-4/Z9 C/ R/Q-6/Z9 R/Q-7/Z9 C/ R/Q-9/Z9 C/ R/Q-11/Z9 P P R/R-2/Z10 C/ R/R-4/Z10 C/ R/R-6/Z10 R/R-7/Z10 C/ R/R-9/Z10 R/R-10/ C/ R/R-12/Z10
Q-2/ Q-5/ Q-8/ Q- P/Q-12/Z9 P/R-1/Z10 R-3/ R-5/ R-8/ Z10 R-
Z9 Z9 Z9 10/ Z10 Z10 Z10 11/

CRAC/CRAH type Row-based CRAH

Z9 Z10

Row S Row T
P
P/S-2/Z7
R
R/S-3/Z7
C
C/
S-4/
Z7
R
R/S-5/Z7
C
C/
S-6/
Z7
R
R/S-7/Z7
R
R/S-8/Z7
C
C/
S-9/
Z7
R
R/S-10/Z7
R
R/S-11/Z7
C
C/
S-
12/
Z7
R
R/S-13/Z7
R
R/T-1/Z8
R
R/T-2/Z8
C
C/T-
3/
Z8
R
R/T-4/Z8
R
R/T-5/Z8
R
R/T-6/Z8
R
R/T-7/Z8
C
C/T-
8/
Z8
R
R/T-9/Z8
P
P/T-10/Z8 CRAC/CRAH redundancy N+1
G
Gap

Row U
R
R/U-1/Z7
C
C/
R
R/U-3/Z7
R
R/U-4/Z7
C
C/
R
R/U-6/Z7
R
R/U-7/Z7
C
C/
R
R/U-9/Z7
C
C/
R
R/U-11/Z7 P
Row V

P
R
R/V-2/Z8
R
R/V-3/Z8
C
C/
R
R/V-5/Z8
R
R/V-6/Z8
R
R/V-7/Z8
C
C/
R
R/V-9/Z8
R
R/V-10/Z8
Containment type None
U-2/ U-5/ U-8/ U- P/U-12/Z7 P/V-1/Z8 V-4/ V-8/
Z7 Z7 Z7 10/ Z8 Z8
Z7

Schneider Electric www.schneider-electric.com

Document Number RD09DS Revision 1
[Reference Design 9] 5

Design Attributes
OVERVIEW Value Unit
Target availability Tier 3 Tier
Annualized PUE at 100% load 1.49 / 1.62 / 1.40
Data center IT capacity 910 kW
2
IT & facility floor space 15400 ft
Average density 6.5 kW/rack
FACILITY POWER Value Unit
Total amps (main bus) 3200 A
Input voltage (main bus) 480 V
Switchboard kAIC 65 kA
Power path Dual
Generator redundancy N+1
IT space UPS capacity 1200 kW
IT space UPS redundancy 2N
IT space UPS runtime @ rated load 6 minutes
IT space UPS output voltage 480 V
Facility cooling UPS capacity 72 kW
Facility cooling UPS redundancy 2N
Facility cooling UPS runtime @ rated load 12 minutes
FACILITY COOLING Value Unit
Total cooling capacity 1196 kW
Input voltage 480 V
Heat rejection medium Chilled water
Mechanical redundancy 2N
Outdoor heat exchange Water-cooled chiller with cooling tower
Coolant supply temperature 46 F
Coolant return temperature 56 F
Storage tank size 7000 gallons
Ride-through time 7 minutes
Economizer type Water-side

IT SPACE Value Unit

IT load 910 kW
Input voltage 480 V
Supply voltage to IT 120 / 208 V © 2013 Schneider Electric. All rights reserved.

Average density 6.5 kW/rack

Number of racks 140 Racks
2
IT floor space 6700 ft
Single or dual cord Dual
Heat rejection medium Chilled water
CRAC/CRAH type Row-based CRAH
CRAC/CRAH redundancy N+1
Containment type None

Schneider Electric www.schneider-electric.com

Document Number RD09DS Revision 1
[Reference Design 9] 6

Data center infrastructure management (DCIM)

Good design and quality construction alone do not ensure a highly available &
efficient data center. Data centers require on-going monitoring and management to
ensure the facility lives up to its design intent. StruxureWare for Data Centers is a
software management suite designed to collect and manage data about a data
center’s assets, resource use, and operational status throughout the life cycle of the
facility. This information is then distributed, integrated, and applied in ways that help
managers optimize the data center’s performance and meet IT, business, and
service-oriented goals. From IT assets to racks, rows, rooms and buildings,
StruxureWare for Data Centers delivers the right information to the right users at the
right time.

Control level: Experts, on site or remotely, can control process performance and
ensure business continuity in real time, while tracking energy consumption in a highly
critical and secure environment.

Operations level: Functional managers can optimize operations, energy, and assets
through smart analytical tools, often spanning multiple sites.

Enterprise level: C-level executives can drive their sustainability strategy efficiently,
choosing the best scenario that meets their business objective to conserve
enterprise-wide resources.

StruxureWare for Data Centers allows for flexibility when requirements and
implementation strategies change over time. StruxureWare software applications
and suites simplify integration time, improve reliability, enhance visibility to energy
information, and streamline operational efficiency.

>
© 2013 Schneider Electric. All rights reserved.

Demo:
Visit www.apc.com/software to learn more about StruxureWare for Data Centers!

Schneider Electric www.schneider-electric.com

Document Number RD09DS Revision 1
[Reference Design 9] 7

Get more information for this design:

Engineering Package

Every reference design is built with technical documentation

for engineers and project managers. This includes
engineering schematics (CAD, PDF), floor layouts,
equipment lists containing all the components used in the
design and 3D images showing real world illustrations of our
Floor layouts
reference designs.
3D spatial views
Documentation is available in multiple formats to suit the
needs of both engineers and managers working on data
center projects.

Bill of materials

One-line schematics

> Click here to register to receive the Engineering Package for this design, or email
ReferenceDesigns@Schneider-Electric.com.

Schneider Electric Life-Cycle Services

Team of over 7,000 trained specialists covering
every phase and system in the data center

© 2013 Schneider Electric. All rights reserved.

Standardized, documented, and validated

methodology leveraging automation tools and
repeatable processes developed over 45 years

Complete portfolio of services to solve your

technical or business challenge, simplify your
life, and reduce costs

Schneider Electric www.schneider-electric.com

Document Number RD09DS Revision 1