Design Guide  ·  Issued for Design  ·  Rev 3  ·  2026-08-14

Small Server Room Design

A complete design set for rooms of twenty racks or fewer — siting, layout geometry, heat and power arithmetic, grounding, suppression, cabling and commissioning. Every number here is one you can compute, check and defend to an inspector. Written for the ten-rack room that most people are actually building.

Author
Silvernail
Scope
≤ 20 racks
Typical case
10 racks · 360 ft²
Density band
2 – 8 kW / rack
Drawing sheets
15 editable
Units
US customary + SI
G-000

Start Here

General · Welcome

Welcome. If you have a small IT space to design, build, or fix — a room, a closet, a corner of the electrical room — this guide is for you. A server room isn't a miniature data center: at ten racks the economics, the failure modes, and the right answers all change. That's what this set is about.

What you'll walk away with

Read through, and you'll be able to:

  • Compute the room's heat load and pick cooling that actually matches it — including the one derate that catches almost everyone out.
  • Lay a room out to a dimensional grid that resolves cooling, service access and future growth in one decision.
  • Size a UPS and a generator that carry each other through an outage — including the room's cooling, which is easy to leave off by accident.
  • Ground and bond the room to one clean standard, without the "isolated ground" myths.
  • Choose a fire suppression system that won't destroy the equipment it protects — and won't blow the walls out on discharge.
  • Test the failure before you need it, so standby power is real and not a theory.
  • Wire, label, monitor and manage the room so it outlasts your involvement with it.

How this guide is organized

The thirty-two sheets are grouped by discipline. Read straight through for a full design; jump around by sheet ID (top-left of each) when you have a specific question. Every sheet is self-contained — it has its own hook, its own worked numbers, and links to whatever it depends on. Unfamiliar term? X-995 is the glossary.

G-xxx
General

This welcome, the standards you'll answer to, and the tier / availability question.

A-xxx · S-2xx
Space & structure

Siting, layout geometry, racks, floor loading and seismic.

M-3xx
Thermal

Heat load, cooling equipment, airflow, humidity.

E-xxx
Electrical

Load, UPS, generator, distribution, grounding, lighting.

FP-xxx
Fire & security

Detection, clean agent, sprinklers, physical security.

T-xxx
Telecom

Cabling, conduit, labeling, documentation.

M-7xx · Cx-8xx
Operations

Monitoring, out-of-band management, commissioning.

X-xxx
Appendices

Two worked examples, design checklists, formulas, glossary.

If you're at 3–5 racks and under 10 kW

You can defer or skip: G-020 (tiering), A-105 (narrow rooms), M-330 (humidity — just keep dew point below 15 °C), E-420 (a rackmount UPS may be enough; skip the generator if downtime is acceptable), FP-510 (a lockable rack in a locked room is proportional), X-910 (20-rack example). Read G-000 through M-320, then jump to X-950 and Cx-800.

What to bring before you start

  • A rough IT load figure — measured if the equipment exists, or a vendor power calculator if it doesn't. Nameplate is not this number.
  • A floor plan or a tape measure — you need to know where columns, doors and beams land.
  • A ceiling height to the lowest obstruction, not to the deck.
  • A conversation with the person who signs off electrical work in your building. In many places that's the licensed electrician; sometimes it's the building's engineer of record.
  • An idea of what downtime costs you. That number decides whether the answer is a generator or a good runbook.

The cheat sheet — ten decisions that most determine the outcome

Skim these. Each links to the sheet that explains it in full. If a term is unfamiliar, read the sheet first and come back.

1

Measure the actual IT load; don't design to the nameplate on the box

Servers rarely draw more than 40–60 % of what their power supply is stamped for. Design to that stamped number and you'll oversize the UPS, the cooling and the generator, and each of those will run unhappy. Measure it, or use the vendor's power calculator. See M-300 and E-400.

2

Design to the aisle-pitch module, even if you never install a raised floor

A cold aisle, a rack, a hot aisle and a rack back-to-back come out to about 14 ft on seven 24-in tiles. It's the dimensional grid that resolves cooling, service access and future growth at once. Rows perpendicular to the cooling discharge. See A-101.

3

Blank every empty rack slot, and seal every hole in the rack base

The cheapest fixes on the guide with the highest payoff. Every open rack slot lets hot exhaust roll back around to the intake above it; every unsealed cable hole leaks the cold air you paid for. Fix these before spending a dollar on containment. See M-320.

4

Comfort air conditioning is smaller than the label says — derate it

A regular office AC unit spends about a third of its capacity dehumidifying — which a server room doesn't need. That means a "10-ton" unit gives you around 7 tons of actual cooling here. Then buy several small units rather than one big one, so failure or service of any one doesn't take you out. See M-310.

5

The cooling has to be on the generator — not just the servers

A UPS keeps the servers running through an outage, but the room heats up in minutes without cooling. If cooling isn't on standby power, you get to watch the temperature climb past the shutdown threshold while the UPS runs happily. Cooling and runtime are one decision, not two. See E-420.

6

Size the UPS on watts, not on the model number

UPS units are commonly sold by kVA (apparent power), but the load draws watts (real power). A "10 kVA" UPS might only carry 8 kW. Check the kW rating on the datasheet — and specify a maintenance bypass, the switch that lets you swap the UPS without an outage. See E-410.

7

Two power paths, kept genuinely separate all the way to the equipment

Every rack gets an A and a B power feed, from different panels, in different raceways, with different-colored cords. Each side runs at less than half its capacity so if one side fails, the other side can carry everything. Cross-tie them together and you've built one path with a spare cable. See E-430.

8

One bonded ground system — never a "separate" one for the server room

Every rack gets its own ground wire run back to a common busbar in the room. Never drive a separate ground rod for the room; two grounds at different potentials mean fault current travels through your equipment on the way between them. Powder-coated rack rails don't count as a bond either — you have to break through the paint. See E-440.

9

Clean-agent suppression needs a pressure relief vent — and never dry-chem in this room

Discharging a fire suppression gas into a sealed room raises the pressure fast enough to blow walls out. The vent that prevents this is the item most often missed in small rooms. And never a dry-chemical extinguisher in a server room — the powder residue destroys more equipment than most fires would. See FP-500.

10

Test the failure before production arrives — pull the plug at full load

Open the utility main with the room fully loaded and prove that UPS, generator, ATS, cooling restart and alarms all do their job together. This is the one test that proves the whole chain, and there's no substitute for it. Do it before the room carries anything important. See Cx-800.

Three principles behind everything above

Principle A
Modularity beats headroom

You can't buy 1.2 of a cooling unit. Redundancy in a small room means doubling — so buy that redundancy as several small units in parallel, not as one big oversized machine that runs unhappy most of the time.

Principle B
Alerts leave the room

The alerting path must not depend on the room being alive. Cellular gateway, external monitoring, or an off-site collector — the difference between "the room went down and paged us" and "the room went down".

Principle C
Documentation lives outside

Runbooks, single-lines, U-maps and contact lists somewhere you can reach from a phone. Documentation that lives only on a server in the room it documents isn't documentation.

What comes next

The next few sheets set up context: G-001 is the scope and the drawing register, G-010 maps the codes and standards you'll answer to, G-020 takes on the "what tier is this" question. If you're eager to get to the design content, skim those and jump to A-100 — siting is where the design decisions start.

G-001

Scope & How To Use This Set

General

This set is written for a room with twenty racks or fewer, and it assumes the ten-rack case as the default. That's not just a size constraint — at this scale the right design answers are genuinely different from those you'll find in most published data-center guidance.

What makes small rooms different

Most published data-center references are written for facilities of hundreds or thousands of racks, where fixed costs amortize into nothing and every subsystem has a dedicated engineer. In a room of ten racks a few things reshape the problem:

  • Fixed overheads are a large share of the bill. Lighting, a UPS running lightly loaded, a cooling unit cycling against a small load — they add up to a much bigger fraction of the total than they would at scale. Small rooms typically run a PUE of 1.8–2.5, where a hyperscale campus runs about 1.15.
  • Redundancy comes in whole units. You can't buy 1.2 of a cooling unit or 1.4 of a UPS. Adding N+1 in a small room usually means doubling, which is why buying several small units in parallel tends to beat one big one.
  • One person often does every trade. There's rarely a mechanical engineer checking the electrical engineer's work. Most small-room problems live at the seams between disciplines — cooling that isn't on the generator, a suppression system that fights the HVAC, a bonding scheme that skipped one rack.
  • You're almost always retrofitting. The room was designed as an office, a supply closet or a corner of a plant space. Floor loading, ceiling height, exterior walls, plumbing overhead — all inherited constraints you'll be working around.

What this set covers

Sheets 1–4
Standards

Executive summary, scope, the standards landscape, availability tiers.

Sheets 5–9
Space

Siting, the aisle-pitch module, narrow rooms, racks, structure.

Sheets 10–13
Thermal

Heat load arithmetic, equipment selection, airflow, humidity.

Sheets 14–19
Electrical

Load, UPS, generator, distribution, grounding, lighting.

Sheets 20–24
Life safety

Detection, clean agent, security, cabling, conduit and pathways.

Sheets 25–32
Delivery

Monitoring, out-of-band management, commissioning, worked examples, checklists, glossary.

The editable drawings

Fifteen Excalidraw sheets accompany this set. They are fully editable vector source, not exported images — open them at excalidraw.com and drag anything. Where a sheet has been exported to PNG it appears inline below the section that references it; the rest show a placeholder until they are exported.

Drawing register
SheetTitleShows
A-101Room layout — 10 racks 20′×18′ plan, 14′ aisle pitch, NEC working space, egress, keynotes
A-102Room layout — 20 racks 32′×20′ plan, in-row cooling, hot-aisle containment, A/B electrical
A-103Narrow room — single row, 10 racks 28′×11′ plan, chimney vs. wall-plenum sections, overhead busway
T-201Rack elevation 42U front and rear build standard, reach zone, zero-U PDUs
A-111Rack mounting hardware EIA-310 hole geometry to scale, cage nut installation right and wrong, the four threads with typical torque, load capacity ratings, bonding at the screw
M-201Airflow section Correct vs. the four classic faults, raised-floor variant
E-301Power single-line Utility → ATS → UPS → PDU → rack, EPO, maintenance bypass
E-302Grounding riser Electrode system → TMGB → TBB → TGB → rack bonding, busbar detail
T-401Cable pathways Tiered separation, ladder rack, fill and bend-radius values
T-402Cabling topology & conduit Carrier → entrance facility → MDA → rack, computed conduit fill, sleeve through a rated wall, bend budget, OSP entrance
T-605Conduit sleeve & bend budget Sleeve through a fire-rated wall in section — firestop, grounding bushing, spare conduit, drip loop — and the NEC ceiling against TIA-569 practice
M-302Cooling plant & condensate Split DX through the wall to a roof condenser, line-set limits, oil traps, condensate with secondary pan and float, outdoor siting and recirculation
E-431Circuit schedule & connectors Phase-balanced panel schedule for DP-A, balance under failover, one branch circuit end to end, connector capacities
E-450Lighting & egress illumination Reflected ceiling plan with the fixture rows on the aisle centerlines, why an over-the-rack fixture leaves the face in shadow, illuminance targets in both planes, and the EPO boundary egress lighting must sit outside
FP-501Fire protection & life safety Agent and nozzle layout, cross-zoned detection, enclosure integrity, pressure relief venting, cause-and-effect matrix

Every sheet uses the same color system, so a color means the same thing on all fifteen:

Cold
Supply air

Cold aisles, intake faces, supply ducts, perforated tiles, CRAH discharge.

Hot
Return air

Hot aisles, exhaust faces, return paths — and warnings and keep-clear zones.

Power
Electrical

UPS, panels, PDUs, generator, ATS, branch circuits, the A-side path.

Ground
Bonding

TMGB, TGB, bonding conductors, electrode system — and access control.

Telecom
Cabling

Patch fields, ladder rack, tray, fiber and copper pathways. Dashed = overhead.

Neutral
Structure

Racks, walls, slab, and blanking panels.

How to read the numbers

Verify locally

Every dimension, rating and concentration in this set is a design starting point drawn from the referenced standards. Codes are adopted, amended and enforced locally. The authority having jurisdiction (AHJ), your electrical engineer of record and your insurer all outrank this document. Where this set and an adopted code differ, the code wins — and you should assume they will differ somewhere.

Standard editions

References are to the editions current as of this revision: NEC 2023 (NFPA 70), NFPA 75 (2024), NFPA 2001, ANSI/TIA-942-C (2024), ANSI/TIA-607-D, ANSI/TIA-606-D, ASHRAE TC 9.9 Thermal Guidelines 5th edition (2021), BICSI 002. Check the edition your AHJ has adopted — it is frequently one or two cycles behind current.

G-010

The Standards Landscape

General · Compliance

Roughly twenty documents touch a server room. Three of them can get you red-tagged; the rest are advisory unless someone put them in a contract. Knowing which is which is the difference between a design review and an argument.

Feel free to skim this sheet on a first read

You don't need to memorize the compliance landscape to keep going — the design sheets that follow cite the specific requirement wherever it applies. Come back to this sheet when you need to answer "which document says so?", when you're preparing for a plan review, or when someone on the team confuses a guideline with a code.

Code, standard, guideline — the distinction that matters

Tier 1 — Code
Mandatory

Adopted into law by your jurisdiction. Non-compliance means no occupancy permit. NEC, IBC, IFC, IMC, and whatever your state amended into them.

Tier 2 — Referenced
Conditional

Mandatory because a code points at it, or because your insurer or contract requires it. NFPA 75, NFPA 2001, NFPA 72, NFPA 855.

Tier 3 — Guideline
Advisory

Best practice. Not enforceable unless specified. TIA-942, BICSI 002, ASHRAE TC 9.9, Uptime Tier. Enormously useful; legally optional.

The trap

People treat TIA-942 as if it were code and NFPA 75 as if it were advice. It's the reverse of what most people assume. TIA-942 is a voluntary telecom infrastructure standard; NFPA 75 is referenced by the International Fire Code and will be enforced. Sort this out before your first plan review, not during it.

Who governs what

Governing document by subsystem
SubsystemPrimaryAlso appliesClass
Branch circuits, feeders, working spaceNFPA 70 (NEC) Art. 110.26, 210, 215, 408Code
IT room wiring & the EPO questionNEC Art. 645 Optional article — see belowCode
Grounding electrode systemNEC Art. 250 ANSI/TIA-607-D for telecom bondingCode
Standby / emergency powerNEC Art. 700/701/702 NFPA 110 where legally requiredCode
Room construction, fire separationNFPA 75 IBC/IFC, local amendmentsReferenced
Clean-agent suppressionNFPA 2001 NFPA 75, IFCReferenced
Detection & alarmNFPA 72NFPA 75 Referenced
Lithium battery energy storageNFPA 855 UL 9540A test data; NFPA 75 (2024) defers to 855Referenced
Portable extinguishersNFPA 10— Referenced
Floor loading, seismic anchorage, egressIBC / ASCE 7 TIA-942 gives loading targetsCode
Temperature & humidity envelopeASHRAE TC 9.9 Equipment manufacturer's spec overridesGuideline
Mechanical energy efficiencyASHRAE 90.1 or 90.4 Which one depends on scope — confirmCode (adopted)
Structured cablingANSI/TIA-568 series TIA-942 for DC topologyGuideline
Pathways & spacesANSI/TIA-569BICSI 002 Guideline
Labeling & recordsANSI/TIA-606-D— Guideline
Overall facility ratingTIA-942-C Rated 1–4 Uptime Tier I–IV (topology only)Guideline
Walkthrough — the documents that drive numbers

NFPA 70 — National Electrical Code

Article 110.26 — working space

The most-violated rule in small server rooms, because racks are the natural thing to put in the space the code reserves. Working space is measured from the face of the equipment outward and must be clear, floor to a height of 6½ ft (or the equipment height, whichever is greater), for the full width of the equipment or 30 in, whichever is greater.

NEC Table 110.26(A)(1) — minimum depth of working space
Nominal voltage to groundCond. 1Cond. 2 Cond. 3
0 – 150 V  (includes 208Y/120) 3 ft3 ft3 ft
151 – 600 V  (includes 480Y/277) 3 ft3 ft 6 in4 ft

Condition 1: no live or grounded parts opposite. Condition 2: grounded parts opposite. Condition 3: live parts on both sides. A concrete or block wall counts as grounded — so a panel facing a masonry wall at 480 V needs 3½ ft, not 3 ft.

  • 110.26(C)(2) — equipment rated 800 A or more and over 6 ft wide requires two entrances to the working space.
  • 110.26(C)(3) — personnel doors within 25 ft of that working space must swing out and carry listed panic hardware.
  • 110.26(E) — dedicated equipment space: the footprint of the panel extended from the floor to 6 ft above the equipment, or to the structural ceiling. No piping, ducts or anything foreign to the electrical installation. This is where a cable tray routed over a panel becomes a violation.

Article 645 — information technology equipment room

Article 645 is optional and elective. It is a set of relaxations — chiefly permission to use flexible cord and non-plenum wiring methods under a raised floor — that you buy by accepting the conditions in 645.4, the headline one being an emergency power off (EPO) at the principal exit that kills all IT power and all dedicated HVAC and closes fire/smoke dampers.

Design decision

If you do not need 645's wiring relaxations, do not invoke 645. Wire the room to Chapter 3 like any other room and you are not obliged to install an EPO. Many small rooms install an EPO reflexively and then suffer the far more common failure mode: somebody leans on it. Accidental EPO activation causes more small-room outages than fire ever has. If you do install one, use a lift-cover or dual-action station and place it where a shoulder cannot reach it.

NFPA 75 — Fire Protection of Information Technology Equipment

Governs the room as a fire problem. What it drives in a small room:

  • Construction and separation. Where the IT room is required to be a separate fire area, it is built of fire-resistive construction — commonly a 1-hour rating minimum, walls slab to slab, with rated penetrations fire-stopped to their listed system.
  • No foreign services. Water, drain, steam and other piping not serving the room should not pass through or above it. Where unavoidable: drip pans, leak detection, and a written acceptance of the risk.
  • Detection. Automatic detection throughout, including below a raised floor and above a suspended ceiling where those are used as plenums.
  • Combustible loading. Limits on packaging, media and storage in the room. Boxes stacked in the corner cross from untidy into a code violation faster than most operators realize.
  • 2024 edition changes. Lithium-ion battery requirements were removed and handed to NFPA 855; requirements for off-gas detection were added; immersion-cooling provisions were introduced; a new Annex F was added from NFPA 76 optional tests.

NFPA 76 is the parallel document for telecommunications service provider facilities — central offices, transmission and switching sites. If you are an enterprise with a server room, NFPA 75 is yours and NFPA 76 is not.

NFPA 2001 — Clean Agent Fire Extinguishing Systems

Drives the suppression arithmetic. The values you will be asked about:

  • Discharge time. Halocarbon agents (FM-200/HFC-227ea, Novec 1230/ FK-5-1-12) must reach 95 % of design concentration within 10 seconds. Inert gases (IG-541, IG-55, IG-100) get 60 seconds, because they produce no decomposition products.
  • Hold time. The enclosure must retain agent above the minimum effective concentration for 10 minutes for Class A hazards (5 minutes for Class B), verified by an enclosure integrity — "door fan" — test per the standard's annex.
  • Pressure relief venting. Sized from agent, discharge rate and the enclosure's structural pressure rating. See FP-500; this is the single most-omitted item in small rooms.

ASHRAE TC 9.9 — Thermal Guidelines

Not a code, but the reference every equipment vendor and mechanical engineer works from. The 5th edition (2021) defines classes A1–A4 by allowable envelope and adds class H1 for high-density and liquid-cooled equipment. Full envelope in M-330. The one number to memorize: the recommended envelope is 64.4–80.6 °F (18–27 °C) at the equipment air intake.

ANSI/TIA-942-C — Telecommunications Infrastructure Standard for Data Centers

Published May 2024. Broader than its name: it covers telecom, architectural, electrical, mechanical and fire protection, and it defines the Rated 1–4 classification (renamed from "Tier" precisely to stop the confusion with Uptime). Relevant provisions:

  • Minimum 3 ft (1 m) front clearance for equipment installation; 4 ft (1.2 m) preferred for deeper equipment.
  • Minimum 2 ft (0.6 m) rear service clearance; 3 ft (1 m) preferred.
  • The C revision sets an 800 mm minimum rack width in distribution areas — rooms still standardized on 600 mm (24 in) racks in the MDA/HDA are now out of step with the current revision.
  • Floor loading targets and a full Rated 1–4 matrix across all disciplines.

ANSI/TIA-607-D — Bonding and Grounding

Defines the telecom bonding system: TMGB, TBB, TGB, and the conductors between them. Busbars are copper, minimum 6 mm × 50 mm (¼ in × 2 in) in section. The TBB is continuous copper, #6 AWG minimum, sized by run length up to 3/0 AWG, and not spliced. Sizing table and detail in E-440.

BICSI 002 — Data Center Design and Implementation Best Practices

The most practical document on this list and the least legally binding. Where TIA-942 tells you what to achieve, BICSI 002 tells you how, with far more design detail on pathways, commissioning and operations. If you buy one reference beyond this guide, buy this one.

Where the documents conflict

1

Adopted code beats everything

If the NEC as amended by your jurisdiction says 3½ ft and a standard says 3 ft, it is 3½ ft. There is no argument to be had.

2

The equipment manufacturer beats the guideline

If a switch is rated to 95 °F intake and ASHRAE A2 allows 104 °F, your ceiling is 95 °F. Warranty follows the nameplate, not the guideline.

3

The listing beats the drawing

A fire-stop, a suppression nozzle or a busbar lug performs as tested in its listed assembly. Substituting a component voids the listing even if the substitute looks identical.

4

The insurer may beat all of the above

FM Global and similar carriers publish their own data sheets and will simply decline to cover a non-conforming room. Ask early — an insurer requirement discovered after construction is expensive.

5

Document every deviation

Where you knowingly depart from a guideline, write down what, why, and who accepted it. A one-page deviation log is what turns "we ignored TIA-942" into "we made an engineering decision".

Compliance matrix

Map each requirement to the design decision that satisfies it. This is the table to hand to a plan reviewer.

Requirement → design decision → evidence
RequirementSourceDesign decisionEvidence at turnover
Working space at panelsNEC 110.26 36 in clear, hatched on plan, no racks in zoneDimensioned as-built plan
Dedicated equipment spaceNEC 110.26(E) No tray or piping routed over panelsCoordination drawing / photos
Grounding electrode bondingNEC 250 All electrodes bonded; single systemGround resistance + continuity test report
Telecom bondingTIA-607-D TGB in room; #6 AWG home run per rackContinuity < 1 Ω to TGB, logged
Fire separationNFPA 75 / IBC 1-hr rated walls slab to slabRated assembly detail + fire-stop schedule
Detection coverageNFPA 72 / 75 ASD plus spot detectors, incl. plenumsSensitivity test + as-built device map
Agent concentration & holdNFPA 2001 Agent selected, room volume calculatedHydraulic calc + door fan test report
Pressure relief ventingNFPA 2001 Vent sized to enclosure pressure ratingVent sizing calculation
Battery installationNFPA 855 Chemistry, spacing, ventilation, detectionUL 9540A data + AHJ approval
Thermal envelopeASHRAE TC 9.9 18–27 °C at intake; sensors at intakeTrend data over 30 days
Floor loadingIBC / TIA-942 Loading verified for rack point loadsStructural engineer's letter
Seismic anchorageIBC / ASCE 7 Racks anchored per local SDCAnchorage detail + special inspection
LabelingTIA-606-D Scheme defined before installLabel schedule + as-built records
G-020

Availability Tiers

General · Resilience

You asked about Tier 1 through Tier 5. Here is the honest answer: there are four, they describe topology rather than uptime, and "Tier 5" is a trademark rather than a standard.

Uptime Institute — Tier I to Tier IV

The Uptime Institute Tier Standard classifies the topology of the power and cooling distribution. It says nothing about security, cabling, fire protection or location. It is expressed in Roman numerals, and only Uptime can certify against it.

Uptime Institute Tier classification — availability column is legacy 1990s figures, not a service-level guarantee
TierNameTopologyCited availability* Maintenance behavior
IBasic CapacityN — single path, no redundancy 99.671 %Must shut down for any planned work
IIRedundant CapacityN+1 components, single path 99.741 %Some work still requires shutdown
IIIConcurrently Maintainable N+1, dual paths (one active)99.982 % Any component removable with no IT impact
IVFault Tolerant 2N or 2(N+1), both paths active, compartmentalized99.995 % Survives any single failure with no IT impact
About those percentages

The availability figures come from Uptime's original 1990s papers and are widely reproduced, but Uptime has long since de-emphasized them. Tier is a topology classification, not a service-level guarantee. A Tier IV facility run badly will beat its own numbers in the wrong direction, and roughly two-thirds of real outages trace to human and process failure rather than to topology. Do not put a Tier availability percentage into a contract as if it were a promise.

The "Tier 5" question

There is no Tier V. The Uptime Institute does not certify at that level and never has.

"Tier 5" is a proprietary designation created by Switch, a Las Vegas colocation provider, marketed as "Tier 5 Platinum" and administered through a foundation Switch itself established — reportedly with the help of authors of the original Uptime criteria. It layers additional criteria on top of Tier IV: multiple carriers and power utilities, renewable supply, coolant line placement, enhanced physical and network security.

Those criteria are not unreasonable. But the designation is a vendor marketing claim, not an independently verified standard, and it appears in Arabic numerals ("Tier 5") rather than the Roman numerals Uptime uses — a tell worth knowing. Several vendor blogs now list "Tier 1–5" as if it were one continuum. It is not.

If someone specifies "Tier 5"

Ask which document defines it and who audits against it. If the answer is a vendor's own foundation, translate the requirement into what they actually want — usually "Tier IV topology plus diverse carriers plus renewable power" — and specify those, which are all verifiable.

TIA-942-C Rated 1 to Rated 4 — the parallel system

TIA-942 defines its own four-level classification, called Rated 1–4 (deliberately renamed from "Tier" in earlier revisions). It is broader than Uptime's: it rates telecommunications, architectural/structural, electrical and mechanical separately, and a facility gets the lowest of its four scores. Third parties can certify against it, which Uptime does not permit for its own standard.

Uptime Tier
Power + cooling

Topology only. Certified by Uptime alone. Roman numerals I–IV.

TIA-942 Rated
All four disciplines

Telecom, architectural, electrical, mechanical. Third-party certifiable. Arabic 1–4.

EN 50600 / ISO 22237
European

Availability Classes 1–4, plus granularity and protection classes. Same idea, different vocabulary.

What a room of twenty racks can actually achieve

Realistic tier targets for a small room
TargetWhat it takesRelative costVerdict
Tier I One UPS, one cooling unit, one path. Maintenance = outage. 1.0×Fine for a lab or non-production room
Tier II N+1 cooling, UPS with maintenance bypass, generator. Still one distribution path. ≈ 1.2–1.4×The sensible floor for production
Tier III Dual UPS, A/B distribution end to end, N+1 cooling, dual-corded IT, rack ATS for single-corded gear, concurrent maintainability proven by test. ≈ 1.7–2.0×Achievable and usually the right target
Tier IV 2N everything, both paths active, continuous cooling through a utility failure, and physical compartmentalization of the A and B infrastructure into separate fire and mechanical zones. ≈ 2.5–3.5× Rarely justified — compartmentalization is near-impossible in 640 ft²

Cost multipliers are order-of-magnitude planning figures relative to a Tier I build of the same capacity, not quotes. Note also that small rooms carry a poor cost per kW regardless of tier — fixed overheads do not amortize across ten racks.

Two principles worth more than a certificate

1

The room is only as resilient as its weakest subsystem

A 2N power system feeding a room with one cooling unit is a Tier I room. So is one with a single fiber entrance, or one where both UPS units share a single output panel, or one where the generator has never been load-bank tested. Tier is the minimum across every subsystem — including the ones nobody rated.

2

Build Tier III behaviors; skip the certificate

Uptime certification is a six-figure exercise in design review, construction audit and (for operations) ongoing assessment. It is worth it if you sell colocation and customers demand it. For an internal room it is not. Build concurrent maintainability — which is the genuinely valuable property, because it means you can do maintenance at all — and spend the certification money on monitoring and a tested runbook.

Recommendation for ≤ 20 racks

Target concurrent maintainability (Tier III behavior) on cooling and on the UPS, and accept a single utility service. Concretely: two cooling units either of which carries the load; a UPS with wrap-around maintenance bypass, or two UPS units; A/B rack PDUs from separate panels; a generator; and dual-corded IT wherever the budget reaches. That combination removes every planned outage and most unplanned ones, at well under half the cost of chasing Tier IV.

A-100

Siting & Room Shell

Architectural

Almost every constraint in the rest of this set is inherited from where you put the room. Siting is the one decision you cannot value-engineer later.

Where not to put it

Location risk assessment
LocationWhy it hurtsIf you have no choice
Below-grade basementFlooding, sewer backup, no gravity drainage Raise equipment on plinths, sump with alarm, leak rope at the low point
Top floor / under the roofRoof leaks, solar gain, HVAC on the deck above Full drip-pan ceiling, roof-mounted leak detection, extra envelope load in calc
Below or beside wet areasRestrooms, kitchens, mechanical rooms — pipe failure lands on youWaterproof membrane, drip pans, relocate the drains
Exterior wall with glazingSolar gain, security exposure, thermal cycling Infill the opening; if not, insulated opaque panel and security film
Adjacent to a transformer or elevator machine room EMI, vibration, heatIncrease separation; shielded pathways; measure before committing
Beside a loading dock or garageDust, vehicle impact, contaminants Positive room pressure, better filtration, bollards
On an exterior corner of the buildingTwo exterior walls of gain, storm exposureInsulate to a higher standard, verify envelope load
The ideal

An interior room, on a slab or a structurally verified floor, on a middle story, with no exterior walls, no plumbing above or adjacent, close to the electrical room, and with a straight equipment path from the freight lift to the door.

Shell construction

Walls

  • Slab to slab, not to the suspended ceiling. A wall stopping at the ceiling grid is a security hole and a smoke path.
  • Fire-resistive construction to the rating required by NFPA 75 and your building code — commonly 1 hour minimum where the room is a separate fire area.
  • Every penetration fire-stopped to its listed assembly, and re-sealed after every move, add and change.
  • Vapor barrier on the warm side, plus sealed penetrations. Without it you cannot hold a humidity setpoint and you will fight condensation.

Ceiling

  • 8 ft 6 in clear under all obstructions is the practical floor; 9–10 ft is comfortable. TIA-942 targets around 10 ft clear.
  • Measure to the lowest obstruction — sprinkler, duct, beam — not to the deck.
  • Allow 12 in clear above the rack for pathway, plus room to lift equipment in.
  • If the plenum above returns air, everything in it must be plenum-rated.

Floor finish

  • Static-dissipative surface — sealed concrete with a dissipative coating, or static-dissipative VCT. Target surface resistance in the 10⁶–10⁹ Ω band: conductive enough to bleed charge, resistive enough to be safe.
  • Never carpet. Never untreated bare concrete — it sheds dust indefinitely.
  • Seal the slab before anything is installed. Retrofitting a floor coating around twenty live racks is not possible.

Doors

  • 36 in clear minimum; 42–48 in or a leaf-and-a-half is much better. Measure clear width with the door open, past the hardware.
  • Out-swinging for egress; hinges on the secure side or non-removable pins.
  • No threshold to trip a rack dolly. No door closer that fights a two-person lift.
  • Walk the entire equipment path — lift dimensions, corridor turns, door heights — with a tape before ordering racks. A crated 42U rack is 7–8 ft tall.
No foreign services

NFPA 75 is explicit that piping not serving the room should not pass through or above it. In a retrofit you will usually find a sanitary line or a chilled-water main already there. Options, in order of preference: reroute it; build a drained drip pan the full length of it; or accept the risk in writing with leak detection directly beneath. What you do not want to do is design around it as if it wasn't there.

A-101

Space Planning & the Aisle-Pitch Module

Architectural · Layout

Small-room layout is not freehand. There is a dimensional module — seven floor tiles, fourteen feet — that resolves cooling, service access and future flexibility at once. Design to the module even if you never install a raised floor.

The seven-tile module

The module comes from the 24-inch access-floor tile and has been the layout unit for front-to-back-cooled equipment for decades. Aisle pitch is the distance from the centerline of one cold aisle to the centerline of the next:

Seven-tile aisle pitch module Plan slice showing a half cold aisle of two feet, a 42-inch rack, a three-foot hot aisle, a second 42-inch rack and a half cold aisle of two feet, totalling fourteen feet of aisle pitch across seven 24-inch floor tiles. 7 TILES @ 24" = 14'-0" AISLE PITCH 123 456 7 ROW A 42" RACK ROW B 42" RACK COLD HOT COLD 2'-0"3'-6" 3'-0"3'-6" 2'-0" ½ COLDRACK HOT AISLERACK ½ COLD 14'-0" PITCH · COLD AISLE ℄ TO COLD AISLE ℄
FIG A-101.1 — The seven-tile module. A full cold aisle is 4 ft (two tiles); the module is drawn from centerline to centerline, so each end shows half of one. cold aisle  hot aisle. See sheet A-101 for the full plan.
Aisle pitch

Pitch = cold aisle + rack depth + hot aisle + rack depth

       = 4'-0" + 3'-6" + 3'-0" + 3'-6" = 14'-0"  (7 × 24" tiles)

4'-0"
cold aisle — two full tiles; the working minimum
3'-6"
rack depth — 42 in, the common deep-rack dimension
3'-0"
hot aisle — service access only, no supply air
When to use an eight-tile pitch

Go to 16 ft (8 tiles) when racks are deeper than 42 in, when you are containing the hot aisle and need a rear door to swing plus a body inside it, or when rack density exceeds roughly 8 kW. The 20-rack plan in this set uses an intermediate 15 ft pitch — a 4 ft hot aisle — for exactly that reason.

Clearances — the numbers and where they come from

Minimum clearances
ClearanceMinimumPreferred Source / reason
Cold aisle (rack front)3 ft4 ft TIA-942-C installation clearance; 4 ft = 2 tiles and fits deep equipment
Hot aisle (rack rear)2 ft3 ft TIA-942-C service clearance; 3 ft to actually work on rear cabling
Front of rack, equipment slide-out3 ft4 ft Rail travel plus a person; 4 ft for long chassis
Beside a fully extended server3 ft— Two people handling a rail-mounted chassis
End of row3 ft4 ft Side-panel removal, turning a rack dolly
In front of electrical panels3 ft4 ft NEC 110.26 — code, not preference
Above rack to lowest obstruction12 in18 in Pathway plus lifting clearance
Rack side to side00 Bay them together — front-to-back airflow needs no side gap, and a gap leaks air

Area per rack

Rack footprint
7 ft²

24 in × 42 in. The rack itself.

With aisles
20 ft²

Five tiles per rack — the classic large-facility planning figure.

Small room, realistic
28–36 ft²

What ten racks actually costs once you add electrical, egress and end-of-row.

Below this, stop
25 ft²

Under ~25 ft² per rack a small room stops being serviceable.

The two reference plans in this set: 10 racks in 360 ft² (36 ft²/rack) and 20 racks in 640 ft² (32 ft²/rack). Small rooms carry a worse ratio than large ones because the electrical zone and the egress route are fixed costs spread across fewer racks.

Row orientation and growth

  • Run rows perpendicular to the cooling discharge so supply enters the cold aisle end-on and travels its length.
  • Keep the module even where you install fewer racks than the row holds. Fill the gaps with blanking racks or containment end panels — not with air.
  • Plan growth as contiguous positions at the end of a row, not scattered gaps. A gap in the middle of a row breaks containment and cannot take a wide chassis later.
  • Do not gap a row for a mid-row walkway. It short-circuits hot and cold air. Walk around the end.
▤ A-101 · 10-rack plan ▤ A-102 · 20-rack plan ▤ M-201 · airflow section
A-101Room layout — 10 racks
Drawing sheet A-101 — Room layout — 10 racks
A-101 — The reference room. 20′×18′, two rows of five, 14′-0″ aisle pitch from the seven-tile module, with the NEC 110.26 working space hatched and kept clear. Editable source: diagrams/a-101…excalidraw
A-102Room layout — 20 racks
Drawing sheet A-102 — Room layout — 20 racks
A-102 — Twice the racks in under twice the area. In-row cooling, hot-aisle containment and a genuinely separated A/B electrical zone. Editable source: diagrams/a-102…excalidraw
A-105

Single-Row & Narrow Rooms

Architectural · Mechanical

Plenty of small rooms are long and thin — a converted corridor, a strip off a plant room, a leftover bay. Ten racks go in one row against a wall. This changes more than the floor plan.

The premise to get right

A single row is not a two-row plan with one row deleted. Deleting the opposing row deletes the hot aisle — and the hot aisle was the separation strategy. Everything in M-320 assumed exhaust had somewhere to go that intakes could not reach. Remove that and the room simply mixes: exhaust rolls off the back of the row, around the ends and over the top, and comes straight back to the front.

So you must replace the hot aisle deliberately. There are three ways.

Capturing exhaust without an opposing row

1

Chimney (ducted) racks — usually the best answer

A vertical duct from the top rear of each rack into a ceiling return plenum. Exhaust is captured positively and never enters the room, so the whole room becomes the cold reservoir.

Best in the narrowest rooms because it needs no rear plenum at all — the row can sit roughly 2 ft off the wall for cabling access alone, making the room about 2 ft shallower than the alternative. Requires a ceiling return plenum, and everything in that plenum must then be plenum-rated.

2

Sealed wall hot plenum

Hold the row about 3 ft off the rear wall, then seal that strip at both ends and cap it at the top. The strip becomes a contained hot aisle with a wall for its far side, and return is taken from it high.

Cheaper and simpler than chimneys, and it preserves genuine walk-in rear access — but it costs a foot of room depth and depends on the seal actually being maintained after the first person props the end panel open.

3

Rear-door heat exchangers

Neutralize the exhaust at the rack itself; air leaves the rear door at roughly room temperature, so there is no hot air to manage anywhere. Elegant, and it makes the airflow problem disappear.

The trade is that you have brought water or refrigerant to every rack, and the doors add several inches of depth plus a swing. Justifiable at higher density; usually over-engineered for a 2 kW rack.

▤ A-103 · narrow-room plan with both sections drawn
A-103Narrow room — single row of 10
Drawing sheet A-103 — Narrow room — single row of 10
A-103 — A single row is not a two-row plan with a row deleted — losing the opposing row deletes the hot aisle. Chimney and wall-plenum strategies both drawn. Editable source: diagrams/a-103…excalidraw

Room depth

Minimum room depth for a single row of 42-in racks
StrategyFrontRack RearTotal depth
Absolute minimum (TIA-942 minimums, cramped)3'-0" 3'-6"2'-0"8'-6"
Chimney racks4'-6" 3'-6"2'-0"10'-0"
Sealed wall plenum4'-6" 3'-6"3'-0"11'-0"
Rear-door heat exchanger4'-6" 4'-6"2'-6"11'-6"

The reference plan A-103 uses 11'-0" × 28'-0" = 308 ft², or 31 ft² per rack — slightly better than the 36 ft² of the two-row plan, because a single row spends nothing on a second cold aisle.

The four things that bite

Wrap-around at the open ends

A single row has two exposed ends and no opposing row to block them. Exhaust wraps round and re-enters the end racks first — so R01 and R10 run hottest, which is not where anyone looks. Fit end-of-row seal panels at both ends; they are cheap and they are not optional here.

Rear access is the binding constraint

This is what actually determines whether the room works. Either hold 3 ft behind the row, or specify racks on casters with service loops in power and data so they roll forward for rear work. Decide before ordering racks — retrofitting slack into terminated cabling is not a thing.

One row is one thermal failure domain

In a two-row plan a cooling fault degrades gradually and there is a second row of thermal mass. Here all ten racks share one exhaust path and one supply throw. Hold N+1 on cooling strictly, and if you use chimneys, remember the ceiling plenum is now a single-point dependency too.

Suppression volume includes the plenum

If chimneys discharge into a ceiling return plenum, or you have created a sealed wall plenum, that volume is part of the protected space. Size the clean agent on room plus plenum, and re-run the hold-time calculation. See FP-500.

Where the narrow plan is actually easier

Two genuine advantages, both worth taking:

  • Power gets simpler. One straight row invites overhead A/B busway running its full length, with a tap box per rack. Adding or moving a rack becomes a tap box change rather than a new home run from the panel — which in a two-row plan means pulling cable through a live room. This is the single best reason to like a narrow layout.
  • Cable tray gets simpler. One tray run instead of two, straight down the row, with no crossings between rows. See T-600.
  • Everything in the room sits in cold air. With the whole room as the cold reservoir, the UPS and its batteries live at supply temperature rather than in a warm corner — which directly extends battery life (E-410).
  • The room is pleasant to work in. No hot aisle to stand in.

What changes, at a glance

Two-row plan vs. single row
SubjectTwo-row (A-101)Single row (A-103)
Hot aisleBetween the rows None — must be created
ContainmentCap the hot aisleChimney duct or sealed wall plenum
Cold sideTwo cold aislesThe whole room is the cold reservoir
End wrap-aroundTwo ends, partly blocked by the opposing row Two ends, fully exposed
Rear accessFrom the hot aisle Constrained — plan for casters or hold 3 ft
Cooling throwDown the length of the aisle Across a narrow room — short throw, easier to get even
Return air temperatureMixes with room air Higher with chimneys — better coil efficiency and ΔT
Power distributionHome runs to two rows One busway run — simpler
Cable trayTwo runsOne run — simpler
Suppression volumeRoom volume Room + ceiling plenum or wall plenum
Thermal redundancyTwo rows share the load One failure domain — N+1 is stricter
Area per rack36 ft²31 ft²
Working space in a narrow room

The NEC 110.26 working space in front of a panel will often overlap the cold zone. That is acceptable — the code requires the space be clear and not used for storage, and a circulation aisle satisfies that. What it may not contain is racks, shelving, staged equipment or spares. In a narrow room this overlap is what makes the plan fit, so mark it on the drawing and make sure everyone understands that strip stays empty.

A-110

Racks & Build Standard

Architectural · IT

The rack is the unit of everything downstream — cooling, power, weight, cabling. Pick one standard and build every rack the same way.

Dimensions

Rack dimensional standards
PropertyValueNote
Rack unit (U)1.75 in / 44.45 mm EIA-310; hole spacing 0.625 / 0.625 / 0.5 in repeating
Mounting rail width19 in / 482.6 mm 23, 24 and 30 in variants exist; 19 in is universal for IT
Rack external width600 mm (24 in) or 800 mm (32 in) TIA-942-C requires 800 mm minimum in distribution areas; 800 mm gives vertical cable managers beside the rails
Rack external depth1000–1200 mm (39–48 in) 42 in is the planning dimension. Allow ~6 in behind the rear rail for cable
Usable height42U typical 45U and 48U exist; check door and lift height before ordering
Door perforation≥ 63 % open area Front and rear. A glass front door on a populated rack is a cooling fault.
Equipment to door clearance≥ 1.5 in Front and rear, so the door does not throttle the intake

Rack or open two-post rack?

Enclosed rack — the default

  • Required for any airflow management: containment, blanking, ducting.
  • Security at the rack level; lockable front and rear.
  • Supports zero-U vertical PDUs and proper cable management.
  • Higher static load rating; anchors cleanly for seismic.

Open two-post — narrow uses

  • Patch-only frames and telecom terminations where there is no heat load.
  • Cheaper and lighter, but no airflow control and no security.
  • Servers belong on four-post racks. Deep chassis need rear support, and you cannot manage front-to-back airflow on an open frame.

The build standard

Sheet T-201 is the full 42U elevation. The rules behind it:

1

Fill from the bottom, heaviest first

UPS, batteries and storage arrays go in the lowest U. Static load belongs in the plinth. A top-heavy rack tips during a slide-out and fails its seismic anchorage.

2

Patch field in the reach zone

Roughly 44–58 in above finished floor — waist to shoulder for a standing technician. That is around U23–U31 in a 42U rack on a 4 in plinth. Never patch at ankle height; you will be back there at 3 a.m.

3

A horizontal manager for every patch or switch panel

One U of management above and below each patch field element. It looks wasteful on the U-map and pays for itself the first time somebody re-patches.

4

Blank every unused U

Non-negotiable. An open U lets exhaust recirculate straight into the intake above it and can cost several degrees at the top of the rack. Blanking panels are the cheapest cooling you will ever buy.

5

Reserve growth as contiguous U

Eight consecutive free U will take a 4U chassis. Eight scattered single U will not.

6

Seal the base and grommet every entry

Brush grommets at every cable penetration and a sealed rack base. An ungrommeted cutout can leak more air than a perforated tile delivers.

7

Watch side-to-side airflow equipment

Many access switches and some firewalls breathe side to side. In a front-to-back rack they ingest the neighbor's exhaust. Specify a duct kit, or order the front-to-back airflow SKU — most vendors sell both, and the airflow direction is often a suffix on the part number.

Mounting hardware — the page everybody skips

Rails, threads, cage nuts and torque get left out of every specification and then cost a stripped rail, a dropped chassis, or a rack that was never actually bonded. Decide these before the first rack lands.

Rail hole types

Rail hole types and what each commits you to
TypeFastenerVerdict
Square, 9.5 mm
universal / EIA-310
Cage nut + machine screw Specify this. The cage nut sets the thread, so one rack can host M6 equipment this year and 10-32 equipment next year. You change a consumable, not the rack
Round, threadedMachine screw, direct Tapped 10-32, 12-24 or M6 at the factory. One thread forever, and a decision you cannot undo. Strip a hole and that U is gone — you must never re-drill or re-tap a rack rail
Round, unthreadedClip nut (snap-on) Common on two-post relay racks. Workable, but clip nuts wander and fall off during a re-fit

The four threads you will meet

Thread comparison and typical seating torque
ThreadMajor dia.Pitch WhereTypical torque
10-32 UNF4.83 mm
0.190 in
32 tpiNorth American threaded rails — the most common tapped thread20–25 in-lb
2.3–2.8 N·m
12-24 UNC5.49 mm
0.216 in
24 tpiOlder and telco racks, two-post relay racks 30–35 in-lb
3.4–4.0 N·m
M55.00 mm
0.197 in
0.80 mm Some vendor rail kits and accessory hardware 22–27 in-lb
2.5–3.0 N·m
M66.00 mm
0.236 in
1.00 mm The default cage nut thread; most modern server equipment 40–50 in-lb
4.5–5.6 N·m
1/4-20 UNC6.35 mm
0.250 in
20 tpiHeavy shelves, some rail kits, seismic hardware 55–65 in-lb
6.2–7.3 N·m
Torque values are typical, not authoritative

Use the figures above only where the equipment manufacturer publishes none. Where a manufacturer does publish a value, that value governs. A calibrated torque driver is a cheap tool next to one stripped rail, and it is the only way to get repeatable results from people who are not you.

The 0.17 mm that eats racks

10-32 is 4.83 mm. M5 is 5.00 mm. An M5 screw will start in a 10-32 hole and feel almost right for two turns before it cuts the thread clean out of the rail. That U is then dead, and there is no repair — you cannot re-tap a rail.

Sort hardware into labeled bins on day one, never mix a bag, and never let a screw that needs force go in. This one mistake scraps more rack rails than any other hardware error.

Cage nuts

  • Tabs top and bottom, never left and right. Sideways tabs leave nothing to resist screw torque; the nut spins in the hole and then pops out under load.
  • Install from the rear face of the flange. The screw must pull the nut onto the back of the rail. Fitted on the front face it holds fine on the bench and lets go when the shelf is loaded, because screw tension is now pushing it out of the hole.
  • Cage nuts are consumables. A cage sprung open by a previous install — or by pliers — will not grip. Bin it.
  • Buy the cage nut tool. It costs less than one hour of the time you will otherwise spend, and it is the difference between a clean install and bloodied knuckles.
  • Match the nut to the hole. 9.5 mm is standard; some racks use 10 mm and the wrong one will not seat.

Screws, washers and the bond

  • Machine screws only. Never a sheet-metal or self-tapping screw in a rack rail.
  • Length matters in both directions. Too long bottoms out in the cage nut and clamps nothing; too short strips on the first turn.
  • Cup or flange washers on painted rails stop the head chipping the coating, and a chipped edge is where corrosion starts.
  • Powder coat is an excellent insulator. A plain screw into a painted rail mounts the equipment and bonds nothing. Use a thread-forming screw with a serrated flange, a paint-piercing washer, or scrape the contact clean and treat it with antioxidant — then home-run the rack frame to the TGB with #6 AWG, per E-440. Bonding is a design item, not a by-product of mounting.

Count from a boundary, not from a hole

Why you are off by one U

The three holes in a rack unit are not evenly spaced. Going up, the pattern is 0.625 in — 0.625 in — 0.500 in, and the U boundary sits in the middle of the 0.500 in gap, not on a hole.

Count from a boundary. Better, mark the U numbers on the rail with a marker before you mount anything, and the whole class of off-by-one-U errors disappears — along with the rework of a full rack built one hole out.

Load capacity — four different numbers

Load ratings, routinely conflated
RatingTypical 42U rackWhat it means
Static load2,000–3,000 lb
900–1,360 kg
Standing still, level, on feet or anchored. The datasheet number
Dynamic / rolling load 1,500–2,250 lb
680–1,020 kg
Being rolled, loaded, on casters. Always lower, often much lower. This is the number that matters the day you move it
Fixed shelf100–250 lb
45–113 kg
Four-post, supported front and rear
Cantilever shelf50–75 lb
23–34 kg
Front rails only. Fine for a monitor, not for a server
Sliding rail kit100–200 lb
45–90 kg
Per the server vendor, not the rack vendor
The floorsee S-200 Usually the real limit. A 2,500 lb rack on a 36 × 42 in footprint is roughly 240 lb/ft² — well past a typical 100 lb/ft² office slab
Anti-tip is not optional

A single 2U server on extended rails, pulled out of a lightly loaded rack, will tip it. Fit the stabilizer foot or anchor the rack to the slab before the first install, not after the room is full. Load heaviest at the bottom and work up — which is also why the UPS sits at U1–U6 on T-201.

The house standard, in one line

Square-hole rails, M6 cage nuts and screws, torque driver, one labeled bin of 10-32 for legacy gear. Write the rail type and thread into the rack documentation — the next person will not be you.

▤ T-201 · rack elevation, front and rear ▤ A-111 · hole geometry, cage nuts, threads, load ratings
T-201Rack elevation — 42U build standard
Drawing sheet T-201 — Rack elevation — 42U build standard
T-201 — Front and rear elevation: heaviest at the bottom, patch field in the 44–58″ reach zone, contiguous growth blanked, zero-U PDUs on the rear rails. Editable source: diagrams/t-201…excalidraw
A-111Rack mounting hardware & load capacity
Drawing sheet A-111 — Rack mounting hardware & load capacity
A-111 — EIA-310 hole geometry drawn to scale, cage nut installation right and wrong, the four threads with typical torque, and the four load ratings people conflate. Editable source: diagrams/a-111…excalidraw
S-200

Floor Loading, Seismic & Raised Floor

Structural

A loaded rack is heavier than almost anything an office floor was designed to carry. This is the check that most retrofits skip and the one that cannot be fixed afterwards.

Rack weight — build it up

Representative loaded 42U rack
Componentlbkg
Rack, doors, rails, side panels300136
Rack UPS 3 kVA + external battery module15068
Storage array, 4U populated10045
4 × 2U servers20091
Switches, patch panels, managers10045
PDUs, cabling, cords5023
Typical total900 408
Dense / fully populated2,000–2,500 900–1,130
Floor loading — distributed and concentrated

Distributed = rack weight ÷ footprint

  typical  = 900 lb ÷ 7 ft² = 129 lb/ft²

  dense    = 2,500 lb ÷ 7 ft² = 357 lb/ft²

Concentrated = rack weight ÷ 4 leveling feet

  typical  = 900 ÷ 4 = 225 lb per foot

  dense    = 2,500 ÷ 4 = 625 lb per foot

Footprint
24 in × 42 in = 7 ft² (0.65 m²)
Feet
Leveling feet, not casters. Casters concentrate load further and are for moving, not standing.
Compare against what the floor was designed for

A typical office floor is designed for around 50 lb/ft² live load plus 20 lb/ft² partition allowance — call it 70–80 lb/ft². A typical loaded rack imposes 129 lb/ft², and a dense one 357 lb/ft². In any building that was not purpose-built, get a structural engineer's letter before you order racks. Remedies exist — spreading the load with steel plate, adding shoring below, relocating rows over a beam line — but all of them are cheaper before the equipment arrives.

Design targets

TIA-942 floor loading targets
LoadingRecommendedMinimumApplies to
Uniform distributed live load250 lbf/ft² (12 kPa) 175 lbf/ft² (8.4 kPa)Equipment space floor
Concentrated load2,000 lbf (8.9 kN) 1,000 lbf (4.4 kN)Any single point
Hanging / suspended load50 lbf/ft² (2.4 kPa) 25 lbf/ft² (1.2 kPa)Structure above, for pathway and containment

Also check the rolling load path: the route from the delivery point to the final position must carry a loaded rack on casters, including the lift, any ramp, and every access-floor tile it crosses. Rolling load is a separate and often lower rating than static load.

Raised access floor — usually the wrong answer at this size

Use one when

  • You are using the plenum as the supply air path, and you can get a genuine 24 in clear beneath the tile.
  • The building already has one and it is rated for your loads.
  • You need a signal reference grid for legacy equipment.

Skip it when

  • You cannot get 24 in — a 12–18 in plenum is obstructed, leaky and does not deliver the static pressure the design assumed.
  • Ceiling height is tight. The floor eats the height you need for pathway above.
  • The room is under 20 racks and overhead pathway plus in-row or perimeter cooling will do the same job with fewer failure modes.
If you do install one
  • Cable belongs overhead, not in a supply plenum. Cable in the plenum blocks the air you are paying to move.
  • Grommet or seal every penetration, and seal the perimeter and every cutout at the wall line.
  • Bond the understructure and install a signal reference grid; see E-440.
  • Brace the understructure for seismic, and provide a ramp or lift — not a step.
  • Perforated tiles go in cold aisles only. A perf tile in a hot aisle is a self-inflicted bypass path.

Seismic anchorage

  • Anchorage requirements follow the Seismic Design Category from IBC and ASCE 7 for your site — this is a local determination, not a national rule.
  • In higher categories, racks are anchored to the structural slab (through the access floor, not to it), often with a seismic base kit and special inspection.
  • Anchorage is the reason weight distribution matters: the calculation assumes the mass is low in the rack. Load it top-heavy and the anchorage design is invalid.
  • Batteries, UPS racks and overhead pathway all need their own anchorage details — cable tray full of copper is a significant suspended mass.
M-300

Heat Load Calculation

Mechanical · Thermal

Seven sources of heat, one of which is 85 % of the answer. Get the IT number right and the rest is arithmetic you can do on one page.

The governing conversion

Watts to BTU per hour

BTU/hr = watts × 3.412

tons = BTU/hr ÷ 12,000   1 ton = 12,000 BTU/hr = 3.517 kW

kW     = BTU/hr ÷ 3,412

Essentially all electrical power delivered to IT equipment becomes heat in the room. A server does not store energy and does no mechanical work worth counting — what goes in as watts comes out as heat. This is why the IT heat load is simply the IT electrical load, and why any argument about "efficiency" reducing the heat load is wrong.

The seven sources

Total room sensible heat

Qtotal = QIT + QUPS + QPDU + Qlight + Qpeople + Qenvelope + Qinfil

QIT
= IT load (W) × 3.412  — measured or vendor-calculated, never nameplate
QUPS
= IT load × (1/η − 1) × 3.412  — η is UPS efficiency at your actual load fraction, not at full load
QPDU
≈ 1–2 % of IT load, × 3.412  — higher if a step-down transformer is in the room
Qlight
= lighting watts × 3.412  — ≈ 1.0 W/ft² for LED, 1.5–2.0 W/ft² for older fluorescent
Qpeople
≈ 300 BTU/hr sensible per person  — usually negligible; count 1–2
Qenvelope
= Σ (U × A × ΔT)  — per wall, ceiling and floor assembly
Qinfil
= 1.08 × CFMoutside air × ΔT

Envelope, in detail

Conduction through the shell

Q = U × A × ΔT   BTU/hr

U
assembly conductance, BTU/hr·ft²·°F (= 1/R)
A
area of that assembly, ft²
ΔT
design temperature difference across it, °F

Typical U values: insulated exterior wall 0.06–0.09 · uninsulated interior gypsum partition 0.30–0.40 · insulated roof/ceiling 0.03–0.06 · single glazing 1.0+ · slab on grade, usually neglected.

ΔT matters more than people expect. Against a conditioned neighbor at 78 °F with the room at 72 °F, ΔT is 6 °F and the wall barely matters. Against outdoor design of 95 °F, ΔT is 23 °F. Against an unconditioned attic in summer, ΔT can exceed 50 °F.

Worked breakdown — 10 racks, 20 kW IT

Room 20 ft × 18 ft = 360 ft², 10 ft ceiling. One exterior wall, three interior partitions, unconditioned space above. UPS at 92 % efficiency at the operating load fraction.

Heat load contribution — 10-rack reference room
SourceBasisBTU/hr % of totalShare
IT equipment20,000 W × 3.412 68,24085.4
UPS losses20 kW × (1/0.92 − 1) × 3.412 5,9377.4
Envelope conductionΣ U·A·ΔT, four assemblies 2,3062.9
Outside air / infiltration1.08 × 50 CFM × 23 °F 1,2421.6
Lighting360 ft² × 1.0 W/ft² × 3.412 1,2281.5
PDU losses1 % of 20 kW × 3.412 6820.9
People1 person × 300 BTU/hr 3000.4
Total sensible= 6.66 tons 79,935100
What the breakdown tells you

IT plus UPS losses are 92.8 % of the load. The envelope, lighting and people together are under 5 %. Two consequences: (a) spend your effort pinning down the real IT number, because a 20 % error there swamps every other term; (b) do not skip the UPS losses — at 7.4 % they are half a ton, which is a whole equipment size.

Getting the IT number right

1

Measure, if the equipment exists

Metered rack PDUs or a clamp meter on the feed. This is ground truth and takes an afternoon. Take readings at peak business load, not at 2 a.m.

2

Use the vendor's configuration tool, if it does not

Dell, HPE, Cisco and others publish power calculators that take your exact configuration. Far more accurate than any rule of thumb.

3

Never design to nameplate

Nameplate is the maximum draw of a fully-populated worst-case configuration with redundant supplies. Actual draw is commonly 40–60 % of nameplate. Designing to nameplate produces a cooling plant that never leaves minimum load, cycles constantly, controls humidity badly and costs twice what it should.

4

Add growth deliberately, not as a fudge

State the design load and the growth allowance separately. "20 kW today, 30 kW design" is a decision. "20 kW plus a bit of margin" is a mess three people will each interpret differently.

On oversizing

Adding a blanket 25 % "safety factor" on top of a design that already includes growth is the most common mechanical error in small rooms. An oversized DX system short-cycles, which wrecks dehumidification, hammers the compressor and shortens its life. If you want headroom, buy it as modularity — three 5-ton units instead of two 7.5-ton units — not as oversized single machines.

M-310

Cooling Selection, Sizing & Redundancy

Mechanical

The heat load gives you a number in tons. Turning that into equipment involves one conversion that catches almost everybody: sensible heat ratio.

The sensible heat ratio trap

A data center load is almost entirely sensible — servers heat air, they do not add moisture. Sensible heat ratio (SHR) is the fraction of a unit's rated capacity that goes to lowering temperature rather than removing water.

IT load SHR
≈ 1.00

No latent component worth counting.

Comfort AC rated SHR
0.70–0.75

Rated for humans in an office. A quarter of its capacity is dehumidification you do not need.

Precision / CRAC SHR
0.95–1.00

Designed for this load. Nominal tons ≈ sensible tons.

Converting sensible load to nominal equipment capacity

Nominal tons required = sensible tons ÷ SHR

Precision unit, SHR 0.98:  6.66 ÷ 0.98 = 6.8 tons → 7-ton unit

Comfort mini-split, SHR 0.72:  6.66 ÷ 0.72 = 9.25 tons → 10-ton nominal

The same room needs a 7-ton precision unit or a 10-ton comfort unit. Specify a comfort unit at its nominal rating and you are roughly 28 % short on the day it matters. This single error explains a large share of small server rooms that "have plenty of cooling" and still run hot.

Airflow — the other half of the answer

Required airflow

CFM = Qsensible ÷ (1.08 × ΔT)

room, ΔT = 20 °F:  79,935 ÷ (1.08 × 20) = 3,700 CFM

per rack, 2 kW, ΔT = 20 °F:  6,824 ÷ (1.08 × 20) = 316 CFM

1.08
= 0.24 BTU/lb·°F × 60 min/hr × 0.075 lb/ft³  (sea level, dry air)
ΔT
supply-to-return temperature rise across the equipment. 18–22 °F is a healthy design target for front-to-back servers.

Shortcut: at ΔT = 20 °F you need roughly 160 CFM per kW. At ΔT = 25 °F, about 126 CFM/kW.

Altitude correction — replace 1.08 with the value for your elevation
Elevation (ft)01,000 2,0003,0005,000 7,00010,000
Constant1.081.05 1.020.990.93 0.880.80
CFM upliftbaseline+3 % +6 %+9 %+16 % +23 %+35 %

Air is thinner at altitude, so the same CFM carries less heat. At Denver you need about 16 % more airflow than at sea level for the same load and ΔT — and most equipment also derates. This catches people who copy a sea-level design inland.

Choosing the cooling architecture

Cooling approach by rack density
kW / rackApproachContainmentNotes
< 3Room-level: ducted split, mini-split or perimeter CRAC Not requiredAisle discipline and blanking still pay for themselves
3 – 6Room-level, hot/cold aisle enforced RecommendedThe band most small rooms live in
6 – 10Perimeter CRAC or in-rowRequired Without containment you cannot hold intake temperature at the top of the rack
10 – 20In-row CRAH, or rear-door heat exchangers RequiredChilled water or refrigerant to the row
> 20Liquid — direct-to-chip or immersion N/AASHRAE class H1 territory; a different design problem entirely

Ductless mini-split — the small-room workhorse

  • Cheap, widely available, easy to service, no water in the room.
  • Must specify a low-ambient kit. A server room needs cooling in January. A standard condenser may refuse to run below roughly 0–30 °F without crankcase heat, fan speed control and a wind baffle.
  • Derate for SHR as above.
  • Wall-mount high, discharging along the cold aisle; return from high in the room.
  • Condensate needs a trapped gravity drain, or a pump with a high-level alarm wired to shut the unit down.

Precision / CRAC — when the load justifies it

  • SHR near 1.0, tight temperature control, built for continuous duty.
  • Filtration, humidity control and proper controls integration included.
  • Higher capital cost and a bigger footprint in a room that has none to spare.
  • Worth it above roughly 15–20 kW, or wherever uptime justifies the control quality.

In-row — for the dense 20-rack case

  • Cooling sits in the row, meters from the load. Short air path, high efficiency, excellent control.
  • Pairs naturally with hot-aisle containment.
  • Consumes row length — budget 12 in of row per unit.
  • Chilled water or refrigerant lines enter the room; plan the route and leak detection.

Never: the building's comfort system alone

  • Runs on a building schedule, is off at night and at weekends, and is rebalanced by people who do not know your room exists.
  • No redundancy, no monitoring you control, no failure alarm to you.
  • A tenant-controlled dedicated system is not a luxury here; it is the requirement.

Redundancy

N+1 means one unit can fail or be serviced and the remaining units still carry the full design load. Two ways to get there in a small room:

N+1 options for a 6.66-ton sensible load (comfort units, SHR 0.72)
ConfigurationUnitsSensible each Capacity with one downTrade-off
2 × 10-ton nominal27.2 tons 7.2 tons ✓ Simplest. Each unit runs at ~46 % load when both run — poor part-load efficiency and short-cycling risk
3 × 5-ton nominal33.6 tons 7.2 tons ✓ Better. Two carry the load, third is the spare. Finer staging, better part-load behavior, cheaper single-unit replacement
1 × 10-ton nominal17.2 tons 0 ✗ N only. Any failure or filter change is a room shutdown
  • Rotate lead/lag automatically so runtime equalizes and the standby unit is proven to start.
  • Test the changeover. A standby unit that has never been asked to start under load is a spare, not redundancy.
  • Feed the units from different electrical panels, or you have one failure domain wearing two boxes.
Cooling must be on the generator

If the UPS carries the IT load but the cooling is not on standby power, the room heats up while everything runs happily. How fast:

air mass = 360 ft² × 10 ft × 0.075 lb/ft³ = 270 lb
heat capacity = 270 × 0.24 = 64.8 BTU/°F
rate = 68,240 BTU/hr ÷ 60 = 1,137 BTU/min
ΔT = 1,137 ÷ 64.8 ≈ 17 °F per minute (room air alone)

Thermal mass in the equipment and structure slows this — call it 4–8 °F per minute in practice. You still go from 72 °F to an A2 shutdown at 95–104 °F in single-digit minutes. Put the mechanical panel downstream of the ATS, and size the generator for compressor inrush.

▤ M-302 · line set, condenser siting and condensate ▤ M-201 · airflow section
M-302Cooling plant, refrigerant & condensate
Drawing sheet M-302 — Cooling plant, refrigerant & condensate
M-302 — Where the tons physically land: line set through the wall, oil trap, roof condenser with clearances, and the condensate path out of the room. Editable source: diagrams/m-302…excalidraw
M-320

Airflow Management

Mechanical · Thermal

Most small rooms that run hot do not lack cooling capacity. They lack separation between the air they paid to cool and the air the servers just heated.

The one principle

Separate supply from return

Every rack front faces a cold aisle. Every rack rear faces a hot aisle. Supply air enters cold aisles only; return air is taken from hot aisles only. Any path that lets exhaust reach an intake without passing through a cooling coil is a defect — and every defect costs you capacity you already bought.

The four faults, in the order you should fix them

1

Unblanked rack units — fix first, costs almost nothing

An open U is a direct short circuit from the hot aisle back into the cold aisle at the intake of whatever sits above it. Cost: a few dollars per U. Benefit: commonly 2–5 °F at the top of the rack. It's the highest-ROI item in this entire guide.

2

Unsealed cable openings and rack bases

Brush grommets on every penetration; seal the rack base and the gaps between bayed racks. An ungrommeted 6 × 12 in floor cutout can leak more air than a perforated tile delivers — you are supplying the plenum, not the servers.

3

Bypass air — supply that never meets a server

Perforated tiles in a hot aisle, tiles under a rack, supply diffusers pointed at the return, an oversized fan pushing air past the row. The symptom is a low return temperature: if return air is barely warmer than supply, you are circulating air around the equipment rather than through it, and paying full price for it.

4

Recirculation over and around the row

Hot exhaust rolling over the top of a short row or around its open end and back into the cold aisle. Fix with blanking end-of-row panels, aisle-end doors, or a full containment cap. This is the fault that containment actually solves — which is why containment comes last, after the cheap fixes.

▤ M-201 · correct vs. the four faults, drawn to scale
M-201Airflow section — correct vs. the four faults
Drawing sheet M-201 — Airflow section — correct vs. the four faults
M-201 — The same rack drawn five times. Bypass, recirculation, an open U and a throttled door, each costing degrees at the top of the rack. Editable source: diagrams/m-201…excalidraw

Delta-T is your health metric

Return − supply ΔT
18–22 °F

Healthy. Air is doing its job.

ΔT below 10 °F
Bypass

You are moving far more air than the load needs, or it is going around the equipment.

ΔT above 30 °F
Starved

Not enough airflow. Check tile count, filters, fan speed and blocked intakes.

Top-of-rack intake
≤ 80.6 °F

The ASHRAE recommended ceiling, measured where it actually matters.

Containment

Hot-aisle containment

  • Enclose the hot aisle; the rest of the room is the cold reservoir.
  • The room stays comfortable to work in — everything outside the aisle is cool.
  • Better for in-row cooling and for a room where people sit or work.
  • Preferred for the 20-rack case in this set.

Cold-aisle containment

  • Enclose the cold aisle; the room becomes the hot return plenum.
  • Cheaper to retrofit onto an existing raised-floor room.
  • The room itself runs hot — unpleasant, and hard on anything outside the aisle (UPS, batteries, and people).
Containment and fire suppression interact

A contained aisle is a separate volume as far as smoke detection and agent distribution are concerned. Two requirements follow: containment roof panels must drop away on a fusible link or on the suppression release so the agent floods the whole room, and you must size suppression on the full room volume, not the aisle volume. Get the fire protection engineer and the containment vendor talking before either orders anything.

Perforated tile placement (raised floor only)

  • Perforated tiles go in cold aisles only. Never in a hot aisle, never under a rack, never in a walkway "because it is warm there".
  • A 24 in tile at 25 % open delivers roughly 400 CFM at typical plenum pressure; a 56 % grate delivers 900–1,200 CFM. Divide the rack's required CFM by that figure to get tile count — the 2 kW rack above needs about one tile.
  • Too many tiles collapses plenum static pressure and starves the far end of the room. Tile count is a budget, not a free resource.
  • Measure, do not assume. A cheap anemometer at each tile pays for itself the first time it finds a dead zone.
M-330

Humidity & the ASHRAE Envelope

Mechanical · Thermal

The temperature and humidity limits most people quote are twenty years out of date, and chasing the old ones wastes a great deal of energy.

Where to measure

At the intake — not at the thermostat

Every number in this section is specified at the air intake of the IT equipment: the rack front face. Not the room average, not the return air, not a thermostat on the wall by the door. Sensors go at the bottom, middle and top of the rack front, because the top of the rack is where an airflow problem shows up first and the wall thermostat will never see it.

The envelope

ASHRAE TC 9.9 thermal guidelines, 5th edition (2021) — at the equipment intake
ClassDry bulbHumidity Max dew pointTypical equipment
Recommended 64.4–80.6 °F
18–27 °C
−9 °C DP to
15 °C DP, ≤ 60 % RH
15 °C Design to this. Applies to all A classes
A1 allowable59–89.6 °F
15–32 °C
8–80 % RH17 °C Enterprise servers, storage — tightly controlled
A2 allowable50–95 °F
10–35 °C
8–80 % RH21 °C Volume servers, storage, networking — the common class
A3 allowable41–104 °F
5–40 °C
8–85 % RH24 °C Equipment rated for wider swings
A4 allowable41–113 °F
5–45 °C
8–90 % RH24 °C Widest envelope; enables aggressive economizer use
H164.4–71.6 °F
18–22 °C
—— High-density and liquid-cooled, added in the 5th edition
Two caveats

Recommended vs. allowable. Recommended is where you design and normally operate. Allowable is where equipment will survive, with excursion-hour limits that vary by class — it is not a license to run there permanently.

The nameplate wins. If a switch is rated to 95 °F intake and the room is class A3, your ceiling is 95 °F. Warranty follows the equipment specification, not the guideline. Confirm the exact current envelope against the edition your mechanical engineer is working from.

Humidity — what actually matters

Too humid

  • Condensation is the real hazard, and it is governed by dew point, not relative humidity. If any surface — a chilled water pipe, a coil, a cold supply duct — falls below the room dew point, you get water.
  • Hygroscopic dust bridges and corrosion over long exposure.
  • Keep dew point at or below 15 °C (59 °F) and you will not have a condensation problem.

Too dry

  • Electrostatic discharge risk — but far less than folklore suggests for properly grounded, enclosed, modern equipment.
  • ASHRAE relaxed the lower limit substantially in 2011 and again since; the old "45 % RH minimum" is obsolete and expensive to maintain.
  • Control ESD with grounding, dissipative flooring and wrist straps — not by humidifying an entire room.
Practical setpoint for a small room

Target 72–75 °F (22–24 °C) at the rack intake with a wide dead band, and control humidity only to the extent of keeping dew point below 15 °C. Do not install a humidifier in a ten-rack room unless you have a measured reason. Do not let two cooling units fight each other — one dehumidifying while the other humidifies is a classic and expensive small-room failure, and it happens whenever units have independent humidity control and slightly different calibration.

Free cooling

Where climate allows, an air- or water-side economizer can cut mechanical cooling hours dramatically — the wider the equipment class, the more hours you get. In a small room, weigh it carefully: an economizer adds dampers, controls, filtration and outside-air humidity swings to a room whose whole appeal is simplicity, and the savings on a 20 kW load may not repay the complexity. It becomes compelling around the 20-rack, 80 kW case and in cold, dry climates.

E-400

Power Load Calculation

Electrical

Power sizing has three layers: what the IT actually draws, what the facility draws to support it, and what the utility service has to deliver. Confusing them is how rooms end up with a 200 A service and a 60 kW generator that cannot start the air conditioning.

Volt-amps, watts and power factor

The relationships

W = VA × PF   power factor is always ≤ 1

Single phase:  W = V × A × PF   →   A = W ÷ (V × PF)

Three phase:  W = √3 × VLL × A × PF   →   kVA = √3 × VLL × A ÷ 1000

208 V three-phase shortcut:  kVA = 0.36 × A   (√3 × 208 ÷ 1000 = 0.360)

PF, modern IT
0.95–0.99. Power-factor-corrected switching supplies are near-unity; W ≈ VA.
PF, older UPS ratings
0.6–0.8. A "3 kVA" UPS from 2005 may deliver only 1.8–2.4 kW. Current units are rated 0.9–1.0.
VLL
line-to-line voltage: 208 V in a 208Y/120 system, 480 V in a 480Y/277 system.
Read UPS ratings carefully

A UPS advertised as "10 kVA" at 0.8 PF delivers 8 kW. If your load is 9 kW, that unit is undersized no matter what the model number says. Always size against the kW rating, and confirm the output power factor on the datasheet rather than the box.

The three layers

What each number is for — 10-rack reference room
LayerIncludesExampleSizes
1. IT load Servers, storage, network — measured or vendor-calculated 20.0 kWUPS capacity, rack circuits, heat load
2. Facility load IT + UPS losses + cooling + lighting + house 34.2 kWGenerator, service, distribution
3. Service capacity Facility load × 1.25 continuous, rounded up to a standard size 200 A @ 208 V 3ØUtility service, main breaker
Facility load build-up — 10-rack room

IT load ..................................... 20.00 kW

UPS losses at 92 % efficiency ............  1.74 kW

Mechanical 7 tons DX @ ~1.5 kW/ton incl. fans  11.00 kW

Lighting + house ........................  1.50 kW

Facility total ............................ 34.24 kW

A = 34,240 ÷ (1.732 × 208 × 0.9) = 105.5 A

Service = 105.5 × 1.25 = 132 A → use 200 A for growth headroom

PUE = 34.24 ÷ 20.00 = 1.71 — typical and honest for a room this size

Nameplate, measured and diversity

1

Nameplate is not a design load

It is the worst case of a fully-populated configuration with every redundant supply drawing. Real draw is commonly 40–60 % of it. Design to nameplate and you buy a UPS that idles at 30 % load — where its efficiency is worst — and a generator you cannot load-bank meaningfully.

2

Apply diversity at the room, never at the circuit

Racks do not all peak at once, so a room-level diversity factor of 0.8–0.9 on the sum of rack maxima is reasonable for a mixed load. But size each branch circuit for its own rack at full load — the breaker does not know about diversity.

3

Dual-corded loads draw on both sides

A dual-corded server splits its draw roughly evenly across A and B in normal operation, but each side must be sized to carry 100 % of the load alone. This is the whole point of A/B. Sizing each side at 50 % gives you a room that fails the moment you lose a path — which is precisely the event you built it for.

4

Set a per-rack density budget and publish it

Decide, in writing, that a rack is (say) 4 kW. Then a rack is 4 kW, and someone who wants 12 kW in one has to come and ask. Without a published budget, density arrives by accident and you discover it thermally.

Density bands for small rooms
kW / rackDescriptionWhat it demands
1–3Light — network gear, older servers One 20 A circuit per side. Room-level cooling
3–6Typical small room One 30 A circuit per side. Aisle discipline mandatory
6–10Dense — virtualization, modern 2U 3-phase rack PDUs. Containment required
10–20High density In-row cooling, 3-phase 60 A feeds, careful phase balance
> 20GPU / HPC A different building. Liquid cooling, 480 V distribution
208 V or 480 V?

Below roughly 75 kW facility load, a 208Y/120 service is simplest — no transformer, everything runs on it. Above roughly 100 kW, take 480Y/277 from the utility, run 480 V to the UPS and to the mechanical equipment, and step down to 208Y/120 at a PDU near the rows. The current at 480 V is 43 % of the current at 208 V for the same kW, and the copper saving alone usually pays for the transformer. Between 75 and 100 kW it is a genuine judgement call — weigh the transformer cost and its heat against feeder size and voltage drop.

E-410

UPS Sizing & Batteries

Electrical

A UPS is not a generator substitute. It is a bridge across the seconds before the generator picks up, or the minutes you need to shut down cleanly if there is no generator. Size it for that job, not for a heroic runtime nobody will use.

Sizing

Capacity

UPS kW rating ≥ IT load × (1 + growth allowance)

UPS kVA rating = required kW ÷ output power factor

20 kW IT + 25 % growth = 25 kW; at 0.9 PF →  27.8 kVA → 30 kVA unit

Target an operating load fraction of 40–75 % of the UPS rating. Below about 25 % load, double-conversion efficiency falls off sharply and the losses you calculated in M-300 get worse. Above 80 % you have no headroom for a step load or a failed module.

Topology

UPS topologies
TopologyTransferEfficiency Use in a server room
Standby / offline2–10 ms~98 % Desktops only. Not for a server room
Line-interactive2–6 ms96–98 % Acceptable for a single edge rack; regulates voltage but does not rebuild the waveform
Double-conversion (online)0 ms 92–96 % The default. Load runs from the inverter continuously; utility disturbances never reach it
Double-conversion in eco mode2–4 ms98–99 % Saves real energy but reintroduces a transfer. Enable only with a tested load

Runtime — how much do you actually need?

With a generator
5–10 min

Generator start and transfer is 3–5 min worst case. Anything beyond ~10 min buys very little.

No generator, graceful shutdown
15–30 min

Long enough to shut down cleanly, with margin for the script to fail once.

No generator, ride through
Don't

Battery to survive a multi-hour outage costs more than a generator and cannot cool the room anyway.

Design at
End of life

Rated runtime is for a new battery at 25 °C. Size for 80 % capacity, which is the replacement threshold.

Battery runtime does not cool the room

See M-310: without cooling on standby power, a 20 kW room heats at several degrees per minute. Thirty minutes of battery runtime with no cooling means thirty minutes of watching the temperature climb past the shutdown threshold. Runtime and cooling are one decision, not two.

Battery chemistry

VRLA vs. lithium iron phosphate
PropertyVRLA (sealed lead-acid)LiFePO₄
Service life3–5 years8–12 years
Capital costLow2–3× higher up front
Lifetime costHigher — 2–3 replacement cyclesUsually lower
WeightHeavy — a structural consideration~⅓ the weight
Temperature tolerancePoor — see belowGood to ~40 °C
FootprintLargerSmaller
MonitoringOften none; failures are discovered during an outage Integral BMS with cell-level state
Code treatmentStraightforward NFPA 855 may apply — spacing, ventilation, detection, UL 9540A test data, AHJ review
Temperature halves battery life

VRLA life is roughly halved for every 15 °F (8.3 °C) above 77 °F (25 °C) — IEEE 485 gives the same Arrhenius rule at 10 °C, and manufacturer data sheets vary between the two. Pick the more pessimistic one for design.

A battery rack sitting in a 95 °F hot aisle has about a quarter of its rated life — a five-year battery becomes a fifteen-month battery, and it will fail without warning during the outage it was bought for. Put the UPS and its batteries in the cold aisle or in the electrical zone, never in the hot aisle.

Lithium and NFPA 855

NFPA 75 (2024) removed its lithium-ion battery provisions and defers to NFPA 855. Depending on installed energy capacity, 855 can trigger requirements for spacing, dedicated rooms, ventilation, explosion control, off-gas detection and UL 9540A large-scale fire test data. Small rack-mounted lithium UPS batteries often fall below the thresholds — but often is not always. Confirm with the AHJ before you specify, not after delivery.

Maintenance bypass — the thing that makes a UPS maintainable

A wrap-around maintenance bypass lets you isolate and remove the UPS entirely while the load keeps running on utility power. Without one, every battery replacement, firmware update and capacitor service is a planned outage.

  • It is the single cheapest step toward concurrent maintainability. Specify it on every UPS above a single rack.
  • Internal bypass (inside the UPS) is not the same thing — it does not let you remove the unit.
  • Label the operating sequence on the rack. Bypass procedures are performed rarely, under pressure, by whoever is available.
  • Exercise it annually as part of your maintenance routine.
▤ E-301 · single-line with bypass shown
E-301Power single-line
Drawing sheet E-301 — Power single-line
E-301 — Utility through ATS, UPS and PDU to the rack, with the wrap-around maintenance bypass that makes the UPS concurrently maintainable. Editable source: diagrams/e-301…excalidraw
E-420

Generator, ATS & the Transfer Window

Electrical

The most common generator sizing error in a small room is to size it on the IT load. The IT load is the smallest thing it has to carry.

What the generator actually carries

Generator sizing — 10-rack room

UPS input (IT + UPS losses) .............. 21.74 kW

Battery recharge allowance ~20 % of UPS rating ...  5.00 kW

Mechanical cooling, both units able to run ..... 11.00 kW

Lighting, house, controls ..................  1.50 kW

Running load ............................. 39.24 kW

÷ 0.8 PF = 49.1 kVA

× 1.25 margin, step load and derate → ~61 kW / 77 kVA

specify a 60–70 kW set, confirmed against the compressor starting kVA

The four things that make a generator bigger than you expect

1

Motor starting inrush

A compressor's locked-rotor current is roughly 6× its full-load current for a few seconds. On a small generator this is the binding constraint — not the running load. Soft starters or variable-speed compressors cut this dramatically and can let you buy a smaller set. Give the generator supplier the actual starting kVA of every motor.

2

Battery recharge

The moment the generator picks up, the UPS starts recharging at up to about 20 % of its rating on top of the IT load. Allow for it or the generator gets loaded harder than the design assumed on every single outage.

3

Step load acceptance

Loads do not arrive gradually. The ATS closes and the whole block lands at once. Generator sets have a published block-load acceptance limit and a frequency/voltage dip specification — a UPS with a narrow input window may reject the source if the dip is too deep, which produces the memorable failure where the generator runs perfectly and the UPS refuses to take it.

4

Altitude and temperature derate

Naturally aspirated sets lose roughly 3 % per 1,000 ft of elevation and further capacity at high ambient temperature. A 60 kW set in Denver on a hot day is not a 60 kW set.

Transfer switch

ATS transition types
TypeBehaviorUse
Open transitionBreak before make — brief total interruption Standard, and fine: the UPS covers the break
Delayed transitionOpen transition with a programmed neutral dwell Preferred with motor loads — lets motor fields decay before reconnection, avoiding out-of-phase re-energization
Closed transitionMake before break, brief parallel with the utility No interruption on return to utility. Requires utility approval

The transfer window — what happens in those minutes

1

t = 0 s · Utility fails

UPS transfers to battery with no interruption. IT load unaffected. Cooling stops immediately.

2

t ≈ 3 s · ATS senses loss, signals start

A deliberate delay avoids starting on a momentary blip.

3

t ≈ 10–30 s · Generator starts and stabilizes

Voltage and frequency must be within tolerance before the ATS will transfer.

4

t ≈ 30 s – 5 min · ATS transfers, load lands

Mechanical restarts, often staged to limit inrush. Room temperature has been climbing this whole time — this is the window that decides whether the room survives.

5

Utility returns · retransfer, then cooldown

Time delay on retransfer to confirm the utility is stable, then an unloaded cooldown run before shutdown.

Fuel, testing and NFPA 110

Plan for 24–72 hours of on-site fuel and a refueling contract. Diesel degrades — polish or turn over the fuel annually. Natural gas removes storage and the fuel contract but depends on a utility that may itself fail in a regional event.

Exercise monthly under real load, and load-bank test annually. An unloaded weekly run does not prove capacity and, in a diesel, causes wet stacking. Where the generator serves a legally required emergency system, NFPA 110 sets the testing and maintenance regime — check whether it applies to yours.

E-430

Distribution, Circuits & Receptacles

Electrical

Everything from the panel to the power cord. The recurring theme is the 80 % rule and the discipline of keeping A and B genuinely separate.

The 80 % rule, stated correctly

Continuous load sizing — NEC 210.20(A) / 215.3

OCPD rating ≥ non-continuous load + (1.25 × continuous load)

which, for an all-continuous IT load, is the same as saying:

usable load ≤ 0.80 × breaker rating

A continuous load is one expected to run for three hours or more. All IT load is continuous. So a 20 A circuit gives you 16 A, and a 30 A circuit gives you 24 A — and the conductor must be sized for the same 125 %.

Circuit and receptacle capacity

Usable continuous capacity by receptacle type (80 % of rating)
ReceptacleVAPhase Usable kWTypical use
NEMA 5-15R120151Ø 1.44Convenience only — not for racks
NEMA 5-20R120201Ø 1.92Light racks, network gear
NEMA L5-30R120301Ø 2.88Legacy 120 V rack PDUs
NEMA L6-20R208201Ø 3.33Small racks — good fit for 2–3 kW
NEMA L6-30R208301Ø 4.99The small-room workhorse
NEMA L21-20R208203Ø 4W 5.76Medium density
NEMA L21-30R208303Ø 4W 8.65Dense racks, 3-phase rack PDU
CS8365C208503Ø 3W 14.4High density
IEC 60309 2P+E208301Ø 4.99Where a sealed, keyed connector is preferred
IEC 60309 3P+N+E208603Ø 4W 17.3Very high density
Three-phase capacity assumes balance

The three-phase figures above are only achievable with the load evenly distributed across all three phases. A 3-phase rack PDU with everything plugged into one branch trips that branch long before the PDU reaches its rating. Use a metered PDU that reports per-phase current, and balance as you install — not after the first trip.

A/B distribution done properly

Do

  • Separate panels, fed from separate UPS units, in separate raceways.
  • Color-code from panel to cord — A one color, B another, consistently, everywhere.
  • One A and one B rack PDU per rack, each able to carry the whole rack.
  • A rack ATS for genuinely single-corded equipment.
  • Test by killing one side entirely, with the room live.

Don't

  • Feed both PDUs from the same panel. That is one path wearing two cables.
  • Cross-tie A and B at the rack. It defeats the separation and can backfeed.
  • Load either side beyond 40–45 % in normal operation — when one side fails, the other takes everything, and if it was at 60 % it now needs 120 %.
  • Assume dual-corded means dual-fed. Plenty of "redundant" gear has both cords in the same strip.

Rack PDU selection

Rack PDU types
TypeGives youWorth it?
BasicOutlets. Nothing elseOnly for non-critical racks
Metered (inlet)Total and per-phase current, remotely The minimum for a production room. Without it you are guessing at capacity
Metered (per outlet)Per-device consumption Useful for chargeback and for finding the one server drawing 400 W at idle
SwitchedRemote power-cycle per outlet Pays for itself the first time you avoid a 2 a.m. drive to reboot a hung box

Zero-U vertical mounting in the rear of the rack keeps U free and puts the outlets beside the equipment they feed. Mount A and B on opposite rear rails so a hand slipping off one cannot reach the other.

Panel schedules, spares and harmonics

  • Leave 25 % spare breaker positions at handover. You will use them within two years, and adding a panel later is an outage.
  • Keep an accurate, printed panel schedule at the panel and a copy in your documentation. An unlabeled panel in a server room is a genuine hazard.
  • Surge protection: Type 1 or 2 at the service entrance, Type 2 at the distribution panel. Coordinate ratings; a single device at the service does not protect a panel forty feet downstream.
  • Harmonics: modern power-factor-corrected supplies produce far less harmonic current than 1990s equipment, so full 200 % neutrals are rarely required now. They still matter where legacy nonlinear load dominates, or on a UPS input at low load. Measure THD rather than assuming — then size the neutral and specify K-rated transformers only if the measurement justifies it.
▤ E-431 · panel schedule, phase balance, one circuit end to end ▤ E-431 · connector schedule with usable capacity
E-431Circuit schedule & connector plate
Drawing sheet E-431 — Circuit schedule & connector plate
E-431 — Panel DP-A with breakers placed to balance rather than filled in sequence, the balance under A/B failover, and one branch circuit end to end. Editable source: diagrams/e-431…excalidraw
E-440

Grounding & Bonding

Electrical · Telecom

One bonded system. Everything metallic in the room ties back to it. There is no such thing as a separate clean ground, and every attempt to create one makes things worse.

The rule that prevents the most damage

Never drive a separate ground rod for the server room. Two electrodes at different potentials, connected to each other only through your equipment, means that during a lightning event or a fault the difference between them travels through switch ports and circuit boards. Every electrode at the building gets bonded into one system, per NEC 250. "Isolated ground" in the NEC sense means an insulated equipment grounding conductor routed back to the source — not a separate electrode.

The telecom bonding system — TIA-607-D

Components
ElementWhat it isSpecification
TMGBTelecommunications Main Grounding Busbar One per building, at the entrance facility. Copper, min 6 × 50 mm (¼ × 2 in)
BCTBonding Conductor for Telecommunications TMGB to the main service grounding — the link into the electrical system
TBBTelecommunications Bonding Backbone TMGB to each TGB. Continuous copper, #6 AWG min, sized by length, not spliced
TGBTelecommunications Grounding Busbar One per telecom space — your server room. Copper busbar on insulated standoffs
RBCRack Bonding Conductor #6 AWG stranded, each rack home-run to the TGB
TBB conductor sizing by run length — ANSI/TIA-607-D
Length (ft)≤ 1314–20 21–2627–3334–41 42–5253–66> 66
AWG643 211/02/0 3/0

In the room

1

Home-run every rack — never daisy-chain

#6 AWG from each rack directly to the TGB. Daisy-chaining means removing one rack breaks the bond of everything downstream of it, and nobody notices until something fails.

2

A screw into painted steel is not a bond

Use paint-piercing washers, or scrape to bright metal, apply antioxidant compound and use a listed two-hole compression lug with an irreversible crimp. Powder coat is an excellent insulator — that is what it is for.

3

Bond the pathway, and jumper every splice

Cable tray and ladder rack get bonded at both ends of every run, with a bonding jumper across every splice plate. Splice plates are a mechanical joint, not an electrical one — their resistance is unpredictable and changes with time and vibration.

4

Bond the access floor understructure, if there is one

A raised floor gets a signal reference grid or mesh bonding network, tied to the TGB. The understructure is a large conductive object in the room; leave it floating and it becomes an antenna.

5

The equipment grounding conductor is separate and additional

Every branch circuit carries an EGC. That is the fault-clearing path and is required by NEC 250. The telecom bonding system is in addition to it, for potential equalization. Neither substitutes for the other, and a rack bonding conductor is not a substitute for a green wire in the conduit.

Busbar installation

  • Copper busbar, minimum ¼ × 2 in section, pre-drilled to NEMA bolt spacing.
  • Mounted on insulated standoffs — the busbar must not touch the wall or any incidental metal.
  • Two-hole listed compression lugs, irreversible crimp, one conductor per lug.
  • Antioxidant compound on every scraped, cleaned contact surface.
  • Green label: TELECOMMUNICATIONS GROUNDING BUSBAR — DO NOT REMOVE.
  • Leave spare positions. You will add racks.

Testing and records

Bond continuity
< 1 Ω

From every rack and tray section to the TGB. Record each reading.

Electrode resistance
≤ 25 Ω

The common code threshold for a single rod; many owners specify ≤ 5 Ω.

When to test
At turnover

Then after any work that disturbs the system. Keep the readings.

Record
Every point

A bonding test report with a point-by-point table is a commissioning deliverable.

▤ E-302 · grounding riser and busbar detail
E-302Grounding & bonding riser
Drawing sheet E-302 — Grounding & bonding riser
E-302 — Electrode system → TMGB → TBB → TGB → rack bonding conductors, with the busbar termination detail. One bonded system, no isolated ground rod. Editable source: diagrams/e-302…excalidraw
E-450

Lighting & Egress Illumination

Electrical · Life Safety

Lighting is the one system in this room you use on every single visit, and the one most likely to be inherited from whatever the shell build happened to leave behind. Elsewhere in this guide it appears only as a load — 1.0 W/ft² into the heat calculation and 1.5 kW into the facility total. This sheet is about making it work.

The number nobody specifies

Specify vertical illuminance, not just horizontal. ANSI/TIA-942-C asks for 500 lux horizontal and 200 lux vertical, both measured 1 m above the finished floor in the middle of the aisle. Nearly every lighting submittal proves the horizontal number and is silent on the vertical one — and the vertical plane is the rack face, where every label, port and status LED you came to look at actually lives. A layout that hits 500 lux on the floor while running the fixture rows over the racks leaves those faces in the racks' own shadow. It passes calculation and fails at 02:00.

Targets

Illuminance, duration and power targets
MeasureTargetWhere measuredSource
Horizontal (maintained)500 lux / 50 fc Middle of the aisle, 1 m AFFANSI/TIA-942-C
Vertical200 lux / 20 fc Rack face plane, 1 m AFFANSI/TIA-942-C
Egress path1 fc avg, 0.1 fc min Floor of the egress pathNFPA 101 / IBC
Egress uniformity40:1 max-to-min Along the pathNFPA 101
Egress duration90 minutes On loss of normal powerNFPA 101 / IBC
Working spaceLit, not auto-only At the panel and UPSNEC 110.26(D)
Power density≈ 1.0 W/ft² LED Whole roomMatches the M-300 heat figure
Color4000 K, CRI ≥ 80 Whole roomReading color-coded patch cords

Where the fixtures go

1

Rows run along the aisles, centered on the aisle

Not over the racks. In the 10-rack reference room that puts three runs at 2′-0″, 9′-0″ and 16′-0″ off the north wall — the three aisle centerlines, at the same 7′-0″ pitch as the aisles themselves. The aisle-pitch module you already used to lay out the floor gives you the ceiling for free.

2

The ceiling is contested space — draw it before you order

Cable tray, containment, suppression nozzles, detectors and diffusers all want the same plane. Coordinate the reflected ceiling plan against T-401 and FP-501 first. A fixture that lands under a nozzle degrades the spray pattern, and one inside the detector spacing envelope delays detection.

3

Light the working space at the panel — and not with a sensor alone

NEC 110.26(D) requires illumination for the working space about panelboards and similar equipment, and in an electrical equipment room that illumination shall not be controlled by automatic means only. An occupancy sensor by itself does not satisfy it. Provide a manual switch.

4

Mount high enough to clear the work, low enough to reach the face

8′-6″ AFF is a reasonable floor for a room with overhead pathway. Higher gets you more uniform floor coverage and less onto the vertical face — which is the trade the vertical target exists to police.

Egress, emergency and the EPO boundary

The miswire that a small room invites

NEC 645.10 has the EPO disconnect power to the electronic equipment and to the room's dedicated HVAC. It does not ask you to kill the lights, and taking egress lighting or the exit sign down with the EPO is a life-safety defect — you have just darkened the room you are asking people to leave in a hurry. In a large facility the separation is obvious because the circuits come from different places. In a small room fed from a single house panel it is easy to build by accident, and nobody finds it until the button is pressed in anger.

The simple answer

Integral-battery emergency fixtures and exit signs. A 90-minute battery in the unit survives both a utility outage and the EPO without any transfer scheme, needs no separate circuit back to a generator, and is testable with a button on the fixture. Lighting stays house load — it does not belong on the UPS.

Controls

ASHRAE 90.1 requires automatic shutoff, and a room occupied a few hours a month is exactly where that pays. Two cautions specific to this space:

  • Specify vacancy, not occupancy. Manual-on, automatic-off. You do not want the lights striking every time someone opens the door to look at a UPS display, and you certainly do not want them doing it on a motion false-positive.
  • Sensor coverage has to see between the racks. A person standing still behind a rack, hands inside it, is invisible to a single center-of-room PIR — and the failure mode is the lights going out while they are wrist-deep in a live cabinet. Use more than one sensor, add ultrasonic where rows block line of sight, and set a long time-out. This is a safety item, not an energy one.
Ask for this before you accept the design

A calculation in the vertical plane at the rack face, with the racks modeled as obstructions, alongside the horizontal one. A horizontal-only calc on an empty room will look excellent and tell you nothing about the condition you actually work in. If the supplier cannot produce it, they have not modeled your room.

Numbers to carry

Horizontal
500 lux

Mid-aisle, 1 m AFF. The number everyone quotes.

Vertical
200 lux

Rack face, 1 m AFF. The number that decides whether you can work.

Egress
1 fc / 90 min

Average on the path, on battery, not on the EPO.

Load
1.0 W/ft²

LED. Already counted in the M-300 heat load — do not double it.

▤ E-450 · reflected ceiling plan, the over-aisle vs. over-rack section, and the EPO boundary
E-450Lighting & egress illumination
Drawing sheet E-450 — Lighting & egress illumination
E-450 — Reflected ceiling plan with the fixture rows on the aisle centerlines, the section showing why over-the-rack leaves the face in shadow, and the EPO boundary that egress lighting must sit outside of. Editable source: diagrams/e-450…excalidraw
FP-500

Fire Detection & Suppression

Fire Protection

The goal is to detect combustion before there are flames and to extinguish without destroying what you were protecting. Get a licensed fire protection engineer — this section tells you what to ask them.

Detection

Air-sampling smoke detection (ASD/VESDA)

  • Draws room air continuously through a pipe network to a laser chamber.
  • Detects at concentrations orders of magnitude below a spot detector — typically at the overheating-insulation stage, before smoke is visible.
  • Sample points in the return air path, above racks, and in any raised-floor or ceiling plenum.
  • This is what gives you the chance to intervene before suppression is needed.

Spot detectors and cross-zoning

  • Ceiling detectors on a spacing reduced for high airflow — moving air dilutes smoke and delays detection.
  • Below a raised floor and above a suspended ceiling where those are plenums.
  • Cross-zoned: two independent detectors in different zones must both alarm before the agent releases. This is what prevents a false discharge.
  • Off-gas detection for lithium batteries — added in NFPA 75 (2024).

Clean agents

Clean agent comparison — NFPA 2001
AgentClass A design conc.NOAEL GWPStorageConsiderations
FK-5-1-12
Novec 1230
4.2–5.9 %10 %< 1 Liquid, superpressurized. Compact Excellent safety margin. Verify long-term supply — see below
HFC-227ea
FM-200
6.25–7.0 %9 %~3,220 Liquefied gas. Compact Very widely installed. High GWP — subject to HFC phase-down
IG-541
Inergen · N₂/Ar/CO₂
34–43 %43 %0 High-pressure cylinder bank No decomposition products. Large footprint
IG-55
Argonite · N₂/Ar
37–40 %43 %0 High-pressure cylinder bank Same trade-off as IG-541

Design concentrations are indicative; the actual figure comes from the listed system's hydraulic calculation for your specific room volume, temperature and hazard class. NOAEL is the no-observed-adverse-effect level — a design concentration below NOAEL is what permits a normally occupied space.

Agent supply chain — verify before you commit

Both mainstream halocarbon agents carry live regulatory and supply-chain questions. HFC-227ea (FM-200) has a GWP around 3,220 and sits inside HFC phase-down programs including the US AIM Act, with allocation quotas that tighten step-wise through the 2030s. FK-5-1-12 (Novec 1230) is a fluoroketone whose primary manufacturer (3M) is exiting PFAS production; secondary sources have emerged but pricing and long-term availability remain unsettled.

Neither is a reason to avoid clean agent — but get written commitments on agent availability and refill pricing over a ten-year horizon before you commit to a chemistry. Inert gases (IG-541, IG-55, IG-100) carry no such exposure; their cost is floor space and cylinder-storage weight.

The numbers NFPA 2001 will hold you to

Halocarbon discharge
≤ 10 s

95 % of design concentration within ten seconds.

Inert gas discharge
≤ 60 s

Slower is permitted — no decomposition products to limit.

Hold time, Class A
10 min

Concentration retained above the minimum, verified by door fan test.

Pre-discharge delay
30 s

Typical. Alarm, strobe, and an abort station inside the room.

Pressure relief venting — the most-omitted item

Discharging a clean agent into a sealed room raises pressure fast. Rooms are typically rated for only 240–720 Pa (5–15 lbf/ft²). Without correctly sized relief venting, a discharge can and does blow walls, doors and ceilings out.

Vent area is calculated from the agent, the discharge rate and the enclosure's structural pressure rating, and the vent must open freely and quickly. Ask for the vent sizing calculation as a named deliverable. In a small, well-sealed room this is the item most likely to be missing.

Acoustic damage to spinning disks

High-pressure inert gas discharge through nozzles can exceed 110 dB, and the resulting vibration has caused hard drive failures and array outages — the well-documented case being a bank data center where an inert gas discharge took the site down without any fire damage at all. Specify low-noise nozzles, keep nozzles away from racks, and consider the exposure when choosing between halocarbon and inert systems.

Interlocks and integration

  • On release: shut down HVAC, stop fans, close fire/smoke dampers. Agent that gets blown out of the room does not extinguish anything.
  • Containment roof panels must drop away so agent reaches the whole volume — see M-320.
  • Abort station inside the room, at the exit; pre-discharge alarm and strobe.
  • Signal to the building fire alarm and to your monitoring, so somebody knows.
  • Seal the room: the hold time test will find every unsealed penetration, cable tray opening and door gap. Fix them before the test, not after the failed one.

Water — sprinklers, if required

Many jurisdictions require sprinkler coverage throughout a building regardless of what else is in a given room. If that is your situation, use a double-interlock pre-action system: the pipe is dry, and water enters only after both a detection alarm and a fused sprinkler head. A physically damaged head alone will not flood the room.

Clean agent and sprinklers together

This is the common and correct answer, not a contradiction. The clean agent handles the incipient electrical fire without damaging equipment. The pre-action sprinkler is the life-safety and structural backstop for a fire the agent does not stop. Design them to work in sequence, and make sure both are on the same detection logic.

Portable extinguishers

  • Clean agent (Halotron, FE-36) or CO₂. Sized and located per NFPA 10, typically 2-A:10-B:C, within the required travel distance.
  • Never dry chemical ABC in a server room. The residue is corrosive and conductive; it gets into everything with a fan, and the cleanup routinely costs more than the fire would have. Remove any that are already there and replace them.
  • Mount by the exit, so reaching for one moves you toward the door.

Housekeeping is a fire requirement

NFPA 75 limits combustible loading in the room. Cardboard boxes, packing material, paper stores and spare-parts piles are not untidiness — they are a code violation and the most likely fuel in the room. Unbox outside; store spares elsewhere.

▤ FP-501 · device layout, enclosure integrity, relief venting ▤ FP-501 · cause-and-effect matrix for the fire alarm contractor
FP-501Fire protection & life safety plan
Drawing sheet FP-501 — Fire protection & life safety plan
FP-501 — Agent and detection layout, slab-to-deck enclosure integrity, pressure relief venting, and the cause-and-effect matrix for the alarm contractor. Editable source: diagrams/fp-501…excalidraw
FP-510

Physical Security

Security

Physical access defeats every other control you have. Someone standing at the rack does not need your credentials.

Layers

Defense in depth for a small room
LayerControlSmall roomHigher assurance
1 · Site / buildingPerimeter, reception, building access Existing building controlDedicated screening
2 · Floor / corridorZone access control Badge to reach the floorSeparate credential group
3 · RoomDoor control and logging Card reader + request-to-exit, logged Card + PIN, or biometric; mantrap
4 · RackRack locksKeyed locks, key control Electronic rack locks with per-user audit

What to specify

Access control

  • Card reader in, request-to-exit out. Log every event, including denials — a string of denials is an incident.
  • Door position switch, so you know when it is propped. Alarm on held-open.
  • Retain logs for at least as long as your incident review window; 90 days is a common floor.
  • Fail-safe or fail-secure is a life-safety decision — coordinate with the fire alarm and the AHJ. Egress must always work.
  • Review the access list quarterly. It only ever grows otherwise.

Video

  • Camera covering the door, both sides, at face height — not a ceiling dome looking at the tops of heads.
  • Camera down each cold aisle so rack work is recorded.
  • 30–90 day retention, stored outside this room. Video of the incident stored in the room the incident happened in is not evidence.

Construction

  • Walls slab to slab. A wall stopping at the ceiling grid means anyone with a ladder is in. This is the single most common physical security failure in retrofit rooms.
  • No exterior windows. If unavoidable: opaque, security film, and covered by the alarm system.
  • Solid-core or steel door in a steel frame. Hinges on the secure side or with non-removable pins — an out-swinging door with exposed hinge pins is not secure.

Process

  • Vendors and contractors escorted, always, with a signed log.
  • Nothing leaves without an equipment pass. Nothing arrives without being unboxed outside.
  • Keys and rack keys under documented control. "The key lives on top of the rack" is not key control.
Proportionality

A ten-rack internal server room does not need a mantrap, an anti-passback vestibule and iris scanning. It needs a locked door with logging, a camera, walls that go to the deck, and a quarterly access review that somebody actually performs. Spend the money on the review.

▤ FP-501 · reader, REX, door contact and camera coverage at the door
T-600

Structured Cabling & Pathways

Telecommunications

Cable outlives three generations of the equipment plugged into it. Install it once, install it properly, and buy a category above what you need today.

Media selection

Media by application
MediaSupportsDistanceUse for
Cat 6A U/UTP or F/UTP10GBASE-T100 m channel The default copper. Do not install Cat 6 new — 10GBASE-T on Cat 6 is distance-limited and alien-crosstalk sensitive
Cat 825/40GBASE-T30 m Short switch-to-server only. Rarely justified: DACs handle in-rack, fiber+optics handle inter-rack, and the cost per port is out of proportion to either
OM4 multimode10G / 40G / 100G~150 m @ 10G In-room and building backbone
OM5 multimodeSWDM, 40/100G~150 m @ 10G Where short-wave division multiplexing is planned
OS2 singlemodeEffectively anythingkm Building entrance, inter-building, and any run you want to never revisit
DAC / twinax10/25/40/100G1–7 m Switch-to-server inside a rack, or rack to adjacent rack
Fiber strand count

Pull far more strands than you need. The cost difference between 12 and 48 strands is almost entirely labor, and the labor is identical. The cost of pulling a second cable in three years is the whole job again, in a live room.

Topology for a small room

TIA-942 defines a full hierarchy — entrance room, main distribution area, horizontal distribution area, equipment distribution area. In a room of ten to twenty racks, collapse it honestly:

Top of rack (ToR)

  • A switch pair in each rack; only fiber uplinks leave the rack.
  • Minimal copper between racks — clean pathways, easy moves.
  • More switches to manage, more ports stranded in low-density racks.
  • Usually right for dense, uniform racks.

Middle / end of row (MoR / EoR)

  • One switch pair serves the row from a network rack.
  • Fewer switches, better port utilization, one place to manage.
  • Large copper bundles converging on one rack — pathway and airflow both suffer.
  • Usually right for ten racks of mixed, low-density equipment.

Whichever you choose, put a permanent copper and fiber link between every rack and the network rack during construction. Structured cabling installed while the room is empty costs a fraction of the same cable pulled later around live equipment.

Pathway design values

Pathway and installation parameters
ParameterValueWhy
Ladder rack support interval5 ft o.c. max Plus within 2 ft of every splice and end
Tray fill at initial install40 % Leaves room for the adds you have not thought of
Tray fill, absolute maximum50 % Above this you cannot re-dress the bundle without removing cable
Conduit fill, 3+ cables40 %NEC Chapter 9, Table 1
Separation from unshielded power12 in (300 mm) For < 2 kVA in an open or non-metallic pathway. Reduces to ~2.5 in where the power run is in bonded metallic conduit
Bend radius, 4-pair UTP4 × cable OD Tighter deforms the twist and fails the channel test
Bend radius, multipair copper10 × cable OD—
Bend radius, fiber10 × OD unloaded / 20 × OD under tension Macrobending loss is permanent if the cable is kinked
Max copper bundle24 cables Larger bundles raise alien crosstalk and trap heat
Cable tiesHook-and-loop only A cinched nylon tie on Cat 6A deforms the geometry and fails certification
Horizontal channel100 m total 90 m permanent link + up to 10 m of patch cords, both ends combined

Choosing the tray type

The tray is not a generic commodity — the type drives airflow, load capacity and how easily you can work on it later.

Cable tray types in a server room
TypeAirflowLoadUse forVerdict
Wire mesh (basket)Excellent — open on all sides Light–mediumData cabling First choice for copper and fiber. Cut and formed on site with bolt cutters, so field changes are trivial. Cables are visible and accessible
LadderGood — open rungsHigh Power cabling, long spans The load-bearing choice. Rung spacing supports heavy feeders and lets you tie down at any point
Perforated / ventilated troughModerateMedium Mixed runs needing some containment Acceptable compromise; rarely the best answer for either job
Solid bottomPoor — traps heatMedium EMI-sensitive runs needing shielding Avoid in a server room unless shielding genuinely requires it
Channel / single railN/ALight Short drops, single-cable runsUseful for a branch off a main run
The pairing that works

Wire mesh for data, ladder for power, on separate tiers. It matches each tray's strength to its job, keeps the 12 in separation without any extra effort, and means the copper and fiber you touch most often sit in the tray that is easiest to open.

Tray load, span and material

Selection parameters
ParameterGuidance
Load / span designation NEMA VE-1 designates a tray by span and working load — e.g. 12C = 12 ft span at 100 lb/ft. Classes A / B / C correspond to roughly 50 / 75 / 100 lb/ft. Always confirm against the manufacturer's published load table for the specific product
Support interval 5–10 ft (1.5–3 m) typical, per the tray's class. Use 5 ft in a server room — it costs little and keeps deflection invisible. Support within 2 ft of every splice, every fitting and every end
Fill at initial install40 % of usable cross-section
Fill, absolute maximum 50 %. Above this you cannot re-dress the bundle without pulling cable out
Spare capacity to plan Size the tray for 30–50 % more than day-one need, and leave room beside it to hang a second tray. Both are nearly free now and expensive later
Material — standardPre-galvanized steel. The default indoors
Material — long spansAluminum. Lighter, faster to install, higher strength-to-weight
Material — appearancePowder-coated where the room is visible
Material — corrosiveStainless. Rarely needed in a server room
EdgesEvery cable entry and exit gets a bushing, grommet or radius drop. A bare cut tray edge will cut a jacket over time

Code points on tray

  • NEC Article 392 governs cable tray: 392.22 for fill, 392.30 for securing and supporting, 392.60 for grounding and bonding.
  • The tray is not your equipment grounding conductor. NEC 392.60(B) permits metallic tray to serve as an EGC only in industrial establishments meeting specific conditions — qualified maintenance, continuous supervision, and minimum tray cross-section. A normal server room does not qualify. Bond the tray, and carry a separate EGC in every circuit.
  • Bond every run at both ends and jumper every splice. Splice plates are a mechanical joint whose resistance changes with vibration and age — see E-440.
  • NEMA VE-2 is the cable tray installation guideline and is the document to hand an installer who is improvising.
  • Provide expansion splice plates on long runs subject to temperature swing.

Overhead, tiered

  • In a slab-on-grade small room, overhead beats underfloor: nothing obstructs airflow, and you can see what you have.
  • Tier the pathways vertically — fiber on top, copper below it, power lowest or on a separate route — with the separation above maintained between power and telecom.
  • Run pathway over the aisles, not over the racks. You need the space above a rack to lift equipment into it.
  • Keep telecom out of the hot aisle where you can — jacket life is a function of temperature.
  • Radius drops (waterfalls) where cable leaves the tray into a rack. A cable bent over a tray edge is a future fault.
  • Bond every section and jumper every splice — see E-440.
  • Fire-stop every rated penetration to its listed system, and re-seal after every change.

Test and certify — do not accept "it links"

Require the installer to certify every permanent link with a calibrated tester against the applicable TIA standard, and to hand over the test results as a file. Link lights prove nothing: a marginal channel will pass traffic on a quiet day and produce intermittent errors under load, and finding that later costs more than the cabling did.

▤ T-401 · pathways, ladder rack and design values ▤ T-402 · topology, carrier to rack
T-401Cable pathways & ladder rack
Drawing sheet T-401 — Cable pathways & ladder rack
T-401 — Tiered separation with fiber over copper over power, support intervals, fill and bend-radius values, and the radius drop into the rack. Editable source: diagrams/t-401…excalidraw
T-605

Conduit, Sleeves & Penetrations

Telecommunications · Fire Protection

Tray gets the cable across the room. Conduit gets it through a wall — and every wall it passes through belongs to somebody else's discipline. This is where cabling, fire rating and clean-agent hold time turn out to be the same detail.

Fill, and the three thresholds people collapse into one

NEC Chapter 9, Table 1 sets fill by cable count, not by a single 40 % rule:

One cable
53 %

A single cable can occupy over half the raceway.

Two cables
31 %

The one everyone gets wrong — two cables are the tightest case.

Three or more
40 %

The number people quote for everything.

Computed fill for EMT

Areas below come from the internal diameters in NEC Chapter 9, Table 4. Cat 6A is taken at 0.30 in OD and 12-strand distribution fiber at 0.20 in — check the OD on the actual datasheet, because shielded Cat 6A runs 0.35 in and up, which costs you roughly a third of the count.

EMT conduit fill at 40 % (three or more cables)
Trade sizeInternal dia.Area 40 % fillCat 6A
geometric
Cat 6A
design
12F fiber
geometric
3/4″0.824″0.533 in² 0.213 in²316
1″1.049″0.864 in² 0.346 in²4211
1-1/4″1.380″1.496 in² 0.598 in²8419
1-1/2″1.610″2.036 in² 0.814 in²11625
2″2.067″3.356 in² 1.342 in²181042
2-1/2″2.731″5.858 in² 2.343 in²331974
3″3.356″8.846 in² 3.538 in²5030112
4″4.334″14.753 in² 5.901 in²8349187
Geometry is not the binding constraint

The design column is 60 % of the geometric count, and that is the number to build to. What actually stops a pull is friction and tension, not area — and a conduit filled to its geometric maximum cannot be added to later without pulling everything out.

Jam ratio: where conduit ID ÷ cable OD lands between roughly 2.8 and 3.2, three same-size cables can wedge across the bore and stop the pull dead. Size deliberately around that band rather than into it.

The bend budget

What the code allows

  • NEC 358.26 (EMT), 344.26 (RMC), 348.26 (FMC): no more than the equivalent of four quarter bends — 360° total — between pull points.
  • That is a ceiling for any raceway, sized around building wire.

What telecom should design to

  • ANSI/TIA-569 practice: no more than two 90° bends between pull points, and a pull point at least every 100 ft (30 m).
  • Data cable has a bend radius and a maximum pulling tension that building wire does not. Design to the stricter number.
Pull box sizing — NEC 314.28
Pull typeMinimum dimensionExample, 2″ conduit
Straight pull, 314.28(A)(1) 8 × trade size of the largest raceway16 in
Angle or U pull, 314.28(A)(2) 6 × trade size, plus the sum of the other raceway diameters in the same row12 in + others
A telecom pull box is not a junction box

Cable passes through it. No splices, no stored slack, no sharp internal corners, and it stays accessible — which means not above a hard ceiling you would have to cut.

Sleeves and penetrations

Use a sleeve, not a cored hole with cable through it. The sleeve is what lets the next person add a cable without destroying the fire rating.

  • Projection: extend the sleeve 1–4 in past each face of the wall.
  • Bushings: insulated throat bushing on both ends. A bare sleeve edge cuts jackets on the next pull, and the damage will not be visible.
  • Firestop: a listed system with F and T ratings matching the barrier. Better, where moves and adds are expected, a listed re-enterable pathway device — a sealed sleeve you can open, add a cable to, and reseal without a putty kit and a guess.
  • The seal is doing two jobs. It is the fire seal, and it is what holds clean-agent concentration through the ten-minute hold time. One detail, done once, correctly — see FP-500.
  • Temperature boundaries: NEC 300.7(A) requires sealing where a raceway passes between spaces at different temperatures. An unsealed conduit from an unconditioned space will condense and drip inside your room, and you will chase the leak for weeks.
  • From outdoors or below grade: assume the conduit carries water. Seal it, and slope it away from the building.

Outside plant at the entrance

  • NEC 805.90 — primary protector on exposed copper OSP, listed, and as close as practicable to the point of entrance.
  • NEC 805.93 / 770.93 — bond the cable sheath and any metallic member to the TMGB, as close as practicable to the point of entrance. See E-440.
  • NEC 770.48 / 805.48 — unlisted OSP cable may run no more than 50 ft inside the building before transitioning to listed cable. Decide where that transition happens at design time, not when the inspector asks.
  • NEC 770.113 / 805.154 — listing by application: OFNP/CMP in plenums, OFNR/CMR in risers.
The lever worth knowing

Specify all-dielectric OSP fiber. With no metallic member there is nothing to bond and no primary protector to install — the entire clause above simply stops applying. For a small room bringing in a carrier circuit, this removes a whole category of work and a whole category of lightning path.

Spares, and the thing that makes a spare real

  • Install at least two spare conduits on any path you cannot cheaply reopen — between floors, through rated construction, and out to the entrance facility.
  • Leave mule tape or a pull line in every conduit at handover, spares included. A spare conduit with no pull line in it is not a spare; it is a future core drill.
  • Conduit is not the telecom bonding system. Bond it, and run the TBB and rack bonding conductors separately — see E-440.
  • Use innerduct where fiber shares a conduit with anything else, so the next pull cannot chafe it.
  • Never terminate a conduit directly over a rack without a drip loop.
▤ T-402 · computed fill, sleeve detail, bend budget, OSP entrance ▤ FP-501 · the same penetrations, seen as agent-tightness
T-402Cabling topology, conduit & penetrations
Drawing sheet T-402 — Cabling topology, conduit & penetrations
T-402 — Carrier to rack as a star, conduit fill computed from NEC Chapter 9, the sleeve through a rated wall, and the bend budget. Editable source: diagrams/t-402…excalidraw
T-605Sleeve through a rated wall & bend budget
Drawing sheet T-605 — Sleeve through a rated wall & bend budget
T-605 — The single most consequential penetration detail: firestop, grounding bushing, spare sleeve and drip loop; and the two-90 TIA-569 practice compared to the four-quarter NEC ceiling. Editable source: diagrams/t-605…excalidraw
T-610

Labeling & Documentation

Telecommunications · Operations

The room will outlive your memory of it, and probably your employment. Every hour spent on labeling during construction saves several at 3 a.m. later.

Design the scheme before anything is installed

ANSI/TIA-606-D sets the framework. The specifics matter less than picking one scheme, writing it down, and never deviating. A workable convention for a small room:

Identifier scheme

Rack      ROW + POSITION   →  A03 row A, third rack

Rack unit   RACK-U   →  A03-U24

Copper      FROM-TO-SEQ   →  A03-B01-014

Circuit     PANEL-BREAKER   →  DP-A-17

Rack PDU   RACK-SIDE   →  A03-PDU-A

What gets labeled

  • Both ends of every cable, power and data, with a machine-printed wrap-around or heat-shrink label. Not handwriting, not tape.
  • Every rack, front and rear, at eye height.
  • Every patch panel port.
  • Every breaker, with an accurate schedule at the panel and in your records.
  • Every rack PDU and every outlet group.
  • The TGB, the EPO, the suppression abort station, and every valve and isolation point.
  • Pathways, at intervals and at every penetration.
Label during installation

Retro-labeling never happens. Make it a condition of payment: no certified test results and no labeling means the work is not complete. It is the only leverage you will have.

The documentation set

Minimum handover documentation
DocumentContainsKeep where
As-built floor planRack positions, dimensions, clearances, equipment Printed in room + version-controlled
U-map per rackWhat is in every U, front and rear The single most-used document. Keep it current
Panel schedulesEvery breaker, its load, its rack At the panel and in records
Single-line diagramUtility to rack, as builtPrinted in room
Cable test resultsCertified results for every permanent link Digital, from the installer
Bonding test reportPoint-by-point continuity readingsDigital
Commissioning reportsLoad bank, IST, air balance, door fanDigital
O&M manuals + warrantiesEvery piece of installed plantDigital, indexed
RunbookWhat to do when each alarm fires, who to call Accessible from outside the room
Store it where you can reach it in an outage

Documentation that lives only on a server in the room it documents is not documentation. Keep a current copy off-site or in a service you can reach from a phone, and print the single-line, the floor plan and the runbook contact list for the wall.

M-700

Monitoring & Alarms

Operations

Every protective system in this document assumes somebody finds out. An unmonitored alarm is a decoration.

Sensor placement

Temperature — at the intake, three heights

ASHRAE specifies conditions at the equipment air intake. Mount sensors on the rack front face at bottom, middle and top. The top sensor is the one that matters: recirculation shows there first, and a wall thermostat by the door will never see it. Minimum one instrumented rack in three; every rack above 6 kW.

What to monitor
PointWhereAlarm at
Intake temperatureRack front, 3 heights, ≥ 1 rack in 3 Warning 80 °F · critical 90 °F at intake
Return temperatureAt each cooling unit Also trend ΔT — a falling ΔT means bypass
Humidity / dew point1–2 per room at intake height Dew point above 15 °C
Water / leak Rope at perimeter, under every cooling unit, at drip pans and the low point Any detection — immediate, day or night
Branch circuit currentMetered rack PDU, per phase 80 % of breaker rating
UPS stateSNMP from the UPS On battery · battery fault · bypass · overload · self-test failure
GeneratorController contacts or SNMP Not-in-auto · fail to start · low fuel · run status
Cooling unit statusPer unitUnit fault · condensate high level
Door positionRoom doorHeld open beyond a set time
Smoke / suppressionFrom the fire panelAny alarm or trouble
Differential pressureAcross containment or the floor plenum Where containment or a plenum is used
"Not in auto" is the alarm nobody configures

A generator left in off or manual after maintenance will not start. It is silent, it looks fine, and you discover it during the outage. Alarm on the not-in-auto contact, and treat it as critical.

Alerting that works

1

Two tiers, and mean them

Warning goes to a queue somebody reads during the day. Critical wakes a human. If everything is critical, nothing is, and people start ignoring the channel — which is worse than no monitoring, because you now believe you are covered.

2

Alert out of band

The alerting path must not depend on the room. A cellular gateway or an external monitoring service is the difference between "the room went down and paged us" and "the room went down".

3

Escalate, and test the escalation

Unacknowledged critical alerts escalate to a second and third contact. Test quarterly by firing a real alert — not by reading the configuration.

4

Trend, do not just alarm

Thresholds catch failures. Trends catch degradation: the rack that has crept up 4 °F over six months, the circuit at 71 % that was at 55 % last year, the UPS runtime that has halved. Keep at least twelve months of history.

DCIM or not?

For ten racks, full DCIM is usually overkill and becomes shelfware. Metered PDUs, networked environmental sensors, SNMP from the UPS and cooling, and a decent time-series dashboard will cover almost everything a small room needs. Revisit DCIM at twenty-plus racks, or when capacity planning and change tracking start costing real time.

A DIY stack that covers most of it

Prometheus + Grafana + snmp_exporter + node_exporter on a small server or a pair of Raspberry Pis (one in the electrical zone, one off-site as a replica) covers 90 % of what a small room needs from DCIM at zero license cost. Add blackbox_exporter for reachability probes and Alertmanager for dedup and routing. Store metrics for 12+ months. Pair with a hosted uptime service (Healthchecks.io, Uptime Kuma on a VPS) as the out-of-band verifier — see M-710.

M-710

Out-of-Band Management

Operations · Networking

Every protective system in this document assumes you can reach the equipment when it fails. In-band management works right up until the switch, firewall, VPN or hypervisor you'd log in through is the thing that broke. Out-of-band exists for that day.

The rule

If you cannot reach the equipment when the primary network is dead, you cannot recover it. OOB is not a nice-to-have — it is the difference between a two-hour incident and a four-hour drive to the site.

The three interfaces you need — and one you shouldn't skip

1 · IPMI / BMC / iDRAC / iLO

  • Every modern server ships with a lights-out controller. It runs on standby power, exposes a web UI, virtual media, and full serial-over-LAN, and it works with the host OS off.
  • The vendor names are branding: IPMI (the underlying standard, being replaced by Redfish), iDRAC (Dell), iLO (HPE), XCC (Lenovo), IMM (older Lenovo), Supermicro/ASRock "IPMI".
  • Configure the dedicated management NIC — do not share the host data NIC in "shared" mode unless you truly have no spare port; it defeats the isolation.
  • Redfish is the modern REST API. Prefer it over IPMI-over-LAN for scripts.

2 · Serial console concentrator

  • Switches, firewalls, routers, storage controllers and any UPS worth owning has a serial console that works when the network doesn't. You need a way to reach it that doesn't itself depend on that network.
  • Commercial: Opengear, Digi Passport, Lantronix. Purpose-built, cellular options, call-home support.
  • DIY: a Raspberry Pi with a multi-port USB-serial adapter running conserver or ser2net covers 4–8 devices at a small fraction of the commercial price. Add an LTE hat or a cellular USB stick and it becomes an OOB gateway too.

3 · KVM-over-IP

  • The "I cannot even get into iLO" case: physical KVM for the console. Modern IP-KVM boxes (PiKVM, JetKVM, TinyPilot, or a commercial Raritan/Vertiv/Aten unit) give you BIOS-level video, keyboard and mouse over the network, with virtual media for install media.
  • One shared KVM per row is usually enough; a fixed one per rack is overkill. Cart-mounted works if the aisles are wide enough.

4 · The out-of-band network path

  • The above only helps if the network reaching them is not the network that just failed. Options in order of independence:
  • Dedicated management VLAN on the production switching. Same physical failure domain — protects against configuration errors, not against hardware failure of the switch itself.
  • Dedicated management switch on its own uplink. Different failure domain. This is the minimum for a production room.
  • Cellular OOB gateway (Opengear IM7200, Digi TX54, or DIY on a Pi + LTE). Runs on its own SIM and its own UPS. This is the one that keeps working when the fiber's cut.

The dedicated management network

A single management VLAN (or, better, a physically separate management fabric) collects every BMC/iLO/iDRAC, every switch console interface, every PDU management port, every UPS network card, and every environmental sensor. Sizing is trivial — half a switch handles a ten-rack room. What matters is what you keep off it.

What belongs on the management network
Belongs on managementDoes not belong on management
Server BMC / iDRAC / iLOProduction workload traffic
Switch, router, firewall console (Ethernet mgmt port) User devices, laptops, phones
Serial console concentratorGuest / vendor traffic
Rack PDU network interfaceInternet-facing services
UPS network card, cooling unit SNMP, environmental sensors Anything that isn't infrastructure telemetry or control
KVM-over-IP applianceBackup or replication traffic
OOB monitoring collector, jumphostAnything the person on the network could use to pivot into the room's infrastructure

Security — the mistake this network exists to prevent, not enable

  1. Isolate at Layer 3. No routing between the management network and user or workload networks — full stop. A jumphost with its own credentials is the only way in.
  2. Separate credentials. BMC accounts are not the same accounts as the host OS accounts. Root passwords are unique per device. Never a shared vendor default.
  3. Turn off what you're not using. Most BMCs ship with IPMI-over-LAN enabled, an insecure default web port, and telnet on the serial concentrator. Disable IPMI 1.5, disable telnet, force TLS on Redfish, disable virtual media redirection unless you use it.
  4. Patch the BMCs. They run their own firmware, they've had CVEs, and the room won't remind you. Add a firmware review to your quarterly maintenance.
  5. Log everything to a collector outside the room. Syslog from the switches, audit logs from the BMCs, session recording from the jumphost. The evidence you'll want is the evidence you can still reach when the room is dark.
A minimum-viable OOB stack

For a ten-rack room: a small managed switch (or a VLAN on the production switch) as the management fabric, a Raspberry Pi running conserver with a 4- or 8-port USB-serial adapter for the switches and UPS, an LTE hat or cellular USB stick to that Pi with a data-only SIM, a shared PiKVM or JetKVM on a cart for BIOS-level access, and a jumphost VM on-premises that mirrors its session logs off-site. Total hardware bill around $400–600. The commercial equivalent — Opengear + Vertiv KVM — solves the same problem for $5–15k and adds a support contract.

Test the OOB path the same way you test the utility

Once a quarter, disconnect the production uplink and prove you can still reach every switch console, every BMC and the jumphost through the cellular OOB gateway. Include the credentials exercise: log in as an operator, not as the person who built it. An OOB path that has never been used in anger is a theory. See Cx-800.

Cx-800

Commissioning & Acceptance

Commissioning

Commissioning is where you find out whether you got what you specified. It is the last point at which problems are somebody else's to fix under contract.

The five levels

1

Factory acceptance testing

Witness testing of the UPS and generator at the manufacturer, before shipping. Worth attending for major plant; a failure found here costs nothing.

2

Component verification on delivery

Right model, right rating, right options, undamaged. Check against the submittal before it comes off the truck, while returning it is still easy.

3

Pre-functional checklists

Installed correctly, connected correctly, anchored, bonded, labeled. Signed off system by system before anything is energized.

4

Functional performance testing

Each system does what it should on its own: UPS transfers, generator starts and takes load, cooling holds setpoint, alarms fire.

5

Integrated systems test — the one that counts

Everything together, under load, with real failures induced. This is where you find the damper that does not close, the alarm that goes nowhere and the cooling unit that is not actually on the generator.

The tests to insist on

Acceptance tests and what each proves
TestMethodProves
Load bank test Resistive load bank at 25 / 50 / 75 / 100 % on UPS and generator, held at full load for several hours Real capacity, thermal behavior, and — for a diesel — that it will not wet-stack. An unloaded run proves nothing
Pull the plug Open the utility main with the room at design load The whole chain: UPS transfer, generator start, ATS transfer, cooling restart, alarms. Nothing else substitutes for this test
Cooling redundancy testDisable each unit in turn at full load N+1 is real and the standby actually starts
Air balance / thermal survey Measure intake temperature at every rack, top middle bottom, at design load Every intake inside the envelope. Establishes the baseline you trend against
Thermal imagingIR scan of every termination under load Loose connections before they fail. Repeat annually
Door fan / room integrity Pressurization test per NFPA 2001 The room holds agent for the required 10 minutes
Grounding verificationContinuity to TGB from every rack and tray < 1 Ω, recorded point by point
Cable certificationCalibrated tester, every permanent link The channel meets standard, not just that it links
Alarm verificationTrigger every alarm point individually Each one reaches a human. Test the path, not the config
Test before you have anything to lose

The pull-the-plug test is unnerving and there is always pressure to skip it. Do it before production load arrives, when the consequence of a failure is an afternoon of rework rather than an outage. A room that has never had its utility feed opened is a room whose standby power is a theory.

Turnover

  • Complete documentation set per T-610.
  • All commissioning reports, including the failures and how they were resolved.
  • Training for whoever will operate it, including the UPS bypass procedure and the suppression abort.
  • Warranty start dates recorded, and maintenance contracts in place before the first year lapses.
  • A written maintenance schedule: battery checks, filter changes, generator exercise, IR scans, fire system inspection, access review.
X-900

Worked Example A — 10 Racks

Appendix · Reference Design

The whole method, end to end, on the room most people are actually building. Every number traces back to a formula in this set.

Brief

Racks
10

Two rows of five, back to back.

IT design load
20 kW

2 kW average per rack, measured.

Room
360 ft²

20 ft × 18 ft, 10 ft clear. Interior, slab on grade.

Target
Tier II–III

Concurrently maintainable cooling and UPS.

Step 1 — Layout

Depth: 4'-0" cold + 3'-6" cab + 3'-0" hot + 3'-6" cab + 4'-0" cold = 18'-0"

Width: 6'-0" electrical + 10'-0" row (5 × 2'-0") + 4'-0" end-of-row = 20'-0"

Aisle pitch: cold ℄ to cold ℄ = 14'-0" (7 tiles)

Area per rack: 360 ÷ 10 = 36 ft²

Electrical zone on the west wall with 36 in of NEC 110.26 working space hatched and kept clear. Out-swinging 36 in egress door at the south-east corner. Overhead ladder rack; no raised floor. ▤ A-101

Step 2 — Heat load

IT       20,000 W × 3.412 ......................... 68,240 BTU/hr

UPS     20 kW × (1/0.92 − 1) × 3.412 ............  5,937

Envelope Σ U·A·ΔT .............................  2,306

Outside air 1.08 × 50 × 23 .....................  1,242

Lighting 360 ft² × 1.0 W/ft² × 3.412 ...........  1,228

PDU     1 % × 20 kW × 3.412 .....................    682

People  1 × 300 ................................    300

Total sensible ............................ 79,935 BTU/hr = 6.66 tons

Step 3 — Cooling

Nominal capacity, comfort units at SHR 0.72: 6.66 ÷ 0.72 = 9.25 tons

Room airflow at ΔT 20 °F: 79,935 ÷ (1.08 × 20) = 3,700 CFM

Per rack: 6,824 ÷ (1.08 × 20) = 316 CFM

Selection

Three 5-ton ductless splits with low-ambient kits, N+1. Each gives 3.6 tons sensible; two carry the 6.66-ton load with 0.5 ton to spare, and the third is the standby. Chosen over two 10-ton units for finer staging, better part-load behavior and a cheaper single-unit failure. Lead/lag rotation weekly. Wall-mounted on the north wall, discharging along the cold aisle. Each unit on a different panel. Mechanical panel fed ahead of the UPS but downstream of the ATS.

Step 4 — Power

IT ....................... 20.00 kW    UPS losses ......  1.74 kW

Mechanical ............... 11.00 kW    House ...........  1.50 kW

Facility ................. 34.24 kW   PUE = 1.71

Service current = 34,240 ÷ (1.732 × 208 × 0.9) = 105.5 A → × 1.25 = 132 A

Electrical schedule
ItemSpecificationNote
Service200 A, 208Y/120 V, 3Ø 4W 132 A calculated; 200 A for growth headroom
Transfer200 A ATS, delayed transition Neutral dwell for compressor loads
Generator60 kW / 75 kVA standby 39.24 kW running load + recharge + step-load margin; confirm against compressor starting kVA
UPS2 × 25 kVA / 25 kW, unity PF, N+1 Either carries the full 20 kW, at 80 % of its rating. Check the power factor before you size: a 20 kVA unit at 0.9 PF is 18 kW and will not do it. Wrap-around maintenance bypass on each
Runtime10 min at full load, at end of battery life Generator picks up in 3–5 min
PanelsDP-A and DP-B, 42-space each Separate UPS each. 25 % spare positions at handover
Branch circuits20 × 30 A, 208 V, 1Ø One A + one B per rack. NEMA L6-30R, 4.99 kW usable — headroom to 5 kW/rack
Rack PDUs20 × zero-U metered, 30 A 208 V A and B on opposite rear rails, color-coded
Load per side, normal~1 kW of 4.99 kW = 20 % Doubles to 40 % if a side is lost — comfortable
SPDType 1 at service, Type 2 at DP-A/DP-BCoordinated ratings
Step 5 — Everything else

Grounding

  • TGB, ¼ × 2 in copper busbar on insulated standoffs, west wall.
  • TBB #6 AWG to the TMGB (run under 13 ft).
  • 10 × #6 AWG rack bonding conductors, home-run.
  • Ladder rack bonded both ends, jumpered at every splice.

Fire

  • Air-sampling detection, cross-zoned with ceiling spot detectors.
  • Clean agent sized on 3,600 ft³ room volume, with pressure relief vent calculation.
  • Pre-action double-interlock sprinkler if the building requires coverage.
  • Two clean-agent portable extinguishers at the exit.

Cabling

  • Middle-of-row: network rack at A03.
  • 24 × Cat 6A + 12-strand OM4 from every rack to A03, installed before occupancy.
  • OS2 to the building entrance facility.
  • Tiered overhead: fiber, copper, then power, 12 in separation.

Monitoring

  • Intake sensors at 3 heights on racks A01, A03, A05, B02, B04.
  • Leak rope at the perimeter and under all three cooling units.
  • SNMP from both UPS, all cooling units, generator and metered PDUs.
  • Out-of-band cellular alerting with two-tier escalation.
▤ A-101 · plan ▤ M-302 · cooling plant ▤ E-431 · DP-A schedule ▤ FP-501 · fire & life safety ▤ T-402 · cabling & conduit
Where this lands

Cooling and UPS are both concurrently maintainable — any unit can be removed at full load. Distribution is genuinely A/B from separate panels on separate UPS. The single utility service and single ATS are the remaining single points of failure, which is a deliberate and documented Tier II compromise. Upgrading those to reach a true Tier III topology would roughly double the electrical cost for a small reduction in an already low risk.

X-910

Worked Example B — 20 Racks

Appendix · Reference Design

Four times the load in under twice the floor area. At this density the answers change: containment becomes mandatory, in-row cooling wins, and the service goes to 480 V.

Racks
20

Two rows of ten, back to back.

IT design load
80 kW

4 kW average per rack.

Room
640 ft²

32 ft × 20 ft, 10 ft clear. 125 W/ft².

Target
Tier III

Concurrently maintainable throughout.

Layout and thermal

Depth: 1'-0" service + 4'-0" cold + 3'-6" cab + 4'-0" hot + 3'-6" cab + 4'-0" cold = 20'-0"

Width: 6'-0" electrical + 22'-0" row + 4'-0" end-of-row = 32'-0"

Aisle pitch: 15'-0" — hot aisle widened to 4'-0" for containment door swing and service access

IT 80,000 W × 3.412 ..................... 272,960 BTU/hr

UPS 80 kW × (1/0.94 − 1) × 3.412 .........  17,422

Envelope + infiltration + lighting + PDU + people ..  10,006

Total sensible ..................... 300,388 BTU/hr = 25.0 tons = 88 kW

Airflow: 300,388 ÷ (1.08 × 20) = 13,900 CFM   per rack 632 CFM

Cooling selection

Four in-row CRAH units at 30 kW each, N+1, two per row at the row-third points. Three units carry the 88 kW load; the fourth is the standby. Combined with hot-aisle containment — mandatory at 4 kW per rack with a 4 ft hot aisle. Containment roof panels drop away on fusible link and on suppression release.

In-row wins here over perimeter cooling for three reasons: the air path is meters rather than the length of the room, containment makes the return air genuinely hot which raises coil efficiency, and units can be serviced one at a time without disturbing the row. ▤ A-102

Power — and why the voltage changes

IT 80.0  +  UPS losses 5.1  +  mechanical 30.0  +  house 2.5 = 117.6 kW

PUE = 117.6 ÷ 80.0 = 1.47 — better than example A; scale and containment both help

At 208 V: 117,600 ÷ (1.732 × 208 × 0.9) = 363 A → ×1.25 = 453 A → 600 A service

At 480 V: 117,600 ÷ (1.732 × 480 × 0.9) = 157 A → ×1.25 = 196 A → 200 A service

Take the 480 V service

Same power, 43 % of the current. A 200 A 480 V service and its feeders cost dramatically less in conductor, conduit and gear than a 600 A 208 V equivalent, and voltage drop over the same distance is a third. Run 480 V to the UPS and the mechanical equipment, and step down to 208Y/120 at transformers feeding the row PDUs. The transformer adds heat to the room — count it in the load, or site it outside the room, which is better.

Electrical schedule — 20 racks
ItemSpecificationNote
Service200 A, 480Y/277 V, 3Ø 4W196 A calculated
Generator200 kW standby 137.6 kW running + recharge + step load, derated for site
UPSModular, 5 × 25 kW modules = 125 kW, N+1 Carries 100 kW with any one module out. More space-efficient than two monolithic units at this scale, and modules are hot-swappable
Step-down2 × 75 kVA, 480 → 208Y/120 One per distribution path. Site outside the room if possible
Branch circuits40 × 30 A, 208 V, 3Ø NEMA L21-30R, 8.65 kW usable per side against a 4 kW rack
Rack PDUs40 × zero-U, 3-phase, per-outlet metered Per-phase metering is essential — three-phase capacity depends on balance
ContainmentHot aisle, sliding end doors both ends Drop-away roof panels on fusible link and suppression release
SuppressionClean agent on 6,400 ft³ full room volume Not the contained aisle volume. Pressure relief vent calculated

What changed from example A

10 racks vs. 20 racks
ParameterExample AExample B Why it changed
Density2 kW/cab4 kW/cab Drives everything below
Watts per ft²56125 Above ~100 W/ft², room-level cooling struggles
Aisle pitch14 ft15 ft Containment needs a wider hot aisle
Cooling3 × 5-ton split4 × 30 kW in-row Air path length becomes the constraint
ContainmentOptionalMandatory Cannot hold top-of-rack intake without it
Service voltage208 V480 V Conductor cost crosses over around 75–100 kW
Rack circuits1Ø 30 A3Ø 30 A 4 kW per side needs more than a single-phase 30 A can comfortably give
PUE1.711.47 Fixed overheads amortize; containment raises coil efficiency
ft² per rack3632 Electrical and egress are fixed costs spread over more racks
X-950

Design Checklists

Appendix

Print these. Work through them with the relevant trade at the relevant stage.

Concept & feasibility

  • IT load measured or vendor-calculated — not nameplate
  • Growth allowance stated explicitly and separately from the design load
  • Per-rack density budget agreed and published
  • Site evaluated against the location risk table (A-100)
  • Floor loading verified by a structural engineer, in writing
  • Ceiling height measured to the lowest obstruction, not the deck
  • Equipment delivery path walked with a tape, including the lift
  • Available electrical service capacity confirmed with the utility
  • Generator location, fuel and exhaust route identified
  • Condenser or dry-cooler location identified with the required clearances
  • Availability target chosen and written down (G-020)

Design review

  • Aisle pitch holds the module; cold aisle ≥ 4 ft, hot aisle ≥ 3 ft
  • All rack fronts face cold aisles, both rows, no exceptions
  • NEC 110.26 working space hatched on the plan and free of racks and pathway
  • NEC 110.26(E) dedicated equipment space clear of tray and piping above panels
  • Heat load includes UPS and PDU losses, envelope, lighting and outside air
  • Cooling capacity derated for SHR, and for altitude if applicable
  • Cooling is N+1 and each unit is on a different panel
  • Mechanical panel is downstream of the ATS
  • Generator sized on UPS input + recharge + mechanical + house, with starting kVA checked
  • UPS has a wrap-around maintenance bypass
  • A and B paths separate from panel to cord; no cross-ties
  • Each side sized for 100 % of load, and loaded to ≤ 45 % in normal operation
  • TGB located and TBB sized by run length
  • Suppression agent selected; pressure relief vent calculation is a named deliverable
  • Containment interaction with suppression coordinated between both vendors
  • Walls slab to slab; no windows; no foreign piping through or above
  • Labeling scheme defined before any installation begins
  • Monitoring points and out-of-band alerting path specified

Pre-energization

  • Floor coating applied and cured before equipment arrives
  • Racks anchored per the seismic design category
  • All bonding installed; continuity tested and recorded, < 1 Ω to the TGB
  • Panel schedules complete and accurate at the panel
  • Every blanking panel and grommet fitted before the first thermal survey
  • All rated penetrations fire-stopped to the listed system
  • Cable certified end to end; results handed over as a file
  • Room cleaned; no packaging or combustible storage left in it

Commissioning

  • Load bank test at 25 / 50 / 75 / 100 % on UPS and generator
  • Pull-the-plug test at design load — before production arrives
  • Each cooling unit disabled in turn at full load; N+1 proven
  • Thermal survey: intake temperature at top, middle and bottom of every rack
  • Infrared scan of every termination under load
  • Door fan / room integrity test passed and reported
  • Every alarm point triggered individually and confirmed to reach a human
  • Generator "not in auto" alarm verified
  • UPS maintenance bypass exercised, with the procedure labeled on the rack
  • Full documentation set handed over per T-610
  • Operator training delivered, including bypass and suppression abort

Recurring maintenance

Maintenance schedule
IntervalTask
MonthlyGenerator exercise under load · visual walk-through · leak detection check · review environmental trends
QuarterlyAccess list review · alert escalation test · cooling filter change · UPS battery visual and readings
Semi-annualCooling service · fire alarm and suppression inspection · containment seal check
AnnualGenerator load bank test · infrared scan · UPS maintenance bypass exercise · door fan re-test (per AHJ) · full documentation review · capacity review against trends
3–5 yearsVRLA battery replacement (sooner if run warm) · re-assess density and cooling headroom

The fifteen most common mistakes

What actually goes wrong in small rooms
#MistakeConsequence
1Cooling not on the generator Room reaches shutdown temperature in minutes while the UPS runs happily
2Comfort AC specified at nominal tons with no SHR derate ~28 % short on capacity from day one
3No blanking panels Recirculation; hot spots at the top of every rack
4Design to nameplate power Oversized plant, short-cycling, poor efficiency, wasted capital
5Racks in the NEC 110.26 working space Code violation found at inspection; racks have to move
6A and B fed from the same panel Redundancy that is not
7No pressure relief venting on the clean agent Discharge can structurally damage the room
8Floor loading never verified Discovered after the racks are in place, or not at all
9UPS batteries in the hot aisle Battery life cut to a fraction; fails during the outage it was bought for
10Walls stop at the suspended ceiling No security, no smoke separation
11No maintenance bypass on the UPS Every battery change is a planned outage
12Alerting depends on equipment inside the room The room fails and tells nobody
13Never load-bank tested, never pull-the-plug tested Standby power is a theory until the first real outage disproves it
14Dry chemical extinguisher in the room Discharge destroys more equipment than the fire would have
15Nothing labeled, nothing documented Every future change is archaeology
X-990

Formula & Conversion Reference

Appendix

Every formula in this set, on one sheet.

Thermal

BTU/hr = W × 3.412

tons = BTU/hr ÷ 12,000

Qenvelope = U × A × ΔT

QUPS = load × (1/η − 1)

CFM = Qsens ÷ (1.08 × ΔT)

nominal tons = sensible ÷ SHR

ΔT = Q ÷ (1.08 × CFM)

Electrical

W = VA × PF

A1Ø = W ÷ (V × PF)

A3Ø = W ÷ (√3 × VLL × PF)

kVA3Ø = √3 × VLL × A ÷ 1000

kVA208 V 3Ø = 0.36 × A

OCPD ≥ 1.25 × continuous load

usable ≤ 0.80 × breaker rating

PUE = facility kW ÷ IT kW

Space & structure

pitch = cold + cab + hot + cab

lb/ft² = rack weight ÷ 7 ft²

point load = weight ÷ 4 feet

1 U = 1.75 in = 44.45 mm

42U = 73.5 in of rail

tile = 24 × 24 in = 4 ft²

Rules of thumb

≈ 160 CFM per kW at ΔT 20 °F

≈ 126 CFM per kW at ΔT 25 °F

perf tile 25 % ≈ 400 CFM

perf grate 56 % ≈ 900–1,200 CFM

actual ≈ 40–60 % of nameplate

28–36 ft² per rack

1.0 W/ft² LED lighting

Conversions

Unit conversions
FromToMultiply by
WattsBTU/hr3.412
BTU/hrWatts0.2931
Tons of refrigerationBTU/hr12,000
Tons of refrigerationkW (thermal)3.517
kWTons0.2843
CFMm³/h1.699
CFML/s0.4719
lbkg0.4536
lbf/ft²kPa0.04788
ftm0.3048
inmm25.4
ft²m²0.0929
°F → °C—(°F − 32) × 5/9
ΔT °F → ΔT °C—× 5/9

Key values at a glance

Design constants
ValueFigureSource
Recommended intake temperature64.4–80.6 °F / 18–27 °C ASHRAE TC 9.9
Recommended max dew point15 °CASHRAE TC 9.9
Cold aisle width, minimum4 ft (2 tiles) Aisle pitch module
Hot aisle width, minimum3 ftAisle pitch module
Aisle pitch14 ft (7 tiles)Aisle pitch module
Working space at panels, ≤ 150 V to ground3 ft NEC 110.26
Continuous load derate80 % of OCPDNEC 210.20(A)
Rack door open area≥ 63 %Airflow practice
Clean agent hold time, Class A10 minNFPA 2001
Halocarbon discharge time≤ 10 sNFPA 2001
Inert gas discharge time≤ 60 sNFPA 2001
Tray fill, initial / maximum40 % / 50 % TIA-569 practice
Telecom to unshielded power separation12 in TIA-569 practice
Horizontal copper channel100 mTIA-568
Rack bonding conductor#6 AWGTIA-607-D
Bond continuity to TGB< 1 ΩTest criterion
VRLA life derate½ per 15 °F above 77 °F Battery chemistry
Floor loading, distributed250 lbf/ft² recommended TIA-942

Standards cited in this set

Reference list
DesignationTitle
NFPA 70 (2023)National Electrical Code — Articles 110, 210, 215, 250, 408, 645, 700/701/702
NFPA 72National Fire Alarm and Signaling Code
NFPA 75 (2024)Fire Protection of Information Technology Equipment
NFPA 76Fire Protection of Telecommunications Facilities
NFPA 110Emergency and Standby Power Systems
NFPA 855Installation of Stationary Energy Storage Systems
NFPA 2001Clean Agent Fire Extinguishing Systems
NFPA 10Portable Fire Extinguishers
ASHRAE TC 9.9 (2021)Thermal Guidelines for Data Processing Environments, 5th edition
ASHRAE 90.1 / 90.4Energy Standard for Buildings / for Data Centers
ANSI/TIA-942-C (2024)Telecommunications Infrastructure Standard for Data Centers
ANSI/TIA-568 seriesCommercial Building Telecommunications Cabling Standard
ANSI/TIA-569Telecommunications Pathways and Spaces
ANSI/TIA-606-DAdministration Standard for Telecommunications Infrastructure
ANSI/TIA-607-DGeneric Telecommunications Bonding and Grounding
BICSI 002Data Center Design and Implementation Best Practices
Uptime InstituteTier Standard: Topology / Operational Sustainability
ISO/IEC 22237 · EN 50600Data center facilities and infrastructures (European)
IBC · IFC · ASCE 7Building and fire code; minimum design loads
Final note

This set is a design reference, not a stamped design. Dimensions, ratings and concentrations are starting points drawn from the standards above. Confirm every one against the edition adopted in your jurisdiction, the equipment you actually buy, and the engineer of record who signs the drawings.

X-995

Glossary

Appendix

Every acronym and term of art used in this set, in one place. Grouped by domain so a mechanical engineer can skip the telecom column and vice versa.

General & regulatory

TermStands for / means
AHJAuthority Having Jurisdiction — the local official who adopts, amends and enforces the code. Outranks every guideline in this set
ANSIAmerican National Standards Institute — accredits the bodies that publish TIA, ASHRAE etc.
ASHRAEAmerican Society of Heating, Refrigerating and Air-Conditioning Engineers. TC 9.9 is the mission-critical committee
BICSIBuilding Industry Consulting Service International — publisher of BICSI 002, the practical companion to TIA-942
IBC / IFC / IMCInternational Building / Fire / Mechanical Codes. Adopted as law in most US jurisdictions
NECNational Electrical Code, published as NFPA 70
NFPANational Fire Protection Association — publisher of NEC, NFPA 72, 75, 110, 855, 2001 etc.
NOAELNo Observed Adverse Effect Level — the concentration below which no physiological effect has been observed in humans
TIATelecommunications Industry Association
Uptime Tier I–IVThe Uptime Institute topology classification. Roman numerals. Distinct from TIA-942 Rated 1–4

Space & structure

TermStands for / means
AFFAbove Finished Floor. All illuminance and sensor heights in this set are AFF
Aisle pitchCenterline-to-centerline distance between two cold aisles. 14 ft on seven 24-in tiles is the module
Cold aisle / hot aisleThe alternating aisles a front-to-back-cooled row creates. Supply enters cold aisles, exhaust leaves into hot
ContainmentPhysical enclosure of either the hot or cold aisle to prevent air mixing
EIA-310The 19-inch rack mounting standard. Rack unit dimensions, hole spacing (0.625/0.625/0.500 in)
MDA · HDA · EDA · ZDAMain / Horizontal / Equipment / Zone Distribution Area — TIA-942 topology zones. In a small room they collapse into one or two
PlenumA space (typically above a suspended ceiling or below a raised floor) used as an air return or supply path. Everything in it must be plenum-rated
Reach zoneThe vertical band on the rack a standing technician can work in without stooping or reaching — roughly 44–58 in AFF
U (rack unit)1.75 in / 44.45 mm of rail height. A 42U rack holds 73.5 in of equipment

Mechanical & thermal

TermStands for / means
CFMCubic Feet per Minute — volumetric airflow
CRACComputer Room Air Conditioner — DX-based, refrigerant on the coil
CRAHComputer Room Air Handler — chilled-water on the coil
ΔT (delta-T)Temperature rise across a system. Room design ΔT across the equipment is 18–22 °F
DXDirect Expansion — refrigerant expands directly in the cooling coil. Most splits and CRACs are DX
Dew pointThe temperature at which water condenses out of the air. Governs condensation risk more than relative humidity does
EconomizerFree-cooling mode that uses outside air or water instead of the compressor. Air-side or water-side
EnvelopeThe permissible temperature and humidity range at the equipment intake — ASHRAE classes A1–A4, H1
In-rowCooling units placed in the row of racks, close to the load. Preferred above 6 kW/rack
SHRSensible Heat Ratio — fraction of a unit's rated capacity that goes to lowering temperature rather than removing water. IT load is ≈ 1.00
Ton (of refrigeration)12,000 BTU/hr = 3.517 kW thermal
VESDA / ASDVery Early Smoke Detection Apparatus / Air-Sampling Detection. Draws room air through a pipe network to a laser chamber

Electrical

TermStands for / means
ATSAutomatic Transfer Switch. Moves the load between utility and generator on loss of power
Diversity factorThe ratio of coincident peak demand to the sum of individual peaks. Applied at the room, never at the circuit
EGCEquipment Grounding Conductor — the green wire in every branch circuit. Fault-clearing path, required by NEC 250
EPOEmergency Power Off — the required disconnect when NEC 645 is invoked
kVAKilovolt-Ampere — apparent power. W = kVA × PF
LRALocked Rotor Amps — the inrush current a motor draws at start, typically 4–8× full-load. Binding constraint on small generators
OCPDOvercurrent Protective Device — the breaker or fuse. Sized to 125 % of continuous load
PDUPower Distribution Unit. Rack PDU = zero-U strip on the rear rail; floor PDU = a cabinet with a step-down transformer and panelboards
PFPower Factor. Ratio of real to apparent power. Modern IT runs at 0.95–0.99
PUEPower Usage Effectiveness — facility power divided by IT power. 1.0 is unreachable; small rooms live at 1.5–2.5
Rack ATSA small transfer switch inside a rack, feeding single-corded equipment from either A or B
SPDSurge Protective Device — Type 1 at the service, Type 2 at distribution
THDTotal Harmonic Distortion. Old K-rated transformer sizing responded to it; modern PFC supplies produce much less
VRLA / LiFePO₄Valve-Regulated Lead-Acid (sealed lead battery) / Lithium Iron Phosphate — the two UPS battery chemistries you'll meet
Wet stackingUnburned diesel accumulating in the exhaust of a generator run under-loaded for too long. Why weekly no-load runs are worse than useless

Grounding & bonding

TermStands for / means
BCTBonding Conductor for Telecommunications — TMGB to the main service ground
RBCRack Bonding Conductor — #6 AWG from each rack, home-run to the TGB
TBBTelecommunications Bonding Backbone — continuous copper from TMGB to each TGB. Not spliced
TGBTelecommunications Grounding Busbar — one per telecom space (your server room)
TMGBTelecommunications Main Grounding Busbar — one per building, at the entrance facility

Telecom & cabling

TermStands for / means
Cat 6A / Cat 8Category-rated twisted-pair copper. 6A is the default; 8 is niche short-run 25/40G
DACDirect-Attach Copper — twinax cable with SFP+/QSFP transceivers built in. 1–7 m switch-to-server
EoR / MoR / ToREnd / Middle / Top of Rack — where the access switch lives relative to the row
InnerductA smaller conduit inside a larger one, used to protect fiber from later pulls
OM4 / OM5 / OS2Multi-mode fiber grades (OM4/OM5) and single-mode (OS2). OS2 for anything you don't want to revisit
OSPOutside Plant — cable that enters the building from the street. Triggers NEC listing and bonding requirements
Permanent linkThe fixed cabling from patch panel to work area outlet. Excludes patch cords

Fire & security

TermStands for / means
Cross-zoningTwo independent detection zones must both alarm before agent release. Prevents false discharge
Fire watchContinuous human observation required when a suppression system is out of service. NFPA 25 / 75 govern
FM-200 · Novec 1230 · IG-541Common clean agents: HFC-227ea, FK-5-1-12, and inert (N₂/Ar/CO₂ blend) respectively
GWPGlobal Warming Potential. FM-200 ~3,220; Novec ~1; inert gases zero
Pre-action (sprinkler)Dry-pipe system that admits water only after a detection alarm. Double-interlock also requires a fused head
REXRequest-to-Exit — the sensor or button that releases the door for egress

Operations & management

TermStands for / means
BMCBaseboard Management Controller — the lights-out processor on a server. iDRAC (Dell), iLO (HPE), XCC (Lenovo), IPMI (Supermicro)
DCIMData Center Infrastructure Management — the software category that unifies inventory, capacity, environmental and power monitoring
IPMIIntelligent Platform Management Interface — the older BMC protocol. Being replaced by Redfish
KVM(-over-IP)Keyboard/Video/Mouse switch, over IP for BIOS-level remote access
OOBOut-of-Band — a management network path independent of the production network. See M-710
RedfishThe modern REST API for server management. DMTF standard, replacing IPMI
RunbookWritten procedure for what to do when a specific alarm fires or an outage occurs. Lives outside the room
SNMPSimple Network Management Protocol. Traps for events, polls for metrics. Almost every piece of infrastructure speaks it