Water Heater vs. Boiler: What the Admin Buyer Needs to Know

If you've ever been tasked with sourcing a new heating or hot water system for your office or facility, you know the drill. You start with a search, and suddenly you're faced with a wall of jargon—'indirect,' 'combi,' 'tankless,' 'high-efficiency condensing.' It's enough to make you want to just call the lowest bidder and hope for the best.

I've been there. Over the last five years managing purchasing for a mid-sized company (think 150 people across two locations), I've had to make this exact call twice. Once when our old boiler finally gave up the ghost, and again when we expanded to a new building. Everything I'd read beforehand said the choice was simple: small space = water heater, big building = boiler. In practice, I found the reality was messier, and a lot more dependent on your specific usage patterns.

Here's the breakdown of what I learned, structured as a head-to-head comparison to help you decide which system is the right fit for your situation.

The Core Difference: What's the Job?

Let's strip away the tech specs. At its simplest:

• A water heater is a dedicated tank. It takes in cold water, heats it, and stores it, waiting for someone to turn on a tap. Its primary job is to provide hot water.
• A boiler is a system component. It heats water (or generates steam) that circulates through pipes to radiators, baseboard heaters, or in-floor loops. Its primary job is to heat the building. Hot water for taps is often a secondary function, handled by a separate tank (indirect water heater) or an internal coil.

This seems clear enough, but the confusion comes from modern 'combi' boilers, which combine both space heating and on-demand domestic hot water into one unit. They blur the line completely.

Dimension 1: Upfront Cost vs. Total Cost of Ownership

This is where I nearly made a costly mistake. I was all set to go with a new high-efficiency water heater for our main office. The quote was about $3,500 installed—a significant saving over the $7,800 boiler quote. Easy choice, right? Not so fast.

The water heater only did half the job. We had existing baseboard radiators for heating the office space. A water heater cannot replace a boiler for heating if you have a hydronic (hot water) system. You don't just buy a water heater; you'd also need new HVAC equipment. The 'savings' on the water heater would have been dwarfed by the cost of installing new forced-air furnaces or heat pumps across the whole building (which we priced out at over $15,000).

For a replacement, the decision is simpler:

• Replacing a boiler: Expect to pay $5,000–$12,000 for a standard residential or light commercial boiler (based on quotes I received in late 2024). This is a system replacement.
• Replacing a water heater: Expect to pay $800–$3,000 for a standard 50-80 gallon tank (installed, based on online pricing). This is a point-source appliance replacement.

The real cost isn't the hardware. A boiler-powered hydronic system heats your building more evenly and efficiently than forced air, especially in cold climates. If you already have radiators, ripping them out to save a few thousand now could cost you tens of thousands in the long run. The 'budget' option can be the most expensive if you're ignoring your existing infrastructure.

Dimension 2: Space & Installation Complexity

Our second location was a new build, so we started from scratch. Here, the boilers vs. water heaters truly went head-to-head.

• Water Heater: Takes up about 4–6 square feet of floor space. Installation is relatively straightforward: connect water lines, gas line (or electric), and a vent. No pumps or expansion tanks required in most small commercial setups.
• Boiler (with indirect tank): Takes up more space—the boiler itself is about 3–4 sq ft, plus a 4–5 sq ft indirect water heater. Then you need pumps, expansion tanks, and more complex piping. Installation requires a pro who understands hydronic systems.

The conventional wisdom is 'a boiler is more complex and takes more space.' That's true. But here's the nuance: a boiler system centralizes the mechanical equipment. You lose a bit of floor space in the boiler room, but you gain the ability to run hot water lines to multiple zones (think different wings of the office) more efficiently.

For our new build, we went with a boiler and an indirect tank. Why? Because the building had a basement (making space less of a constraint), and we wanted to provide both heat and hot water to a break room on one side of the building and a larger kitchen on the other. A single water heater would have struggled with the distance and the demand.

Dimension 3: Efficiency at the Point of Use

This is the surprise dimension I mentioned. Everything you read will tell you a modern condensing boiler (95%+ AFUE) is more efficient than a standard water heater (60-70%). That's correct from a fuel-to-heat perspective.

But here's the less discussed reality: a water heater can be more efficient at the point of use for hot water.

A boiler system has 'standby losses.' The boiler fires up to heat the building. At the same time, the indirect water heater—which is basically a heavily insulated tank with a coil in it—absorbs heat from the boiler water to heat the domestic water. Even with good insulation, that coil and the associated piping lose heat into the boiler room. You're essentially running the bigger system to provide small amounts of hot water 24/7.

A dedicated water heater, on the other hand, only fires when you need hot water. Its losses are much lower when the demand is small and infrequent (like an office where the dishwasher runs once a day and no one showers).

In our office, the boiler system probably heats the water to a temperature that's higher than necessary for most hand-washing, and the heat takes a while to travel through the pipes. With a dedicated water heater placed closer to the break room, the hot water arrives faster and at the exact temperature needed, meaning less energy wasted waiting for it to arrive.

So, who wins? For a small office with intermittent hot water demand (like a dental or law office), a water heater can be the more efficient choice for hot water, despite the boiler's higher overall rating. For a facility with continuous hot water need (a gym, a restaurant, a factory with showers), the boiler system's higher capacity and heat recovery rate is more efficient overall.

So, Boiler or Water Heater for Your Facility?

Here's my framework after making both choices in the real world. Ask yourself these three questions:

1. What are you replacing? If you have a hydronic heating system with radiators in place, you're almost certainly buying a boiler. Don't try to solve a problem you don't have.
2. What's the hot water demand? Will multiple people need hot water simultaneously (like a busy lunch hour or showers)? An indirect tank (used with a boiler) or a commercial water heater is needed. A standard 50-gallon tank will be exhausted quickly. If it's just the break room sink and an occasional toilet hand-wash, a standard water heater is fine.
3. What's your tolerance for complexity? Boilers need annual maintenance—pumps, valves, inspections. They're more of a 'system' that can fail in interesting ways. A water heater is more of an 'appliance.' If you don't have a maintenance staff and just want something to work, a water heater is simpler to manage.

In my experience, most small to mid-sized offices end up with a water heater because they're in a building with a forced-air HVAC system, and the hot water need is modest. But if you're in an older building with radiators, a boiler is the right answer—and don't let the higher upfront cost scare you off, because the alternative (ripping out the old system) is far more expensive.

Take it from someone who nearly bought the wrong thing: always check your existing infrastructure first. The cheapest option is almost never the right one if you're trying to retrofit a wrong system into your building.