When a water heater fails, most homeowners want to replace it fast and move on. But if you are going to spend $800 to $4,000 on a new unit, it is worth taking 10 minutes to understand whether a tank or tankless water heater is the better fit for your home.
Both technologies work well. Both have real advantages. And both have situations where they are the wrong choice. This breakdown covers what you actually need to know to make the right call for a Bay Area home.
How Each System Works
A traditional tank water heater stores 40 to 75 gallons of pre-heated water in an insulated tank. The burner or heating element runs periodically throughout the day to keep that water at the set temperature, whether you are using hot water or not. When you turn on the tap, hot water flows from the tank.
A tankless water heater has no storage tank. Cold water flows through the unit only when a hot water tap is open, and a high-powered burner heats the water on demand as it passes through. When the tap closes, the burner shuts off completely. There is no standby heat loss because there is no stored water to lose heat.
Upfront Cost: Tank Wins by a Wide Margin
A 40 to 50-gallon gas tank water heater installed in a San Jose or Sunnyvale home runs $800 to $1,400 depending on the brand and any code upgrades required. The unit itself is $400 to $700, and installation typically takes two to three hours.
A whole-home gas tankless water heater installed in the same home runs $2,000 to $4,000. The unit costs $700 to $1,500, but installation is more involved. Most Bay Area homes need gas line upsizing (from 1/2-inch to 3/4-inch), new venting (tankless units require sealed direct-vent exhaust), and sometimes electrical work for the unit's electronic controls. These upgrades are what drive the installed cost up.
If your home already has a 3/4-inch gas line and accessible exterior venting, the installation cost is lower. A plumber can assess your home's readiness before you commit to a tankless unit.
Operating Cost: Tankless Wins Over Time
Tank water heaters lose heat through the tank walls and flue 24 hours a day. This standby heat loss accounts for 15 to 20 percent of a typical household's water heating energy use. In the Bay Area, where PG&E gas rates are among the highest in the country, that waste adds up.
Tankless water heaters eliminate standby loss entirely. The U.S. Department of Energy estimates that tankless units are 24 to 34 percent more efficient than tank heaters for homes that use 41 gallons or less of hot water per day, and 8 to 14 percent more efficient for homes using more.
For a typical South Bay family spending $400 to $600 per year on water heating, switching to tankless saves $80 to $200 per year. Over a 20-year lifespan, that is $1,600 to $4,000 in savings, which closes most of the gap on the higher upfront cost.
Lifespan and Long-Term Value
Tank water heaters last 8 to 12 years with basic maintenance. In South Bay homes with hard water (which is common throughout Santa Clara County), scale buildup can shorten that lifespan to 7 to 9 years without annual flushing and anode rod replacement.
Tankless water heaters last 20 years or more. The heat exchanger (the main wear component) is replaceable, and most quality brands offer 12 to 15-year heat exchanger warranties. Over a 20-year period, you would likely replace a tank unit two or three times but replace a tankless unit zero times.
When you factor in replacement cycles, the total cost of ownership over 20 years often favors tankless despite the higher upfront price, particularly if you stay in your home long-term.
Hot Water Supply: It Depends on How You Use It
This is the most misunderstood part of the comparison. A properly sized tankless unit provides unlimited hot water because it heats on demand. You cannot run out. But it has a maximum flow rate (measured in gallons per minute), and if you exceed that rate by running two showers and the dishwasher simultaneously, the water temperature can drop.
For most Bay Area households, a whole-home tankless unit rated at 7 to 10 GPM handles simultaneous demand comfortably. A plumber can calculate your peak demand load based on the number of bathrooms, fixtures, and typical usage patterns in your home.
Tank water heaters have the opposite profile. They provide a large reserve of hot water (40 to 75 gallons) but can run low during high-demand periods, like a morning rush with multiple showers. Once the tank is depleted, you wait 30 to 45 minutes for recovery.
Which Is Better for Bay Area Homes Specifically?
Bay Area conditions favor tankless for several reasons. PG&E gas rates make operating efficiency worth more here than in lower-cost energy markets. The mild climate means no risk of freezing (a concern for outdoor tankless installations in cold climates). And high home values mean the efficiency and longevity of a tankless unit add measurable resale value.
Older homes in San Jose, Santa Clara, and Campbell that were built in the 1950s through 1970s often have undersized gas lines (1/2-inch) that require upsizing to support a tankless unit. This adds $300 to $800 to the install cost but is a worthwhile upgrade that improves appliance performance throughout the home.
For rental properties or homes you plan to sell within 5 years, a tank replacement is the more practical choice. Lower upfront cost, faster installation, and a buyer who will make their own decision about appliances.
The Bottom Line: Which Should You Choose?
Choose tankless if you plan to stay in your home for 8 or more years, have two or more bathrooms, pay attention to energy costs, and want the reliability of a system that lasts 20-plus years. The higher upfront cost is a real investment, not just a premium.
Choose a tank unit if you need a fast, cost-effective replacement, are on a tight budget, or are replacing a heater in a rental or short-term property. A quality tank unit from a name brand installed by a licensed plumber will give you 10 to 12 years of reliable service.
At Arcune Plumbing, we install both. We will assess your home, walk you through the numbers, and recommend what makes sense for your situation, not what costs more. Call us at (650) 787-7061 for a free water heater estimate. We serve San Jose, Santa Clara, Sunnyvale, Mountain View, Cupertino, Campbell, Los Altos, Palo Alto, Milpitas, and Portola Valley.