KyperX AI  /  Tools  /  Self-hosted LLM cost calculator

Free tool · Size private AI infrastructure

Compare running your own model against paying per token.

Every price on this page is one you enter.

No vendor price list, no GPU price, no electricity price and no per-token rate, because any of those would be wrong within weeks. Enter your own, in a currency you name, and the tool separates the two questions people routinely merge: what it costs a year once the hardware is annualised, and what it costs in cash in the first year.

For
Whoever has to justify owning infrastructure
Time
About 10 minutes
You need
Token volumes, the API prices quoted to you, hardware cost, power and who would operate it
You get
Annual owned cost against annual API cost, a first-year cash figure, a break-even volume and three scenarios

The tool

Enter your own figures.

Use one currency throughout. Every commercial figure is an input; the tool supplies none.

Every price here is one you enter, in the currency you name. The tool converts nothing and carries no vendor price list.

The input controls on this page need JavaScript. Everything else works without it: the worked example below is computed when the page is built, and the method, tables, limits and questions are plain text.

Workload

A code or symbol of your choosing. It is printed beside every money figure and carried into the export. Nothing is converted.

Model calls a month at the volume you are planning for.

Prompt, retrieved context and system instructions together.

Generated tokens per request.

Hosted API prices, as quoted to you

From the supplier's current price list or your contract. Nothing is assumed here.

Output tokens are usually priced higher than input tokens.

Owned hardware

Servers, accelerators, networking and storage as quoted, including installation.

The period you would depreciate it over. This drives the annualised figure, not the cash figure.

Energy

Measured or supplier-quoted electrical draw of the equipment itself, not the facility.

Average draw as a share of the planning load across the year.

Facility input divided by IT load. Use the figure for the site you will actually use.

Delivered price including network and environmental charges, in your currency.

Hosting, support and people

Colocation, or the internal charge for the space if there is one. Zero if the space is already paid for.

Orchestration, monitoring, vendor support and any licensed components.

Full-time equivalent to keep it running: patching, capacity, incidents, upgrades.

Salary plus on-costs for the people who would do that work.

Anything else that only exists because the deployment does: insurance, spares, network uplift.

Sensitivity scenarios

Request volume in the low case, as a percentage of the figure above.

Request volume in the high case. Owned cost barely moves with volume; API cost moves proportionally.

Average load factor in the low case, which is the only owned cost that moves with utilisation.

Average load factor in the high case.

What you enter stays in this browser. Nothing is sent to KyperX, nothing is written to browser storage, and the copy, CSV and print are assembled from what is already on screen. Reloading clears it.

Method and limits

How it works, and what it does not do.

Open what you need. None of it is required to use the tool.

A worked example, computed when this page was built

Round synthetic numbers chosen to make the arithmetic legible. They are not a market survey, a quotation, or anything KyperX has paid or charged.

  • Currency — AUD
  • Requests — 1200000 a month
  • Average input tokens — 2400 per request
  • Average output tokens — 400 per request
  • API input price — 2.5 per million tokens
  • API output price — 10 per million tokens
  • Hardware capital cost — 420000 one-off
  • Useful life — 4 years
  • Total IT draw at planning load — 24 kW
  • Average load factor — 55 %
  • Power usage effectiveness — 1.4 PUE
  • Electricity price — 0.21 per kWh
  • Rack, hosting or space cost — 3200 a month
  • Software and support — 36000 a year
  • Operations effort — 0.4 FTE
  • Loaded annual cost per FTE — 185000 a year
  • Other annual cost — 12000 a year
  • Low scenario volume — 50 % of planned
  • High scenario volume — 200 % of planned
  • Low scenario load factor — 35 %
  • High scenario load factor — 80 %
Annual API cost
AUD 144,000
a year
Annual owned cost
AUD 299,396
a year
First-year cash outlay
AUD 614,396
the full capital cost plus a year of operating cost — a different question
Annual difference
AUD -155,396
a year
Break-even volume
2,494,965
requests a month
Every line of the worked example, with what each one means
FigureValueWhat it is
API cost per requestAUD 0.0100(input tokens × input price + output tokens × output price) ÷ 1,000,000
Annual API costAUD 144,000 a yearat the planned volume
Annualised hardwareAUD 105,000 a yearcapital cost ÷ useful life
Annual energyAUD 33,996 a yearIT kW × load factor × 8,760 × PUE × price
Annual electricity161,885 kWhfacility input, not IT draw alone
HostingAUD 38,400 a yearmonthly × 12
Operations labourAUD 74,000 a yearFTE × loaded annual cost
Annual owned costAUD 299,396 a yearannualised, so the capital cost is spread over its life
First-year cash outlayAUD 614,396the full capital cost plus a year of operating cost — a different question
Annual differenceAUD -155,396 a yearAPI cost less annual owned cost; positive means owned is cheaper on an annualised view
Break-even volume2,494,965 requests a monthwhere annual API cost equals annual owned cost; undefined when the API cost per request is zero
Break-even output tokens6,985,902,187 tokens a monththe same point expressed as total tokens a month at your current input/output mix
Sensitivity: the same owned deployment against three request volumes
ScenarioVolumeLoad factorAnnual API costAnnual owned costDifference
Low50%35%AUD 72,000AUD 287,034AUD -215,034
Base100%55%AUD 144,000AUD 299,396AUD -155,396
High200%80%AUD 288,000AUD 314,848AUD -26,848

Assumptions register

Every figure below is one the reader supplied, not one this page chose. They travel with the result so a reviewer can argue with them.

  • Useful life — 4 years
  • Average load factor — 55 %
  • Power usage effectiveness — 1.4 PUE
  • Operations effort — 0.4 FTE
  • Low scenario volume — 50 % of planned
  • High scenario volume — 200 % of planned
  • Low scenario load factor — 35 %
  • High scenario load factor — 80 %

Information gaps

Nothing in this example is missing or self-contradictory.

How it works, rule by rule

Every figure this tool produces, and how it is produced
FigureHow it is calculated
API cost per request(input tokens × input price + output tokens × output price) ÷ 1,000,000
Annual API cost12 × monthly requests × API cost per request
Annualised hardwarecapital cost ÷ useful life in years
Annual energyIT kW × load factor × 8,760 × PUE × electricity price
Annual owned costannualised hardware + annual energy + monthly hosting × 12 + software and support + operations labour + other annual cost
First-year cash outlayfull capital cost + annual energy + hosting × 12 + software and support + operations labour + other annual cost
Break-even volumeannual owned cost ÷ (12 × API cost per request), defined only where the API cost per request is above zero

Annualised cost and cash outlay are different questions

The annual owned cost spreads the hardware purchase across its useful life and adds the operating cost. That is the figure to compare against an annual API bill, because the API bill is also an annual operating cost.

The first-year cash outlay includes the whole capital purchase. It is usually the figure that decides whether the project happens, and it is a different conversation with a different person. Presenting the annualised figure to someone asking about cash, or the reverse, is the most common way this comparison goes wrong.

Break-even volume is the monthly request count at which the annual API cost equals the annual owned cost, at your current token mix. It exists only where the API cost per request is above zero; where both API prices are zero the comparison has no break-even and the tool says so rather than printing a large number. It is also a genuinely one-sided calculation: below break-even, hosted is cheaper and the owned deployment is idle capital; above it, the owned deployment is cheaper only if it can actually serve the load, which is not a cost question.

Energy is calculated on facility input, not IT draw. IT kilowatts times load factor times 8,760 hours times PUE. Leaving PUE out understates the electricity bill by whatever the site's overhead actually is.

Operations labour is an input because it is real. A self-hosted deployment is an operating commitment: patching, capacity management, incidents, model updates and re-evaluation. A comparison that omits it flatters the owned option, and it is the line most often set to zero on the grounds that somebody's existing time absorbs it.

Every input, and how to use it

Every input this tool takes, with its unit
InputUnitWhat it means
Currency—A code or symbol of your choosing. It is printed beside every money figure and carried into the export. Nothing is converted.
Requestsa monthModel calls a month at the volume you are planning for.
Average input tokensper requestPrompt, retrieved context and system instructions together.
Average output tokensper requestGenerated tokens per request.
API input priceper million tokensFrom the supplier's current price list or your contract. Nothing is assumed here.
API output priceper million tokensOutput tokens are usually priced higher than input tokens.
Hardware capital costone-offServers, accelerators, networking and storage as quoted, including installation.
Useful lifeyearsThe period you would depreciate it over. This drives the annualised figure, not the cash figure.
Total IT draw at planning loadkWMeasured or supplier-quoted electrical draw of the equipment itself, not the facility.
Average load factor%Average draw as a share of the planning load across the year.
Power usage effectivenessPUEFacility input divided by IT load. Use the figure for the site you will actually use.
Electricity priceper kWhDelivered price including network and environmental charges, in your currency.
Rack, hosting or space costa monthColocation, or the internal charge for the space if there is one. Zero if the space is already paid for.
Software and supporta yearOrchestration, monitoring, vendor support and any licensed components.
Operations effortFTEFull-time equivalent to keep it running: patching, capacity, incidents, upgrades.
Loaded annual cost per FTEa yearSalary plus on-costs for the people who would do that work.
Other annual costa yearAnything else that only exists because the deployment does: insurance, spares, network uplift.
Low scenario volume% of plannedRequest volume in the low case, as a percentage of the figure above.
High scenario volume% of plannedRequest volume in the high case. Owned cost barely moves with volume; API cost moves proportionally.
Low scenario load factor%Average load factor in the low case, which is the only owned cost that moves with utilisation.
High scenario load factor%Average load factor in the high case.

The costs most often missing from a self-hosting comparison

  1. Facility overhead. Cooling, distribution losses and everything else the site consumes to keep the equipment running. That is what PUE captures, and omitting it is the single largest energy error.
  2. Operations labour. Someone patches it, watches it, and is woken when it stops. Even a fraction of an FTE at a loaded cost is usually larger than the electricity.
  3. Idle time. Owned hardware costs the same at three per cent utilisation as at ninety. The load factor input is where that shows up, and a peaky workload is the usual argument against owning.
  4. Serving, monitoring and support software. Rarely free at production scale, and rarely in the first version of the spreadsheet.
  5. Refresh, not just depreciation. Useful life decides the annualised figure. What happens at the end of it is a second capital decision.
  6. Evaluation effort. Every model or stack change requires re-evaluating against your own material. The API route does not remove that either; it changes who triggers it and when you find out.
  7. The capability question. A self-hosted open-weight model may not do the task as well as the hosted model you are comparing against. This tool compares cost, not capability, and a cheaper system that does not work is not cheaper.

What this does not do

  1. It does not establish that the hardware can serve the load. Cost and throughput are separate questions, and a cost case built on hardware that cannot meet peak demand is worthless. That is the capacity planner, and it should be run first.
  2. It carries no prices. No GPU price, no electricity tariff, no per-token rate. Everything commercial is yours, and the tool has no opinion about whether your figures are plausible.
  3. It compares cost, not capability or quality. Two options with the same annual cost may not do the same job.
  4. It is a single-period model. Constant volume, constant prices, straight-line annualisation. No discounting, no cost of capital, no tax effect, no ramp, no price escalation.
  5. The scenarios are yours. The low and high cases apply the percentages you enter; they are not a forecast and not a probability.
  6. It ignores the non-cost reasons for either option. Residency, retention, model control and exit frequently decide this before cost does — see the deployment path finder.
General information

This page is general information and a starting point for your own analysis. It is not financial, accounting, tax, investment or engineering advice, and it does not take account of your organisation's circumstances. Every figure it produces is arithmetic on values you entered; none is a quotation, a forecast, a benchmark, or a cost KyperX has incurred or charged. Electrical and cooling implications of any owned deployment require qualified engineering review.

Terms used here

  • Annualised cost — capital cost divided by useful life, plus operating cost. The figure comparable with an annual API bill.
  • First-year cash outlay — the whole capital purchase plus a year of operating cost. A different question, usually asked by a different person.
  • PUE — power usage effectiveness: facility input power divided by IT load. A PUE of 1.4 means the site draws 1.4 kW for every 1 kW the equipment uses.
  • Load factor — average draw as a share of the planning load across the year. The main lever on energy cost, and on whether owning makes sense.
  • Break-even volume — the monthly request count at which annual API cost equals annual owned cost, at your current token mix.
  • Token — the unit models are priced in. Output tokens usually cost several times input tokens, which is why the two prices are separate inputs.

Common questions

Is self-hosting an LLM cheaper than using an API?

It depends almost entirely on utilisation. Owned hardware costs the same whether it is busy or idle, so there is a monthly volume above which owning is cheaper and below which it is not. This tool computes that break-even from your own figures. Two things decide it more than anything else: the load factor you can genuinely sustain, and whether operations labour is counted honestly.

Why does the tool not include GPU or token prices?

Because they change faster than a web page does, and a stale price presented as current is worse than no price at all. Every commercial figure here is an input, which also means the result is defensible: it is arithmetic on numbers you can source and cite.

What is the difference between the annualised cost and the first-year cash figure?

The annualised figure spreads the hardware purchase over its useful life, so it can be compared with an annual API bill. The first-year cash figure includes the whole purchase. Both are correct answers to different questions, and confusing them is the most common error in this comparison.

How do I calculate the electricity cost of an AI server?

Multiply the IT draw in kilowatts by the average load factor, by 8,760 hours, by the site's PUE, by your delivered electricity price. The PUE term is what makes it a facility figure rather than an equipment figure, and leaving it out understates the bill by the whole of the site's overhead.

Why is there a break-even figure sometimes and not others?

Break-even only exists where the API cost per request is above zero. If both token prices are zero there is nothing to break even against, so the tool shows no figure rather than a meaningless one.

Does a lower cost mean self-hosting is the right answer?

No. Cost is one input. Whether the hardware can serve your peak load is a separate calculation, whether an open-weight model does the task as well is a separate evaluation, and residency, retention, model control and exit requirements frequently decide the question before cost does.

Are my figures sent anywhere?

No. Everything is calculated in your browser, nothing is written to browser storage, and the CSV and print outputs are built from what is already rendered on the page.