CLOUD COST EMERGENCY BRAKE
Emergency Brake for Runaway Cloud Costs
A runaway process, deployment or API workload can keep spending while nobody is watching. CostNerve is designed to detect the economic emergency first, explain the affected project and only enable provider write controls after explicit opt-in.
What problem does it solve?
- Cross-provider sudden-spend detection
- CRITICAL push alert path
- Emergency Brake OFF by default
- Explicit, reversible cost controls
What to check first
- Pin down the first minute/hour where spend velocity changed; avoid comparing only monthly totals.
- Start with Spend velocity versus the previous hour/day/week and then break the delta down across the your cloud/AI stack dimensions that actually moved.
- Correlate the inflection with deployments, traffic, retries, schedulers, background jobs and abuse/bot events.
- Keep a before/after record, then use the smallest reversible mitigation so you can measure whether it worked.
Metrics and signals that matter
- Spend velocity versus the previous hour/day/week
- Cost by provider, project, service and environment
- Deployment, traffic, retry and job timestamps around the first inflection
- Exact, estimated and unallocated cost separated instead of blended
Likely causes
Deployment or configuration regression
A release can change request fan-out, runtime, memory, model choice, logging volume or cache behavior without obvious user-facing breakage.
Traffic, retries or loops
Legitimate growth, bots, retry storms and recursive/background loops can all multiply a normally cheap unit of work.
Billing dimension changed
For your cloud/AI stack, investigate Spend velocity versus the previous hour/day/week and Cost by provider, project, service and environment before assuming the total moved for a single reason.
How it works
Alert before taking control
Critical alerts, 70/85/100 budget thresholds and sudden-spend detection work with read-only connections. Emergency Brake remains OFF by default.
Make emergency action narrow and reversible
When automatic cost controls are explicitly enabled, the control model is resource-specific, least-privilege, reversible and audit logged rather than a blanket account shutdown.
Worked example with explicit assumptions
Illustrative example, not a provider rate: 12 USD/hour versus a 3 USD/hour baseline means 9 USD/hour of excess spend. If that rate persists for six hours, the additional cost is 54 USD. Recalculate after mitigation; do not treat this scenario as an invoice.
Frequently asked questions
Which your cloud/AI stack signals should I inspect first?
Start with Spend velocity versus the previous hour/day/week, Cost by provider, project, service and environment, Deployment, traffic, retry and job timestamps around the first inflection. Compare the same time window before and after the change so volume and unit-cost effects do not get mixed.
How do I know the incident is contained?
Check request volume, concurrency or the affected usage metric after the change. Then reconcile delayed billing for the same scope and currency. Record the action, owner and rollback condition; a quiet alert alone does not prove recovery.
Should uncertain cost be forced into a project?
No. Keep it unallocated until tags, project IDs, resource IDs or another reliable signal justify attribution. False precision produces worse decisions than visible uncertainty.
What should I do before an emergency cost control?
Capture the affected provider/project, current spend velocity, suspected cause and deployment/traffic context. Use a read-only investigation first; any write action should be explicit, scoped, reversible and audit logged.