The Surprising Cost of On-Call
In this report, we surveyed more than 300 on-call practitioners, managers and executives running businesses that ranged from managing fewer than 20 nodes to more than 10,000. A lot can be learned about the industry simply by looking at a theoretical “average company”. This data uncovers a number of fascinating challenges and opportunities for the industry.
Key Findings:
- On average, 8.7 major incidents occur each year, with 62% escalated to the C-suite
- 55% of incidents are escalated to second-line responders
- The average time to resolve escalated incidents is 10.7 hours
- 48% of incidents are straightforward and repetitive
- Human error caused major incidents 5x more frequently than bugs in automation
- The average cost of on-call operations is $2,500,000 per year
About Dimensional Research
Dimensional Research® provides practical market research to help technology companies make their customers more successful. Our researchers are experts in the people, processes, and technology of corporate IT. We partner with our clients to deliver actionable information that reduces risks, increases customer satisfaction, and grows the business. For more information, visit dimensionalresearch.com.
About Shoreline
Shoreline is helping software engineers and site reliability engineers take the toil out of on-call. We make it easy to debug new issues in the moment and then automate them away forever. Shoreline runs across clouds, VMs, and containers and lets you manage your fleet as if it were a single box. Shoreline is working with large and hyper-growth companies like Dataiku, Domino Data Lab, TigerGraph, and Incorta.
Shoreline gives users a path to automation with a CLI for debugging and immediate issue resolution. Shoreline allows users to capture a debug and repair session in a Jupyter-style notebook built for on-call. Then, share notebooks with your entire team to safely fix issues using a list of pre-approved repair actions. Finally, when you are confident that you have precisely matched the repair action to the alarm, you can automate away common issues permanently.
Shoreline provides many pre-built automations, called Op Packs, that any customer can use. Shoreline is offering the JVM Op Pack for free so that users can eliminate JVM memory issues permanently.
