In this blog, we’ll explore how SCB TechX tackled the challenge of monitoring backups in a complex multi-cloud environment using Script Exporter. With workloads spread across multiple AWS accounts and Azure subscriptions, each cloud relied on its own backup service.
To make the story clear, we’ll use the STAR methodology to walk through the problem we faced, the goals we set, the solution we implemented, and the results we achieved.
1. Situation
SCB TechX manages workloads in a multi-cloud environment, which makes it difficult to monitor backups across environments since each cloud has its own backup service. We want a unified centralized solution to monitor and detect alerts across the multi-cloud environment.
2. Task
- Build an automated and flexible solution to monitor backups across multi-cloud environments.
- Display Backup status in Grafana dashboards and integrate alerting with PagerDuty.
3. Action
Developed a centralized monitoring flow where Script Exporter runs Python scripts to call AWS Boto3 and Azure SDK APIs. The raw JSON data is transformed into Prometheus metrics, which are scraped by Alloy/Prometheus and remote write to Grafana Mimir. Grafana dashboards provide unified visibility across AWS and Azure backups, while alerting rules trigger PagerDuty notifications for quick response. The entire solution is deployed on Kubernetes using a Helm chart, with Terraform automating the multi-cloud provisioning and configuration.
4. Result
- Achieved a unified view of backup operations across AWS accounts and Azure subscriptions.
- Improved operational efficiency by eliminating manual checks and consolidating monitoring in Grafana dashboards.
- Ensured consistent, repeatable deployments using Terraform and Helm across multi-cloud environments.
- Increased reliability and visibility of backup processes, reducing response times and simplifying maintenance.
Reference
- https://github.com/ricoberger/script_exporter
Looking for a DevOps solution that automates your workflow and reduces business costs? SCB TechX helps you modernize your delivery pipeline and bring high-quality products to market faster, building a foundation for long-term growth.
For service inquiries, please contact us at https://bit.ly/4etA8Ym
Learn more: https://bit.ly/3H7W9zm
