This chapter covers the core features and capabilities of Databricks Monitoring & Alerting Suite.
A comprehensive, production-ready monitoring and alerting toolkit for Databricks workspaces. This suite provides 8 SQL dashboards, configurable alert definitions, 50+ pre-built system table queries, webhook integrations, report templates, and operational runbooks -- everything you need to achieve full observability over your Databricks environment.
| Dashboard | Description |
|---|---|
| Pipeline Health | Success rates, failure trends, duration tracking across all pipelines |
| Cluster Utilization | CPU, memory, idle time, and cost attribution per cluster |
| Job Failure Analysis | Error categorization, root cause patterns, failure heatmaps |
| Cost Trends | Daily/weekly/monthly DBU spend broken down by team, workspace, SKU |
| User Activity | Active users, notebook execution patterns, query frequency analysis |
| Data Freshness | Table update timestamps vs SLA targets with breach detection |
| Query Performance | SQL warehouse query latency, throughput, and optimization signals |
| Capacity Planning | Growth projections, resource demand forecasting, headroom analysis |
system.billing, system.access, system.compute, and related tables covering billing analysis, access auditing, compute profiling, and operational diagnosticsFollow this guide to get Databricks Monitoring & Alerting Suite up and running in your environment.
system.billing, system.access, system.compute)1. Import Dashboards -- Open each .sql file in dashboards/ and create a new Databricks SQL dashboard with the queries
2. Configure Alerts -- Run alerts/alert_definitions.sql to create alert rules, then configure destinations using the webhook templates in alerts/webhook_templates.json
3. Explore Queries -- Use queries/system_table_library.sql as a reference library; copy individual queries into notebooks or dashboards as needed
4. Schedule Reports -- Adapt templates/monthly_health_report.md to your organization and schedule the underlying queries
5. Adopt Runbooks -- Customize runbooks/common_operations.md with your team's escalation paths and thresholds
Get the full Databricks Monitoring & Alerting Suite and unlock everything.
Get the complete guide with every chapter unlocked, including code samples, diagrams, and best practices.
Access all interactive tools with complete data, all workload profiles, and the full scenario library.
Downloadable source code, configuration files, and working examples from every chapter.
Free updates for life. Every new chapter, tool, and improvement included.