Spark Monitoring, Anomaly Detection, and Alerting

Spark Monitoring, Anomaly Detection, and Alerting

Already have an account?
Sign in to get started.

Monitor all Master, Worker, Driver, and Executor metrics

  • Out of the box graphs and custom dashboards
  • Filter metrics by server, time, etc.
  • Built-in anomaly detection, threshold, and heartbeat alerts
  • ChatOps integrations: Slack, HipChat, PagerDuty, WebHooks, Nagios, etc.
  • Multi-user RBAC and sharing support

Need On Premises solution?
Get in touch!

The 1st Spark Monitor

The 1st Spark Monitor

Spark has a Master and Workers, Drivers and Executors, along with Spark Streaming. Which of them should you monitor? All of them, of course! SPM captures all Spark metrics and gives you performance monitoring charts out of the box. Setting up anomaly detection or threshold-based alerts on any combination of metrics and filters takes just a minute. Heartbeat alerts, enabled by default, notify you when any of your nodes goes down.

Full Stack Visibility

Spark doesn’t run alone. There are other apps around it. Perhaps you also run Kafka, HBase, or Cassandra? Perhaps Elasticsearch, Solr, or HDFS? SPM monitors them all, so you can have a single place to see your full stack. And not just metrics, but also alerts, anomalies, arbitrary events, and even logs when you ship them to Logsene so you can find out not only WHEN something happened, but also WHAT and WHY.

Full Stack Visibility

In depth knowledge base

Content crafted by our engineers with only one goal:
to help you monitor with ease.

Find the integration you need? Start using Sematext

Simple set up. Easy to use. No credit card needed

Sign Up for free

Stay up to date

Get tips, how-tos, and news about Elastic / ELK Stack, Observability, Solr, and Sematext Cloud news and updates.

Stay up to date