We looked into running our own Elastic Stack, and quickly realized that was a job and specialty within itself. We are a small startup and every dollar counts. Wasting precious and expensive sysadmin time on managing things far out of our project scope really isn’t an option
Sematext Logs provides us a flexible, extensible and reliable means of monitoring all of our environments in real time
Sematext is great for monitoring SolrCloud, with out of the box dashboards and easy to setup alerts
Just looking at the default graphs it was clear I can reduce my serverless resource usage on Vercel by 90%, by reducing the allocated memory. Sematext simply turns your logs in actionable data, out of the box. Costs, performance, it's all there
Sematext shows one unified view for all of our Docker log, events, and metrics!
What you get
Find Performance Issues Faster
- Simple agent setup with extremely low overhead and no dependencies
- Monitor all key Apache Spark metrics and get Apache Spark performance monitoring charts out of the box
- Collect logs, key Apache Spark metrics and events to cut troubleshooting time in half
- Set up anomaly detection or threshold-based alerts on any combination of metrics and filters
Get Started in Seconds
- Install the agent in seconds. Check out the Sematext Agent docs for more details.
- Supported across any environment, Linux, Docker, Kubernetes, and more
- Use Discovery to discover and monitor services inside containers
- Select which logs and metrics to collect from the UI
Real-Time Visibility into Your Apache Spark instances
Key metrics include cluster status, nodes, index, shard, search, cache, thread pool, circuit breaker and much more. See JVM and system metrics to optimize Solr by spotting resource bottlenecks, slow garbage collection, inadequate JVM heap settings, and more.
View the Apache Spark integration docs for a detailed list of metrics!
Troubleshooting Made Easy with Enriched Logs
Ship Apache Spark logs to Sematext using any log shipper or library for correlation with performance metrics and faster Apache Spark troubleshooting. Find slow Apache Spark queries, broken queries, queries returning zero hits, node timeouts, replication issues, master node elections, and much more.
Gain Key Insights with Traces
To enable tracing you edit the agent’s configuration file to set tracing to enabled. As simple as that! Trace code execution from any back-end services and databases that interact with Apache Spark.
Notify Your DevOps Team About Critical Issues
- Set up anomaly detection or threshold alerts
- Get alerted on both metrics and logs
- Invite team members. There is no limit on the number of users!
- Share logs and metrics with your team using role-based access control
Benefit from Pre-Built Dashboards
- Benefit from out-of-the-box Apache Spark dashboards with both host-specific metrics and container metrics
- Add or remove components and charts in existing reports to customize dashboards
- Add a new report page with your favorite metrics, charts, components, and filters
- Combine metrics and logs to cut troubleshooting time in half
Compare Any Two Reports in a Single View
With Split Screen you can compare any two reports. Split Screen is available across the whole product and you can open any report with events, logs, or metrics for easy correlation.