We are thrilled to announce the availability of the containerd monitoring in Sematext Cloud. Containerd is a minimalist container runtime focused on simplicity and portability.
Go grab the latest Sematext Agent container image to start monitoring your containerd workloads. If you are using containerd and not docker there is nothing special you need to do or configure.
You now have even more alert notification options to choose from!
Configuring notification hooks is super simple. For example, here’s how you configure Sematext to send alert notifications to Telegram:
We have improved the SSL/TLS Certificate monitoring capabilities of Sematext Synthetics. Now you can:
- Monitor the complete certificate chain of your API or website
- Get notified 30, 14, 7, and 3 days before the expiry of any certificate in the chain
- Get notified on certificate changes, with a detailed change report comparing old and new certificates
- View certificate details in the SSL Certificates report
All these features are available for both the HTTP and Browser monitor. For more details, refer to the SSL Certificate Monitoring section in our documentation.
We had MySQL monitoring for many years, and we’re proud to release our PostgreSQL monitoring integration as well. Agent setup (EU) is a simple matter of copy-pasting instructions, as the PostgreSQL connector is included in the agent.
Once metrics start flowing, you can explore them in our UI. You’ll get everything from high-level information about connections and rows, to lower-level stats about buffers and the write-ahead log. Below is a screenshot of the Overview report:
IP address-based geocoding for logs is now available in Sematext Cloud!
You can now get enriched logs in Sematext Cloud with geographical data. By including an IP address in your log events you can get location data such as the continent and country.
It’s all done automatically, without the need for processing the data in the log shipper. The only thing you need to do is provide a log event with the IP address or latitude and longitude or use our open-source Logagent to do the job for you.
Use your data to build rich dashboards that include GeoMap visualization based on the reverse geocoding of your logs.
With our new Linux Journald Integration, you can look deep into your Linux systems easier than ever:
The overview dashboard listed above gives you a general breakdown of your logs: by host, by severity, by Systemd unit, and so on. If you want to dig deeper into a specific topic, you can select one of the other dashboards (and, of course, you can create your own). For example, the Auth dashboard shows more security-related information, such as the latest sudo commands:
Other built-in dashboards include:
- Kernel: Logs filtered by the facility 0 (kernel). Here you will find all your startup logs, information about crashes, all that you typically see via
- SSH: Logs generated by the SSH daemon.
- Services: Logs from systemd saying starting/started/stopping/stopped. Look here for unexpected service restarts, for example.
- Startup&Shutdown: Logs from the system-shutdown service, as well as the kernel message telling you the Linux version on startup. Look here for reboots.
- Audit: Logs from the auditd service, with a syslog tag of audit and kernel messages including
- Cron: Logs sent to the cron facility (9). For example, you shell see here if
- YUM/Snap: Logs labeled with either
snapdsyslog tag. Look here for more info on package management.
- Mail: Logs sent to the mail facility (2). You can check on your postfix here.
- DNS: Messages from the systemd-resolved service. Look here if you suspect DNS resolution issues.
When you use group by or you configure multiple data series, the component automatically calculates optimal grid layout to fill the space. The font will also automatically resize for optimal user experience.
Feel free to use any unit that is required. Any text can be used in the unit picker. Values like 1000 will be rendered as 1k and values like 1000000 will be rendered as 1M.
Stay tuned for more updates! We’re developing new types of dashboard components for Logs and Metrics in Chart Builder.
Log archiving to AWS S3, which has been available in Sematext since May 2017, has now been extended to support all S3-compatible services and solutions. This includes:
- Microsoft Azure Storage
- Google Cloud Storage
- IBM Cloud Object Storage
- DigitalOcean Spaces
To improve your website or webapp performance you first need to know which metrics are essential. Web Vitals is an initiative by Google to provide unified guidance for quality signals that are essential to delivering a great user experience on the web.
The Core Web Vitals metrics: Largest Contentful Paint, First Input Delay, and Cumulative Layout Shift are now available in Experience under the Web Vitals screen. These metrics, as all others in Experience are measured in the field, based on data from real users.
If you are looking for Web Vitals as measured in a controlled lab environment, you can find these metrics in Synthetics under the Web Vitals screen for each of your Browser monitors. This is a good option for testing features that are not yet released to real users.
Element Timing lets you track how fast, or slow, certain elements render on your website. You can track both image and text elements.
For example, you can use this to track the render time of the hero image in your blog posts, or the actual time it takes for the user to see the first paragraph of text.
In some cases these metrics are a better indicator of the real time your users will wait before reading an article or seeing the product pricing page than other metrics such as page load time, first paint time, etc.
Experience will now collect Element Timing information and display it so all you need to do is mark which elements on a page you want to track. You can read the docs on how to do that.
We’re excited to introduce logs in Chart Builder and hope you’ll enjoy using it as much as we’ve enjoyed developing it!
This gives you new possibilities to draw charts using data from Sematext Logs. We’ve made Logs charting more powerful and easier to use. You can select counts or any numeric fields to chart data. You can also use mathematical operations and functions to apply transformations. As always you can filter, group, and roll up metrics by various criteria, as well as style them to your heart’s content.
With variables, you can now dynamically filter and group charts by tags. This makes it even easier to drill down to issues when troubleshooting!
How do you start using Chart Builder for Logs? Two ways:
1. By editing any chart in your Logs Apps 2. By adding a new component to any dashboard or any report, as shown below
Charts you create with Chart Builder will be added to your dashboards and reports as dashboard components.
Stay tuned for more updates! We’re currently developing new types of components for Logs and Metrics in Chart Builder.
With the new mobile application logs integration, you get out of the box insights into what your mobile apps are doing. By using the open-source iOS or Android mobile app SDKs you can collect your mobile apps’ logs and use them for troubleshooting, analytics, and more.
This integration includes a number of out of the box dashboards. There is a dashboard specifically for iOS and another one for Android. There is a dashboard for errors across both Android and iOS with several reports to quickly let you get the sense of error patterns, trends, and numbers. The overview report, which you can see above, is designed to be easily scannable and digestible and give you a birds-eye view of the health of your mobile applications. All data can be filtered and grouped by a number of tags, so you can easily narrow things down to a particular device type, version, geographical region, and more. Note that in Sematext you can create multiple Apps, so if you have more than one mobile app you could ship all their logs to a single App or multiple Apps in Sematext. It’s up to you how you like to see and analyze your data!
Once you have your mobile app logs in Sematext you can create alerts on and be notified about unexpected errors and other types of problematic conditions that could otherwise be overlooked and lead to higher customer churn.
The Geo dashboard shows you where on the planet your mobile users are located. The location data is collected automatically if you enable that via Sematext mobile app SDKs and if users have their location services turned on, of course. The SDKs send latitude and longitude data and Sematext does the rest to show you users by country or continent…
Have you ever wished you could monitor your software stacks with zero configuration changes and no service disruptions?
With Discovery, we automate the discovery and monitoring of your services regardless of their runtime target. It works across bare metal and VM environments, Docker containers, including Docker Swarm, and Kubernetes workloads.
We give you a simple way to monitor services with the click of a single button. Even in dynamic environments and with auto-scaling. Our monitoring rules ensure replicas are automatically monitored when you scale them up. Monitoring also stops as soon as those replicas are removed as a side effect of scaling down.To see what we’ve discovered for you, make sure you have a recent Sematext Agent (or Sematext Europe) and head over to Discovery in Sematext (or Sematext Europe) or learn about Discovery in the docs.
With our new Vercel Logs Integration you get insight into your whole Vercel account. View logs from all your projects, serverless functions, static and Jamstack websites, including build logs and errors!
We wanted to make your life easier by giving you out-of-the-box dashboards that show your build, static, and function logs for a complete overview of your Vercel deployments, projects, and apps. Now you can analyze all data about your Vercel projects and apps in one place.
The cherry on top is that you can set alerts for errors, timeouts, and cold starts, keeping a close eye on your serverless functions. Even better, you can search for specific logs with a full-text search and filter logs based on sources, status codes, errors, and much more!
Vercel enables you to host Jamstack websites and web services that deploy instantly, scale automatically, and require no supervision, with no configuration. Sematext enables you to make sure your Jamstack websites and web services are operating at peak performance.
We are happy to announce the release of Sematext Synthetics. With Synthetics, you can monitor availability (uptime) of APIs and websites. You can also monitor your website performance and user journeys.
Sematext Synthetics monitors your APIs/websites 24×7 from multiple locations around the globe and alerts you when they fail or perform poorly. Sematext Synthetics also provides detailed reports on their availability and performance.
- Monitor the availability of your APIs and track their performance
- Monitor SSL certificate expiration time
- Monitor your websites and track various web performance metrics like page load time, paint metrics, etc.
- Monitor individual resource performance in a website by domain, type and response code and identify the slowest resources
- Monitor third-party resources performance
- Investigate slow pages & identify bottlenecks using a waterfall chart
- Script user journeys with custom assertions based on contents of the webpage
- Collect custom metrics from your sites and track them
- Benchmark against competitors
- Create custom dashboards and alerts based on Synthetic performance metrics
- Debug downtimes with end-to-end visibility of your application performance
- Get alerted when things fail via multiple alert channels like emails, Slack, Pager Duty, WebHooks, etc.
Check out this short video for more info.
Read more about Sematext Synthetics, here.
When we first released Heartbeat Alerts years ago, we made it possible to get alerted when a monitored service running on a host stopped sending metrics to Sematext. This works well in the static world of virtual machines and bare-metal servers. However, it isn’t suitable for the dynamic world of containers.
We have now added the ability to create Heartbeat Alerts based on any combination of tags. Meaning, Heartbeat Alerts can be tied to specific services regardless of where they are running. You can specify tags to include or exclude, as well as tags to group by, then create Heartbeat Alerts for services matching your criteria. This way, even if a containerized service is moved from one host to another, it will not trigger false alerts.
Using these tags you can do things like:
- Filtering by and grouping by container.image.name to get alerted when all containers with the specified image name are gone.
- Grouping by
container.idto get alerted when that particular container dies. Yes, this could lead to a lot of alert noise, so use this sparingly and wisely.
- Grouping by
container.image.nameto get alerted when a host stops running all containers with some image name (container may have moved to another host)
We have also improved the Heartbeat Alerts preview, which now shows all “heartbeats” – one for each combination of selected tags – in a tooltip when you hover, as shown in the screenshot below.
Read more about creating Heartbeat alerts here.
Store all data about triggered GitHub Events in one place. When an event is triggered, GitHub sends an HTTP POST payload to Sematext.
Gain insight into the entire GitHub workflow in your Organization, including your Organization’s team pulse, patterns, metrics, development velocity, progress, trends, helping you to spot opportunities for improvement in your team’s daily workflow.
Keep your team happy by keeping them productive and fulfilled.
The GitHub Events we support are:
- Commit comments
- Branch or tag creation
- Branch or tag deletion
- Issue comments
- Pull requests
- Pull request reviews
- Pull request review comments
The path to increasing developer happiness and productivity starts here!
Long tasks are tasks that block the main thread for 50 milliseconds or more.
Long tasks can cause issues such as:
- Clunky animations and scrolling affecting user experience
- High input latency
- A long delay when triggering event handlers
- A long delay between your application’s first-time-to-paint and when it becomes interactive
We now display Long Tasks information in Experience. Read more about Long Tasks in Experience here.
With the growth in popularity of ARM-based processors, we’ve added support for all ARM v8 architectures to our Sematext Agent and Logagent. This includes all ARM-based EC2 instances – both Graviton and Graviton 2, as well as embedded devices, Raspberry Pi, etc.
Our agents can run natively, but also as Docker containers, on ARM-based machines. You’ll get the same experience with collecting metrics and logs as with our current agents.
With our Infrastructure dashboards that contain metrics about servers, containers, processes, and much more, you can monitor your ARM instances alongside your existing machines.
When we first released Experience, we also made it possible to create alerts for different Apdex scores. That worked well enough but now we have improved alerts support in Experience and added additional types of alerts that you can create for your Experience Apps.
This gives you additional flexibility in deciding what is important for your website or webapp.
In addition to Apdex scores, you can now create alerts for:
- First contentful paint (FCP) time
- First paint (FP) time
- HTTP requests count
- HTTP requests load time
- Long tasks count
- Long tasks duration
- Page load backend load time
- Page load frontend load time
- Page load time
- HTTP resource load count
- HTTP resource load time
- HTTP resource transfer size
- User sessions count
- Users count
We have also improved the interface for creating alerts so you can see a preview of the alert.
Learn more about creating Experience alerts.
Kubernetes audit logs are detailed descriptions of each call made to the Kubernetes API Server. They provide a chronological sequence of activities that lead to the state of the system at a specific moment.
Gain insight into Authentication and Authorization requests hitting your Kubernetes API server, alongside errors and timeouts that help you pinpoint users, hosts and IP addresses that should not be accessing your resources.
Track error codes, verbs, and resources to pinpoint what is getting accessed with what
As you can see, Kubernetes audit logs are extremely useful for security and compliance purposes, telling you exactly who did what, when, and how.
The Heatmap is a two-dimensional representation of data, where values are represented using color saturation. The vertical axis shows weekdays, while the horizontal axis represents the hours in a day.
With our latest release of a brand new Alerts Overview page, you gave us invaluable feedback about the Heatmap chart. With Heatmap you can visually represent historical data to gain actionable insight into how to improve performance.
You can create Heatmap components in two places in Sematext Cloud:
Yes, it’s April 1st. No, we are not joking! We’ve been working hard to make our Alerts even more awesome! This is what we’ve come up with. A brand new Alert Landing Page. From now on when you receive an alert notification it takes you to a new page dedicated to giving you actionable insight into the issue that happened.
The Alert Landing Page contains all necessary details about the cause of a problem, when it happened, what broke, and any related information about other alerts that happened around the same time, as well as Alert Rule details and related charts.
We also improved the way you navigate through Alert Rules and Alert Notifications. We’ve introduced an Alert Page that contains a stream of Alert Events belonging to an Alert Rule and a heatmap that helps you find what point had the highest density of Alert Events.
Lastly, we also have a new Alert Rules table that contains links to both Alert Rule details and info about the most recent Alert Events belonging to an Alert Rule.
Read more in our docs about how to configure Alerts.
We have updated our Kubernetes logs integrations! You can now ship a wide variety of Kubernetes logs to Sematext by configuring our Logagent. We now also support the Containerd and CRI-O container runtimes as well as Docker, which is currently the most popular runtime.
After creating a Logs App, choose a Kubernetes integration in the Containers sections and follow the instructions to get started.
The instructions allow you to choose which setup you’re using. We support everything from Helm 2 and Helm 3 to Kubectl, Docker Stack, Swarm and Compose.
If you’re familiar with our Logagent, this is all possible because we’ve developed new Kubernetes filters.
Read more in our docs about how to configure log shipping.
We have a new Kubernetes Audit logs integration! You can now ship Kubernetes Audit logs directly to Sematext, without any overhead, by configuring either a Dynamic Backend or Log Backend. You don’t need to install any agents!
After creating a Logs App, choose the Kubernetes Audit integration and follow the instructions to get started.
If you are already using Logagent, we’ve developed a new Kubernetes Audit plugin there as well. Configuring it is as simple as always.
Read more in our docs about how to configure log shipping.
Do you know which images your containers are based on? Do you know how many different versions of each image you have in production? Does your container image digest match the one in the registry?
These are all important questions you need answers to. Guess what? We’re giving you the answers today!
You can find the Container Images report in the Inventory section of the Infrastructure menu.
For each container image you can see its version, the host where it’s downloaded, which registry it came from, the digest, time of creation, and size. You can also group and filter by relevant tags.
We have a new Journald logs integration! You can now ship Journald logs directly to Sematext, without any overhead, by configuring a single URL. You don’t need to install any agents!
After creating a Logs App, choose the Journald integration and follow the instructions to get started.
If you are already using Logagent, we’ve developed a new Journald plugin there as well. Configuring it is as simple as always.
Read more in our docs about how to configure log shipping.
We’ve been hard at work to bring you a new Process Overview report to our Infrastructure Process Monitoring. First update your instance of Sematext Agent, or run the latest version of the container if you’re using Docker or Kubernetes.
You’ll get insight into crucial process metrics in your infrastructure, giving you an easy way to aggregate, group and filter process-related metrics. Head over to our docs to set it up if you haven’t already.
Want to see CPU usage per PID? Check! Want to see the memory usage for each type of process you have? We have it!
This is a helpful feature if you have several different runtimes, such as Python, Node.js, or Java running across your infrastructure. You can quickly group the processes by their name and then do further aggregations and filtering to visualize data.
You can also group by the process type, which can be crucial in runtimes like Node.js where you have master and child processes.
The latest release of the Sematext Agent cuts down the CPU and memory footprint by almost a half! If you haven’t updated your Sematext Agent instances in a while, now’s the time to do it.
We’ve completely reworked the event pipeline for intercommunication within the agent. It’s now replaced with an even more lightweight version. This, alongside a significant number of low-level tweaks, cut the already tiny CPU usage by a third, while cutting the memory usage in half!
Meanwhile, we took the liberty to add even more data collection features for you, such as even more detailed process metrics. But, you’ll have to wait and see what we have in store for you there. You’ll have access to it in Sematext very soon.
Now you want to update Sematext Agent, don’t you? It’s simple, check it out.
We’re excited to give you the new Chart Builder and hope you’ll enjoy using it as much as we’ve enjoyed developing it!
Besides its complete visual overhaul, we’ve made it more powerful and easier to use. You can select one or more metrics data series to chart and use mathematical operations and functions to apply transformations to them. You can also filter, group, and roll up metrics by various criteria, as well as style them to your heart’s content. If you are a Sematext power user you might like the new support for variables, which are used to dynamically filter and group charts by tags.
How do you start using Chart Builder? Two ways:1. By editing any chart in your Monitoring Apps 2. By adding a new component to any dashboard or any report, as shown below
Charts you create with Chart Builder will be added to your dashboards and reports as dashboard components.
You will soon be able to use Chart Builder with your logs in Sematext as well. Stay tuned!
We now show a more detailed load time breakdown whenever we have the data available. Hard page loads, same-origin HTTP requests and resources have detailed load time breakdown.
This breakdown helps you understand which part of the process affects your load times the most. Read more in the documentation to understand what each part means.
The new Group By selector allows you to slice the data and find performance differences between browsers, countries, device types, etc. Click on the Group By selector next to the filters and select the field to get started.
Group by also works well in combination with filters.
If you have defined any custom tags for your users, you can group by those as well.
Resources pages will give you detailed information about each resource that was fetched while loading your website.
This includes images, fonts, stylesheets, and other media. To better understand the metrics shown in the table, read more in the documentation.