Netdata - 1.34.0

Table of contents

• Kubernetes Monitoring: new charts for CPU throttling
• Machine learning (ML) powered anomaly detection
• Streaming compression now enabled by default
• SNMP collector now runs on Go
• Improved installation experience

❗ We're keeping our codebase healthy by removing features that are end of life. Read the deprecation notice to check if you are affected.

Netdata open-source Agent statistics

We're proud to empower each and every one of you to troubleshoot your infrastructure using Netdata:

• 7.3M+ troubleshooters monitor with Netdata
• 1.3M+ unique nodes currently live
• 3.3k+ new nodes per day
• 51k+ Docker pulls per day with 387M all-time total

If you're part of our community and love Netdata, please give us a star on GitHub⭐.

Release highlights

Kubernetes Monitoring: New charts for CPU throttling

Have you seen your applications get stuck or fail to respond to health checks? It might be the CPU quota limit!

Kubernetes relies on the kernel control group (cgroup) mechanisms to manage CPU constraints. The CPU quota is allocated based on a period of time, not on available CPU power. When an application has used its allotted quota for a given period, it gets throttled until the next period.

So if you don’t set your CPU limits correctly, your applications will be throttled while your CPU may be idle. And CPU throttling is really hard to identify since Kubernetes only exposes usage metrics.

In this release, we make troubleshooting Kubernetes even easier by adding two new charts for CPU throttling:

• CPU throttled Runnable Periods: The percentage of runnable periods when tasks in a cgroup have been throttled.
• CPU throttled Time Duration: The total time duration for which tasks in a cgroup have been throttled.

Machine learning (ML) powered anomaly detection

The performance of the machine learning threads have been significantly optimized in this release. We were able to reduce peak CPU usage considerably by sampling input data randomly and excluding constant metrics from training. That way, we've optimized performance while maintaining high levels of accuracy. If you're streaming data between nodes: We've optimized CPU usage on parent nodes with multiple child nodes by altering the training thread's max sleep time.

Streaming compression is now in Alpha

We introduced streaming compression in Netdata Agent v1.33.0 as a tech preview. The feature has matured a lot since then so we are moving forward to alpha stage. From now on, streaming compression will be enabled by default, allowing you to leverage faster streaming between parent and child nodes at a lower bandwidth.

SNMP collector now runs on Go

Go is known for its reliability and blazing speed - precisely what you need when monitoring networks. We've rewritten our SNMP collector from Node.js to Go. Apart from improved configuration options, the new collector eliminates the need for Node.js, slimming down our dependency tree.

Note: The node.js-based SNMP collector will be deprecated in the next release, see the deprecation notice.

📄 SNMP Go collector documentation

Improved installation experience

We have been improving our kickstart script to give you a smooth installation experience. We've added some handy features like:

• Dry run mode: Show what would be done without actually modifying the system, including reporting a number of common installation issues before they arise.
• Overhauled auto-update management: Including support for auto-updates with our native packages and much easier control of whether auto updates are enabled or not.
• Improved reinstallation support: With the new --reinstall-clean option, you can now have the kickstart script cleanly uninstall an existing installation before installing Netdata again.

Acknowledgments

We would like to thank our dedicated, talented contributors that make up this amazing community. The time and expertise that you volunteer is essential to our success. We thank you and look forward to continue to grow together to build a remarkable product.

• @xrgman for fixing typos in our documentation.
• @wooyey for fixing a parsing error in python.d/hpssa collector.
• @tycho for fixing python collector that use sudo.
• @tnagorran for fixing a typo in the step-by-step Netdata guide.
• @rex4539 for fixing typos.
• @petecooper for improving the installer script usage message.
• @godismyjudge95 for fixing a bug in the updater script.
• @fayak for fixing parsing of claiming extra parameters in kickstart.
• @dvdmuckle for fixing a typo in ZFS ARC Cache size dashboard info.
• @d--j for fixing setting of 'time offset' configuration option in timex plugin.
• @cimnine for fixing a bug when tar can not set the correct permissions during installation.
• @AlexGhiti for fixing building Netdata on riscv64.
• @Daniel15 for fixing license URL.
• @MariosMarinos for fixing a typo in the anomaly-detection-python.md file.
• @RatishT for fixing typo in Running-behind-haproxy.md.
• @DanTheMediocre for improving timex plugin documentation and dashboard info.
• @DanTheMediocre for fixing a typo in anomaly-detection-python.md.
• @Steve8291 for fixing ioping_disk_latency alarm lookup value.
• @Steve8291 for fixing config file check in stock config directory in ioping plugin.
• @Steve8291 for adding a link to Netdata badges readme in the health documentation.
• @Steve8291 for fixing libnetfilter-acct-dev package name in nfacct plugin documentation.

Collectors

New collectors

• Add CPU throttling charts (cgroups.plugin) (#12591, @ilyam8)
• Add clock status chart (timex.plugin) (#12501, @ilyam8)
• Add Asterisk configuration file with synthetic charts (statsd.plugin) (#12381, @ilyam8)
• Add new chart for process states metrics (apps.plugin) (#12305, @surajnpn)
• Add thermal zone metrics collection (go.d/wmi) (#667, @ilyam8)
• Add SNMP data collector (go.d/snmp) (#644, @surajnpn)

Improvements

⚙️ Enhancing our collectors to collect all the data you need.

Bug fixes

🐞 Improving our collectors one bug fix at a time.

eBPF

Improvements

• Improve chart titles and dashboard info (#12665, @thiagoftsm)
• Update eBPF dashboard info (#12617, @thiagoftsm)
• Update links in the dashboard info (#12581, @thiagoftsm)
• Add monitoring for inbound and outbound connections (#12532, @thiagoftsm)
• Improve eBPF dashboard info (#12467, @thiagoftsm)
• Add CO-RE support for eBPF plugin (#12318, @thiagoftsm)
• Update libbpf version and adjust eBPF modules for using new version of libbpf (#12190, @thiagoftsm)

Bug fixes

🐞 Improving eBPF integration one bug fix at a time.

Dashboard

• Change color of Netdata logo on left sidebar (#12607)
• Update Community section and the links for opening a new issue on GitHub in 'Need Help?' modal (#12607)
• Add 'Netdata Cloud connection status' modal (#12407)

Streaming

• Fix parsing of 'os_name' for older agent versions streaming to a parent (#12425, @stelfrag)
• Deactivate streaming compression at runtime in case of a compressor buffer overflow (#12037, @odynik)

Exporting

• Remove backends subsystem (#12146, @vlvkobal)

Health

• Fix ioping_disk_latency alarm green/red thresholds (#12351, @ilyam8)
• Fix ioping_disk_latency alarm lookup value (#12329, @Steve8291)
• Adjust 10s_ipv4_tcp_resets_sent alarm warn expression (#12320, @ilyam8)
• Add alarms for charts.d/nut collector (#12285, @ilyam8)
• Fix respecting of 'delay' parameter when using 'repeat' feature (#12164, @erdem2000)

ML

• Fix training/prediction stats charts context (#12610, @vkalintiris)
• Enable streaming of anomaly_detection.* charts (#12606, @vkalintiris)
• Update ML-related charts (#12574, @vkalintiris)
• Reduce min 'dbengine anomaly rate every' from 60s to 30s (#12543, @andrewm4894)
• ML-related changes to address issue/discussion comments. (#12494, @vkalintiris)
• Skip 'foreach' alarms for dimensions of anomaly rate chart. (#12441, @vkalintiris)
• Prepend context in anomaly rate dimension id (#12342, @vkalintiris)
• Skip training of constant metrics (#12212, @vkalintiris)
• Track anomaly rates with DBEngine (#12083, @vkalintiris)

Packaging / Installation

📦 "Handle with care" - Just like handling physical packages, we put in a lot of care and effort to publish beautiful software packages.

Documentation

📄 Keeping our documentation healthy together with our awesome community.

Other notable changes

Improvements

⚙️ Greasing the gears to smoothen your experience with Netdata.

Bug fixes

🐞 Increasing Netdata's reliability one bug fix at a time.

Code organization

🏋️ Changes to keep our code base in good shape.

Deprecation notice

The following items will be removed in our next minor release (v1.35.0):

Patch releases (if any) will not be affected.

| Component | Type | Replaced by |
|----------------------------------------------------------------------------------------------------------------------|:-----------:|:-----------------------------------------------------------------------------------------------------------:|
| node.d | plugin | - |
| node.d/snmp | collector | go.d/snmp |
| python.d/apache | collector | go.d/apache |
| python.d/couchdb | collector | go.d/couchdb |
| python.d/dns_query_time | collector | go.d/dnsquery |
| python.d/dnsdist | collector | go.d/dnsdist |
| python.d/elasticsearch | collector | go.d/elasticsearch |
| python.d/energid | collector | go.d/energid |
| python.d/freeradius | collector | go.d/freeradius |
| python.d/httpcheck | collector | go.d/httpcheck |
| python.d/isc_dhcpd | collector | go.d/isc_dhcpd |
| python.d/mysql | collector | go.d/mysql |
| python.d/nginx | collector | go.d/nginx |
| python.d/phpfpm | collector | go.d/phpfpm |
| python.d/portcheck | collector | go.d/portcheck |
| python.d/powerdns | collector | go.d/powerdns |
| python.d/redis | collector | go.d/redis |
| python.d/web_log | collector | go.d/weblog |

All the deprecated components will be moved to the netdata/community repository.

Deprecated in this release

In accordance with our previous deprecation notice, the following items have been removed in this release:

| Component | Type | Replaced by |
|----------------------------------------------------------------------------------------------------------------|:---------:|:---------------------------------------------------------------------------------------:|
| backends | subsystem | exporting engine |
| node.d/fronius | collector | - |
| node.d/sma_webbox | collector | - |
| node.d/stiebeleltron | collector | - |
| node.d/named | collector | go.d/bind |

Support options

Supporting people in using and building with Netdata is very important to us! Should you need any help or encounter an issue with any of the changes made in this release, feel free to get in touch with the community through the following channels:

• GitHub: Report bugs or submit a new feature request.
• GitHub Discussions: Share your ideas, and be part of the Netdata Agent development process.
• Community forum: Collaborate with other troubleshooters in building a community-driven knowledge base around Netdata.
• Discord: Join us in celebrating the culture of infrastructure monitoring. Hang out with like-minded sysadmins, SREs, and troubleshooters.