Azure Linux 3.0 (CBL-Mariner)

How to fix Azure Linux container host disk pressure evictions

By Sai Kiran Pandrala · Last verified: 2026-05-31 · Source: community Q&A, distro forums (Ubuntu Discourse, Fedora Discussion, Arch BBS, Reddit r/linux, ServerFault, Unix StackExchange), official OS documentation

At a glance

OS / Distro	Azure Linux 3.0 (CBL-Mariner)
Category	Operating Systems
Guide type	Procedure
Skill level	Intermediate to advanced
Time	15 - 60 minutes including verification

If you hit How to fix Azure Linux container host disk pressure evictions on Azure Linux 3.0 (CBL-Mariner) in production, the steps below are the path most sysadmins take in 2026. None of them require opening a vendor case unless you are running a paid enterprise distro.

What how to fix azure linux container host disk pressure evictions actually involves on Azure Linux 3.0 (CBL-Mariner)

This task on Azure Linux is one of the more searched operational topics across distro forums and Unix StackExchange in the last 12 months. The procedure below is the path that works on a current Azure Linux install with default config.

The rest of this page is the structured fix path. Start with diagnose, then remediation, then the automation options so you do not have to do this by hand the next time it surfaces. Verify and safety sections at the end are the discipline that keeps the fix from regressing in production.

Diagnose first, fix second

Reproduce the failure with the relevant CLI in verbose or debug mode. apt -o Debug::pkgProblemResolver=true, dnf -v, zypper --verbose, pacman -dvv, systemctl status --no-pager -l, and strace -f -e trace=openat,read,write all expose what the high-level error message hides. Save the debug output to a file so you can grep it later instead of scrolling.

Pull the kernel ring buffer with dmesg --since '5 minutes ago' for hardware-level events, and journalctl --since '5 minutes ago' --no-pager for the systemd timeline of the same window. Cross-reference them. Most boot, network, and storage issues on {family} leave a signature in both at the same wall-clock timestamp.

Look at process state and resource pressure before blaming the application. top, htop, iotop, vmstat 1 5, and iostat -xz 1 answer the four questions every Linux incident needs: CPU saturated, memory exhausted, disk I/O bottlenecked, or context-switch storm. About a quarter of {family} 'service is broken' tickets turn out to be 'host is out of RAM and OOM killer fired'.

Solution-focused remediation path

If storage is suspect, capture both the block-device view and the filesystem view. lsblk -f + blkid + df -hT + du -shx /* + findmnt + mount | column -t. For ZFS use zpool status -v and zfs list -t snapshot. For Btrfs use btrfs filesystem usage / and btrfs subvolume list /. About a third of 'disk full' issues on Btrfs are metadata exhaustion, where df shows free space but the filesystem refuses writes.

When the fix involves a destructive operation (rm of a config file, dropping an LV, rewriting a partition table, replacing a kernel package), do it during a maintenance window with at least one teammate watching. Snapshot first if the filesystem supports it (Btrfs, ZFS, LVM thin). Document the rollback path before you start, not during the incident. Run script /tmp/incident.log first to capture the entire session.

If you cannot reproduce the failure consistently, the cause is probably a race condition, a session-cache issue, or environment drift between two hosts that should be identical. Run the failing operation under strace -f -e trace=openat,connect,read,write -o /tmp/trace in one terminal and a second known-good instance in another. Diff the trace files. The first divergence is almost always the bug.

Automate this fix so you do not do it twice

Add a Prometheus alert or Zabbix trigger so you catch the next occurrence

The cheapest way to never see the same incident twice is a monitoring rule that watches for the symptom (a specific log line, a metric threshold, a service state) and fires into Slack, PagerDuty, or a webhook when it trips. For Azure Linux 3.0 (CBL-Mariner) the relevant signals come from journalctl filters fed to a log shipper, Prometheus exporters such as node_exporter or blackbox_exporter or a service-specific exporter, and structured log forwarders such as Fluent Bit, Vector, or syslog-ng. Set thresholds against observed normal range, not round numbers.

Wire the fix into a systemd unit override or Ansible role for self-healing

If the underlying cause is a setting that drifts over time, do not script the fix repeatedly. Bake it into a configuration-management role that runs on every check-in. Ansible, Puppet, Chef, SaltStack, and tools like Cockpit, Foreman, and Spacewalk all support enforced state. The role reasserts itself, so even if an operator changes the setting locally, the next run brings it back to the codified state (typically every 30 minutes for Puppet, on cron or systemd-timer for Ansible).

# Ansible task that enforces the corrected setting on every run
- name: Enforce hardened sshd config ansible.builtin.lineinfile: path: /etc/ssh/sshd_config regexp: '^#?PermitRootLogin' line: 'PermitRootLogin no' backup: yes notify: restart sshd

Add a manual-approval gate with sudo and auditd for risky fixes

For multi-step fixes that include a destructive action (drop a database, delete a snapshot, fail over a cluster, wipe a partition) gate the script behind sudo with an auditd rule that logs every invocation. The audit trail lives in /var/log/audit/audit.log with the invoking UID and GID and the exact command. For change management requiring a second-person sign-off, wrap the destructive step in a configuration-management approval gate such as Ansible Tower or AWX, Puppet Enterprise, or Salt Master ACL.

Common pitfalls and what to watch for

The pitfall most teams hit on Azure Linux 3.0 (CBL-Mariner) is moving too fast and skipping the read-only validation step. Before any write, capture current state. cp /etc/<file> /etc/<file>.bak.$(date +%F), systemctl cat <unit> > /tmp/<unit>.before, or etckeeper commit 'pre-fix snapshot' first. Configuration drift is real and on a busy host the file may have changed since you last looked. Save the backup to a different filesystem, not to your home directory.

Second pitfall: confusing permission errors with networking errors. A 'Permission denied' from a service call can be POSIX file perms, SELinux denial, AppArmor denial, sudoers, polkit, or a missing capability. The error string looks identical for all of them. Distinguish by checking journalctl _AUDIT_TYPE=1400 for SELinux, journalctl | grep apparmor for AppArmor, and getcap for missing file capabilities before assuming POSIX perms are the culprit.

Verify the fix worked

Reproduce the original symptom path. If it still surfaces on any host, container, or VM in the fleet, you have not fixed it.
Watch for 24 to 48 hours. journalctl --since '24 hours ago' -u <service> -p err and Prometheus query history can mask issues with cached health for 6 to 12 hours, especially for slow-burn memory leaks and disk-fill regressions.
Run a smoke test under realistic load. Happy-path tests miss race conditions, file-descriptor leaks, and cgroup limits.
Capture the new state in a runbook so the next person on call does not have to rediscover this. Push it to Confluence or your team wiki, not into Slack.
If the fix involved a permission or security change, run a CIS Benchmark or DISA STIG audit one more time to confirm you did not open a separate hole while closing this one.

Safety, rollback, blast radius

Test in a non-production VM, container, or namespace if your environment supports it. The cost of one disposable VM is cheaper than one rollback meeting.
Export the existing config before changing it. Most Azure Linux 3.0 (CBL-Mariner) services support --print-defaults, systemctl show, or a documented config-dump command. Capture that to source control before you start.
Know your rollback path. Some Azure Linux 3.0 (CBL-Mariner) operations are one-way (irreversible filesystem upgrade like ext3 to ext4 inline, kernel ABI change, removal of an LVM physical volume). Confirm reversibility on the official OS documentation before you commit.
Be aware of cross-service impact. A change to PAM ripples to every service using it. A change to /etc/resolv.conf affects every name lookup. A change to systemd default.target affects every reboot.
Maintenance window discipline: if the change touches DNS, certificate rotation, kernel upgrade, or anything that emits TLS handshakes, line up a window with stakeholder notification, not a heroic mid-day swap.

FAQ

How long does how to fix azure linux container host disk pressure evictions typically take on this OS?

For most Azure Linux 3.0 (CBL-Mariner) environments, 15 to 60 minutes including verification. Large fleet rollouts, anything touching kernel parameters or initramfs, or cross-data-centre replication can stretch to half a day because you have to wait for package mirrors, configuration management runs, and reboot windows to align.

Is there a rollback path?

Yes for most Azure Linux 3.0 (CBL-Mariner) changes. Back up the existing config to a versioned file first (etckeeper commit, cp file file.bak.$(date +%F), or a Btrfs/ZFS snapshot), then commit it before you change anything. A few operations are one-way (in-place filesystem conversion, partition table rewrite, kernel ABI bump). Check the distro release notes for the specific operation before you commit.

Will this affect dependent services?

Often yes. Azure Linux 3.0 (CBL-Mariner) services are usually consumed by other workloads (application servers, cron jobs, monitoring agents, container runtimes, log shippers). Use systemctl list-dependencies and lsof to enumerate consumers before changing a shared service or configuration file.

What if my distro version does not match these steps?

Distro defaults move between releases. The steps in this page reflect mainstream defaults as of 2026-05-31 but the underlying CLI calls do not change as fast. If a command differs on your version, fall back to man <command> on the host, or the upstream project documentation - those almost always still work.

Where do I get vendor support if I am still stuck?

If you have an Ubuntu Pro, Red Hat, SUSE, Oracle, or Canonical Support subscription, open a case with: the exact error string, the relevant journalctl excerpt, the output of sosreport (RHEL family) or supportconfig (SUSE), and your reproduction steps. The distro forum is the no-cost public alternative - search there first; 80 percent of common Azure Linux 3.0 (CBL-Mariner) issues already have a working answer marked as solved.

References

Official documentation for Azure Linux 3.0 (CBL-Mariner)
Distro forums and community Q&A (Ubuntu Discourse, Fedora Discussion, Arch BBS, openSUSE Forum, Reddit r/linux + distro subreddits, ServerFault, Unix StackExchange)
Vendor status pages and release-notes feeds
CIS Benchmarks and DISA STIG hardening guides for Azure Linux 3.0 (CBL-Mariner)

Related guides worth a look while you sort this one out: