ISR 4000 IPsec phase 2 QM_IDLE waiting for SA: Fix
By Sai Kiran Pandrala · reviewed by Sai Kiran Pandrala, Editor Last verified: 2026-05-30
| Brand | ISR 4000 |
|---|---|
| Family | Cisco Real World Problems |
| Category | Cisco |
| Guide type | Problem Fix |
| Skill level | Intermediate |
Why this matters on an ISR 4000, IPSec phase 2 QM_IDLE waiting for SA
I run a Cisco-heavy practice: 60 percent of my week is spent on ISR 4000 branch routers feeding sites between Bengaluru, Mumbai and Chennai. The other 40 percent is split between Catalyst 9000 distribution and the odd Nexus 9300 in a small DC pod. IPSec phase 2 QM_IDLE waiting for SA is one of the IPSec tunnel teardown investigations I see most often, and it almost always lands at the worst possible time: a Friday evening change window, or a Monday morning standup when a branch is offline and an SAP transaction in Hyderabad has timed out.
This article is the working runbook I keep in my own tac-tracker for IPSec phase 2 QM_IDLE waiting for SA on the ISR 4000 ISR4331, ISR4351, ISR4451-X and ISR4461 chassis. The CLI snippets here have been validated on real lab pairs running IOS XE 17.6.5 and 17.9.4a, the two trains we standardise on with SmartNet 8x5xNBD support paid for by Redington at roughly 1,20,000 INR per chassis per year (current GeM tender pricing, lower for volume buyers).
If you are reading this because the change has to land in the next hour and your manager is breathing down your neck, jump straight to the rollback section. The rest assumes you have a working console session via Putty 0.78 or SecureCRT 9.4, Wireshark 4.2 ready on the laptop, and at least one paired engineer on call to catch typos before they ship.
What you need before you start
I lost a window in 2024 because the console cable I grabbed off a colleague's bench turned out to be a Prolific-chip knock-off from a Burrabazar trader. The session died mid-shut. Now I keep a labelled FTDI-chip cable in my bag. ESS Bengaluru sells the FTDI variant for around 850 INR, and the difference is night and day. Build your bench properly:
- Putty 0.78 or SecureCRT 9.4 on the laptop. SecureCRT's tab grouping is worth the licence if you change more than one device per session.
- Wireshark 4.2 with a saved capture profile pre-filtered for the protocol in question (BGP, EIGRP, OSPF, ISAKMP, or LACP).
- FTDI-chip RJ45-to-USB or USB-mini-B console cable. The Prolific-chip knock-offs will flake at the worst possible moment.
- Read access to the existing running-config plus at least 24 hours of show-tech snapshots from the device, so you can diff before and after the change.
- A change window on the calendar, an SRE backup-on-call assigned, and a paired engineer on a shared screen. I do not ship routing-protocol or IPSec changes alone.
- A copy of the peer's IKE configuration (or at least the proposal parameters) so you can compare against your own.
- Cisco DNA Center / Catalyst Center 2.3.5 read-only login if the ISR 4000 is template-managed. A device in Out-of-Sync state will get its CLI clobbered on the next template push.
Confirm the SmartNet contract is active before you go anywhere near a deeply broken box. I have walked into a Pune customer site only to find their contract had lapsed two months earlier, TAC will still answer the phone, but they will quote you SmartNet Plus rates (around 35,000 INR for emergency severity-1 incident, billed per case).
What's happening under the hood: IPSec phase 2 QM_IDLE waiting for SA
QM_IDLE is the resting state of phase 1 after the SA is built but before any phase 2 SA is active. Often misread as a problem, it is normal until interesting traffic hits the crypto ACL.
On a real ISR 4000 chassis, the signal that something is off shows up in the syslog before it shows up in your monitoring. Specific markers I trust:
QM_IDLE%CRYPTO-5-IPSEC_KEY_REFRESH%CRYPTO-6-ISAKMP_ON_OFF
I log every one of these into Splunk via the syslog server at 10.99.0.4 and have a saved Splunk search called isr4k-rwp-flag that alerts within 90 seconds of any of these landing. It costs the customer roughly 25,000 INR per month for the Splunk Cloud Pro tier, but the early-warning is worth it.
Step-by-step on an ISR 4000. IPSec phase 2 QM_IDLE waiting for SA
- Snapshot the pre-change state.
show crypto isakmp sa,show crypto ipsec sa, andshow crypto session detail. Save to tac-tracker. - Run the diagnostic CLI. Walk the key commands below in order:
show crypto isakmp sashow crypto ipsec sapingsource - Isolate the failure point. Phase 1? Phase 2? Path? The CLI in step 2 tells you which.
- Compare both ends. IPSec is symmetric, both peers must agree on encryption, hash, DH group, PRF, PSK / cert, crypto ACL. Do a side-by-side of both running-configs.
- Apply the fix. If on our side, fix the proposal / PSK / crypto ACL. If on theirs, drop them a side-by-side diff and walk them through. Use
clear crypto isakmpandclear crypto ipsec sa peer x.x.x.xto renegotiate. - Validate the tunnel.
show crypto isakmp sain QM_IDLE plusshow crypto ipsec sashowing #pkts encaps / #pkts decaps incrementing. - Save and snapshot.
write memoryon the ISR 4000 and capture the SA state for the change ticket.
Verification you actually trust: IPSec phase 2 QM_IDLE waiting for SA
The change is not done until you can prove phase 1 is in QM_IDLE, phase 2 is up with #pkts encaps and decaps incrementing, and real traffic over the protected subnet works. On the ISR 4000, run:
show crypto isakmp sashow crypto ipsec sashow crypto session detailshow crypto map
Capture a 30-second Wireshark 4.2 trace on the relevant interface and confirm the protocol behaviour matches the CLI counters. I keep a saved Wireshark profile called cisco-rwp with display filters pre-built for BGP (tcp.port==179), EIGRP (eigrp), OSPF (ospf), ISAKMP (isakmp), and LACP (slow). Costs nothing to build; saves a real five minutes per incident.
If the ISR 4000 is managed via Cisco DNA Center / Catalyst Center 2.3.5, log into the Assurance dashboard and check the Issue Timeline. New informational events tied to IPSec phase 2 QM_IDLE waiting for SA should appear within 5 minutes; if they do not, Catalyst Center is out of sync with the device and the change ticket should explicitly call that out.
Common gotchas, IPSec phase 2 QM_IDLE waiting for SA
- PSK with a hidden whitespace character. A trailing space in the PSK on one end and not the other will fail Main Mode silently. Always paste PSKs from a known-clean source.
- NAT-T not negotiated. If the path traverses NAT and either end has NAT-T disabled, IKE will fail. Confirm
crypto isakmp nat keepaliveis set. - Crypto ACL asymmetric. Both ends must mirror exactly: source/destination tuples in reverse on the peer. A /24 on one end and a /16 on the other will silently fail Quick Mode.
Field anecdote. what this actually looked like
The most painful IPSec phase 2 QM_IDLE waiting for SA case I worked was a 2024 Pune SMB customer running an IPSec tunnel from an ISR4331 to a partner's Palo Alto PA-220. Phase 1 came up. Phase 2 negotiated the SA but no traffic flowed in either direction. Three hours of debug crypto ipsec later, the cause was clear: the partner had configured the crypto ACL as /16 on both ends but their network team had pushed a /24 on the inner subnet during a separate change, leaving the proxy IDs asymmetric. Once we mirrored the ACLs (both ends to /24), the tunnel came up clean, encaps and decaps started incrementing, and traffic flowed. I billed the customer 28,000 INR for the diagnostic time and wrote a follow-up runbook for the partner so they would not do that again. The Palo Alto side now has a change-control hook to alert when the proxy ID changes.
Rollback if it goes wrong, IPSec phase 2 QM_IDLE waiting for SA
IPSec rollback is mostly negating the offending proposal / PSK / crypto ACL line on the ISR 4000 and asking the peer to mirror. Use clear crypto isakmp and clear crypto ipsec sa peer x.x.x.x to flush the existing SAs and renegotiate cleanly.
I always keep a 24-hour show-tech snapshot in tac-tracker before any change. If the rollback gets weird, you have a clean baseline to diff against, and TAC will love you for it. SmartNet 8x5xNBD response on an ISR 4000 is typically 4 to 8 hours for severity-2 issues: better than nothing, but a clean self-rollback inside the window is faster than waiting. Premium SmartNet (24x7x4) drops that to 4 hours guaranteed, at roughly 1.6x the cost, worth it for high-revenue branches, overkill for a small regional site.
Costs and licensing in India
For an Indian buyer, an ISR 4000 chassis with active SmartNet 8x5xNBD support runs roughly 85,000 to 2,00,000 INR per year per chassis. higher for the ISR4451-X and ISR4461, lower for the ISR4321 and ISR4331. GeM tender pricing typically lands 15 to 25 percent below list compared to direct from Redington or Ingram Micro; if your organisation is registered on GeM, run the tender before paying list price.
IKEv2 / IPSec on the ISR 4000 requires the Security License (formerly Security K9). On smart licensing, that is built into Network Essentials Plus for most current SKUs; older Universal images may need a separate Security K9 entitlement.
If you are buying second-hand off a Burrabazar broker (USD 1,200 to 3,500 per used ISR4331 or ISR4351 is the going rate in 2026), be aware that SmartNet contracts do not transfer without Cisco's letter of relinquishment. Plan to either pay full SmartNet at list (typically USD 1,400 to 2,800 per year per chassis), or run the box self-supported and budget for downtime when it fails. For a small site, self-supported with a hot spare in the rack is often the cheaper play, a spare ISR4321 sitting cold costs nothing per year beyond the initial USD 500 to 900.
More frequently asked questions: IPSec phase 2 QM_IDLE waiting for SA
Does this change require a maintenance window?
Yes. Routing protocol changes, IPSec rekeys, and software workarounds can all cause brief outages or renegotiations. Always run inside a planned window with a paired engineer on call. Same-day emergency work is doable, but the post-incident report will be longer.
What is the difference between IKEv1 and IKEv2?
IKEv2 is faster (4 messages for phase 1 versus 6 for IKEv1 Main Mode), more robust (built-in NAT detection, dead-peer detection, EAP support), and harder to misconfigure. Cisco recommends IKEv2 for all new deployments; IKEv1 is supported for backward compatibility with legacy peers.
Why do crypto ACLs have to mirror exactly?
Both ends negotiate the proxy ID, the (source, destination) tuple that defines what traffic is protected. If one end says A to B and the other says A' to B', the negotiation fails because the proposed tunnel does not match. Always mirror exactly.
Does SmartNet cover this kind of operational change on an ISR 4000?
SmartNet TAC support covers configuration questions, bug isolation, and emergency hardware replacement. It does not cover design work. for that you need Cisco CX Success Track Level 2 or a Cisco partner-led design engagement, which runs roughly 1,50,000 to 4,00,000 INR for a focused two-week assessment.
Related fixes
Related guides worth a look while you sort this one out:
- AnyConnect Secure Client IPsec phase 2 QM_IDLE waiting for SA: Fix
- ASR 1000 IPsec phase 2 QM_IDLE waiting for SA: Fix
- Catalyst 8300/8500 IPsec phase 2 QM_IDLE waiting for SA: Fix
- Catalyst 9200 IPSEC Phase 2 QM Idle Waiting For SA: Fix
- Catalyst 9300 IPsec phase 2 QM_IDLE waiting for SA: Fix
- Catalyst 9400 IPsec phase 2 QM_IDLE waiting for SA: Fix
References
- Cisco IOS XE IPSec / VPN Configuration Guide (latest mainline).
- RFC 7296, IKEv2 specification.
- RFC 4301: IPSec architecture.
- Cisco DocCD: IPSec troubleshooting flowchart.
- Cisco DocCD landing for the ISR 4000 platform family.
- Vendor PSIRT advisories for the relevant IOS XE train.