x86/entry/entry_64.S

944  * only on return from non-NMI IST interrupts that came
1110 	 * the iretq it performs will take us out of NMI context.
1112 	 * NMI is using the top of the stack of the previous NMI. We
1113 	 * can't let it execute because the nested NMI will corrupt the
1114 	 * stack of the previous NMI. NMI handlers are not re-entrant
1121 	 *  is an NMI stack.
1122 	 *  If the variable is not set and the stack is not the NMI
1128 	 *    o Continue processing the NMI
1129 	 *  If the variable is set or the previous stack is the NMI stack:
1131 	 *    o return back to the first NMI
1133 	 * Now on exit of the first NMI, we first clear the stack variable
1134 	 * The NMI stack will tell any nested NMIs at that point that it is
1136 	 * a nested NMI that updated the copy interrupt stack frame, a
1138 	 * NMI.
1156 	 * NMI from user mode.  We need to run on the thread stack, but we
1163 	 * stacks lest we corrupt the "NMI executing" variable.
1188 	 * done with the NMI stack.
1212 	 * | "NMI executing" variable                                |
1216 	 * | iret RFLAGS      } by a nested NMI to force another     |
1222 	 * | outermost RFLAGS      } NMI processing is done.         |
1234 	 * That will either return for real or it will loop back into NMI
1243 	 * Determine whether we're a nested NMI.
1246 	 * end_repeat_nmi, then we are a nested NMI.  We must not
1248 	 * the outer NMI.  That's okay; the outer NMI handler is
1250 	 * the outer NMI.
1262 	 * Now check "NMI executing".  If it's set, then we're nested.
1263 	 * This will not detect if we interrupted an outer NMI just
1270 	 * Now test if the previous stack was an NMI stack.  This covers
1271 	 * the case where we interrupt an outer NMI after it clears
1272 	 * "NMI executing" but before IRET.  We need to be careful, though:
1273 	 * there is one case in which RSP could point to the NMI stack
1274 	 * despite there being no NMI active: naughty userspace controls
1279 	 * "NMI executing".
1282 	/* Compare the NMI stack (rdx) with the stack we came from (4*8(%rsp)) */
1284 	/* If the stack pointer is above the NMI stack, this is a normal NMI */
1289 	/* If it is below the NMI stack, it is a normal NMI */
1292 	/* Ah, it is within the NMI stack. */
1297 	/* This is a nested NMI. */
1302 	 * iteration of NMI handling.
1325 	/* Make room for "NMI executing". */
1358 	 * If there was a nested NMI, the first NMI's iret will return
1360 	 * nested NMI. The nested NMI checks the interrupted RIP to see
1362 	 * it will just return, as we are about to repeat an NMI anyway.
1364 	 * NMI will update.
1367 	 * we're repeating an NMI, gsbase has the same value that it had on
1369 	 * gsbase if needed before we call exc_nmi().  "NMI executing"
1372 	movq	$1, 10*8(%rsp)		/* Set "NMI executing". */
1388 	 * Everything below this point can be preempted by a nested NMI.
1389 	 * If this happens, then the inner NMI will change the "iret"
1396 	 * as we should not be calling schedule in NMI context.
1397 	 * Even with normal interrupts enabled. An NMI should not be
1443 	 * Clear "NMI executing".  Set DF first so that we can easily
1452 	movq	$0, 5*8(%rsp)		/* clear "NMI executing" */
1456 	 * NMI in kernel after user state is restored. For an unprivileged user
1461 	 * iretq reads the "iret" frame and exits the NMI stack in a