Peter Zijlstra ff77e46853
sched/rt: Fix PI handling vs. sched_setscheduler() ...
Andrea Parri reported:
> I found that the following scenario (with CONFIG_RT_GROUP_SCHED=y) is not
> handled correctly:
>
> T1 (prio = 20)
> lock(rtmutex);
>
> T2 (prio = 20)
> blocks on rtmutex (rt_nr_boosted = 0 on T1's rq)
>
> T1 (prio = 20)
> sys_set_scheduler(prio = 0)
> [new_effective_prio == oldprio]
> T1 prio = 20 (rt_nr_boosted = 0 on T1's rq)
>
> The last step is incorrect as T1 is now boosted (c.f., rt_se_boosted());
> in particular, if we continue with
>
> T1 (prio = 20)
> unlock(rtmutex)
> wakeup(T2)
> adjust_prio(T1)
> [prio != rt_mutex_getprio(T1)]
> dequeue(T1)
> rt_nr_boosted = (unsigned long)(-1)
> ...
> T1 prio = 0
>
> then we end up leaving rt_nr_boosted in an "inconsistent" state.
>
> The simple program attached could reproduce the previous scenario; note
> that, as a consequence of the presence of this state, the "assertion"
>
> WARN_ON(!rt_nr_running && rt_nr_boosted)
>
> from dec_rt_group() may trigger.
So normally we dequeue/enqueue tasks in sched_setscheduler(), which
would ensure the accounting stays correct. However in the early PI path
we fail to do so.
So this was introduced at around v3.14, by:
c365c292d0parri.andrea@gmail.com >
Tested-by: Andrea Parri <parri.andrea@gmail.com >
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org >
Cc: Juri Lelli <juri.lelli@arm.com >
Cc: Linus Torvalds <torvalds@linux-foundation.org >
Cc: Mike Galbraith <efault@gmx.de >
Cc: Peter Zijlstra <peterz@infradead.org >
Cc: Steven Rostedt <rostedt@goodmis.org >
Cc: Thomas Gleixner <tglx@linutronix.de >
Signed-off-by: Ingo Molnar <mingo@kernel.org >
2016-02-29 09:53:05 +01:00
2015-12-13 19:59:48 -08:00
2015-12-14 10:11:09 -08:00
2015-10-09 07:49:01 -07:00
2016-02-04 18:26:08 +01:00
2016-01-20 18:03:56 -08:00
2016-02-04 18:25:55 +01:00
2015-10-17 21:22:08 -07:00
2015-09-30 19:22:50 +09:00
2015-10-07 18:08:15 +01:00
2015-12-11 16:56:16 +01:00
2016-01-13 16:00:32 +01:00
2015-11-21 18:42:00 +01:00
2015-10-20 18:10:25 +02:00
2015-12-22 17:04:56 +00:00
2015-09-27 17:33:59 -07:00
2015-12-29 10:08:45 +01:00
2016-01-07 10:10:50 -05:00
2016-01-18 12:10:45 -08:00
2016-02-17 10:29:27 -05:00
2016-02-16 15:21:47 -05:00
2016-01-05 18:04:58 +01:00
2016-01-07 09:55:39 -08:00
2015-12-28 18:43:15 +01:00
2015-09-18 21:57:43 +02:00
2015-09-18 21:57:35 +02:00
2015-09-18 21:57:43 +02:00
2015-09-18 21:57:43 +02:00
2015-11-16 15:41:49 +00:00
2015-12-21 14:26:28 +05:30
2015-10-27 11:24:23 +01:00
2016-01-24 12:50:56 -08:00
2016-02-21 20:49:34 +01:00
2015-12-17 22:08:28 -05:00
2016-01-21 14:47:08 -08:00
2016-01-12 18:26:10 +00:00
2015-05-20 15:05:39 -07:00
2015-06-10 15:10:26 +08:00
2016-02-09 11:54:23 +01:00
2016-02-21 22:03:15 -05:00
2016-01-11 16:48:35 +00:00
2015-12-16 16:36:25 +02:00
2016-01-23 18:45:06 -08:00
2015-05-13 12:04:55 -05:00
2016-01-13 09:26:40 -08:00
2016-01-12 01:10:19 +01:00
2015-12-23 08:37:10 -07:00
2015-04-22 17:06:52 +02:00
2016-01-04 16:19:57 +00:00
2015-08-05 13:38:07 +01:00
2015-04-22 08:00:42 +10:00
2015-08-03 12:01:54 -04:00
2015-07-23 18:00:42 -07:00
2015-10-06 12:33:14 +02:00
2016-01-14 13:40:30 +01:00
2015-11-03 17:22:17 -08:00
2016-01-17 19:13:15 -08:00
2015-08-20 14:10:23 -07:00
2015-10-12 10:31:12 -06:00
2015-11-05 14:51:32 -08:00
2015-06-23 15:47:35 +01:00
2016-01-09 08:39:04 -08:00
2015-06-21 21:55:33 +02:00
2015-12-13 15:55:55 +01:00
2016-01-24 03:47:37 +01:00
2016-01-24 03:49:03 +01:00
2015-12-03 09:32:21 -07:00
2015-08-05 09:38:08 +02:00
2015-12-09 10:35:16 -08:00
2015-12-22 09:38:34 -07:00
2015-10-27 15:04:56 +09:00
2015-12-01 10:53:59 -07:00
2016-02-04 21:37:52 -08:00
2015-09-29 13:37:04 -07:00
2015-12-06 12:46:31 +01:00
2015-05-19 08:39:11 +02:00
2015-11-25 12:14:09 -05:00
2015-11-25 11:35:14 -05:00
2015-11-11 02:19:33 -05:00
2015-05-24 12:31:33 -07:00
2015-11-18 11:20:40 +11:00
2015-12-03 10:24:08 -05:00
2016-01-22 10:42:57 -05:00
2016-01-12 19:20:32 -08:00
2016-01-27 09:10:29 -05:00
2015-12-23 13:08:56 -08:00
2015-05-06 11:58:51 +01:00
2015-07-17 16:39:53 -07:00
2015-09-14 11:00:55 +02:00
2015-11-25 22:28:30 +01:00
2015-10-23 17:55:10 +09:00
2015-11-05 19:34:48 -08:00
2015-07-17 16:39:53 -07:00
2015-11-06 17:50:42 -08:00
2015-06-25 17:00:38 -07:00
2016-02-15 13:06:00 -05:00
2015-12-07 00:02:05 +00:00
2016-01-20 17:20:53 -08:00
2015-05-10 19:15:52 +02:00
2016-01-16 11:17:25 -08:00
2015-11-24 09:56:43 +01:00
2015-12-04 10:34:45 +01:00
2015-10-07 17:54:09 +01:00
2015-10-15 00:21:07 +02:00
2015-07-15 13:30:38 +01:00
2015-05-04 21:27:52 -07:00
2015-10-07 16:02:49 -07:00
2015-07-22 09:58:02 +02:00
2016-01-01 03:49:51 +01:00
2015-08-28 15:14:54 +02:00
2016-01-20 17:09:18 -08:00
2016-01-22 10:22:46 -05:00
2015-05-26 15:26:43 +02:00
2015-05-30 22:42:24 -07:00
2015-09-04 16:54:41 -07:00
2015-08-17 16:53:53 +08:00
2016-02-27 10:28:52 -08:00
2015-11-16 09:27:32 +05:30
2016-01-14 16:00:49 -08:00
2015-10-09 07:49:02 -07:00
2015-10-18 10:14:39 -07:00
2015-12-30 13:01:03 -05:00
2015-11-02 13:14:44 -08:00
2016-01-13 17:30:32 +09:00
2015-10-31 19:05:59 -04:00
2016-01-08 01:12:06 +01:00
2016-02-06 23:45:46 -08:00
2015-10-15 13:22:35 +01:00
2016-01-20 17:09:18 -08:00
2015-05-13 14:35:57 +05:30
2015-10-23 17:55:10 +09:00
2015-10-15 16:41:04 +02:00
2016-01-20 17:09:18 -08:00
2016-01-06 15:17:47 +05:30
2015-09-08 15:35:28 -07:00
2015-06-12 11:33:52 +02:00
2016-01-15 22:08:45 +01:00
2015-11-18 16:27:46 -05:00
2016-01-04 10:58:35 +01:00
2015-11-25 09:22:00 -07:00
2015-11-25 09:22:02 -07:00
2015-12-11 16:56:40 +01:00
2016-02-10 16:25:52 +00:00
2015-06-10 08:01:20 -06:00
2015-12-11 11:05:57 -08:00
2016-01-16 11:17:24 -08:00
2016-01-06 16:31:56 -05:00
2015-12-15 08:53:36 -05:00
2015-10-16 08:30:09 +09:00
2015-12-14 18:58:42 -08:00
2015-10-04 11:36:07 +01:00
2015-12-15 15:41:24 +02:00
2015-10-31 16:12:10 -07:00
2015-10-30 01:47:27 -04:00
2016-01-08 21:40:34 -05:00
2015-06-24 17:49:45 -07:00
2016-01-30 13:35:31 -08:00
2015-08-14 16:50:36 -07:00
2015-08-07 22:59:34 -05:00
2016-02-18 16:23:24 -08:00
2016-02-18 16:34:15 -08:00
2015-11-04 18:10:13 -08:00
2015-12-22 17:10:17 -06:00
2015-10-09 07:48:59 -07:00
2016-01-09 22:42:31 -08:00
2016-02-05 18:10:40 -08:00
2015-05-31 11:40:14 +09:00
2015-05-12 10:46:53 +02:00
2015-05-19 08:39:11 +02:00
2015-11-18 16:17:42 -05:00
2015-12-05 17:41:42 -05:00
2015-07-13 14:18:07 -07:00
2015-12-28 13:41:50 +01:00
2015-11-09 15:11:24 -08:00
2016-01-17 11:13:55 +01:00
2015-04-24 15:36:50 +02:00
2016-01-21 17:20:51 -08:00
2015-11-06 17:50:42 -08:00
2016-01-15 17:56:32 -08:00
2015-05-02 09:54:30 +03:00
2015-12-21 13:07:56 -08:00
2015-10-20 17:47:45 +02:00
2016-01-13 11:06:03 +01:00
2015-05-05 13:40:42 -06:00
2015-11-25 09:22:00 -07:00
2015-10-13 10:34:46 +02:00
2015-09-24 20:42:37 +02:00
2015-09-23 14:35:58 -07:00
2015-10-23 05:44:28 -07:00
2015-06-23 06:14:04 -07:00
2015-11-20 11:31:26 -05:00
2015-12-03 11:49:26 -05:00
2015-12-15 16:50:20 -05:00
2015-09-29 16:27:47 -07:00
2015-12-15 23:26:51 -05:00
2015-10-09 07:49:05 -07:00
2015-12-04 10:34:46 +01:00
2015-07-05 23:59:14 -04:00
2015-10-13 23:30:31 -07:00
2016-02-15 12:42:38 +00:00
2015-10-27 08:36:08 +09:00
2016-01-23 18:45:06 -08:00
2015-10-15 00:21:07 +02:00
2015-10-15 00:21:07 +02:00
2015-08-10 23:07:05 -04:00
2016-01-20 17:09:18 -08:00
2015-11-04 11:30:57 -08:00
2016-01-29 12:34:29 +01:00
2015-10-16 22:18:51 +02:00
2015-10-04 12:46:06 +01:00
2015-09-03 15:02:28 -05:00
2015-12-02 23:37:16 -05:00
2015-12-11 11:52:29 -08:00
2015-10-11 11:33:42 +02:00
2015-10-01 15:06:43 +02:00
2015-10-01 02:18:38 +02:00
2015-12-14 10:03:46 +01:00
2016-01-26 16:00:14 +01:00
2015-09-16 15:47:51 +02:00
2015-06-25 12:06:45 +02:00
2015-10-30 10:13:26 +01:00
2015-10-18 17:02:56 -04:00
2015-09-01 14:04:50 -07:00
2015-11-23 09:44:58 +01:00
2015-08-22 14:54:55 +02:00
2016-01-16 11:17:23 -08:00
2016-01-16 11:17:22 -08:00
2015-11-20 15:55:52 -05:00
2016-01-20 17:09:18 -08:00
2015-10-21 15:18:36 +01:00
2015-12-15 10:01:43 -05:00
2015-07-28 08:50:42 +01:00
2015-12-12 10:15:34 -08:00
2015-09-10 13:29:01 -07:00
2015-10-04 11:46:16 +01:00
2015-08-04 10:16:54 +02:00
2015-11-28 19:33:29 -08:00
2015-09-04 16:54:41 -07:00
2015-05-13 10:19:35 +02:00
2016-02-25 11:27:16 +01:00
2015-10-01 15:06:46 +02:00
2015-11-25 17:24:23 +01:00
2016-01-15 17:56:32 -08:00
2016-02-09 11:54:23 +01:00
2016-01-04 09:57:40 +01:00
2015-06-19 10:03:12 +02:00
2016-01-25 15:20:44 -05:00
2015-04-29 17:17:17 -05:00
2016-02-23 17:17:20 -08:00
2016-02-04 09:19:45 -07:00
2015-11-23 10:37:35 -08:00
2016-01-20 17:09:18 -08:00
2015-11-23 10:37:35 -08:00
2016-01-15 17:56:32 -08:00
2015-12-03 23:01:27 +01:00
2015-08-12 11:59:08 +02:00
2016-02-11 18:35:48 -08:00
2015-11-25 09:22:02 -07:00
2015-07-13 13:31:58 -04:00
2015-12-24 11:09:40 -05:00
2016-01-20 17:09:18 -08:00
2015-06-11 22:19:45 +05:30
2015-08-10 14:29:27 +05:30
2015-11-17 15:25:43 -05:00
2015-11-10 12:06:16 +01:00
2015-05-28 12:21:08 +02:00
2016-01-07 14:31:27 -05:00
2015-09-20 19:31:10 -07:00
2016-01-15 17:56:32 -08:00
2016-02-03 08:28:43 -08:00
2016-01-15 17:56:32 -08:00
2016-01-14 16:00:49 -08:00
2016-01-15 17:56:32 -08:00
2015-10-04 12:46:06 +01:00
2015-09-09 17:19:14 -07:00
2015-10-27 18:55:31 -07:00
2016-01-14 16:00:49 -08:00
2016-02-03 08:28:43 -08:00
2015-06-24 17:49:41 -07:00
2016-02-03 08:28:43 -08:00
2016-01-15 17:56:32 -08:00
2015-07-17 16:39:53 -07:00
2015-09-10 13:29:01 -07:00
2016-02-03 08:28:43 -08:00
2015-12-14 19:15:05 -08:00
2016-02-03 16:58:15 +10:30
2015-11-06 17:50:42 -08:00
2015-10-20 22:10:45 +08:00
2015-07-21 10:39:05 -07:00
2015-11-30 15:26:22 -05:00
2016-01-21 11:52:16 -08:00
2015-10-17 21:11:29 -07:00
2016-01-09 03:07:52 -05:00
2015-06-25 04:20:04 -04:00
2015-12-01 15:45:05 -05:00
2015-12-15 16:50:20 -05:00
2016-02-19 15:29:26 -05:00
2015-09-17 17:18:37 -07:00
2015-06-18 21:14:31 +02:00
2015-11-06 19:33:12 +01:00
2015-09-29 20:21:32 +02:00
2015-09-30 01:45:03 -05:00
2015-10-16 18:45:36 +02:00
2015-12-15 23:25:20 -05:00
2016-01-14 16:08:23 -08:00
2015-12-28 09:57:15 -05:00
2016-02-08 15:20:01 -05:00
2015-06-10 18:32:40 -04:00
2016-02-17 11:44:45 -05:00
2015-05-05 17:10:11 -07:00
2015-11-05 19:34:48 -08:00
2015-09-07 15:17:08 -04:00
2015-09-07 15:17:09 -04:00
2015-12-01 10:59:38 -07:00
2015-08-05 13:43:44 -07:00
2015-08-05 13:43:12 -07:00
2015-12-17 10:43:06 -06:00
2015-07-27 08:23:27 -05:00
2015-11-16 09:03:21 +05:30
2015-07-01 19:40:18 -07:00
2016-01-05 11:20:12 +01:00
2015-06-24 11:18:48 +10:00
2015-12-09 09:23:28 -06:00
2016-01-15 12:30:35 -06:00
2015-08-25 11:29:55 -05:00
2016-01-25 08:35:50 -06:00
2015-09-01 09:59:20 +10:00
2015-12-18 11:17:26 +05:30
2015-10-08 05:26:36 -07:00
2015-09-08 15:35:28 -07:00
2015-05-08 12:27:59 +02:00
2015-11-05 19:34:48 -08:00
2015-09-10 13:29:01 -07:00
2015-09-10 13:29:01 -07:00
2015-07-17 16:39:54 -07:00
2016-01-15 17:56:32 -08:00
2015-09-08 15:35:28 -07:00
2015-11-06 17:50:42 -08:00
2016-01-22 17:02:18 -08:00
2015-06-01 07:08:18 +09:00
2015-07-17 16:39:53 -07:00
2016-01-15 17:29:37 -06:00
2015-10-16 22:18:51 +02:00
2015-08-13 15:59:58 -05:00
2016-02-17 17:23:36 -06:00
2015-05-29 07:39:34 +10:00
2015-07-14 17:43:56 -04:00
2015-11-16 10:40:50 -05:00
2015-10-06 11:25:31 -07:00
2015-11-16 10:50:25 -05:00
2016-02-25 08:42:34 +01:00
2016-02-11 18:35:48 -08:00
2016-02-11 18:35:48 -08:00
2015-08-31 14:48:02 -07:00
2016-01-07 14:31:27 -05:00
2015-11-30 15:26:22 -05:00
2016-01-19 19:25:21 -05:00
2016-01-12 20:25:09 -08:00
2015-05-12 23:55:37 +02:00
2016-01-08 01:12:06 +01:00
2015-12-10 23:08:51 +01:00
2015-07-28 08:50:41 +01:00
2015-12-21 03:11:12 +01:00
2015-05-30 02:17:15 +02:00
2015-05-20 01:56:31 +02:00
2016-01-08 01:12:06 +01:00
2016-01-22 17:02:18 -08:00
2016-01-16 11:17:22 -08:00
2015-12-06 21:25:17 -05:00
2015-06-10 16:15:54 +02:00
2016-01-02 00:29:35 +01:00
2015-10-01 09:59:16 -07:00
2015-10-21 14:46:56 -06:00
2015-10-06 17:08:19 +02:00
2016-01-16 11:17:29 -08:00
2016-01-01 02:09:51 +01:00
2015-11-23 09:44:58 +01:00
2015-10-02 14:35:16 +01:00
2015-10-22 08:59:18 -07:00
2015-11-03 11:08:22 -05:00
2016-01-20 17:09:18 -08:00
2015-11-10 13:06:16 +01:00
2015-10-30 11:18:05 +09:00
2015-10-14 14:51:22 -05:00
2015-07-23 20:59:10 +02:00
2016-02-05 18:10:40 -08:00
2016-02-27 10:28:52 -08:00
2015-05-28 11:32:04 +09:30
2015-05-28 11:32:06 +09:30
2016-01-20 17:09:18 -08:00
2015-10-06 11:25:45 -07:00
2015-12-07 17:02:54 -08:00
2015-12-07 17:02:54 -08:00
2015-12-07 17:01:31 -08:00
2015-12-07 17:01:31 -08:00
2016-01-05 19:07:17 +00:00
2015-06-17 09:57:12 +03:00
2015-11-16 09:23:47 +01:00
2015-12-17 22:08:28 -05:00
2015-11-02 14:23:38 -05:00
2015-05-26 15:23:23 +02:00
2016-02-05 18:10:40 -08:00
2015-10-16 15:32:18 -07:00
2015-06-25 01:13:43 +02:00
2016-01-10 22:13:15 -05:00
2015-08-24 14:28:01 -06:00
2015-12-15 09:41:09 +01:00
2016-02-29 09:53:05 +01:00
2015-10-04 12:54:54 +01:00
2015-11-19 16:22:43 +01:00
2015-10-27 19:55:13 -07:00
2015-12-24 11:09:40 -05:00
2015-09-11 15:21:34 -07:00
2015-07-01 10:49:25 -07:00
2015-07-23 17:43:30 -07:00
2015-12-13 19:59:48 -08:00
2015-12-17 11:18:44 +01:00
2015-07-16 10:30:55 -07:00
2015-11-24 11:48:35 +09:00
2016-01-04 16:11:11 -05:00
2015-08-05 08:48:00 +05:30
2016-01-20 17:09:18 -08:00
2016-01-22 18:08:52 -05:00
2015-11-20 16:17:32 -08:00
2016-02-09 04:28:06 -05:00
2016-01-20 17:09:18 -08:00
2016-01-20 17:09:18 -08:00
2016-01-20 17:09:18 -08:00
2015-10-20 10:23:55 +02:00
2015-12-15 23:26:51 -05:00
2015-09-01 08:40:25 -07:00
2015-09-20 19:32:02 -07:00
2015-10-06 11:15:43 -07:00
2015-06-25 17:00:38 -07:00
2015-10-04 20:28:58 +01:00
2015-07-29 00:13:25 -07:00
2016-01-06 11:02:29 +01:00
2015-09-10 13:29:01 -07:00
2016-01-04 10:20:19 -05:00
2015-10-26 10:11:58 +09:00
2015-10-14 02:17:33 +02:00
2015-05-11 15:06:43 +08:00
2016-02-25 11:27:16 +01:00
2016-01-20 17:09:18 -08:00
2015-09-08 15:35:28 -07:00
2016-01-20 17:29:52 -05:00
2015-12-01 14:00:53 -05:00
2015-07-01 10:36:39 -05:00
2015-11-13 21:53:18 -08:00
2015-06-25 17:00:39 -07:00
2015-10-21 14:42:38 -06:00
2015-11-05 14:36:09 -05:00
2015-12-29 16:00:00 +08:00
2016-01-14 16:00:49 -08:00
2015-09-20 22:52:13 -07:00
2016-01-15 22:34:39 +01:00
2015-08-17 11:25:28 -07:00
2015-12-10 22:41:06 -08:00
2015-06-12 11:15:49 +02:00
2015-10-01 09:59:01 -07:00
2015-06-19 15:18:28 +02:00
2015-04-22 17:06:49 +02:00
2015-10-01 09:57:59 -07:00
2016-01-18 14:49:33 -05:00
2015-10-19 01:01:21 +02:00
2015-10-25 21:33:56 -04:00
2015-11-05 19:34:48 -08:00
2015-12-06 12:56:06 +01:00
2016-02-15 13:04:46 -05:00
2015-08-03 15:24:43 -07:00
2016-01-26 23:17:54 -08:00
2015-11-25 15:49:13 +00:00
2015-06-15 16:02:52 -07:00
2015-12-17 09:57:27 -08:00
2016-02-10 13:19:03 +00:00
2015-05-14 17:55:51 -07:00
2015-12-18 17:48:50 -08:00
2015-12-06 20:42:15 -05:00
2015-11-23 09:44:58 +01:00
2015-04-28 12:48:57 +02:00
2015-12-01 14:58:18 -08:00
2015-09-04 16:54:41 -07:00
2015-05-05 17:10:11 -07:00
2015-08-12 17:01:01 +01:00
2015-12-21 15:28:11 -07:00
2015-11-05 11:07:36 +10:00
2015-12-04 10:38:59 -02:00
2015-06-01 15:48:54 +02:00
2016-01-12 20:47:06 +02:00
2016-01-12 20:47:02 +02:00
2016-01-15 17:56:32 -08:00
2016-01-14 16:00:49 -08:00
2015-10-17 22:03:00 -07:00
2016-01-14 16:00:49 -08:00
2016-01-14 16:00:49 -08:00
2015-06-01 15:48:54 +02:00
2015-12-04 10:34:45 +01:00
2016-02-24 09:09:45 +01:00
2016-01-11 21:53:59 +01:00
2015-12-03 07:24:29 -08:00
2016-01-29 13:31:10 -05:00
2015-06-02 08:40:20 -06:00
2015-12-13 19:46:12 -05:00
2015-09-08 15:35:28 -07:00
2015-11-06 17:50:42 -08:00
2015-11-06 17:50:42 -08:00
2015-11-06 17:50:42 -08:00
ff77e46853