From: Sergey Senozhatsky <sergey.senozhatsky@gmail.com>
To: Peter Zijlstra <a.p.zijlstra@chello.nl>
Cc: Ingo Molnar <mingo@elte.hu>, Thomas Gleixner <tglx@linutronix.de>,
Steven Rostedt <rostedt@goodmis.org>,
Andrew Morton <akpm@linux-foundation.org>,
"Paul E. McKenney" <paulmck@linux.vnet.ibm.com>,
Dipankar Sarma <dipankar@in.ibm.com>,
linux-kernel@vger.kernel.org
Subject: INFO: possible circular locking dependency detected
Date: Thu, 14 Jul 2011 17:49:46 +0300 [thread overview]
Message-ID: <20110714144946.GA3354@swordfish.minsk.epam.com> (raw)
[-- Attachment #1: Type: text/plain, Size: 7990 bytes --]
Hello,
[ 4172.371094] =======================================================
[ 4172.371097] [ INFO: possible circular locking dependency detected ]
[ 4172.371103] 3.0.0-rc7-dbg-00565-g6b31efc #644
[ 4172.371105] -------------------------------------------------------
[ 4172.371108] make/11702 is trying to acquire lock:
[ 4172.371111] (rcu_node_level_0){..-...}, at: [<ffffffff810a55e2>] __rcu_read_unlock+0xb9/0x217
[ 4172.371123]
[ 4172.371123] but task is already holding lock:
[ 4172.371125] (&p->pi_lock){-.-.-.}, at: [<ffffffff8103775e>] try_to_wake_up+0x29/0x28b
[ 4172.371135]
[ 4172.371135] which lock already depends on the new lock.
[ 4172.371136]
[ 4172.371138]
[ 4172.371138] the existing dependency chain (in reverse order) is:
[ 4172.371141]
[ 4172.371141] -> #2 (&p->pi_lock){-.-.-.}:
[ 4172.371146] [<ffffffff810717f6>] lock_acquire+0x138/0x1ac
[ 4172.371153] [<ffffffff8147cdfe>] _raw_spin_lock_irqsave+0x4e/0x60
[ 4172.371159] [<ffffffff8103775e>] try_to_wake_up+0x29/0x28b
[ 4172.371163] [<ffffffff810379cd>] default_wake_function+0xd/0xf
[ 4172.371167] [<ffffffff8105d7ad>] autoremove_wake_function+0xf/0x33
[ 4172.371173] [<ffffffff81028d6b>] __wake_up_common+0x48/0x7e
[ 4172.371179] [<ffffffff8102b4f4>] __wake_up+0x34/0x48
[ 4172.371183] [<ffffffff810a54ef>] rcu_report_exp_rnp.isra.24+0x4a/0x84
[ 4172.371187] [<ffffffff810a56de>] __rcu_read_unlock+0x1b5/0x217
[ 4172.371191] [<ffffffff8105a2cd>] get_pid_task+0x71/0x7e
[ 4172.371195] [<ffffffff811571b8>] proc_single_show+0x36/0x7c
[ 4172.371201] [<ffffffff81124e59>] seq_read+0x17b/0x362
[ 4172.371208] [<ffffffff81107ff1>] vfs_read+0xaa/0x13a
[ 4172.371213] [<ffffffff811080c6>] sys_read+0x45/0x6c
[ 4172.371217] [<ffffffff81483792>] system_call_fastpath+0x16/0x1b
[ 4172.371223]
[ 4172.371223] -> #1 (sync_rcu_preempt_exp_wq.lock){......}:
[ 4172.371228] [<ffffffff810717f6>] lock_acquire+0x138/0x1ac
[ 4172.371232] [<ffffffff8147cdfe>] _raw_spin_lock_irqsave+0x4e/0x60
[ 4172.371236] [<ffffffff8102b4dd>] __wake_up+0x1d/0x48
[ 4172.371240] [<ffffffff810a54ef>] rcu_report_exp_rnp.isra.24+0x4a/0x84
[ 4172.371244] [<ffffffff810a56de>] __rcu_read_unlock+0x1b5/0x217
[ 4172.371248] [<ffffffff8105a2cd>] get_pid_task+0x71/0x7e
[ 4172.371251] [<ffffffff811571b8>] proc_single_show+0x36/0x7c
[ 4172.371255] [<ffffffff81124e59>] seq_read+0x17b/0x362
[ 4172.371259] [<ffffffff81107ff1>] vfs_read+0xaa/0x13a
[ 4172.371263] [<ffffffff811080c6>] sys_read+0x45/0x6c
[ 4172.371266] [<ffffffff81483792>] system_call_fastpath+0x16/0x1b
[ 4172.371270]
[ 4172.371270] -> #0 (rcu_node_level_0){..-...}:
[ 4172.371275] [<ffffffff81070bd7>] __lock_acquire+0xffa/0x1661
[ 4172.371279] [<ffffffff810717f6>] lock_acquire+0x138/0x1ac
[ 4172.371283] [<ffffffff8147cd0e>] _raw_spin_lock+0x36/0x45
[ 4172.371286] [<ffffffff810a55e2>] __rcu_read_unlock+0xb9/0x217
[ 4172.371290] [<ffffffff81038ccc>] select_task_rq_fair+0xa51/0xa99
[ 4172.371294] [<ffffffff81037888>] try_to_wake_up+0x153/0x28b
[ 4172.371298] [<ffffffff810379df>] wake_up_process+0x10/0x12
[ 4172.371302] [<ffffffff81056581>] wake_up_worker+0x1f/0x21
[ 4172.371306] [<ffffffff810572c0>] insert_work+0x63/0x67
[ 4172.371309] [<ffffffff8105803b>] __queue_work+0x3bd/0x46a
[ 4172.371313] [<ffffffff810581a9>] delayed_work_timer_fn+0x25/0x2a
[ 4172.371316] [<ffffffff8104c8ae>] run_timer_softirq+0x2dc/0x510
[ 4172.371321] [<ffffffff8104528c>] __do_softirq+0x134/0x2ff
[ 4172.371327] [<ffffffff8148469c>] call_softirq+0x1c/0x30
[ 4172.371331] [<ffffffff8100316f>] do_softirq+0x46/0x9f
[ 4172.371336] [<ffffffff810456ad>] irq_exit+0x4e/0xa0
[ 4172.371339] [<ffffffff8101895a>] smp_apic_timer_interrupt+0x85/0x93
[ 4172.371343] [<ffffffff814841d3>] apic_timer_interrupt+0x13/0x20
[ 4172.371347] [<ffffffff81204e96>] do_msgsnd+0x399/0x40e
[ 4172.371352] [<ffffffff81204f53>] sys_msgsnd+0x48/0x4f
[ 4172.371355] [<ffffffff81483792>] system_call_fastpath+0x16/0x1b
[ 4172.371360]
[ 4172.371360] other info that might help us debug this:
[ 4172.371361]
[ 4172.371363] Chain exists of:
[ 4172.371363] rcu_node_level_0 --> sync_rcu_preempt_exp_wq.lock --> &p->pi_lock
[ 4172.371370]
[ 4172.371371] Possible unsafe locking scenario:
[ 4172.371372]
[ 4172.371374] CPU0 CPU1
[ 4172.371375] ---- ----
[ 4172.371377] lock(&p->pi_lock);
[ 4172.371380] lock(sync_rcu_preempt_exp_wq.lock);
[ 4172.371384] lock(&p->pi_lock);
[ 4172.371387] lock(rcu_node_level_0);
[ 4172.371390]
[ 4172.371390] *** DEADLOCK ***
[ 4172.371391]
[ 4172.371393] 3 locks held by make/11702:
[ 4172.371395] #0: (&(&dbs_info->work)->timer){+.-...}, at: [<ffffffff8104c79f>] run_timer_softirq+0x1cd/0x510
[ 4172.371402] #1: (&(&gcwq->lock)->rlock){-.-...}, at: [<ffffffff81057e55>] __queue_work+0x1d7/0x46a
[ 4172.371409] #2: (&p->pi_lock){-.-.-.}, at: [<ffffffff8103775e>] try_to_wake_up+0x29/0x28b
[ 4172.371415]
[ 4172.371416] stack backtrace:
[ 4172.371419] Pid: 11702, comm: make Not tainted 3.0.0-rc7-dbg-00565-g6b31efc #644
[ 4172.371421] Call Trace:
[ 4172.371423] <IRQ> [<ffffffff8147361c>] print_circular_bug+0x293/0x2a4
[ 4172.371431] [<ffffffff81070bd7>] __lock_acquire+0xffa/0x1661
[ 4172.371436] [<ffffffff81038400>] ? select_task_rq_fair+0x185/0xa99
[ 4172.371440] [<ffffffff810a55e2>] ? __rcu_read_unlock+0xb9/0x217
[ 4172.371444] [<ffffffff810717f6>] lock_acquire+0x138/0x1ac
[ 4172.371448] [<ffffffff810a55e2>] ? __rcu_read_unlock+0xb9/0x217
[ 4172.371453] [<ffffffff8147cd0e>] _raw_spin_lock+0x36/0x45
[ 4172.371456] [<ffffffff810a55e2>] ? __rcu_read_unlock+0xb9/0x217
[ 4172.371460] [<ffffffff810a55e2>] __rcu_read_unlock+0xb9/0x217
[ 4172.371464] [<ffffffff81038ccc>] select_task_rq_fair+0xa51/0xa99
[ 4172.371468] [<ffffffff810388d1>] ? select_task_rq_fair+0x656/0xa99
[ 4172.371471] [<ffffffff8103775e>] ? try_to_wake_up+0x29/0x28b
[ 4172.371475] [<ffffffff8103775e>] ? try_to_wake_up+0x29/0x28b
[ 4172.371482] [<ffffffff81246c1d>] ? do_raw_spin_lock+0x6b/0x122
[ 4172.371486] [<ffffffff81037888>] try_to_wake_up+0x153/0x28b
[ 4172.371489] [<ffffffff81246c1d>] ? do_raw_spin_lock+0x6b/0x122
[ 4172.371493] [<ffffffff810379df>] wake_up_process+0x10/0x12
[ 4172.371497] [<ffffffff81056581>] wake_up_worker+0x1f/0x21
[ 4172.371500] [<ffffffff810572c0>] insert_work+0x63/0x67
[ 4172.371503] [<ffffffff8105803b>] __queue_work+0x3bd/0x46a
[ 4172.371507] [<ffffffff8104c79f>] ? run_timer_softirq+0x1cd/0x510
[ 4172.371511] [<ffffffff810581a9>] delayed_work_timer_fn+0x25/0x2a
[ 4172.371514] [<ffffffff8104c8ae>] run_timer_softirq+0x2dc/0x510
[ 4172.371518] [<ffffffff8104c79f>] ? run_timer_softirq+0x1cd/0x510
[ 4172.371521] [<ffffffff81058184>] ? schedule_work+0x15/0x15
[ 4172.371525] [<ffffffff8104528c>] __do_softirq+0x134/0x2ff
[ 4172.371530] [<ffffffff8106b9a1>] ? tick_program_event+0x1a/0x1c
[ 4172.371534] [<ffffffff8148469c>] call_softirq+0x1c/0x30
[ 4172.371538] [<ffffffff8100316f>] do_softirq+0x46/0x9f
[ 4172.371541] [<ffffffff810456ad>] irq_exit+0x4e/0xa0
[ 4172.371545] [<ffffffff8101895a>] smp_apic_timer_interrupt+0x85/0x93
[ 4172.371549] [<ffffffff814841d3>] apic_timer_interrupt+0x13/0x20
[ 4172.371551] <EOI> [<ffffffff81071fca>] ? trace_hardirqs_on_caller+0x10d/0x131
[ 4172.371559] [<ffffffff810a5578>] ? __rcu_read_unlock+0x4f/0x217
[ 4172.371563] [<ffffffff81204e96>] do_msgsnd+0x399/0x40e
[ 4172.371567] [<ffffffff81204f53>] sys_msgsnd+0x48/0x4f
[ 4172.371571] [<ffffffff81483792>] system_call_fastpath+0x16/0x1b
Sergey
[-- Attachment #2: Type: application/pgp-signature, Size: 316 bytes --]
next reply other threads:[~2011-07-14 14:50 UTC|newest]
Thread overview: 55+ messages / expand[flat|nested] mbox.gz Atom feed top
2011-07-14 14:49 Sergey Senozhatsky [this message]
2011-07-14 16:41 ` Peter Zijlstra
2011-07-14 16:57 ` Paul E. McKenney
2011-07-14 19:16 ` Sergey Senozhatsky
2011-07-14 19:15 ` Sergey Senozhatsky
2011-07-14 19:34 ` Paul E. McKenney
2011-07-14 19:38 ` Dave Jones
2011-07-14 20:33 ` Paul E. McKenney
2011-07-14 19:38 ` Sergey Senozhatsky
2011-07-14 16:58 ` Steven Rostedt
2011-07-14 17:02 ` Steven Rostedt
2011-07-14 17:05 ` Paul E. McKenney
2011-07-14 17:32 ` Steven Rostedt
2011-07-14 17:46 ` Steven Rostedt
2011-07-14 19:18 ` Paul E. McKenney
2011-07-14 19:41 ` Steven Rostedt
2011-07-14 20:33 ` Paul E. McKenney
2011-07-15 11:05 ` Ed Tomlinson
2011-07-15 11:29 ` Peter Zijlstra
2011-07-15 11:35 ` Ed Tomlinson
2011-07-15 11:39 ` Peter Zijlstra
2011-07-15 18:11 ` Paul E. McKenney
2011-07-15 12:42 ` Paul E. McKenney
2011-07-15 13:07 ` Peter Zijlstra
2011-07-15 14:36 ` Paul E. McKenney
2011-07-15 15:04 ` Peter Zijlstra
2011-07-15 15:59 ` Paul E. McKenney
2011-07-15 16:11 ` Peter Zijlstra
2011-07-15 16:56 ` Paul E. McKenney
2011-07-15 21:48 ` Ed Tomlinson
2011-07-15 22:04 ` Paul E. McKenney
2011-07-16 19:42 ` Ed Tomlinson
2011-07-17 0:02 ` Paul E. McKenney
2011-07-17 1:56 ` Ed Tomlinson
2011-07-17 14:28 ` Paul E. McKenney
2011-07-18 15:15 ` Paul E. McKenney
2011-07-18 9:29 ` Peter Zijlstra
2011-07-18 15:29 ` Paul E. McKenney
2011-07-15 16:55 ` Steven Rostedt
2011-07-15 17:03 ` Paul E. McKenney
2011-07-15 17:16 ` Steven Rostedt
2011-07-15 17:24 ` Paul E. McKenney
2011-07-15 17:42 ` Steven Rostedt
2011-07-15 18:33 ` Paul E. McKenney
-- strict thread matches above, loose matches on Subject: below --
2011-08-07 16:22 Justin P. Mattock
2011-08-11 20:57 ` Justin P. Mattock
2009-12-06 10:11 Richard Zidlicky
2009-10-10 23:09 John Kacur
2007-02-08 15:03 Pedro M. López
2006-10-16 14:05 alpha @ steudten Engineering
2006-10-16 14:32 ` Nick Piggin
2006-10-16 15:42 ` Randy Dunlap
2006-10-16 15:46 ` Nick Piggin
2006-10-19 6:02 ` Andrew Morton
2006-10-19 6:30 ` Nick Piggin
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20110714144946.GA3354@swordfish.minsk.epam.com \
--to=sergey.senozhatsky@gmail.com \
--cc=a.p.zijlstra@chello.nl \
--cc=akpm@linux-foundation.org \
--cc=dipankar@in.ibm.com \
--cc=linux-kernel@vger.kernel.org \
--cc=mingo@elte.hu \
--cc=paulmck@linux.vnet.ibm.com \
--cc=rostedt@goodmis.org \
--cc=tglx@linutronix.de \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®