Eric Dumazet
4b9d9be839
inetpeer: remove unused list ...
Andi Kleen and Tim Chen reported huge contention on inetpeer
unused_peers.lock, on memcached workload on a 40 core machine, with
disabled route cache.
It appears we constantly flip peers refcnt between 0 and 1 values, and
we must insert/remove peers from unused_peers.list, holding a contended
spinlock.
Remove this list completely and perform a garbage collection on-the-fly,
at lookup time, using the expired nodes we met during the tree
traversal.
This removes a lot of code, makes locking more standard, and obsoletes
two sysctls (inet_peer_gc_mintime and inet_peer_gc_maxtime). This also
removes two pointers in inet_peer structure.
There is still a false sharing effect because refcnt is in first cache
line of object [were the links and keys used by lookups are located], we
might move it at the end of inet_peer structure to let this first cache
line mostly read by cpus.
Signed-off-by: Eric Dumazet <eric.dumazet@gmail.com>
CC: Andi Kleen <andi@firstfloor.org>
CC: Tim Chen <tim.c.chen@linux.intel.com>
Signed-off-by: David S. Miller <davem@davemloft.net>
2011-06-08 17:05:30 -07:00
2011-05-26 10:55:15 -07:00
2011-05-26 17:12:34 -07:00
2011-05-29 01:50:40 -04:00
2010-08-04 15:21:40 +02:00
2011-05-25 21:47:48 +01:00
2009-09-24 07:20:57 -07:00
2010-08-06 12:55:52 -04:00
2011-03-31 11:26:23 -03:00
2011-05-06 08:23:59 -06:00
2010-08-04 15:21:40 +02:00
2011-05-26 17:12:34 -07:00
2010-04-23 02:09:52 +02:00
2010-02-24 13:51:32 +01:00
2011-03-16 17:54:31 -04:00
2008-02-14 00:16:13 -05:00
2008-10-16 11:21:30 -07:00
2009-08-29 19:09:27 -07:00
2011-03-25 14:30:31 -06:00
2011-03-31 11:26:23 -03:00
2011-05-27 22:59:57 +01:00
2011-05-27 20:06:53 -07:00
2011-05-06 18:01:05 -07:00
2011-04-07 11:14:49 -07:00
2008-04-21 22:19:05 +00:00
2010-03-06 11:26:32 -08:00
2011-03-31 11:26:23 -03:00
2011-05-28 13:03:41 -07:00
2010-08-05 13:53:34 -07:00
2008-02-03 15:54:28 +02:00
2011-03-22 11:43:51 +01:00
2011-05-25 20:43:33 +02:00
2011-05-24 20:58:49 +02:00
2011-03-31 11:26:23 -03:00
2011-03-31 11:26:23 -03:00
2009-06-07 13:52:52 +02:00
2010-08-04 15:21:40 +02:00
2011-05-16 22:48:24 -07:00
2011-05-25 16:55:55 -07:00
2011-03-31 11:26:23 -03:00
2011-04-19 16:53:45 -07:00
2011-05-25 16:54:01 -07:00
2010-11-25 14:36:38 +01:00
2010-11-15 23:50:13 +01:00
2011-05-27 12:36:46 -04:00
2011-04-04 17:51:47 -07:00
2008-01-11 18:22:30 -06:00
2010-12-14 22:16:19 +01:00
2011-03-31 11:26:23 -03:00
2011-03-31 11:26:23 -03:00
2011-05-24 21:01:21 -04:00
2009-06-12 18:01:47 +02:00
2010-08-04 15:21:40 +02:00
2007-11-29 09:24:53 -08:00
2010-04-23 02:09:52 +02:00
2011-06-08 17:05:30 -07:00
2011-01-13 08:03:19 -08:00
2011-03-31 11:26:23 -03:00
2010-09-29 17:20:24 +02:00
2011-05-27 10:34:37 +01:00
2011-03-31 11:26:23 -03:00
2011-01-13 08:03:21 -08:00
2008-04-19 19:19:55 +02:00
2011-05-13 16:31:00 -07:00
2011-05-23 13:01:00 -07:00
2011-03-23 19:46:41 -07:00
2011-05-26 09:42:23 -07:00
2011-04-04 17:51:47 -07:00
2011-03-31 13:00:35 +02:00
2011-05-24 12:36:06 -04:00
2011-05-19 15:59:38 -07:00
2011-03-31 11:26:23 -03:00
2010-11-15 18:25:12 +09:00
2011-05-22 10:01:35 +02:00
2008-08-29 02:15:25 -07:00
2011-03-31 11:26:23 -03:00
2011-05-26 17:12:36 -07:00
2011-03-23 11:36:45 -05:00
2011-03-31 11:26:23 -03:00
2011-01-12 00:08:35 -05:00
2011-05-17 10:52:02 +02:00
2011-04-24 13:18:38 +02:00
2011-05-23 12:33:02 -07:00
2011-05-20 09:30:36 -03:00
2011-05-30 11:14:12 +09:30
2011-05-26 10:50:56 -07:00
2011-03-31 11:26:23 -03:00
2011-03-31 11:26:23 -03:00
2009-01-07 10:00:18 -08:00
2011-05-10 17:22:06 +02:00
2011-05-06 17:59:20 -07:00
2010-04-08 11:34:34 +02:00
2011-05-20 09:10:04 -07:00
2011-05-26 17:12:34 -07:00
2008-12-03 16:09:53 -07:00
2010-08-04 15:21:40 +02:00
2009-06-12 18:01:47 +02:00
2008-07-25 10:53:30 -07:00
2009-08-22 14:25:32 -07:00
2008-02-06 10:41:09 -08:00
2010-07-20 17:49:30 +00:00
2011-05-25 08:39:21 -07:00
2011-03-22 17:44:17 -07:00
2010-03-24 16:31:22 -07:00
2010-12-03 12:27:01 +01:00
2011-03-22 17:44:16 -07:00
2011-03-31 11:26:23 -03:00
2007-03-01 14:53:39 -08:00
2010-09-09 20:41:25 +02:00
2008-02-03 15:27:38 +02:00
2009-10-03 09:28:11 +02:00
2011-03-31 11:26:23 -03:00
2010-10-28 09:35:11 -07:00
2010-08-14 11:56:46 -07:00
2010-08-11 08:59:21 -07:00
2008-07-22 10:39:36 +10:00
2011-05-25 14:49:20 -07:00
2011-05-23 15:14:11 -07:00
2011-03-27 19:46:59 -07:00
2011-04-07 11:14:49 -07:00
2011-03-31 11:26:23 -03:00
2011-01-13 08:03:15 -08:00
2011-05-29 11:18:09 -07:00
2011-04-28 16:12:47 -04:00
2009-05-09 07:12:50 +02:00
2009-09-21 15:14:56 +02:00
2011-01-13 17:26:46 -08:00
2008-04-21 15:10:15 -07:00
2011-05-23 15:14:11 -07:00
2008-03-24 19:22:19 -07:00
2011-02-17 09:52:03 -08:00
2010-03-06 11:26:29 -08:00
2008-02-03 14:54:41 +02:00
2010-08-04 15:21:40 +02:00
2009-09-19 09:37:23 -07:00
2008-11-03 18:21:44 +01:00
2011-03-23 20:44:18 +01:00
2010-12-14 00:22:00 -05:00
2011-05-25 08:39:45 -07:00
2011-03-31 11:26:23 -03:00
2007-10-20 02:37:21 +02:00
2010-09-11 16:49:21 -07:00
2011-01-06 09:59:38 -08:00
2011-06-02 05:48:50 +09:00
2009-07-01 22:36:22 +02:00
2011-04-04 17:51:46 -07:00
2010-03-19 07:12:20 -07:00
2010-11-01 15:38:34 -04:00
2011-03-07 13:20:05 -08:00
2010-08-04 15:21:40 +02:00
2009-06-12 18:01:47 +02:00
2009-08-07 12:03:46 +02:00
2011-05-28 17:03:29 +02:00
2009-04-27 12:00:27 -07:00
2009-04-27 12:00:27 -07:00
2011-01-12 20:02:48 -05:00
2010-12-29 08:17:12 -02:00
2008-10-30 11:38:46 -07:00
2008-03-17 09:03:05 +01:00
2011-04-20 15:40:01 +10:00
2011-03-31 11:26:23 -03:00
2011-03-04 08:05:49 -08:00
2011-02-03 16:08:57 -08:00
2009-09-22 07:17:26 -07:00
2010-09-03 08:19:51 +02:00
2008-10-30 19:07:04 +01:00
2009-12-15 08:53:24 -08:00
2009-09-22 07:17:39 -07:00
2010-05-19 08:37:43 +01:00
2010-08-11 08:59:18 -07:00
2007-11-26 19:39:01 -08:00
2010-02-05 12:22:44 +01:00
2008-11-12 17:17:17 -08:00
2010-11-11 12:09:59 +01:00
2010-03-10 17:09:33 -05:00
2009-06-18 13:03:56 -07:00
2010-06-05 17:39:09 +02:00
2011-03-09 11:25:10 -08:00
2008-10-16 11:21:32 -07:00
2011-03-31 11:26:23 -03:00
2009-06-12 18:01:47 +02:00
2010-07-19 10:56:54 +02:00
2011-01-27 12:30:38 +01:00
2011-03-30 12:02:05 +02:00
2010-04-22 15:24:56 -07:00
2010-05-24 07:31:20 -07:00
2011-03-31 11:26:23 -03:00
2011-05-23 15:14:11 -07:00
2010-03-16 11:47:56 +01:00
2010-10-26 17:32:41 -07:00
2008-07-25 10:53:27 -07:00
2011-05-23 15:14:11 -07:00
2006-12-20 01:46:58 -05:00
2010-03-24 16:31:20 -07:00
2011-03-31 13:40:42 +02:00
2011-01-13 08:03:24 -08:00
4b9d9be839
