Eric Dumazet 4b0b72f7dd net: speedup udp receive path ...

Since commit 95766fff ([UDP]: Add memory accounting.), 
each received packet needs one extra sock_lock()/sock_release() pair.

This added latency because of possible backlog handling. Then later,
ticket spinlocks added yet another latency source in case of DDOS.

This patch introduces lock_sock_bh() and unlock_sock_bh()
synchronization primitives, avoiding one atomic operation and backlog
processing.

skb_free_datagram_locked() uses them instead of full blown
lock_sock()/release_sock(). skb is orphaned inside locked section for
proper socket memory reclaim, and finally freed outside of it.

UDP receive path now take the socket spinlock only once.

Signed-off-by: Eric Dumazet <eric.dumazet@gmail.com>
Signed-off-by: David S. Miller <davem@davemloft.net>

2010-04-28 14:35:48 -07:00

..

datagram.c

net: speedup udp receive path

2010-04-28 14:35:48 -07:00

dev_addr_lists.c

net: include linux/proc_fs.h in dev_addr_lists.c

2010-04-07 16:46:36 -07:00

dev.c

net: batch skb dequeueing from softnet input_pkt_queue

2010-04-27 15:11:49 -07:00

drop_monitor.c

include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h

2010-03-30 22:02:32 +09:00

dst.c

dst: don't inline dst_ifdown

2010-04-13 03:32:44 -07:00

ethtool.c

Merge branch 'master' of master.kernel.org:/pub/scm/linux/kernel/git/davem/net-2.6

2010-04-11 14:53:53 -07:00

fib_rules.c

net: fib_rules: mark arguments to fib_rules_register const and __net_initdata

2010-04-26 16:02:04 +02:00

filter.c

net: Socket filter ancilliary data access for skb->dev->type

2010-04-22 16:05:44 -07:00

flow.c

flow: delayed deletion of flow cache entries

2010-04-07 03:43:20 -07:00

gen_estimator.c

include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h

2010-03-30 22:02:32 +09:00

gen_stats.c

pkt_sched: gen_estimator: Dont report fake rate estimators

2009-10-07 01:07:42 -07:00

iovec.c

include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h

2010-03-30 22:02:32 +09:00

kmap_skb.h

…

link_watch.c

include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h

2010-03-30 22:02:32 +09:00

Makefile

net: convert multicast list to list_head

2010-04-03 14:22:15 -07:00

neighbour.c

include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h

2010-03-30 22:02:32 +09:00

net_namespace.c

net: disallow to use net_assign_generic externally

2010-04-27 15:49:02 -07:00

net-sysfs.c

rps: static functions

2010-04-19 14:40:57 -07:00

net-sysfs.h

netns: Fix device renaming for sysfs

2008-05-02 17:00:58 -07:00

net-traces.c

include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h

2010-03-30 22:02:32 +09:00

netevent.c

…

netpoll.c

include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h

2010-03-30 22:02:32 +09:00

pktgen.c

pktgen node allocation

2010-03-21 20:33:36 -07:00

request_sock.c

net: convert BUG_TRAP to generic WARN_ON

2008-07-25 21:43:18 -07:00

rtnetlink.c

Merge branch 'master' of git://git.kernel.org/pub/scm/linux/kernel/git/kaber/ipmr-2.6

2010-04-27 12:57:39 -07:00

scm.c

include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h

2010-03-30 22:02:32 +09:00

skbuff.c

net: Remove two unnecessary exports (skbuff).

2010-04-20 22:39:53 -07:00

sock.c

net: sk_add_backlog() take rmem_alloc into account

2010-04-27 15:13:20 -07:00

stream.c

net: sk_sleep() helper

2010-04-20 16:37:13 -07:00

sysctl_net_core.c

rfs: Receive Flow Steering

2010-04-16 16:01:27 -07:00

user_dma.c

net/core/user_dma.c: Use frag list abstraction interfaces.

2009-06-09 00:19:10 -07:00

utils.c

printk: Remove ratelimit.h from kernel.h

2009-09-22 16:18:09 +02:00