Joanne Koong d5a42de8bd net: Add a second bind table hashed by port and address ... We currently have one tcp bind table (bhash) which hashes by port number only. In the socket bind path, we check for bind conflicts by traversing the specified port's inet_bind2_bucket while holding the bucket's spinlock (see inet_csk_get_port() and inet_csk_bind_conflict()). In instances where there are tons of sockets hashed to the same port at different addresses, checking for a bind conflict is time-intensive and can cause softirq cpu lockups, as well as stops new tcp connections since __inet_inherit_port() also contests for the spinlock. This patch proposes adding a second bind table, bhash2, that hashes by port and ip address. Searching the bhash2 table leads to significantly faster conflict resolution and less time holding the spinlock. Signed-off-by: Joanne Koong <joannelkoong@gmail.com> Reviewed-by: Eric Dumazet <edumazet@google.com> Acked-by: Kuniyuki Iwashima <kuniyu@amazon.co.jp> Signed-off-by: Jakub Kicinski <kuba@kernel.org>		2022-05-20 18:16:24 -07:00
..
9p	net/p9: load default transports	2022-01-10 10:00:09 +09:00
bluetooth	Bluetooth: Fix the creation of hdev->name	2022-05-11 17:18:42 -07:00
caif	net: remove the caif_hsi driver	2021-07-01 13:19:48 -07:00
iucv	net/af_iucv: Use struct_group() to zero struct iucv_sock region	2021-11-19 11:52:25 +00:00
netfilter	netfilter: nf_conncount: reduce unnecessary GC	2022-05-16 13:05:40 +02:00
netns	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netfilter/nf-next	2022-05-16 10:10:37 +01:00
nfc	NFC: add NCI_UNREG flag to eliminate the race	2021-11-17 20:17:05 -08:00
phonet
sctp	net: remove noblock parameter from recvmsg() entities	2022-04-12 15:00:25 +02:00
tc_act	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2022-05-12 16:15:30 -07:00
6lowpan.h
act_api.h	net/sched: act_api: Add extack to offload_act_setup() callback	2022-04-08 13:45:43 +01:00
addrconf.h	net: Add new protocol attribute to IP addresses	2022-02-18 21:20:06 -08:00
af_ieee802154.h
af_rxrpc.h	afs: Don't truncate iter during data fetch	2021-04-23 10:17:26 +01:00
af_unix.h	af_unix: Replace the big lock with small locks.	2021-11-26 18:01:58 -08:00
af_vsock.h	vsock: each transport cycles only on its own sockets	2022-03-11 23:14:19 -08:00
ah.h
amt.h	amt: add mld report message handler	2021-11-01 13:36:09 +00:00
arp.h	ipv4: Invalidate neighbour for broadcast address upon address addition	2022-02-21 11:44:30 +00:00
atmclip.h
ax25.h	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2022-02-03 17:36:16 -08:00
ax88796.h	ax88796: export ax_NS8390_init() hook	2021-08-03 13:05:25 +01:00
bareudp.h	bareudp: Move definition of struct bareudp_conf to bareudp.c	2021-12-13 12:34:09 +00:00
bond_3ad.h	bonding: fix data-races around agg_select_timer	2022-02-15 14:35:18 +00:00
bond_alb.h	bonding: make tx_rebalance_counter an atomic	2021-12-03 14:16:48 +00:00
bond_options.h	bonding: add new option ns_ip6_target	2022-02-21 12:13:45 +00:00
bonding.h	net: add per-cpu storage and net->core_stats	2022-03-11 23:17:24 -08:00
bpf_sk_storage.h	bpf: struct sock is declared twice in bpf_sk_storage header	2021-03-26 17:43:55 +01:00
busy_poll.h	tcp: fix another uninit-value (sk_rx_queue_mapping)	2021-12-03 14:15:49 +00:00
calipso.h
cfg80211-wext.h
cfg80211.h	cfg80211: fix kernel-doc for cfg80211_beacon_data	2022-05-17 12:48:49 +02:00
cfg802154.h	net: mac802154: Set durations automatically	2022-02-10 15:41:58 +01:00
checksum.h	powerpc/net: Implement powerpc specific csum_shift() to remove branch	2022-03-11 10:57:22 +00:00
cipso_ipv4.h	cipso: Remove unused inline functions	2020-07-15 07:45:24 -07:00
cls_cgroup.h	bpf: Allow to retrieve cgroup v1 classid from v2 hooks	2020-03-27 19:40:38 -07:00
codel.h	codel: remove unnecessary pkt_sched.h include	2021-12-22 15:03:51 -08:00
codel_impl.h	codel: remove unnecessary sock.h include	2021-12-22 15:03:47 -08:00
codel_qdisc.h	codel: remove unnecessary pkt_sched.h include	2021-12-22 15:03:51 -08:00
compat.h	net/ipv4/ipv6: Replace one-element arraya with flexible-array members	2021-08-05 11:46:42 +01:00
datalink.h	llc/snap: constify dev_addr passing	2021-10-13 09:40:46 -07:00
dcbevent.h
dcbnl.h
devlink.h	Revert "Merge branch 'mlxsw-line-card-model'"	2022-05-05 15:47:23 -07:00
dn.h	decnet: constify dev_addr passing	2021-10-13 09:40:46 -07:00
dn_dev.h
dn_fib.h	net: convert fib_treeref from int to refcount_t	2021-07-30 15:33:24 +02:00
dn_neigh.h
dn_nsp.h
dn_route.h
dsa.h	net: dsa: remove port argument from ->change_tag_protocol()	2022-05-12 16:38:55 -07:00
dsfield.h
dst.h	net: dst: add net device refcount tracking to dst_entry	2021-12-06 16:05:10 -08:00
dst_cache.h	wireguard: device: reset peer src endpoint when netns exits	2021-11-29 19:50:45 -08:00
dst_metadata.h	net: fix a memleak when uncloning an skb dst and its metadata	2022-02-09 11:41:47 +00:00
dst_ops.h	net/dst: use a smaller percpu_counter batch for dst entries accounting	2020-05-08 21:33:33 -07:00
erspan.h	erspan: Add type I version 0 support.	2020-05-05 13:23:29 -07:00
esp.h	esp: limit skb_page_frag_refill use to a single page	2022-04-13 10:16:11 +02:00
espintcp.h	xfrm: espintcp: save and call old ->sk_destruct	2020-04-20 07:34:16 +02:00
ethoc.h
failover.h	net: failover: add net device refcount tracker	2021-12-06 16:06:02 -08:00
fib_notifier.h
fib_rules.h	fib: expand fib_rule_policy	2021-12-16 07:18:35 -08:00
firewire.h
flow.h	net: Add l3mdev index to flow struct and avoid oif reset for port devices	2022-03-15 20:20:02 -07:00
flow_dissector.h	flow_dissector: Add number of vlan tags dissector	2022-04-20 11:09:13 +01:00
flow_offload.h	net/sched: add vlan push_eth and pop_eth action to the hardware IR	2022-03-16 19:59:36 -07:00
fou.h
fq.h	net/fq_impl: do not maintain a backlog-sorted list of flows	2021-01-21 13:33:45 +01:00
fq_impl.h	net/fq_impl: do not maintain a backlog-sorted list of flows	2021-01-21 13:33:45 +01:00
garp.h
gen_stats.h	net: sched: Remove Qdisc::running sequence counter	2021-10-18 12:54:41 +01:00
genetlink.h	mptcp: avoid lock_fast usage in accept path	2021-02-12 16:31:46 -08:00
geneve.h
gre.h	ip_gre: add csum offload support for gre header	2021-01-29 20:39:14 -08:00
gro.h	net: gro: Fix a 'directive in macro's argument list' sparse warning	2022-02-18 11:00:25 +00:00
gro_cells.h
gtp.h	gtp: Add support for checking GTP device type	2022-03-11 08:28:27 -08:00
gue.h	GUE: Fix a typo	2020-06-22 21:12:44 -07:00
hwbm.h
icmp.h	ipv6: ICMPV6: add response to ICMPV6 RFC 8335 PROBE messages	2021-06-28 14:29:45 -07:00
ieee80211_radiotap.h	ieee80211: radiotap: fix -Wcast-qual warnings	2022-02-04 16:25:21 +01:00
ieee802154_netdev.h
if_inet6.h	ipv6: fix locking issues with loops over idev->addr_list	2022-04-06 22:09:39 -07:00
ife.h
ila.h
inet6_connection_sock.h
inet6_hashtables.h	ipv6: add READ_ONCE(sk->sk_bound_dev_if) in INET6_MATCH()	2022-05-16 10:31:06 +01:00
inet_common.h	bpf: Allow rewriting to ports under ip_unprivileged_port_start	2021-01-27 18:18:15 -08:00
inet_connection_sock.h	net: Add a second bind table hashed by port and address	2022-05-20 18:16:24 -07:00
inet_dscp.h	ipv6: Define dscp_t and stop taking ECN bits into account in fib6-rules	2022-02-07 20:12:45 -08:00
inet_ecn.h	net: add skb_get_dsfield() helper	2021-10-15 11:33:08 +01:00
inet_frag.h	net: ip: Handle delivery_time in ip defrag	2022-03-03 14:38:48 +00:00
inet_hashtables.h	net: Add a second bind table hashed by port and address	2022-05-20 18:16:24 -07:00
inet_sock.h	tcp: sk->sk_bound_dev_if once in inet_request_bound_dev_if()	2022-05-16 10:31:06 +01:00
inet_timewait_sock.h	Revert "tcp/dccp: get rid of inet_twsk_purge()"	2022-05-13 12:24:12 +01:00
inetpeer.h
ioam6.h	treewide: Replace zero-length arrays with flexible-array members	2022-02-17 07:00:39 -06:00
ip.h	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2022-05-19 11:23:59 -07:00
ip6_checksum.h	net: move gro definitions to include/net/gro.h	2021-11-16 13:16:54 +00:00
ip6_fib.h	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2022-02-17 11:44:20 -08:00
ip6_route.h	ipv6: ip6_skb_dst_mtu() cleanups	2021-11-19 20:09:55 -08:00
ip6_tunnel.h	ip_gre, ip6_gre: Fix race condition on o_seqno in collect_md mode	2022-04-25 11:40:45 +01:00
ip_fib.h	ipv4: Use dscp_t in struct fib_entry_notifier_info	2022-04-11 17:37:50 -07:00
ip_tunnels.h	ip_gre, ip6_gre: Fix race condition on o_seqno in collect_md mode	2022-04-25 11:40:45 +01:00
ip_vs.h	ipvs: add sysctl_run_estimation to support disable estimation	2021-10-07 19:52:58 +02:00
ipcomp.h
ipconfig.h
ipv6.h	net: allow gro_max_size to exceed 65536	2022-05-16 10:18:56 +01:00
ipv6_frag.h	net: don't include ndisc.h from ipv6.h	2022-02-04 14:15:11 -08:00
ipv6_stubs.h	net: ipv6: add fib6_nh_release_dsts stub	2021-11-22 15:44:49 +00:00
iw_handler.h
kcm.h
l3mdev.h	l3mdev: add infrastructure for table to VRF mapping	2020-06-20 17:22:22 -07:00
lag.h
lapb.h	net: lapb: Make "lapb_t1timer_running" able to detect an already running timer	2021-03-23 14:14:50 -07:00
lib80211.h
llc.h	llc: fix out-of-bound array index in llc_sk_dev_hash()	2021-11-07 19:25:29 +00:00
llc_c_ac.h
llc_c_ev.h
llc_c_st.h
llc_conn.h	llc: add net device refcount tracker	2021-12-07 20:44:59 -08:00
llc_if.h	llc/snap: constify dev_addr passing	2021-10-13 09:40:46 -07:00
llc_pdu.h	net: llc: fix skb_over_panic	2021-07-27 13:05:56 +01:00
llc_s_ac.h
llc_s_ev.h
llc_s_st.h
llc_sap.h
lwtunnel.h	netfilter: add netfilter hooks to SRv6 data plane	2021-08-30 01:51:36 +02:00
mac80211.h	mac80211: extend current rate control tx status API	2022-05-16 10:05:02 +02:00
mac802154.h	net: mac802154: Create an error helper for asynchronous offloading errors	2022-04-25 20:51:12 +02:00
macsec.h	net: macsec: fix the length used to copy the key for offloading	2021-06-24 12:41:12 -07:00
mctp.h	mctp: Use output netdev to allocate skb headroom	2022-04-01 12:04:15 +01:00
mctpdevice.h	mctp: Pass flow data & flow release events to drivers	2021-10-29 13:23:51 +01:00
mip6.h
mld.h	mld: add new workqueues for process mld events	2021-03-26 15:14:56 -07:00
mpls.h	net: Make mpls_entry_encode() available for generic users	2020-05-29 21:20:20 -07:00
mpls_iptunnel.h
mptcp.h	tcp: allow MPTCP to update the announced window	2022-05-05 19:00:15 -07:00
mrp.h
ncsi.h
ndisc.h	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2022-03-03 11:55:12 -08:00
neighbour.h	net, neigh: Do not trigger immediate probes on NUD_FAILED from neigh_managed_work	2022-02-02 20:30:18 -08:00
net_debug.h	net: add CONFIG_DEBUG_NET	2022-05-11 12:43:10 +01:00
net_failover.h
net_namespace.h	net: make net->dev_unreg_count atomic	2022-02-10 15:30:26 +00:00
net_ratelimit.h
net_trackers.h	net: add networking namespace refcount tracker	2021-12-10 06:38:26 -08:00
netevent.h
netlabel.h
netlink.h	net: netlink: add the case when nlh is NULL	2021-07-27 11:43:50 +01:00
netprio_cgroup.h
netrom.h
nexthop.h	net: ipv4: Fix rtnexthop len when RTA_FLOW is present	2021-09-24 14:07:10 +01:00
nl802154.h	net: ieee802154: handle iftypes as u32	2021-11-16 18:02:46 +01:00
nsh.h
p8022.h
page_pool.h	net: page_pool: introduce ethtool stats	2022-04-15 10:43:47 +01:00
pie.h
ping.h	net: remove noblock parameter from recvmsg() entities	2022-04-12 15:00:25 +02:00
pkt_cls.h	net/sched: act_api: Add extack to offload_act_setup() callback	2022-04-08 13:45:43 +01:00
pkt_sched.h	net: sched: remove psched_tdiff_bounded()	2022-01-27 13:53:27 +00:00
pptp.h
protocol.h	net: Remove the member netns_ok	2021-05-17 15:29:35 -07:00
psample.h	psample: Add a fwd declaration for skbuff	2021-08-09 15:34:21 -07:00
psnap.h
raw.h
rawv6.h
red.h	sch_red: fix off-by-one checks in red_check_params()	2021-03-25 17:40:43 -07:00
regulatory.h	net/wireless: regulatory.h: drop duplicate word in comment	2020-07-31 09:24:23 +02:00
request_sock.h	tcp: Use BPF timeout setting for SYN ACK RTO	2022-02-02 14:45:18 +00:00
rose.h	rose: constify dev_addr passing	2021-10-13 09:40:45 -07:00
route.h	ipv4: Avoid using RTO_ONLINK with ip_route_connect().	2022-04-22 13:06:03 +01:00
rpl.h	net: ipv6: Use struct_size() helper and kcalloc()	2020-06-23 20:27:09 -07:00
rsi_91x.h
rtnetlink.h	net: rtnetlink: add bulk delete support flag	2022-04-13 12:46:26 +01:00
rtnh.h
sch_generic.h	net: sched: remove qdisc_qlen_cpu()	2022-01-27 13:53:27 +00:00
scm.h	fs: Move __scm_install_fd() to __receive_fd()	2020-07-13 11:03:44 -07:00
secure_seq.h	secure_seq: use the 64 bits of the siphash for port offset calculation	2022-05-04 19:22:20 -07:00
seg6.h	udp6: Use Segment Routing Header for dest address if present	2022-01-04 12:17:35 +00:00
seg6_hmac.h
seg6_local.h
selftests.h	net: selftest: fix build issue if INET is disabled	2021-04-28 14:06:45 -07:00
slhc_vj.h
smc.h	net/smc: introduce CHID callback for ISM devices	2020-09-28 15:19:03 -07:00
snmp.h
sock.h	net: Add a second bind table hashed by port and address	2022-05-20 18:16:24 -07:00
sock_reuseport.h	tcp: Add reuseport_migrate_sock() to select a new listener.	2021-06-15 18:01:05 +02:00
Space.h	wan: remove sbni/granch driver	2021-08-03 13:05:26 +01:00
stp.h
strparser.h	tls: rx: don't store the decryption status in socket context	2022-04-08 11:49:08 +01:00
switchdev.h	net: bridge: mst: Notify switchdev drivers of MST state changes	2022-03-17 16:49:58 -07:00
tcp.h	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2022-04-28 13:02:01 -07:00
tcp_states.h
timewait_sock.h
tipc.h
tls.h	tls: Add opt-in zerocopy mode of sendfile()	2022-05-19 12:14:11 +02:00
tls_toe.h
transp_v6.h	tcp: move ipv4_specific to tcp include file	2020-06-23 20:10:15 -07:00
tso.h	net: tso: cache transport header length	2020-06-18 20:46:23 -07:00
tun_proto.h
udp.h	net: remove noblock parameter from recvmsg() entities	2022-04-12 15:00:25 +02:00
udp_tunnel.h	udp: call udp_encap_enable for v6 sockets when enabling encap	2021-02-04 18:37:14 -08:00
udplite.h	udplite: remove udplite_csum_outgoing()	2022-01-27 13:53:27 +00:00
vsock_addr.h
vxlan.h	drivers: vxlan: vnifilter: per vni stats	2022-03-01 08:38:02 +00:00
wext.h
x25.h
x25device.h
xdp.h	net: veth: Account total xdp_frame len running ndo_xdp_xmit	2022-03-17 20:33:52 +01:00
xdp_priv.h	xsk: Wipe out dead zero_copy_allocator declarations	2021-12-14 00:24:24 +01:00
xdp_sock.h	net: Don't include filter.h from net/sock.h	2021-12-29 08:48:14 -08:00
xdp_sock_drv.h	i40e: xsk: Move tmp desc array from driver to pool	2022-01-27 17:25:32 +01:00
xfrm.h	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2022-05-19 11:23:59 -07:00
xsk_buff_pool.h	xsk: Fix possible crash when multiple sockets are created	2022-04-26 16:19:54 +02:00