Commit graph

322 commits

Author SHA1 Message Date
Joakim Frostegård
20eef8677d udp: add integration test 2023-08-27 12:17:51 +02:00
Joakim Frostegård
7f01f4024a Upgrade hashbrown and indexmap crates 2023-07-30 20:32:30 +02:00
Joakim Frostegård
8323d963c9 udp: don't incorrectly remove peers in client counting 2023-06-10 00:05:23 +02:00
Joakim Frostegård
e6b0585372 udp: update config comments 2023-06-08 01:25:58 +02:00
Joakim Frostegård
da25d60a5d udp: improve peer client statistics 2023-06-08 01:06:19 +02:00
Joakim Frostegård
467f75e1fb udp: use prettier formatting for html peer client count output 2023-06-07 13:39:38 +02:00
Joakim Frostegård
47b45f28d5 udp: add separate config flag for prometheus peer client reports 2023-06-07 13:28:38 +02:00
Joakim Frostegård
00c4e61ed9 udp: fix template error 2023-06-07 13:06:44 +02:00
Joakim Frostegård
08b28c9e1b udp statistics: improve peer client reporting
- fix prometheus peer id prefix reporting
- don't report peer id prefix in html output (current method
  was incorrect and output would become huge)
2023-06-07 12:58:41 +02:00
Joakim Frostegård
a74d6aa458 udp: initial support for listing peer clients 2023-06-06 01:04:37 +02:00
Joakim Frostegård
8734855c49 Upgrade metrics, metrics-exporter, tungstenite & async-tungstenite 2023-06-03 18:03:51 +02:00
Joakim Frostegård
4dba6f92cd Run cargo fmt 2023-04-10 01:05:23 +02:00
Joakim Frostegård
67f765f003 Upgrade io-uring to v0.6 2023-04-10 00:53:56 +02:00
Joakim Frostegård
a0255ff919 Upgrade socket2 to v0.5 2023-04-10 00:49:55 +02:00
Joakim Frostegård
cf08e96a7e udp: uring: store pending_scrape_valid_until in SocketWorker 2023-03-15 23:32:13 +01:00
Joakim Frostegård
d6f8adcb53 udp: uring: reduce buffer sizes 2023-03-15 23:29:59 +01:00
Joakim Frostegård
d61bc34521 udp: uring: minor refactoring 2023-03-10 00:29:22 +01:00
Joakim Frostegård
612cc4cf62 udp: uring: refactor SocketWorker, fix Timespec UB 2023-03-10 00:17:39 +01:00
Joakim Frostegård
3cf6e30159 udp: uring: rename SendBuffers.mark_index_as_free 2023-03-09 23:00:10 +01:00
Joakim Frostegård
442ae5154e udp: improve config docs 2023-03-09 22:57:22 +01:00
Joakim Frostegård
987c880e01 udp: improve config comments for resend_buffer_max_len 2023-03-09 22:16:57 +01:00
Joakim Frostegård
63c705fd17 udp: config: rename ring_entries to ring_size 2023-03-09 22:15:57 +01:00
Joakim Frostegård
0f333d4755 udp: uring: set send_buffer_entries to ring_entries, improve comments 2023-03-09 22:15:19 +01:00
Joakim Frostegård
587dd07131 udp: uring: decrease request buffer sizes 2023-03-09 21:57:37 +01:00
Joakim Frostegård
fe294e8119 udp: uring: wait for num_send_added.max(1), improve comments 2023-03-09 21:53:48 +01:00
Joakim Frostegård
f89bdce7f0 udp: uring: change SendBuffer unsafe declarations, add comments 2023-03-09 21:30:03 +01:00
Joakim Frostegård
aae19c4cb3 udp: uring: combine SendBuffers metadata lookups 2023-03-08 14:40:29 +01:00
Joakim Frostegård
1be6d4fa61 udp: uring: improve log messages 2023-03-08 14:31:45 +01:00
Joakim Frostegård
d862da2aef udp: uring: add recv_helper::Error type 2023-03-08 14:14:15 +01:00
Joakim Frostegård
9bb69627c8 udp: uring: branch less in RecvHelper::parse 2023-03-08 13:54:49 +01:00
Joakim Frostegård
aa2c36a373 udp: uring: rewrite RecvHelper to use UnsafeCell 2023-03-08 13:43:11 +01:00
Joakim Frostegård
fa93f38d82 udp: uring: improve SendBuffers code 2023-03-08 13:33:14 +01:00
Joakim Frostegård
339feb3d0a udp: uring: rewrite SendBuffers to use UnsafeCell 2023-03-08 13:14:35 +01:00
Joakim Frostegård
2e67f11caf
udp: add experimental io_uring implementation (#131)
* WIP: add udp uring support

* WIP: fix udp uring address parsing

* WIP: udp uring: resubmit recv when needed

* WIP: udp uring: add OutMessageStorage, send swarm responses

* WIP: udp uring: increase ring entries to 1024

* WIP: udp uring: add constants

* WIP: udp uring: use sqpoll, avoid kernel calls

* WIP: udp uring: disable sqpoll

* WIP: udp uring: use VecDeque for local responses

* udp uring: enable setup_coop_taskrun

* udp uring: add RecvMsgStorage

* udp: improve split of uring and mio implementations

* udp uring: clean up

* udp uring: initial ipv6 support

* udp uring: improve helper structs

* udp uring: clean up, use constants for important data

* udp: share create_socket fn between implementations

* udp uring: improve send buffer free index finding

* udp uring: work on SendBuffers.try_add

* udp uring: split into modules

* udp uring: Rename RecvMsgMultiHelper to RecvHelper

* udp uring: improve SendBuffers

* udp uring: fix copyright attribution in buf_ring module

* udp uring: stop always consuming 100% cpu

* udp uring: clean up

* udp uring: add handle_recv_cqe

* udp uring: move local_responses into SocketWorker

* udp uring: move timeout_timespec into SocketWorker

* Update TODO

* udp: make io-uring optional

* Update TODO

* udp uring: enqueue timeout before sends

* udp uring: move likely empty buffer tracking logic into SendBuffers

* udp uring: improve error handling and logging

* udp uring: keep one timeout submitted at a time

* udp uring: update pending_scrape_valid_until

* udp uring: add second timeout for cleaning

* Update TODO

* udp uring: store resubmittable squeue entries in a Vec

* udp uring: add comment, remove a log statement

* Update TODO

* Update TODO

* udp: io_uring: fall back to mio if io_uring support not recent enough

* udp: uring: add bytes_received statistics

* udp: uring: add bytes_sent statistics

* udp: uring: add more statistics

* Update TODO

* udp: uring: improve SendBuffers code

* udp: uring: remove unneeded squeue sync calls

* udp: uring: replace buf_ring impl with one from tokio-uring

* udp: uring: store ring in TLS so it can be used in Drop impls

* udp: uring: store BufRing in SocketWorker

* udp: uring: silence buf_ring dead code warnings, improve comment

* Update TODO

* udp: uring: improve CurrentRing docs, use anonymous struct field

* udp: uring: improve ring setup

* udp: uring: get ipv6 working

* udp: uring: make ring entry count configurable, use more send entries

* udp: uring: log number of pending responses (info level)

* udp: uring: improve comment on send_buffer_entries calculation

* udp: improve config comments

* udp: uring: add to responses stats when they are confirmed as sent

* Update TODO

* udp: uring: enable IoUring setup_submit_all

* Update README
2023-03-07 19:01:37 +01:00
Joakim Frostegård
3806faaff9 udp: only include prometheus fields in config if feature enabled 2023-02-26 16:41:37 +01:00
Joakim Frostegård
f1d0901416 udp: check statistics.extended config for prometheus 2023-02-26 12:10:54 +01:00
Joakim Frostegård
07eac06a36 Enable prometheus by default, update README 2023-02-26 12:10:12 +01:00
Joakim Frostegård
9e7e56b082 udp: prometheus metrics for peers per torrent, add p999 2023-02-26 12:07:14 +01:00
Joakim Frostegård
5276a919da udp: add prometheus support 2023-02-26 11:57:00 +01:00
Joakim Frostegård
b42d55b003 Replace indexmap-amortized with plain (ahash) indexmap 2023-02-25 22:37:54 +01:00
Joakim Frostegård
9ace8f53b8 Upgrade hashbrown to version 0.13 2022-11-12 14:37:53 +01:00
Joakim Frostegård
82122da762 udp: in bandwidth statistics, take headers etc into account 2022-11-01 18:13:15 +01:00
Joakim Frostegård
c192ee6e5a udp: simplify statistics code further 2022-11-01 09:36:20 +01:00
Joakim Frostegård
3d6b012490 udp: refactor statistics code for better code clarity 2022-10-31 23:53:07 +01:00
Joakim Frostegård
77f5e68a9e udp: TorrentData: stop explicitly storing num_leechers
Calculate it with peers.len() - num_seeders instead
2022-10-26 20:59:25 +02:00
Joakim Frostegård
15f8d30518 udp: improve socket worker comments 2022-10-25 02:16:16 +02:00
Joakim Frostegård
224ae3ea3b udp: socket worker: always use relaxed ordering for stats 2022-10-25 02:00:55 +02:00
Joakim Frostegård
5e28f5a498 udp: handle request parse errors outside of handle_request function 2022-10-25 01:55:32 +02:00
Joakim Frostegård
4587c267d6 udp: rewrite socket worker to use SocketWorker struct
Also, stop checking token number all the time
2022-10-25 01:33:35 +02:00
Joakim Frostegård
ed98327e1a udp: if PeerStatus is Stopped, return empty peer list 2022-09-25 11:51:28 +02:00