Commit Graph

1404 Commits

Author SHA1 Message Date
Bryan Stitt
d94e7f4453 check should_disconnect during the health check 2023-10-24 23:35:30 -07:00
Bryan Stitt
2e3b40a885 move health check during voting 2023-10-24 23:33:24 -07:00
Bryan Stitt
8d20019b5a include the rpc age in the serialized list 2023-10-24 23:29:23 -07:00
Bryan Stitt
336242ccc8 use a hash set to avoid duplicates 2023-10-24 23:11:34 -07:00
Bryan Stitt
27264f591f skip backups one more place 2023-10-24 22:46:47 -07:00
Bryan Stitt
5170f5f820 add todo comment 2023-10-24 21:55:11 -07:00
Bryan Stitt
16caf1d0fe dynamic max_head_block_age 2023-10-24 21:53:41 -07:00
Bryan Stitt
d706a53c04 skip backups in another place 2023-10-24 18:16:59 -07:00
Bryan Stitt
5fb64614fe use pin for some sleeps 2023-10-23 23:06:02 -07:00
Bryan Stitt
d5ac4b5d78 move health check inside consensus finder 2023-10-23 19:44:21 -07:00
Bryan Stitt
6cb2accd0d dedicated error for lagged servers 2023-10-23 18:46:53 -07:00
Bryan Stitt
32935644de Revert "streaming responses require premium instead of debug responses"
This reverts commit 0a4a6d783237af53a3fc4fa4892d891a2357b547.
2023-10-23 17:31:23 -07:00
Bryan Stitt
ca52e34762 cache larger responses 2023-10-23 16:19:54 -07:00
Bryan Stitt
0a4a6d7832 streaming responses require premium instead of debug responses 2023-10-23 15:47:19 -07:00
Bryan Stitt
45fb2e5ea6 require premium for debug module 2023-10-23 15:38:44 -07:00
Bryan Stitt
cef4edc17a more Cow 2023-10-23 15:30:01 -07:00
Bryan Stitt
4b44e787cb return early if no bytes given for the transaction 2023-10-23 13:45:51 -07:00
Bryan Stitt
049f927862 variable pricing for debug and ots methods 2023-10-23 13:36:31 -07:00
Bryan Stitt
4585724c08 1.43.56. check web3_clientVersion 2023-10-20 15:33:28 -07:00
Bryan Stitt
b5d34b0fad cache for 200ms 2023-10-20 12:30:54 -07:00
Bryan Stitt
c507cc89d3 dont cache transaction queries so that to_block is None 2023-10-20 12:30:10 -07:00
Bryan Stitt
2019888957 improve eth_sendRawTransaction 2023-10-20 12:02:03 -07:00
Bryan Stitt
2de4654fb2 check one more error message 2023-10-17 10:05:49 -07:00
Bryan Stitt
03c167f6eb todos 2023-10-17 10:05:35 -07:00
Bryan Stitt
7ce515f7f0 remove NullResult from another spot 2023-10-17 10:05:25 -07:00
Bryan Stitt
5071e8b298 use to_raw_value instead of to_string 2023-10-17 10:03:52 -07:00
Bryan Stitt
1e707251ef remove unused things 2023-10-17 00:46:06 -07:00
Bryan Stitt
042707eca2 maybe getting rid of this arc will fix streaming taking twice 2023-10-17 00:33:32 -07:00
Bryan Stitt
349624498f Revert "always buffer (again)"
This reverts commit 9ffbead73d9f4d91545962efba2a329ed006c475.
2023-10-16 19:02:25 -07:00
Bryan Stitt
9ffbead73d always buffer (again)
i see some errors in sentry. we need to figure them out before turning this back on
2023-10-16 15:09:01 -07:00
Bryan Stitt
369abae2fa make rdkafka fully optional 2023-10-16 12:06:10 -07:00
Bryan Stitt
b030773881 rewest timeout should be shorter than erigons 2023-10-16 11:10:46 -07:00
Bryan Stitt
7a81b1654b disable compression 2023-10-16 11:08:59 -07:00
Bryan Stitt
20a0b99f3a move future block check outside the wait future 2023-10-16 11:04:02 -07:00
Bryan Stitt
e80de22317 comment cleanup 2023-10-13 21:15:06 -07:00
Bryan Stitt
ba7eba41db allow_unhealthy should also skip checking block heights 2023-10-13 20:39:34 -07:00
Bryan Stitt
e11e6f6f27 shorter log 2023-10-13 20:23:40 -07:00
Bryan Stitt
97677cd746 remove some instruments 2023-10-13 19:46:20 -07:00
Bryan Stitt
ce3fbca7b6 fix eth_sendRawTransaction 2023-10-13 19:41:59 -07:00
Bryan Stitt
7cd7257058 update comments 2023-10-13 18:01:11 -07:00
Bryan Stitt
8067c33079 add todo 2023-10-13 00:46:46 -07:00
Bryan Stitt
aa3b40e03f add a spot for retries 2023-10-13 00:22:57 -07:00
Bryan Stitt
51ba539800 bring back outer rpc checking 2023-10-12 23:57:12 -07:00
Bryan Stitt
fc3d2420bd bring back head_delay 2023-10-12 23:33:25 -07:00
Bryan Stitt
93533eabc7 Revert "try a RwLock (more should be done if this works)"
This reverts commit 9aa33dae2d3869965ba131e8e561338f2298fd56.
2023-10-12 23:33:25 -07:00
Bryan Stitt
5df4bd8da8 Revert "async serialize"
This reverts commit d8e1bd44dc3cc53a6d8b7894d9280ee4a31c35ba.
2023-10-12 23:33:25 -07:00
Bryan Stitt
3b45256c9a always have some kind of health check 2023-10-12 21:05:17 -07:00
Bryan Stitt
51d86ade59 handle empty futures 2023-10-12 20:48:37 -07:00
Bryan Stitt
3bf7f6c34e replace subscribe_stop_rx with aborts 2023-10-12 20:17:40 -07:00
Bryan Stitt
9786fb58b2 use select_all more 2023-10-12 19:23:22 -07:00
Bryan Stitt
6bd5ca3277 only select on the balanced handle 2023-10-12 16:52:39 -07:00
Bryan Stitt
f73fd66b89 dont sleep at start
that was a gross fix anyways
2023-10-12 16:25:26 -07:00
Bryan Stitt
d27b91cad9 no need for try_join_all here 2023-10-12 16:06:15 -07:00
Bryan Stitt
2a421778ef get rid of a noop future 2023-10-12 14:30:17 -07:00
Bryan Stitt
06cd1cc3dd include phantomdata on the streaming response 2023-10-12 14:14:02 -07:00
Bryan Stitt
1178cb61a4 turn streaming on 2023-10-12 14:12:31 -07:00
Bryan Stitt
4009995bb3 move retries into request_with_metadata 2023-10-11 20:58:13 -07:00
Bryan Stitt
d8e1bd44dc async serialize 2023-10-11 12:34:56 -07:00
Bryan Stitt
874d8b1775 fix find and replace that missed the stripe feature 2023-10-11 12:00:36 -07:00
Bryan Stitt
a259b2b955 1.43.39 2023-10-11 10:57:41 -07:00
Bryan Stitt
9aa33dae2d try a RwLock (more should be done if this works) 2023-10-11 10:55:45 -07:00
Bryan Stitt
e43309abc0 move permits around and start rpcs slower 2023-10-11 04:18:53 -07:00
Bryan Stitt
072c52050f add another minimum sleep and set missed tick behavior 2023-10-11 01:42:55 -07:00
Bryan Stitt
15216b7d33 no waiting and simpler rpc looping 2023-10-11 01:23:08 -07:00
Bryan Stitt
38c6fbf246 delete unused functions 2023-10-11 00:57:28 -07:00
Bryan Stitt
91a9d62ce1 pass head_block to internal_request 2023-10-11 00:48:08 -07:00
Bryan Stitt
57f8c4bd40 split web3_proxy/src/jsonrpc.rs into multiple files and DRY it up 2023-10-11 00:12:20 -07:00
Bryan Stitt
a9d5006ced get rid of async recursion 2023-10-10 23:32:50 -07:00
Bryan Stitt
ceaed4f239 move rpc filtering to later 2023-10-10 23:05:14 -07:00
Bryan Stitt
9b4f14e779 try turning off streaming again 2023-10-10 23:04:58 -07:00
Bryan Stitt
1666a45564 faster head_block_num 2023-10-10 21:30:55 -07:00
Bryan Stitt
86f70332be use web3_rpcs.blocks_by_hash.get instead of something that might make queries 2023-10-10 20:54:17 -07:00
Bryan Stitt
bf49b84eae skip outers earlier 2023-10-10 20:02:20 -07:00
Bryan Stitt
38d0c7f2cc don't wait for rpcs
come back to this later
2023-10-10 19:24:58 -07:00
Bryan Stitt
c27f0d065b try wait_for_sync a new way with a min sleep 2023-10-10 18:41:31 -07:00
Bryan Stitt
6906eee0dd wait_for_sync was waiting too long 2023-10-10 17:15:03 -07:00
Bryan Stitt
47749df94e catch one more rate limit type 2023-10-10 16:05:28 -07:00
Bryan Stitt
9ba2045dbd improve health checking 2023-10-10 15:46:11 -07:00
Bryan Stitt
a10a283023 trust just removing uncles from the cache 2023-10-10 14:21:54 -07:00
Bryan Stitt
78edfee6b9 timeout and server selection fixes
add a short connect timeout separate from the overall request timeout.

also fix a bug when only 1 server was in the rpc list causing a very tight loop that made tokio sad
2023-10-09 23:30:17 -07:00
Bryan Stitt
ab16f6b2e8 check for MDBX_PANIC 2023-10-09 09:38:58 -07:00
Bryan Stitt
d04f99a0e4 DRY 2023-10-07 16:52:54 -07:00
Bryan Stitt
e02a1e3b7c stream again 2023-10-07 16:52:46 -07:00
Bryan Stitt
36ce2f6524 derp 2023-10-07 16:16:42 -07:00
Bryan Stitt
7e0b6c3034 next_available should not be reversed and other bugs 2023-10-07 16:12:51 -07:00
Bryan Stitt
5a1a87a314 stream should count as success. lagged return the rpc 2023-10-07 15:18:55 -07:00
Bryan Stitt
4dc6f47f9a add new_internal_requests to the logs 2023-10-07 14:36:36 -07:00
Bryan Stitt
580f4c1865 lint 2023-10-07 14:26:10 -07:00
Bryan Stitt
de5674254b hopefully handle min_synced_rpcs properly 2023-10-07 13:45:04 -07:00
Bryan Stitt
9ed0c70ecd wait for lagged rpcs. v1.43.19 2023-10-07 11:58:47 -07:00
Bryan Stitt
349be463f3 initial sort on median latency instead of weighted peak 2023-10-07 10:31:33 -07:00
Bryan Stitt
b2ab5bd6d6 fix from_rpcs 2023-10-07 10:06:01 -07:00
Bryan Stitt
cc2eb9e862 no more overflow on the pending txid firehose 2023-10-07 03:41:11 -07:00
Bryan Stitt
36363c8921 lint 2023-10-07 00:35:22 -07:00
Bryan Stitt
d38a35903e cargo update 2023-10-07 00:35:22 -07:00
Bryan Stitt
97f7e1673e finish todo for waiting for head_block_sender 2023-10-07 00:35:22 -07:00
Bryan Stitt
aeb30787dd more openssl and no rmp
i like rustls, but we can't use it on everything and so our compile times are bad
2023-10-07 00:35:22 -07:00
Bryan Stitt
159fef9e8d include ws_url in hash 2023-10-07 00:35:22 -07:00
Bryan Stitt
f7997a4878 split inner and outer 2023-10-07 00:35:22 -07:00
Bryan Stitt
949c3eeb5d DRY throttling 2023-10-07 00:35:22 -07:00