Commit Graph

1659 Commits

Author SHA1 Message Date
Bryan Stitt
e80de22317 comment cleanup 2023-10-13 21:15:06 -07:00
Bryan Stitt
67a7a334b4 1.43.48 2023-10-13 20:40:11 -07:00
Bryan Stitt
ba7eba41db allow_unhealthy should also skip checking block heights 2023-10-13 20:39:34 -07:00
Bryan Stitt
e11e6f6f27 shorter log 2023-10-13 20:23:40 -07:00
Bryan Stitt
18e3795863 1.43.47 2023-10-13 19:46:52 -07:00
Bryan Stitt
97677cd746 remove some instruments 2023-10-13 19:46:20 -07:00
Bryan Stitt
ce3fbca7b6 fix eth_sendRawTransaction 2023-10-13 19:41:59 -07:00
Bryan Stitt
7cd7257058 update comments 2023-10-13 18:01:11 -07:00
Bryan Stitt
8067c33079 add todo 2023-10-13 00:46:46 -07:00
Bryan Stitt
c1ef3a57f7 1.43.46 2023-10-13 00:23:50 -07:00
Bryan Stitt
aa3b40e03f add a spot for retries 2023-10-13 00:22:57 -07:00
Bryan Stitt
51ba539800 bring back outer rpc checking 2023-10-12 23:57:12 -07:00
Bryan Stitt
433bf02c3c 1.43.45 2023-10-12 23:34:06 -07:00
Bryan Stitt
fc3d2420bd bring back head_delay 2023-10-12 23:33:25 -07:00
Bryan Stitt
93533eabc7 Revert "try a RwLock (more should be done if this works)"
This reverts commit 9aa33dae2d3869965ba131e8e561338f2298fd56.
2023-10-12 23:33:25 -07:00
Bryan Stitt
5df4bd8da8 Revert "async serialize"
This reverts commit d8e1bd44dc3cc53a6d8b7894d9280ee4a31c35ba.
2023-10-12 23:33:25 -07:00
Bryan Stitt
59e5beeac8 1.43.44 2023-10-12 21:49:55 -07:00
Bryan Stitt
3b45256c9a always have some kind of health check 2023-10-12 21:05:17 -07:00
Bryan Stitt
51d86ade59 handle empty futures 2023-10-12 20:48:37 -07:00
Bryan Stitt
d4e72a5455 1.43.43 2023-10-12 20:19:24 -07:00
Bryan Stitt
3bf7f6c34e replace subscribe_stop_rx with aborts 2023-10-12 20:17:40 -07:00
Bryan Stitt
9786fb58b2 use select_all more 2023-10-12 19:23:22 -07:00
Bryan Stitt
6bd5ca3277 only select on the balanced handle 2023-10-12 16:52:39 -07:00
Bryan Stitt
926003edd9 1.43.42 2023-10-12 16:32:19 -07:00
Bryan Stitt
f73fd66b89 dont sleep at start
that was a gross fix anyways
2023-10-12 16:25:26 -07:00
Bryan Stitt
d27b91cad9 no need for try_join_all here 2023-10-12 16:06:15 -07:00
Bryan Stitt
2a421778ef get rid of a noop future 2023-10-12 14:30:17 -07:00
Bryan Stitt
75da1b8070 make tokio-console and the normal logging work together 2023-10-12 14:14:02 -07:00
Bryan Stitt
06cd1cc3dd include phantomdata on the streaming response 2023-10-12 14:14:02 -07:00
Bryan Stitt
1178cb61a4 turn streaming on 2023-10-12 14:12:31 -07:00
Bryan Stitt
235f514997 1.43.41 2023-10-11 20:58:42 -07:00
Bryan Stitt
4009995bb3 move retries into request_with_metadata 2023-10-11 20:58:13 -07:00
Bryan Stitt
12b3069030 1.43.40 2023-10-11 12:45:00 -07:00
Bryan Stitt
d8e1bd44dc async serialize 2023-10-11 12:34:56 -07:00
Bryan Stitt
874d8b1775 fix find and replace that missed the stripe feature 2023-10-11 12:00:36 -07:00
Bryan Stitt
a259b2b955 1.43.39 2023-10-11 10:57:41 -07:00
Bryan Stitt
9aa33dae2d try a RwLock (more should be done if this works) 2023-10-11 10:55:45 -07:00
Bryan Stitt
28687f153f 1.43.38 2023-10-11 04:21:25 -07:00
Bryan Stitt
e43309abc0 move permits around and start rpcs slower 2023-10-11 04:18:53 -07:00
Bryan Stitt
2c175103ae remove more unused deps 2023-10-11 01:46:59 -07:00
Bryan Stitt
4b0756711f 1.43.37 2023-10-11 01:44:11 -07:00
Bryan Stitt
072c52050f add another minimum sleep and set missed tick behavior 2023-10-11 01:42:55 -07:00
Bryan Stitt
15216b7d33 no waiting and simpler rpc looping 2023-10-11 01:23:08 -07:00
Bryan Stitt
20413b883f remove unused deps 2023-10-11 00:57:46 -07:00
Bryan Stitt
38c6fbf246 delete unused functions 2023-10-11 00:57:28 -07:00
Bryan Stitt
91a9d62ce1 pass head_block to internal_request 2023-10-11 00:48:08 -07:00
Bryan Stitt
bb3c3482f1 1.43.35 2023-10-11 00:12:55 -07:00
Bryan Stitt
57f8c4bd40 split web3_proxy/src/jsonrpc.rs into multiple files and DRY it up 2023-10-11 00:12:20 -07:00
Bryan Stitt
0f92f457b0 1.43.34 2023-10-10 23:33:34 -07:00
Bryan Stitt
a9d5006ced get rid of async recursion 2023-10-10 23:32:50 -07:00
Bryan Stitt
b35a211217 1.43.33 2023-10-10 23:09:16 -07:00
Bryan Stitt
ceaed4f239 move rpc filtering to later 2023-10-10 23:05:14 -07:00
Bryan Stitt
9b4f14e779 try turning off streaming again 2023-10-10 23:04:58 -07:00
Bryan Stitt
27ba7adea2 rustls is faster 2023-10-10 23:04:42 -07:00
Bryan Stitt
1666a45564 faster head_block_num 2023-10-10 21:30:55 -07:00
Bryan Stitt
f8b2571c65 1.43.32 2023-10-10 20:55:28 -07:00
Bryan Stitt
86f70332be use web3_rpcs.blocks_by_hash.get instead of something that might make queries 2023-10-10 20:54:17 -07:00
Bryan Stitt
bf49b84eae skip outers earlier 2023-10-10 20:02:20 -07:00
Bryan Stitt
8b8dfbbda7 1.43.30 2023-10-10 19:25:12 -07:00
Bryan Stitt
38d0c7f2cc don't wait for rpcs
come back to this later
2023-10-10 19:24:58 -07:00
Bryan Stitt
55dc4f7323 1.43.29 2023-10-10 18:42:01 -07:00
Bryan Stitt
c27f0d065b try wait_for_sync a new way with a min sleep 2023-10-10 18:41:31 -07:00
Bryan Stitt
9efd36ceeb 1.43.28 2023-10-10 17:15:29 -07:00
Bryan Stitt
6906eee0dd wait_for_sync was waiting too long 2023-10-10 17:15:03 -07:00
Bryan Stitt
0e2ed425c1 1.43.27 2023-10-10 16:06:54 -07:00
Bryan Stitt
47749df94e catch one more rate limit type 2023-10-10 16:05:28 -07:00
Bryan Stitt
45a6526d9a 1.43.26 2023-10-10 15:53:52 -07:00
Bryan Stitt
9ba2045dbd improve health checking 2023-10-10 15:46:11 -07:00
Bryan Stitt
1b144d0aeb 1.43.25 2023-10-10 14:21:54 -07:00
Bryan Stitt
a10a283023 trust just removing uncles from the cache 2023-10-10 14:21:54 -07:00
Bryan Stitt
faf48e8d50 1.43.24 2023-10-09 23:31:48 -07:00
Bryan Stitt
78edfee6b9 timeout and server selection fixes
add a short connect timeout separate from the overall request timeout.

also fix a bug when only 1 server was in the rpc list causing a very tight loop that made tokio sad
2023-10-09 23:30:17 -07:00
Bryan Stitt
4f6e75e109 cargo upgrade and update 2023-10-09 09:46:43 -07:00
Bryan Stitt
ab16f6b2e8 check for MDBX_PANIC 2023-10-09 09:38:58 -07:00
Bryan Stitt
d1d5e8ecf5 1.43.22 2023-10-07 16:54:02 -07:00
Bryan Stitt
d04f99a0e4 DRY 2023-10-07 16:52:54 -07:00
Bryan Stitt
e02a1e3b7c stream again 2023-10-07 16:52:46 -07:00
Bryan Stitt
36ce2f6524 derp 2023-10-07 16:16:42 -07:00
Bryan Stitt
7e0b6c3034 next_available should not be reversed and other bugs 2023-10-07 16:12:51 -07:00
Bryan Stitt
5fe5b97aef 1.43.21 2023-10-07 15:21:32 -07:00
Bryan Stitt
5a1a87a314 stream should count as success. lagged return the rpc 2023-10-07 15:18:55 -07:00
Bryan Stitt
4dc6f47f9a add new_internal_requests to the logs 2023-10-07 14:36:36 -07:00
Bryan Stitt
580f4c1865 lint 2023-10-07 14:26:10 -07:00
Bryan Stitt
2d6daf4def 1.43.20 2023-10-07 13:51:43 -07:00
Bryan Stitt
de5674254b hopefully handle min_synced_rpcs properly 2023-10-07 13:45:04 -07:00
Bryan Stitt
9ed0c70ecd wait for lagged rpcs. v1.43.19 2023-10-07 11:58:47 -07:00
Bryan Stitt
349be463f3 initial sort on median latency instead of weighted peak 2023-10-07 10:31:33 -07:00
Bryan Stitt
b2ab5bd6d6 fix from_rpcs 2023-10-07 10:06:01 -07:00
Bryan Stitt
bb9c8f297e 1.43.16 2023-10-07 03:41:45 -07:00
Bryan Stitt
cc2eb9e862 no more overflow on the pending txid firehose 2023-10-07 03:41:11 -07:00
Bryan Stitt
36363c8921 lint 2023-10-07 00:35:22 -07:00
Bryan Stitt
d38a35903e cargo update 2023-10-07 00:35:22 -07:00
Bryan Stitt
97f7e1673e finish todo for waiting for head_block_sender 2023-10-07 00:35:22 -07:00
Bryan Stitt
aeb30787dd more openssl and no rmp
i like rustls, but we can't use it on everything and so our compile times are bad
2023-10-07 00:35:22 -07:00
Bryan Stitt
159fef9e8d include ws_url in hash 2023-10-07 00:35:22 -07:00
Bryan Stitt
f7997a4878 split inner and outer 2023-10-07 00:35:22 -07:00
Bryan Stitt
949c3eeb5d DRY throttling 2023-10-07 00:35:22 -07:00
Bryan Stitt
9a7777e3f9 fix >= to < 2023-10-07 00:35:22 -07:00
Bryan Stitt
8180290be7 chain isn't ExactSizeIterator 2023-10-07 00:35:22 -07:00
Bryan Stitt
c1df05f8b6 fix sort order (hopefully) 2023-10-07 00:35:22 -07:00
Bryan Stitt
0dcc324b61 disable tests that need refactor to match new code 2023-10-07 00:35:22 -07:00
Bryan Stitt
6756559ec2 wow this got big 2023-10-07 00:35:22 -07:00
Bryan Stitt
f704d1c4aa more refs will cut down on cloning an Arc multiple times that isn't really necessary 2023-10-07 00:35:22 -07:00
Bryan Stitt
376048a76b bump returndata limit to 16mb 2023-10-07 00:35:22 -07:00
Bryan Stitt
9258d36e6a refactor rpc selection 2023-10-07 00:35:22 -07:00
Bryan Stitt
aee8ede8ef 1.43.15 2023-10-06 00:05:27 -07:00
Bryan Stitt
d6e9f61ee2 only send to 2 servers (not 3x2) 2023-10-06 00:04:46 -07:00
Bryan Stitt
572fc87cf5 1.43.14 2023-10-05 20:28:51 -07:00
Bryan Stitt
249ad884fc only send to 3 servers 2023-10-05 20:28:22 -07:00
Bryan Stitt
bba02cc121
temporarily switch off streaming and always buffer (#225)
Co-authored-by: Rory Neithinger <rory@llamanodes.com>
2023-10-05 18:26:29 -07:00
Bryan Stitt
84bff33257 cargo upgrade 2023-10-05 11:01:24 -07:00
Bryan Stitt
ac8d77252e 1.43.13 2023-10-05 11:01:24 -07:00
Bryan Stitt
32862937ad fix newHead serialization 2023-10-05 11:01:24 -07:00
Bryan Stitt
f153b2b805
add method/params to duplicate stream (#224)
Co-authored-by: Rory Neithinger <rory@llamanodes.com>
2023-10-04 21:53:46 -07:00
Bryan Stitt
5aa967dfa9 1.43.12 2023-10-03 21:35:43 -07:00
Bryan Stitt
c1c127e6bd try_send_all_synced_connections for getting transactions 2023-10-03 21:35:25 -07:00
Bryan Stitt
633177c0a6 bump version to 1.43.11 2023-10-03 19:29:44 -07:00
Bryan Stitt
73d16b83e6 cargo upgrade and update 2023-10-03 19:07:21 -07:00
Bryan Stitt
dd3fc165e3 error instead of panic 2023-10-03 19:05:15 -07:00
Bryan Stitt
e917a11d6c
Suprisingly large refactor to get ids everywhere (#222)
* cargo upgrade --incompatible and update

* first draft at suprisingly_large_refactor_to_get_ids_everywhere

* put app in a task_local

* ref cleanup

* use a OnceLock instead of a tokio local

* test more methods

* APP isn't set in all tests

* it compiles. tests fail. todos still open

* use the app only when necessary

* more tests. less panic

* less verbose debug impl

* short enum names

* move kafka and secrets to their own files

* main tests pass

* add debug chain block time

* helper for stats that ignores internal stats

* Update Jenkinsfile (#223)

* more tests

---------

Co-authored-by: Pewxz <124064710+pewxz@users.noreply.github.com>
2023-10-03 13:46:27 -07:00
Bryan Stitt
abe516c21e turn down logging on eth_getLogs for now 2023-09-29 10:37:49 -07:00
Bryan Stitt
f0b6465069
streaming responses 2 (#219)
* streaming responses compile, still small TODOs & cleanup

* refactor to allow short curcuits on uncacheable requests (#220)

* refactor to allow short curcuits on uncacheable requests

* handle error inside an Arc from moka

* arc instead of box

* lint

* more lint

* add bonus rate limits and keep all semaphores after rate limits (#221)

* add bonus rate limits and keep all semaphores after rate limits

* remove stale todos

* better function names

* cargo upgrade and update

* make some panics warn. more todo

* pass request_metadata through so streaming responses include their final size

* remove stale TODO

* remove more stale todos

* add file i missed

* make to_json_string work well enough

* check config for free_subscriptions

---------

Co-authored-by: Rory Neithinger <rory@llamanodes.com>
2023-09-26 18:18:06 -07:00
Bryan Stitt
5b0aebb6e5 allow missing params in requests 2023-09-26 17:41:42 -07:00
Bryan Stitt
f79c8adbf9
add a shared pool of bonus concurrency (#218) 2023-09-25 12:34:00 -07:00
Bryan Stitt
e1f922dc57 v1.43.8 2023-09-25 10:39:31 -07:00
Bryan Stitt
3aee9071ad require active premium for most websocket subscriptions
only newHeads is allowed without premium
2023-09-25 10:38:55 -07:00
Bryan Stitt
d732b8a171 cargo upgrade and update
ordered-float went from v3 to v4
2023-09-25 10:02:04 -07:00
Bryan Stitt
9b2f27862d remove unnecessary yield_nows 2023-09-21 11:22:20 -07:00
Bryan Stitt
f9b6c2fe0c cargo upgrade and update 2023-09-21 09:35:06 -07:00
Bryan Stitt
0b3dfd095e upgrade nightly for doc fix 2023-09-20 11:02:41 -07:00
Bryan Stitt
ac2f518174 filter_map instead of unwrap 2023-09-20 10:14:21 -07:00
Bryan Stitt
dc037e663a
tokio spawn the cached future (#217)
* tokio spawn the cached future

* lint
2023-09-20 10:11:07 -07:00
Bryan Stitt
e4d3a736d0 return an error earlier 2023-09-19 19:22:28 -07:00
Bryan Stitt
b44c774edb remove some unused features 2023-09-19 18:48:15 -07:00
Bryan Stitt
8a0c2dfdc1 try timeout inside the cache get again but with shorter timeouts 2023-09-19 18:37:49 -07:00
Bryan Stitt
0437d9bfc9 sigh 2023-09-19 15:38:40 -07:00
Bryan Stitt
fe2493236e missing & 2023-09-19 15:28:53 -07:00
Bryan Stitt
e137d813af this fix got lost in rebases 2023-09-19 15:28:07 -07:00
Bryan Stitt
8b08828473 make it compile. my editor didnt show any errors 🤷 2023-09-19 14:57:42 -07:00
Bryan Stitt
416d179c09 1.43.6 2023-09-19 14:43:15 -07:00
Bryan Stitt
f0be8b992b always wait for watch_ranked_rpcs change 2023-09-19 14:42:31 -07:00
Bryan Stitt
10c4ffc9d2 smarter archive retry 2023-09-19 10:56:54 -07:00
Bryan Stitt
60ffbdfbb2 move the timeout outside the try_get_with 2023-09-19 09:24:07 -07:00
Bryan Stitt
9ec408765c v1.43.2 2023-09-18 23:43:45 -07:00
Bryan Stitt
41314df25b move another yield_now 2023-09-18 23:42:54 -07:00
Bryan Stitt
fc287d24ea borrow_and_update instead of borrow
i think this won't matter and the update is probably a waste, but it feels wrong to leave it in a changed state
2023-09-18 23:29:01 -07:00
Bryan Stitt
94cbe6153a remove timeout layer. its not playing nice with moka 2023-09-18 23:18:52 -07:00
Bryan Stitt
6d4d8ea840 minor refactor of error retry logic 2023-09-18 23:17:55 -07:00
Bryan Stitt
5f85a17b19 put timeout around the moka stuff
we went a long time without seeing errors on this, but i just saw some again
2023-09-18 23:08:16 -07:00
Bryan Stitt
e6c376ae94 add block interval for zkevm polygon 2023-09-18 15:21:02 -07:00
Bryan Stitt
37df2a5650 delete unused deps 2023-09-18 14:32:02 -07:00
Bryan Stitt
3174fa5bad increase cost of eth_subscribe(newPendingTransactions) 2023-09-18 14:18:05 -07:00
Bryan Stitt
f4a648223b add uptime to /status 2023-09-18 12:35:17 -07:00
Bryan Stitt
b5a1e9ff71 add start Instant to app 2023-09-18 12:33:58 -07:00
Bryan Stitt
7e60a21956 prepare for more complex variable pricing 2023-09-18 12:26:52 -07:00
Bryan Stitt
a68a98ce41 cargo upgrade and update
moka 0.12 required some migration help: https://github.com/moka-rs/moka/blob/main/MIGRATION-GUIDE.md
2023-09-18 11:04:22 -07:00
Bryan Stitt
c72db731bd add block times for optimism and base 2023-09-18 10:55:30 -07:00
Bryan Stitt
357dae108a loop, dont crash 2023-09-14 12:51:40 -07:00
Bryan Stitt
01179d14f2 cargo upgrade and update 2023-09-14 12:51:16 -07:00
Bryan Stitt
8e5a27a184 use Ordering::Relaxed more 2023-09-13 12:35:58 -07:00
Bryan Stitt
1fd8f6f383
Deduped broadcast channel (#209)
* upgrade and start adding deduped_broadcast

* basic test

* accept arg for cache ttl

* first pass at bringing the tx firehose back

* try_send instead of send since there aren't always receivers

* deduped broadcaster needs the try send

* track counts and include in /status

* use config for enable subscribe_txs
2023-09-13 12:05:47 -07:00
Bryan Stitt
c7c2497238 add cost for txpool_content and some unimplemented methods 2023-09-12 21:53:44 -07:00
Bryan Stitt
fc7ec5e5ee custom deserializer for BlockDataLimit 2023-09-12 14:59:13 -07:00
Bryan Stitt
56db1eb13e untagged serde magic 2023-09-12 14:30:01 -07:00
Bryan Stitt
274b2c89fc v1.43.1 2023-09-12 13:43:17 -07:00
Bryan Stitt
ceb202b53c allow the string 'Archive' when setting block data limit 2023-09-12 13:35:51 -07:00
Bryan Stitt
8050f699f3 cargo upgrade and cargo update 2023-09-11 11:33:36 -07:00
Bryan Stitt
d34f884f1c clean inputs to Web3ProxyError::MethodNotFound 2023-09-07 13:09:03 -07:00
Bryan Stitt
0dcd368ac7 v1.42.18 2023-09-06 13:17:35 -07:00
Bryan Stitt
71dd6614dc test chain priced same as eth 2023-09-02 11:32:10 -07:00
Bryan Stitt
d5090df5a4 1.42.17 2023-09-02 10:59:37 -07:00
Bryan Stitt
633abc0d60 make wait_for_best_rpc work for private/4337/groups without head subscriptions 2023-09-02 10:59:07 -07:00
Bryan Stitt
2cf688cc68 fix one syntax error 2023-09-02 10:38:26 -07:00
Bryan Stitt
5ce1b5bace add web3_bundlerVersion with the same cost as web3_clientVersion 2023-09-02 10:30:42 -07:00
Bryan Stitt
8d51a1b4dd remove stale comment 2023-09-02 10:20:50 -07:00
Bryan Stitt
bd77a6cac4 cargo upgrade and update 2023-09-02 10:20:30 -07:00
Bryan Stitt
428dfdd835 improve 4337 bundler support and retries 2023-09-02 10:19:43 -07:00
Bryan Stitt
a487ce5149 skip backups unless backups are needed for ranked_rpcs to exist 2023-09-01 17:01:59 -07:00
Bryan Stitt
57f5d5b483 cargo upgrade and update 2023-09-01 16:58:02 -07:00
Bryan Stitt
f415315626 check more possible empty values 2023-09-01 16:56:20 -07:00
Bryan Stitt
7530605e5b v1.42.14 2023-08-30 21:06:09 -07:00
Bryan Stitt
484610b80f cargo upgrade and update 2023-08-30 21:05:34 -07:00
Bryan Stitt
0ff3ccd479 eth = 0.0000004. everything else to match polygon (0.0000005333) 2023-08-30 21:02:31 -07:00
Bryan Stitt
ec533c8b30 cargo upgrade and update 2023-08-30 20:59:06 -07:00
Bryan Stitt
df12b3dc73 cargo upgrade and update 2023-08-24 14:37:04 -07:00
Bryan Stitt
e76bef272f put rate limit things into data 2023-08-24 13:25:14 -07:00
Bryan Stitt
a32e2ddcad cargo upgrade 2023-08-22 13:27:19 -07:00
Bryan Stitt
2acca1fbbc unimplemented compute units for alchemy_ method 2023-08-22 13:27:19 -07:00
Bryan Stitt
8b4aba592c cargo fmt 2023-08-22 10:49:04 -07:00
Bryan Stitt
d036806a61 cargo upgrade and cargo update 2023-08-22 10:42:59 -07:00
Bryan Stitt
372c3c60fd shorter cache and timeout on /status and related endpoints 2023-08-22 10:42:02 -07:00
Bryan Stitt
99d405f7db Revert "remove caching the /status things"
This reverts commit c5827b6f37ff44f50a63c07e6c03023429b97287.
2023-08-22 10:37:12 -07:00
Bryan Stitt
c5827b6f37 remove caching the /status things 2023-08-21 15:45:23 -07:00
Bryan Stitt
dbda653812 trim trailing slashes isn't working as expected. put the routes back for now 2023-08-21 15:18:57 -07:00
Bryan Stitt
eed03d2bfe cargo upgrade 2023-08-18 16:18:30 -07:00
Bryan Stitt
24058e04f1 bump version to 1.42.10 2023-08-18 16:01:32 -07:00
Bryan Stitt
d2aa67e8ee test more methods 2023-08-17 21:55:58 -07:00
Bryan Stitt
10a8620044 fix method not found jsonrpc error codes 2023-08-17 15:32:22 -07:00
Bryan Stitt
6be05bab4b cargo upgrade 2023-08-17 13:49:45 -07:00
Bryan Stitt
e0f700189b fix error code on method not implemented and error_response user_response bools 2023-08-17 13:44:26 -07:00