369abae2fa
make rdkafka fully optional
2023-10-16 12:06:10 -07:00
d877d84d05
1.43.49
2023-10-16 11:10:46 -07:00
b030773881
rewest timeout should be shorter than erigons
2023-10-16 11:10:46 -07:00
7a81b1654b
disable compression
2023-10-16 11:08:59 -07:00
20a0b99f3a
move future block check outside the wait future
2023-10-16 11:04:02 -07:00
e80de22317
comment cleanup
2023-10-13 21:15:06 -07:00
67a7a334b4
1.43.48
2023-10-13 20:40:11 -07:00
ba7eba41db
allow_unhealthy should also skip checking block heights
2023-10-13 20:39:34 -07:00
e11e6f6f27
shorter log
2023-10-13 20:23:40 -07:00
18e3795863
1.43.47
2023-10-13 19:46:52 -07:00
97677cd746
remove some instruments
2023-10-13 19:46:20 -07:00
ce3fbca7b6
fix eth_sendRawTransaction
2023-10-13 19:41:59 -07:00
7cd7257058
update comments
2023-10-13 18:01:11 -07:00
8067c33079
add todo
2023-10-13 00:46:46 -07:00
c1ef3a57f7
1.43.46
2023-10-13 00:23:50 -07:00
aa3b40e03f
add a spot for retries
2023-10-13 00:22:57 -07:00
51ba539800
bring back outer rpc checking
2023-10-12 23:57:12 -07:00
433bf02c3c
1.43.45
2023-10-12 23:34:06 -07:00
fc3d2420bd
bring back head_delay
2023-10-12 23:33:25 -07:00
93533eabc7
Revert "try a RwLock (more should be done if this works)"
...
This reverts commit 9aa33dae2d
2023-10-12 23:33:25 -07:00
5df4bd8da8
Revert "async serialize"
...
This reverts commit d8e1bd44dc
2023-10-12 23:33:25 -07:00
59e5beeac8
1.43.44
2023-10-12 21:49:55 -07:00
3b45256c9a
always have some kind of health check
2023-10-12 21:05:17 -07:00
51d86ade59
handle empty futures
2023-10-12 20:48:37 -07:00
d4e72a5455
1.43.43
2023-10-12 20:19:24 -07:00
3bf7f6c34e
replace subscribe_stop_rx with aborts
2023-10-12 20:17:40 -07:00
9786fb58b2
use select_all more
2023-10-12 19:23:22 -07:00
6bd5ca3277
only select on the balanced handle
2023-10-12 16:52:39 -07:00
926003edd9
1.43.42
2023-10-12 16:32:19 -07:00
f73fd66b89
dont sleep at start
...
that was a gross fix anyways
2023-10-12 16:25:26 -07:00
d27b91cad9
no need for try_join_all here
2023-10-12 16:06:15 -07:00
2a421778ef
get rid of a noop future
2023-10-12 14:30:17 -07:00
75da1b8070
make tokio-console and the normal logging work together
2023-10-12 14:14:02 -07:00
06cd1cc3dd
include phantomdata on the streaming response
2023-10-12 14:14:02 -07:00
1178cb61a4
turn streaming on
2023-10-12 14:12:31 -07:00
235f514997
1.43.41
2023-10-11 20:58:42 -07:00
4009995bb3
move retries into request_with_metadata
2023-10-11 20:58:13 -07:00
12b3069030
1.43.40
2023-10-11 12:45:00 -07:00
d8e1bd44dc
async serialize
2023-10-11 12:34:56 -07:00
874d8b1775
fix find and replace that missed the stripe feature
2023-10-11 12:00:36 -07:00
a259b2b955
1.43.39
2023-10-11 10:57:41 -07:00
9aa33dae2d
try a RwLock (more should be done if this works)
2023-10-11 10:55:45 -07:00
28687f153f
1.43.38
2023-10-11 04:21:25 -07:00
e43309abc0
move permits around and start rpcs slower
2023-10-11 04:18:53 -07:00
2c175103ae
remove more unused deps
2023-10-11 01:46:59 -07:00
4b0756711f
1.43.37
2023-10-11 01:44:11 -07:00
072c52050f
add another minimum sleep and set missed tick behavior
2023-10-11 01:42:55 -07:00
15216b7d33
no waiting and simpler rpc looping
2023-10-11 01:23:08 -07:00
20413b883f
remove unused deps
2023-10-11 00:57:46 -07:00
38c6fbf246
delete unused functions
2023-10-11 00:57:28 -07:00
91a9d62ce1
pass head_block to internal_request
2023-10-11 00:48:08 -07:00
bb3c3482f1
1.43.35
2023-10-11 00:12:55 -07:00
57f8c4bd40
split web3_proxy/src/jsonrpc.rs into multiple files and DRY it up
2023-10-11 00:12:20 -07:00
0f92f457b0
1.43.34
2023-10-10 23:33:34 -07:00
a9d5006ced
get rid of async recursion
2023-10-10 23:32:50 -07:00
b35a211217
1.43.33
2023-10-10 23:09:16 -07:00
ceaed4f239
move rpc filtering to later
2023-10-10 23:05:14 -07:00
9b4f14e779
try turning off streaming again
2023-10-10 23:04:58 -07:00
27ba7adea2
rustls is faster
2023-10-10 23:04:42 -07:00
1666a45564
faster head_block_num
2023-10-10 21:30:55 -07:00
f8b2571c65
1.43.32
2023-10-10 20:55:28 -07:00
86f70332be
use web3_rpcs.blocks_by_hash.get instead of something that might make queries
2023-10-10 20:54:17 -07:00
bf49b84eae
skip outers earlier
2023-10-10 20:02:20 -07:00
8b8dfbbda7
1.43.30
2023-10-10 19:25:12 -07:00
38d0c7f2cc
don't wait for rpcs
...
come back to this later
2023-10-10 19:24:58 -07:00
55dc4f7323
1.43.29
2023-10-10 18:42:01 -07:00
c27f0d065b
try wait_for_sync a new way with a min sleep
2023-10-10 18:41:31 -07:00
9efd36ceeb
1.43.28
2023-10-10 17:15:29 -07:00
6906eee0dd
wait_for_sync was waiting too long
2023-10-10 17:15:03 -07:00
0e2ed425c1
1.43.27
2023-10-10 16:06:54 -07:00
47749df94e
catch one more rate limit type
2023-10-10 16:05:28 -07:00
45a6526d9a
1.43.26
2023-10-10 15:53:52 -07:00
9ba2045dbd
improve health checking
2023-10-10 15:46:11 -07:00
1b144d0aeb
1.43.25
2023-10-10 14:21:54 -07:00
a10a283023
trust just removing uncles from the cache
2023-10-10 14:21:54 -07:00
faf48e8d50
1.43.24
2023-10-09 23:31:48 -07:00
78edfee6b9
timeout and server selection fixes
...
add a short connect timeout separate from the overall request timeout.
also fix a bug when only 1 server was in the rpc list causing a very tight loop that made tokio sad
2023-10-09 23:30:17 -07:00
4f6e75e109
cargo upgrade and update
2023-10-09 09:46:43 -07:00
ab16f6b2e8
check for MDBX_PANIC
2023-10-09 09:38:58 -07:00
d1d5e8ecf5
1.43.22
2023-10-07 16:54:02 -07:00
d04f99a0e4
DRY
2023-10-07 16:52:54 -07:00
e02a1e3b7c
stream again
2023-10-07 16:52:46 -07:00
36ce2f6524
derp
2023-10-07 16:16:42 -07:00
7e0b6c3034
next_available should not be reversed and other bugs
2023-10-07 16:12:51 -07:00
5fe5b97aef
1.43.21
2023-10-07 15:21:32 -07:00
5a1a87a314
stream should count as success. lagged return the rpc
2023-10-07 15:18:55 -07:00
4dc6f47f9a
add new_internal_requests to the logs
2023-10-07 14:36:36 -07:00
580f4c1865
lint
2023-10-07 14:26:10 -07:00
2d6daf4def
1.43.20
2023-10-07 13:51:43 -07:00
de5674254b
hopefully handle min_synced_rpcs properly
2023-10-07 13:45:04 -07:00
9ed0c70ecd
wait for lagged rpcs. v1.43.19
2023-10-07 11:58:47 -07:00
349be463f3
initial sort on median latency instead of weighted peak
2023-10-07 10:31:33 -07:00
b2ab5bd6d6
fix from_rpcs
2023-10-07 10:06:01 -07:00
bb9c8f297e
1.43.16
2023-10-07 03:41:45 -07:00
cc2eb9e862
no more overflow on the pending txid firehose
2023-10-07 03:41:11 -07:00
36363c8921
lint
2023-10-07 00:35:22 -07:00
d38a35903e
cargo update
2023-10-07 00:35:22 -07:00
97f7e1673e
finish todo for waiting for head_block_sender
2023-10-07 00:35:22 -07:00
aeb30787dd
more openssl and no rmp
...
i like rustls, but we can't use it on everything and so our compile times are bad
2023-10-07 00:35:22 -07:00
159fef9e8d
include ws_url in hash
2023-10-07 00:35:22 -07:00
f7997a4878
split inner and outer
2023-10-07 00:35:22 -07:00
949c3eeb5d
DRY throttling
2023-10-07 00:35:22 -07:00
9a7777e3f9
fix >= to <
2023-10-07 00:35:22 -07:00
8180290be7
chain isn't ExactSizeIterator
2023-10-07 00:35:22 -07:00
c1df05f8b6
fix sort order (hopefully)
2023-10-07 00:35:22 -07:00
0dcc324b61
disable tests that need refactor to match new code
2023-10-07 00:35:22 -07:00
6756559ec2
wow this got big
2023-10-07 00:35:22 -07:00
f704d1c4aa
more refs will cut down on cloning an Arc multiple times that isn't really necessary
2023-10-07 00:35:22 -07:00
376048a76b
bump returndata limit to 16mb
2023-10-07 00:35:22 -07:00
9258d36e6a
refactor rpc selection
2023-10-07 00:35:22 -07:00
aee8ede8ef
1.43.15
2023-10-06 00:05:27 -07:00
d6e9f61ee2
only send to 2 servers (not 3x2)
2023-10-06 00:04:46 -07:00
572fc87cf5
1.43.14
2023-10-05 20:28:51 -07:00
249ad884fc
only send to 3 servers
2023-10-05 20:28:22 -07:00
bba02cc121
temporarily switch off streaming and always buffer ( #225 )
...
Co-authored-by: Rory Neithinger <rory@llamanodes.com>
2023-10-05 18:26:29 -07:00
84bff33257
cargo upgrade
2023-10-05 11:01:24 -07:00
ac8d77252e
1.43.13
2023-10-05 11:01:24 -07:00
32862937ad
fix newHead serialization
2023-10-05 11:01:24 -07:00
f153b2b805
add method/params to duplicate stream ( #224 )
...
Co-authored-by: Rory Neithinger <rory@llamanodes.com>
2023-10-04 21:53:46 -07:00
5aa967dfa9
1.43.12
2023-10-03 21:35:43 -07:00
c1c127e6bd
try_send_all_synced_connections for getting transactions
2023-10-03 21:35:25 -07:00
633177c0a6
bump version to 1.43.11
2023-10-03 19:29:44 -07:00
73d16b83e6
cargo upgrade and update
2023-10-03 19:07:21 -07:00
dd3fc165e3
error instead of panic
2023-10-03 19:05:15 -07:00
e917a11d6c
Suprisingly large refactor to get ids everywhere ( #222 )
...
* cargo upgrade --incompatible and update
* first draft at suprisingly_large_refactor_to_get_ids_everywhere
* put app in a task_local
* ref cleanup
* use a OnceLock instead of a tokio local
* test more methods
* APP isn't set in all tests
* it compiles. tests fail. todos still open
* use the app only when necessary
* more tests. less panic
* less verbose debug impl
* short enum names
* move kafka and secrets to their own files
* main tests pass
* add debug chain block time
* helper for stats that ignores internal stats
* Update Jenkinsfile (#223 )
* more tests
---------
Co-authored-by: Pewxz <124064710+pewxz@users.noreply.github.com>
2023-10-03 13:46:27 -07:00
abe516c21e
turn down logging on eth_getLogs for now
2023-09-29 10:37:49 -07:00
f0b6465069
streaming responses 2 ( #219 )
...
* streaming responses compile, still small TODOs & cleanup
* refactor to allow short curcuits on uncacheable requests (#220 )
* refactor to allow short curcuits on uncacheable requests
* handle error inside an Arc from moka
* arc instead of box
* lint
* more lint
* add bonus rate limits and keep all semaphores after rate limits (#221 )
* add bonus rate limits and keep all semaphores after rate limits
* remove stale todos
* better function names
* cargo upgrade and update
* make some panics warn. more todo
* pass request_metadata through so streaming responses include their final size
* remove stale TODO
* remove more stale todos
* add file i missed
* make to_json_string work well enough
* check config for free_subscriptions
---------
Co-authored-by: Rory Neithinger <rory@llamanodes.com>
2023-09-26 18:18:06 -07:00
5b0aebb6e5
allow missing params in requests
2023-09-26 17:41:42 -07:00
f79c8adbf9
add a shared pool of bonus concurrency ( #218 )
2023-09-25 12:34:00 -07:00
e1f922dc57
v1.43.8
2023-09-25 10:39:31 -07:00
3aee9071ad
require active premium for most websocket subscriptions
...
only newHeads is allowed without premium
2023-09-25 10:38:55 -07:00
d732b8a171
cargo upgrade and update
...
ordered-float went from v3 to v4
2023-09-25 10:02:04 -07:00
9b2f27862d
remove unnecessary yield_nows
2023-09-21 11:22:20 -07:00
f9b6c2fe0c
cargo upgrade and update
2023-09-21 09:35:06 -07:00
0b3dfd095e
upgrade nightly for doc fix
2023-09-20 11:02:41 -07:00
ac2f518174
filter_map instead of unwrap
2023-09-20 10:14:21 -07:00
dc037e663a
tokio spawn the cached future ( #217 )
...
* tokio spawn the cached future
* lint
2023-09-20 10:11:07 -07:00
e4d3a736d0
return an error earlier
2023-09-19 19:22:28 -07:00
b44c774edb
remove some unused features
2023-09-19 18:48:15 -07:00
8a0c2dfdc1
try timeout inside the cache get again but with shorter timeouts
2023-09-19 18:37:49 -07:00
0437d9bfc9
sigh
2023-09-19 15:38:40 -07:00
fe2493236e
missing &
2023-09-19 15:28:53 -07:00
e137d813af
this fix got lost in rebases
2023-09-19 15:28:07 -07:00
8b08828473
make it compile. my editor didnt show any errors 🤷
2023-09-19 14:57:42 -07:00
416d179c09
1.43.6
2023-09-19 14:43:15 -07:00
f0be8b992b
always wait for watch_ranked_rpcs change
2023-09-19 14:42:31 -07:00
10c4ffc9d2
smarter archive retry
2023-09-19 10:56:54 -07:00
60ffbdfbb2
move the timeout outside the try_get_with
2023-09-19 09:24:07 -07:00
9ec408765c
v1.43.2
2023-09-18 23:43:45 -07:00
41314df25b
move another yield_now
2023-09-18 23:42:54 -07:00
fc287d24ea
borrow_and_update instead of borrow
...
i think this won't matter and the update is probably a waste, but it feels wrong to leave it in a changed state
2023-09-18 23:29:01 -07:00
94cbe6153a
remove timeout layer. its not playing nice with moka
2023-09-18 23:18:52 -07:00
6d4d8ea840
minor refactor of error retry logic
2023-09-18 23:17:55 -07:00
5f85a17b19
put timeout around the moka stuff
...
we went a long time without seeing errors on this, but i just saw some again
2023-09-18 23:08:16 -07:00
e6c376ae94
add block interval for zkevm polygon
2023-09-18 15:21:02 -07:00
37df2a5650
delete unused deps
2023-09-18 14:32:02 -07:00
3174fa5bad
increase cost of eth_subscribe(newPendingTransactions)
2023-09-18 14:18:05 -07:00
f4a648223b
add uptime to /status
2023-09-18 12:35:17 -07:00
b5a1e9ff71
add start Instant to app
2023-09-18 12:33:58 -07:00
7e60a21956
prepare for more complex variable pricing
2023-09-18 12:26:52 -07:00
a68a98ce41
cargo upgrade and update
...
moka 0.12 required some migration help: https://github.com/moka-rs/moka/blob/main/MIGRATION-GUIDE.md
2023-09-18 11:04:22 -07:00
c72db731bd
add block times for optimism and base
2023-09-18 10:55:30 -07:00
357dae108a
loop, dont crash
2023-09-14 12:51:40 -07:00
01179d14f2
cargo upgrade and update
2023-09-14 12:51:16 -07:00
8e5a27a184
use Ordering::Relaxed more
2023-09-13 12:35:58 -07:00
1fd8f6f383
Deduped broadcast channel ( #209 )
...
* upgrade and start adding deduped_broadcast
* basic test
* accept arg for cache ttl
* first pass at bringing the tx firehose back
* try_send instead of send since there aren't always receivers
* deduped broadcaster needs the try send
* track counts and include in /status
* use config for enable subscribe_txs
2023-09-13 12:05:47 -07:00
c7c2497238
add cost for txpool_content and some unimplemented methods
2023-09-12 21:53:44 -07:00
fc7ec5e5ee
custom deserializer for BlockDataLimit
2023-09-12 14:59:13 -07:00
56db1eb13e
untagged serde magic
2023-09-12 14:30:01 -07:00
274b2c89fc
v1.43.1
2023-09-12 13:43:17 -07:00
ceb202b53c
allow the string 'Archive' when setting block data limit
2023-09-12 13:35:51 -07:00
8050f699f3
cargo upgrade and cargo update
2023-09-11 11:33:36 -07:00
d34f884f1c
clean inputs to Web3ProxyError::MethodNotFound
2023-09-07 13:09:03 -07:00
0dcd368ac7
v1.42.18
2023-09-06 13:17:35 -07:00
71dd6614dc
test chain priced same as eth
2023-09-02 11:32:10 -07:00
d5090df5a4
1.42.17
2023-09-02 10:59:37 -07:00
633abc0d60
make wait_for_best_rpc work for private/4337/groups without head subscriptions
2023-09-02 10:59:07 -07:00
2cf688cc68
fix one syntax error
2023-09-02 10:38:26 -07:00
5ce1b5bace
add web3_bundlerVersion with the same cost as web3_clientVersion
2023-09-02 10:30:42 -07:00
8d51a1b4dd
remove stale comment
2023-09-02 10:20:50 -07:00
bd77a6cac4
cargo upgrade and update
2023-09-02 10:20:30 -07:00
428dfdd835
improve 4337 bundler support and retries
2023-09-02 10:19:43 -07:00
a487ce5149
skip backups unless backups are needed for ranked_rpcs to exist
2023-09-01 17:01:59 -07:00
57f5d5b483
cargo upgrade and update
2023-09-01 16:58:02 -07:00
f415315626
check more possible empty values
2023-09-01 16:56:20 -07:00
7530605e5b
v1.42.14
2023-08-30 21:06:09 -07:00
484610b80f
cargo upgrade and update
2023-08-30 21:05:34 -07:00
0ff3ccd479
eth = 0.0000004. everything else to match polygon (0.0000005333)
2023-08-30 21:02:31 -07:00
ec533c8b30
cargo upgrade and update
2023-08-30 20:59:06 -07:00
df12b3dc73
cargo upgrade and update
2023-08-24 14:37:04 -07:00
e76bef272f
put rate limit things into data
2023-08-24 13:25:14 -07:00
a32e2ddcad
cargo upgrade
2023-08-22 13:27:19 -07:00
2acca1fbbc
unimplemented compute units for alchemy_ method
2023-08-22 13:27:19 -07:00
8b4aba592c
cargo fmt
2023-08-22 10:49:04 -07:00
d036806a61
cargo upgrade and cargo update
2023-08-22 10:42:59 -07:00
372c3c60fd
shorter cache and timeout on /status and related endpoints
2023-08-22 10:42:02 -07:00
99d405f7db
Revert "remove caching the /status things"
...
This reverts commit c5827b6f37
2023-08-22 10:37:12 -07:00
c5827b6f37
remove caching the /status things
2023-08-21 15:45:23 -07:00
dbda653812
trim trailing slashes isn't working as expected. put the routes back for now
2023-08-21 15:18:57 -07:00
eed03d2bfe
cargo upgrade
2023-08-18 16:18:30 -07:00
Bryan Stitt