Commit Graph

767 Commits

Author SHA1 Message Date
Bryan Stitt
b2016190e1 change_admin_status script fixes 2023-03-06 04:44:54 +00:00
yenicelik
ffd63444b2 tests seem to run successfully, should double check the huge merge 2023-03-04 22:31:39 +01:00
yenicelik
5a54fc5e99 lets modify web3 proxyd manually copy pasta 2023-03-04 21:19:39 +01:00
Bryan Stitt
c7dcc4aac3 actually return a json result from influx 2023-03-04 20:54:24 +01:00
Bryan Stitt
163bbbafca FromDataPoint needs Default 2023-03-04 20:54:24 +01:00
Bryan Stitt
5b48d471bb fix influxdb derive macro
https://github.com/aprimadi/influxdb2/issues/17
2023-03-04 20:54:24 +01:00
Bryan Stitt
dbd7860416 wip influxdb2 2023-03-04 20:54:04 +01:00
Bryan Stitt
3f217b930a cargo upgrade 2023-03-04 20:49:21 +01:00
Bryan Stitt
eb4d05a520 stats v2
rebased all my commits and squashed them down to one
2023-03-04 20:48:49 +01:00
Bryan Stitt
36e4183373 todos 2023-03-03 11:19:25 -08:00
Bryan Stitt
94089eb72b combine comparison 2023-03-03 07:34:04 -08:00
Bryan Stitt
4c18657387 more kafka things 2023-03-03 06:58:45 -08:00
Bryan Stitt
2eb8df22ec kafka helper script 2023-03-03 02:54:52 -08:00
Bryan Stitt
1869e73131 actually add the script 2023-03-02 22:50:14 -08:00
Bryan Stitt
cbdd6d7c1e oops. didn't mean to commit this script yet 2023-03-02 21:12:35 -08:00
Bryan Stitt
586b772cdf apt needs '--yes' 2023-03-02 20:58:07 -08:00
Bryan Stitt
3b61e009f8 group cfgs 2023-03-02 17:51:41 -08:00
Bryan Stitt
3098791ad9 add optional kafka feature 2023-03-03 01:39:50 +00:00
Bryan Stitt
a54e33f598 head lag instead of head block 2023-03-02 19:10:30 +00:00
Bryan Stitt
e6ca8a5253 add head_block, head_latency, and request_latency to popularity_contest table 2023-03-02 19:08:47 +00:00
Bryan Stitt
c7b74e1795 sort popularity_contest rows descending by request counts 2023-03-02 18:33:17 +00:00
Bryan Stitt
d1b955275d clean up wait_for_ functions 2023-03-02 18:27:32 +00:00
Bryan Stitt
907a147afa wait_for_provider helper function 2023-03-02 18:14:17 +00:00
Bryan Stitt
0d07e20d7c make it compile 2023-03-02 17:38:42 +00:00
Bryan Stitt
258e889f69 wait for a provider 2023-03-02 16:52:28 +00:00
Bryan Stitt
499d50b5fc handle empty private_rpcs 2023-03-01 23:21:09 +00:00
Bryan Stitt
c8bc0d288f high log level 2023-03-01 23:04:20 +00:00
Bryan Stitt
fdba8e7864 test all_connections with Nones 2023-03-01 22:50:44 +00:00
Bryan Stitt
f68886fafd add simple test for all connections and include more rpcs 2023-03-01 22:32:01 +00:00
Bryan Stitt
baf07f7de5 sync sort should include backup 2023-03-01 21:35:50 +00:00
Bryan Stitt
2e9803de72 remove arbitrary sleep timer 2023-03-01 20:56:00 +00:00
Bryan Stitt
b87c988439 lint 2023-03-01 11:23:59 -08:00
Bryan Stitt
1da12f5844 bump version to match number of migrations 2023-02-28 23:35:20 -08:00
Bryan Stitt
1ffccbe229
Merge pull request #36 from yenicelik/19-admin-imitate
Admin endpoint (Godmode / Imitate User)
2023-02-28 23:32:05 -08:00
Bryan Stitt
20851af51b log seconds instead of milliseconds 2023-02-28 11:09:49 -08:00
Bryan Stitt
d83a1f0169 use Web3Rpc instead of the name as a key 2023-02-28 11:01:34 -08:00
Bryan Stitt
26970c2d88 move wait on new connection 2023-02-27 13:40:13 -08:00
Bryan Stitt
c5e2402d6e disconnect is noisy but it works 2023-02-27 13:29:07 -08:00
Bryan Stitt
11ee0aafe9 inotify is a pain cross platform. just check file hashes 2023-02-27 13:13:18 -08:00
Bryan Stitt
6067369ee3 add inotify and rpc disconnect 2023-02-27 12:50:57 -08:00
David
27a85c946f
Merge branch 'main' into 19-admin-imitate 2023-02-27 10:56:29 +01:00
yenicelik
fb5c9c8770 typo login should have been logout 2023-02-27 10:56:06 +01:00
Bryan Stitt
475e521918 cache getLogs with blockhash 2023-02-26 23:08:00 -08:00
Bryan Stitt
f8f5e7a1c8 add thread for config file watching and run clippy lint 2023-02-26 23:08:00 -08:00
Bryan Stitt
bf79d677b0 by_name needs to a lock 2023-02-26 20:00:13 -08:00
Bryan Stitt
e96f09a9c4 refactors to make configs partially reloadable 2023-02-25 23:52:33 -08:00
Bryan Stitt
c9e5661c5b wip 2023-02-25 09:55:28 -08:00
Bryan Stitt
c47c9136a1 cargo upgrade 2023-02-25 00:47:16 -08:00
Bryan Stitt
580965ef83 get instead of remove 2023-02-24 23:31:10 -08:00
Bryan Stitt
91b853d21e archive instead of Some(u64::MAX) in the logs 2023-02-21 21:14:49 -08:00
Bryan Stitt
0ab7738393 per-chain rpc rate limits 2023-02-21 21:10:23 -08:00
Bryan Stitt
6c33b1ae1e block number instead of hash during health check 2023-02-21 20:25:54 -08:00
yenicelik
933f71d2d9 should be ok now again 2023-02-19 21:54:23 +01:00
yenicelik
a7161790f1 pull from origin, about to push 2023-02-19 21:45:58 +01:00
yenicelik
f783ff66cf fix some errors that occurred during refactor 2023-02-19 21:43:38 +01:00
yenicelik
fc1fdaaaf1 continue rebase 2023-02-19 21:36:54 +01:00
Bryan Stitt
df87a41d5b theres a perf regression in here somewhere 2023-02-19 21:34:42 +01:00
Bryan Stitt
678cd8067b lower log level 2023-02-19 21:34:42 +01:00
Bryan Stitt
30d4da6594 the macro is easier 2023-02-19 21:34:42 +01:00
Bryan Stitt
0c4ec8ea03 properly encode number responses as hex 2023-02-19 21:34:42 +01:00
Bryan Stitt
85608dbf25 fix params in health check query 2023-02-19 21:34:42 +01:00
Bryan Stitt
cfff3ac532 comment 2023-02-19 21:34:42 +01:00
Bryan Stitt
e1f803e91a make it work 2023-02-19 21:34:42 +01:00
Bryan Stitt
1b7050d294 yes health, no channel 2023-02-19 21:34:42 +01:00
Bryan Stitt
688cc62460 remove health for now? 2023-02-19 21:34:42 +01:00
Bryan Stitt
d50c869df0 dont hold a lock open 2023-02-19 21:34:42 +01:00
Bryan Stitt
6eff5e3bf1 health check and latency recordings 2023-02-19 21:34:42 +01:00
Bryan Stitt
83c1d7051d undo a rename in the json 2023-02-19 21:34:42 +01:00
Bryan Stitt
88da33c7e4 i think it works 2023-02-19 21:34:42 +01:00
Bryan Stitt
658f658a0b add time to idle to more caches 2023-02-19 21:34:42 +01:00
Bryan Stitt
45fe524efb cargo upgrade 2023-02-19 21:34:42 +01:00
Bryan Stitt
0e8ebfa823 getting close 2023-02-19 21:34:42 +01:00
Bryan Stitt
a519427fcf fixed one test. still more to fix though 2023-02-19 21:34:42 +01:00
Bryan Stitt
da33ec32eb well it compiles. doesnt work yet. but it compiles 2023-02-19 21:34:42 +01:00
Bryan Stitt
53757621ef variable rename 2023-02-19 21:34:42 +01:00
Bryan Stitt
54b4aa8522 cargo upgrade 2023-02-19 21:34:42 +01:00
Bryan Stitt
4daf984b4b use http and ws providers in a single config 2023-02-19 21:34:42 +01:00
Bryan Stitt
5a3f586d99 include to_block more places 2023-02-19 21:34:42 +01:00
Bryan Stitt
8af87845c9 better sorting of connections 2023-02-19 21:34:42 +01:00
yenicelik
11b787e8b1 removed one comment (not needed to remove redis) 2023-02-19 21:34:42 +01:00
yenicelik
38ac23ca06 added admin trail when someone tries to login for godmode 2023-02-19 21:34:42 +01:00
yenicelik
85bec3aaf0 currently also have to specify the admin user calling the request. also added a tiny manual test to imitate user. will add trails next 2023-02-19 21:34:42 +01:00
yenicelik
7bf1d6e95a redis is not saving raw bearer tokens, so i will remove this from here 2023-02-19 21:34:42 +01:00
yenicelik
2e1fd5cd3c still struggingling with login 2023-02-19 21:34:42 +01:00
yenicelik
2ac550f60a will wait for how to login as a third party user 2023-02-19 21:34:42 +01:00
yenicelik
b1f18460d1 changes from review. will test now 2023-02-19 21:34:42 +01:00
yenicelik
de8d665e40 should next write some simple end2end test 2023-02-19 21:34:42 +01:00
yenicelik
f701109aed should write some tests next 2023-02-19 21:34:42 +01:00
yenicelik
1250b7dba2 continue rebase 2023-02-19 21:34:39 +01:00
yenicelik
61bd7d6e35 also removing login from cache. should add tests for all these cases 2023-02-19 21:33:39 +01:00
yenicelik
bbe9061402 continue rebase 2023-02-19 21:33:33 +01:00
yenicelik
6420dc6aa6 tiny refactoring and added admin entities. some bugs coming up 2023-02-19 21:27:59 +01:00
yenicelik
310df0c86d apply rebase 2023-02-19 21:27:53 +01:00
yenicelik
9e3c3fcbe0 continue rebase 2023-02-19 21:25:29 +01:00
David
2c8c4306fa
Merge branch 'main' into 19-admin-imitate 2023-02-17 14:33:43 +01:00
Bryan Stitt
738815244d change ewma calculation 2023-02-16 00:26:58 -08:00
Bryan Stitt
4916188d5c theres a perf regression in here somewhere 2023-02-15 21:54:07 -08:00
Bryan Stitt
cb2b5c16ad lower log level 2023-02-15 21:30:42 -08:00
Bryan Stitt
f2cfe2956a the macro is easier 2023-02-15 21:19:24 -08:00
Bryan Stitt
02bada3006 properly encode number responses as hex 2023-02-15 21:16:33 -08:00
Bryan Stitt
b7dfec9c63 fix params in health check query 2023-02-15 21:13:28 -08:00
Bryan Stitt
91cab8ffe2 comment 2023-02-15 21:09:39 -08:00
Bryan Stitt
bc306f62d4 make it work 2023-02-15 21:05:41 -08:00
Bryan Stitt
3c9576c13b yes health, no channel 2023-02-15 15:52:42 -08:00
Bryan Stitt
63adbc0587 remove health for now? 2023-02-15 15:42:27 -08:00
Bryan Stitt
268ad3a7c5 dont hold a lock open 2023-02-15 15:37:43 -08:00
Bryan Stitt
056670d29a health check and latency recordings 2023-02-15 15:31:59 -08:00
Bryan Stitt
774bd5b232 undo a rename in the json 2023-02-15 12:59:03 -08:00
Bryan Stitt
1fb4dd6ccc i think it works 2023-02-15 12:33:43 -08:00
Bryan Stitt
df668a5dfd add time to idle to more caches 2023-02-15 11:42:25 -08:00
Bryan Stitt
8506cd6bdc cargo upgrade 2023-02-15 11:40:55 -08:00
yenicelik
5fd440523f removed one comment (not needed to remove redis) 2023-02-15 17:13:31 +01:00
yenicelik
d6a7b702f8 added admin trail when someone tries to login for godmode 2023-02-15 17:10:45 +01:00
yenicelik
44ae497100 currently also have to specify the admin user calling the request. also added a tiny manual test to imitate user. will add trails next 2023-02-15 15:20:16 +01:00
yenicelik
36c884c9ab redis is not saving raw bearer tokens, so i will remove this from here 2023-02-15 14:57:34 +01:00
Bryan Stitt
c65ffc9ce0 getting close 2023-02-14 17:41:40 -08:00
Bryan Stitt
f1e6de3677 fixed one test. still more to fix though 2023-02-14 12:41:05 -08:00
Bryan Stitt
824a6fa1f0 well it compiles. doesnt work yet. but it compiles 2023-02-14 12:14:50 -08:00
yenicelik
0d4acfbacc still struggingling with login 2023-02-14 17:15:54 +01:00
Bryan Stitt
70105bc7bb variable rename 2023-02-12 10:22:20 -08:00
Bryan Stitt
0e2e45cf90 cargo upgrade 2023-02-12 01:47:06 -08:00
Bryan Stitt
c008f50943 use http and ws providers in a single config 2023-02-12 01:40:01 -08:00
yenicelik
4904bc6734 will wait for how to login as a third party user 2023-02-11 14:19:33 +00:00
Bryan Stitt
f1bc00082a include to_block more places 2023-02-10 20:45:57 -08:00
Bryan Stitt
c959110986 better sorting of connections 2023-02-10 20:24:20 -08:00
yenicelik
8562fc3384 changes from review. will test now 2023-02-10 17:48:51 +00:00
yenicelik
cc41e54cbf Merge branch 'upstream-main' into 19-admin-imitate 2023-02-10 17:12:22 +00:00
David
67765d2bd5
Merge branch 'llamanodes:main' into main 2023-02-10 16:34:10 +00:00
Bryan Stitt
90b57c7aed fix test. usize -> u64 2023-02-09 12:02:57 -08:00
Bryan Stitt
e062975b13 cargo upgrade 2023-02-09 11:56:58 -08:00
Bryan Stitt
1a93e39b09 FuturesUnordered on the spawn handles 2023-02-09 11:56:07 -08:00
Bryan Stitt
6741cd72ac lint 2023-02-09 11:55:54 -08:00
Bryan Stitt
4e63e69c97 actually use app.response_cache_max_bytes 2023-02-09 11:55:39 -08:00
Bryan Stitt
5ffe2aa72a eth_sendRawTransactions should use backups more often 2023-02-09 11:47:56 -08:00
Bryan Stitt
1efa8e7772 improve log message
we don't always get an empty block because we aren't synced. sometimes it is because we got disconnected
2023-02-08 11:30:16 -08:00
Bryan Stitt
ff4cb9abce cargo upgrade 2023-02-08 11:11:16 -08:00
Bryan Stitt
0b1929a820 add minimal config for quick testing 2023-02-06 15:20:36 -08:00
Bryan Stitt
0edd11349f web3 rpc spawn should be unordered 2023-02-06 14:13:43 -08:00
Bryan Stitt
19e51ce328 check http servers twice as often 2023-02-06 13:48:50 -08:00
Bryan Stitt
0f280ce483 cargo upgrade and shorten variable names
also begin adding a latency tracker for rpc stats
2023-02-06 09:55:27 -08:00
Bryan Stitt
266c410f15 add todo 2023-02-05 18:19:13 -08:00
Bryan Stitt
f2d35ba5eb remove metered in favor of influxdb stats 2023-02-05 18:17:26 -08:00
Bryan Stitt
6d959e2c1f add archive depth to app config 2023-02-05 17:58:03 -08:00
yenicelik
a0e257c8cb added endpoint to get or create the referral link for a given user 2023-02-05 14:53:41 +01:00
Bryan Stitt
37830f1156 Jenkinsfile from llamanodes/erigon 2023-02-05 00:13:14 -08:00
Bryan Stitt
1d749ed33d block all admin_ commands 2023-02-03 10:56:19 -08:00
Bryan Stitt
ca1e550370 improve sort order during eth_sendRawTransaction 2023-02-02 14:48:23 -08:00
Bryan Stitt
9ac3ef1e3d cache /health and cache /status for longer 2023-02-02 13:58:04 -08:00
Bryan Stitt
a3f2eff512 simple request counts 2023-02-02 13:45:05 -08:00
Bryan Stitt
cac31303f3 include backup in web3connection serializer 2023-02-02 08:00:59 -08:00