tornadocontrib/web3-proxy
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,303 Commits 1 Branch 0 Tags 12 MiB
013994994d
Commit Graph

1363 Commits

Author SHA1 Message Date
Bryan Stitt
5747caec71 break if no max_wait 2023-08-03 00:23:44 -07:00
Bryan Stitt
5fbcb75157 Revert "remove max_tries for now" 
This reverts commit e0d7d11398163bb8554cd6736d1dbc7f55caaa24.
 2023-08-03 00:22:45 -07:00
Bryan Stitt
ab6d3a1d9b split command line into separte module 2023-08-03 00:16:54 -07:00
Bryan Stitt
e0d7d11398 remove max_tries for now 
i think this is causing problematic looping
 2023-08-02 22:07:28 -07:00
Bryan Stitt
8aac4779bf clean up some selects 2023-08-02 21:27:56 -07:00
Bryan Stitt
d25884dfbb dont cache responses larger than 2MB 2023-08-02 15:22:26 -07:00
Bryan Stitt
7cd91af3a8 don't cache nulls 2023-07-31 14:26:07 -07:00
Bryan Stitt
ca92b3646c cache eth_feeHistory and eth_gasPrice 2023-07-28 10:41:23 -07:00
Bryan Stitt
1185b2d0f9 cache eth_maxPriorityFeePerGas with the head block 2023-07-28 10:38:12 -07:00
Bryan Stitt
a696fb92f6 disable CheckEmailInput for now 2023-07-27 13:52:12 -07:00
Bryan Stitt
32a73a0c53 cargo upgrade --incompatible 2023-07-27 12:29:10 -07:00
Bryan Stitt
9c458c9ee0 add grant_credits_to_address script 2023-07-27 12:29:10 -07:00
Bryan Stitt
f9dd827439 add a log message about how many users are being upgraded 2023-07-27 12:29:10 -07:00
Bryan Stitt
67fd5a2188 change log levels 2023-07-26 16:42:49 -07:00
Bryan Stitt
788ebff29f improve logging during payment parsing 2023-07-26 16:39:17 -07:00
Bryan Stitt
2b14842879 check the payment factory address against the log address 2023-07-26 13:22:13 -07:00
Bryan Stitt
b1f447c5c8
add mass_grant_credits helper script and other prep for premium (#196) 
* add mass_grant_credits helper script

* include error in the rate limit log

* allow granting 0 credits

* migration to change default user_tier to premium
 2023-07-26 07:33:00 -07:00
Bryan Stitt
b80f994e90 timestamps instead of tags for cardinality reduction 2023-07-25 21:45:01 -07:00
talking-llama
e238203bbc
Add OtterScan Methods and corresponding CUs (#195) 
Co-authored-by: Rory Neithinger <rorytrent@gmail.com>
 2023-07-25 21:06:03 -07:00
Bryan Stitt
c831a810b4 error level for anyhow errors 2023-07-25 15:15:03 -07:00
Bryan Stitt
05e618f74c
Anon rpc accounting (#194) 
* cargo generate migrations didnt work without this

* anon rpc accounting

* Revert "anon rpc accounting"

This reverts commit f1b8cbcdeca0d5f9545da32f11dda6a90854f97a.

* 0 for anon in mysql

* only set approximate_balance_remaining on owned stats

* only set self.approximate_balance_remaining when adding if some

* todo complete
 2023-07-24 22:02:33 -07:00
Bryan Stitt
439ac49495 jsonrpc formatted errors for JsonRejection 2023-07-24 16:25:58 -07:00
Bryan Stitt
e01b3c2806 watch for SIGTERM 2023-07-22 02:30:49 -07:00
Bryan Stitt
12f3f940a0 include the window in the tsdb logs 2023-07-22 01:56:13 -07:00
Bryan Stitt
35b03cffad lint 2023-07-22 01:41:07 -07:00
Bryan Stitt
80d50bc2c0 need unique names in tests 2023-07-22 01:38:54 -07:00
Bryan Stitt
4091e05f3d influx id from config. default to the hostname or fallback to ulid 2023-07-22 00:26:02 -07:00
Bryan Stitt
df027527e9 remove origin (pt 2) 2023-07-21 22:47:43 -07:00
Bryan Stitt
252b3001c1 increment a wrapping counter every time we save stats 2023-07-21 22:47:22 -07:00
Bryan Stitt
39141c1e52 comments 2023-07-21 22:14:31 -07:00
Bryan Stitt
185ce7a3b4 flush tsdb every 10 2023-07-21 16:39:27 -07:00
Bryan Stitt
88b2618edf add to the running total everywhere 2023-07-21 16:38:02 -07:00
Bryan Stitt
b08a279b60 add another field to try to handle improper de-duplication 2023-07-21 16:29:10 -07:00
Bryan Stitt
620f2d9d00 30 second flushes for db too 2023-07-21 16:12:43 -07:00
Bryan Stitt
0a3698de0f 30 seconds for tsdb everywhere 2023-07-21 15:51:32 -07:00
Bryan Stitt
f15f1027cf stat buffer count total requests and print on exit 2023-07-21 15:25:02 -07:00
yenicelik
f7cfd39d93 Revert "Merge branch 'devel' of github.com:llamanodes/web3-proxy into devel" 
This reverts commit 4fc745b52b90b72fdd2d9e8e990ec2d42d9f680d, reversing
changes made to bc6d18041d652502f83d44aedbea234e02b59f6f.
 2023-07-21 18:03:55 -04:00
Bryan Stitt
489cd7c326 drop Origin (it was none everywhere already anyways) 2023-07-21 14:50:38 -07:00
Bryan Stitt
d4518cd2bf spans on the stat add function 2023-07-21 14:27:43 -07:00
Bryan Stitt
dc4b6d501c move active_premium opt_in check 2023-07-21 13:58:09 -07:00
Bryan Stitt
044d19e3ec more info in Balance's Debug 2023-07-21 13:57:47 -07:00
Bryan Stitt
e6666d92d8 don't unwrap if config cant send 2023-07-21 13:28:08 -07:00
Bryan Stitt
a68d0d60b7 only health check if theres a block and rpc sender 2023-07-21 13:28:00 -07:00
Bryan Stitt
7fa88e7251 keep the cache size consistent 2023-07-20 22:34:32 -07:00
Bryan Stitt
c674871c98 only create owned key if active premium 2023-07-20 21:13:55 -07:00
Bryan Stitt
e222572d09 rpc_key_user_id should be None for global stats 2023-07-20 21:13:24 -07:00
Bryan Stitt
0b1cfeffed use normalize path layer to trim trailing slash 2023-07-20 20:05:37 -07:00
Bryan Stitt
cb5c1c6582 no limits on rpc_secret_key_cache and user_balance_cache 2023-07-20 19:04:32 -07:00
Bryan Stitt
7678cb7389 caches aren't actualy optional on buffer 2023-07-20 18:21:49 -07:00
Bryan Stitt
3334dc5c0b mark as premium if no downgrade tier id 2023-07-20 14:54:42 -07:00
Bryan Stitt
ae8a12047e tarpit strange methods 2023-07-20 14:32:52 -07:00
Bryan Stitt
e7905b4344 Revert "First pass implementation of async serialize for Web3Rps (#192)" 
This reverts commit 269aa32260a4c3e94d7ada55fee6c8e62d975c87.
 2023-07-19 23:12:49 -07:00
Bryan Stitt
ac2d9049be improve flushing and buffering of stats 2023-07-19 22:55:14 -07:00
Bryan Stitt
90ffb5254a flush all stats 2023-07-19 18:41:40 -07:00
Bryan Stitt
e6dc64f369 add timeout as a the tower layer 2023-07-19 18:41:26 -07:00
Bryan Stitt
a97cb6a0c5 lint 2023-07-18 09:50:51 -07:00
Bryan Stitt
600c1bafb4
David/multiple proxy test (#187) 
* add test_multiple_proxies_stats_add_up

* make a premium user using both proxies

* added a couple clones, must add constraints now to run for multiple-proxies (check arithmetic)

* lint and code review

* fix comment

* fix tests (now fails at todo)

* will introduce endpoint to fetch rpc stats from mysql

* added influxdb to tests, should next do asserst in stats collected by influx, and mysql for multi-proxy

* created test where influx and mysql have separate data, should help with debugging

* forgot to drop influx

* tests pass except multi-proxy

* test passes, will check out nothing broke elswhere

* go back to numbers

* some linting

* linting

* removed redundant info!

* responding to PR comments

* ULID as instance-hash for the tag in influx (for anti-dup)

---------

Co-authored-by: yenicelik <david.yenicelik@gmail.com>
 2023-07-17 13:31:41 -07:00
Bryan Stitt
fe672b5189 dont disable on_failure. the log breadcrumbs can be helpful still 2023-07-14 23:04:24 -07:00
Bryan Stitt
140dc04a8b dont put anon stats in the db (for now) 
the indexes need to be fixed. UNIQUE+NULL do not play nice
 2023-07-14 22:19:18 -07:00
Bryan Stitt
264508c454 treat serde errors as rate limits (because all of them seem to be) 2023-07-14 21:43:37 -07:00
Bryan Stitt
042e644865 comment 2023-07-14 18:38:13 -07:00
Bryan Stitt
61126bb2ac one more Cow 2023-07-14 18:35:40 -07:00
Bryan Stitt
020dff0233 lint 2023-07-14 18:31:42 -07:00
Bryan Stitt
efa189d101 less anyhow and fix tests 2023-07-14 18:31:00 -07:00
Bryan Stitt
0046a02a4a
Global db (#191) 
* dont migrate on start. just connect

* it compiles

* that log is loud

* get transaction from a local clone

* import the trait

* put the test app into a thread instead of tokio::spawn

* fix one test

* try db before rpcs

* db connection is too slow. need to wait for it

* do db setup once while spawning
 2023-07-14 18:30:01 -07:00
Bryan Stitt
269aa32260
First pass implementation of async serialize for Web3Rps (#192) 
Co-authored-by: Rory Neithinger <rorytrent@gmail.com>
 2023-07-14 18:29:48 -07:00
Bryan Stitt
fe45813e4c remove info logging 2023-07-14 01:21:50 -07:00
Bryan Stitt
37e3d0be2b you cant do a runtime in a drop like this apparently 2023-07-14 01:19:27 -07:00
Bryan Stitt
6371206315 rate limit by ip if unknown key 2023-07-14 00:23:05 -07:00
Bryan Stitt
f217bf33b3 disable db stats for now 2023-07-13 23:45:04 -07:00
David
31f840432d
Add DateCreated fields to admin and on-chain deposit (#190) 
* tests seem to be passing

* bump version

* bump version
 2023-07-13 19:25:14 -07:00
Bryan Stitt
3c2d06324e faster rpc. backups always lose 2023-07-13 18:14:13 -07:00
Bryan Stitt
45af241429 less db transactions 2023-07-13 15:44:07 -07:00
Bryan Stitt
5d5e65ed40 close the db connection on exit 2023-07-13 15:44:07 -07:00
Bryan Stitt
a893a41c90 rename get to connect 2023-07-13 15:44:07 -07:00
Bryan Stitt
dce3540ee3 less authorization and remove pending txs for now 2023-07-13 11:01:16 -07:00
Bryan Stitt
53877ed2e5 less transactions when handling uncles 2023-07-13 10:27:44 -07:00
Bryan Stitt
28e6be5d9b handle uncles in the background and keep transaction open for a shorter time 2023-07-13 10:13:50 -07:00
Bryan Stitt
fa21b7c0a8 lint 2023-07-13 10:13:14 -07:00
David
c1a3a2dfbb
Remove stripe duplicate endpoint (#186) 2023-07-12 19:19:15 -07:00
Bryan Stitt
5d207fb2c6
Auto tier change (#184) 
* lint

* change user to premium on admin credits

todo: change on other deposits

* set tier more places

* BadRequest instead of 500

* insert existing users too

* add the premium file
 2023-07-12 10:24:16 -07:00
Bryan Stitt
df2f3d340f
More balance tests (#182) 
* fix popularity contest

* more info in the Debug for Web3Rpc

* add frontend_requests and cache_misses to the Balance query

* add more to balance and stats flushing and improved test coverage

* it compiles

* deserializer for Ulid to Uuid

I think a wrapper type on Ulid that implements sea_orm::Value is probably better

* rename variable to match struct name

* add deserializer for Address -> Vec<u8>

* sql sum returns a Decimal. need to convert to u64

* assert more

* one log and assert more

* log more

* use a helper to get the user's rpc provider

* this should be 2 now that we have a public and authed call

* this should be zero. the public has the cache miss

* instrument cu calcs

* trace the value we took, not the default that replaced it

* move usd_per_chain into config

* remove some extra logging

* use Arc::into_inner to maybe avoid a race

* off by 1

* pass paid credits used instead of returning it

this lets us use it to write to our user balance cache first. importantly, this keeps us from holding a write lock while writing to mysql

* no cache misses expected in this test

* actually check the admin

* put the balance checks back now that the rest of the test works

* archive request is being set incorrectly

* wow howd we manage flipping the greater than sign on archive depth

* move latest_balance and premium_credits_used to before any stats are emitted

* lint

* and build undoes the linting. fun

i didnt even want to lint them in the first place, so this is fine

* missed incrementing total_spent when not incrementing total_spent_paid_credits

* use the credits on self

* use the credits on self (pt 2)

* fix type for 10 cu query

* convert the requestmetadata on the other side of the channel

* logs

* viewing stats is allowed even without a balance

* move paid_credits_used to AuthorizationChecks

* wip

* test_sum_credits_used finally passes

* UserBalanceCache::get_or_insert

* re-enable rpc_secret_key_cache

* move invalidate to a helper function

and always call it **after** the db is commited

* fix PartialEq and Eq on RpcSecretKey

* cargo upgrade
 2023-07-12 00:35:07 -07:00
Bryan Stitt
5f215facab fix typo 2023-07-11 13:18:19 -07:00
Bryan Stitt
8746cc1ae6 catch the new error format for returndata limit 2023-07-10 23:38:23 -07:00
Bryan Stitt
0f7e370c92 drop flume. just use tokio 
i dont know if this is the problem, but this will also get compile times down
 2023-07-10 23:08:06 -07:00
Bryan Stitt
3059d08674 error on max_head_block_age and keep the sender alive longer 2023-07-10 22:17:15 -07:00
Bryan Stitt
04825be99d error if health checks are failing 2023-07-10 20:59:17 -07:00
Bryan Stitt
fe39ad1e1e Revert "Revert "fixes for disconnect and config reloads"" 
This reverts commit 3cfbc3cbf124caf9154ffe6a444082cb0c3e20a1.
 2023-07-10 20:59:03 -07:00
Bryan Stitt
3cfbc3cbf1 Revert "fixes for disconnect and config reloads" 
This reverts commit 50fed0b0e79778d17bb40df96a11e44341dde0d1.
 2023-07-10 20:30:10 -07:00
Bryan Stitt
50fed0b0e7 fixes for disconnect and config reloads 2023-07-10 19:41:14 -07:00
Bryan Stitt
2dfc5dcdf3 set http keep alive to a longer time 2023-07-10 18:37:25 -07:00
Bryan Stitt
31f772591b put rpcs in a rwlock again 2023-07-10 18:09:58 -07:00
Bryan Stitt
98bda65735 inner instead of left 2023-07-10 16:25:01 -07:00
Bryan Stitt
0181347b42 one less clone 2023-07-10 15:41:55 -07:00
Bryan Stitt
e80d1bd23a add more to Web3Rpcs debug 2023-07-10 15:31:10 -07:00
Bryan Stitt
a7f1c043c5 sync before Serialize 2023-07-10 15:26:00 -07:00
Bryan Stitt
c00eebeb32 admin_ should be unimplemented cost 2023-07-10 15:13:49 -07:00
Bryan Stitt
a7119f6b5b
split balance queries up (#177) 
* wip

* tests pass, referee_bonus changed to one_time_referee_bonus

---------

Co-authored-by: yenicelik <david.yenicelik@gmail.com>
 2023-07-10 14:03:05 -07:00
Bryan Stitt
9ef08c80e1 remove parking_lot 2023-07-10 11:05:07 -07:00
Bryan Stitt
2ea53cc396 could not get block from params should be error level 2023-07-09 22:52:29 -07:00
Bryan Stitt
9ee6b18172 no more lock update needed 
all these things are idempodent now
 2023-07-09 22:51:01 -07:00
Bryan Stitt
af4ca0f450 distinguish some errors 2023-07-09 22:49:29 -07:00
Bryan Stitt
a43fda0c32
Bryan devel (#176) 
* refactor more balance logic

* refactor more balance checks

* doc running full test suite
 2023-07-09 21:37:50 -07:00
Bryan Stitt
0ddd3662ac
David/new balance logic mk3 (#175) 
* WIP will work on locks

* added concurrent test for referral, numbers rn still add up

* will change balance table to be a view instead of a table

* merged in devel. will proceed with migrations for rpc_stats_v2 and referral

* WIP

* WIP

* WIP compiling

* gotta add the balance_v2 view

* about to add balance view

* stupid missing closing param

* compiles again, now i will just have to implement the raw sql

* need to paste the real query and play with it

* ok now on to testing

* addresses many comments in PR

* app works for simple unauthorized access. will look into tests

* some tests pass, referral logic tests fail

* not sure why the test is failing

* invalidate cache for admin, will check for more possible targets

* user balance decrease test works

* all tests pass

* changed to active model

---------

Co-authored-by: yenicelik <david.yenicelik@gmail.com>
 2023-07-09 20:15:32 -07:00
Bryan Stitt
a560d47c48 lint 2023-07-09 20:13:03 -07:00
Bryan Stitt
b527f5d0d6
David/remove balance logic non destructive (#173) 
* WIP will work on locks

* added concurrent test for referral, numbers rn still add up

* will change balance table to be a view instead of a table

* merged in devel. will proceed with migrations for rpc_stats_v2 and referral

* WIP

* WIP

* WIP compiling

* gotta add the balance_v2 view

* about to add balance view

* stupid missing closing param

* compiles again, now i will just have to implement the raw sql

* need to paste the real query and play with it

* ok now on to testing

* addresses many comments in PR

* app works for simple unauthorized access. will look into tests

* some tests pass, referral logic tests fail

* not sure why the test is failing

---------

Co-authored-by: yenicelik <david.yenicelik@gmail.com>
 2023-07-09 19:23:32 -07:00
Bryan Stitt
386363e295 add request id to tracing 2023-07-08 11:57:53 -07:00
Bryan Stitt
9e89304eb7 try_send instead of send 2023-07-07 21:58:00 -07:00
Bryan Stitt
62407ee834 more trace logging cleanup 2023-07-07 16:24:45 -07:00
Bryan Stitt
1b7cc2bffe clean trace logging 2023-07-07 16:22:49 -07:00
Bryan Stitt
78c6179f02 clean up rate limit logging 2023-07-07 15:56:46 -07:00
Bryan Stitt
b476a56ad6 check for U64 instead of just BlockNumber 
i thouht block number would be smart enough to deserialize, but it seems like not
 2023-07-07 15:28:24 -07:00
Bryan Stitt
b234265458
Premium tier changes (#170) 
* lower premium concurrency in preparation for key+IP limits

* include the ip in the user semaphore

* 3, not 5

this is our current limit for free

* per user_id+ip rate limiting
 2023-07-07 15:15:41 -07:00
Bryan Stitt
651244fbca lower log levels 2023-07-07 14:14:03 -07:00
Bryan Stitt
57f640765a remove a level of retries 2023-07-07 14:06:44 -07:00
Bryan Stitt
512bcf305b lint 2023-07-07 14:06:35 -07:00
Bryan Stitt
6176a91fc1 whitespace 2023-07-07 12:36:26 -07:00
Bryan Stitt
e15235e2a3 add CU cost for trace_callMany 
arbitrary cost. we should do some actual calculations
 2023-07-07 12:34:12 -07:00
Bryan Stitt
f49a64e551 raise warning to error 2023-07-07 12:27:20 -07:00
Bryan Stitt
f6fea1541b this is warn, not an error 2023-07-07 12:21:25 -07:00
David
f6337ce940
Update payment_stripe.rs 2023-07-07 08:37:47 -04:00
Bryan Stitt
ac77b691df improve deadlock panic message 2023-07-06 15:03:02 -07:00
Bryan Stitt
a8d2f3fe62 include the error in the warning 2023-07-06 14:58:18 -07:00
Bryan Stitt
cf3d984548
switch the lock type (#165) 2023-07-06 14:54:52 -07:00
Bryan Stitt
4a32ce0a19 only warn if unable to flush 2023-07-06 14:51:21 -07:00
Bryan Stitt
205a5b9b42 add missing import and test more 2023-07-06 14:00:26 -07:00
yenicelik
af45f78ff5 added test for admin deposit endpoint, fixed bugs 2023-07-06 08:19:33 -04:00
Bryan Stitt
fc9b1dd69e fix feature name 2023-07-06 04:37:49 -07:00
Bryan Stitt
ffef36dafe more tracing cleanup 2023-07-06 04:36:02 -07:00
Bryan Stitt
a0b256cbd2 panic on deadlock 2023-07-06 04:18:48 -07:00
Bryan Stitt
5d3751ea88 another test 2023-07-06 04:04:12 -07:00
Bryan Stitt
0e51a7ca2e roundabout Default 2023-07-06 04:02:30 -07:00
Bryan Stitt
e0c57a22ae derivative and serde didn't work together like we'd hoped 2023-07-06 03:51:39 -07:00
Bryan Stitt
0e3fdfa0ea cache eth_getLogs fromBlock properly 2023-07-05 23:13:42 -07:00
Bryan Stitt
4ae4d7a75e include default sample rate 2023-07-05 22:34:10 -07:00
David
8d31680ff1
David/referral test new (#162) 
* working on test for referral

* refactored logic in tests to helper functions

* added getbalance helper

* added more helper functions to test for referral

* gotta be able to submit to rpc now

* adding provider instead

* referral tests are not passing, may be because we need for stats to be updated

* balance doesnt decrease

* will look into deposits in the meantime

* finding some first bugs

* seems to have fixed a bunch of stuff

* feedback, lint, and make it compile

---------

Co-authored-by: Bryan Stitt <bryan@llamanodes.com>
 2023-07-05 22:18:39 -07:00
David
659fce0e33
Deposit history for stripe and admin (endpoints) (#160) 
* added endpoints for stripe and admin deposits

* modified comments
 2023-07-05 19:26:03 -07:00
Bryan Stitt
3bbbdd5596
Flush stats (#161) 
* create buffer if mysql OR influx is set up

* this one flush should error

* it helps to set up the db in the db migration test

* comment
 2023-07-05 19:24:21 -07:00
Bryan Stitt
eb7b98fdbe
Split errors (#158) 
* add migration for splitting errors

* fix type from u32 to u64

* update entities to match migrations

* no migration needed. these are only in stats

* add user_error_response to influx

* only if detailed

* set error_response and user_error_response

* 0 cost error responses

* only 33 migrations now

* put macros back

* get the stat buffer sender to the TestApp helper

* fixes
 2023-07-05 18:18:10 -07:00
Bryan Stitt
97d3faa3d7 wait up to 35 seconds to start frontend 2023-07-05 11:29:56 -07:00
Bryan Stitt
21b59bb953 rename stripe_api_key to stripe_whsec_key 2023-07-05 11:26:39 -07:00
Bryan Stitt
477f69c6e9 use derivative+serde default instead of just serde default 2023-07-03 20:38:39 -07:00
Bryan Stitt
a64e32b085 remove bearer token semaphore. it isn't really necesary 
we can come back to rate limiting authenticated endpoints later
 2023-07-03 16:54:25 -07:00
Bryan Stitt
f0cdb3b234 flatten routes 2023-07-03 15:59:06 -07:00
Bryan Stitt
d613969c3e Merge remote-tracking branch 'origin/devel' into david/test-admin 2023-07-03 14:07:43 -07:00
Bryan Stitt
ee6b725a1b lower log level on payload and headers 2023-07-03 13:34:16 -07:00
Bryan Stitt
d9c6da74c2 fix case on currency check 2023-07-03 13:30:37 -07:00
Bryan Stitt
d8512d50de just pass the whole string through 
based on this test (which i think async-stripe forked): https://docs.rs/stripe-rust/0.12.3/src/stripe/resources/event.rs.html#355

and then based on the struct that they deserialize into: https://docs.rs/async-stripe/latest/src/stripe/resources/generated/event.rs.html#16
 2023-07-03 12:57:52 -07:00
Bryan Stitt
b13e5b2440 move more logs to tracing and possible stripe payment fix 
maybe RawValue does need to_string instead of just get
 2023-07-03 12:17:30 -07:00
yenicelik
458f7d6514 could call subcommand 2023-07-01 15:26:42 -04:00
Bryan Stitt
377cd8bcf3 one more stripe option 
need to check if case matters
 2023-07-01 09:12:50 -07:00
Bryan Stitt
7044edc63c check multiple posible stripe headers 2023-07-01 09:10:53 -07:00
yenicelik
17c42243d0 wont shutdown 2023-06-30 22:24:48 -04:00
Bryan Stitt
c26d57fe5e test log in and out 2023-06-30 12:53:21 -07:00
Bryan Stitt
4a03d2e331 loop until it works 2023-06-29 23:15:57 -07:00
Bryan Stitt
5da334fcb7 start adding tests that need docker for mysql management 2023-06-29 22:38:35 -07:00
Bryan Stitt
581af0d596
stripe integration first mvp (replaces #140) (#154) 
* stripe integration first mvp

* addressing some points from #140

* stripe endpoint needs testing

* addressed some comments

* added Json(payload)

* update toolchain

* lint (well, most of it)

---------

Co-authored-by: yenicelik <david.yenicelik@gmail.com>
 2023-06-29 14:32:05 -07:00
Bryan Stitt
f6c8172a13 always do connectinfo for now 2023-06-29 13:12:35 -07:00
Bryan Stitt
c0a658c6b4 move subcommands so integration tests are easier to write 2023-06-29 12:24:36 -07:00
Bryan Stitt
b4f02b24f3 pricing for ots_ 2023-06-29 10:24:05 -07:00
Bryan Stitt
da13542789 lower sample rate 2023-06-29 10:18:32 -07:00
Bryan Stitt
335480cec9 more tracing logs 2023-06-29 10:15:12 -07:00
Bryan Stitt
357701bccc no need to check the caches, we have latest block 2023-06-29 00:06:58 -07:00
Bryan Stitt
bfc663d678 fix eth_blockNumber formatting 2023-06-28 23:00:48 -07:00
Bryan Stitt
280e2075d3
Fix Issue 65 Pt. 2 (#153) 
* change subuser balance logic and add message to access denied errors

* clearer import

* comments

* comments
 2023-06-28 23:00:34 -07:00
Bryan Stitt
ebceb0d7d6 descriptive text on NotImplemented errors 2023-06-28 21:47:06 -07:00
Bryan Stitt
d0e77237fa raise log level 2023-06-28 21:38:57 -07:00
Bryan Stitt
0c389e43b4 don't dedupe rpc 2023-06-28 21:34:51 -07:00
Bryan Stitt
fba41b9bc2 lots of tracing improvements 2023-06-28 21:30:00 -07:00
Bryan Stitt
25b04db3b5 lower log level and optional to 2023-06-28 21:08:43 -07:00
Bryan Stitt
342adb528d add sentry tag for env and chain_id 2023-06-28 20:38:33 -07:00
Bryan Stitt
2a714acc30 deref 2023-06-28 19:19:36 -07:00
Bryan Stitt
c6930dcb4c saturating sub 2023-06-28 19:19:14 -07:00
Bryan Stitt
d11d6c1f8a more logs 2023-06-28 18:44:54 -07:00
Bryan Stitt
e8d992168c more logs and retries 2023-06-28 18:36:17 -07:00
Bryan Stitt
3cfbc5baa4 improve cache keys and allow failures while parsing params 2023-06-28 17:42:49 -07:00
Bryan Stitt
df865292a7 add another layer of retries 2023-06-28 15:12:16 -07:00
Bryan Stitt
eab3aa7943 that simpler param doesn't work everywhere 2023-06-27 17:39:37 -07:00
Bryan Stitt
ec7c8f0434 todo 2023-06-27 17:08:49 -07:00
Bryan Stitt
cdea61cb6b one list for ranked rpcs 2023-06-27 15:55:29 -07:00
Bryan Stitt
46ee5bf277 that loop waits forever 2023-06-27 11:02:12 -07:00
Bryan Stitt
25e5caaab8 simple sleep for now. will fix with better waits later 2023-06-27 10:50:15 -07:00
Bryan Stitt
8e98eabebe lower error log when starting 2023-06-27 10:05:07 -07:00
Bryan Stitt
b35ad330c9 save last provider error 2023-06-26 23:04:56 -07:00
Bryan Stitt
917dfc914f handle more jsonrpc errors as HTTP 200 2023-06-26 22:40:00 -07:00
Bryan Stitt
009fdbe2cf make references compile 2023-06-26 21:38:41 -07:00
Bryan Stitt
469b55fa9a sort and 0 cost test method 2023-06-26 21:38:08 -07:00
Bryan Stitt
0d1e629567 more tracing and error handling 2023-06-26 21:11:43 -07:00
Bryan Stitt
6f7783d260 add block stats to top of status data 2023-06-26 21:11:16 -07:00
Bryan Stitt
1a7d4c9cbb handle subscriptions and unimplemented 
this also means we handle new methods that haven't been added to our list as only 2 cu
 2023-06-26 21:10:32 -07:00
Bryan Stitt
8cb57e2f88 add EXTRA_RUST_LOG helper 2023-06-26 21:08:48 -07:00
Bryan Stitt
f68964f63d add 3 tries 2023-06-26 21:08:32 -07:00
Bryan Stitt
8815b5c8cd lint 2023-06-25 21:26:28 -07:00
yenicelik
627c359645 mixed up directions 2023-06-25 21:19:13 -04:00
yenicelik
bbdff1d916 some code got lost in all the commits, deploying again 2023-06-25 21:02:07 -04:00
David
0f4d12e2a5
Merge pull request #149 from yenicelik/devel 
Devel
 2023-06-25 17:55:55 -04:00
Bryan Stitt
0aa94d9c87 don't escape newlines 2023-06-25 14:34:19 -07:00
yenicelik
88617dc72b added more tracing for balance 2023-06-25 17:25:35 -04:00
yenicelik
32156e981d adding balances 2023-06-25 17:19:31 -04:00
yenicelik
992860a46d forgot to allow aggregate global stats 2023-06-25 16:18:09 -04:00
yenicelik
4c157cfcf7 made paymentrequired error code instead of introducing a new one 2023-06-25 15:05:27 -04:00
yenicelik
935681fde7 stats subuser + premium access logic 2023-06-25 14:29:54 -04:00
Bryan Stitt
fee1a423a1 simpler type when no args 2023-06-24 22:30:57 -07:00
Bryan Stitt
83123f5cdd wait up to a second for it to sync 2023-06-24 21:51:58 -07:00
Bryan Stitt
e7baeb1ba4 rearrange so maybe time works better 2023-06-24 21:41:18 -07:00
Bryan Stitt
c2917f1093 try sleeping 2023-06-24 21:35:36 -07:00
Bryan Stitt
ba702c7647 tests pass local, but jenkins isn't as fast 2023-06-24 21:27:11 -07:00
Bryan Stitt
b5ae11b7f7 lint 2023-06-24 21:21:51 -07:00
Bryan Stitt
a440d51377 test fixture 2023-06-24 21:17:08 -07:00
Bryan Stitt
8cfbbfe1b3 use default derive helpers 2023-06-24 20:39:46 -07:00
Bryan Stitt
efe1e30791 better handling of 0 port and fix test port 2023-06-24 20:38:06 -07:00
Bryan Stitt
ab3d4a91a8 json body instead of params 2023-06-24 18:17:51 -07:00
Bryan Stitt
0c10994835 why wont that import? 2023-06-24 16:45:07 -07:00
Bryan Stitt
94d0a25aaf test logs 2023-06-24 16:43:11 -07:00
Bryan Stitt
38b266156a consistent route name 2023-06-24 15:49:26 -07:00
Bryan Stitt
1d6e1ef9af polish error logs 2023-06-24 15:24:46 -07:00
Bryan Stitt
fef03f089f less verbose db_conn and db_replica helpers 2023-06-24 11:11:07 -07:00
Bryan Stitt
9115419ec0 handle addresses consistently 2023-06-24 10:20:24 -07:00
Bryan Stitt
39a505c0ff POST instead of GET and use more txs 2023-06-24 09:59:08 -07:00
Bryan Stitt
8f76d9320d support EIP1271 login 2023-06-24 09:48:31 -07:00
Bryan Stitt
91cbce6ce8 start adding stat for CU 2023-06-24 00:48:56 -07:00
Bryan Stitt
30828ccae2 prioritize block. queries to syncing nodes ends up being slower 2023-06-24 00:41:30 -07:00
Bryan Stitt
ac4b7e46b4 actually import info level 2023-06-23 22:54:02 -07:00
Bryan Stitt
6edf1a5c1b info on new block 2023-06-23 22:52:42 -07:00
Bryan Stitt
fd661689a3
Tracing (#144) 
* tracing

* add tracing and features to match

* use just one hostname crate

* cargo upgrade

* set up pretty logger and sentry layer
 2023-06-23 16:28:45 -07:00
Bryan Stitt
3fac4248d6 Revert "just use Ulid instead of RpcSecretKey type" 
It did work

This reverts commit 377e8356a57d80dd17b746dd05a62b475d9e7d07.
 2023-06-23 01:29:11 -07:00
Bryan Stitt
377e8356a5 just use Ulid instead of RpcSecretKey type 2023-06-23 01:28:47 -07:00
Bryan Stitt
68ab9b6d1d always serialize RpcSecretKey as a ULID 2023-06-23 01:07:54 -07:00
Bryan Stitt
6b6fac396f lower default web3_proxy::rpcs::consensus level 2023-06-22 22:45:43 -07:00
Bryan Stitt
b1b8346db9
#123 role to rpc keys (#142) 
* added roles to rpc keys

* dont unwrap

---------

Co-authored-by: yenicelik <david.yenicelik@gmail.com>
 2023-06-22 12:56:19 -07:00
Bryan Stitt
c79b787e13
allow setting referral code if not already set (#141) 2023-06-22 12:41:05 -07:00
Bryan Stitt
376b9f474d use short syntax for json data in logs 2023-06-22 12:10:23 -07:00
Bryan Stitt
f593667169 fix lifetimes 2023-06-22 10:16:58 -07:00
Bryan Stitt
dffff65950 allow no referrer_record 2023-06-22 09:25:12 -07:00
Bryan Stitt
c560a59ef0 add more headers for debug endpoints and use more refs 2023-06-21 22:11:26 -07:00
Bryan Stitt
662bbb296f add header debug endpoint 2023-06-21 11:28:33 -07:00
Bryan Stitt
63c4f9e591 allow no ip 
this shouldn't be needed, but is a workaround while we debug staging
 2023-06-21 11:28:22 -07:00
Bryan Stitt
7f4da8d43c lint 2023-06-21 10:40:55 -07:00
Bryan Stitt
d962b749a2 use find_with_related, not find_also_related 
find_also_related is 1:1, but we want 1:Many
 2023-06-21 10:37:01 -07:00
Bryan Stitt
1cbb58e8e0 comment 2023-06-21 10:25:10 -07:00
Bryan Stitt
06ce95c386 let serde_json do more of the work 2023-06-21 10:18:36 -07:00
Bryan Stitt
5504062f47 dont error if no referrals 2023-06-21 10:18:06 -07:00
Bryan Stitt
8f1b6fe6c0 lint 2023-06-21 10:02:02 -07:00
Bryan Stitt
4dad743fc3 tuple, not list 2023-06-21 10:01:51 -07:00
Bryan Stitt
f75f3f8d2f serialize caches in a list 2023-06-21 10:00:05 -07:00
Bryan Stitt
3c2f95de10
Improve max wait and timeouts (#137) 
* pass max wait with more functions

* move rpc_head_str higher up to use it in all the logs

* refresh consensus at double the block time

* new pricing that also includes archive check

* lint

* don't clone method

* put caches into one list

they serialize with their name, so it will still be easy to tell them apart

* more consistent waiting. still waits more than I want right now

* clean up default max waits

* more timeouts
 2023-06-20 14:22:14 -07:00
Bryan Stitt
6d25c41faf
Compute units (#136) 
* wip

* add basic compute unit calculator

* calculate costs with compute units
 2023-06-19 17:47:38 -07:00
Bryan Stitt
b7935f77fc spawn recording latency 2023-06-19 17:46:58 -07:00
Bryan Stitt
6038351cb8 change default tracking in prep for premium-only keys 2023-06-19 13:00:57 -07:00
Bryan Stitt
b35cd58a76 rate limit user_balance_post by bearer OR ip 2023-06-19 10:21:48 -07:00