Commit Graph

2102 Commits

Author SHA1 Message Date
Bryan Stitt
b6cbf02ae7 test_sum_credits_used needs docker 2023-07-12 00:47:55 -07:00
Bryan Stitt
df2f3d340f
More balance tests (#182)
* fix popularity contest

* more info in the Debug for Web3Rpc

* add frontend_requests and cache_misses to the Balance query

* add more to balance and stats flushing and improved test coverage

* it compiles

* deserializer for Ulid to Uuid

I think a wrapper type on Ulid that implements sea_orm::Value is probably better

* rename variable to match struct name

* add deserializer for Address -> Vec<u8>

* sql sum returns a Decimal. need to convert to u64

* assert more

* one log and assert more

* log more

* use a helper to get the user's rpc provider

* this should be 2 now that we have a public and authed call

* this should be zero. the public has the cache miss

* instrument cu calcs

* trace the value we took, not the default that replaced it

* move usd_per_chain into config

* remove some extra logging

* use Arc::into_inner to maybe avoid a race

* off by 1

* pass paid credits used instead of returning it

this lets us use it to write to our user balance cache first. importantly, this keeps us from holding a write lock while writing to mysql

* no cache misses expected in this test

* actually check the admin

* put the balance checks back now that the rest of the test works

* archive request is being set incorrectly

* wow howd we manage flipping the greater than sign on archive depth

* move latest_balance and premium_credits_used to before any stats are emitted

* lint

* and build undoes the linting. fun

i didnt even want to lint them in the first place, so this is fine

* missed incrementing total_spent when not incrementing total_spent_paid_credits

* use the credits on self

* use the credits on self (pt 2)

* fix type for 10 cu query

* convert the requestmetadata on the other side of the channel

* logs

* viewing stats is allowed even without a balance

* move paid_credits_used to AuthorizationChecks

* wip

* test_sum_credits_used finally passes

* UserBalanceCache::get_or_insert

* re-enable rpc_secret_key_cache

* move invalidate to a helper function

and always call it **after** the db is commited

* fix PartialEq and Eq on RpcSecretKey

* cargo upgrade
2023-07-12 00:35:07 -07:00
Bryan Stitt
5f215facab fix typo 2023-07-11 13:18:19 -07:00
Bryan Stitt
8746cc1ae6 catch the new error format for returndata limit 2023-07-10 23:38:23 -07:00
Bryan Stitt
0f7e370c92 drop flume. just use tokio
i dont know if this is the problem, but this will also get compile times down
2023-07-10 23:08:06 -07:00
Bryan Stitt
3059d08674 error on max_head_block_age and keep the sender alive longer 2023-07-10 22:17:15 -07:00
Bryan Stitt
1af023d689 no iouring for now 2023-07-10 21:17:48 -07:00
Bryan Stitt
04825be99d error if health checks are failing 2023-07-10 20:59:17 -07:00
Bryan Stitt
fe39ad1e1e Revert "Revert "fixes for disconnect and config reloads""
This reverts commit 3cfbc3cbf124caf9154ffe6a444082cb0c3e20a1.
2023-07-10 20:59:03 -07:00
Bryan Stitt
3cfbc3cbf1 Revert "fixes for disconnect and config reloads"
This reverts commit 50fed0b0e79778d17bb40df96a11e44341dde0d1.
2023-07-10 20:30:10 -07:00
Bryan Stitt
50fed0b0e7 fixes for disconnect and config reloads 2023-07-10 19:41:14 -07:00
Bryan Stitt
2dfc5dcdf3 set http keep alive to a longer time 2023-07-10 18:37:25 -07:00
Bryan Stitt
31f772591b put rpcs in a rwlock again 2023-07-10 18:09:58 -07:00
Bryan Stitt
670b64de31 9th try? 2023-07-10 16:40:41 -07:00
Bryan Stitt
ad8763b5d1 add them 2023-07-10 16:39:43 -07:00
Bryan Stitt
dbe7db69e0 more pwd 2023-07-10 16:38:16 -07:00
Bryan Stitt
75fb5927ef hmmm 2023-07-10 16:37:28 -07:00
Bryan Stitt
5e6da3e456 wat 2 2023-07-10 16:35:31 -07:00
Bryan Stitt
4a88aa295c wat 2023-07-10 16:34:11 -07:00
Bryan Stitt
8503c49c04 touch payment-contracts
stupid caches. this shouldnt be needed
2023-07-10 16:32:58 -07:00
Bryan Stitt
98bda65735 inner instead of left 2023-07-10 16:25:01 -07:00
Bryan Stitt
0181347b42 one less clone 2023-07-10 15:41:55 -07:00
Bryan Stitt
e80d1bd23a add more to Web3Rpcs debug 2023-07-10 15:31:10 -07:00
Bryan Stitt
a7f1c043c5 sync before Serialize 2023-07-10 15:26:00 -07:00
Bryan Stitt
c00eebeb32 admin_ should be unimplemented cost 2023-07-10 15:13:49 -07:00
Bryan Stitt
cceee646ad cargo upgrade 2023-07-10 14:05:03 -07:00
Bryan Stitt
a7119f6b5b
split balance queries up (#177)
* wip

* tests pass, referee_bonus changed to one_time_referee_bonus

---------

Co-authored-by: yenicelik <david.yenicelik@gmail.com>
2023-07-10 14:03:05 -07:00
Bryan Stitt
9ef08c80e1 remove parking_lot 2023-07-10 11:05:07 -07:00
Bryan Stitt
2ea53cc396 could not get block from params should be error level 2023-07-09 22:52:29 -07:00
Bryan Stitt
9ee6b18172 no more lock update needed
all these things are idempodent now
2023-07-09 22:51:01 -07:00
Bryan Stitt
af4ca0f450 distinguish some errors 2023-07-09 22:49:29 -07:00
Bryan Stitt
5f88146ac5 add certs to all the proxies 2023-07-09 21:57:39 -07:00
Bryan Stitt
a43fda0c32
Bryan devel (#176)
* refactor more balance logic

* refactor more balance checks

* doc running full test suite
2023-07-09 21:37:50 -07:00
Bryan Stitt
0ddd3662ac
David/new balance logic mk3 (#175)
* WIP will work on locks

* added concurrent test for referral, numbers rn still add up

* will change balance table to be a view instead of a table

* merged in devel. will proceed with migrations for rpc_stats_v2 and referral

* WIP

* WIP

* WIP compiling

* gotta add the balance_v2 view

* about to add balance view

* stupid missing closing param

* compiles again, now i will just have to implement the raw sql

* need to paste the real query and play with it

* ok now on to testing

* addresses many comments in PR

* app works for simple unauthorized access. will look into tests

* some tests pass, referral logic tests fail

* not sure why the test is failing

* invalidate cache for admin, will check for more possible targets

* user balance decrease test works

* all tests pass

* changed to active model

---------

Co-authored-by: yenicelik <david.yenicelik@gmail.com>
2023-07-09 20:15:32 -07:00
Bryan Stitt
a560d47c48 lint 2023-07-09 20:13:03 -07:00
David
000a1326c3
New Balance Logic (#174)
* WIP will work on locks

* added concurrent test for referral, numbers rn still add up

* will change balance table to be a view instead of a table

* merged in devel. will proceed with migrations for rpc_stats_v2 and referral

* WIP

* WIP

* WIP compiling

* gotta add the balance_v2 view

* about to add balance view

* stupid missing closing param

* compiles again, now i will just have to implement the raw sql

* need to paste the real query and play with it

* ok now on to testing

* addresses many comments in PR

* app works for simple unauthorized access. will look into tests

* some tests pass, referral logic tests fail

* not sure why the test is failing

* invalidate cache for admin, will check for more possible targets

* user balance decrease test works

* all tests pass
2023-07-09 19:43:44 -07:00
Bryan Stitt
b527f5d0d6
David/remove balance logic non destructive (#173)
* WIP will work on locks

* added concurrent test for referral, numbers rn still add up

* will change balance table to be a view instead of a table

* merged in devel. will proceed with migrations for rpc_stats_v2 and referral

* WIP

* WIP

* WIP compiling

* gotta add the balance_v2 view

* about to add balance view

* stupid missing closing param

* compiles again, now i will just have to implement the raw sql

* need to paste the real query and play with it

* ok now on to testing

* addresses many comments in PR

* app works for simple unauthorized access. will look into tests

* some tests pass, referral logic tests fail

* not sure why the test is failing

---------

Co-authored-by: yenicelik <david.yenicelik@gmail.com>
2023-07-09 19:23:32 -07:00
Bryan Stitt
386363e295 add request id to tracing 2023-07-08 11:57:53 -07:00
Bryan Stitt
9e89304eb7 try_send instead of send 2023-07-07 21:58:00 -07:00
Bryan Stitt
62407ee834 more trace logging cleanup 2023-07-07 16:24:45 -07:00
Bryan Stitt
1b7cc2bffe clean trace logging 2023-07-07 16:22:49 -07:00
Bryan Stitt
78c6179f02 clean up rate limit logging 2023-07-07 15:56:46 -07:00
Bryan Stitt
b476a56ad6 check for U64 instead of just BlockNumber
i thouht block number would be smart enough to deserialize, but it seems like not
2023-07-07 15:28:24 -07:00
Bryan Stitt
71aab0dedc cargo upgrade 2023-07-07 15:16:14 -07:00
Bryan Stitt
b234265458
Premium tier changes (#170)
* lower premium concurrency in preparation for key+IP limits

* include the ip in the user semaphore

* 3, not 5

this is our current limit for free

* per user_id+ip rate limiting
2023-07-07 15:15:41 -07:00
Bryan Stitt
651244fbca lower log levels 2023-07-07 14:14:03 -07:00
Bryan Stitt
57f640765a remove a level of retries 2023-07-07 14:06:44 -07:00
Bryan Stitt
512bcf305b lint 2023-07-07 14:06:35 -07:00
Bryan Stitt
6176a91fc1 whitespace 2023-07-07 12:36:26 -07:00
Bryan Stitt
e15235e2a3 add CU cost for trace_callMany
arbitrary cost. we should do some actual calculations
2023-07-07 12:34:12 -07:00