add a short connect timeout separate from the overall request timeout.
also fix a bug when only 1 server was in the rpc list causing a very tight loop that made tokio sad
* cargo upgrade --incompatible and update
* first draft at suprisingly_large_refactor_to_get_ids_everywhere
* put app in a task_local
* ref cleanup
* use a OnceLock instead of a tokio local
* test more methods
* APP isn't set in all tests
* it compiles. tests fail. todos still open
* use the app only when necessary
* more tests. less panic
* less verbose debug impl
* short enum names
* move kafka and secrets to their own files
* main tests pass
* add debug chain block time
* helper for stats that ignores internal stats
* Update Jenkinsfile (#223)
* more tests
---------
Co-authored-by: Pewxz <124064710+pewxz@users.noreply.github.com>
* streaming responses compile, still small TODOs & cleanup
* refactor to allow short curcuits on uncacheable requests (#220)
* refactor to allow short curcuits on uncacheable requests
* handle error inside an Arc from moka
* arc instead of box
* lint
* more lint
* add bonus rate limits and keep all semaphores after rate limits (#221)
* add bonus rate limits and keep all semaphores after rate limits
* remove stale todos
* better function names
* cargo upgrade and update
* make some panics warn. more todo
* pass request_metadata through so streaming responses include their final size
* remove stale TODO
* remove more stale todos
* add file i missed
* make to_json_string work well enough
* check config for free_subscriptions
---------
Co-authored-by: Rory Neithinger <rory@llamanodes.com>
* upgrade and start adding deduped_broadcast
* basic test
* accept arg for cache ttl
* first pass at bringing the tx firehose back
* try_send instead of send since there aren't always receivers
* deduped broadcaster needs the try send
* track counts and include in /status
* use config for enable subscribe_txs
* fix popularity contest
* more info in the Debug for Web3Rpc
* add frontend_requests and cache_misses to the Balance query
* add more to balance and stats flushing and improved test coverage
* it compiles
* deserializer for Ulid to Uuid
I think a wrapper type on Ulid that implements sea_orm::Value is probably better
* rename variable to match struct name
* add deserializer for Address -> Vec<u8>
* sql sum returns a Decimal. need to convert to u64
* assert more
* one log and assert more
* log more
* use a helper to get the user's rpc provider
* this should be 2 now that we have a public and authed call
* this should be zero. the public has the cache miss
* instrument cu calcs
* trace the value we took, not the default that replaced it
* move usd_per_chain into config
* remove some extra logging
* use Arc::into_inner to maybe avoid a race
* off by 1
* pass paid credits used instead of returning it
this lets us use it to write to our user balance cache first. importantly, this keeps us from holding a write lock while writing to mysql
* no cache misses expected in this test
* actually check the admin
* put the balance checks back now that the rest of the test works
* archive request is being set incorrectly
* wow howd we manage flipping the greater than sign on archive depth
* move latest_balance and premium_credits_used to before any stats are emitted
* lint
* and build undoes the linting. fun
i didnt even want to lint them in the first place, so this is fine
* missed incrementing total_spent when not incrementing total_spent_paid_credits
* use the credits on self
* use the credits on self (pt 2)
* fix type for 10 cu query
* convert the requestmetadata on the other side of the channel
* logs
* viewing stats is allowed even without a balance
* move paid_credits_used to AuthorizationChecks
* wip
* test_sum_credits_used finally passes
* UserBalanceCache::get_or_insert
* re-enable rpc_secret_key_cache
* move invalidate to a helper function
and always call it **after** the db is commited
* fix PartialEq and Eq on RpcSecretKey
* cargo upgrade
* lower premium concurrency in preparation for key+IP limits
* include the ip in the user semaphore
* 3, not 5
this is our current limit for free
* per user_id+ip rate limiting