* upgrade and start adding deduped_broadcast
* basic test
* accept arg for cache ttl
* first pass at bringing the tx firehose back
* try_send instead of send since there aren't always receivers
* deduped broadcaster needs the try send
* track counts and include in /status
* use config for enable subscribe_txs
* add test_multiple_proxies_stats_add_up
* make a premium user using both proxies
* added a couple clones, must add constraints now to run for multiple-proxies (check arithmetic)
* lint and code review
* fix comment
* fix tests (now fails at todo)
* will introduce endpoint to fetch rpc stats from mysql
* added influxdb to tests, should next do asserst in stats collected by influx, and mysql for multi-proxy
* created test where influx and mysql have separate data, should help with debugging
* forgot to drop influx
* tests pass except multi-proxy
* test passes, will check out nothing broke elswhere
* go back to numbers
* some linting
* linting
* removed redundant info!
* responding to PR comments
* ULID as instance-hash for the tag in influx (for anti-dup)
---------
Co-authored-by: yenicelik <david.yenicelik@gmail.com>
* dont migrate on start. just connect
* it compiles
* that log is loud
* get transaction from a local clone
* import the trait
* put the test app into a thread instead of tokio::spawn
* fix one test
* try db before rpcs
* db connection is too slow. need to wait for it
* do db setup once while spawning
* fix popularity contest
* more info in the Debug for Web3Rpc
* add frontend_requests and cache_misses to the Balance query
* add more to balance and stats flushing and improved test coverage
* it compiles
* deserializer for Ulid to Uuid
I think a wrapper type on Ulid that implements sea_orm::Value is probably better
* rename variable to match struct name
* add deserializer for Address -> Vec<u8>
* sql sum returns a Decimal. need to convert to u64
* assert more
* one log and assert more
* log more
* use a helper to get the user's rpc provider
* this should be 2 now that we have a public and authed call
* this should be zero. the public has the cache miss
* instrument cu calcs
* trace the value we took, not the default that replaced it
* move usd_per_chain into config
* remove some extra logging
* use Arc::into_inner to maybe avoid a race
* off by 1
* pass paid credits used instead of returning it
this lets us use it to write to our user balance cache first. importantly, this keeps us from holding a write lock while writing to mysql
* no cache misses expected in this test
* actually check the admin
* put the balance checks back now that the rest of the test works
* archive request is being set incorrectly
* wow howd we manage flipping the greater than sign on archive depth
* move latest_balance and premium_credits_used to before any stats are emitted
* lint
* and build undoes the linting. fun
i didnt even want to lint them in the first place, so this is fine
* missed incrementing total_spent when not incrementing total_spent_paid_credits
* use the credits on self
* use the credits on self (pt 2)
* fix type for 10 cu query
* convert the requestmetadata on the other side of the channel
* logs
* viewing stats is allowed even without a balance
* move paid_credits_used to AuthorizationChecks
* wip
* test_sum_credits_used finally passes
* UserBalanceCache::get_or_insert
* re-enable rpc_secret_key_cache
* move invalidate to a helper function
and always call it **after** the db is commited
* fix PartialEq and Eq on RpcSecretKey
* cargo upgrade
* WIP will work on locks
* added concurrent test for referral, numbers rn still add up
* will change balance table to be a view instead of a table
* merged in devel. will proceed with migrations for rpc_stats_v2 and referral
* WIP
* WIP
* WIP compiling
* gotta add the balance_v2 view
* about to add balance view
* stupid missing closing param
* compiles again, now i will just have to implement the raw sql
* need to paste the real query and play with it
* ok now on to testing
* addresses many comments in PR
* app works for simple unauthorized access. will look into tests
* some tests pass, referral logic tests fail
* not sure why the test is failing
---------
Co-authored-by: yenicelik <david.yenicelik@gmail.com>
* quick cache and allocate less
* improve /status cache
* prepare to cache raw transaction hashes so we dont dos our backends
* simple benchmark for /health and /status
* mut not needed with atomics
* DRY all the status pages
* use u64 instead of bytes for subscriptions
* fix setting earliest_retry_at and improve logs
* Revert "use kanal instead of flume or tokio channels (#68)"
This reverts commit 510612d343fc51338a8a4282dcc229b50097835b.
* fix automatic retries
* put relaxed back
* convert error message time to seconds
* assert instead of debug_assert while we debug
* ns instead of seconds
* disable peak_latency for now
* null is the default
* cargo fmt
* comments
* remove request caching for now
* log on exit
* unit weigher for now
* make cache smaller. we need a weigher for prod. just debugging
* oops. we need async
* add todo
* no need for to_string on a RawValue
* will implement balance topup endpoint
* will quickly fix other PR reviews
* merging from master
* will finish up godmoe
* will finish up login
* added logic to top up balance (first iteration)
* should implement additional columns soon (currency, amount, tx-hash), as well as a new table for spend
* updated migrations, will account for spend next
* get back to this later
* will merge PR from stats-v2
* stats v2
rebased all my commits and squashed them down to one
* cargo upgrade
* added migrtation for spend in accounting table. will run test-deposit next
* trying to get request from polygon
* first iteration /user/balance/:tx_hash works, needs to add accepted tokens next
* creating the referral code seems to work
* will now check if spending enough credits will lead to both parties receiving credits
* rpcstats takes care of accounting for spend data
* removed track spend from table
* Revert "removed track spend from table"
This reverts commit a50802d6ae75f786864c5ec42d0ceb2cb27124ed.
* Revert "rpcstats takes care of accounting for spend data"
This reverts commit 1cec728bf241e4cfd24351134637ed81c1a5a10b.
* removed rpc request table entity
* updated referral code to use ulid s
* credits used are aggregated
* added a bunch of fields to referrer
* added database logic whenever an aggregate stats is added. will have to iterate over this a couple times i think. go to (1) detecting accepted stables next, (2) fix influxdb bug and (3) start to write test
* removed track spend as this will occur in the database
* will first work on "balance", then referral. these should really be treated as two separate PRs (although already convoluted)
* balance logic initial commit
* breaking WIP, changing the RPC call logic functions
* will start testing next
* got rid of warnings & lint
* will proceed with subtracting / adding to balance
* added decimal points, balance tracking seems to work
* will beautify code a bit
* removed deprecated dependency, and added topic + deposit contract to app.yaml
* brownie test suite does not rely on local contract files it pulls all from polygonscan
* will continue with referral
* should perhaps (in a future revision) recordhow much the referees got for free. marking referrals seems to work rn
* user is upgraded to premium if they deposit more than 10$. we dont accept more than $10M in a single tx
* will start PR, referral seems to be fine so far, perhaps up to some numbers that still may need tweaking
* will start PR
* removed rogue comments, cleaned up payments a bit
* changes before PR
* apply stats
* added unique constraint
* some refactoring such that the user file is not too bloated
* compiling
* progress with subusers, creating a table entry seems to work
* good response type is there as well now, will work on getters from primary user and secondary user next
* subuser logic also seems fine now
* downgrade logic
* fixed bug influxdb does not support different types in same query (which makes sense)
* WIP temporary commit
* merging with PR
* Delete daemon.rs
there are multiple daemons now, so this was moved to `proxyd`
* will remove request clone to &mut
* multiple request handles for payment
* making requests still seem fine
* removed redundant commented out bits
* added deposit endpoint, added deposit amount and deposit user, untested yet
* small bug with downgrade tier id
* will add authorization so balance can be received for users
* balance history should be set now too
* will check balance over time again
* subususer can see rpc key balance if admin or owner
* stats also seems to work fine now with historical balance
* things seem to be building and working
* removed clone from OpenRequestHandle
* removed influxdb from workspace members
* changed config files
* reran sea-orm generate entities, added a foreign key, should be proper now
* removed contract from commit
* made deposit contract optional
* added topic in polygon dev
* changed deposit contract to deposit factory contract
* added selfrelation on user_tier
* added payment required
* changed chain id to u64
* add wss in polygon llamarpc
* removed origin and method from the table
* added onchain transactions naming (and forgot to add a migration before)
* changed foreign key to be the referrer (id), not the code itself
* forgot to add id as the target foreign key
* WIP adding cache to update role
* fixed merge conflicts
---------
Co-authored-by: Bryan Stitt <bryan@llamanodes.com>
Co-authored-by: Bryan Stitt <bryan@stitthappens.com>
