7f4da8d43c
lint
2023-06-21 10:40:55 -07:00
d962b749a2
use find_with_related, not find_also_related
...
find_also_related is 1:1, but we want 1:Many
2023-06-21 10:37:01 -07:00
1cbb58e8e0
comment
2023-06-21 10:25:10 -07:00
06ce95c386
let serde_json do more of the work
2023-06-21 10:18:36 -07:00
5504062f47
dont error if no referrals
2023-06-21 10:18:06 -07:00
8f1b6fe6c0
lint
2023-06-21 10:02:02 -07:00
4dad743fc3
tuple, not list
2023-06-21 10:01:51 -07:00
f75f3f8d2f
serialize caches in a list
2023-06-21 10:00:05 -07:00
3c2f95de10
Improve max wait and timeouts ( #137 )
...
* pass max wait with more functions
* move rpc_head_str higher up to use it in all the logs
* refresh consensus at double the block time
* new pricing that also includes archive check
* lint
* don't clone method
* put caches into one list
they serialize with their name, so it will still be easy to tell them apart
* more consistent waiting. still waits more than I want right now
* clean up default max waits
* more timeouts
2023-06-20 14:22:14 -07:00
78efad5453
cargo upgrade strum
2023-06-19 17:48:46 -07:00
6d25c41faf
Compute units ( #136 )
...
* wip
* add basic compute unit calculator
* calculate costs with compute units
2023-06-19 17:47:38 -07:00
b7935f77fc
spawn recording latency
2023-06-19 17:46:58 -07:00
6038351cb8
change default tracking in prep for premium-only keys
2023-06-19 13:00:57 -07:00
b35cd58a76
rate limit user_balance_post by bearer OR ip
2023-06-19 10:21:48 -07:00
c3ae4ded2b
move data to the right places
2023-06-18 21:42:16 -07:00
58cc129837
forgot to convert tier_sec_size from ms. 1 was a very large default
2023-06-18 17:57:21 -07:00
ba410cf126
better log message
2023-06-18 16:41:01 -07:00
89009dcd42
use web3_context for more errors
2023-06-18 16:40:17 -07:00
af8543c3bf
some defaults are needed maybe?
2023-06-18 16:36:23 -07:00
2f78e64c5d
create empty balance entry if none exists
2023-06-18 16:25:25 -07:00
6deeabe1e1
pretty print errors
2023-06-18 16:14:06 -07:00
9dd0bae40a
text instead of string payload
2023-06-18 16:13:55 -07:00
825ba006f1
move floats and durations around for latency tracking
2023-06-18 10:46:22 -07:00
2f0e6103ac
Revert "tier more important than backup"
...
This reverts commit bca22537c6
2023-06-18 10:09:21 -07:00
bca22537c6
tier more important than backup
...
we filter backups when they aren't needed, so this should be okay
2023-06-18 10:06:26 -07:00
e54299beca
rolling median for choosing tier
2023-06-18 09:53:36 -07:00
8b22c9861b
Revert "temp fix while filtering is improved"
...
This reverts commit 5367c51195
2023-06-17 12:15:40 -07:00
5367c51195
temp fix while filtering is improved
2023-06-17 12:09:04 -07:00
3b65074f38
cleaner duration multiplication
2023-06-17 11:33:33 -07:00
eab86c7ee8
automatic max_head_block_age
2023-06-17 10:13:40 -07:00
bf13e86a04
warn if no max_head_block_age
2023-06-17 09:19:05 -07:00
3b9314a76f
comments
2023-06-17 08:44:18 -07:00
9b9e5341cb
lint
2023-06-17 08:44:07 -07:00
6bfa5a69ca
latest_balance is part of AuthorizationChecks now
2023-06-17 08:43:51 -07:00
8ffd7d2e1b
enable more advanced cost calculation
2023-06-16 23:55:41 -07:00
ba67151706
lint
2023-06-16 23:48:16 -07:00
745870d119
drop a bunch of log levels
2023-06-16 23:46:20 -07:00
74d2333039
try this version of influxdb2
2023-06-16 23:41:12 -07:00
d6513cde74
Forgot to handle Option unwrap ( #132 )
...
* made the query much faster
* aggregate queries should be fast now too
* forgot to handle an option unwrap
2023-06-16 23:18:51 -07:00
86f9e7358a
move balance onto AuthorizationChecks ( #131 )
...
* move balance onto AuthorizationChecks
* todone
* bigger default
* flat cost for testing
2023-06-16 23:14:43 -07:00
5d9365449f
simplify max item weight by having the weigher send MAX for big things
2023-06-16 16:14:11 -07:00
1ec0f14144
upgrade to influxdb 1e5577e14150797584f5ed0ea7aba0bd68f0a678
2023-06-16 14:48:03 -07:00
cb71de7d14
pin influxdb2 to 6d3cf64d61967f41fafb57b3f4553206a8f3f2a3
2023-06-16 13:30:35 -07:00
d9a865fd1b
cargo upgrade
2023-06-16 10:58:09 -07:00
3928496be5
start tiers at 1
2023-06-16 10:52:13 -07:00
af7759e491
by_name needs a lock to prevent races during disconnects
2023-06-16 10:40:02 -07:00
7c876ac561
delete stale code
...
this was rewritten and put into its own crate
2023-06-16 10:02:14 -07:00
7707729f77
Merge remote-tracking branch 'origin/main' into devel
2023-06-16 10:01:17 -07:00
4772166e97
Make aggregate queries faster as well ( #130 )
...
* made the query much faster
* aggregate queries should be fast now too
2023-06-16 08:27:46 -07:00
fe8675ddf2
cargo upgrade
2023-06-16 00:48:22 -07:00
a083bc652d
Handle uncle transactions ( #129 )
...
* add more columns to handle uncled transactions
* handle payment uncles
* put relations back
* include all the new columns
* lower log levels
* improve block caching
if we have a block with a number, its canonical. uncles don't get returned
* improve disconnect logic
* lint
* clear first changed for new_top_config_receiver
* better logs around config changing
* i guess we do want one apply top_config at the start
* check correct variable for data limits
2023-06-16 00:46:27 -07:00
6040ca297f
fix eth_unsubscribe
2023-06-15 11:43:24 -07:00
49c60ac1b5
improve websocket error handling
2023-06-15 09:50:21 -07:00
5859cd8a8d
made the query much faster ( #127 )
2023-06-15 09:38:51 -07:00
957ba161b5
move table data around
2023-06-13 12:08:47 -07:00
b8f429d70a
improvements to popularity_contesst
2023-06-13 11:51:19 -07:00
f5a1ac274a
refactor send_head_block_result
2023-06-13 10:00:08 -07:00
1473ccb085
gentler parsing of new head blocks
2023-06-13 09:31:22 -07:00
602b0117c4
panic if influxdb_bucket is not set when influxdb_host is set
2023-06-13 09:30:41 -07:00
45543be256
add more caches to /status
2023-06-12 23:03:38 -07:00
a7fb12bd72
less random is fine for shuffling
2023-06-12 22:42:22 -07:00
55e8471b19
interval instead of watch_blocks
2023-06-12 22:26:10 -07:00
6324d9c7d9
short circuit if no requests
2023-06-12 21:54:33 -07:00
18835e09da
allow empty batches
2023-06-12 21:51:08 -07:00
c192e03fa2
count all the tiers at once
2023-06-12 21:03:38 -07:00
bba7ccf7eb
change divisor for tier calculation
2023-06-12 20:44:52 -07:00
c771479d94
use WyRand instead of Xoshiro
2023-06-12 19:46:36 -07:00
1a8f799969
we need our own Reconnect ( #124 )
...
* first pass at handling different return data limits
* put ws_provider in an arcswap
* add min max_latency
* add min max_latency
* subscribe with reconnect
* better logging around reconnect
* select on both watches
* subscribe to the correct watch
2023-06-12 18:58:51 -07:00
62bda636b8
return the response instead of panicing
2023-06-12 16:38:57 -07:00
c456432cc3
cargo upgrade
2023-06-12 11:44:51 -07:00
c3a7d1646c
lint
2023-06-12 11:41:10 -07:00
70d5c09d3e
clean up redirect url
2023-06-12 11:38:34 -07:00
f1176685dd
pause time on more tests
2023-06-12 11:08:33 -07:00
093ca19454
added subuser RPC keys into key access control, as well as fetching RPC keys ( #115 )
2023-06-12 08:59:23 -07:00
0cc4557e8d
Use rpc id instead of key ( #118 )
...
* added logic to check e-mails thru SMPT server, very basic, no validation e-mails etc.
* Revert "added logic to check e-mails thru SMPT server, very basic, no validation e-mails etc."
This reverts commit 022a13cfd9ca24aad9e05f75489396936f14784a.
* mixed up branches
2023-06-11 19:14:02 -07:00
81aa4788b4
David/60 add basic email verification ( #119 )
...
* added logic to check e-mails thru SMPT server, very basic, no validation e-mails etc.
* added rpc key logic to use db numbers instead of UUIDs
* Revert "added rpc key logic to use db numbers instead of UUIDs"
This reverts commit 056771d02725f90ed5f1745b0372e13e630a19ac.
2023-06-11 19:10:10 -07:00
0b26ae3bad
made modify-subuser post
2023-06-11 18:59:27 +02:00
2333b8bbb6
influx query is not 20-40% faster
2023-06-11 17:57:02 +02:00
4a9c1a0ce6
move user registration into a dedicated function
2023-06-09 18:31:47 -07:00
71d3d63524
put ip rate limiting back
2023-06-09 16:35:44 -07:00
41950c886c
improvements for web3-this-then-that
2023-06-09 16:35:14 -07:00
bcf4f33543
add payment_factory_address to /status
2023-06-09 14:02:29 -07:00
bb900c61a5
todo
2023-06-09 13:31:46 -07:00
8bf0ee473d
loud log on rollback
2023-06-09 13:30:00 -07:00
bd87fcb13c
move sort and shuffle for loadbalancing into proper functions
2023-06-09 13:09:58 -07:00
1f3040f6c7
automated tiers
2023-06-09 12:21:55 -07:00
b6ff14210d
cargo upgrade
2023-06-08 22:35:14 -07:00
d91713e09e
this brings back balance back to the stats request ( #112 )
...
* removed bloom filter temporarily, added some fixes with decimals in payment.rs
* balance is inside the influx query again
* fixed aggregate
2023-06-08 15:57:53 -07:00
68f73ec0b1
more things should be BadRequest instead of 500
2023-06-08 13:42:45 -07:00
50ec653557
lower log level
2023-06-08 11:46:38 -07:00
74280bc329
lint
2023-06-08 11:33:16 -07:00
334b1c21b3
improve logs
2023-06-08 11:30:48 -07:00
1d05bc5e89
lower log levels
2023-06-08 11:26:09 -07:00
3f76b08364
Test balance and referral accounting ( #111 )
...
* removed bloom filter temporarily, added some fixes with decimals in payment.rs
* balance accounting for a single user (paid and free tier) seems to be ok
* fixed some balance accounting
* compute_cost reduced back to 0
2023-06-08 10:08:29 -07:00
c37b320286
add cache names and actually serialize
2023-06-07 17:55:34 -07:00
5744b459ee
lint
2023-06-07 17:43:10 -07:00
6cf738261b
fix test
2023-06-07 17:42:34 -07:00
bfaff81626
cargo upgrade
2023-06-07 17:31:29 -07:00
5c1569f9c2
clippy lint
2023-06-07 17:31:15 -07:00
40bee30730
back to moka
2023-06-07 17:30:05 -07:00
de7d8919d3
Change balance to record total spend and total deposits ( #109 )
...
* lets test total deposit and total spent
* removed referrer from cache for performance reasons
2023-06-07 14:45:57 -07:00
4f7144abc6
Arc instead of Box for better caching
2023-06-07 13:57:38 -07:00
c2a3a4a0a9
Merge remote-tracking branch 'origin/main' into devel
2023-06-07 13:29:12 -07:00
91d288315f
add queue lengths to status page
2023-06-07 13:05:15 -07:00
b50579ea3a
add block caches to web3rpcs serializer
2023-06-07 12:04:39 -07:00
8249b0aefe
cache isnt on main yet
2023-06-07 11:18:36 -07:00
aa57dd2fcf
serialize the caches on /status
2023-06-07 10:58:30 -07:00
f0a9f03076
smaller caches
2023-06-07 10:57:43 -07:00
c4b2ce5266
smaller caches
2023-06-07 10:57:01 -07:00
fb97ef5180
cargo clippy lints
2023-06-07 10:55:07 -07:00
f6b2b0deab
cargo upgrade
2023-06-07 10:50:34 -07:00
2b814e7a4d
serialize the caches on /status
2023-06-07 10:48:55 -07:00
63499c1564
David/66 downgrade balance logic ( #89 )
...
* tried to make the balance_entry atomic, asking for feedback
* added locked select everywhere and inside the txn, it should be atomic now
* forgot about overwrite (referee vs sender entities were the same, overwriting each other), fixed it
* will now trigger refreshing cache when balance thresholds are met
* will also invalidate cache if balance gets too low (to out of funds)
* added separate balance cache with shorter TTL. need to know if i should modify it (rn its not atomic), or if low TTL is good enough, and we just fetch the value every now and then from the Database
* removed UserTier struct bcs duplicate with database
* removed subuser premium requirement (which would have lead to a merge conflict later on)
* removed user_tier artefact
* replaced cache to use AtomicF64
* a bunch of small changes
* some changes
* will merge with devel
* changed AtomicF64 to RwLock<Decimal>
* changed AtomicF64 to RwLock<Decimal>
* downgrading user when at 0.1$ or if sum_credits_used is very low
* changed caches to be more aggressive in being non-empty
* replaced Arc::clone() by reference
2023-06-07 09:39:30 -07:00
fd69e6acdd
added stats page for referrals (shared, and received) ( #95 )
...
* added stats page for referrals (shared, and received)
* removed referrals address, and return ok response if no referrals used
* merged from devel
* changed unwrap for context
* changes from PR
2023-06-07 09:38:19 -07:00
172baabb4e
even more fields onto popularity contest
2023-06-05 16:40:49 -07:00
640bcd1378
update popularity_contest script to match new status page
2023-06-05 16:40:49 -07:00
f66edd961b
Making Balance Changes Atomic (Read and Write) ( #84 )
...
* tried to make the balance_entry atomic, asking for feedback
* added locked select everywhere and inside the txn, it should be atomic now
* forgot about overwrite (referee vs sender entities were the same, overwriting each other), fixed it
* will now trigger refreshing cache when balance thresholds are met
* Revert "will now trigger refreshing cache when balance thresholds are met"
This reverts commit b1215ddc43a1358f6086bddbd106996165431165.
* will not modify userTier in database anymore
* made payment atomic
* made updates mostly atomic, locking only the referral table (bcs more complex logic)
* latest changes
2023-06-04 09:32:53 -07:00
79e52f4cdb
Merge remote-tracking branch 'origin/main' into devel
2023-05-31 17:12:59 -07:00
633bf1f53b
need a decimal 0
2023-05-31 17:12:32 -07:00
cb580d4ea8
Merge remote-tracking branch 'origin/main' into devel
2023-05-31 17:02:34 -07:00
1a26260351
if no credits used, return early
2023-05-31 17:02:24 -07:00
8709737d74
lower log level
2023-05-31 16:07:13 -07:00
fbe0ecfbff
rate limit on websockets
2023-05-31 16:05:44 -07:00
cadab50692
lint
2023-05-31 15:54:32 -07:00
56ec9439c3
insert on conflict update for balance table
2023-05-31 14:07:25 -07:00
88526c3702
Missing subuser logic ( #96 )
...
* will push it for feedback loop
* filtering also to only show rpc keys that the user is an owner of
* revert logs also returning rpc keys
* merged with devel
2023-05-31 13:46:59 -07:00
62997774b1
use abigen types for decoding the logs
2023-05-31 12:44:02 -07:00
7dcc2b4d93
use MultiAbigen
2023-05-31 11:52:57 -07:00
7947cb95ff
use bloom filters and support transactions with multiple deposit events
2023-05-31 11:20:17 -07:00
b9f0824dfe
start using the internal provider
2023-05-30 23:52:12 -07:00
d64761403b
Cow instead of String
2023-05-30 23:17:05 -07:00
f1636d3b85
unlimited localhost
2023-05-30 22:31:35 -07:00
fcc1843af0
put it back. duplication between cargo.toml isnt worth it
2023-05-30 21:37:58 -07:00
fd8bba4bdd
most of these are for the whole app, not just the frontend
2023-05-30 21:26:11 -07:00
0b62ffcdfc
no need to move the semaphore around like this
2023-05-30 21:08:21 -07:00
2273637a07
move cli into a separate packge and clean up dependencies
2023-05-30 20:58:24 -07:00
cebe8ed1ea
Request refactor ( #99 )
...
* wip
* AsRef finally works like i wanted
* actually return the block
* start adding async trait
* remove stale import
* include id in the error response when possible
* remove stale comments
2023-05-30 16:32:34 -07:00
4246342806
lower log levels
2023-05-29 17:26:32 -07:00
c1eba556a5
fix missing ttl send and add name to cache
2023-05-29 17:19:05 -07:00
bb50efb7f9
quick cache ttl max item size, better function names, and tests ( #97 )
...
* Revert "remove cache on /status and /health for now"
This reverts commit 166b0d810c4597967def
2023-05-29 15:48:22 -07:00
5f0c99530c
referral code does not have llamanodes- prefix any longer ( #90 )
2023-05-29 14:41:15 -07:00
9e935e2c44
cargo upgrade
2023-05-29 09:43:51 -07:00
b05d866f8a
Merge remote-tracking branch 'origin/main' into devel
2023-05-29 09:42:21 -07:00
a275e2dee4
add blocktime for binance
2023-05-29 09:41:19 -07:00
dc6e0559f7
improve will_work_eventually
2023-05-29 09:41:19 -07:00
84990bb7b6
check hard_limit_until when finding if an rpc will work
2023-05-29 09:41:19 -07:00
08859ba04d
wait for consensus rpcs to change before trying again
2023-05-29 09:41:19 -07:00
48905f0235
David/76 bring back docs ( #91 )
...
* bring back docs
* added some more rudimentary documentation
2023-05-29 09:24:41 -07:00
ccb3a559ad
removed requirement for subuser logic to be admin ( #94 )
2023-05-29 08:35:24 -07:00
4597967def
remove cache on backups needed, too
2023-05-28 09:39:24 -07:00
166b0d810c
remove cache on /status and /health for now
2023-05-28 09:38:51 -07:00
7cb07cc49f
debug -> trace for some verbose logs
2023-05-27 01:53:49 -07:00
0e7bd1fbf3
add missing anyhow::Context
2023-05-26 17:00:39 -07:00
4aa34740a8
default balance to 0
2023-05-26 16:54:52 -07:00
9a5e9d46a9
Merge branch 'devel' into david/devel/debug-graph
2023-05-24 13:36:45 +02:00
b6cab88c4e
removed joined_on variable that was not used
2023-05-24 13:35:10 +02:00
47f07261ed
detailed request must come with a bearer token
2023-05-24 13:34:50 +02:00
0d15d5baf7
bump versions to match number of migrations
2023-05-23 20:58:29 -07:00
b1a0bcac57
add max wait to fix tests
2023-05-23 20:46:27 -07:00
dafb69fae1
move timeout deeper
2023-05-23 15:50:29 -07:00
55f9c57827
include error in warning
2023-05-23 15:03:16 -07:00
4c7a7b87cb
cargo upgrade
2023-05-23 14:58:13 -07:00
dd347fd916
add units to serialized variables
2023-05-23 14:57:24 -07:00
77c9b0ab12
peak latency instead of head latency
2023-05-23 14:52:45 -07:00
651f0fcad3
lint
2023-05-23 14:51:34 -07:00
d83e2f7015
Merge remote-tracking branch 'origin/devel' into devel
2023-05-23 14:44:40 -07:00
78f247fc6c
split http and ws provider
2023-05-23 14:40:34 -07:00
27333a0028
David/devel/debug graph ( #82 )
...
* now should also group by archive_needed (turns out this was wanted)
* influxdb query also groups by archive_needed now
* updated error_response
* updated error_response
2023-05-22 17:08:35 -07:00
ddfd1dbff1
Added admin balance increase, and also test ( #72 )
...
* added admin balance increase, and also test
* slightly hacky, but does do an update expression
* added note column to entities
* removed redundant printlns
* flattened items
* removed user tier logic from admin increase balance completely. admin will have to manually increase the user tier
2023-05-22 17:07:17 -07:00
05f862f3e4
cargo upgrade
2023-05-22 15:50:00 -07:00
3ac15558e3
fix decay time
2023-05-22 15:43:39 -07:00
91eeee23e2
use ether's reconnects instead of our own which need a lock (wip)
2023-05-22 15:32:27 -07:00
59634139c9
updated error_response
2023-05-21 20:27:52 -04:00
29678b025e
updated error_response
2023-05-21 20:27:46 -04:00
46afe8b1e4
influxdb query also groups by archive_needed now
2023-05-21 17:13:15 -04:00
795548580a
now should also group by archive_needed (turns out this was wanted)
2023-05-21 16:40:42 -04:00
c443f76623
refactor tiers again
2023-05-19 14:09:03 -07:00
5aae318620
logs and comments
2023-05-18 15:11:29 -07:00
9c584354d9
add to skip list earlier
2023-05-18 13:51:28 -07:00
a92c93706b
dont check heads while waiting
...
this isn't great. but should work better than what we have
2023-05-18 13:47:00 -07:00
8898ffe578
cargo upgrade
2023-05-18 13:36:35 -07:00
b61675e928
replace all moka with quick_cache_ttl
2023-05-18 13:34:22 -07:00
24439c5143
disable balance join for now
2023-05-18 00:43:33 -07:00
0f367d9035
more quick cache ttl
2023-05-18 00:04:30 -07:00
1c61390ad1
check if watch_consensus_rpcs.changed has failed
...
i dont think it ever will, but better safe than sorry
2023-05-16 23:42:42 -07:00
c818a8fcd7
default balance to zero instead of panicing
2023-05-16 23:40:32 -07:00
89961331af
refactor wait_for_block into should_wait_for_block
2023-05-16 22:29:36 -07:00
a07da30042
keep usable_rpcs_by_tier_and_head_number around longer
2023-05-16 18:32:33 -07:00
0f79d2e60d
more loud logs
2023-05-16 18:29:56 -07:00
58b7799cc5
for now, always return 0 for cost
2023-05-16 18:25:56 -07:00
a0d8218eb1
best block num has to check has_block_data
2023-05-16 18:18:56 -07:00
30ea532c70
display, not debug
2023-05-16 16:13:56 -07:00
5d64524aa6
add name to web3rpcs
2023-05-16 16:04:17 -07:00
efaaf1bb5f
send the correct content type
2023-05-16 15:27:18 -07:00
525f6d4a34
better variable names
2023-05-16 14:58:00 -07:00
40b15579ab
Merge remote-tracking branch 'origin/devel' into quick_cache_ttl
2023-05-16 14:47:43 -07:00
f4cebde53f
use ttl quick cache
2023-05-16 14:46:05 -07:00
978c385b3c
improve wait for block
2023-05-16 14:02:37 -07:00
c66eb6d864
head latency instead of peak latency for now
2023-05-16 12:18:59 -07:00
685c1d039a
cargo upgrade
2023-05-13 15:00:24 -07:00
Bryan Stitt
David
Bryan Stitt
yenicelik