tornadocontrib/infra
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
89 Commits 2 Branches 0 Tags MIT 1.3 MiB
ce9f585d3e
Commit Graph

89 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
mergify[bot]
ce9f585d3e Merge pull request #3700 from ethereum-optimism/feat/proxyd-allow-backend-lim-disable 
proxyd: Allow disabling backend rate limiting
 2022-10-17 16:01:48 +00:00
mergify[bot]
019f800e90 Merge branch 'develop' into feat/proxyd-allow-backend-lim-disable 2022-10-17 15:53:44 +00:00
mergify[bot]
43f0e88f5b Merge pull request #3708 from ethereum-optimism/feat/pattern-origins 
proxyd: Support pattern matching in origin and user agent
 2022-10-17 15:18:22 +00:00
Matthew Slipper
fe8a89e61d proxyd: Support pattern matching in origin and user agent 
Adds support for pattern matchin in exempt origins. This should help with some of the issues Synthetix and others are seeing.
 2022-10-17 07:08:33 -06:00
Matthew Slipper
fd5e974bd5 fix tests 2022-10-15 09:59:11 -05:00
Zach Howard
24a3668bc8 adds log level conf to proxyd (#3704) 2022-10-14 13:56:27 -05:00
Matthew Slipper
8a624bb2ca proxyd: Allow disabling backend rate limiting 
The backend rate limiter is in place to protect upstreams like the sequencer. However, in many cases it isn't needed and it causes unnecessary requests to Redis. This PR allows this to be disabled, and disables this by default.
 2022-10-13 15:02:35 -05:00
Matthew Slipper
53a58bcdc8 Merge pull request #3698 from ethereum-optimism/changeset-release/master 
Version Packages
 2022-10-13 12:52:59 -05:00
github-actions[bot]
053ce4ddfd Version Packages 2022-10-13 15:32:03 +00:00
Matthew Slipper
82ab59b8c7 Merge pull request #3697 from ethereum-optimism/develop 
Develop -> Master
 2022-10-13 10:29:30 -05:00
Matthew Slipper
3f19d26ea8 Merge pull request #3681 from ethereum-optimism/10-09-proxyd_Integrate_custom_rate_limiter 
proxyd: Integrate custom rate limiter
 2022-10-12 15:34:14 -05:00
Matthew Slipper
7fd63c6c6c Merge pull request #3679 from ethereum-optimism/10-09-proxyd_Custom_rate_limiter_implementation 
proxyd: Custom rate limiter implementation
 2022-10-12 15:34:02 -05:00
Matthew Slipper
f737002baa proxyd: Integrate custom rate limiter 
Integrates the custom rate limiter in the previous PR into the rest of the application. Also takes the opportunity to clean up how we instantiate Redis clients so that we can share them among multiple different services.

There are some config changes in this PR. Specifically, you must specify a `base_rate` and `base_interval` in the rate limit config.
 2022-10-11 17:20:23 -05:00
Matthew Slipper
fa7425683a proxyd: Custom rate limiter implementation 
Our current proxyd deployment does not share rate limit state across multiple servers within a backend group. This means that rate limits on the public endpoint are artifically high.

This PR adds a Redis-based rate limiter to fix this problem. While our current rate limiting library (github.com/sethvargo/go-limiter) _does_ support Redis, the client library it uses is not type safe, is less performant, and would require us to update the other places we use Redis. To avoid these issues, I created a simple rate limiting interface with both Redis and memory backend.

Note that this PR only adds the new implementations - it does not integrate them with the rest of the codebase. I'll do that in a separate PR to make review easier.
 2022-10-11 17:20:23 -05:00
Chris Wessels
15a59bad99 fix(proxyd): Fix compliance with JSON-RPC 2.0 spec by adding optional RPCError.Data (#3683) 
* fix: add optional data field to RPCError struct

* fix: formatting lint

* feat(proxyd): add changeset
 2022-10-11 08:51:02 -06:00
Matthew Slipper
8476e1b194 Merge pull request #3604 from ethereum-optimism/develop 
Develop -> Master
 2022-09-28 19:37:57 -06:00
Matthew Slipper
7cadaca188 Merge pull request #3603 from ethereum-optimism/changeset-release/master 
Version Packages
 2022-09-28 19:37:23 -06:00
github-actions[bot]
09552fddea Version Packages 2022-09-29 01:37:00 +00:00
Matthew Slipper
3638b5575b Merge pull request #3602 from ethereum-optimism/develop 
Develop -> Master
 2022-09-28 19:34:57 -06:00
Matthew Slipper
537717610e proxyd: Add batch size metric and configurable max (#3545) 
* proxyd: Add batch size metric and configurable max

The max batch size will be overwritten if it is over `MaxBatchRPCCallsHardLimit`.

Builds on https://github.com/ethereum-optimism/optimism/pull/3544.

* changeset

* fix lint

* fix test
 2022-09-23 15:06:02 -06:00
Matthew Slipper
485258d3c2 proxyd: Add customizable whitelist error message (#3544) 
* proxyd: Add customizable whitelist error message

Alchemy is asking for this so that we can include their affiliate link.

* add missing test case

* fix error message

* goimports
 2022-09-23 14:21:12 -06:00
Matthew Slipper
795d1025bb Merge pull request #3540 from ethereum-optimism/develop 
Version Packages
 2022-09-23 15:49:28 +02:00
Matthew Slipper
7f2456f217 Merge pull request #3539 from ethereum-optimism/changeset-release/master 
Version Packages
 2022-09-23 15:47:59 +02:00
Matthew Slipper
11ffe341b2 Merge pull request #3510 from ethereum-optimism/develop 
ci: release step 3
 2022-09-20 17:27:49 +02:00
Matthew Slipper
9fb21b52b8 Merge pull request #3509 from ethereum-optimism/changeset-release/master 
Version Packages
 2022-09-20 17:24:31 +02:00
github-actions[bot]
70557fdafd Version Packages 2022-09-20 15:21:51 +00:00
Matthew Slipper
787ae9b9a5 Merge pull request #3508 from ethereum-optimism/develop 
ci: trigger releases
 2022-09-20 17:19:04 +02:00
Matthew Slipper
d228a55bd7 proxyd: Fix error message in tests (#3503) 
* proxyd: Fix error message in tests

The custom error message wasn't being carried over in batch responses.

* review fixes

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2022-09-19 16:44:08 +00:00
Matthew Slipper
3fb4debfe1 proxyd: Add logging for origin and remote IP (#3482) 
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Mark Tyneway <mark.tyneway@gmail.com>
 2022-09-16 17:28:56 +00:00
Matthew Slipper
487f61e2f2 Merge pull request #3481 from ethereum-optimism/develop 
Develop -> Master
 2022-09-15 10:55:56 +02:00
Matthew Slipper
859c950fd0 Merge pull request #3480 from ethereum-optimism/changeset-release/master 
Version Packages
 2022-09-15 10:55:22 +02:00
github-actions[bot]
320d6ebeea Version Packages 2022-09-15 08:51:21 +00:00
Matthew Slipper
c1ab3f356d Merge pull request #3479 from ethereum-optimism/develop 
Develop -> Master
 2022-09-15 10:49:26 +02:00
Matthew Slipper
ccf0934459 proxyd: Support per-RPC rate limits (#3471) 
* proxyd: Support per-RPC rate limits

* add log

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2022-09-15 08:46:11 +00:00
Mark Tyneway
d9b654b6c1 Merge pull request #3465 from ethereum-optimism/develop 
Trigger Releases
 2022-09-14 08:53:19 -07:00
Mark Tyneway
f6f4a32997 Merge pull request #3464 from ethereum-optimism/changeset-release/master 
Version Packages
 2022-09-14 08:52:37 -07:00
Mark Tyneway
3122ee718a Merge pull request #3427 from ethereum-optimism/develop 
Trigger Releases
 2022-09-12 05:13:11 -07:00
Mark Tyneway
eb267a1a74 Merge pull request #3426 from ethereum-optimism/changeset-release/master 
Version Packages
 2022-09-12 05:12:25 -07:00
Matthew Slipper
7e54f414f7 Merge pull request #3389 from ethereum-optimism/develop 
Develop -> Master
 2022-09-10 01:59:41 -06:00
Joshua Gutow
8e92c91e6d Last unwrapped errors 
These where missed in local lints but when a full lint was run these
popped up.
 2022-09-09 04:56:59 -07:00
protolambda
9a4626856a style(batch-submitter,bss-core,proxyd): Fix lint Go (#3328) 
* style(batch-submitter): fix lint

* style(bss-core): fix lint

* chore(proxyd): use io and os instead of deprecated ioutil methods, fixes lint
 2022-08-26 19:39:30 -06:00
smartcontracts
c76107cdb0 Merge pull request #3316 from ethereum-optimism/master 
merge Master into Develop
 2022-08-25 19:50:04 -04:00
Matthew Slipper
d54217657d Merge pull request #3192 from ethereum-optimism/develop 
Develop -> Master
 2022-08-08 12:42:12 -06:00
Matthew Slipper
0791dd2328 Merge pull request #3191 from ethereum-optimism/changeset-release/master 
Version Packages
 2022-08-08 12:40:29 -06:00
Matthew Slipper
2be30523c9 Merge pull request #3176 from ethereum-optimism/develop 
Develop -> Master
 2022-08-04 12:49:14 -06:00
Matthew Slipper
f84edae8ae Merge pull request #3175 from ethereum-optimism/changeset-release/master 
Version Packages
 2022-08-04 12:48:37 -06:00
github-actions[bot]
fc9487bf83 Version Packages 2022-08-04 18:48:19 +00:00
Matthew Slipper
db220c7ff1 Merge pull request #3174 from ethereum-optimism/develop 
Develop -> Master
 2022-08-04 12:46:46 -06:00
Matthew Slipper
7a2b4bdf45 proxyd: Add rate limit logging (#3173) 2022-08-04 18:44:46 +00:00
Matthew Slipper
d5ddd4f75d Merge pull request #3172 from ethereum-optimism/develop 
Develop -> Master
 2022-08-04 11:53:56 -06:00