Commit Graph

12835 Commits

Author SHA1 Message Date
flywukong
fea1c96d28 asynchronous update snap in updatetrie 2022-06-07 12:00:35 +08:00
WayToFuture
2288373b7e
Merge pull request #905 from forcodedancing/improve_snap_lock
[R4R] improve snap mutex
2022-06-07 09:57:35 +08:00
forcodedancing
fe2d84bd4a improve snap mutex 2022-05-12 10:07:01 +08:00
zjubfd
2f2b98abb2
Merge pull request #888 from bnb-chain/develop
[R4R] Release For BSC v1.1.10
v1.1.10
2022-05-05 17:26:16 +08:00
zjubfd
55ef216c66 relace binance to bnb in changelog 2022-05-05 13:32:24 +08:00
zjubfd
b679ba81f2
prepare for release v1.1.10 (#889) 2022-05-05 11:29:33 +08:00
Gothery
4feb52e5b0
[R4R]: add Euler Hardfork, including BEP-127 and BEP-131 (#885)
* feat: add BEP-127 and BEP-131 hardfork bytecode to upgrade

* feat: force check that Euler height cannot be a multiple of 200, fix getCurrentValidators, raise SystemTxsGas after Euler fork

Co-authored-by: goth <goth>
2022-04-29 18:03:22 +08:00
WayToFuture
5b5abc4e22
[R4R] fix validator pipecommit issue (#877)
* fix validator account root issue in piepecommit

* fix test and imports

* add check for snap

* refacto a bit
2022-04-29 15:45:55 +08:00
Leon
717b38c5f5
[R4R] fix:defer bloomprocessor close (#860)
* fix:defer bloomprocessor close

* fix: fix deadlock in Close

* perf:rm defer bloomprocessors Close and manual close before return
2022-04-28 18:22:02 +08:00
Leon
0f5a4c87db
[R4R]fix:Shift panic for zero length of heads (#870)
* fix:Shift panic for zero length of heads

* fix: make sure peek before shift

* refactor and update ut

* refactor
2022-04-25 10:47:02 +08:00
Jolly Zhao
15bc2548c1
fix logic issue: handlers.removePeer() is called twice. (#856)
* fix logic issue: handlers.removePeer() is called twice.

There is a logic issue which cause "Ethereum peer removal failed, err=peer not registered" occur quite often.

handler.runEthPeer set up a defer removePeer(). This is always called after a peer is disconnected.
However removePeer is also called by mulitple functions like downloader/fetcher.  After those kind of functions removePeer(), peer handler executes defer removePeer(). This makes removePeer() happened twice, and this is the reason we often see "Ethereum peer removal failed, err=peer not registered".

To solve this, removePeer only needs to hard Disconnect peer from networking layer. Then defer unregisterPeer() will do the cleanup task after then.

* fix: modify test function for close testing.

reference from go-thereum.

Co-authored-by: zjubfd <296179868@qq.com>
2022-04-24 14:24:07 +08:00
zjubfd
74ecbf271d
Merge pull request #850 from bnb-chain/develop
[R4R] Release v1.1.9
v1.1.9
2022-04-08 19:06:42 +08:00
WayToFuture
1aeadc143a
[R4R] prepare for release of v1.1.9 (#849)
* prepare release of v1.1.9

* prepare release of v1.1.9

* prepare release of v1.1.9

Co-authored-by: forcodedancing <liguo.fudan@gmail.com>
2022-04-08 15:59:40 +08:00
WayToFuture
343b315030
put error check to the correct location (#842)
Co-authored-by: forcodedancing <liguo.fudan@gmail.com>
2022-04-06 18:21:54 +08:00
Leon
12c5eb00a8
[R4R]Fix mining-prefetcher panic for empty transaction initial of txCurr(#843) 2022-04-06 15:28:01 +08:00
qinglin89
1ff4721434 fix:replace fake transaction with first peek for txCurr 2022-04-06 13:40:14 +08:00
zjubfd
05925da696
fix deadlock on miner module when failed to commit trie (#835) 2022-04-02 17:53:19 +08:00
zjubfd
f5a1c073bc
fix deadlock when failed to verify state root (#834) 2022-04-02 11:52:03 +08:00
flywukong
c57b02c293
change prefetch thread num (#830) 2022-04-01 21:56:23 +08:00
zjubfd
4598334a9a
disable diffsync when pipecommit is enabled (#820) 2022-03-30 11:22:00 +08:00
flywukong
cde35b0b36 add sharedStorage to the prefetcher of miner (#818)
* add sharedStorage to the prefetcher of miner

* fix miner prefetcher copy
2022-03-30 00:19:47 +08:00
WayToFuture
d8949871fb [R4R] state verification pipeline (#795)
* pipeline state verification

* update codes and add logs for debug

* refactor

* update and add logs

* refactor

* refactor

* remove unneeded logs

* fix a blocking issue

* fix sync issue when force kill

* remove logs

* refactor based on comments

* refactor based on comments

* refactor based on comments

* refactor based on comments

* refactor based on comments

* fix a deadlock issue

* fix merkle root mismatch issue during sync

* refactor based on review comments

* remove unnecessary code

* remove unnecessary code

* refactor based on review comments

* change based on comments

* refactor

* uew dummyRoot to replace emptyRoot

* add nil check

* add comments

* remove unneeded codes

* format comments

Co-authored-by: forcodedancing <liguo.fudan@gmail.com>
2022-03-30 00:19:47 +08:00
flywukong
4ff96978cb [R4R]add sharedStorage for prefetching to L1 (#792)
* add sharedStorage for prefetching to L1

* remote originStorage in stateObjects

* fix core

* fix bug of sync map

* remove read lock when get & set keys

* statedb copy use CopyWithSharedStorage

* reduce lock access

* fix comment

* avoid sharedPool effects on other modules

* remove  tryPreload

* fix comment

* fix var name

* fix lint

* fix L1 miss data && data condition

* fix comment
2022-03-30 00:19:47 +08:00
zjubfd
5f1aabeb38 fix race condition on preimage (#797) 2022-03-30 00:19:47 +08:00
zjubfd
58f3b2cd84 fix code of difflayer not assgin before return (#808) 2022-03-30 00:19:47 +08:00
Leon
91d7cd5fd2 [R4R]Prefetch state data on mining process (#803)
* perf(miner):add mining prefetcher

* fix ineffassign

* fix comments

* fix comments

* fix comments: add AsMessagePrefetch to skip nonce check

* fix comment:refactor check order of method Forward

* fix comments:rename variables

* fix comments: rename

* rename

* fix comments: refactor

* update
2022-03-30 00:19:47 +08:00
user
c0c6396509 fix pruner block tool bug, add some check logic 2022-03-25 15:22:21 +08:00
zjubfd
859186f299
Merge pull request #743 from binance-chain/develop
[R4R] Release v1.1.8
v1.1.8
2022-01-28 11:44:08 +08:00
zjubfd
21a3b11d17
prepare for relase v1.1.8 (#741) 2022-01-26 14:57:22 +08:00
dylanhuang
6499b3f890
doc: update discord link (#740) 2022-01-26 14:30:07 +08:00
zjubfd
eb7e3092d5
[R4R] implement State Verification && Snapshot Commit pipeline (#668)
* pipeline commit trie

add metrics

reopen trie

* add unit testcase

* resolve keefe's comment

* resolve igor's comments

* update prefetch

remove prefetcher

* no need to return error for precacheTransaction

* fix lint issue

* add some comments

* remove useless code

* add default option is false

* fix diffsync nil point

* fix panic on  GetProofByHash

Co-authored-by: zjubfd <zjubfd@google.com>
2022-01-26 14:12:18 +08:00
John
476d5200f7
[R4R]offline block prune (#543)
* offline block prune

* update

* update

* update and add unit test

* addressed comments from walt

* Addressed comments from walt and Igor

* ensure MPT and snapshot matched

* add one more parameter to indicate blockprune

* update the logic of creating freezerDb

* update flag command description

* expose the function for db inspect the offset/startBlockNumber

* add flags to inspect prune info

* rename flag of reserved-recent-blocks to block-amount-reserved

* addressed comments from walt

* handle the case of command interruption

* refined goimports

* addressed comments from walt

* change the logic as restarting prune after interruption

* addressed comments

* reclaimed freezer logic

* introduce flag to enable/disable check between MPT and snapshot

* update the logic of frozen field in freezerDB

* update the code in all places related to freezer change

* addressed comments from dylan

* update the logic for backup block difficulty

* addressed comments from dylan
2022-01-19 18:07:49 +08:00
dylanhuang
ebc39330c5
ci: add arm binaries for release pipeline (#713) 2022-01-14 15:44:33 +08:00
zjubfd
c78ecfbb4b
[R4R]prefetch state by applying the transactions within one block (#704)
* prefetch state by apply transactions within one block

* resolve comments

* stop prefetch once process is done

* update comments

fix ut
2022-01-11 13:55:30 +08:00
Delweng
50ad4e3f60
[R4R]Feature/backport geth native trace (#581)
* eth/tracers: implement debug.intermediateRoots (#23594)

This PR implements a new debug method, which I've talked briefly about to some other client developers. It allows the caller to obtain the intermediate state roots for a block (which might be either a canon block or a 'bad' block).
Signed-off-by: wenbiao <delweng@gmail.com>

* core, rpc: disable memory output by default in traces (#23558)

* core: cmd: invert disableMemory

* core: fix missed inversion

* cmd/evm: preserve Flags but change default value

* Apply suggestions from code review

Co-authored-by: Martin Holst Swende <martin@swende.se>

Co-authored-by: Martin Holst Swende <martin@swende.se>
Signed-off-by: wenbiao <delweng@gmail.com>

* eth/tracers: abort evm execution when trace is aborted (#23580)

Signed-off-by: wenbiao <delweng@gmail.com>

* eth/tracers: avoid unsyncronized mutations on trie database (#23632)

This PR fixes an issue in traceChain, where the statedb Commit operation was performed asynchronously with dereference-operations agains the underlying trie.Database instance. Due to how the reference counting works within the trie database (where parent count is recursively updated when new parents are added), doing dereferencing in the middle of Commit can cause the refcount to become wrong, leading to an inconsistent state. 

This was fixed by doing Commit/Deref from the same routine.  
Signed-off-by: wenbiao <delweng@gmail.com>

* core,eth: call frame tracing (#23087)

This change introduces 2 new optional methods; `enter()` and `exit()` for js tracers, and makes `step()` optiona. The two new methods are invoked when entering and exiting a call frame (but not invoked for the outermost scope, which has it's own methods). Currently these are the data fields passed to each of them:

    enter: type (opcode), from, to, input, gas, value
    exit: output, gasUsed, error

The PR also comes with a re-write of the callTracer. As a backup we keep the previous tracing script under the name `callTracerLegacy`. Behaviour of both tracers are equivalent for the most part, although there are some small differences (improvements), where the new tracer is more correct / has more information.

Signed-off-by: wenbiao <delweng@gmail.com>

* eth/tracers: re-write of 4byte tracer using enter/exit (#23622)

* eth/tracers: add re-write of 4byte tracer using enter/exit

* eth/tracers: fix 4byte indent
Signed-off-by: wenbiao <delweng@gmail.com>

* eth/tracers: tx.BaseFee not implemented

Signed-off-by: wenbiao <delweng@gmail.com>

* eth/tracers: do the JSON serialization via .js to capture C faults

Signed-off-by: wenbiao <delweng@gmail.com>

* eth/tracers: fix callTracer fault handling (#23667)

* eth/tracers: fix calltracer fault handling

* eth/tracers: fix calltracer indentation
Signed-off-by: wenbiao <delweng@gmail.com>

* eth/tracers: invoke enter/exit on 0-value calls to inex accounts (#23828)

Signed-off-by: wenbiao <delweng@gmail.com>

* eth: make traceChain avoid OOM on long-running tracing (#23736)

This PR changes long-running chain tracing, so that it at some points releases the memory trie db, and switch over to a fresh disk-backed trie.
Signed-off-by: wenbiao <delweng@gmail.com>

* eth/tracers: expose contextual infos (block hash, tx hash, tx index)

Signed-off-by: wenbiao <wenbiao.zheng@ambergroup.io>

* eth/tracers: redefine Context

Signed-off-by: wenbiao <wenbiao.zheng@ambergroup.io>

* eth/tracers: support for golang tracers + add golang callTracer (#23708)

* eth/tracers: add basic native loader

* eth/tracers: add GetResult to tracer interface

* eth/tracers: add native call tracer

* eth/tracers: fix call tracer json result

* eth/tracers: minor fix

* eth/tracers: fix

* eth/tracers: fix benchTracer

* eth/tracers: test native call tracer

* eth/tracers: fix

* eth/tracers: rm extra make

Co-authored-by: Martin Holst Swende <martin@swende.se>

* eth/tracers: rm extra make

* eth/tracers: make callFrame private

* eth/tracers: clean-up and comments

* eth/tracers: add license

* eth/tracers: rework the model a bit

* eth/tracers: move tracecall tests to subpackage

* cmd/geth: load native tracers

* eth/tracers: minor fix

* eth/tracers: impl stop

* eth/tracers: add native noop tracer

* renamings

Co-authored-by: Martin Holst Swende <martin@swende.se>

* eth/tracers: more renamings

* eth/tracers: make jstracer non-exported, avoid cast

* eth/tracers, core/vm: rename vm.Tracer to vm.EVMLogger for clarity

* eth/tracers: minor comment fix

* eth/tracers/testing: lint nitpicks

* core,eth: cancel evm on nativecalltracer stop

* Revert "core,eth: cancel evm on nativecalltracer stop"

This reverts commit 01bb908790a369c1bb9d3937df9325c6857bf855.

* eth/tracers: linter nits

* eth/tracers: fix output on err

Co-authored-by: Martin Holst Swende <martin@swende.se>
Signed-off-by: wenbiao <wenbiao.zheng@ambergroup.io>

* eth/tracers: make native calltracer default (#23867)

Signed-off-by: wenbiao <wenbiao.zheng@ambergroup.io>

* eth/tracers: package restructuring (#23857)

* eth/tracers: restructure tracer package

* core/vm/runtime: load js tracers

* eth/tracers: mv bigint js code to own file

* eth/tracers: add method docs for native tracers

* eth/tracers: minor doc fix

* core,eth: cancel evm on nativecalltracer stop

* core/vm: fix failing test

Co-authored-by: Sina Mahmoodi <itz.s1na@gmail.com>
Signed-off-by: wenbiao <wenbiao.zheng@ambergroup.io>

* eth/tracers: ethapi.TransactionArgs was not merged

Signed-off-by: wenbiao <wenbiao.zheng@ambergroup.io>

* eth/tracers: fix the api_test with ErrInsufficientFunds to ErrInsufficientFundsForTransfer

Signed-off-by: wenbiao <wenbiao.zheng@ambergroup.io>

* eth/tracers: check posa before statedb.Prepare in IntermiateRoots api

Signed-off-by: wenbiao <wenbiao.zheng@ambergroup.io>

* eth/tracers: make js calltracer default, compatible with old version

Signed-off-by: wenbiao <wenbiao.zheng@ambergroup.io>

* eth/tracers: fix the default callTrace name of callTracerJs

Signed-off-by: wenbiao <wenbiao.zheng@ambergroup.io>

* Revert "eth/tracers: fix the default callTrace name of callTracerJs"

This reverts commit 62a3bc215d9f07e422a4c659289bb3ba4f9ed2fa.

Signed-off-by: wenbiao <wenbiao.zheng@ambergroup.io>

* Revert "eth/tracers: make js calltracer default, compatible with old version"

This reverts commit 85ef42c0ea651f0b228d4209b1b2598b24e12f1f.

Signed-off-by: wenbiao <wenbiao.zheng@ambergroup.io>

* eth/tracers: fix the variable race condition

Signed-off-by: wenbiao <wenbiao.zheng@ambergroup.io>

Co-authored-by: Martin Holst Swende <martin@swende.se>
Co-authored-by: Marius van der Wijden <m.vanderwijden@live.de>
Co-authored-by: Sina Mahmoodi <1591639+s1na@users.noreply.github.com>
Co-authored-by: Péter Szilágyi <peterke@gmail.com>
Co-authored-by: Sina Mahmoodi <itz.s1na@gmail.com>
2021-12-27 10:09:12 +08:00
zjubfd
ffb7f4a52c
Merge pull request #676 from binance-chain/catch_up_master
[R4R] develop branch catch up master
2021-12-27 10:07:50 +08:00
zjubfd
3a4192464c merge with release v1.1.7 2021-12-20 12:26:44 +08:00
KeefeL
5218949ba9
trie: reject deletions when verifying range proofs (#667)
Co-authored-by: Péter Szilágyi <peterke@gmail.com>
2021-12-20 12:15:34 +08:00
yutianwu
7c1c8e2e88
[R4R] add timeout for stopping p2p server (#643)
* add timeout for stopping p2p server

* extend extension wait time

* add unit tests

* fix lint issue
2021-12-13 11:16:03 +08:00
zjubfd
74f6b613a4
Merge pull request #628 from guagualvcha/fix_state_inconsistent
[R4R]fix state inconsistent when doing diffsync
v1.1.7
2021-12-05 12:23:57 +08:00
guagualvcha
d7e48bf824 add change logs && prelease v1.1.7 2021-12-05 11:58:07 +08:00
guagualvcha
2bf7d669ea change the release env 2021-12-05 11:55:59 +08:00
guagualvcha
a8618952fd fix state inconsistent between snapshot and MPT when doing diffsync 2021-12-05 01:23:22 +08:00
KeefeL
ec8d46e059
reorganize the logic of reannouncing transactions (#620) 2021-12-03 13:43:39 +08:00
dylanhuang
0b575443c4 prepare for release v.1.1.6 (#603) v1.1.6 2021-11-29 14:08:28 +08:00
dylanhuang
aff68c35a4 [R4R] pre-release ci flow (#594)
* ci: add pre release ci flow

* ci: fix change log format
2021-11-29 14:08:28 +08:00
KeefeL
90fd01423a [R4R]reannounce local pending transactions (#570)
* reannouce local pending transactions

* add tests for tx_pool reannouce local pending transactions

* add tests for handler reannounce local pending transactions
2021-11-29 14:08:28 +08:00
flywukong
c9f892cd6a go.mod: update goleveldb (#23417) (#578)
Co-authored-by: ucwong <ucwong@126.com>
2021-11-29 14:08:28 +08:00
zjubfd
cccd675148 eth/protocols/snap, trie: better error-handling (#23657) (#582)
Co-authored-by: Martin Holst Swende <martin@swende.se>
2021-11-29 14:08:28 +08:00
dylanhuang
a9ac317571
prepare for release v.1.1.6 (#603) 2021-11-29 10:59:36 +08:00