will@2012
8749c8e8ce
perf: add more metrics/log to perf pebble
2024-05-20 20:40:51 +08:00
will@2012
79fe2899c7
chore: add more metrics to perf pbss
2024-05-20 17:35:29 +08:00
rjl493456442
bf16a39876
ethdb/pebble: print warning log if pebble performance degrades ( #29478 )
2024-05-14 15:26:21 +08:00
Devon Bear
2c8720016d
go.mod: bump pebble db to official release ( #29038 )
...
bump pebble
2024-05-14 15:26:21 +08:00
buddh0
a1c2491aab
Merge tag 'v1.13.11' from go-ethereum
2024-02-02 15:55:18 +08:00
wayen
a25a2143ce
ethdb/pebble: cap memory table size as maxMemTableSize-1 ( #28444 ) ( #2120 )
2024-01-03 14:37:01 +08:00
wayen
8a440e753f
fix: fix the pebble config of level option ( #2072 )
2023-12-18 13:11:17 +08:00
Péter Szilágyi
0b632d97f3
cmd, core, ethdb: enable Pebble on 32 bits and OpenBSD
2023-12-14 11:10:45 +08:00
Marius van der Wijden
55b483d82a
ethdb/pebble: remove a dependency ( #28627 )
...
The dependency was not really used anyway, so we can get rid of it.
Co-authored-by: Felix Lange <fjl@twurst.com>
2023-12-06 11:41:04 +01:00
Maciej Kulawik
6489a0dd1f
ethdb/pebble: don't double-close iterator inside pebbleIterator ( #28566 )
...
Adds 'released' flag to pebbleIterator to avoid double closing cockroachdb/pebble.Iterator as it is an invalid operation.
Fixes #28565
2023-11-21 15:22:22 +01:00
wayen
497fdf8358
fix: upgrade pebble and improve config ( #1979 )
2023-11-20 14:28:01 +08:00
Jim McDonald
f7dde2a96c
ethdb/pebble: add Errorf function to panicLogger ( #28491 )
...
cockroachdb/pebble@422dce9 added Errorf to the Logger interface, this change makes it possible to compile geth with that version of pebble by adding the corresponding method to panicLogger.
2023-11-09 15:15:22 +01:00
rjl493456442
f4ac548619
ethdb/pebble: cap memory table size as maxMemTableSize-1 ( #28444 )
2023-10-31 18:19:31 +02:00
Péter Szilágyi
509a64ffb9
cmd, core, ethdb: enable Pebble on 32 bits and OpenBSD too ( #28335 )
...
* cmd, core, ethdb: enable Pebble on 32 bits and OpenBSD too
* ethdb/pebble: use Pebble's internal constant calculation
2023-10-13 22:50:20 +03:00
rjl493456442
7776a3214a
ethdb/pebble: add level file metrics ( #28271 )
2023-10-11 09:18:18 +02:00
Péter Szilágyi
966e50bddb
ethdb/pebble: luv you linter
2023-09-29 20:52:55 +03:00
rjl493456442
22dcb7a77b
ethdb/pebble: upgrade pebble to master (aa077af62593) ( #28070 )
...
* ethdb/pebble: upgrade pebble
* ethdb/pebble, go.mod: update pebble to master (aa077af62593)
---------
Co-authored-by: Péter Szilágyi <peterke@gmail.com>
2023-09-29 20:45:38 +03:00
Péter Szilágyi
f988b2332e
ethdb, internal/ethapi: support exposing Pebble stats too, beside LevelDB ( #28224 )
...
ethdb, internal/ethapi: support exposing Pebble stats too, besinde LevelDB
2023-09-28 22:27:21 +03:00
Martin Holst Swende
f0f8703bf2
core/rawdb, ethdb/pebble: avoid fsync db in tests ( #27836 )
...
Adds an option to disable fsync for database operations.
This is to make tests faster.
2023-08-23 20:43:55 +02:00
rjl493456442
4b90c4488d
ethdb/pebble: use sync mode for pebble writes ( #27615 )
2023-06-27 03:19:02 -04:00
Martin Holst Swende
713fc8bbe6
ethdb/pebble: fsync for batch writes ( #27522 )
...
This is likely the culprit behind several data corruption issues, e.g. where data has been
written to the freezer, but the deletion from pebble does not go through due to process
crash.
2023-06-21 18:08:12 +02:00
Martin Holst Swende
33fdd030b1
ethdb/pebble: fix NewBatchWithSize to set db ( #27350 )
2023-05-25 10:31:05 +03:00
Martin Holst Swende
99394adcb8
ethdb/pebble: prevent shutdown-panic ( #27238 )
...
One difference between pebble and leveldb is that the latter returns error when performing Get on a closed database, the former does a panic. This may be triggered during shutdown (see #27237 )
This PR changes the pebble driver so we check that the db is not closed already, for several operations. It also adds tests to the db test-suite, so the previously implicit assumption of "not panic:ing at ops on closed database" is covered by tests.
2023-05-19 08:36:21 -04:00
Péter Szilágyi
d3ece3a07c
cmd/utils, node: switch to Pebble as the default db if none exists ( #27136 )
...
* cmd/utils, node: switch to Pebble as the default db if none exists
* node: fall back to LevelDB on platforms not supporting Pebble
* core/rawdb, node: default to Pebble at the node level
* cmd/geth: fix some tests explicitly using leveldb
* ethdb/pebble: allow double closes, makes tests simpler
2023-04-21 19:24:18 +03:00
s7v7nislands
50317bdace
ethdb/pebble: use atomic type ( #27014 )
2023-03-30 15:02:14 -04:00
Péter Szilágyi
19f74fa3c0
core/rawdb, ethdb/pebble: disable pebble on openbsd ( #26801 )
2023-03-03 12:05:00 +02:00
rjl493456442
2bb622ce40
ethdb/pebble: fix max memorytable size ( #26776 )
2023-02-28 15:34:12 +02:00
rjl493456442
98b0ea62b5
ethdb/pebble: fix range compaction ( #26771 )
...
* ethdb/pebble: fix range compaction
* ethdb/pebble: add comment
2023-02-28 15:32:51 +02:00
Patrick O'Grady
5967a2290a
ethdb/pebble: Fix MemTableStopWritesThreshold ( #26692 )
...
MemTableStopWritesThreshold was set to the max size of all memtables before blocking writing but should be set to the max number of memtables. This is documented [here](https://github.com/cockroachdb/pebble/blob/master/options.go#L738-L742 ).
2023-02-15 03:27:52 -05:00
rjl493456442
0ea65d4020
ethdb: add benchmark test suite ( #26659 )
2023-02-10 04:35:00 -05:00
Péter Szilágyi
da3c974c36
ethdb/pebble: fix nil callbacks ( #26650 )
2023-02-09 13:31:42 +02:00
Martin Holst Swende
ed51b8c5d3
ethdb: pebble backend (64bit platforms only) ( #26517 )
...
* ethdb: use pebble
Co-authored-by: Gary Rong <garyrong0905@gmail.com>
foo
update
* apply suggested changes
* flags: go format
node: fix ddir lookup mistake
accounts/abi/bind: fix go.mod replacement for generated binding
deps: update pebble + with fix 32-bit build
* ethdb/pebble: respect max memtable size
* core/rawdb, ethdb: enable pebble on non-32bit platforms only
* core/rawdb: fix build tags, fix some review concerns
* core/rawdb: refactor methods for database opening
* core/rawdb: remove erroneous build tag
* cmd/geth: fix the flag default handling + testcase
* cmd/geth: improve testing regarding custom backends
* ethdb/pebble, deps: update pebble dependency
* core/rawdb: replace method with Open
* ethdb/pebble: several updates for pebble (#49 )
* ethdb/pebble: fix size count in batch
* ethdb/pebble: disable seek compaction
* ethdb/pebble: more fixes
* ethdb, core, cmd: polish and fixes (#50 )
* cmd/utils, core/rawdb, ethdb/pebble: address some review concerns
* Update flags.go
* ethdb/pebble: minor refactors
* ethdb/pebble: avoid copy on batch replay
* ethdb: fix compilation flaw
* cmd: fix test fail due to mismatching error message
* cmd/geth, node: rename backingdb to db.engine
---------
Co-authored-by: Jared Wasinger <j-wasinger@hotmail.com>
Co-authored-by: rjl493456442 <garyrong0905@gmail.com>
Co-authored-by: Péter Szilágyi <peterke@gmail.com>
2023-02-09 10:48:34 +02:00
