98 Commits (055528ae05723b075ecb0665c4305283817656b9)

Author	SHA1	Message	Date
Melvin Junhee Woo	04a72260c5	snapshot: merge loops for better performance (#22160)	4 years ago
gary rong	5e9f5ca5d3	core/state/snapshot: write snapshot generator in batch (#22163) ... * core/state/snapshot: write snapshot generator in batch * core: refactor the tests * core: update tests * core: update tests	4 years ago
Péter Szilágyi	c4deebbf1e	core/state/snapshot: add generation logs to storage too	4 years ago
Martin Holst Swende	93a89b2681	go.mod: use github.com/holiman/bloomfilter/v2 (#22044) ... * deps: use improved bloom filter implementation * eth/handler, trie: use 4 keys for syncbloom + minor fixes * eth/protocols, trie: revert change on syncbloom method signature	4 years ago
Melvin Junhee Woo	d2e1b17f18	snapshot, trie: fixed typos, mostly in snapshot pkg (#22133)	4 years ago
Melvin Junhee Woo	167ff563d1	core/state/snapshot: gethring -> gathering typo (#22104)	4 years ago
Péter Szilágyi	017831dd5b	core, eth: split eth package, implement snap protocol (#21482) ... This commit splits the eth package, separating the handling of eth and snap protocols. It also includes the capability to run snap sync (https://github.com/ethereum/devp2p/blob/master/caps/snap.md) , but does not enable it by default. Co-authored-by: Marius van der Wijden <m.vanderwijden@live.de> Co-authored-by: Martin Holst Swende <martin@swende.se>	4 years ago
Péter Szilágyi	7b7b327ff2	core/state/snapshot: update generator marker in sync with flushes	4 years ago
gary rong	e6402677c2	core/state/snapshot: fix journal recovery from generating old journal (#21775) ... * core/state/snapshot: print warning if failed to resolve journal * core/state/snapshot: fix snapshot recovery When we meet the snapshot journal consisted with: - disk layer generator with new-format - diff layer journal with old-format The base layer should be returned without error. The broken diff layer can be reconstructed later but we definitely don't want to reconstruct the huge diff layer. * core: add tests	4 years ago
gary rong	b63e3c37a6	core: improve snapshot journal recovery (#21594) ... * core/state/snapshot: introduce snapshot journal version * core: update the disk layer in an atomic way * core: persist the disk layer generator periodically * core/state/snapshot: improve logging * core/state/snapshot: forcibly ensure the legacy snapshot is matched * core/state/snapshot: add debug logs * core, tests: fix tests and special recovery case * core: polish * core: add more blockchain tests for snapshot recovery * core/state: fix comment * core: add recovery flag for snapshot * core: add restart after start-after-crash tests * core/rawdb: fix imports * core: fix tests * core: remove log * core/state/snapshot: fix snapshot * core: avoid callbacks in SetHead * core: fix setHead cornercase where the threshold root has state * core: small docs for the test cases Co-authored-by: Péter Szilágyi <peterke@gmail.com>	4 years ago
gary rong	43c278cdf9	core/state: disable snapshot iteration if it's not fully constructed (#21682) ... * core/state/snapshot: add diskRoot function * core/state/snapshot: disable iteration if the snapshot is generating * core/state/snapshot: simplify the function * core/state: panic for undefined layer	4 years ago
Péter Szilágyi	a15d71a255	core/state/snapshot: stop generator if it hits missing trie nodes (#21649) ... * core/state/snapshot: exit Geth if generator hits missing trie nodes * core/state/snapshot: error instead of hard die on generator fault * core/state/snapshot: don't enable logging on the tests	4 years ago
Péter Szilágyi	3ee91b9f2e	core/state/snapshot: reduce disk layer depth during generation	4 years ago
Martin Michlmayr	4f2784b38f	all: fix typos in comments (#21118)	5 years ago
gary rong	85944c2561	core/state/snapshot: fix typo (#21037)	5 years ago
Péter Szilágyi	90af6dae6e	core/state/snapshot: don't create storage list for non-existing accounts	5 years ago
Péter Szilágyi	da59147014	core/state/snapshot: release iterator after verification	5 years ago
gary rong	2337aa64eb	core/state/snapshot: fix trie generator reporter (#21004)	5 years ago
Péter Szilágyi	4b6f6ffe23	core/state/snapshot: fix journal nil deserialziation	5 years ago
gary rong	26d271dfbb	core/state/snapshot: implement storage iterator (#20971) ... * core/state/snapshot: implement storage iterator * core/state/snapshot, tests: implement helper function * core/state/snapshot: fix storage issue If an account is deleted in the tx_1 but recreated in the tx_2, the it can happen that in this diff layer, both destructedSet and storageData records this account. In this case, the storage iterator should be able to iterate the slots belong to new account but disable further iteration in deeper layers(belong to old account) * core/state/snapshot: address peter and martin's comment * core/state: address comments * core/state/snapshot: fix test	5 years ago
gary rong	8a2e8faadd	core/state/snapshot: fix binary iterator (#20970)	5 years ago
gary rong	b9df7ecdc3	all: seperate consensus error and evm internal error (#20830) ... * all: seperate consensus error and evm internal error There are actually two types of error will be returned when a tranaction/message call is executed: (a) consensus error (b) evm internal error. The former should be converted to a consensus issue, e.g. The sender doesn't enough asset to purchase the gas it specifies. The latter is allowed since evm itself is a blackbox and internal error is allowed to happen. This PR emphasizes the difference by introducing a executionResult structure. The evm error is embedded inside. So if any error returned, it indicates consensus issue happens. And also this PR improve the `EstimateGas` API to return the concrete revert reason if the transaction always fails * all: polish * accounts/abi/bind/backends: add tests * accounts/abi/bind/backends, internal: cleanup error message * all: address comments * core: fix lint * accounts, core, eth, internal: address comments * accounts, internal: resolve revert reason if possible * accounts, internal: address comments	5 years ago
Martin Holst Swende	c036fe35a8	core/state/snapshot: make difflayer account iterator seek operation inclusive	5 years ago
Boqin Qin	7599999dcd	snapshot: add Unlock before return (#20948) ... * Forget Unlock in snapshot * Remove Unlock before panic	5 years ago
Martin Holst Swende	6402c42b67	all: simplify and fix database iteration with prefix/start (#20808) ... * core/state/snapshot: start fixing disk iterator seek * ethdb, rawdb, leveldb, memorydb: implement iterators with prefix and start * les, core/state/snapshot: iterator fixes * all: remove two iterator methods * all: rename Iteratee.NewIteratorWith -> NewIterator * ethdb: fix review concerns	5 years ago
Martin Holst Swende	76eed9e50d	snapshotter/tests: verify snapdb post-state against trie (#20812) ... * core/state/snapshot: basic trie-to-hash implementation * tests: validate snapshot after test * core/state/snapshot: fix review concerns	5 years ago
Martin Holst Swende	074efe6c8d	core: fix two snapshot iterator flaws, decollide snap storage prefix ... * core/state/snapshot/iterator: fix two disk iterator flaws * core/rawdb: change SnapshotStoragePrefix to avoid prefix collision with preimagePrefix	5 years ago
Péter Szilágyi	fab0ee3bfa	core/state/snapshot: fix various iteration issues due to destruct set	5 years ago
Martin Holst Swende	eff7cfbb03	core/state/snapshot: handle deleted accounts in fast iterator	5 years ago
Péter Szilágyi	a4cf279494	core/state: extend snapshotter to handle account resurrections	5 years ago
Péter Szilágyi	6e05ccd845	core/state/snapshot, tests: sync snap gen + snaps in consensus tests	5 years ago
Péter Szilágyi	06d4470b41	core: fix broken tests due to API changes + linter	5 years ago
Martin Holst Swende	19099421dc	core/state/snapshot: faster account iteration, CLI integration	5 years ago
Péter Szilágyi	6ddb92a089	core/state/snapshot: full featured account iteration	5 years ago
Martin Holst Swende	e570835356	core/state/snapshot: implement iterator priority for fast direct data lookup	5 years ago
Péter Szilágyi	e567675473	core/state/snapshot: move iterator out into its own files	5 years ago
Martin Holst Swende	7e38996301	core/state/snapshot: implement snapshot layer iteration	5 years ago
Péter Szilágyi	22c494d399	core/state/snapshot: bloom, metrics and prefetcher fixes	5 years ago
Martin Holst Swende	3ad4335acc	core/state/snapshot: node behavioural difference on bloom content	5 years ago
Péter Szilágyi	fd39f722a3	core: journal the snapshot inside leveldb, not a flat file	5 years ago
Martin Holst Swende	d5d7c0c24b	core/state/snapshot: fix difflayer origin-initalization after flatten	5 years ago
Péter Szilágyi	351a5903b0	core/rawdb, core/state/snapshot: runtime snapshot generation	5 years ago
Martin Holst Swende	f300c0df01	core/state/snapshot: replace bigcache with fastcache	5 years ago
Péter Szilágyi	d754091a87	core/state/snapshot: unlink snapshots from blocks, quad->linear cleanup	5 years ago
Martin Holst Swende	cdf3f016df	snapshot: iteration and buffering optimizations	5 years ago
Péter Szilágyi	d7d81d7c12	core/state/snapshot: extract and split cap method, cover corners	5 years ago
Martin Holst Swende	e146fbe4e7	core/state: lazy sorting, snapshot invalidation	5 years ago
Péter Szilágyi	542df8898e	core: initial version of state snapshots	5 years ago