github/reth
1
1
Fork 0
mirror of https://github.com/paradigmxyz/reth.git synced 2026-02-07 21:45:24 -05:00
Code Issues Packages Projects Releases Wiki Activity
410 Commits 1,153 Branches 96 Tags
82cd84eca7d7dee4d7c93f9dd7b5c0e0bdf0967a
Commit Graph

340 Commits

Author SHA1 Message Date
Bjerg
82cd84eca7 test: fix emits_bodies_in_order test (#534) 
* feat(test-utils): make body tx count configurable

* test: fix `emits_bodies_in_order` test
 2022-12-20 01:29:04 +01:00
Matthias Seitz
5c1f97cbf7 test: create events handler before interacting with network mngr (#532) 2022-12-20 00:38:23 +01:00
Dan Cline
fc11443b97 feat(net): create enr to peerid helper (#533) 
* set network enr dev-dep to 0.7.0 instead of git - ethers and each
   other crate uses 0.7.0 and not git
 2022-12-19 18:32:19 -05:00
Dan Cline
c53b2bcccb feat(net): use NodeRecord instead of enode format (#530) 
* feat(eth-wire): add timeouts to tests using Geth

* feat(net): use NodeRecord instead of enode format

 * make NodeRecord::new pub instead of pub(crate)

Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>
 2022-12-19 17:57:02 -05:00
Dan Cline
ac1c0419d2 feat(eth-wire): add timeouts to tests using Geth (#529) 2022-12-19 23:35:06 +01:00
Matthias Seitz
3db7455eca fix(net): fix disconnect edge case on remove from discovery (#479) 
* fix(net): fix disconnect edge case on remove from discovery

* test: add disconnect test
 2022-12-19 22:27:01 +01:00
Bjerg
f65562e2e4 refactor(sync): remove require_tip (#528) 
`require_tip` could only be determined by the headers stage,
and it signalled that we have all of the headers to sync all
the way to the chain tip. Some stages may wait to execute
until the tip is reached, e.g. the stage that checks the
stage root, but there are a few problems:

- On initial sync, `reached_tip` would be `true`, but by
  the time we reach the hashing stage, this would actually
  no longer be the case: the other stages have spent
  enough time for us to be "out of sync". This means
  that the optimization here is lost, and the additional
  logic is added for nothing.
- When we are not doing our initial sync, `reached_tip` would
  always be `true` for each subsequent block we sync.
  The same logic applies as above, i.e. the extra logic
  is there for nothing.

In other words, `reached_tip` would *always* be `true` once
we leave the header stage, making the extra logic entirely
redundant.
 2022-12-19 22:04:42 +01:00
Bjerg
13bb41517d feat: config (#496) 
* feat: default reth dirs

* docs: clarify txpool config docs

* feat: `serde` feature for `reth-consensus`

* feat: add missing hardforks

* feat: full chain specification

* feat: `DbPath` type

* feat: custom chain specs

* feat: `--debug.tip` option

* feat: basic stage config

* fix: resize db geometry

* refactor: don't commit in headers stage

* chore: remove headers dl timeout

* feat: loading of config

* refactor(config): `stage` -> `stages`
 2022-12-19 21:27:26 +01:00
Matthias Seitz
516d744bdd test: run geth tests in serial (#527) 2022-12-19 19:12:14 +01:00
Matthias Seitz
a2849cd81e chore(net): improve ecies error for unreadable stream (#514) 
* chore(net): improve ecies error for unreadable stream

* Update crates/net/ecies/src/error.rs

Co-authored-by: Bjerg <onbjerg@users.noreply.github.com>

Co-authored-by: Bjerg <onbjerg@users.noreply.github.com>
 2022-12-19 19:07:19 +01:00
Roman Krasiuk
6a36a6a58c chore(sync): remove unused timeout from LinearDownloadBuilder (#524) 
* chore(sync): remove timeout from linear download builder

* rm unused import
 2022-12-19 18:40:45 +01:00
Matthias Seitz
40579bf233 test: decrease test timeout for keep alive (#523) 2022-12-19 18:03:50 +01:00
Matthias Seitz
e713b0c015 fix(net): poll after starting disconnect (#522) 2022-12-19 18:03:36 +01:00
Matthias Seitz
aac078a132 fix(net): add already connected check (#521) 
* fix(net): add already connected check

* fix: get events before adding peer
 2022-12-19 18:03:10 +01:00
Dan Cline
5758c297b3 fix(eth-wire): fix disconnect reason rlp decoding (#502) 
* add trace in DisconnectReason Decodable impl

* add trace for decoding p2p hello

* add traces to p2p and eth stream

* refactor P2PMessage decoding

 * improve disconnect tracing

* s/Hello/first

* add geth disconnect test

* add disconnectreason test cases

* add known failing disconnect messages

* add trace when disconnect reason decoding fails

* cargo fmt

* add more examples

 * adding more as they appear in traces
 * will add the rest since they can be exhaustively enumerated

* add every other possible encoding

* fix disconnect decoding

 * the four possible formats for a disconnect message (rlp list (y/n) x
   snappy (y/n)):
   * encoded as a single rlp byte
     * with snappy
     * without snappy
   * encoded as a rlp list
     * with snappy
     * without snappy
 * fix the type for decoding in the test_decode_known_reasons test

* sort reasons by length in test

* remove printlns

* use one call to advance

* simplify decode impl to strip last byte

 * todo: comment explaining the different formats being parsed?

* explicitly remove geth as a peer

* style: traces

* add another disconnect code from geth

* fix: add check for DisconnectRequested

Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>
 2022-12-19 11:19:08 -05:00
Matthias Seitz
f8b719e04c refactor(disc): use KBucekt entry API (#518) 
* refactor(disc): use entry API

* refactor(disc): cleanup

* chore: rustfmt
 2022-12-19 16:54:03 +01:00
Matthias Seitz
dc85695d0d fix(net): set disconnect status (#520) 2022-12-19 16:22:55 +01:00
Matthias Seitz
a5f01238b9 feat(net): allow disconnect with reason (#519) 2022-12-19 16:22:24 +01:00
Roman Krasiuk
c1a863d067 test(download): header downloader request attempts & remove duplicates (#517) 
* test(download): header downloader request attempts

* fix comment
 2022-12-19 16:18:38 +01:00
Roman Krasiuk
1dca4b58df test(sync): sender recovery single tx (#516) 2022-12-19 16:08:07 +01:00
Bjerg
bdec2357d2 fix: properly convert unknown error codes (#510) 2022-12-19 11:31:18 +02:00
Matthias Seitz
bffc829bcb perf(net): increase udp channel buffers (#508) 
* perf(net): increase channel buffers

* Update crates/net/discv4/src/config.rs

Co-authored-by: Bjerg <onbjerg@users.noreply.github.com>

Co-authored-by: Bjerg <onbjerg@users.noreply.github.com>
 2022-12-18 15:22:19 +01:00
Tomás
253aae5ea9 RLP decoding error tracing (#499) 
* Add tracing to ProtocolMessage::decode errors

* Change trace message formatting

Now it prints the bytes as a hex string.
Also changed trace level to WARN and added 'handshake' to one of the traces to differentiate between them

* Add prefix to raw message bytes

* Specify 'eth' in trace message

to differentiate it from other handshakes

Co-authored-by: Dan Cline <6798349+Rjected@users.noreply.github.com>

Co-authored-by: Dan Cline <6798349+Rjected@users.noreply.github.com>
 2022-12-16 20:57:48 -05:00
0xYami
0a4bf67c32 chore: complete StageDB -> Transaction renaming (#497) 2022-12-16 23:16:31 +01:00
Mariano A. Nicolini
4da574df84 feat: add prometheus support (#474) 2022-12-16 20:21:26 +01:00
Matthias Seitz
c1f124d3e3 feat(net): temporarily ban bad peers (#492) 
* feat(net): temporarily ban bad peers

* use half duration interval

* Update crates/net/network/src/peers/manager.rs

Co-authored-by: Bjerg <onbjerg@users.noreply.github.com>

* fix bad test

Co-authored-by: Bjerg <onbjerg@users.noreply.github.com>
 2022-12-16 18:22:25 +01:00
Roman Krasiuk
daaf039fbf feat(sync): state transition indexes (#449) 
* introduce state transitions and revert/modify block bodies table

* init refactor

* revamp transaction iteration based on bodies and add state transition mappings

* change expected return on empty db execution

* interim commit

* fix body downloader & stage

* refactor(bodies/dl): make fetch bodies fn more clear

* chore: disable unused vars/fns temporarily until exec is back

* chore: fmt

* test: fix tests

* use transitions in execution stage

* clarify empty unwind test

* remove last_tx_index fn

* rename fn and var names

* fix full block response comment

* rename fetcher`s get_block_body to get_block_bodies

* Update crates/stages/src/db.rs

Co-authored-by: Georgios Konstantopoulos <me@gakonst.com>

* fmt

* fix index overlap check error

* uncomment eth chain command

* fix doc comment

* typos

* cleanup

* any_last_tx_index -> last_tx_index

Co-authored-by: Georgios Konstantopoulos <me@gakonst.com>
Co-authored-by: Oliver Nordbjerg <hi@notbjerg.me>
 2022-12-16 08:37:49 -08:00
Matthias Seitz
345b2c35b9 fix: apply reputation (#487) 
* fix: apply reputation

* add note
 2022-12-16 13:36:58 +01:00
Dan Cline
635203759b feat(discv4): support eth entries (#447) 
* add ENRRequest and ENRResponse messages

 * todo: encode and decode impls

* scaffold enrrequest and enrresponse msgs

* implement encodable and decodable for enr

* cargo fmt

* impl sending enr requests

* silence clippy for now

* add todos for enrrequest and response in mocks

* make payload length fold more explicit

* feat: add enr support to ping pong

* integrate enr

* add update methods

* add enr handling

* feat: add enr handling

* integrate fork id

* fix: set frontier forkid

* disable eip868 by default

* address comments

Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>
 2022-12-16 14:14:19 +02:00
Matthias Seitz
864e6481da fix: set forkfilter correctly (#486) 
* fix: set forkfilter correctly

* fix types

* update tests
 2022-12-16 14:14:07 +02:00
Bjerg
8e4a35ae31 chore: clean up traces (#481) 
* chore: clean up traces

* fix: typo in error
 2022-12-16 11:24:46 +02:00
Roman Krasiuk
e9ec6c2847 fix(sync): remove redundant error (#476) 2022-12-16 10:08:49 +02:00
Matthias Seitz
6a70494612 fix(net): use frontier forkid as default (#478) 2022-12-16 10:08:16 +02:00
Roman Krasiuk
f89fb4b453 fix(sync): database integrity header error message (#475) 2022-12-15 23:00:56 +01:00
mempirate
b1ce398dff feat(net): add Status to session established event (#473) 2022-12-15 22:37:03 +01:00
Roman Krasiuk
2b0f5316f9 fix(sync): headers stage progress (#467) 
* fix(sync): headers stage progress

* add tests to head/tip and split suite

* fix(sync): headers stage progress

* add tests to head/tip and split suite

* fix local tip and address comments

* rename error
 2022-12-15 10:41:32 -08:00
Bjerg
789dc3bc87 feat: request multiple bodies per request (#468) 2022-12-15 18:39:47 +01:00
Georgios Konstantopoulos
9cd5824f35 chore: rename StageDB to Transaction (#470) 
* chore: rename StageDB to Transaction

* chore: cargo fmt

* chore: add note about potentially removing this in the future
 2022-12-15 18:14:14 +02:00
mempirate
6e577c6e5f feat(net): request peer by id through PeersHandle (#464) 2022-12-15 17:10:21 +02:00
Bjerg
f509213cb4 refactor: clean up reth node (#450) 
* feat: parse genesis block from a json spec

* refactor: clean up `init_genesis`
 2022-12-15 17:09:31 +02:00
Roman Krasiuk
9208f2fd9b test(execution): execution test runner (#426) 
* wip run chain test

* dump pre test state

* bug: fix casting to revm spec

* wip move execution to std thread

* wip scoped thread execution

* fmt clippy

* Update crates/stages/src/stages/execution.rs

* Update bin/reth/Cargo.toml

Co-authored-by: Georgios Konstantopoulos <me@gakonst.com>

* Update bin/reth/src/test_eth_chain/models.rs

Co-authored-by: Georgios Konstantopoulos <me@gakonst.com>

* Correct models for chain tests

Co-authored-by: rakita <dragan0rakita@gmail.com>
Co-authored-by: rakita <rakita@users.noreply.github.com>
Co-authored-by: Georgios Konstantopoulos <me@gakonst.com>
 2022-12-15 13:39:55 +01:00
Oliver Nordbjerg
48fadbdf2e fix: missing import 2022-12-15 13:53:20 +02:00
Bjerg
f8b4251886 feat: don't stop the pipeline on internal stage errs (#453) 
* feat: don't stop the pipeline on internal stage errs

* test: add tests for pipeline err handling

* chore: few notes

* refactor: stage error fatal/recoverable variants

* refactor: use recoverable errors in headers stage

* test: adjust tests

* chore: nits

Co-authored-by: Georgios Konstantopoulos <me@gakonst.com>

Co-authored-by: Georgios Konstantopoulos <me@gakonst.com>
 2022-12-15 12:48:41 +01:00
Matthias Seitz
9dbf280bfb docs(net): add bird's eye view docs (#456) 2022-12-15 11:36:58 +02:00
Roman Krasiuk
22dc50e5f6 feat(sync): download peer penalization (#427) 
* feat(sync): download peer penalization

* peer penalization

* add tracing on penalization

* add trace on request

* rename consensus back

* clippy

* fix tests

* nit: download result

* nit: fix comment

* rename penalize() to report_bad_message() and move DownloadError

Co-authored-by: Georgios Konstantopoulos <me@gakonst.com>
 2022-12-15 10:42:18 +02:00
Matthias Seitz
f2707d32b5 fix(net): kick useless peers (#451) 2022-12-15 10:04:22 +02:00
mempirate
c23c65fc3b feat(net): draft for sending status updates through NetworkHandle (#436) 
* feat(net): draft for sending status updates through `NetworkHandle`

* feat(net): draft for sending status updates through `NetworkHandle`

* fix(net): remove unused import

* feat(net): implement getters for status update sender half

* docs(net): document methods

* chore: cargo fmt

* feat(net): move status updating logic to NetworkManager and NetworkHandle

* feat(net): move status updating logic to NetworkManager and NetworkHandle

* fix(net): fix headers stage testing

* fix: derive default

* fix: remove StatusUpdate struct

Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>
 2022-12-15 08:59:28 +01:00
joshieDo
7b6bf0820e fix(cli): remove usage of StageDB on DbTool (#448) 
* use view and update instead of StageDB

* change DbTool docs

* clippy
 2022-12-15 08:33:49 +01:00
Matthias Seitz
43f6bb9127 feat(net): integrate discovery banlist (#442) 
* feat(net): integrate discovery banlist

* fix typos
 2022-12-14 19:47:11 +02:00
Bjerg
ae2fc494c8 test: fix header dl error test (#441) 2022-12-14 17:32:26 +02:00