56 Commits

Author SHA1 Message Date
jonesho
b31a330d40 feat: add calldata based pricing for variable cost (#1189)
* feat: add calldata based pricing for variable cost

* feat: revised log and removed comment

* feat: revised tests and checks beased on PR reviews
2025-06-21 01:29:11 +08:00
jonesho
0c1649788e feat: add request timeout for conflated trace, trace counter, and sta… (#1125)
* feat: add request timeout for conflated trace, trace counter, and state manager requests

* fix: requestTimeout for TracesGeneratorJsonRpcClientV2
2025-06-20 02:42:10 +08:00
Fluent Crafter
8461bde17e coordinator: carveout conflation app (#1138)
* coordinator: carvout conflation app

* coordinator: stop conflation app

* coordinator: fix client setup

* coordinator: fix spotless
2025-06-12 09:17:02 +01:00
Fluent Crafter
5c874e9ff9 coordinator: fix duplicated anchoring on high frequency tick interval (#1135) 2025-06-11 09:35:50 +01:00
jonesho
0b863e2a6e feat: update trace-limits and besu images (#1129)
* feat: update trace-limits and besu images

* update prover image

* feat: update trace-limits ROM to the power of 2

* feat: update trace-limits to be at max 2147483647

---------

Co-authored-by: gusiri <dreamerty@postech.ac.kr>
2025-06-11 00:09:20 +08:00
jonesho
50e4933495 feat: fix batch-limits, coordinator update for local run, and L1 d… (#1123)
* mainnet: fix batch-limits, coordinator update for local run, and L1 dynamic gas pricing readme update

* fix: spotless
2025-06-10 00:51:42 +08:00
Fluent Crafter
0c7c736830 coordinator: adds config v2 (#853)
* coordinator: adds config v2 sample

* coordinator: update config V2

* coordinator: update config v2

* coordinator: update config v2

* coordinator: config v2 wip

* spotless fix

* coordinator: adds config v2 parsers

* coordinator: adds config v2 classes and parsing tests

* coordinator: adds config v2 classes and parsing tests

* remove end2end changes from staterecovery test trigger

* coordinator: config v2 - fix prover directory config

* coordinator: add getChaindId to EthApiClient.kt

* coordinator: improve EIP1559GasProvider validation

* coordinator: add createReadOnly to Web3JL2MessageServiceSmartContractClient

* coordinator: add validation to FeeHistoryFetcherImpl

* coordinator: add more configs to v2

* coordinator: extend Web3JFactory

* coordinator: addapt CoordinatorApp to new V2 configs

* coordinator: adapt local stack coordinator configs

* coordinator: log4j clients.l1 debug

* coordinator: revert attempt to use web3signer on CI ONly :(

* coordinator: fix test and configs

* coordinator: fix test and configs

* coordinator: fix traces node address

* coordinator: remove unnecessary file

* coordinator: hardcode tracesVersion to v2.1.0 to match prover regex

* Update config/coordinator/coordinator-config-v2.toml

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Signed-off-by: Fluent Crafter <205769460+fluentcrafter@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Roman Vaseev <4833306+Filter94@users.noreply.github.com>
Signed-off-by: Fluent Crafter <205769460+fluentcrafter@users.noreply.github.com>

* coordinator: default targetBlobsPerTransaction=7u

* coordinator: hardcode tracesVersion to 2.1.0 to match prover regex

* coordinator: fix agg configs

* coordinator: strict configs log warning when config is not used

* coordinator: add carved out config files

* coordinator: add opt-in to avoid annoying warning log

* feat: update Makefile for new coordinator config file and variable name

* localstack: remove coordinator forced platform

* coordinator: add missing config on gas-price-cap-calculation

* coordinator: remove old configs

---------

Signed-off-by: Fluent Crafter <205769460+fluentcrafter@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Roman Vaseev <4833306+Filter94@users.noreply.github.com>
Co-authored-by: jonesho <81145364+jonesho@users.noreply.github.com>
Co-authored-by: jonesho <jones.ho@consensys.net>
2025-06-06 11:15:01 +01:00
jonesho
7e306e2658 feat: remove l2-node in e2e test and make it to run in local stack op… (#1001)
* feat: remove l2-node in e2e test and make it to run in local stack optionally

* fix: l2 spec transaction data size limit e2e test

* feat: revise blockscout configs

* feat: revised comment in Makefile

* feat: update transaction-exclusion-api and postman image

* feat: remove expected-traces-api-version-v2 from coordinator local overrides toml

* feat: remove shomei-frontend from ci and add disabled option in Type2StateProofProviderConfig

* feat: add endpoint for type2-state-proof-provider

* feat: revise coordinator local-dev override configs

* feat: remove white space
2025-05-22 23:27:14 +08:00
Fluent Crafter
f6cb0f2a05 Besu packgae update sequencer version (#1026)
* besu-package: update sequencer version

* besu-package: update sequencer version

* besu-package: update sequencer version

* besu-package: sequencer plugin update to v2.1-rc16.2.3

* besu-package: update besu package

* localstack: update coordinator version

* localstack: remove unnecessary

* localstack: revert l2 node configs on profitability check

* localstack: update e2e README

* besu-package: update sequencer plugin

* Revert "localstack: revert l2 node configs on profitability check"

This reverts commit 24ac5f6b746b85c4f27c02aaa63d992549aa44ac.

* besu-package: update plugins

* besu-package: update besu image

* fix flaky test

* besu-package: remove besu/plugins from classpath

* expected-traces-api-version-v2="beta-v2.1-rc16.2"

* update shomei plugin

* update besu-package image

* besu-package add back plugins folder to classpath

* localstack: update besu package
2025-05-21 14:39:50 +01:00
Fluent Crafter
c3eb71d8cd coordinator: update compressor binaries (#1029)
* coordinator: update compressor binaries

* coordinator: update compressor binaries

* coordinator: bump jvm compressor lib to v1.2.1

* removes unused gradle file

* coordinator: blob-shnarf update binary to have linux_arm64.so

* coordinator: bump blob-shnarf to 1.2 to have linux_arm64.so
2025-05-20 11:11:36 +01:00
Fluent Crafter
3513e62952 coordinator: add compressedSize(data) to compressor (#1009)
* coordinator: add compressedSize(data) to compressor

* coordinator: compressor java friendly

* coordinator: remove v0 binary

* coordinator: remove compressor v0 support
2025-05-19 12:09:37 +01:00
Fluent Crafter
cd49558fcf besu-package: fix dockerfile classpath (#1021)
* besu-package: fix dockerfile classpath

* besu-package: update local stack

* fid tracer version on coordinator configs beta-v2.1-rc16.1

* fid tracer version on coordinator configs beta-v2.1-rc16.1

* feat: revise workflow to trigger e2e on dockerfile change, update sed command, and update coordinator config

* feat: revert the coordinator config for l2-network-gas-pricing

* update local images

* staterecovery: synchronize latch variable

---------

Co-authored-by: jonesho <jones.ho@consensys.net>
2025-05-19 12:08:42 +01:00
jonesho
9bf4b5cd17 feat: add manual inputs to set custom expected-traces-api-version (#1016)
* feat: add manual inputs to set custom expected-traces-api-version

* feat: revise comment

* feat: revert the l1-el-node image hardcoded tag and update L1 genesis for Prague

* feat: update linea-besu-package image tag and coordinator config
2025-05-16 15:42:54 +08:00
jonesho
47a9d07d4f feat: remove switch-to-linea-besu, counter-v1, conflation-v1, file-ma… (#952)
* feat: remove switch-to-linea-besu, counter-v1, conflation-v1, file-manager related configs and their reference codes in L1DependentApp

* fix: spotless

* feat: remove traces-api-facade module

* feat: remove traces-counter-v1 from coordinator config and removed TracesFileManager, TracesRpcClientV1, TraceCounterV1WatcherClient classes

* feat: removed TracesCounterV1 and update tests

* feat: removed TracingModuleV1 and traces-limits-v1 toml files

* feat: removed TracesClientV1, TracesClientV2Adapter, and revised codes accordingly

* feat: removed FileManager in CoordinatorConfig and updated test case for assertConsecutiveBlocksRange

* feat: updated l2-node-besu docker-compose configs

* feat: rename traces-node-v2 to traces-node in all places

* feat: use prover v3 compression proofs for tests

* fix: spotless
2025-05-09 19:52:46 +08:00
jonesho
1b874b45fb feat: removed all tracing-v1 related codes from github workflow (#932)
* feat: removed all tracing-v1 related codes from github workflow

* feat: removed all tracing-v1 related codes from makefile, test files, and docker yml files

* feat: removed all old prover, geth traces node, and traces-api in docker files

* feat: removed traces-api-facade related codes from workflow

* feat: update image tag of coordinator and others
2025-05-06 01:19:33 +08:00
Fluent Crafter
f005044583 Message anchoring v2 part6 (#910)
* coordinator: order MessageSentEvent.kt params for better reading

* coordinator: fix MessageSentEvent.kt serialization

* coordinator: WIP implementation of new Web3JL2MessageServiceSmartContractClient

* coordinator: use new anchoring implementation

* coordinator: use version from maven

* coordinator: minor generics tweak

* add .java-version to gitignore

* coordinator: remove old anchoring implementation

* coordinator: move Anchoring events to common interfaces packages

* coordinator: add factory method

* coordinator: use factory method

* coordinator: clean unused method
2025-04-29 11:55:08 +01:00
Fluent Crafter
8cbfc75ffb coordinator: fix feature toggle (#874)
* coordinator: fix feature toggle

* coordinator: remove unnecessary configs
2025-04-15 14:08:13 +01:00
Fluent Crafter
4f5af620c5 staterecovery: fix 2B block gas limit (#837)
* staterecovery: fix 2B block gas limit

* staterecovery: Add better failure message for fake client

* staterecovery: update besu image

* staterecovery: udpate traces version on coordinator file

* staterecovery: add explicit timeout in test

* staterecovery: fix CLI typo
2025-04-07 09:41:41 +01:00
Fluent Crafter
811743bb5a coordinator: update Shomei frontend at LATEST finalization (#831)
* coordinators: add finalization monitor on LATEST to update shomei frontend faster.

* coordinators: fix spotless

* coordinators: adapt local configs to not try to update disabled services in docker local stack
2025-04-02 09:57:53 +01:00
Roman Vaseev
29db47d91f L2 configs improvement (#752)
* L2 configs improvement

* Removed ZkTraces config class, moved newBlockPollingInterval to l2 subconfig instead
2025-03-31 11:51:13 +02:00
kyzooghost
e861b42699 [Fix] Update smart-contract-errors.yaml with script assistance (#809)
* fix

* added more errors to smart-contract-errors.toml

* cross-check against bytecode

* remove redundant comment
2025-03-25 20:34:49 +11:00
jonesho
869c0c63d4 feat: updated linea-besu-package in local stack (#794) 2025-03-20 02:51:52 +08:00
jonesho
6aa305f500 feat: update build.gradle to org.hyperledger and linea-besu-upstream (#779)
* feat: update build.gradle to org.hyperledger and linea-besu-upstream

* feat: add org.hyperledger as included group in maven repositories url

* feat: update linea-besu-package in compose files for linea-besu-upstream with new plugin releases
2025-03-17 16:33:04 +08:00
jonesho
5c8ea31d2a feat: add support of eth_estimateGas for L1 transactions (#694)
* feat: add support of eth_estimateGas for L1 transactions

* feat: revise log message for calling eth estimate gas

* chore: update function signatures

* fix: unit test for merge conflicts

* fix: merge conflicts

* feat: use web3J async helper to encapsulate useEthEstimateGas option

* feat: remove calling eth_estimateGas in eth_call for aggregation tx and disable eth estimate gas on data submission

* feat: seperate useEthEstimateGas option for data submission and aggregation and remove calling eth_estimateGas on eth_call for data submission

* feat: add new function in LineaRollupSmartContractClient and remove unnecessary parameter

* feat: correct coordinator config and update sequencer config
2025-02-28 02:40:53 +08:00
kyzooghost
086c861f0b [Fix] Smart contract errors references (#721)
* update for smart-contract-errors.toml

* remove ref to deprecated errors in coordinator

* update bridge-ui abi
2025-02-27 20:11:02 +11:00
Pedro Novais
3caceed6f6 Staterecovery part 13 blockhash fixes (#675)
staterecovery: fix blockHash opcode and improve performance of blob fetching from L1

---------

Signed-off-by: Pedro Novais <1478752+jpnovais@users.noreply.github.com>
Co-authored-by: Roman Vaseev <4833306+Filter94@users.noreply.github.com>
2025-02-20 10:14:38 +00:00
Roman Vaseev
4af51c0193 Updating sequencer (#708)
* Updating sequencer

* Updating tracer as well

* Updating besu node as well
2025-02-19 15:43:27 +01:00
Roman Vaseev
cd7228ecdc Updating tracer plugin and traces API (#705)
* Updating tracer plugin and traces API
2025-02-18 15:41:16 +01:00
Pedro Novais
4d85082d33 Staterecovery adapt to new besu (#642)
* staterecovery: adapt to Besu 25.6-delivery46 and support forced stop sync for debug purposes
2025-02-06 10:28:03 +00:00
The Dark Jester
b1c8ec57d6 [Chore] - 498 v5 techdebt cleanup (#613)
* initial V5 removal before main coordinator adjust

* fix build issue

* default to V6 and remove V5 references

* force  Web3JLineaRollupSmartContractClientReadOnly

* fix test reference

* remove V5 references
2025-01-29 20:49:23 +00:00
Pedro Novais
fe967c703b State recover part 4 (#324)
* statereover: adds working StateRecoverApp, besu-plugin and Integration tests
---------

Signed-off-by: Pedro Novais <1478752+jpnovais@users.noreply.github.com>
Co-authored-by: jonesho <81145364+jonesho@users.noreply.github.com>
2025-01-16 10:16:39 +00:00
Pedro Novais
1ad6131079 coordinator: update traces limits-v2 (#548) 2025-01-14 16:39:02 +00:00
Pedro Novais
d37c5c09aa update besu-package (#471)
* update besu-package and Shomei to 2.3.0
2024-12-19 16:29:59 +00:00
FlorianHuc
2c8d1c6286 update linea-besu and tracer versions in e2e tests (#421)
* update linea-besu and tracer versions in e2e tests

* update sequencer plugin version in e2e tests.

---------

Co-authored-by: jonesho <81145364+jonesho@users.noreply.github.com>
2024-12-11 11:12:37 +01:00
jonesho
62f552b57d feat: update local compose file for linea-besu delivery39 and plugins (#397) 2024-12-05 17:21:56 +08:00
The Dark Jester
7b99e5ff20 [Fix] M-01 Validate final blob was submitted on finalization (#226)
* Validate final blob was submitted on finalization

* Use new error code in Coordinator

* Use correct name for error
2024-10-31 17:38:52 +01:00
Roman Vaseev
8600745120 Limiting number of concurrent traces API requests for the local stack… (#236)
* Limiting number of concurrent traces API requests for the local stack to avoid occasional OOM-s

* Limiting number of verticles for Traces API node

* Trying out Besu untuned and raising limit per endpoint to 2 for traces

* Trying out Besu untuned and raising limit per endpoint to 2 for traces and Shomei node

* Using besu untuned for arithmetization as well
2024-10-25 11:44:29 +02:00
jonesho
fad0db4fc6 3822 rejected transaction api service (#101)
* feat: first commit for transaction exclusion api service

* feat: removed debug logs and improved params error handling

* fix: jacocoRootReport error

* feat: improved json request param parsings

* feat: added docker container and github workflow pipeline for transaction exclusion api

* feat: added rejection stage in response and use txHash and rejectReason as primary key of tables

* feat: separate database into read and write config and each with dedicated connection

* fix: e2e testing error

* feat: removed redundant commands in Makefile

* feat: updated transaction exclusion api default image tag in compose file

* feat: added metric and change param name from reasonMessage to reason

* feat: added integration and unit tests and use reasonMessage for both request and response

* fix: transaction-exclusion-api unit test

* feat: added e2e tests and remove reasonMessage from get response and redundant codes

* feat: updated README.md and removed abi file

* feat: updated image version of transaction exclusion api service in compose file

* feat: updated README and added more test cases

* feat: updated transaction exclusion api default image tag in compose file

* feat: decoupled transaction exclusion api from coordinator package

* feat: removed unnecessary dependencies to prover client

* feat: moved persistence:db package to jvm-libs

* feat: removed migration file dir location config from transaction exclusion api

* fix: db migration location for fee history integration test

* changed db column name timestamp to reject_timestamp and add dto for ModuleOverflow to remove all jackson dependencies in core module

* feat: rejected transaction dao and config refactoring

* feat: removed repository service and using persistence retryer

* feat: updated transaction exclusion api default image tag in compose file

* feat: updated log and increase retry backoff delay to avoid repetitive error logs

* feat: added support of list request on save method and added dto for RejectedTransaction

* feat: revised gradle.build dependencies

* feat: switch from shadow jar to zipped jar

* feat: updated transaction exclusion api default image tag in compose file

* feat: updated sql and tables and changes for PR comments

* feat: improved log message for duplicate key error

* feat: updated transaction exclusion api default image tag in compose file

* feat: avoid redundant logs on periodic db cleanup

* feat: revised request handlers plus better test assertions on insertion

* fix: test case

* feat: parse save method json request with jackson

* feat: extracted db migrations from the coordinator and transaction-exclusion app

* feat: decoupled coordinator modules from jvm-libs persistence db test module

* feat: updated dockerfile of transaction-exclusion-api

* feat: removed the find check before metric increment on save rejected transaction

* feat: updated docker base image for tx-exclusion-api image buid and queryable window config

* feat: skip migration scripts on read db instance

* feat: updated more percise jvm-libs change filtering on transaction-exclusion-api

* feat: updated coordinator config for geth node l2 gas pricing recipients

* feat: update runners with specific version and removed the use of retry for transaction exclusion api testing

* feat: add integration test for transaction exclusion app

* feat: update local stack docker compose and workflow for transaction exclusion

* feat: add e2e test for transaction exclusion

* feat: skip the sequencer test in transaction exclusion e2e test

* feat: revert sequencer config poa-block-txs-selection-max-time

* feat: remove incorrect comment

* feat: added explicitly assertion if tx exclusion is not defined and simplify the localStackPostgresDbOnly in build.gradle

* feat: remove beforeAll in test suite with it.concurrent

* feat: set coordinator config blob-compressor-version as V1_0_1 explicitly for traces-v2

* feat: update coordinator config test

* feat: change default prefix not to be coordinator specific

* feat: place persistence:db under jvm-libs:generic and fixed conflicts from latest main

* fix: remove dependency to resolve circular dependency issue

* test: switch from localStackPostgresDbOnlyComposeUp to localStackComposeUp

* feat: replace GITHUB_SHA with github.event.pull_request.head.sha in computing commit tag

* feat: update filter change file lists for transaction exclusion api
2024-10-22 15:50:44 +08:00
The Dark Jester
017df93188 [Feat] optimize blob submission data (#209)
* smart-contract: small tweak on validation and consistent naming on params

* use currentL2BlockNumber vs. memory

* cache blobFirstBlockNumber

* optimize blob number validation

* cache snarkhash and finalStateRootHash

* remove redundant checks

* remove block numbers from blob submits

* remove extra space

* address naming considerations

* use updated ABI for V6 LineaRollup

* Use NatSpec for ITokenBridge events and errors (#202)

* Use NatSpec for ITokenBridge events and errors

* pass 1 of NatSpec cleanup

* natspec pass 2

* correct wording on NatSpec

* use correct indexed keyword location

---------

Signed-off-by: The Dark Jester <thedarkjester@users.noreply.github.com>
Co-authored-by: Pedro Novais <1478752+jpnovais@users.noreply.github.com>
2024-10-18 11:13:09 -07:00
Pedro Novais
f53e2d11d4 fix coordinator local overrides file (#199)
* fix coordinator local overrides file
* coordinator: removes broken test
2024-10-16 18:59:10 +01:00
Roman Vaseev
bdd9fb1261 Added a test for traces v2 config (#166)
* Added a test for traces v2 config
2024-10-14 17:07:51 +02:00
Roman Vaseev
d86aa9ab3a Added a separate config to support blob switch without ties to linea … (#151)
* Added a separate config to support blob switch without ties to linea besu switch

* Added a separate config to support blob switch without ties to linea besu switch
2024-10-09 13:07:10 +02:00
Roman Vaseev
ca278a0ae7 Updating tracer (#139)
* Updating tracer

* Increasing size of prover testing job

* Fixed runner for e2e tests

* Bumping postman tests runner size

* Switching back to a tag without a fixed version

---------

Signed-off-by: Roman Vaseev <4833306+Filter94@users.noreply.github.com>
2024-10-08 15:27:37 +02:00
Roman Vaseev
2db07df57f Fixing Sequencer to make it return gas price. Disabling compatibility… (#135)
* Fixing Sequencer to make it return gas price. Disabling compatibility mode for linea_estimateGas

* Fixed config test

* Removing console log
2024-10-03 16:59:55 +02:00
Roman Vaseev
aa440c4da3 Updating Sequencer plugin to accomodate linea_estimateGas fix (#112)
* Updating Sequencer plugin to accomodate linea_estimateGas fix

* Updating tracer plugin as well. Fixing Sequencer plugin configuration.
2024-10-02 22:38:14 +02:00
Pedro Novais
41cec7c602 small e2e CI tweaks (#33)
improve e2e test with dedicated liveness account

Signed-off-by: Pedro Novais <1478752+jpnovais@users.noreply.github.com>
2024-10-01 10:20:49 +01:00
Roman Vaseev
d0e97c171e Coordinator - Allowing endless retries and setting them throughout th… (#89)
* Coordinator - Allowing endless retries and setting them throughout the app
2024-09-25 12:47:37 +02:00
Roman Vaseev
b44d89c756 Tracer update (#93) 2024-09-25 11:47:23 +02:00
Victorien Gauch
961ac9b4d8 feat(3450): complete contracts recommendation (#65)
* Feat/3450 Complete contracts recommendation V2

* fix: linting issue in CoordinatorConfigTest file

---------

Co-authored-by: count-sum <andrei.alexandru@consensys.net>
Co-authored-by: thedarkjester <grant.southey@consensys.net>
2024-09-24 15:53:48 +02:00
Roman Vaseev
77f58ebb5f Updating Traces with readiness endpoint (#87)
* Updating Traces with readiness endpoint
2024-09-24 15:44:42 +02:00