github/ethereum-etl
1
1
Fork 0
mirror of https://github.com/blockchain-etl/ethereum-etl.git synced 2026-01-09 13:57:54 -05:00
Code Issues Packages Projects Releases Wiki Activity

Resolve conflicts

Browse Source
This commit is contained in:
Maxim Razhev
2022-04-28 17:41:54 +05:00
parent 817660199c 898ce3f3bf
commit d58e72974a
27 changed files with 77 additions and 37 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@@ -91,7 +91,7 @@ For the latest version, check out the repo and call
## Running in Docker
1. Install Docker: https://docs.docker.com/install/
1. Install Docker: https://docs.docker.com/get-docker/
2. Build a docker image

2
docs/dockerhub.md
View File

@@ -1,7 +1,7 @@
# Uploading to Docker Hub
```bash
ETHEREUMETL_VERSION=1.10.1
ETHEREUMETL_VERSION=1.11.0
docker build -t ethereum-etl:${ETHEREUMETL_VERSION} -f Dockerfile .
docker tag ethereum-etl:${ETHEREUMETL_VERSION} blockchainetl/ethereum-etl:${ETHEREUMETL_VERSION}
docker push blockchainetl/ethereum-etl:${ETHEREUMETL_VERSION}

8
docs/exporting-the-blockchain.md
View File

@@ -2,20 +2,20 @@
If you'd like to have blockchain data set up and hosted for you, [get in touch with us at D5](https://d5.ai/?ref=ethereumetl).
1. Install python 3.5.3+ https://www.python.org/downloads/
1. Install python 3.5.3+: [https://www.python.org/downloads/](https://www.python.org/downloads/)
1. You can use Infura if you don't need ERC20 transfers (Infura doesn't support eth_getFilterLogs JSON RPC method).
For that use `-p https://mainnet.infura.io` option for the commands below. If you need ERC20 transfers or want to
export the data ~40 times faster, you will need to set up a local Ethereum node:
1. Install geth https://github.com/ethereum/go-ethereum/wiki/Installing-Geth
1. Install geth: [https://github.com/ethereum/go-ethereum/wiki/Installing-Geth](https://github.com/ethereum/go-ethereum/wiki/Installing-Geth)
1. Start geth.
Make sure it downloaded the blocks that you need by executing `eth.syncing` in the JS console.
You can export blocks below `currentBlock`,
there is no need to wait until the full sync as the state is not needed (unless you also need contracts bytecode
and token details; for those you need to wait until the full sync). Note that you may need to wait for another day or
two for the node to download the states. See this issue https://github.com/blockchain-etl/ethereum-etl/issues/265#issuecomment-970451522.
two for the node to download the states. See this issue [https://github.com/blockchain-etl/ethereum-etl/issues/265#issuecomment-970451522](https://github.com/blockchain-etl/ethereum-etl/issues/265#issuecomment-970451522).
Make sure to set `--txlookuplimit 0` if you use geth.
1. Install Ethereum ETL: `> pip3 install ethereum-etl`
@@ -42,7 +42,7 @@ output/token_transfers/start_block=00000000/end_block=00099999/token_transfers_0
Should work with geth and parity, on Linux, Mac, Windows.
If you use Parity you should disable warp mode with `--no-warp` option because warp mode
does not place all of the block or receipt data into the database https://wiki.parity.io/Getting-Synced
does not place all of the block or receipt data into the database [https://wiki.parity.io/Getting-Synced](https://wiki.parity.io/Getting-Synced)
If you see weird behavior, e.g. wrong number of rows in the CSV files or corrupted files,
check out this issue: https://github.com/medvedev1088/ethereum-etl/issues/28

2
docs/google-bigquery.md
View File

@@ -16,4 +16,4 @@ Read [this article](https://medium.com/google-cloud/building-token-recommender-i
### Awesome BigQuery Views
https://github.com/blockchain-etl/awesome-bigquery-views
[https://github.com/blockchain-etl/awesome-bigquery-views](https://github.com/blockchain-etl/awesome-bigquery-views)

2
docs/index.md
View File

@@ -2,7 +2,7 @@
Ethereum ETL lets you convert blockchain data into convenient formats like CSVs and relational databases.
With 700+ likes on Github, Ethereum ETL is the most popular open source project for Ethereum data.
With 1,700+ likes on GitHub, Ethereum ETL is the most popular open source project for Ethereum data.
Data is available for you to query right away in [Google BigQuery](https://goo.gl/oY5BCQ).

2
ethereumetl/cli/__init__.py
View File

@@ -48,7 +48,7 @@ from ethereumetl.cli.stream import stream
@click.group()
@click.version_option(version='1.10.1')
@click.version_option(version='1.11.0')
@click.pass_context
def cli(ctx):
pass

7
ethereumetl/cli/stream.py
View File

@@ -58,7 +58,6 @@ def stream(last_synced_block_file, lag, provider_uri, output, start_block, entit
configure_logging(log_file)
configure_signals()
entity_types = parse_entity_types(entity_types)
validate_entity_types(entity_types, output)
from ethereumetl.streaming.eth_streamer_adapter import EthStreamerAdapter
from blockchainetl.streaming.streamer import Streamer
@@ -99,12 +98,6 @@ def parse_entity_types(entity_types):
return entity_types
def validate_entity_types(entity_types, output):
if output is not None and 'postgres' in output \
and (EntityType.CONTRACT in entity_types or EntityType.TOKEN in entity_types):
raise ValueError('contract and token are not yet supported entity types for postgres item exporter.')
def pick_random_provider_uri(provider_uri):
provider_uris = [uri.strip() for uri in provider_uri.split(',')]
return random.choice(provider_uris)

4
ethereumetl/streaming/item_exporter_creator.py
View File

@@ -57,7 +57,7 @@ def create_item_exporter(output):
from blockchainetl.jobs.exporters.converters.unix_timestamp_item_converter import UnixTimestampItemConverter
from blockchainetl.jobs.exporters.converters.int_to_decimal_item_converter import IntToDecimalItemConverter
from blockchainetl.jobs.exporters.converters.list_field_item_converter import ListFieldItemConverter
from ethereumetl.streaming.postgres_tables import BLOCKS, TRANSACTIONS, LOGS, TOKEN_TRANSFERS, TRACES
from ethereumetl.streaming.postgres_tables import BLOCKS, TRANSACTIONS, LOGS, TOKEN_TRANSFERS, TRACES, TOKENS, CONTRACTS
item_exporter = PostgresItemExporter(
output, item_type_to_insert_stmt_mapping={
@@ -66,6 +66,8 @@ def create_item_exporter(output):
'log': create_insert_statement_for_table(LOGS),
'token_transfer': create_insert_statement_for_table(TOKEN_TRANSFERS),
'trace': create_insert_statement_for_table(TRACES),
'token': create_insert_statement_for_table(TOKENS),
'contract': create_insert_statement_for_table(CONTRACTS),
},
converters=[UnixTimestampItemConverter(), IntToDecimalItemConverter(),
ListFieldItemConverter('topics', 'topic', fill=4)])

25
ethereumetl/streaming/postgres_tables.py
View File

@@ -20,7 +20,9 @@
# OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
# SOFTWARE.
from sqlalchemy import Table, Column, Integer, BigInteger, String, Numeric, MetaData, TIMESTAMP
from sqlalchemy import Table, Column, Integer, BigInteger, Boolean, String, Numeric, \
MetaData, PrimaryKeyConstraint, VARCHAR, TIMESTAMP
from sqlalchemy.dialects.postgresql import ARRAY
metadata = MetaData()
@@ -127,4 +129,25 @@ TRACES = Table(
Column('trace_id', String, primary_key=True),
)
TOKENS = Table(
'tokens', metadata,
Column('address', VARCHAR(42)),
Column('name', String),
Column('symbol', String),
Column('decimals', Integer),
Column('function_sighashes', ARRAY(String)),
Column('total_supply', Numeric(78)),
Column('block_number', BigInteger),
PrimaryKeyConstraint('address', 'block_number', name='tokens_pk'),
)
CONTRACTS = Table(
'contracts', metadata,
Column('address', VARCHAR(42)),
Column('bytecode', String),
Column('function_sighashes', ARRAY(String)),
Column('is_erc20', Boolean),
Column('is_erc721', Boolean),
Column('block_number', BigInteger),
PrimaryKeyConstraint('address', 'block_number', name='contracts_pk'),
)

1
mkdocs.yml
View File

@@ -16,3 +16,4 @@ nav:
- Citing: citing.md
theme: readthedocs
repo_url: https://github.com/blockchain-etl/ethereum-etl/
edit_uri: edit/develop/docs

2
setup.py
View File

@@ -48,7 +48,7 @@ setup(
'google-cloud-pubsub==2.1.0',
'google-cloud-storage==1.33.0',
'kafka-python==2.0.2',
'sqlalchemy==1.3.13',
'sqlalchemy==1.4',
'pg8000==1.13.2',
# This library is a dependency for google-cloud-pubsub, starting from 0.3.22 it requires Rust,
# that's why we lock the version here

8
tests/resources/test_export_blocks_job/block_with_logs/expected_transactions.csv
View File

@@ -1,5 +1,5 @@
hash,nonce,block_hash,block_number,transaction_index,from_address,to_address,value,gas,gas_price,input,block_timestamp,max_fee_per_gas,max_priority_fee_per_gas,transaction_type
0x04cbcb236043d8fb7839e07bbc7f5eed692fb2ca55d897f1101eac3e3ad4fab8,12,0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae,483920,0,0x1b63142628311395ceafeea5667e7c9026c862ca,0xf4eced2f682ce333f96f2d8966c613ded8fc95dd,0,150853,50000000000,0xa9059cbb000000000000000000000000ac4df82fe37ea2187bc8c011a23d743b4f39019a00000000000000000000000000000000000000000000000000000000000186a0,1446561880,,,
0xcea6f89720cc1d2f46cc7a935463ae0b99dd5fad9c91bb7357de5421511cee49,84,0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae,483920,1,0x9b22a80d5c7b3374a05b446081f97d0a34079e7f,0xf4eced2f682ce333f96f2d8966c613ded8fc95dd,0,150853,50000000000,0xa9059cbb00000000000000000000000066f183060253cfbe45beff1e6e7ebbe318c81e560000000000000000000000000000000000000000000000000000000000030d40,1446561880,,,
0x463d53f0ad57677a3b430a007c1c31d15d62c37fab5eee598551697c297c235c,88,0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae,483920,2,0x9df428a91ff0f3635c8f0ce752933b9788926804,0x9e669f970ec0f49bb735f20799a7e7c4a1c274e2,11000440000000000,90000,50000000000,0x,1446561880,,,
0x05287a561f218418892ab053adfb3d919860988b19458c570c5c30f51c146f02,20085,0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae,483920,3,0x2a65aca4d5fc5b5c859090a6c34d164135398226,0x743b8aeedc163c0e3a0fe9f3910d146c48e70da8,1530219620000000000,90000,50000000000,0x,1446561880,,,
0x04cbcb236043d8fb7839e07bbc7f5eed692fb2ca55d897f1101eac3e3ad4fab8,12,0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae,483920,0,0x1b63142628311395ceafeea5667e7c9026c862ca,0xf4eced2f682ce333f96f2d8966c613ded8fc95dd,0,150853,50000000000,0xa9059cbb000000000000000000000000ac4df82fe37ea2187bc8c011a23d743b4f39019a00000000000000000000000000000000000000000000000000000000000186a0,1446561880,,,0
0xcea6f89720cc1d2f46cc7a935463ae0b99dd5fad9c91bb7357de5421511cee49,84,0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae,483920,1,0x9b22a80d5c7b3374a05b446081f97d0a34079e7f,0xf4eced2f682ce333f96f2d8966c613ded8fc95dd,0,150853,50000000000,0xa9059cbb00000000000000000000000066f183060253cfbe45beff1e6e7ebbe318c81e560000000000000000000000000000000000000000000000000000000000030d40,1446561880,,,0
0x463d53f0ad57677a3b430a007c1c31d15d62c37fab5eee598551697c297c235c,88,0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae,483920,2,0x9df428a91ff0f3635c8f0ce752933b9788926804,0x9e669f970ec0f49bb735f20799a7e7c4a1c274e2,11000440000000000,90000,50000000000,0x,1446561880,,,0
0x05287a561f218418892ab053adfb3d919860988b19458c570c5c30f51c146f02,20085,0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae,483920,3,0x2a65aca4d5fc5b5c859090a6c34d164135398226,0x743b8aeedc163c0e3a0fe9f3910d146c48e70da8,1530219620000000000,90000,50000000000,0x,1446561880,,,0
1 hash nonce block_hash block_number transaction_index from_address to_address value gas gas_price input block_timestamp max_fee_per_gas max_priority_fee_per_gas transaction_type
2 0x04cbcb236043d8fb7839e07bbc7f5eed692fb2ca55d897f1101eac3e3ad4fab8 12 0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae 483920 0 0x1b63142628311395ceafeea5667e7c9026c862ca 0xf4eced2f682ce333f96f2d8966c613ded8fc95dd 0 150853 50000000000 0xa9059cbb000000000000000000000000ac4df82fe37ea2187bc8c011a23d743b4f39019a00000000000000000000000000000000000000000000000000000000000186a0 1446561880 0
3 0xcea6f89720cc1d2f46cc7a935463ae0b99dd5fad9c91bb7357de5421511cee49 84 0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae 483920 1 0x9b22a80d5c7b3374a05b446081f97d0a34079e7f 0xf4eced2f682ce333f96f2d8966c613ded8fc95dd 0 150853 50000000000 0xa9059cbb00000000000000000000000066f183060253cfbe45beff1e6e7ebbe318c81e560000000000000000000000000000000000000000000000000000000000030d40 1446561880 0
4 0x463d53f0ad57677a3b430a007c1c31d15d62c37fab5eee598551697c297c235c 88 0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae 483920 2 0x9df428a91ff0f3635c8f0ce752933b9788926804 0x9e669f970ec0f49bb735f20799a7e7c4a1c274e2 11000440000000000 90000 50000000000 0x 1446561880 0
5 0x05287a561f218418892ab053adfb3d919860988b19458c570c5c30f51c146f02 20085 0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae 483920 3 0x2a65aca4d5fc5b5c859090a6c34d164135398226 0x743b8aeedc163c0e3a0fe9f3910d146c48e70da8 1530219620000000000 90000 50000000000 0x 1446561880 0

4
tests/resources/test_export_blocks_job/block_with_logs/web3_response.eth_getBlockByNumber_0x76250_true.json
View File

@@ -43,6 +43,7 @@
"standardV": "0x0",
"to": "0xf4eced2f682ce333f96f2d8966c613ded8fc95dd",
"transactionIndex": "0x0",
"type": "0x0",
"v": "0x1b",
"value": "0x0"
},
@@ -65,6 +66,7 @@
"standardV": "0x1",
"to": "0xf4eced2f682ce333f96f2d8966c613ded8fc95dd",
"transactionIndex": "0x1",
"type": "0x0",
"v": "0x1c",
"value": "0x0"
},
@@ -87,6 +89,7 @@
"standardV": "0x1",
"to": "0x9e669f970ec0f49bb735f20799a7e7c4a1c274e2",
"transactionIndex": "0x2",
"type": "0x0",
"v": "0x1c",
"value": "0x2714d78692b000"
},
@@ -109,6 +112,7 @@
"standardV": "0x0",
"to": "0x743b8aeedc163c0e3a0fe9f3910d146c48e70da8",
"transactionIndex": "0x3",
"type": "0x0",
"v": "0x1b",
"value": "0x153c6ea30e6ee800"
}

8
tests/resources/test_export_blocks_job/blocks_with_transactions/expected_transactions.csv
View File

@@ -1,5 +1,5 @@
hash,nonce,block_hash,block_number,transaction_index,from_address,to_address,value,gas,gas_price,input,block_timestamp,max_fee_per_gas,max_priority_fee_per_gas,transaction_type
0x99f1097abd8f33a68f0ed63d60de5f3e7e2a3e0579b90d5f46a4f201c658b46d,9,0x889c421abc62a48641eee140519e6da8c9dc01d85d8f5c4fbc3c13e3c6e4cb3e,47218,0,0x1406854d149e081ac09cb4ca560da463f3123059,0xa0e74ae010d51894734c308d612131056bb721ad,110000000000000000000,40000,62227241854,0x,1438936285,,,
0x95844e6c54b4aafc8e1f75784127529280e75c3a980d91f6dfca1c1b0eb078fb,78,0x889c421abc62a48641eee140519e6da8c9dc01d85d8f5c4fbc3c13e3c6e4cb3e,47218,1,0xe6a7a1d47ff21b6321162aea7c6cb457d5476bca,0xee80ef3c49d9465c7fc2b3d7373fdbbbc3fe282f,8140416390630760000,21000,62222792381,0x,1438936285,,,
0xbd5ab8937e52a6244209d804471be4878df6c364bca0111dd6d05e0d3edf63cf,79,0x944f09177142833c644c979a83900d8cae1ee67369774b88b3b330bb72825082,47219,0,0xe6a7a1d47ff21b6321162aea7c6cb457d5476bca,0xe25e3a1947405a1f82dd8e3048a9ca471dc782e1,8306052477120672000,21000,61580653163,0x,1438936326,,,
0x4bcc1dd0c56c0b767b1ee3cb8bce7df44518f1696205299e34eb53a5e00a863e,1,0x944f09177142833c644c979a83900d8cae1ee67369774b88b3b330bb72825082,47219,1,0xf9a19aea1193d9b9e4ef2f5b8c9ec8df93a22356,0x32be343b94f860124dc4fee278fdcbd38c102d88,1998716170000000000,21000,61134768794,0x,1438936326,,,
0x99f1097abd8f33a68f0ed63d60de5f3e7e2a3e0579b90d5f46a4f201c658b46d,9,0x889c421abc62a48641eee140519e6da8c9dc01d85d8f5c4fbc3c13e3c6e4cb3e,47218,0,0x1406854d149e081ac09cb4ca560da463f3123059,0xa0e74ae010d51894734c308d612131056bb721ad,110000000000000000000,40000,62227241854,0x,1438936285,,,0
0x95844e6c54b4aafc8e1f75784127529280e75c3a980d91f6dfca1c1b0eb078fb,78,0x889c421abc62a48641eee140519e6da8c9dc01d85d8f5c4fbc3c13e3c6e4cb3e,47218,1,0xe6a7a1d47ff21b6321162aea7c6cb457d5476bca,0xee80ef3c49d9465c7fc2b3d7373fdbbbc3fe282f,8140416390630760000,21000,62222792381,0x,1438936285,,,0
0xbd5ab8937e52a6244209d804471be4878df6c364bca0111dd6d05e0d3edf63cf,79,0x944f09177142833c644c979a83900d8cae1ee67369774b88b3b330bb72825082,47219,0,0xe6a7a1d47ff21b6321162aea7c6cb457d5476bca,0xe25e3a1947405a1f82dd8e3048a9ca471dc782e1,8306052477120672000,21000,61580653163,0x,1438936326,,,0
0x4bcc1dd0c56c0b767b1ee3cb8bce7df44518f1696205299e34eb53a5e00a863e,1,0x944f09177142833c644c979a83900d8cae1ee67369774b88b3b330bb72825082,47219,1,0xf9a19aea1193d9b9e4ef2f5b8c9ec8df93a22356,0x32be343b94f860124dc4fee278fdcbd38c102d88,1998716170000000000,21000,61134768794,0x,1438936326,,,0
1 hash nonce block_hash block_number transaction_index from_address to_address value gas gas_price input block_timestamp max_fee_per_gas max_priority_fee_per_gas transaction_type
2 0x99f1097abd8f33a68f0ed63d60de5f3e7e2a3e0579b90d5f46a4f201c658b46d 9 0x889c421abc62a48641eee140519e6da8c9dc01d85d8f5c4fbc3c13e3c6e4cb3e 47218 0 0x1406854d149e081ac09cb4ca560da463f3123059 0xa0e74ae010d51894734c308d612131056bb721ad 110000000000000000000 40000 62227241854 0x 1438936285 0
3 0x95844e6c54b4aafc8e1f75784127529280e75c3a980d91f6dfca1c1b0eb078fb 78 0x889c421abc62a48641eee140519e6da8c9dc01d85d8f5c4fbc3c13e3c6e4cb3e 47218 1 0xe6a7a1d47ff21b6321162aea7c6cb457d5476bca 0xee80ef3c49d9465c7fc2b3d7373fdbbbc3fe282f 8140416390630760000 21000 62222792381 0x 1438936285 0
4 0xbd5ab8937e52a6244209d804471be4878df6c364bca0111dd6d05e0d3edf63cf 79 0x944f09177142833c644c979a83900d8cae1ee67369774b88b3b330bb72825082 47219 0 0xe6a7a1d47ff21b6321162aea7c6cb457d5476bca 0xe25e3a1947405a1f82dd8e3048a9ca471dc782e1 8306052477120672000 21000 61580653163 0x 1438936326 0
5 0x4bcc1dd0c56c0b767b1ee3cb8bce7df44518f1696205299e34eb53a5e00a863e 1 0x944f09177142833c644c979a83900d8cae1ee67369774b88b3b330bb72825082 47219 1 0xf9a19aea1193d9b9e4ef2f5b8c9ec8df93a22356 0x32be343b94f860124dc4fee278fdcbd38c102d88 1998716170000000000 21000 61134768794 0x 1438936326 0

2
tests/resources/test_export_blocks_job/blocks_with_transactions/web3_response.eth_getBlockByNumber_0xb872_true.json
View File

@@ -43,6 +43,7 @@
"standardV": "0x0",
"to": "0xa0e74ae010d51894734c308d612131056bb721ad",
"transactionIndex": "0x0",
"type": "0x0",
"v": "0x1b",
"value": "0x5f68e8131ecf80000"
},
@@ -65,6 +66,7 @@
"standardV": "0x1",
"to": "0xee80ef3c49d9465c7fc2b3d7373fdbbbc3fe282f",
"transactionIndex": "0x1",
"type": "0x0",
"v": "0x1c",
"value": "0x70f89193d7505e40"
}

2
tests/resources/test_export_blocks_job/blocks_with_transactions/web3_response.eth_getBlockByNumber_0xb873_true.json
View File

@@ -43,6 +43,7 @@
"standardV": "0x1",
"to": "0xe25e3a1947405a1f82dd8e3048a9ca471dc782e1",
"transactionIndex": "0x0",
"type": "0x0",
"v": "0x1c",
"value": "0x734506b87887f100"
},
@@ -65,6 +66,7 @@
"standardV": "0x1",
"to": "0x32be343b94f860124dc4fee278fdcbd38c102d88",
"transactionIndex": "0x1",
"type": "0x0",
"v": "0x1c",
"value": "0x1bbcddc457ade400"
}

8
tests/resources/test_export_receipts_job/receipts_with_logs/expected_receipts.csv
View File

@@ -1,5 +1,5 @@
transaction_hash,transaction_index,block_hash,block_number,cumulative_gas_used,gas_used,contract_address,root,status,effective_gas_price
0x463d53f0ad57677a3b430a007c1c31d15d62c37fab5eee598551697c297c235c,2,0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae,483920,122706,21000,,0x2f98549737594bf832213696d954cc1ee5ccbb1349f63e3983ea3d1b494180eb,,
0x05287a561f218418892ab053adfb3d919860988b19458c570c5c30f51c146f02,3,0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae,483920,143706,21000,,0x4ab93bd0e8d40aaa3668404162449a76fa671a1cde7da668cccab99359924d2f,,
0x04cbcb236043d8fb7839e07bbc7f5eed692fb2ca55d897f1101eac3e3ad4fab8,0,0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae,483920,50853,50853,,0x2ec017656e20275e92cbd1cdee9aeb43c1a090a5e217797da7c58dbf5be50e5b,,
0xcea6f89720cc1d2f46cc7a935463ae0b99dd5fad9c91bb7357de5421511cee49,1,0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae,483920,101706,50853,,0xf7c67a3c8bc02b2c581b66f2bdf589a2a7ae9fccb2bf2ca3345b15cdcec6aefa,,
0x463d53f0ad57677a3b430a007c1c31d15d62c37fab5eee598551697c297c235c,2,0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae,483920,122706,21000,,0x2f98549737594bf832213696d954cc1ee5ccbb1349f63e3983ea3d1b494180eb,,50000000000
0x05287a561f218418892ab053adfb3d919860988b19458c570c5c30f51c146f02,3,0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae,483920,143706,21000,,0x4ab93bd0e8d40aaa3668404162449a76fa671a1cde7da668cccab99359924d2f,,50000000000
0x04cbcb236043d8fb7839e07bbc7f5eed692fb2ca55d897f1101eac3e3ad4fab8,0,0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae,483920,50853,50853,,0x2ec017656e20275e92cbd1cdee9aeb43c1a090a5e217797da7c58dbf5be50e5b,,50000000000
0xcea6f89720cc1d2f46cc7a935463ae0b99dd5fad9c91bb7357de5421511cee49,1,0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae,483920,101706,50853,,0xf7c67a3c8bc02b2c581b66f2bdf589a2a7ae9fccb2bf2ca3345b15cdcec6aefa,,50000000000
1 transaction_hash transaction_index block_hash block_number cumulative_gas_used gas_used contract_address root status effective_gas_price
2 0x463d53f0ad57677a3b430a007c1c31d15d62c37fab5eee598551697c297c235c 2 0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae 483920 122706 21000 0x2f98549737594bf832213696d954cc1ee5ccbb1349f63e3983ea3d1b494180eb 50000000000
3 0x05287a561f218418892ab053adfb3d919860988b19458c570c5c30f51c146f02 3 0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae 483920 143706 21000 0x4ab93bd0e8d40aaa3668404162449a76fa671a1cde7da668cccab99359924d2f 50000000000
4 0x04cbcb236043d8fb7839e07bbc7f5eed692fb2ca55d897f1101eac3e3ad4fab8 0 0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae 483920 50853 50853 0x2ec017656e20275e92cbd1cdee9aeb43c1a090a5e217797da7c58dbf5be50e5b 50000000000
5 0xcea6f89720cc1d2f46cc7a935463ae0b99dd5fad9c91bb7357de5421511cee49 1 0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae 483920 101706 50853 0xf7c67a3c8bc02b2c581b66f2bdf589a2a7ae9fccb2bf2ca3345b15cdcec6aefa 50000000000

8
tests/resources/test_export_receipts_job/receipts_with_logs/expected_receipts.json
View File

@@ -1,4 +1,4 @@
{"transaction_hash": "0x05287a561f218418892ab053adfb3d919860988b19458c570c5c30f51c146f02", "transaction_index": 3, "block_hash": "0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae", "block_number": 483920, "cumulative_gas_used": 143706, "gas_used": 21000, "contract_address": null, "root": "0x4ab93bd0e8d40aaa3668404162449a76fa671a1cde7da668cccab99359924d2f", "status": null, "effective_gas_price": null}
{"transaction_hash": "0xcea6f89720cc1d2f46cc7a935463ae0b99dd5fad9c91bb7357de5421511cee49", "transaction_index": 1, "block_hash": "0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae", "block_number": 483920, "cumulative_gas_used": 101706, "gas_used": 50853, "contract_address": null, "root": "0xf7c67a3c8bc02b2c581b66f2bdf589a2a7ae9fccb2bf2ca3345b15cdcec6aefa", "status": null, "effective_gas_price": null}
{"transaction_hash": "0x04cbcb236043d8fb7839e07bbc7f5eed692fb2ca55d897f1101eac3e3ad4fab8", "transaction_index": 0, "block_hash": "0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae", "block_number": 483920, "cumulative_gas_used": 50853, "gas_used": 50853, "contract_address": null, "root": "0x2ec017656e20275e92cbd1cdee9aeb43c1a090a5e217797da7c58dbf5be50e5b", "status": null, "effective_gas_price": null}
{"transaction_hash": "0x463d53f0ad57677a3b430a007c1c31d15d62c37fab5eee598551697c297c235c", "transaction_index": 2, "block_hash": "0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae", "block_number": 483920, "cumulative_gas_used": 122706, "gas_used": 21000, "contract_address": null, "root": "0x2f98549737594bf832213696d954cc1ee5ccbb1349f63e3983ea3d1b494180eb", "status": null, "effective_gas_price": null}
{"transaction_hash": "0x05287a561f218418892ab053adfb3d919860988b19458c570c5c30f51c146f02", "transaction_index": 3, "block_hash": "0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae", "block_number": 483920, "cumulative_gas_used": 143706, "gas_used": 21000, "contract_address": null, "root": "0x4ab93bd0e8d40aaa3668404162449a76fa671a1cde7da668cccab99359924d2f", "status": null, "effective_gas_price": 50000000000}
{"transaction_hash": "0xcea6f89720cc1d2f46cc7a935463ae0b99dd5fad9c91bb7357de5421511cee49", "transaction_index": 1, "block_hash": "0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae", "block_number": 483920, "cumulative_gas_used": 101706, "gas_used": 50853, "contract_address": null, "root": "0xf7c67a3c8bc02b2c581b66f2bdf589a2a7ae9fccb2bf2ca3345b15cdcec6aefa", "status": null, "effective_gas_price": 50000000000}
{"transaction_hash": "0x04cbcb236043d8fb7839e07bbc7f5eed692fb2ca55d897f1101eac3e3ad4fab8", "transaction_index": 0, "block_hash": "0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae", "block_number": 483920, "cumulative_gas_used": 50853, "gas_used": 50853, "contract_address": null, "root": "0x2ec017656e20275e92cbd1cdee9aeb43c1a090a5e217797da7c58dbf5be50e5b", "status": null, "effective_gas_price": 50000000000}
{"transaction_hash": "0x463d53f0ad57677a3b430a007c1c31d15d62c37fab5eee598551697c297c235c", "transaction_index": 2, "block_hash": "0x246edb4b351d93c27926f4649bcf6c24366e2a7c7c718dc9158eea20c03bc6ae", "block_number": 483920, "cumulative_gas_used": 122706, "gas_used": 21000, "contract_address": null, "root": "0x2f98549737594bf832213696d954cc1ee5ccbb1349f63e3983ea3d1b494180eb", "status": null, "effective_gas_price": 50000000000}

1
tests/resources/test_export_receipts_job/receipts_with_logs/web3_response.eth_getTransactionReceipt_0x04cbcb236043d8fb7839e07bbc7f5eed692fb2ca55d897f1101eac3e3ad4fab8.json
View File

@@ -5,6 +5,7 @@
"blockNumber": "0x76250",
"contractAddress": null,
"cumulativeGasUsed": "0xc6a5",
"effectiveGasPrice": "0xba43b7400",
"gasUsed": "0xc6a5",
"logs": [
{

1
tests/resources/test_export_receipts_job/receipts_with_logs/web3_response.eth_getTransactionReceipt_0x05287a561f218418892ab053adfb3d919860988b19458c570c5c30f51c146f02.json
View File

@@ -5,6 +5,7 @@
"blockNumber": "0x76250",
"contractAddress": null,
"cumulativeGasUsed": "0x2315a",
"effectiveGasPrice": "0xba43b7400",
"gasUsed": "0x5208",
"logs": [],
"logsBloom": "0x00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000",

1
tests/resources/test_export_receipts_job/receipts_with_logs/web3_response.eth_getTransactionReceipt_0x463d53f0ad57677a3b430a007c1c31d15d62c37fab5eee598551697c297c235c.json
View File

@@ -5,6 +5,7 @@
"blockNumber": "0x76250",
"contractAddress": null,
"cumulativeGasUsed": "0x1df52",
"effectiveGasPrice": "0xba43b7400",
"gasUsed": "0x5208",
"logs": [],
"logsBloom": "0x00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000",

1
tests/resources/test_export_receipts_job/receipts_with_logs/web3_response.eth_getTransactionReceipt_0xcea6f89720cc1d2f46cc7a935463ae0b99dd5fad9c91bb7357de5421511cee49.json
View File

@@ -5,6 +5,7 @@
"blockNumber": "0x76250",
"contractAddress": null,
"cumulativeGasUsed": "0x18d4a",
"effectiveGasPrice": "0xba43b7400",
"gasUsed": "0xc6a5",
"logs": [
{

4
tests/resources/test_stream/blocks_1755634_1755635/expected_transactions.json
View File

@@ -1,2 +1,2 @@
{"type": "transaction", "hash": "0x2e3dcd051a91d3a694f6b8de2ac4b5fe7acdba55f58bcf8471ff00d4a430074d", "nonce": 34160, "transaction_index": 0, "from_address": "0xed059bc543141c8c93031d545079b3da0233b27f", "to_address": "0x8b3b3b624c3c0397d3da8fd861512393d51dcbac", "value": 0, "gas": 250000, "gas_price": 20000000000, "input": "0x7edae70f0000000000000000000000006498077292a0921c8804924fdf47b5e91e2a215f", "block_timestamp": 1466669562, "block_number": 1755635, "block_hash": "0x1dec87ec1ba8e65b7773bb6f62249468948a28a427efd3d896a2ff7d7c591a67", "max_fee_per_gas": null, "max_priority_fee_per_gas": null, "transaction_type": null, "receipt_cumulative_gas_used": 36418, "receipt_gas_used": 36418, "receipt_contract_address": null, "receipt_root": "0x4db3f06ff4e7283ab1187045ca78f4bd713b0737640180377b4d4a2e9a80c235", "receipt_status": null, "receipt_effective_gas_price": null, "item_id": "transaction_0x2e3dcd051a91d3a694f6b8de2ac4b5fe7acdba55f58bcf8471ff00d4a430074d", "item_timestamp": "2016-06-23T08:12:42Z"}
{"type": "transaction", "hash": "0x9a5437ec71b74ecf5930b406908ac6999966d38a86d1534b7190ece7599095eb", "nonce": 3745, "transaction_index": 1, "from_address": "0x3763e6e1228bfeab94191c856412d1bb0a8e6996", "to_address": "0xec1ebac9da3430213281c80fa6d46378341a96ae", "value": 405738107000000000, "gas": 90000, "gas_price": 20000000000, "input": "0x", "block_timestamp": 1466669562, "block_number": 1755635, "block_hash": "0x1dec87ec1ba8e65b7773bb6f62249468948a28a427efd3d896a2ff7d7c591a67", "max_fee_per_gas": null, "max_priority_fee_per_gas": null, "transaction_type": null, "receipt_cumulative_gas_used": 57418, "receipt_gas_used": 21000, "receipt_contract_address": null, "receipt_root": "0x379f143510d5703cf162e37e61d906341b4a6acf4f339d422c656000ccd5898f", "receipt_status": null, "receipt_effective_gas_price": null, "item_id": "transaction_0x9a5437ec71b74ecf5930b406908ac6999966d38a86d1534b7190ece7599095eb", "item_timestamp": "2016-06-23T08:12:42Z"}
{"type": "transaction", "hash": "0x2e3dcd051a91d3a694f6b8de2ac4b5fe7acdba55f58bcf8471ff00d4a430074d", "nonce": 34160, "transaction_index": 0, "from_address": "0xed059bc543141c8c93031d545079b3da0233b27f", "to_address": "0x8b3b3b624c3c0397d3da8fd861512393d51dcbac", "value": 0, "gas": 250000, "gas_price": 20000000000, "input": "0x7edae70f0000000000000000000000006498077292a0921c8804924fdf47b5e91e2a215f", "block_timestamp": 1466669562, "block_number": 1755635, "block_hash": "0x1dec87ec1ba8e65b7773bb6f62249468948a28a427efd3d896a2ff7d7c591a67", "max_fee_per_gas": null, "max_priority_fee_per_gas": null, "transaction_type": 0, "receipt_cumulative_gas_used": 36418, "receipt_gas_used": 36418, "receipt_contract_address": null, "receipt_root": "0x4db3f06ff4e7283ab1187045ca78f4bd713b0737640180377b4d4a2e9a80c235", "receipt_status": null, "receipt_effective_gas_price": 20000000000, "item_id": "transaction_0x2e3dcd051a91d3a694f6b8de2ac4b5fe7acdba55f58bcf8471ff00d4a430074d", "item_timestamp": "2016-06-23T08:12:42Z"}
{"type": "transaction", "hash": "0x9a5437ec71b74ecf5930b406908ac6999966d38a86d1534b7190ece7599095eb", "nonce": 3745, "transaction_index": 1, "from_address": "0x3763e6e1228bfeab94191c856412d1bb0a8e6996", "to_address": "0xec1ebac9da3430213281c80fa6d46378341a96ae", "value": 405738107000000000, "gas": 90000, "gas_price": 20000000000, "input": "0x", "block_timestamp": 1466669562, "block_number": 1755635, "block_hash": "0x1dec87ec1ba8e65b7773bb6f62249468948a28a427efd3d896a2ff7d7c591a67", "max_fee_per_gas": null, "max_priority_fee_per_gas": null, "transaction_type": 0, "receipt_cumulative_gas_used": 57418, "receipt_gas_used": 21000, "receipt_contract_address": null, "receipt_root": "0x379f143510d5703cf162e37e61d906341b4a6acf4f339d422c656000ccd5898f", "receipt_status": null, "receipt_effective_gas_price": 20000000000, "item_id": "transaction_0x9a5437ec71b74ecf5930b406908ac6999966d38a86d1534b7190ece7599095eb", "item_timestamp": "2016-06-23T08:12:42Z"}

2
tests/resources/test_stream/blocks_1755634_1755635/web3_response.eth_getBlockByNumber_0x1ac9f3_true.json
View File

@@ -33,6 +33,7 @@
"s": "0x3d3f4367d6906993f9b2f2e54741cc3e86356cfb81085c3ff656b82a79d87153",
"to": "0x8b3b3b624c3c0397d3da8fd861512393d51dcbac",
"transactionIndex": "0x0",
"type": "0x0",
"v": "0x1b",
"value": "0x0"
},
@@ -49,6 +50,7 @@
"s": "0x5f17d3dd1010dd6fd13a1300e9a4fca00d900670cdaeabbeec75a904506b404e",
"to": "0xec1ebac9da3430213281c80fa6d46378341a96ae",
"transactionIndex": "0x1",
"type": "0x0",
"v": "0x1b",
"value": "0x5a178a89b930e00"
}

1
tests/resources/test_stream/blocks_1755634_1755635/web3_response.eth_getTransactionReceipt_0x2e3dcd051a91d3a694f6b8de2ac4b5fe7acdba55f58bcf8471ff00d4a430074d.json
View File

@@ -6,6 +6,7 @@
"blockNumber": "0x1ac9f3",
"contractAddress": null,
"cumulativeGasUsed": "0x8e42",
"effectiveGasPrice": "0x4a817c800",
"from": "0xed059bc543141c8c93031d545079b3da0233b27f",
"gasUsed": "0x8e42",
"logs": [

1
tests/resources/test_stream/blocks_1755634_1755635/web3_response.eth_getTransactionReceipt_0x9a5437ec71b74ecf5930b406908ac6999966d38a86d1534b7190ece7599095eb.json
View File

@@ -6,6 +6,7 @@
"blockNumber": "0x1ac9f3",
"contractAddress": null,
"cumulativeGasUsed": "0xe04a",
"effectiveGasPrice": "0x4a817c800",
"from": "0x3763e6e1228bfeab94191c856412d1bb0a8e6996",
"gasUsed": "0x5208",
"logs": [],

5
txs.csv Normal file
View File

@@ -0,0 +1,5 @@
hash,nonce,block_hash,block_number,transaction_index,from_address,to_address,value,gas,gas_price,input,block_timestamp,max_fee_per_gas,max_priority_fee_per_gas,transaction_type
0x99f1097abd8f33a68f0ed63d60de5f3e7e2a3e0579b90d5f46a4f201c658b46d,9,0x889c421abc62a48641eee140519e6da8c9dc01d85d8f5c4fbc3c13e3c6e4cb3e,47218,0,0x1406854d149e081ac09cb4ca560da463f3123059,0xa0e74ae010d51894734c308d612131056bb721ad,110000000000000000000,40000,62227241854,0x,1438936285,,,0
0x95844e6c54b4aafc8e1f75784127529280e75c3a980d91f6dfca1c1b0eb078fb,78,0x889c421abc62a48641eee140519e6da8c9dc01d85d8f5c4fbc3c13e3c6e4cb3e,47218,1,0xe6a7a1d47ff21b6321162aea7c6cb457d5476bca,0xee80ef3c49d9465c7fc2b3d7373fdbbbc3fe282f,8140416390630760000,21000,62222792381,0x,1438936285,,,0
0xbd5ab8937e52a6244209d804471be4878df6c364bca0111dd6d05e0d3edf63cf,79,0x944f09177142833c644c979a83900d8cae1ee67369774b88b3b330bb72825082,47219,0,0xe6a7a1d47ff21b6321162aea7c6cb457d5476bca,0xe25e3a1947405a1f82dd8e3048a9ca471dc782e1,8306052477120672000,21000,61580653163,0x,1438936326,,,0
0x4bcc1dd0c56c0b767b1ee3cb8bce7df44518f1696205299e34eb53a5e00a863e,1,0x944f09177142833c644c979a83900d8cae1ee67369774b88b3b330bb72825082,47219,1,0xf9a19aea1193d9b9e4ef2f5b8c9ec8df93a22356,0x32be343b94f860124dc4fee278fdcbd38c102d88,1998716170000000000,21000,61134768794,0x,1438936326,,,0
1 hash nonce block_hash block_number transaction_index from_address to_address value gas gas_price input block_timestamp max_fee_per_gas max_priority_fee_per_gas transaction_type
2 0x99f1097abd8f33a68f0ed63d60de5f3e7e2a3e0579b90d5f46a4f201c658b46d 9 0x889c421abc62a48641eee140519e6da8c9dc01d85d8f5c4fbc3c13e3c6e4cb3e 47218 0 0x1406854d149e081ac09cb4ca560da463f3123059 0xa0e74ae010d51894734c308d612131056bb721ad 110000000000000000000 40000 62227241854 0x 1438936285 0
3 0x95844e6c54b4aafc8e1f75784127529280e75c3a980d91f6dfca1c1b0eb078fb 78 0x889c421abc62a48641eee140519e6da8c9dc01d85d8f5c4fbc3c13e3c6e4cb3e 47218 1 0xe6a7a1d47ff21b6321162aea7c6cb457d5476bca 0xee80ef3c49d9465c7fc2b3d7373fdbbbc3fe282f 8140416390630760000 21000 62222792381 0x 1438936285 0
4 0xbd5ab8937e52a6244209d804471be4878df6c364bca0111dd6d05e0d3edf63cf 79 0x944f09177142833c644c979a83900d8cae1ee67369774b88b3b330bb72825082 47219 0 0xe6a7a1d47ff21b6321162aea7c6cb457d5476bca 0xe25e3a1947405a1f82dd8e3048a9ca471dc782e1 8306052477120672000 21000 61580653163 0x 1438936326 0
5 0x4bcc1dd0c56c0b767b1ee3cb8bce7df44518f1696205299e34eb53a5e00a863e 1 0x944f09177142833c644c979a83900d8cae1ee67369774b88b3b330bb72825082 47219 1 0xf9a19aea1193d9b9e4ef2f5b8c9ec8df93a22356 0x32be343b94f860124dc4fee278fdcbd38c102d88 1998716170000000000 21000 61134768794 0x 1438936326 0