Commit Graph

8316 Commits

Author SHA1 Message Date
zero
b2d29aaa0a sdk/python: add missing SparseMerklePath 2024-03-28 09:47:24 +01:00
zero
cb80b9a69f money/dao: regen zk witness json files, and comment out zk::export_witness() from money clients 2024-03-28 07:28:02 +01:00
zero
61661052ce sdk/util: rename Fp.to_str() to Fp.to_string(), and encode/deocde hex strings with 0x prefix. 2024-03-28 07:21:20 +01:00
parazyd
19b0325dd9 contract/test-harness: Update PKS and VKS cache hashes 2024-03-27 15:36:20 +01:00
parazyd
b0df9d5f38 chore: Clippy lints 2024-03-27 15:19:04 +01:00
therealyingtong
ce35921cab zk::vm: Refactor range checks to reuse table 2024-03-27 15:14:44 +01:00
draoi
10404a962e doc: fix various hosts documentation 2024-03-27 13:39:51 +01:00
zero
b1ba95b9e0 bench: correct paths and add missing EcNiPoint to import_witness_json() 2024-03-27 13:02:29 +01:00
zero
19016fb521 bench: add generic zk_from_json() which will benchmark most .zk files using witness.json files provided. 2024-03-27 11:30:05 +01:00
zero
4532b8d229 for most .zk proofs, provide a corresponding witness.json file which is usable with zkrunner, benchmarks and other utils (using import_witness_json()). 2024-03-27 11:30:04 +01:00
zero
a1c48a39c7 zk/debug: add import_witness_json() 2024-03-27 11:30:04 +01:00
zero
4c049778bb sdk/crypto: FieldElemAsStr trait which provides to/from_str() for Fp/Fq 2024-03-27 11:30:04 +01:00
draoi
4bad13e687 net: create darklist for unknown transports + share darklist (not greylist)
In monero, nodes broadcast addrs from their whitelist. Receiving nodes
save the information on their greylist.

This is to ensure that honest nodes only broadcast active (i.e. whitelist)
nodes to the network. Dishonest nodes can send garbage info through
the hostlist, and therefore all information received from other nodes
is considered hostile and placed in the greylist, until we independently
verify it is accessible via the refinery.

Previously, darkfi deviated from this design as follows:

* Since peers on the greylist that do not match our transports never
  enter the refinery, we assume that the greylist consists of
  unsupported transports.
* We broadcast the greylist in ProtocolAddr, in an attempt to
  ensure that all transports are propagated.

Rather than simply assuming the greylist contains unsupported
transports, it is better to assume the greylist is hostile (since it
comes from other nodes).

We create a `darklist` specifically for storing unknown/ unsupported
transports. When we receive information from other peer, unsupported
addrs are added to our `darklist`, which is then broadcast to other
peers in ProtocolAddr. This fulfils to requirement (of broadcasting all
transports) without also involving honest peers in the propagating of
hostile info.

Specifically:

* Hostile peers can still broadcast garbage info in their gold, white
  and dark lists.

* Since info from other nodes is potentially hostile, honest peers save
  this info on their greylist and do not broadcast it to other peers
  unless a) it passes the refinery b) we connect to in outbound session
  c) we do not support this transport.

* There is a potential attack in which an attacker could fill their
  darklist with garbage e.g. Nym addresses, and honest nodes that do not
  support Nym will continue sharing these addresses via the dark list.
  The hostile peers will continue to be shared until a Nym-supporting
  node receives them and they pass via the refinery.

* Note that this attack is less severe, since providing the nodes stay
  on the Dark list they are ignored by the refinery and outbound connect
  loop and do not eat up resources of the node. The only time it will
  potentially cause pressure on a node if is the e.g. Nym node receives
  a list of hostile fake Nym addresses and they enter its greylist,
  causing it to refine many garbage addresses and potentially slowing
  its ability to make outbound connections. The latter can be prevented
  by increasing the settings `anchor_connect_count` and
  `white_connection_percent` (meaning outbound connections will not
  select from the greylist, or select less).

* Since there exists a potential attack vector of garbage entries in the
  Dark list, we limit the Dark list size to 1000 peers.

* This also means that supporting all transports is the best setup for a
  since it increases the security of the network (wrt the dark list).
2024-03-27 10:44:28 +01:00
zero
afa1856236 tests/bench: delete bench_zk, add zk_arith (uses criterion crate) 2024-03-26 17:19:08 +01:00
zero
f8f446f916 money: change DARK_TOKEN_ID = hash_to_base("DarkFi:DRK_Native_Token") 2024-03-26 16:37:14 +01:00
skoupidi
3349ea5cd8 script/research/gg: Use async (de)serialisation and prefer base64 over base58 2024-03-26 16:11:17 +02:00
skoupidi
3fc0fb19ed minerd: use (de)serialize_async 2024-03-26 15:46:01 +02:00
skoupidi
fbeb88ad45 darkfid: cleaned up unused PoWReward fields, use (de)serialize_async 2024-03-26 15:43:42 +02:00
skoupidi
4b12c9de4f chore: clippy 2024-03-26 15:18:08 +02:00
skoupidi
b6c7b5ff3c contract/money/model/token_id: restore deprecated functions(with minor cleanup) and added clarification TODOs 2024-03-26 15:06:53 +02:00
skoupidi
2956207cc5 chore: clippy 2024-03-26 15:02:21 +02:00
skoupidi
6a11e5e048 tests: ignore bench_zk.rs 2024-03-26 14:40:48 +02:00
parazyd
41045f4433 drk: Use async (de)serialisation and prefer base64 over base58 for txs. 2024-03-26 10:24:56 +01:00
draoi
afde25dd1d store: don't store whitelist entries in greylist on stop()
Previously we had decided on forcing whitelist entries through the
refinery on each new run, by writing them to the greylist on stop.

However, this is a bad design for the following reasons:

1. It deletes the work performed by the refinery, which is valuable and
   should be preserved. The whitelist is expensive (i.e. 15s/ peer + bandwidth),
   whereas the greylist is cheap (costs nothing to create). Therefore it's
   important to retain the distinction even on stop().

2. It means that when we start a node, since we have no memory of white
   hosts, the node will always try to connect to peers from the greylist.
   Probably safe peers (white) are mixed with potentially hostile peers (grey),
   so the node will struggle to form connections and DAG sync will fail.

3. Whitelist peers will be downgraded to Greylist if we cannot connect to
    them in Outbound Session, so forcing them through the refinery is redundant.
2024-03-26 08:58:49 +01:00
skoupidi
7e6a9a937b script/research/gg: GenerateTx added to create genesis mint txs 2024-03-26 03:31:04 +02:00
skoupidi
4d74247c9f drk: fixed erroneous eprintlns 2024-03-26 01:35:50 +02:00
zero
432800129c doc: fix small typo 2024-03-24 16:54:34 +01:00
zero
ecb3b833f8 doc: add wasm benchmark numbers 2024-03-24 16:52:38 +01:00
zero
99d5e54883 test-harness: change wasm benchmark to use microsecs instead of millisecs 2024-03-24 15:51:34 +01:00
zero
783aea03b2 doc: add graph of zk benchmarks 2024-03-24 13:19:07 +01:00
zero
544a7b7a21 doc: add laptop zk benchmark 2024-03-24 13:02:25 +01:00
zero
ae0e8f6ff3 doc: add desktop zk benchmarks 2024-03-24 12:14:10 +01:00
zero
baa0146834 tests: add zk benchmark 2024-03-24 10:52:24 +01:00
zero
48d23df367 create zkrender tool to plot circuit layouts 2024-03-24 10:23:43 +01:00
zero
74b7d2f7b8 py: Proof.create() return None when failing rather than use .unwrap() 2024-03-24 09:39:35 +01:00
skoupidi
8871f0898d validator: eat ze bugs 2024-03-23 19:50:40 +02:00
skoupidi
f46c3f7a68 script/research/blockchain-explorer: updated to latest darkfi structures 2024-03-23 14:09:11 +02:00
skoupidi
74ed38a7e6 blockchain/contract_store: added auxilliary fn get_all() to WasmStore and ContractStateStore 2024-03-23 14:08:42 +02:00
skoupidi
5cac7b404d sdk: chore clippy and typo 2024-03-23 14:07:55 +02:00
draoi
b5764d2c9f store: remove redundant Result<()> type on register_channel() 2024-03-23 10:26:25 +01:00
draoi
1d6f1175be net: fix bug that was causing duplicate connections to seed nodes
We establish some new rules:

1. Configured seed nodes should never enter the hostlist.
2. If by weird chance they enter the hostlist, they should never be connected to in outbound session.
3. Manual connections to configured seeds are also not allowed.
2024-03-23 09:59:00 +01:00
skoupidi
7edbac5c65 darkfid/tests: minor fix 2024-03-22 20:55:19 +02:00
skoupidi
b70ade1922 validator: permanently store ranks as blockchain expands 2024-03-22 20:19:44 +02:00
zero
05ea80bd99 wasm tests: add option to generate a CSV of benchmarks 2024-03-22 11:06:42 +01:00
zero
70cce66740 doc: dao notes 2024-03-22 11:06:42 +01:00
parazyd
3192390fa3 chore: Update halo2 repo ref 2024-03-22 10:36:42 +01:00
parazyd
68214cde3e chore: cargo update 2024-03-22 10:19:50 +01:00
draoi
c2941c4726 error: more descriptive error handling for state transitions 2024-03-22 10:14:22 +01:00
draoi
0329e2b296 settings: delete deprecated quarantine setting 2024-03-22 10:14:22 +01:00
skoupidi
c15facda1c validator: fixed not saving PoW module updates to db 2024-03-21 20:54:40 +02:00