Commit Graph

369 Commits

Author SHA1 Message Date
Vincent Liao
57fee6ab87 fix: relative path on hubble docs not resolving to contributing.md (#564) 2023-02-15 16:25:20 -08:00
Paul Fletcher-Hill
8068ec61d6 feat: support Renew events from the name registry contract (#574)
* feat: support Renew events from the name registry contract

* represent renews as NameRegistryEvents

* log both success and errors in eth events provider

* fix import syntax
2023-02-15 11:29:34 -08:00
Paul Fletcher-Hill
a31de82054 update changeset version (#572) 2023-02-14 17:42:09 -08:00
Paul Fletcher-Hill
2117ac7fc1 chore: replace SequentialMergeStore with locks (#571)
* intermediate commit

* remove SequentialMergeStore in favor of async-lock
2023-02-14 17:29:26 -08:00
adityapk00
51b0b7d1bb fix: Clean shutdown for sync and merkle trie (#570)
* fix: Clean shutdown for sync and merkle trie

* logs
2023-02-14 12:27:29 -08:00
Paul Fletcher-Hill
54a3eb9117 fix: resolve out of range errors (#569) 2023-02-14 15:03:17 -05:00
Paul Fletcher-Hill
6a66bae932 feat: add mentionsPositions to CastAddBody (#568)
* add mentionsPositions to CastAddBody

* validate mentionsPositions sorted in ascending order
2023-02-13 18:26:23 -05:00
adityapk00
6967a7e8cc feat: Use cron jobs to schedule peer syncs (#567) 2023-02-13 10:30:46 -08:00
Paul Fletcher-Hill
1151fea239 feat: change farcaster epoch (#566)
* update fromFarcasterTime and confirm 320 byte cast text limit

* fix sync tests that use the farcaster epoch

* add changeset
2023-02-13 11:31:33 -05:00
adityapk00
e69bebb525 fix: Occasional crash in UpdateNameRegistryEventExpiryJob (#565) 2023-02-13 06:42:20 -08:00
adityapk00
5d6e07cb50 feat: Unload Trie from memory (#554) 2023-02-13 06:06:45 -08:00
adityapk00
8819dfd47d fix: Remove --no-fetch-ip arg (#560) 2023-02-11 10:49:32 -08:00
adityapk00
afacba8082 fix: Disable audit in github actions (#559) 2023-02-11 10:36:41 -08:00
Paul Fletcher-Hill
cf9c64c3a0 feat: asynchronously fetch NameRegistryEvent expiry (#553)
* intermediate name expiry commit

* integrate fname expiry update job with hubble

* add changeset
2023-02-10 12:09:59 -05:00
Chu Ka-cheong
bf4e899f13 feat: Sync Engine benchmark script (#552)
Add SyncEngine simulation. It is a round-based test (not CPU bound).
This test aims at measuring the performance of the sync algorithm.
Number of RPC are measured, which can be used to estimate the
performance in a network-bounded situation.
2023-02-10 06:54:49 -08:00
Paul Fletcher-Hill
c7aeb32bf5 fix: changing log message key again (#551) 2023-02-09 12:16:40 -05:00
adityapk00
b92e6e8f5b fix: Better multiaddr parsing (#550)
* fix: Better multiaddr parsing

* forgot test
2023-02-09 08:07:00 -08:00
Chu Ka-cheong
31baa724c1 fix: 2 bugs that break sync (#549)
* Fix `getSnapshot` returning non-existent prefix in some cases (#536)
  * Refactor `getSnapshot` to make it more readable
  * Fix `getAllValues` not working if child nodes are not loaded
  * Add test cases for `getAllValues` case
2023-02-09 06:11:14 -08:00
Varun Srinivasan
b880a8851e fix: e2e tests should validate a network of 10 nodes (#548) 2023-02-08 21:22:03 -08:00
Paul Fletcher-Hill
05b98663e1 fix: use msg instead of message for logs (#547) 2023-02-08 23:43:21 -05:00
adityapk00
05d4ac1b94 fix: Run the yarn console gen command batched (#546)
* fix: Run the yarn console gen command batched

* args
2023-02-08 18:10:41 -08:00
Paul Fletcher-Hill
b9410f2d3e update hub logging (#545) 2023-02-08 19:54:16 -05:00
Varun Srinivasan
720ed34c7f docs: libp2p upgrade instructions (#544) 2023-02-08 13:30:50 -08:00
adityapk00
829056f375 fix: gossip test (#542) 2023-02-08 11:49:05 -08:00
adityapk00
8a4507d063 feat: Gossip only messages submitted via RPC (#541) 2023-02-08 10:58:13 -08:00
adityapk00
491cb2917d fix: Add checks before fetching syncIDs during sync (#540) 2023-02-08 08:47:12 -08:00
adityapk00
b870a815cb fix: Fetch missing SyncIDs in parallel batches (#539) 2023-02-08 07:51:16 -08:00
adityapk00
e9a166f54d fix: Use other snapshot prefix when syncing (#538)
Addresses some of the issues in #536
2023-02-08 06:52:01 -08:00
Varun Srinivasan
7483d8ca8e chore: upgrade libp2p to 0.42.2 (#534)
* chore: upgrade libp2p to 0.42.2

* chore: add common terms to cSpell
2023-02-07 16:51:16 -08:00
adityapk00
124cb3e756 feat: Add protobufs, Factories and gen command to yarn console (#537) 2023-02-07 07:35:34 -08:00
Chu Ka-cheong
1774b35e0d fix: incorrect prefix used by SyncEngine.getSnapshot() (#535)
SyncEngine.getSnapshot() divides timestamp by 10 inadvertently and
makes the prefix to be shifted right, causing the prefix to be mismatch
with with messages in MerkleTrie.
2023-02-07 06:23:17 -08:00
Varun Srinivasan
0311379208 chore: make version pinning stricter (#532)
* chore: strictly pin all versions of libp2p packages

* chore: pin versions with ~ instead of ^ wherever possible
2023-02-06 11:43:43 -08:00
adityapk00
b942d3c04f fix: Init DB before loading Merkle Trie (#533) 2023-02-06 11:28:05 -08:00
adityapk00
a93c6b70ee feat: Persist Merkle Trie to DB (#531)
* feat: Persist Merkle Trie to DB

* Save hash and items to DB

* fix benchmark
2023-02-06 08:08:19 -08:00
adityapk00
689a373e5b fix: Fix accidental checkin (#530) 2023-02-05 13:39:27 -08:00
adityapk00
9529cb1f2c fix: flaky test. (#529)
Fixes #526
2023-02-05 13:29:21 -08:00
Varun Srinivasan
624a071427 chore: suppress false positive security warnings (#528) 2023-02-05 12:29:35 -08:00
Varun Srinivasan
d6634cfdd3 chore: upgrade to typescript v5 beta (#527) 2023-02-04 10:45:10 -08:00
adityapk00
83a2ca0cbd feat: Console connections to prod hub (#524) 2023-02-03 19:31:21 -08:00
Paul Fletcher-Hill
1c1ca622ac increase SequentialMergeStore timeout (#522) 2023-02-03 22:29:14 -05:00
adityapk00
348c9125d7 feat: bulkServiceTest to protos (#521) 2023-02-03 19:13:10 -08:00
Shane da Silva
5f15d04433 chore: Remove shard flag from tests (#519)
This doesn't appear to serve any purpose, since the second shard appears
to be empty / no tests.
2023-02-03 17:32:43 -08:00
Shane da Silva
e91cf7ab5a chore: Test Docker builds in CI (#518)
To prevent accidental breakages, test our Docker builds on PRs.

This should be relatively fast thanks to GitHub Actions caching, and the
fact that the NPM `rocksdb` package has a pre-built binary for x64,
which is what `ubuntu-latest` runs.
2023-02-03 17:21:27 -08:00
Shane da Silva
36bf4a1845 fix: Docker build failing after package removal (#517)
A package removal in d21a8f2e caused the Docker build to start failing.
Removing this line seems to fix it.
2023-02-03 16:58:23 -08:00
Varun Srinivasan
26649cd3de chore: upgrade commander to 10 (#516) 2023-02-03 16:25:19 -08:00
Paul Fletcher-Hill
d21a8f2e55 chore: remove unused packages and investigate async job memory leak (#515)
* investigate async job memory leak

* add changeset
2023-02-03 17:55:54 -05:00
Varun Srinivasan
afd5a2946a chore: upgrade packages [feb 2023] (#514)
* chore: upgrade tsx, typescript

* chore: upgrade jest minor version

* chore: upgrade @swc minor

* chore: upgrade eslint, prettier minor

* chore: upgrade minor packages husky tsx

* chore: upgrade minor package undici

* chore: upgrade noble/hashes minor

* chore: upgrade ts-proto minor

* chore: upgrade grpc-js patch

* chore: upgrade rimraf major

* chore: upgrade turbo again

* chore: update node-cron types patch, move to dev deps
2023-02-03 12:22:22 -08:00
Varun Srinivasan
b33b4cf146 docs: minor improvements (#513) 2023-02-03 10:51:32 -08:00
Shane da Silva
8dbf92202f chore: Reduce Docker image size using Alpine base (#512)
This requires a few additional packages to be manually installed, but
results in a smaller image (from ~530MB → ~465MB, over 12% reduction).
2023-02-03 09:44:50 -08:00
Shane da Silva
cf8a681fb3 fix: Set default network ID to mainnet (#510)
Make it a bit easier to get started by connecting to mainnet.

While here, shrink the size of our image further by squashing layers in
a final stage of the build. This gets us down from ~612MB to ~530MB.
2023-02-03 09:17:32 -08:00