Commit Graph

1179 Commits

Author SHA1 Message Date
Sanjay
71114df0b2 chore: Release 1.10.2 (#1723) @farcaster/hubble@1.10.2 2024-02-21 12:00:47 -08:00
Sanjay
915c6adb12 fix: Fix hub crash from bad message data submit (#1722) 2024-02-21 11:52:18 -08:00
Tony D'Addeo
1f97d0c249 chore: version packages (#1718) @farcaster/core@0.14.1 @farcaster/hub-nodejs@0.11.1 @farcaster/hubble@1.10.1 2024-02-20 14:05:47 -07:00
Sanjay
7f60a223ca fix: Increase hub stream buffer size to keep up with faster hub merges (#1709) 2024-02-17 10:09:32 +09:00
Wasif Iqbal
38a9ea3876 fix: gossipsub version and "iwant" parameter (#1708)
* fix: expose environment variable GOSSIPSUB_IWANT_FOLLOWUP_MS, update @chainsafe/libp2p-gossipsub to 6.3.0, and pass in gossipsubIWantFollowupMs parameter in gossipNodeWorker

* revert version bump on Friday to avoid inducing heart attack before weekend
2024-02-16 16:07:44 -08:00
Sanjay
1a52b8694d fix: Handle solana verification removes (#1707)
* fix: Fix solana verification removes

* convert solana strings to base58 in the http api

* changeset
2024-02-16 13:46:14 -08:00
adityapk00
8cfaa2cf83 fix: Remove DB_RESET_TOKEN (#1704) 2024-02-16 11:05:02 -06:00
piratekev
592bbb2536 docs: update spec.yaml to support Frames & validateMessage (#1634)
* Update spec.yaml to support Frames & validateMessage

* fix embed spec
2024-02-15 17:21:03 -08:00
Sanjay
8dc176138a fix: Add additional checks to prevent contact info duplicates (#1701) 2024-02-13 17:05:26 -08:00
Sanjay
83f66ab1e6 fix: Fix duplicate message ttl check and reduce fname poll timeout (#1700)
* fix: Fix duplicate message ttl check and reduce fname poll timeout

* Add more contact info logging
2024-02-13 15:42:08 -08:00
Sanjay
402b678e47 chore: additional logging for invalid messages (#1699) 2024-02-13 11:04:30 -08:00
adityapk00
bf37ec7666 fix: Run validateOrRevoke only if signer is changed (#1695)
* fix: Run validateOrRevoke only if signer is changed

* cleanup

* timebug

* review
2024-02-13 09:27:03 -06:00
Sanjay
e1c590a8c1 chore: Log gossip message delay (#1697) 2024-02-12 15:58:13 -08:00
adityapk00
8e928cea90 fix: Small optimizations for merge code (#1694)
1. Don't create dup Buffer objects
2. Don't recompute tsHash
2024-02-12 16:44:44 -06:00
Sanjay
330ce838ef chore: Release 1.10 (#1692) @farcaster/replicator@0.3.0 @farcaster/hubble@1.10.0 @farcaster/hub-web@0.8.0 @farcaster/hub-nodejs@0.11.0 @farcaster/core@0.14.0 2024-02-09 15:35:03 -08:00
Sanjay
d90fb0b5cc fix: Increase sync max duration so hubs have more time to catch up (#1691) 2024-02-09 14:34:09 -08:00
adityapk00
20d0e68d0c fix: Add a check to see if we have at least 16GB of RAM (#1690)
* fix: Add a check to see if we have at least 16GB of RAM

* check for 15GB
2024-02-09 16:27:17 -06:00
Sanjay
ae91b73ae0 feat: support solana verified addresses (#1668)
* feat: rename verification message to support additional protocols in the future

* chore: add changeset

* refactor: change signature for verification message

* remove solana related changes

* refactor: update ethereum verification tests to support new protocol field on message

* feat: add initial logic for parsing solana vs ethereum message

* Add protocol to verifications, update tests

* Add sol factories

* Add some verification tests

* Update claim factory for solana

* Fix tests for sol

* Update comment

* Verify signature for solana

* Replace tweetnacl due to dynamic import issue

* Got signature verification working for Solana ed25519

* Add changeset

* minor cleanup

* update solana verification to use full message adhering to off-chain message specification

* Use a simpler claim message format

* feature flag solana verifications

* cleanup

---------

Co-authored-by: Wasif Iqbal <Wazzymandias@users.noreply.github.com>
2024-02-09 14:07:49 -08:00
adityapk00
97a4216508 fix: Stop old messages from being broadcast on gossip (#1688)
* fix: Stop old messages from being broadcast on gossip

* add separate timestamp

* await
2024-02-09 12:18:40 -06:00
adityapk00
a9105e2051 fix: Add 8G heap to docker commands (#1689) 2024-02-09 12:04:27 -06:00
adityapk00
be07bc86e9 fix: init merkle trie so we don't miss l2events (#1686) 2024-02-09 08:42:32 -06:00
adityapk00
24072dad02 fix: Print stacktrace with iterator timeouts (#1685) 2024-02-08 13:52:09 -06:00
Sanjay
39fd2b763c chore: release 1.9.9 (#1684) @farcaster/hubble@1.9.9 @farcaster/replicator@0.2.10 @farcaster/hub-nodejs@0.10.24 @farcaster/hub-web@0.7.6 @farcaster/core@0.13.8 2024-02-08 10:28:14 -08:00
adityapk00
5a70330bca fix: Reduce gossip TTL to 5 mins (#1683) 2024-02-08 11:26:14 -06:00
adityapk00
52102c217e fix: Detect duplicate messages early (#1682) 2024-02-08 10:44:48 -06:00
adityapk00
81f453ab6d fix: write out cached blocks while processing L2 events (#1677) 2024-02-08 08:45:08 -06:00
Sanjay
c0551bfbe4 fix: increase sync timeout (#1681) 2024-02-07 21:22:51 -08:00
Sanjay
97317971b2 fix: prefer peers with more messages to sync with (#1680)
* fix: prefer peers with more messages to sync with

* Use a 5% buffer
2024-02-07 15:50:36 -08:00
Sanjay
6fec63caf3 fix: Keep the old message type name for backwards compatibility (#1678) 2024-02-07 13:17:22 -08:00
adityapk00
c0e17a49a2 feat: Add a new DB for Merkle Trie data (#1664) (#1676)
* feat: Add a new DB for Merkle Trie data

* cleanup

* move keys from main -> trie DB
2024-02-07 14:04:22 -06:00
adityapk00
f49e9fe41d fix: Use pendingUpdates size to flush updates (#1675) 2024-02-07 12:30:59 -06:00
adityapk00
aa6f41f948 Revert "feat: Add a new DB for Merkle Trie data (#1664)" (#1674)
This reverts commit ab09ed13e5.
2024-02-07 12:21:08 -06:00
adityapk00
41735d62a0 feat: Save connected peers in DB (#1673)
* feat: Save connected peers in DB

* default opts

* tests
2024-02-07 10:55:13 -06:00
adityapk00
382279843c fix: Set heap size to 8GB during dev/running from code (#1671) 2024-02-07 08:10:14 -06:00
Sanjay
763d3154af feat: Rename verifications message to support multiple protocols (#1667)
* Revert "fix: Revert verification rename (#1642)"

This reverts commit f8c5f28034.

* Rename to claimSignature

* Add http api backwards compatibility

* changeset
2024-02-06 16:56:39 -08:00
adityapk00
ab09ed13e5 feat: Add a new DB for Merkle Trie data (#1664)
* feat: Add a new DB for Merkle Trie data

* cleanup

* move keys from main -> trie DB
2024-02-06 15:52:15 -06:00
Sanjay
240e396686 chore: Release 1.9.8 (#1666) @farcaster/hubble@1.9.8 2024-02-06 10:24:35 -08:00
adityapk00
acf985c251 feat: Add neynar hubs to bootstrap list (#1665) 2024-02-06 11:54:09 -06:00
Sanjay
06160b9645 perf: Use execution timeout so we don't drop all messages in the lock queue (#1662) 2024-02-05 21:54:20 -08:00
adityapk00
8bff4de6c5 fix: Gossip seen TTL to 10 mins (#1661)
* fix: Gossip seen TTL to 10 mins

* changeset
2024-02-05 14:22:16 -06:00
adityapk00
248996d2dc fix: Change quicksync cutoff to 2 days (#1660) 2024-02-05 14:09:59 -06:00
adityapk00
0a6a7b7016 fix: Use multipart to upload snapshots to S3 (#1659) 2024-02-05 13:59:54 -06:00
adityapk00
d29dfe51a1 fix: Filter existing messages during sync (#1658)
When doing a quicksync, don't attempt to repair the sync trie by re-fetching existing messages
2024-02-05 13:38:25 -06:00
adityapk00
6ec1b4ddde feat: Add ActiveSigners cache (#1657)
* feat: Add ActiveSigners cache

* test

* cleanup
2024-02-05 11:27:41 -06:00
Sanjay
dc36db0cd0 chore: Release 1.9.7 (#1656) @farcaster/hubble@1.9.7 2024-02-05 08:49:06 -08:00
Sanjay
d3cd9c96ff fix: don't force fetch message count for non-existent fids (#1653) 2024-02-05 08:26:29 -08:00
adityapk00
618e6fad6a feat: Add quicksync (#1654)
* feat: Add quicksync

Quicksync will perform a sync for messages only newer than 2 weeks.

* changeset

* cleanup
2024-02-05 10:07:58 -06:00
adityapk00
05ce5fe8c5 fix: Increase sync trie cache to 64MB (#1655) 2024-02-05 09:52:08 -06:00
Sanjay
a5ed0199bd chore: fix log level for storage cache logging (#1652) 2024-02-04 16:37:52 -08:00
Sanjay
fb011fc519 fix: Additional performance tweaks and logging (#1651)
* fix: Minor perf tweaks and logging

* Only log after prepopulate is complete

* changeset
2024-02-04 15:48:34 -08:00