Commit Graph

152 Commits

Author SHA1 Message Date
Varun Srinivasan
73d11308fb chore: changeset version bumps (#660) 2023-03-16 13:28:19 -07:00
Varun Srinivasan
a74ecb2097 refactor(farcaster/hub-nodejs): rename farcaster/js to farcaster/hub-nodejs (#658)
* refactor: rename farcaster/js to farcaster/hub-nodejs

* chore: add changeset
2023-03-16 13:08:05 -07:00
Paul Fletcher-Hill
9b4a7fea27 fix prune messages job (#655) 2023-03-16 13:00:45 -04:00
Paul Fletcher-Hill
68230b7f86 chore: move submitIdRegistryEvent and submitNameRegistryEvent to admin grpc service (#650)
* move submitIdRegistryEvent and submitNameRegistryEvent to admin grpc service

* add changeset

* fix imports
2023-03-15 13:31:36 -04:00
Anthony D'Addeo
e7602bdd31 feat: pagination for list queries and gRPC (#610)
* poc

* address pr feedback, add pagination to getAllSignerMessagesByFid

* fix types

* use bytes and uint32

* move makeEndPrefix into utils

* getSignersByFid

* fix: getCastsByFid should return items in reverse chronological order

* returns casts in chronological order

* fix: getCastsByFid should return casts in chronological order

In the RocksDB iterator we use to construct thashes for the messages query, select only the CastMessages which are CastAdds

* rename page options and move page iterator to message file

* intermediate commit

* fix tests

* use suffixes as tokens rather than full keys

* remove commented out code

* paginate getCastsByParent, getCastsByMention, getReactionsByCast

* add changeset and fix linting

* update multiPeerSyncEngine test

* add more tests

* fix import

---------

Co-authored-by: bstchow <36556453+bstchow@users.noreply.github.com>
Co-authored-by: Paul Fletcher-Hill <pfletcherhill@gmail.com>
2023-03-15 01:15:31 -04:00
adityapk00
d809846423 fix: Catch timeouts during shutdown (#643) 2023-03-13 09:33:26 -07:00
Shane da Silva
935b6ec6e8 chore: changeset version (#640) 2023-03-12 14:34:11 -07:00
Paul Fletcher-Hill
f55fa8a219 feat: refactor @farcaster/js to only export from utils and protobufs (#636)
* remove js files and export from utils and protobufs

* remove hex methods and add changeset
2023-03-11 18:38:12 -05:00
Shane da Silva
fe503a29c8 chore: changeset version (#637) 2023-03-11 14:10:18 -08:00
Paul Fletcher-Hill
f132d9a345 force shutdown on stop (#632) 2023-03-09 14:47:46 -05:00
Paul Fletcher-Hill
42680b459d chore: changeset version (#629) 2023-03-07 22:52:38 -05:00
Paul Fletcher-Hill
6f1c5a92fb use ts-proto removeEnumPrefix flag (#628) 2023-03-07 21:27:34 -05:00
Zach Terrell
ea7b9c9c66 feat: add name field to signers (#627)
* add: SignerAdd and SignerRemove to message.proto

* add: finish message.proto and validations

* progress: refactor signer factory

* update tests to support signerAddBody and signerRemoveBody

* add changeset

---------

Co-authored-by: Paul Fletcher-Hill <pfletcherhill@gmail.com>
2023-03-07 19:54:48 -05:00
adityapk00
114dfabec9 fix: Fix rpcAuth test db name (#625) 2023-03-01 09:46:25 -08:00
adityapk00
cf0c452e3f feat: Add RPC Auth and SSL support (#624)
* feat: Add RPC Auth and SSL support

* tests
2023-03-01 09:35:47 -08:00
payton
bf5beb879d feat: add ability to change contract configuration via cli (#623)
* feat: add ability to change contract configuration via cli

* feat: add cli options for id + name registry contract addresses,
starting block, and block chunk size for historical event syncing

* feat: generalize makeWithGoerli into build factory method for
EthEventsProvider

* feat: default to Goerli constants from hubble.ts instead of
eth/ethEventsProvider.ts

Signed-off-by: Payton Garland <payton.r.g@gmail.com>

* feat: set 10000 as default chunk size in cli

Signed-off-by: Payton Garland <payton.r.g@gmail.com>

* fix: remove redundant default from command option

Signed-off-by: Payton Garland <payton.r.g@gmail.com>

---------

Signed-off-by: Payton Garland <payton.r.g@gmail.com>
2023-03-01 09:16:21 -08:00
adityapk00
a237a6554a feat: Add warpcast client setup command (#621) 2023-02-28 10:00:34 -08:00
adityapk00
5d16644020 chore: Add multiple signer test for sync (#618) 2023-02-27 07:25:30 -08:00
Shane da Silva
cf8624d340 chore: bump changeset versions (#615)
Ran `yarn changeset version`
2023-02-25 22:59:36 -08:00
adityapk00
cbb6b4aea8 feat: Implement rate limits for gossip/sync (#609)
* feat: Rate limit gossip messages

* rename const
2023-02-24 06:38:17 -08:00
adityapk00
4b6e7149a1 fix: Handle startup errors gracefully (#605) 2023-02-23 09:40:48 -08:00
Paul Fletcher-Hill
d04d5d4a3c feat: support fromId param in subscribe method (#604)
* support fromId param in subscribe method

* add fromId to js event filters

* support filtering by fromId and eventTypes

* add changeset
2023-02-23 12:32:05 -05:00
Paul Fletcher-Hill
22a9d46015 chore: remove location (#603)
* remove location from UserDataAdd types

* add changeset
2023-02-23 01:25:48 -05:00
Paul Fletcher-Hill
4056b5d4d1 feat: add hub events log and delete amps (for now) (#602)
* add hub events and delete amps

* include hub_event.proto
2023-02-23 01:03:17 -05:00
Varun Srinivasan
ad4dfcfa1d docs: update READMEs to match latest behavior (#601) 2023-02-22 20:36:52 -08:00
adityapk00
a3f6668b4f feat: Add admin debug commands (#600) 2023-02-21 07:49:17 -08:00
adityapk00
af69c98419 fix: Sync stalls after a few hours are not stored (#599) 2023-02-20 14:57:39 -08:00
Shane da Silva
d7c9e0a4ab chore: bump changeset versions (#597) 2023-02-19 21:20:24 -08:00
adityapk00
f14bedab78 feat: p2p allowlist (#595) 2023-02-19 15:45:17 -08:00
Paul Fletcher-Hill
0c32de2230 chore: bump changeset versions (#594)
* bump package versions

* add prepublishOnly scripts to packages

* fix changelog typo

* remove lint from prepublishOnly
2023-02-19 13:57:44 -05:00
adityapk00
8a345cafec feat: Allow reading server identity from environment (#593) 2023-02-19 10:29:09 -08:00
Paul Fletcher-Hill
245718cb13 bump package versions (#592) 2023-02-19 10:34:11 -05:00
adityapk00
2e0f705507 fix: Store peer contacts instead of RPC proxy objects (#581) 2023-02-17 10:53:58 -08:00
adityapk00
995548515a fix: Cleanup prev commit (#580) 2023-02-17 09:14:30 -08:00
adityapk00
68bd26b3e7 fix: Make sync interruptable (#578) 2023-02-16 12:32:18 -08:00
adityapk00
daeda43ed9 fix: Log failed sync message that didn't merge (#576) 2023-02-16 10:32:54 -08:00
adityapk00
9a3807d135 feat: Detect unclean shutdown and rebuild trie CLI option (#575) 2023-02-16 10:01:01 -08:00
Vincent Liao
57fee6ab87 fix: relative path on hubble docs not resolving to contributing.md (#564) 2023-02-15 16:25:20 -08:00
Paul Fletcher-Hill
8068ec61d6 feat: support Renew events from the name registry contract (#574)
* feat: support Renew events from the name registry contract

* represent renews as NameRegistryEvents

* log both success and errors in eth events provider

* fix import syntax
2023-02-15 11:29:34 -08:00
Paul Fletcher-Hill
a31de82054 update changeset version (#572) 2023-02-14 17:42:09 -08:00
Paul Fletcher-Hill
2117ac7fc1 chore: replace SequentialMergeStore with locks (#571)
* intermediate commit

* remove SequentialMergeStore in favor of async-lock
2023-02-14 17:29:26 -08:00
adityapk00
51b0b7d1bb fix: Clean shutdown for sync and merkle trie (#570)
* fix: Clean shutdown for sync and merkle trie

* logs
2023-02-14 12:27:29 -08:00
Paul Fletcher-Hill
54a3eb9117 fix: resolve out of range errors (#569) 2023-02-14 15:03:17 -05:00
adityapk00
6967a7e8cc feat: Use cron jobs to schedule peer syncs (#567) 2023-02-13 10:30:46 -08:00
Paul Fletcher-Hill
1151fea239 feat: change farcaster epoch (#566)
* update fromFarcasterTime and confirm 320 byte cast text limit

* fix sync tests that use the farcaster epoch

* add changeset
2023-02-13 11:31:33 -05:00
adityapk00
e69bebb525 fix: Occasional crash in UpdateNameRegistryEventExpiryJob (#565) 2023-02-13 06:42:20 -08:00
adityapk00
5d6e07cb50 feat: Unload Trie from memory (#554) 2023-02-13 06:06:45 -08:00
adityapk00
8819dfd47d fix: Remove --no-fetch-ip arg (#560) 2023-02-11 10:49:32 -08:00
Paul Fletcher-Hill
cf9c64c3a0 feat: asynchronously fetch NameRegistryEvent expiry (#553)
* intermediate name expiry commit

* integrate fname expiry update job with hubble

* add changeset
2023-02-10 12:09:59 -05:00
Chu Ka-cheong
bf4e899f13 feat: Sync Engine benchmark script (#552)
Add SyncEngine simulation. It is a round-based test (not CPU bound).
This test aims at measuring the performance of the sync algorithm.
Number of RPC are measured, which can be used to estimate the
performance in a network-bounded situation.
2023-02-10 06:54:49 -08:00