github/hub-monorepo
1
1
Fork 0
mirror of https://github.com/farcasterxyz/hub-monorepo.git synced 2026-04-18 03:00:22 -04:00
Code Issues Packages Projects Releases Wiki Activity
511 Commits 64 Branches 465 Tags
92c2eadd646d308e69932da8db62e835ca5f323f
Commit Graph

212 Commits

Author SHA1 Message Date
Varun Srinivasan
92c2eadd64 chore(hubble): syncEngine used incorrect terms to refer to a hub (#763) 2023-03-26 20:12:00 -07:00
Varun Srinivasan
57c540d520 chore: release new version of packages (#761) 
* chore: changelog bump to app/hubble to prep for release

* chore: don't minor bump hubble and protobufs for client changes

* chore: bump versions for publishing
 2023-03-26 18:17:47 -07:00
adityapk00
048052b218 fix: Test data messages should be gossiped (#760) 2023-03-26 14:49:29 -07:00
adityapk00
f965209daa fix: Don't get recursive snapshots (#759) 
* fix: Don't sync if engine is pruning

* move divergence prefix

* no timeouts
 2023-03-26 13:54:54 -07:00
adityapk00
2b1ec6199a bump sync limit to 10s (#758) 2023-03-26 12:04:50 -07:00
adityapk00
55b7e7d80a chore: improve logging for failure cases (#756) 
* chore: improve logging for failure cases

* 2 min timeout

* add tests

* Improve logging in merkleTrie.ts

* change shutdown order
 2023-03-26 09:02:39 -07:00
adityapk00
e5cb3276c5 docs: Use SSL or Insecure clients in examples (#754) 
* docs: Use SSL or Insecure clients in examples

* remove unnecessary awaits

* Remove getHubRpcClient

* changeset

* Fix changeset

* improve error message
 2023-03-25 13:20:07 -07:00
adityapk00
96c73f8b9c fix: Sync stalls when peer is not responding (#755) 2023-03-25 10:08:20 -07:00
adityapk00
74588d351c feat: Dynamically recover from syncTrie corruption (#753) 
* feat: Dynamically recover from syncTrie corruption

* log
 2023-03-24 16:55:49 -07:00
Paul Fletcher-Hill
9307b57778 changeset version and make custom packages private (#752) 2023-03-24 17:11:47 -04:00
adityapk00
7a6599a405 fix: Attempt cleanshutdown on unexpected exceptions (#751) 2023-03-24 13:42:34 -07:00
adityapk00
7e77816045 fix: Handle errors when peer unexpectedly disconnects (#750) 2023-03-24 12:25:08 -07:00
adityapk00
111e926a45 fix: Catch any SSL errors if peer unexpectedly dies (#749) 2023-03-24 11:10:51 -07:00
Paul Fletcher-Hill
fa6cab2ce5 feat: commit one event at a time (#748) 
* commit one event at a time

* ensure we end revoke iterator

* add revoke tests to stores

* improve pruning and revoking logging

* get rid of commented code

* test fname add revoke and transfer

* fix log typo
 2023-03-24 13:10:04 -04:00
Varun Srinivasan
5c7840518e fix(hubble): crash by bumping ethers to 6.2.1 (#744) 
* fix: crash by bumping ethers to 6.2.1

* chore: add changeset
 2023-03-23 19:19:51 -07:00
Paul Fletcher-Hill
23de6e7eaf feat: move revoking messages into delayed job (#741) 
* move revoking messages into delayed job

* fix imports, add changeset, add revoke tests
 2023-03-23 16:08:14 -04:00
adityapk00
ed35c2d16b fix: Don't use RPC while handling gossip messages (#740) 2023-03-23 12:31:26 -07:00
adityapk00
21b9d3fae5 chore: better logging (#739) 2023-03-23 10:46:40 -07:00
adityapk00
6a0bf29f91 fix: Share dns name when gossiping contactinfo (#738) 
* fix: Share dns name when gossiping contactinfo

* changeset
 2023-03-23 10:08:11 -07:00
Paul Fletcher-Hill
aa970d2dfe fix: prune in serial (#730) 
* changeset version

* fix pruning error logging

* Revert "changeset version"

This reverts commit 144fa7071a.

* prune bug investigation
 2023-03-22 23:13:44 -04:00
adityapk00
d5e6395dfd chore: Improve sync logging (#729) 2023-03-22 18:57:57 -07:00
Paul Fletcher-Hill
13c316b9bb chore: improve logging for pruning errors (#728) 
* changeset version

* fix pruning error logging

* Revert "changeset version"

This reverts commit 144fa7071a.
 2023-03-22 21:48:07 -04:00
adityapk00
0f6737bfc6 feat: IP based rate limiting for submitMessage RPC (#722) 2023-03-22 14:53:39 -07:00
adityapk00
3d45ccba81 chore: Change port numbers (#726) 2023-03-22 14:44:49 -07:00
adityapk00
7a2beb5f12 fix: Remove peerIDs checked into config file (#723) 
* fix: Remove peerIDs checked into config file

* Change dockerfile
 2023-03-22 14:30:43 -07:00
Paul Fletcher-Hill
72ca1416d6 move signer pruning before other sets (#725) 2023-03-22 17:30:22 -04:00
Paul Fletcher-Hill
9710f4af40 chore: minor pruning refactor (#721) 
* minor pruning refactor

* fix imports

* prune batches of fids in parallel
 2023-03-22 17:13:37 -04:00
adityapk00
c26fafa255 feat: Add test data into test hubs (#719) 
* feat: Add test data into test hubs

* changeset
 2023-03-22 11:57:31 -07:00
Paul Fletcher-Hill
3e45dbe24c use warn rather than error for submitMessage (#718) 2023-03-22 00:58:18 -04:00
Paul Fletcher-Hill
b47a170f0a feat: add storage cache to speed up pruning (#717) 
* add storage cache

* use event emitter to call revokeMessagesBySigner in engine

* test engine listeners

* log engine start and stop

* fix prune messages cron

* add more processEvent tests

* ensure event listeners are removed on engine stop

* move validation worker back into constructor

* fix imports

* more logging in engine and storage cache
 2023-03-22 00:45:19 -04:00
adityapk00
a89a5b9520 feat: Reset DB if DB_RESET_TOKEN is set (#713) 
* feat: Reset DB if DB_RESET_TOKEN is set

* changeset
 2023-03-21 10:24:31 -07:00
adityapk00
b4105c94b1 fix: Handle ethersv6 contract listener change (#712) 
* fix: Handle ethersv6 contract listener change

* forgot test file
 2023-03-21 08:27:24 -07:00
Paul Fletcher-Hill
e090a3d6f5 feat: revoke messages immediately (#705) 
* revoke messages immediately

* ensure db calls are wrapped in fromPromise
 2023-03-21 00:42:32 -04:00
adityapk00
e29958ea04 fix: Terminate webworker at end of tests (#708) 
* fix: Terminate webworker at end of tests

* changeset
 2023-03-20 19:20:09 -07:00
Varun Srinivasan
d139dae5d4 chore: bump versions (#700) 2023-03-20 14:16:44 -07:00
Paul Fletcher-Hill
403c3ccfb8 feat: sort casts and reactions indices by timestamp (#699) 
* sort casts and reactions indices by timestamp

* add more getReactionsByTargetCast tests
 2023-03-20 17:06:15 -04:00
adityapk00
1b0e3a7efc feat: Allow setting rpcAuth via env variables (#698) 
* feat: Allow setting rpcAuth via env variables

* changeset
 2023-03-20 13:49:48 -07:00
adityapk00
f059e4c7f1 fix: Add a simple cache to the sync trie (#697) 
* fix: Add a simple cache to the sync trie

This reduces the amount of disk writes the sync trie does.

* flaky tests
 2023-03-20 13:09:51 -07:00
adityapk00
69ff0efada fix: Fix issue with ethers v6 (#696) 
* fix: Fix issue with ethers v6

* add warning
 2023-03-20 10:26:05 -07:00
Paul Fletcher-Hill
469825e7e1 feat: add reverse rpc pageOption (#695) 
* add reverse rpc pageOption

* implement reverse for cast and reaction indices

* add changeset
 2023-03-20 13:18:14 -04:00
Paul Fletcher-Hill
60ed81e8c6 feat: prune events after 3 days (#690) 
* prune events after 3 days

* use fromId option

* schedule prune events job

* update default cron schedule and log any prune events errors

* update default prune events time limit to use ms
 2023-03-20 12:15:59 -04:00
adityapk00
9235f68394 feat: Do validations in webworkers (#671) 
* feat: Do validations in webworkers

* address code review comments

* don't encode/decode
 2023-03-20 07:05:00 -07:00
Shane da Silva
a91afdb634 Allow specifying hub name via environment variable (#692) 
This makes it easier to set the name when deploying multiple hubs.
 2023-03-19 18:14:49 -07:00
Shane da Silva
d63e05f0f9 Switch to time-based check for process shutdown file (#688) 
Using `fs.watch` uses `inotify`, which doesn't work with network file
systems like EFS where other kernels could be responsible for changes to
the file system.

Instead, check every 10 seconds to see if there is a change.

Ran this locally and it seemed to work fine.
 2023-03-19 14:54:45 -07:00
adityapk00
0a0fec3bd5 fix: Fix accidentally removed sleep from prev commit (#686) 2023-03-19 13:46:15 -07:00
adityapk00
be864e31c0 Pidfix (#685) 
* fix: Use a random number instead of PID

* maxsafeint
 2023-03-19 13:36:08 -07:00
adityapk00
b596ec9189 feat: Exit if superseeded by a newer hub (#684) 
* feat: Exit if superseeded by a newer hub

* changeset
 2023-03-19 13:17:12 -07:00
Vincent Liao
f875c1ed65 chore: turn prettier into its own package (#653) 
* chore: separate out prettier from eslint into its own package

* fix: duplicate package name in package.json
 2023-03-19 12:47:15 -07:00
Paul Fletcher-Hill
e0ca40de25 feat: refactor events to create and broadcast in order (#675) 
* refactor events

* update tests and remove unused eventhandler methods
 2023-03-19 15:26:59 -04:00
adityapk00
8815067813 fix: Fix memory leak in prune messages job (#679) 
* fix: Fix memory leak in prune messages job

* Add end() to nameRegistryTest iterator

* refactor rocksdb iterator to use promises

* simplify next API

* clear iterator when paginating

* change prune messages cron back to every hour

* clear iterators from pagination methods

* fix build

---------

Co-authored-by: Paul Fletcher-Hill <pfletcherhill@gmail.com>
 2023-03-19 15:17:14 -04:00