github/hub-monorepo
1
1
Fork 0
mirror of https://github.com/farcasterxyz/hub-monorepo.git synced 2026-02-19 09:14:19 -05:00
Code Issues Packages Projects Releases Wiki Activity
484 Commits 62 Branches 465 Tags
aa970d2dfe90f2bf8f65f8dad2ff6e8f2c98cfc5
Commit Graph

193 Commits

Author SHA1 Message Date
Paul Fletcher-Hill
aa970d2dfe fix: prune in serial (#730) 
* changeset version

* fix pruning error logging

* Revert "changeset version"

This reverts commit 144fa7071a.

* prune bug investigation
 2023-03-22 23:13:44 -04:00
adityapk00
d5e6395dfd chore: Improve sync logging (#729) 2023-03-22 18:57:57 -07:00
Paul Fletcher-Hill
13c316b9bb chore: improve logging for pruning errors (#728) 
* changeset version

* fix pruning error logging

* Revert "changeset version"

This reverts commit 144fa7071a.
 2023-03-22 21:48:07 -04:00
adityapk00
0f6737bfc6 feat: IP based rate limiting for submitMessage RPC (#722) 2023-03-22 14:53:39 -07:00
adityapk00
3d45ccba81 chore: Change port numbers (#726) 2023-03-22 14:44:49 -07:00
adityapk00
7a2beb5f12 fix: Remove peerIDs checked into config file (#723) 
* fix: Remove peerIDs checked into config file

* Change dockerfile
 2023-03-22 14:30:43 -07:00
Paul Fletcher-Hill
72ca1416d6 move signer pruning before other sets (#725) 2023-03-22 17:30:22 -04:00
Paul Fletcher-Hill
9710f4af40 chore: minor pruning refactor (#721) 
* minor pruning refactor

* fix imports

* prune batches of fids in parallel
 2023-03-22 17:13:37 -04:00
adityapk00
c26fafa255 feat: Add test data into test hubs (#719) 
* feat: Add test data into test hubs

* changeset
 2023-03-22 11:57:31 -07:00
Paul Fletcher-Hill
3e45dbe24c use warn rather than error for submitMessage (#718) 2023-03-22 00:58:18 -04:00
Paul Fletcher-Hill
b47a170f0a feat: add storage cache to speed up pruning (#717) 
* add storage cache

* use event emitter to call revokeMessagesBySigner in engine

* test engine listeners

* log engine start and stop

* fix prune messages cron

* add more processEvent tests

* ensure event listeners are removed on engine stop

* move validation worker back into constructor

* fix imports

* more logging in engine and storage cache
 2023-03-22 00:45:19 -04:00
adityapk00
a89a5b9520 feat: Reset DB if DB_RESET_TOKEN is set (#713) 
* feat: Reset DB if DB_RESET_TOKEN is set

* changeset
 2023-03-21 10:24:31 -07:00
adityapk00
b4105c94b1 fix: Handle ethersv6 contract listener change (#712) 
* fix: Handle ethersv6 contract listener change

* forgot test file
 2023-03-21 08:27:24 -07:00
Paul Fletcher-Hill
e090a3d6f5 feat: revoke messages immediately (#705) 
* revoke messages immediately

* ensure db calls are wrapped in fromPromise
 2023-03-21 00:42:32 -04:00
adityapk00
e29958ea04 fix: Terminate webworker at end of tests (#708) 
* fix: Terminate webworker at end of tests

* changeset
 2023-03-20 19:20:09 -07:00
Varun Srinivasan
d139dae5d4 chore: bump versions (#700) 2023-03-20 14:16:44 -07:00
Paul Fletcher-Hill
403c3ccfb8 feat: sort casts and reactions indices by timestamp (#699) 
* sort casts and reactions indices by timestamp

* add more getReactionsByTargetCast tests
 2023-03-20 17:06:15 -04:00
adityapk00
1b0e3a7efc feat: Allow setting rpcAuth via env variables (#698) 
* feat: Allow setting rpcAuth via env variables

* changeset
 2023-03-20 13:49:48 -07:00
adityapk00
f059e4c7f1 fix: Add a simple cache to the sync trie (#697) 
* fix: Add a simple cache to the sync trie

This reduces the amount of disk writes the sync trie does.

* flaky tests
 2023-03-20 13:09:51 -07:00
adityapk00
69ff0efada fix: Fix issue with ethers v6 (#696) 
* fix: Fix issue with ethers v6

* add warning
 2023-03-20 10:26:05 -07:00
Paul Fletcher-Hill
469825e7e1 feat: add reverse rpc pageOption (#695) 
* add reverse rpc pageOption

* implement reverse for cast and reaction indices

* add changeset
 2023-03-20 13:18:14 -04:00
Paul Fletcher-Hill
60ed81e8c6 feat: prune events after 3 days (#690) 
* prune events after 3 days

* use fromId option

* schedule prune events job

* update default cron schedule and log any prune events errors

* update default prune events time limit to use ms
 2023-03-20 12:15:59 -04:00
adityapk00
9235f68394 feat: Do validations in webworkers (#671) 
* feat: Do validations in webworkers

* address code review comments

* don't encode/decode
 2023-03-20 07:05:00 -07:00
Shane da Silva
a91afdb634 Allow specifying hub name via environment variable (#692) 
This makes it easier to set the name when deploying multiple hubs.
 2023-03-19 18:14:49 -07:00
Shane da Silva
d63e05f0f9 Switch to time-based check for process shutdown file (#688) 
Using `fs.watch` uses `inotify`, which doesn't work with network file
systems like EFS where other kernels could be responsible for changes to
the file system.

Instead, check every 10 seconds to see if there is a change.

Ran this locally and it seemed to work fine.
 2023-03-19 14:54:45 -07:00
adityapk00
0a0fec3bd5 fix: Fix accidentally removed sleep from prev commit (#686) 2023-03-19 13:46:15 -07:00
adityapk00
be864e31c0 Pidfix (#685) 
* fix: Use a random number instead of PID

* maxsafeint
 2023-03-19 13:36:08 -07:00
adityapk00
b596ec9189 feat: Exit if superseeded by a newer hub (#684) 
* feat: Exit if superseeded by a newer hub

* changeset
 2023-03-19 13:17:12 -07:00
Vincent Liao
f875c1ed65 chore: turn prettier into its own package (#653) 
* chore: separate out prettier from eslint into its own package

* fix: duplicate package name in package.json
 2023-03-19 12:47:15 -07:00
Paul Fletcher-Hill
e0ca40de25 feat: refactor events to create and broadcast in order (#675) 
* refactor events

* update tests and remove unused eventhandler methods
 2023-03-19 15:26:59 -04:00
adityapk00
8815067813 fix: Fix memory leak in prune messages job (#679) 
* fix: Fix memory leak in prune messages job

* Add end() to nameRegistryTest iterator

* refactor rocksdb iterator to use promises

* simplify next API

* clear iterator when paginating

* change prune messages cron back to every hour

* clear iterators from pagination methods

* fix build

---------

Co-authored-by: Paul Fletcher-Hill <pfletcherhill@gmail.com>
 2023-03-19 15:17:14 -04:00
adityapk00
6ff9f4e18d fix: Add a grace period before forcing exit after signals (#682) 2023-03-19 11:59:09 -07:00
Anthony D'Addeo
99518efe30 refactor: introduce generic and dependency specific signers (#677) 
* refactor: update ethers to v6.1 from v5.7

* refactor: generic signer classes

* remove neverthrow from crypto and signers

* update docs

* rm signer util fns

* add comment to getSignerKey

* rm not present methods from signers

* fix doc

* fix docs

* simplify Eip712Factory

* add changeset

---------

Co-authored-by: Varun Srinivasan <varunsrin@gmail.com>
 2023-03-19 12:44:32 -05:00
Varun Srinivasan
59920f9716 refactor: update ethers to v6.1 from v5.7 (#670) 2023-03-18 17:38:17 -07:00
Varun Srinivasan
1e4482e6ba chore: upgrade minor and patch versions of packages (#678) 
* chore: update all devDependencies to the latest versions

* chore: update @noble/hashes to 1.3.0

* chore: update @swc/core to 1.3.41

* chore: update @noble/ed25519 by a patch version

* chore: update ts-proto and eslint/parser dev deps

* chore: upgrade pino minor version

* chore: upgrade tsx minor version

* chore: add changeset
 2023-03-18 17:26:45 -07:00
Shane da Silva
75ed86a30a chore: changeset version bumps (#676) 2023-03-18 13:13:38 -07:00
adityapk00
4e6b83e10c feat: Retry rocksDB lock during open (#666) 2023-03-18 12:58:22 -07:00
Anthony D'Addeo
86c00f5326 refactor: simplify Eip712Signer interface (#673) 
* refactor: simplify Eip712Signer interface

* add changeset
 2023-03-18 14:55:09 -05:00
Paul Fletcher-Hill
269337c7e6 improve engine error messages (#674) 2023-03-18 15:44:33 -04:00
adityapk00
8f2c6ef0e7 fix: Increase Q limits now that we have more memory. (#668) 
* fix: Increase Q limits now that we have more memory.

* changeset
 2023-03-17 14:28:40 -07:00
adityapk00
2bd81f6255 feat: Admin server on localhost only (#667) 2023-03-17 13:27:11 -07:00
Varun Srinivasan
73d11308fb chore: changeset version bumps (#660) 2023-03-16 13:28:19 -07:00
Varun Srinivasan
a74ecb2097 refactor(farcaster/hub-nodejs): rename farcaster/js to farcaster/hub-nodejs (#658) 
* refactor: rename farcaster/js to farcaster/hub-nodejs

* chore: add changeset
 2023-03-16 13:08:05 -07:00
Paul Fletcher-Hill
9b4a7fea27 fix prune messages job (#655) 2023-03-16 13:00:45 -04:00
Paul Fletcher-Hill
68230b7f86 chore: move submitIdRegistryEvent and submitNameRegistryEvent to admin grpc service (#650) 
* move submitIdRegistryEvent and submitNameRegistryEvent to admin grpc service

* add changeset

* fix imports
 2023-03-15 13:31:36 -04:00
Anthony D'Addeo
e7602bdd31 feat: pagination for list queries and gRPC (#610) 
* poc

* address pr feedback, add pagination to getAllSignerMessagesByFid

* fix types

* use bytes and uint32

* move makeEndPrefix into utils

* getSignersByFid

* fix: getCastsByFid should return items in reverse chronological order

* returns casts in chronological order

* fix: getCastsByFid should return casts in chronological order

In the RocksDB iterator we use to construct thashes for the messages query, select only the CastMessages which are CastAdds

* rename page options and move page iterator to message file

* intermediate commit

* fix tests

* use suffixes as tokens rather than full keys

* remove commented out code

* paginate getCastsByParent, getCastsByMention, getReactionsByCast

* add changeset and fix linting

* update multiPeerSyncEngine test

* add more tests

* fix import

---------

Co-authored-by: bstchow <36556453+bstchow@users.noreply.github.com>
Co-authored-by: Paul Fletcher-Hill <pfletcherhill@gmail.com>
 2023-03-15 01:15:31 -04:00
adityapk00
d809846423 fix: Catch timeouts during shutdown (#643) 2023-03-13 09:33:26 -07:00
Shane da Silva
935b6ec6e8 chore: changeset version (#640) 2023-03-12 14:34:11 -07:00
Paul Fletcher-Hill
f55fa8a219 feat: refactor @farcaster/js to only export from utils and protobufs (#636) 
* remove js files and export from utils and protobufs

* remove hex methods and add changeset
 2023-03-11 18:38:12 -05:00
Shane da Silva
fe503a29c8 chore: changeset version (#637) 2023-03-11 14:10:18 -08:00