Commit Graph

272 Commits

Author SHA1 Message Date
Sanjay
5cee2c5526 fix: Fix off by one error when retrying id registry event on sync (#899)
* fix: Fix off by one error when retrying id registry event on sync

* feat: Add a command line flag to resync eth events from the beginning

* Add changeset
2023-04-20 18:18:49 -07:00
Kind Jeff
7d8f1aa524 chore: add new mainnet peer for rss3 (#890)
from https://github.com/NaturalSelectionLabs
2023-04-19 21:02:19 -07:00
Niranjan Singh
9d56e84fe0 Adding @nj's PeerID to be allowed to run mainnet hub (#897) 2023-04-19 16:02:18 -07:00
Manan
f7ff9b81b0 Adding a peer for mainnet (#881) 2023-04-19 13:06:13 -07:00
Paul Fletcher-Hill
c5a6aac6e4 changeset version (#889) 2023-04-19 00:43:57 -04:00
Paul Fletcher-Hill
87b2789124 feat: support arbitrary target types (#847)
* support CastId embeds, url parents and reaction targets

* docs(changeset): support CastId embeds, cast parent URLs, and reaction target URLs

* fix validations test

* add version and embeds deprecated validation

* docs(changeset): upgrade to protocol version 2023.4.19

* update protobuf generated code

* add reaction service tests

* add more examples to builder tests

* add more cast and reaction tests
2023-04-18 23:10:13 -04:00
Sanjay
aabe4f21bb chore: fail the build if current version is too close to expiry (#888) 2023-04-18 18:11:45 -07:00
Sanjay
a027a3ed63 fix: compact the db occasionally when syncing to avoid db bloat (#884)
* fix: compact the db occasionally when syncing to avoid db bloat

* Additional tests and logging

* add changeset
2023-04-18 15:25:47 -07:00
Milo Watanabe
fbb78de341 add new mainnet hub (#880) 2023-04-18 11:51:46 -07:00
David Furlong
a67c7c2d6e Update allowedPeers.mainnet.ts (#886) 2023-04-18 11:49:08 -07:00
Paul Fletcher-Hill
0cb0a522b2 chore: re-organize sync engine to use submitMessage rather than mergeMessage (#878)
* upgrade hub-web in examples and move gossip to hubble

* use submitMessage for sync

* simplify logging in sync engine

* remove sync related methods from storage engine

* cleanup imports and remove test methods

* add changeset
2023-04-18 00:49:57 -04:00
Paul Fletcher-Hill
8a7e781fae changeset version hubble v1.1.0 (#869) 2023-04-12 21:31:11 -04:00
Sanjay
34fe54f3cc feat: Include network id in gossip topics to keep networks isolated (#861)
* chore: cleaner logging when ignoring peers

* feat: Include network id in gossip topics to keep peers homogeneous

* Add changeset
2023-04-12 16:27:14 -07:00
Sanjay
c5c0d98247 chore: Add mainnet peer for sanjay (#868) 2023-04-12 15:04:01 -07:00
Sanjay
8758ef2e1a chore: log sync status for better visibility (#865)
* fix: log sync status for better visibility

* Add peer version and network to sync status logs
2023-04-12 14:05:15 -07:00
Greg Skriloff
9cdb60a8fb docs: Correct steps to reset db in hubble readme (#848) 2023-04-12 06:18:30 -07:00
Varun Srinivasan
503740d25a chore: add peer ids for trusted mainnet hubs from users (#858) 2023-04-11 15:29:42 -07:00
adityapk00
0a3b09c960 Killstream (#843)
* fix: Kill streams if client is not responding

* end iterator

* log error and return error with destroy

---------

Co-authored-by: Paul Fletcher-Hill <pfletcherhill@gmail.com>
2023-04-10 19:46:24 -04:00
Sanjay
31d8917f66 feat: make commit lock queue size and timeout configurable (#830)
* feat: make commit lock queue size and timeout configurable

* Add changeset

* make StorageCache a child of StoreEventHandler

---------

Co-authored-by: Paul Fletcher-Hill <pfletcherhill@gmail.com>
2023-04-10 15:17:22 -04:00
Sanjay
562b9639b1 chore: Add test to ensure verification and claim must have same network (#836)
* chore: Add test to ensure verification and claim must have same network

* cleanup
2023-04-10 09:58:14 -07:00
adityapk00
a3b0d098ec chore: Check in mainnet allowed peers (#844)
* chore: Check in mainnet allowed peers

* changeset
2023-04-07 12:42:42 -07:00
adityapk00
25c768d943 fix: Hangup on peers when removing from address book (#841)
* fix: Hangup on peers while removing from address book.

* changeset

* test disconnect both ways

* sleep
2023-04-07 10:38:21 -07:00
adityapk00
0fbbbccf24 fix: Make dbreset its own command (#838) 2023-04-07 07:59:01 -07:00
Varun Srinivasan
038a647bd7 chore: release new versions (#839) 2023-04-06 17:47:33 -07:00
Sanjay
edea195dba feat: ensure hub networks match when syncing with peers (#837)
* feat: ensure hub networks match when syncing with peers

* send the network when gossiping
2023-04-06 17:29:20 -07:00
Sanjay
d12ed86add fix: handle invalid version strings (#833)
* fix: handle invalid version string

* simplify version check
2023-04-06 11:53:27 -07:00
adityapk00
d0fa584e7a fix: Log cases where the subscribe stream is not being consumed (#825) 2023-04-05 14:15:05 -07:00
Sanjay
7aad7542ca Fix build due to merge conflict with main (#824) 2023-04-05 12:49:42 -07:00
Sanjay
8bf29bc209 feat: prune unreachable peers and periodically gossip contact info (#817) 2023-04-05 10:00:09 -07:00
Paul Fletcher-Hill
64418e9495 changeset version (#820) 2023-04-04 23:28:23 -04:00
PangZhi
c4529a7ef2 feat: merge protobufs and utils into core package (#818)
* remove protobufs as a package, merge into utils

* update yarn.lock

* rename utils package to core

* update docker

* add changeset

* tsup config

* change schema path in workflow file

* update protobufs readme link
2023-04-04 19:21:30 -07:00
Paul Fletcher-Hill
58af42fdda chore: run changeset version (#816)
* update hub-web changeset from major to minor

* run changeset version
2023-04-04 18:52:33 -04:00
Paul Fletcher-Hill
088da4722e allow client to subscribe from 0 fromId (#814) 2023-04-04 17:03:26 -04:00
Sanjay
759e1cfbc0 feat: ignore hubs below minimum version for sync (#808)
* feat: ignore hubs below minimum version for sync

* fix tests and add changeset
2023-04-04 13:09:31 -07:00
adityapk00
8e46cac194 fix: Start the rpc Server before the ethEventsProvider for smoke test (#812)
* fix: Start the rpc Server before the ethEventsProvider for smoke test

* changeset
2023-04-04 12:19:03 -07:00
adityapk00
13415ead71 fix: Prevent slow subscribers from crashing the hub (#799)
* fix: Prevent slow subscribers from crashing the hub

* changeset

* Add bufferedStreamWriter

* register listeners first

* Check if iterator has ended before ending it

* fix compile
2023-04-04 11:52:50 -07:00
PangZhi
1f47906693 feat: refactor protobufs and utils to remove grpc-js dependency (#798)
* remove grpc-js dependency from protobufs, refactor hubble to use hub-nodejs

* hub-web to use @farcaster/protobufs and utils

* add yarn.lock

* refactor hubble app to only use hub-nodejs

* update readme

* update export order

* update export order

* fix protobufs namespace build issue

* update codecov

* fix protobufCommand naming

---------

Co-authored-by: Paul Fletcher-Hill <pfletcherhill@gmail.com>
2023-04-04 09:27:53 -07:00
adityapk00
71d6494c04 fix: Better error when id protobuf is not found (#807)
* fix: More information when peerId proto is not found

* changeset
2023-04-04 07:10:34 -07:00
adityapk00
9e39bb8156 docs: update docs to close() grpc connection (#790)
* docs: Update docs to close grpc connections

* changeset
2023-04-04 07:07:10 -07:00
adityapk00
54dbf42fb5 fix: End iterator if returning early from forEachMessage (#800) 2023-04-04 07:06:12 -07:00
Paul Fletcher-Hill
a55fb80c34 feat: add validate or revoke messages cleanup job (#801)
* add validate or revoke messages cleanup job

* make validateMessage private again
2023-04-03 19:30:20 -04:00
Paul Fletcher-Hill
7c9ca5aac0 add farcaster version and check version job (#795) 2023-04-03 17:56:21 -04:00
PangZhi
3ac5315fd5 feat: add hub-web package to only depend on grpc-web (#797)
* add new hub-web package and generate code from grpc-web

* expose RpcWebClient

* add envoy support

* update readme and changelog

* add changeset

* move envoy to apps/hubble and fix service name

* reduce the code generation from protoc to only rpc.proto
2023-04-03 11:35:08 -07:00
adityapk00
d0239f8e53 fix: Retry bootstrap nodes if they fail to connect at startup (#794)
* fix: Retry bootstrap nodes if they fail to connect at startup

* changeset
2023-03-31 11:35:21 -07:00
adityapk00
564f61e2f0 fix: Fetch missing IdRegistry from the contract instead of the peer (#792)
* fix: Fetch missing IdRegistry from the contract instead of the peer

* changeset
2023-03-31 09:19:24 -07:00
Paul Fletcher-Hill
142f3f52c2 add getIdRegistryEventByAddress method (#791) 2023-03-31 12:10:34 -04:00
adityapk00
b9643b210e fix: Sync was sometimes off by 1 (#780)
* fix: Sync was sometimes off by 1

* changeset
2023-03-30 15:35:35 -07:00
adityapk00
e900d010ee Release v1.0.19 of hubble (#789) 2023-03-30 13:06:00 -07:00
adityapk00
9ee10769c2 fix: Improve RPC error messages (#788) 2023-03-30 11:23:36 -07:00
adityapk00
1f3286538d fix: Missed a check if previous PR (#786) 2023-03-29 19:47:16 -07:00