Commit Graph

292 Commits

Author SHA1 Message Date
Sagar Dhawan
530878831d fix: improve handling of duplicate messages on gossip (#919)
* fix: improve handling of duplicate messages on gossip

* fix tests

* fix changeset

* make gossip backwards compatible

* fix tests
2023-05-05 13:02:52 -07:00
Sanjay
f0e4df7d78 chore: ensure we clear the event handler cache in tests (#942) 2023-05-05 12:11:09 -07:00
Sanjay
5d1fef9db7 fix: Only consider a peer bad if we failed to merge a large number of messages (#939) 2023-05-04 21:36:12 -07:00
Paul Fletcher-Hill
2e633db09b feat: reject prunable messages on merge (#928)
* feat: don't merge messages that would immediately be pruned

* Fix tests and minor cleanup/review comments

* Support all other stores

* Add changeset

* use prune iterator with keys available and expand cast store tests

* re-add prune iterator args

* Additional tests

* Add tests for other stores

---------

Co-authored-by: Sanjay Raveendran <sanjayprabhu@gmail.com>
2023-05-04 10:35:32 -07:00
Tiago Alves
d3f707be82 Minor fix on hubs interaction link (#931) 2023-05-02 09:31:54 -07:00
Tiago Alves
36fe1b7990 Add eventcaster hub to allowlist (#929) 2023-05-01 15:15:31 -07:00
Sanjay
6c8c05d957 fix: Fix inSync reporting true when peer is blocked from sync (#934) 2023-05-01 14:58:20 -07:00
Meyanis95
aa8f451861 Ask to run a mainnet Hub (#927) 2023-04-28 09:23:12 -04:00
Rohit Jha
806e5a1f31 chore: added jam.so peer id to mainnet allowed peers (#926) 2023-04-28 08:28:22 -04:00
Sanjay
52fc714970 chore: Release 1.2.1 (#925) 2023-04-27 14:36:13 -07:00
Sanjay
427ced4f1b feat: Remember bad peers during sync and ignore them for a while. (#920)
This helps reduce excessive sync attempts (attempting to sync
with a peer that's catching up for the first time, sync divergence
prefix bugs, etc)
2023-04-26 20:40:04 -07:00
Sanjay
421c385453 feat: Add sync stats to getInfo call (#916)
* refactor: Rename sync events flag for clarity

* feat: Add sync statuts to HubInfo RPC call

* feat: Add sync stats to getInfo rpc call

* re-patch hub-web to use default export as before

* changeset
2023-04-25 10:40:59 -07:00
Sanjay
4fc319812e fix: Dedup eth events retries by block number to save api calls (#917) 2023-04-25 10:40:42 -07:00
Paul Fletcher-Hill
71e9248ec2 add @les (#914) 2023-04-24 22:15:04 -04:00
Varun Srinivasan
e53b38b9c5 docs(hubble): add pm2 logrotate, exponential backoff to address common failures (#913) 2023-04-24 15:28:38 -07:00
Varun Srinivasan
a5fa70d652 docs(hubble): use hubble/latest instead of a specific version (#912) 2023-04-24 15:05:40 -07:00
Paul Fletcher-Hill
38b434ae0b log when stream starts (#909) 2023-04-24 16:00:19 -04:00
Paul Fletcher-Hill
1680726c36 parse cli chunk-size as number (#908) 2023-04-24 15:29:41 -04:00
Crypto Benkei
8f6754df45 chore: Add mainnet peer to allowed peers (#901) 2023-04-23 20:10:33 -07:00
Varun Srinivasan
f2f7297a13 docs(hubble): add instructions for connecting to mainnet (#903)
* chore(hubble): remove all references to flatbuffers

* docs(hubble): update getting started with mainnet instructions
2023-04-21 11:02:49 -07:00
Sanjay
5cee2c5526 fix: Fix off by one error when retrying id registry event on sync (#899)
* fix: Fix off by one error when retrying id registry event on sync

* feat: Add a command line flag to resync eth events from the beginning

* Add changeset
2023-04-20 18:18:49 -07:00
Kind Jeff
7d8f1aa524 chore: add new mainnet peer for rss3 (#890)
from https://github.com/NaturalSelectionLabs
2023-04-19 21:02:19 -07:00
Niranjan Singh
9d56e84fe0 Adding @nj's PeerID to be allowed to run mainnet hub (#897) 2023-04-19 16:02:18 -07:00
Manan
f7ff9b81b0 Adding a peer for mainnet (#881) 2023-04-19 13:06:13 -07:00
Paul Fletcher-Hill
c5a6aac6e4 changeset version (#889) 2023-04-19 00:43:57 -04:00
Paul Fletcher-Hill
87b2789124 feat: support arbitrary target types (#847)
* support CastId embeds, url parents and reaction targets

* docs(changeset): support CastId embeds, cast parent URLs, and reaction target URLs

* fix validations test

* add version and embeds deprecated validation

* docs(changeset): upgrade to protocol version 2023.4.19

* update protobuf generated code

* add reaction service tests

* add more examples to builder tests

* add more cast and reaction tests
2023-04-18 23:10:13 -04:00
Sanjay
aabe4f21bb chore: fail the build if current version is too close to expiry (#888) 2023-04-18 18:11:45 -07:00
Sanjay
a027a3ed63 fix: compact the db occasionally when syncing to avoid db bloat (#884)
* fix: compact the db occasionally when syncing to avoid db bloat

* Additional tests and logging

* add changeset
2023-04-18 15:25:47 -07:00
Milo Watanabe
fbb78de341 add new mainnet hub (#880) 2023-04-18 11:51:46 -07:00
David Furlong
a67c7c2d6e Update allowedPeers.mainnet.ts (#886) 2023-04-18 11:49:08 -07:00
Paul Fletcher-Hill
0cb0a522b2 chore: re-organize sync engine to use submitMessage rather than mergeMessage (#878)
* upgrade hub-web in examples and move gossip to hubble

* use submitMessage for sync

* simplify logging in sync engine

* remove sync related methods from storage engine

* cleanup imports and remove test methods

* add changeset
2023-04-18 00:49:57 -04:00
Paul Fletcher-Hill
8a7e781fae changeset version hubble v1.1.0 (#869) 2023-04-12 21:31:11 -04:00
Sanjay
34fe54f3cc feat: Include network id in gossip topics to keep networks isolated (#861)
* chore: cleaner logging when ignoring peers

* feat: Include network id in gossip topics to keep peers homogeneous

* Add changeset
2023-04-12 16:27:14 -07:00
Sanjay
c5c0d98247 chore: Add mainnet peer for sanjay (#868) 2023-04-12 15:04:01 -07:00
Sanjay
8758ef2e1a chore: log sync status for better visibility (#865)
* fix: log sync status for better visibility

* Add peer version and network to sync status logs
2023-04-12 14:05:15 -07:00
Greg Skriloff
9cdb60a8fb docs: Correct steps to reset db in hubble readme (#848) 2023-04-12 06:18:30 -07:00
Varun Srinivasan
503740d25a chore: add peer ids for trusted mainnet hubs from users (#858) 2023-04-11 15:29:42 -07:00
adityapk00
0a3b09c960 Killstream (#843)
* fix: Kill streams if client is not responding

* end iterator

* log error and return error with destroy

---------

Co-authored-by: Paul Fletcher-Hill <pfletcherhill@gmail.com>
2023-04-10 19:46:24 -04:00
Sanjay
31d8917f66 feat: make commit lock queue size and timeout configurable (#830)
* feat: make commit lock queue size and timeout configurable

* Add changeset

* make StorageCache a child of StoreEventHandler

---------

Co-authored-by: Paul Fletcher-Hill <pfletcherhill@gmail.com>
2023-04-10 15:17:22 -04:00
Sanjay
562b9639b1 chore: Add test to ensure verification and claim must have same network (#836)
* chore: Add test to ensure verification and claim must have same network

* cleanup
2023-04-10 09:58:14 -07:00
adityapk00
a3b0d098ec chore: Check in mainnet allowed peers (#844)
* chore: Check in mainnet allowed peers

* changeset
2023-04-07 12:42:42 -07:00
adityapk00
25c768d943 fix: Hangup on peers when removing from address book (#841)
* fix: Hangup on peers while removing from address book.

* changeset

* test disconnect both ways

* sleep
2023-04-07 10:38:21 -07:00
adityapk00
0fbbbccf24 fix: Make dbreset its own command (#838) 2023-04-07 07:59:01 -07:00
Varun Srinivasan
038a647bd7 chore: release new versions (#839) 2023-04-06 17:47:33 -07:00
Sanjay
edea195dba feat: ensure hub networks match when syncing with peers (#837)
* feat: ensure hub networks match when syncing with peers

* send the network when gossiping
2023-04-06 17:29:20 -07:00
Sanjay
d12ed86add fix: handle invalid version strings (#833)
* fix: handle invalid version string

* simplify version check
2023-04-06 11:53:27 -07:00
adityapk00
d0fa584e7a fix: Log cases where the subscribe stream is not being consumed (#825) 2023-04-05 14:15:05 -07:00
Sanjay
7aad7542ca Fix build due to merge conflict with main (#824) 2023-04-05 12:49:42 -07:00
Sanjay
8bf29bc209 feat: prune unreachable peers and periodically gossip contact info (#817) 2023-04-05 10:00:09 -07:00
Paul Fletcher-Hill
64418e9495 changeset version (#820) 2023-04-04 23:28:23 -04:00