Commit Graph

277 Commits

Author SHA1 Message Date
Sanjay
40cacee931 fix: Drop signer constraint in replicator temporarily (#1298) 2023-08-29 10:07:10 -07:00
Sanjay
35b0d2a281 feat: Support onchain events and username proofs in replicator (#1297) 2023-08-29 08:01:32 -07:00
Sanjay
ec0264e7dc chore: Release 1.5 (#1287) 2023-08-23 15:55:45 -07:00
Sanjay
bf1c44d2f1 feat: Add new signer event fields and new onchainevent RPC calls (#1276)
* feat: RPC compatibility for migration

* Add rpc tests

* Store key and metadata types on onchain signer events

* changeset

* Use generic iterator
2023-08-18 22:06:39 -07:00
adityapk00
ee3897f3f0 feat: Add startup checks and progress bars (#1268)
* feat: Add startup checks and progress bars


* changeset

* typo

* cli option to diable

* initial sync progress bar

* change cli option name

* Install instructions
2023-08-17 09:31:51 -05:00
Sanjay
e6180074d8 feat: enforce storage pruning 1 day after migration (#1267) 2023-08-15 20:00:52 -07:00
Manan
ac12e69d1b remove hub_subscriptions on migrate down, add utility functions (#1249) 2023-08-14 14:20:26 -07:00
adityapk00
75099a855f chore: Release v1.4.6 (#1261) 2023-08-14 15:44:50 -05:00
Sanjay
1fcfd49517 fix: last block bugs with events providers (#1243)
* fix: last block bugs with events providers

* Remove usages of name registry worker

* Better defaults for OP constants

* Fix tests

* Add changeset
2023-08-14 13:32:45 -07:00
Sanjay
c6d79cdbb8 feat: Handle onchain event edge cases (#1240)
* feat: Handle onchain event ordering edge cases

* changeset

* validate scheme for signer

* Sort events by blocknumber and logindex to reflect actual order of onchain operations

* revert enum ordering changes
2023-08-09 10:14:20 -07:00
adityapk00
e55e571f2d chore: add "getting blockchain events" to hub status (#1239) 2023-08-09 09:04:50 -05:00
Manan
cbc45b5a98 fix: resolves conflicts for links_fid_target_fid_type_unique (#1223)
* fix: resolves conflicts for links_fid_target_fid_type_unique

* delete the rows to fix for follow/unfollow back & forth.

* keep the soft deletes but ensure we don't get multiple rows for a follow relation
2023-08-08 23:47:08 -07:00
adityapk00
0752a27283 Update release (#1238) 2023-08-08 13:11:33 -05:00
adityapk00
41334ab865 fix: Move rust code to apps/hubble, @farcaster/core to PureJS (#1235)
* fix: Move rust code to apps/hubble, @farcaster/core to PureJS

* changeset

* cleanup

* lint

* fix path for tests
2023-08-08 12:29:05 -05:00
Landon
9daee18b14 fix: typo's regarding time utilities in hub-nodejs (#1224) 2023-08-07 20:56:21 -07:00
Shane da Silva
8f7c6a36db chore: Cut patch release to fix neon shim (#1233) 2023-08-07 17:51:45 -07:00
adityapk00
afd2146f80 fix: Remove neon shim (#1232)
* fix: Remove neon shim

* changeset
2023-08-07 19:40:41 -05:00
Shane da Silva
4f9bc9cb71 chore: Cut patch release for core and hub-nodejs (#1231)
This removes Rust for now, until we have prebuilt packages for multiple
architectures.
2023-08-07 17:01:10 -07:00
adityapk00
cfec77670a fix: Disable the rust codepath (#1230) 2023-08-07 18:44:11 -05:00
Shane da Silva
505790be6c chore: Cut Hubble version 1.4.4 and other package upgrades (#1228) 2023-08-07 16:10:29 -07:00
adityapk00
503b379dcb feat: Integrity checks during Sync (#1225)
* feat: Check integrity during sync

* changeset

* test
2023-08-07 11:27:18 -05:00
Sanjay
86149d3277 feat: Storage RPC (#1211)
* Storage RPC

* added changeset

* updated docs

* Add tests and minor cleanup

* Rename signer on chain event factory for clarity

---------

Co-authored-by: Cassie Heart <cassie@merklemanufactory.com>
2023-08-03 17:10:25 -07:00
Sanjay
67e9466ed5 feat: Refactor storage events to use OnChainEvent (#1210)
* feat: Refactor storage events to use OnChainEvent

* Add tests for getOnChainEvents

* Add changeset

* Guarantee ordering to fix tests
2023-08-02 16:53:11 -07:00
adityapk00
3f180073ab chore: Setup grpc server timeouts (#1208)
* chore: Setup grpc server timeouts

* Update package.json
2023-08-02 11:24:00 -05:00
Sanjay
dcd7a14920 feat: Implement migrating to L2 (#1203)
* feat: onchain signers

* Refactor l2 provider to accept more contracts and events easily

* flesh out support for storing onchain events

* Switch source of truth on migration

* Emit events and fix active signer
2023-08-01 10:17:40 -07:00
Manan
7012a4c377 fix: unique hash on links, index embeds (#1174)
* fix: unique hash on links, index embeds

* fixes linting

* handle conflicts on the uniqueness

* remove the 2nd onConflict

* fix: merges embedsDeprecated into embeds

* yarn lint

* remove embedsDeprecated from interface
2023-07-31 22:44:02 -07:00
adityapk00
eae1ba848d test: Add rust tests (#1196) 2023-07-28 14:00:38 -07:00
adityapk00
ec7734cf77 feat: Move blake3 into rust (#1194) 2023-07-28 12:07:13 -07:00
adityapk00
15fad46703 feat: Add Rust toolchain to Hubble and move ed25519 to rust (#1191)
* feat: Add Rust toolchain to hubble and move ed25519 to rust

* changeset

* cleanup

* Add rust-toolchain

* Add Rust installation to docs

* Update docs

* tests for invalid data

* fix: Fix TestData generator for testnet (#1193)

* fix: Fix TestData generator for testnet

* changeset

* update docs
2023-07-28 09:32:03 -07:00
Cassandra Heart
d443fbe9f9 feat: Adds support for storage/logging if would be pruned (#1165)
* Adds support for storage/logging if would be pruned

* pr feedback, fixed unclosed iterator

* update test to increment timestamp so fast runs of test don't hit prune early

* Add test to verify cache invalidation
2023-07-24 09:42:12 -07:00
Sanjay
f49df2d87b chore: release 1.4.3 (#1173) 2023-07-20 15:26:56 -07:00
Christian Mladenov
e36fcae936 Fix proof message timestamp validation & add builders for UsernameProofData and UsernameProofMessage (#1164) 2023-07-19 11:43:10 -07:00
Sanjay
88f31f27dc fix: Fix typing for merge username proof events (#1161) 2023-07-17 20:10:58 -07:00
Varun Srinivasan
9668d34e40 chore: release hubble v1.4.1 and new package versions (#1143) 2023-07-14 22:30:56 -07:00
Christian Mladenov
57235761a8 chore: remove obsolete ethers dependency from hub-nodejs (#1105) 2023-07-14 11:24:03 -07:00
Tony D'Addeo
1fd9b2b22a docs: improve chron-feed example, upgrade @farcaster packages in examples (#1126)
* docs: fix chronfeed example

* bump farcaster package versions in examples

* run linter
2023-07-13 12:30:09 -05:00
Cassandra Heart
2391c3a5e3 feat: storage registry support (#1052)
This PR adds support for storage events and includes the following changes:

Adds support for storage events in the protobufs
Updates the server to handle rent registry events
Updates the logger to include rent registry and storage admin registry events
Adds CLI option for L2 RPC URL
Adds methods to submit rent registry and storage admin registry events in the mock hub
Updates the sync engine to use L2 events provider
2023-07-12 18:43:41 -05:00
Zach Terrell
9d843aac76 feat: Add hash to links table in postgres replicator (#1113)
* improvement: add hash to links table

* add type to Kysely

* add rome formatting
2023-07-12 11:04:05 -07:00
Sanjay
0223f670fa chore: fix flaky validations test (#1110) 2023-07-11 18:02:02 -07:00
Sanjay
e072a0e535 chore: Release 1.3.4 (#1109) 2023-07-11 17:34:17 -07:00
Sanjay
4fa7a56153 Rename UserDataType.FNAME to USERNAME (#1108) 2023-07-11 17:16:53 -07:00
Sanjay
cd0ddd6d24 feat: Support ENS names in the hub (#1101)
* feat: Add ENS username proof support

* Add UserNameProof store

* ENS name ownership validations

* Add remaining ens validations

* Generate events correctly

* Allow setting ens names on UserData and handle revoking it

* Add changeset and cli flag
2023-07-10 23:40:50 -07:00
dependabot[bot]
68a687d783 build(deps): bump protobufjs in /packages/hub-nodejs/examples/chron-feed (#1091)
Bumps [protobufjs](https://github.com/protobufjs/protobuf.js) from 7.2.2 to 7.2.4.
- [Release notes](https://github.com/protobufjs/protobuf.js/releases)
- [Changelog](https://github.com/protobufjs/protobuf.js/blob/master/CHANGELOG.md)
- [Commits](https://github.com/protobufjs/protobuf.js/compare/protobufjs-v7.2.2...protobufjs-v7.2.4)

---
updated-dependencies:
- dependency-name: protobufjs
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-10 14:32:27 -07:00
dependabot[bot]
4cba08e76b build(deps): bump protobufjs in /packages/hub-nodejs/examples/write-data (#1092)
Bumps [protobufjs](https://github.com/protobufjs/protobuf.js) from 7.2.2 to 7.2.4.
- [Release notes](https://github.com/protobufjs/protobuf.js/releases)
- [Changelog](https://github.com/protobufjs/protobuf.js/blob/master/CHANGELOG.md)
- [Commits](https://github.com/protobufjs/protobuf.js/compare/protobufjs-v7.2.2...protobufjs-v7.2.4)

---
updated-dependencies:
- dependency-name: protobufjs
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-10 14:32:18 -07:00
dependabot[bot]
ee217cabb9 build(deps): bump protobufjs in /packages/hub-nodejs/examples/make-cast (#1093)
Bumps [protobufjs](https://github.com/protobufjs/protobuf.js) from 7.2.2 to 7.2.4.
- [Release notes](https://github.com/protobufjs/protobuf.js/releases)
- [Changelog](https://github.com/protobufjs/protobuf.js/blob/master/CHANGELOG.md)
- [Commits](https://github.com/protobufjs/protobuf.js/compare/protobufjs-v7.2.2...protobufjs-v7.2.4)

---
updated-dependencies:
- dependency-name: protobufjs
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-10 14:32:10 -07:00
dependabot[bot]
81bee098b3 build(deps): bump protobufjs (#1094)
Bumps [protobufjs](https://github.com/protobufjs/protobuf.js) from 7.2.3 to 7.2.4.
- [Release notes](https://github.com/protobufjs/protobuf.js/releases)
- [Changelog](https://github.com/protobufjs/protobuf.js/blob/master/CHANGELOG.md)
- [Commits](https://github.com/protobufjs/protobuf.js/compare/protobufjs-v7.2.3...protobufjs-v7.2.4)

---
updated-dependencies:
- dependency-name: protobufjs
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-10 14:32:01 -07:00
dependabot[bot]
847046ff93 build(deps): bump @grpc/grpc-js from 1.8.7 to 1.8.8 (#1083)
Bumps [@grpc/grpc-js](https://github.com/grpc/grpc-node) from 1.8.7 to 1.8.8.
- [Release notes](https://github.com/grpc/grpc-node/releases)
- [Commits](https://github.com/grpc/grpc-node/compare/@grpc/grpc-js@1.8.7...@grpc/grpc-js@1.8.8)

---
updated-dependencies:
- dependency-name: "@grpc/grpc-js"
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-10 14:31:50 -07:00
Akshaan Kakar
2bfcaf4ec3 feat: create a system to track network propagation delay (#970)
* Add new proto definitions

* Add ping and ack functions

* Add gossip event handler

* Add cli argument for network latency mode

* Add ping message scheduler

* Fix imports

* Add tests for message handler

* Add metrics store

* Fix cli arg name

* Add multinode setup and fix metric logging

* Add docker-compose file for multinode test setup

* Drop hard coded id paths

* preserve backward compatibility of process file path

* Enable gossip network diagnostics

* Add tests 1

* Clean up gossipNode tests

* Fix lint

* Lower frequency for latency pings

* Add tests for metrics

* Improve coverage computation algo

* Clean up

* Fixes from PR feedback

* Fixes from PR feedback

* Fixes from PR feedback

* Rename field for consistency

* Add jitter to ping cron

Add jitter to ping cron

* Log legible peerIds

* Fix import paths

* Update log field name

* Consolidate metrics recorder and ping job

* Fix docker compose

* Add time-to-merge metric

* Confine metrics logic to single class

* Clean up

* Fix div by zero

* Use peerId string as metrics key

* Drop unused getter

* Refactor metrics to be keyed by peerId

* Fix tests

* Clean up and fix tests

* Store metrics in DB

* Replace interfaces with types

* Fix testS

* WIP: Adding metrics serde

* Replace map with object to allow for metrics serde

* Add test for serde

* Fix security warnings

* Fix coverage logging

* Add test

* Move message handling to hub

* Fix timestamp overflow

* Lower ping freq and fix coverage logging

* Add peer network to logs

* Fix merge time metric

* Revert "Fix merge time metric"

This reverts commit 76beb5f11a.

* Expire metrics after logging

* Rename command line arguments

* Fixes + test updateS

* Fixes + test updateS

* Add test for expiry

* Add test for ping function

* Drop unused function

* Record merge times for all merges

* Don't accumulate message count metrics

* Add check for successful message merge

* Re-add generated code

* Fix types

* Re-add generated code

* Fix imports

* fix imports
2023-07-07 21:02:59 -04:00
Greg Skriloff
41c3b7b72a docs: update schema in the postgres example (#1069) 2023-07-05 20:38:36 +03:00
Varun Srinivasan
4c38067c15 chore: switch from eslint/prettier to rome (#1074)
* chore: add rome config files

* chore: add rome into configs and ci

* chore: remove eslint annotations

* chore: update annotations for rome ignores

* chore: remove prettier
2023-07-04 19:09:15 -07:00