mirror of
https://github.com/farcasterxyz/hub-monorepo.git
synced 2026-01-24 12:38:00 -05:00
@farcaster/hub-shuttle@0.1.4
1327 Commits
| Author | SHA1 | Message | Date | |
|---|---|---|---|---|
Sanjay
|
c72bf8f92b |
fix(shuttle): fix interfaces export (#1892)
## Motivation Fix import bug ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the version to `0.1.4`, fixes an issue with interfaces import, and improves logging in the `hub-shuttle` package. ### Detailed summary - Updated package version to `0.1.4` - Fixed interfaces import issue - Improved logging functionality in message processing > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex -->@farcaster/hub-shuttle@0.1.4 |
||
|
Sanjay
|
d87e370d66 |
feat(shuttle): Refactor message reconciliation to use function (#1887)
## Motivation Use a separate function instead of message handler for reconciliation. ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers@farcaster/hub-shuttle@0.1.3 |
||
|
adityapk00
|
28e9c0147b |
chore: Release v1.11.5 (#1886)
## Motivation Describe why this issue should be fixed and link to any relevant design docs, issues or other relevant items. ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the versions of `@farcaster/hubble` and `@farcaster/hub-shuttle`, along with various fixes and performance improvements in the codebase. ### Detailed summary - Updated `@farcaster/hubble` version to `1.11.5` - Updated `@farcaster/hub-shuttle` version to `0.1.2` - Various fixes and performance improvements in `@farcaster/hubble`: - Added opt-out diagnostics reporting feature - Added L2_RPC_AUTHORIZATION_HEADER environment variable > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex -->@farcaster/hubble@1.11.5 @farcaster/hub-shuttle@0.1.2 |
||
|
adityapk00
|
4fc41e1bdc |
perf: Use threadpool while pruning old hub events (#1885)
## Motivation Use the threadpool while pruning old hub events ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR focuses on fixing and optimizing hub events pruning in a threadpool. ### Detailed summary - Added `rsDbDeleteAllKeysInRange` function in `rustfunctions.ts` - Updated `storeEventHandler.ts` to use `deleteAllKeysInRange` - Modified `package.json` to change test concurrency to 2 - Updated `utils.rs` and `rocksdb.rs` for iterator options and key deletion functionality > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Wasif Iqbal
|
436139f50c |
feat: Opt Out Hub Diagnostics (#1869)
## Motivation - Hub issues can be difficult to troubleshoot because they are part of decentralized network - There is no guarantee subtle edge cases will be surfaced in timely manner ## Change Summary - Add support for opt-out diagnostics reporter. Diagnostics are used to troubleshoot user issues and improve health of the network. No sensitive information is shared. - Add `--opt-out-diagnostics` flag. If `--opt-out-diagnostic true`, no errors will be reported to the Farcaster foundation team - Add environment variable `L2_RPC_AUTHORIZATION_HEADER` to support L2 RPC URLs where authorization header is required for event queries ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [x] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview The focus of this PR is to add opt-out diagnostics reporting and a diagnostic report URL feature to the Farcaster Hub. ### Detailed summary - Added opt-out diagnostics reporting feature - Introduced a diagnostic report URL option - Updated CLI flags and environment variables - Implemented diagnostic reporting functionality - Refactored diagnostic reporting logic into a separate file > The following files were skipped due to too many changes: `apps/hubble/src/eth/l2EventsProvider.ts`, `apps/hubble/src/utils/diagnosticReportWorker.ts` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
2dcb3e802a |
fix: Change out-of-order warning to statsd (#1884)
## Motivation Instead of logging out-of-order warnings, change them to statsd metric ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the `hubble` app to fix an out-of-order warning by replacing it with a statsd increment call. ### Detailed summary - Changed out-of-order warning to statsd increment call in `rpc/server.ts` of `hubble` app. > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
c838795d88 |
perf: Use threadpool for grpc queries (#1882)
## Motivation Some grpc queries were being executed in the main thread, and so when there was a lot of queries, the main thread would get locked up, causing the grpc health check to sometimes fail because the main thread didn't respond in time. This PR offloads some of the work of the queries, so as long as the server is healthy, it can immediately respond to healthchecks. In addition, this PR allows the servers to serve more clients/queries. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview The focus of this PR is to improve performance by running long gRPC queries in a threadpool. ### Detailed summary - Added `deferred_settle_messages` function to handle settling promises with messages - Moved gRPC query handling to a threadpool for improved performance > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
d90b127dec |
perf: Support multiple validation workers (#1880)
## Motivation Support multiple validation workers so that we can validate messages in parallel. This is not really used yet, but will be once we start merging bundles. ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR enhances performance by enabling multiple validation workers in the Hubble app. ### Detailed summary - Added support for multiple validation workers in the Hubble app for improved performance. - Refactored validation worker handling to utilize an array of workers. - Updated interfaces and types related to validation workers and messages. - Improved error handling and response structure in validation worker messages. > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
ab71a53bbd |
perf: LRU cache for activeSigner and IdRegistry (#1881)
## Motivation Every validateMessage gets the IdRegistry event and Active Signer. While we were caching signers, we weren't caching the immutable IdRegistry event, which was causing 2 DB gets per validateMessage. Cache both these in a new LRUCache ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR focuses on improving performance by adding an LRU Cache for active signers and ID registry events. ### Detailed summary - Added LRU Cache implementation for caching active signers and ID registry events - Updated cache clearing methods in the OnChainEventStore class - Implemented cache retrieval logic in OnChainEventStore methods for active signers and ID registry events - Added tests for the LRU Cache implementation in the `lruCache.test.ts` file > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
b069d1e9f4 |
fix: Adjust nightly validateOrRevoke job time to run earlier (#1878)
## Motivation Adjust the nightly job to run ~4 hours earlier so it finishes before morning peak traffic ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR adjusts the time for the nightly `validateOrRevokeMessagesJob` to run earlier in the Hubble app. ### Detailed summary - Changed the cron time for `validateOrRevokeMessagesJob` to run at 8:10 UTC. - Removed unnecessary `Date.now()` usage in `index.ts`. > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
dependabot[bot]
|
cdfcbce36e |
chore(deps): bump h2 from 0.3.24 to 0.3.26 in /apps/hubble/src/addon (#1871)
Bumps [h2](https://github.com/hyperium/h2) from 0.3.24 to 0.3.26. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/hyperium/h2/releases">h2's releases</a>.</em></p> <blockquote> <h2>v0.3.26</h2> <h2>What's Changed</h2> <ul> <li>Limit number of CONTINUATION frames for misbehaving connections.</li> </ul> <p>See <a href="https://seanmonstar.com/blog/hyper-http2-continuation-flood/">https://seanmonstar.com/blog/hyper-http2-continuation-flood/</a> for more info.</p> <h2>v0.3.25</h2> <h2>What's Changed</h2> <ul> <li>perf: optimize header list size calculations by <a href="https://github.com/Noah-Kennedy"><code>@Noah-Kennedy</code></a> in <a href="https://redirect.github.com/hyperium/h2/pull/750">hyperium/h2#750</a></li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/hyperium/h2/compare/v0.3.24...v0.3.25">https://github.com/hyperium/h2/compare/v0.3.24...v0.3.25</a></p> </blockquote> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/hyperium/h2/blob/v0.3.26/CHANGELOG.md">h2's changelog</a>.</em></p> <blockquote> <h1>0.3.26 (April 3, 2024)</h1> <ul> <li>Limit number of CONTINUATION frames for misbehaving connections.</li> </ul> <h1>0.3.25 (March 15, 2024)</h1> <ul> <li>Improve performance decoding many headers.</li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href=" |
||
|
dependabot[bot]
|
7f4ebe6986 |
chore(deps): bump undici from 5.28.3 to 5.28.4 in /packages/hub-nodejs/examples/contract-signatures (#1866)
Bumps [undici](https://github.com/nodejs/undici) from 5.28.3 to 5.28.4. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/nodejs/undici/releases">undici's releases</a>.</em></p> <blockquote> <h2>v5.28.4</h2> <h2>⚠️ Security Release ⚠️</h2> <ul> <li>Fixes <a href="https://github.com/nodejs/undici/security/advisories/GHSA-m4v8-wqvr-p9f7">https://github.com/nodejs/undici/security/advisories/GHSA-m4v8-wqvr-p9f7</a> CVE-2024-30260</li> <li>Fixes <a href="https://github.com/nodejs/undici/security/advisories/GHSA-9qxr-qj54-h672">https://github.com/nodejs/undici/security/advisories/GHSA-9qxr-qj54-h672</a> CVE-2024-30261</li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/nodejs/undici/compare/v5.28.3...v5.28.4">https://github.com/nodejs/undici/compare/v5.28.3...v5.28.4</a></p> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href=" |
||
|
dependabot[bot]
|
a7e32c9e06 |
chore(deps): bump h2 from 0.3.24 to 0.3.26 in /packages/hub-web/examples/rust-submitmessage (#1870)
Bumps [h2](https://github.com/hyperium/h2) from 0.3.24 to 0.3.26. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/hyperium/h2/releases">h2's releases</a>.</em></p> <blockquote> <h2>v0.3.26</h2> <h2>What's Changed</h2> <ul> <li>Limit number of CONTINUATION frames for misbehaving connections.</li> </ul> <p>See <a href="https://seanmonstar.com/blog/hyper-http2-continuation-flood/">https://seanmonstar.com/blog/hyper-http2-continuation-flood/</a> for more info.</p> <h2>v0.3.25</h2> <h2>What's Changed</h2> <ul> <li>perf: optimize header list size calculations by <a href="https://github.com/Noah-Kennedy"><code>@Noah-Kennedy</code></a> in <a href="https://redirect.github.com/hyperium/h2/pull/750">hyperium/h2#750</a></li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/hyperium/h2/compare/v0.3.24...v0.3.25">https://github.com/hyperium/h2/compare/v0.3.24...v0.3.25</a></p> </blockquote> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/hyperium/h2/blob/v0.3.26/CHANGELOG.md">h2's changelog</a>.</em></p> <blockquote> <h1>0.3.26 (April 3, 2024)</h1> <ul> <li>Limit number of CONTINUATION frames for misbehaving connections.</li> </ul> <h1>0.3.25 (March 15, 2024)</h1> <ul> <li>Improve performance decoding many headers.</li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href=" |
||
|
Stephan Cilliers
|
86cfa4f551 | fix: add missing db and redis exports to hub-shuttle (#1876) | ||
|
Stephan Cilliers
|
5282c73049 | fix: add support for windows file paths in hub-shuttle example app (#1877) | ||
|
Sanjay
|
a03c7bd7ae |
fix: Update hub-shuttle exports (#1875)
## Motivation Fix missing exports ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview The focus of this PR is to update the package version to `0.1.1`, fix exports, and adjust file paths in `hub-shuttle`. ### Detailed summary - Updated package version to `0.1.1` - Fixed exports in `hub-shuttle/src/index.ts` - Adjusted file paths in `hub-shuttle/package.json` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex -->@farcaster/hub-shuttle@0.1.1 |
||
|
Sanjay
|
d523d92e2b |
chore: release hub-shuttle (#1874)
## Motivation Release hub-shuttle 0.1 ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the version of `@farcaster/hub-shuttle` to `0.1.0`, marking the initial release of the package. ### Detailed summary - Updated version to `0.1.0` for initial release of hub-shuttle package > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex -->@farcaster/hub-shuttle@0.1.0 |
||
|
Sanjay
|
31d54545ca |
Initial version of hub-shuttle (#1873)
## Motivation Provide shared set of primitives to move data from hub to databases ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [x] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR introduces the initial release of `hub-shuttle`. ### Detailed summary - Exported interfaces related to shuttle - Added `getHubClient` function to handle hub connections - Updated `tsconfig.json` and `tsup.config.ts` for TypeScript compilation - Added logging functionality with `pino` - Configured Jest for testing - Updated CI workflow for testing with PostgreSQL and Redis - Added environment variables handling in `env.ts` - Implemented message handling interfaces and Redis client - Added Docker Compose configuration for PostgreSQL and Redis - Updated package.json with dependencies and scripts - Added README with architecture overview and usage instructions - Implemented migration module for database migrations > The following files were skipped due to too many changes: `packages/hub-shuttle/src/app/migration.ts`, `packages/hub-shuttle/src/shuttle.integration.test.ts`, `packages/hub-shuttle/src/shuttle/messageProcessor.ts`, `packages/hub-shuttle/src/shuttle/hubSubscriber.ts`, `yarn.lock`, `packages/hub-shuttle/src/app/app.ts`, `packages/hub-shuttle/src/app/migrations/001_initial_migration.ts`, `packages/hub-shuttle/src/shuttle/messageReconciliation.ts`, `packages/hub-shuttle/src/shuttle/db.ts`, `packages/hub-shuttle/src/utils.ts` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
c46790ac2c |
fix: Calculate sleep time correctly for throttling validateOrRevoke job (#1872)
## Motivation Bugfix to calculate throttling speed correctly for validate or revoke job ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the calculation of sleep time for throttling in the `ValidateOrRevokeMessagesJob` to ensure accurate job scheduling. ### Detailed summary - Updated `TIME_SCHEDULED_PER_FID_MS` calculation for accurate job timing - Adjusted sleep time calculation based on fid processing progress > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
58b4913822 |
perf: Use countKeysAtPrefix for storage cache counts (#1868)
## Motivation Instead of using a `forEachIteratorAtPrefix` which incurs FFI + JS object creation + GC overhead, directly count the keys of a prefix in rust to speed up StorageCache calculations ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR focuses on improving performance in the `@farcaster/hubble` module by optimizing key counting operations. ### Detailed summary - Introduced `rsDbCountKeysAtPrefix` function to directly count keys at a prefix in Rust - Added `dbCountKeysAtPrefix` function in Rust to count keys with a given prefix - Updated `countKeysAtPrefix` method in TypeScript to utilize the new Rust functions - Refactored key counting operations for efficiency > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Dawson Botsford
|
fa6812b415 |
docs: Update legacy browser warning (#1865)
## Motivation Browser support was added via https://github.com/farcasterxyz/hub-monorepo/issues/573 but this documentation was not updated to reflex those changes ## Change Summary See above ^ ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR focuses on updating the README.md file in the hub-nodejs package. It includes changes related to error handling, required packages, and support for both Nodejs and browser environments. ### Detailed summary - Updated support information for Nodejs and browser environments. - Improved error handling with a monadic pattern. - Clarified the required packages for creating new messages. - Encoded fixed length data in byte formats for consistency. > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
651ba7ac22 |
fix: Throttle storageCache population (#1864)
## Motivation When a hub starts up, it attempts to pre-populate the storage cache. This is slow, since it has to basically scan every message. ## Change Summary - Slow down the pre-population - Don't do too many scans in parallel. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR focuses on fixing storage cache prepopulation throttling and adding memory usage logging with optional heap dumps. ### Detailed summary - Fixed throttle issue in storage cache prepopulation - Added memory usage logging in LibP2PNode and Hub - Implemented optional heap dumps for memory analysis > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
bbc9448789 |
fix: Log gossipnode worker heap stats (#1861)
## Motivation Log heap usage of main and gossip worker thread every 60s ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR optimizes memory usage logging in the Hubble app by adding interval-based statsd logging and updating logger messages. ### Detailed summary - Added interval-based memory usage logging to `gossipNodeWorker.ts` and `hubble.ts` - Updated logger messages in `snapshot.ts` and `gossipContactInfoJob.ts` - Modified data type in `merkle_trie.rs` for memory optimization > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
1a95ad9ebe |
chore: Cleanup snapshot generation (#1859)
## Motivation Cleanup snapshot generation and do tar + gz in single step ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR focuses on refactoring the `RocksDB` module in `rocksdb.rs` by removing the `js_create_tar_gzip` function and enhancing the `create_tar_gzip` function for better file path handling and error management. ### Detailed summary - Removed `js_create_tar_gzip` function - Improved `create_tar_gzip` to handle file paths more effectively - Updated logging messages for snapshot backups > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
0728546f24 |
fix: Online snapshot using rocksdb snapshot iterators (#1858)
## Motivation Do an online backup/snapshot using rocksdb snapshot iterators instead of restarting the hub. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the `@farcaster/hubble` package with a fix for creating online snapshots using snapshot iterators. ### Detailed summary - Added `pub` visibility to a constant in `merkle_trie.rs` - Added a new function `internal_db_error` in `store.rs` - Updated dependencies in `Cargo.toml` - Removed functions related to tar backup and gzip in `lib.rs` - Added a new function `dbSnapshotBackup` in `lib.rs` - Updated functions related to tar backup and gzip in `rustfunctions.ts` - Added a new function `rsDbSnapshotBackup` in `dbSnapshotBackupJob.ts` - Added new imports and functions related to snapshot backup job in `dbSnapshotBackupJob.ts` - Updated `Cargo.lock` to include the `flate2` dependency > The following files were skipped due to too many changes: `apps/hubble/src/addon/Cargo.lock`, `apps/hubble/src/hubble.ts`, `apps/hubble/src/addon/src/db/rocksdb.rs` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
exd0tpy
|
76f55e2e42 |
Update Client.md (#1854)
Fix not working api call ## Motivation Describe why this issue should be fixed and link to any relevant design docs, issues or other relevant items. ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [ ] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [ ] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR updates a parameter key in a function call from `castId` to `parentCastId` for clarity and consistency. ### Detailed summary - Updated parameter key from `castId` to `parentCastId` in `getCastsByParent` function call for clarity. > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
86e972ec00 |
logs: Add --log-individual-messages to log indivdual submitMessage (#1856)
## Motivation `--log-individual-messages` will log each individual submitMessage status. If disabled (default) will log one line per second with aggregate status ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [X] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR adds a new feature to log individual submitMessage statuses in the Hubble application. ### Detailed summary - Added `--log-individual-messages` option to log each submitMessage status - Created `SubmitMessageSuccessLogCache` class to handle logging of individual submitMessage statuses - Updated logging logic in `Hub` class based on the new option > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
05cb33974f |
perf: Use write cache for TrieDB (#1855)
## Motivation Cache TrieDB writes into batches ## Change Summary - Every update to the trie writes a lot of the same nodes (eg., the root node is updated each time). - Cache the writes, so we don't keep writing the same nodes over and over again - Flush to DB on stop or when unloading children. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR focuses on improving performance by caching trieDB writes in the `@farcaster/hubble` package. ### Detailed summary - Introduced a `commitToDb` method in `MerkleTrie` to cache trieDB writes - Added logging for initializing Merkle Trie - Modified `RocksDbTransactionBatch` to use `HashMap` for batch operations - Implemented merging of transaction batches in `RocksDbTransactionBatch` - Updated the `stop` method in `MerkleTrie` to unload data to disk before closing - Added tests for merging transaction batches in `RocksDbTransactionBatch` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> --------- Co-authored-by: Wasif Iqbal <Wazzymandias@users.noreply.github.com> |
||
|
adityapk00
|
5e04c0a7ed |
perf: Move merkle trie to Rust (#1853)
## Motivation Move the sync merkle trie to rust ## Change Summary - Merkle trie is now in rust - Remove merkletrieworker ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR focuses on migrating the merkle trie to Rust for improved performance. ### Detailed summary - Moved merkle trie to Rust - Migrated trie node data to TrieDB - Updated various test files to start the sync engine before running tests - Updated sleep timeout in crypto utils - Renamed `create_cast_store` function to `js_create_cast_store` in `cast_store.rs` > The following files were skipped due to too many changes: `apps/hubble/src/storage/db/migrations/5.fnameSyncIds.test.ts`, `apps/hubble/src/addon/src/store/store.rs`, `apps/hubble/src/storage/stores/linkStore.test.ts`, `apps/hubble/src/rpc/test/syncService.test.ts`, `apps/hubble/src/rpc/test/httpServer.test.ts`, `apps/hubble/src/addon/src/lib.rs`, `apps/hubble/src/network/sync/multiPeerSyncEngine.test.ts`, `apps/hubble/src/addon/src/store/utils.rs`, `apps/hubble/src/addon/src/trie/trie_node_tests.rs`, `apps/hubble/src/network/sync/syncEngine.test.ts`, `apps/hubble/src/rustfunctions.ts`, `apps/hubble/src/network/sync/syncEngine.ts`, `apps/hubble/src/addon/src/trie/trie_node.rs`, `apps/hubble/src/network/sync/merkleTrie.test.ts`, `apps/hubble/src/network/sync/merkleTrie.ts`, `apps/hubble/src/addon/src/trie/merkle_trie.rs` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> --------- Co-authored-by: Wasif Iqbal <Wazzymandias@users.noreply.github.com> |
||
|
Wasif Iqbal
|
2bccc165c1 |
chore(hubble): release 1.11.4 (#1852)
## Motivation - Release hubble 1.11.4 ## Change Summary ### Patch Changes -@farcaster/hubble@1.11.4 |
||
|
Wasif Iqbal
|
ccd4d96a9f |
fix(hubble): reduce hub bandwidth with floodsub toggle (#1851)
## Motivation - Hub bandwidth usage has increased to around 400-500 KiB per second, or 40-50 GiB per day - Needless bandwidth utilization can increase resource requirements to run Hub ## Context - The default settings for our libp2p library publish to floodsub and subscribe to floodsub topic - Floodsub is a p2p protocol where every message a node receives gets forwarded to all known peers in the network - While there are benefits to Floodsub, it has significant network amplification factors and hits scalability limits as the number of hubs in the network grows ## Change Summary - By default, disable `floodPublish` and `fallbackToFloodsub` - Expose environment variables `GOSSIPSUB_FALLBACK_TO_FLOODSUB` and `GOSSIPSUB_FLOOD_PUBLISH` to toggle the values for gossipsub p2p ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR reduces hub bandwidth in the `hubble` app by adding toggles for `GOSSIPSUB_FALLBACK_TO_FLOODSUB` and `GOSSIPSUB_FLOOD_PUBLISH`. ### Detailed summary - Added toggles for `GOSSIPSUB_FALLBACK_TO_FLOODSUB` and `GOSSIPSUB_FLOOD_PUBLISH` in `gossipNode.ts` - Refactored callback handling in `server.ts` - Added environment variable checks for `fallbackToFloodsub` and `floodPublish` in `gossipNodeWorker.ts` - Added stats tracking for message sizes in `gossipNodeWorker.ts` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
b754a8c631 |
fix: throttle triedb migration (#1850)
## Motivation Throttle the trie db migration. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview The focus of this PR is to increase the timeout duration for a migration process in `merkleTrie.ts` and adjust the sleep duration before continuing the process. ### Detailed summary - Increased timeout duration for migration process from 1 second to 5 minutes - Adjusted sleep duration before continuing process from 1 second to 2 seconds > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
5ec735b494 |
chore: Migrate Trie data to TriDB (#1847)
## Motivation Migrate any remaining entries in the main DB for the sync trie into the Trie DB (and delete them from the main DB) ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR migrates trie node data from the main DB to TrieDB in the `hubble` app. ### Detailed summary - Migrates key-values to TrieDB - Adds `migrate` method to `MerkleTrie` for migration - Implements key migration logic in batches - Initiates migration in Prod environment - Deletes migrated keys from the main DB > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Wasif Iqbal
|
3dad8049b4 |
core: release(hubble): v1.11.3 (#1849)
## Motivation
- release hubble 1.11.3
## Change Summary
-
@farcaster/hubble@1.11.3
|
||
|
Wasif Iqbal
|
e3f4997615 |
fix: handle edge cases of rocksdb instantiation (#1844)
## Motivation - There were certain edge cases in instantiation that could cause snapshots to be uploaded with 0 messages - If snapshot flag is enabled but zero messages are found, we now return an error - path checks for trie db uses normalized paths and properly checks in cases where there's prefix of `.rocks` - If the trie DB directory exists, but hasn't loaded any messages yet, we catch the error in getting root node and return 0 ## Change Summary - If snapshot flag is enabled but zero messages are found, we now return an error - path checks for trie db uses normalized paths and properly checks in cases where there's prefix of `.rocks` - If the trie DB directory exists, but hasn't loaded any messages yet, we catch the error in getting root node and return 0 ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview The focus of this PR is to enhance the `hubble` app by handling edge cases of rocksdb instantiation for snapshot uploads. ### Detailed summary - Handle edge cases of rocksdb instantiation for snapshot uploads in `hubble` - Synchronously fetch the number of elements in the trie DB - Throw an error if message count is not obtained for snapshot upload - Support catch up sync with snapshot only on mainnet - Improve logging for catchup sync using snapshot - Refactor trie database instantiation for consistency and error handling > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
0e26c7643b |
feat: Add trie node rust code + tests (#1846)
## Motivation Add the rust code for the trie node + tests. This PR contains only the rust code, it is not connected to the merkle trie yet. Pushing this PR early to avoid merge conflicts. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR introduces new dependencies, adds `trie` module, updates `HubError` struct, and refactors code in the `trie_node_tests`. ### Detailed summary - Added `tempfile`, `rand`, and `hex` dependencies - Introduced `trie` module in `lib.rs` - Updated `HubError` struct with `PartialEq` - Refactored code in `trie_node_tests.rs` > The following files were skipped due to too many changes: `apps/hubble/src/addon/src/trie/trie_node_tests.rs`, `apps/hubble/src/addon/src/trie/trie_node.rs` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Wasif Iqbal
|
6ef0638492 |
chore: release hubble 1.11.2 (#1841)
## Motivation - Set default catch up sync to true for install script ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the version of `@farcaster/hubble` to `1.11.2` and includes a fix for catch-up sync in the install script and docker compose. ### Detailed summary - Updated `@farcaster/hubble` version to `1.11.2` - Added fix for catch-up sync in install script and docker compose - Modified `pm2.config.cjs` to set `CATCHUP_SYNC_WITH_SNAPSHOT` environment variable to `true` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex -->@farcaster/hubble@1.11.2 |
||
|
Wasif Iqbal
|
568e605f50 |
chore: release hubble 1.11.1 (#1840)
## Motivation Describe why this issue should be fixed and link to any relevant design docs, issues or other relevant items. ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [x] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR updates version numbers and dependencies in multiple packages, including bug fixes and feature enhancements. ### Detailed summary - Updated `@farcaster/core` and `@farcaster/hub-nodejs` versions - Bug fix enforcing protobuf oneof constraints - Added support for using S3 snapshot for "catch up" sync - Updated dependencies in `hub-nodejs` package - Updated version numbers in `hubble` package to 1.11.1 > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Wasif Iqbal
|
8a35af34cb |
Revert "chore: release hubble 1.11.1" (#1839)
Reverts farcasterxyz/hub-monorepo#1838 <!-- start pr-codex --> --- ## PR-Codex overview This PR focuses on updating versions and adding features related to the `@farcaster/hubble` package. ### Detailed summary - Added feature to run full validation every 14 days - Enforced protobuf oneof constraints - Added support for using S3 snapshot for "catch up" sync - Updated S3 snapshot metadata with database statistics - Updated versions of `@farcaster/core` and `@farcaster/hub-nodejs` to `0.14.7` and `0.11.7` respectively > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Wasif Iqbal
|
236a8cdd04 |
chore: release hubble 1.11.1 (#1838)
## Motivation - Release hubble 1.11.1 ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [x] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR updates version numbers and dependencies for various packages. ### Detailed summary - Updated version numbers for `@farcaster/core` and `@farcaster/hub-nodejs` - Enforced protobuf oneof constraints - Added new features and fixes in `@farcaster/hub-nodejs` and `apps/hubble` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex -->@farcaster/hubble@1.11.1 @farcaster/hub-nodejs@0.11.8 @farcaster/core@0.14.8 |
||
|
Wasif Iqbal
|
c178662d74 |
fix(hubble): path checking for num items (#1837)
## Motivation - Path resolution was not working correctly, returning 0 for rocksdb path since rocksdb creates its own subdirectory on instantiation ## Change Summary - Fix path resolution to check if directory empty ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR enhances logging and handles empty directories more efficiently in the Hubble application. ### Detailed summary - Added logging with message count when creating tar.gz file - Improved handling of empty directories in RocksDB - Refactored logic for uploading snapshot to S3 > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
751ed729c3 |
fix: ValidateOrRevoke an fid's messages every 14 days (#1836)
## Motivation Every 14 days, check all messages of an fid and revoke any invalid ones. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the `validateOrRevokeMessagesJob` to run a full scan for all FIDs every 14 days and adds throttling to match the schedule. ### Detailed summary - Adjusted cron schedule for full scan every 14 days - Implemented throttling to match the schedule - Added logging and sleeping logic for job throttling - Fixed test cases for job execution based on FID and timestamps > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Wasif Iqbal
|
935246bde7 |
feat(hubble): catchup sync with s3 snapshot (#1833)
## Motivation - If there is a large gap in message count for a hub compared to the latest snapshot, it is faster to sync from s3 snapshot which is publicly available online - **NOTE**: Catchup sync using snapshot WILL RESET THE DATABASE ## Change Summary - Add `--catchup-sync-with-snapshot` and `--catchup-sync-snapshot-message-limit <number>` - By default, `--catchup-sync-with-snapshot` is disabled, and will be used if message difference is greater than `3_000_000` - Add logic for using s3 snapshot for "catch up" sync. Snapshot metadata is used to determine whether snapshot should be used. If metadata JSON is missing attribute for message count, an error is returned - Fix small bug where HTTP API was reporting incorrect sync status - **NOTE**: Catchup sync using snapshot **WILL RESET THE DATABASE** ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [x] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context Confirmed upload and download working: ``` {"level":30,"time":1710988900433,"pid":18800,"hostname":"mbp.local","component":"Hub","downloadedSize":1073751179,"totalSize":24114175697,"msg":"Downloading snapshot..."} {"level":30,"time":1710988921461,"pid":18800,"hostname":"mbp.local","component":"Hub","downloadedSize":2147499571,"totalSize":24114175697,"msg":"Downloading snapshot..."} {"level":30,"time":1710988941068,"pid":18800,"hostname":"mbp.local","component":"Hub","downloadedSize":3221242283,"totalSize":24114175697,"msg":"Downloading snapshot..."} ``` This is using test bucket with transfer acceleration enabled. **NOTE:** If the s3-bucket-name isn't valid DNS endpoint, the snapshot sync fails. This was issue before, but was not problem because we hardcoded download.farcaster.xyz: ``` {"level":30,"time":1710988763240,"pid":18380,"hostname":"mbp.local","component":"Hub","db_location":".rocks/rocks.hub._default","file_count":1,"overwrite":true,"msg":"DB is empty or overwrite is true, fetching snapshot from S3"} {"level":50,"time":1710988763292,"pid":18380,"hostname":"mbp.local","component":"Hub","error":{"message":"getaddrinfo ENOTFOUND wasif-test3","name":"Error","stack":"Error: getaddrinfo ENOTFOUND wasif-test3 ``` For now, it shouldn't be concern since default is download.farcaster.xyz which is public and available to everyone --- ## PR-Codex overview The focus of this PR is to enhance catchup sync functionality and snapshot handling in the Hubble application. ### Detailed summary - Improved catchup sync with snapshot feature - Added option to enable catchup sync using S3 snapshot - Added message limit trigger for catchup sync - Updated default configuration settings for catchup sync - Refactored code for snapshot handling and sync process > The following files were skipped due to too many changes: `apps/hubble/src/hubble.ts` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> <!-- start pr-codex --> --- ## PR-Codex overview This PR introduces support for catch up sync using S3 snapshot in the `Hubble` app. ### Detailed summary - Added support for catch up sync with S3 snapshot - Updated CLI options for catch up sync with snapshot - Implemented catch up sync logic with snapshot - Defined catch up sync snapshot message limit - Modified default configuration for catch up sync snapshot message limit > The following files were skipped due to too many changes: `apps/hubble/src/hubble.ts` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> <!-- start pr-codex --> --- ## PR-Codex overview The focus of this PR is to introduce support for using S3 snapshots for "catch up" sync in the Hubble app. ### Detailed summary - Added support for catch up sync using S3 snapshot - Modified CLI options for enabling catch up sync with snapshot - Implemented logic for catch up sync with snapshot based on message count difference - Updated default configuration for catch up sync with snapshot - Implemented functions for handling snapshot metadata and uploading to S3 > The following files were skipped due to too many changes: `apps/hubble/src/hubble.ts` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` |
||
|
adityapk00
|
e30297b905 |
bug: Enforce protobuf oneof constraints (#1835)
## Motivation When protobufs have fields that are defined `oneof`, the compiler doesn't enforce that exactly one of the fields is set. We need to manually validate these ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview The focus of this PR is to enforce protobuf oneof constraints in the `validateMessage` function and ensure only one body can be set in a message. ### Detailed summary - Enforced protobuf oneof constraints in `validateMessage` - Added validation for setting only one body in a message > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Wasif Iqbal
|
c678742ff8 |
feat(hubble): update s3 snapshot metadata to include database statistics (#1829)
## Motivation - As part of improvements to scaling Hub sync, we want to use snapshots more often - Determining whether to use s3 snapshot for catch up sync requires additional information in metadata JSON ## Change Summary - Update s3 snapshot metadata to include database statistics - Add `snapshot-url` command to print latest snapshot URL for convenience - Within `apps/hubble` run `yarn snapshot-url` or `node build/cli.js snapshot-url` ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [x] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context Confirmed upload and download working ``` {"level":30,"time":1710985820939,"pid":5242,"hostname":"mbp.local","component":"Hub","progress":{"loaded":10485760000,"total":24114175697,"part":10,"Key":"snapshots/MAINNET/DB_SCHEMA_9/snapshot-2024-03-21-1710983283.tar.gz","Bucket":"test-bucket"},"msg":"Uploading snapshot to S3"} {"level":30,"time":1710985925021,"pid":5242,"hostname":"mbp.local","component":"Hub","progress":{"loaded":11534336000,"total":24114175697,"part":11,"Key":"snapshots/MAINNET/DB_SCHEMA_9/snapshot-2024-03-21-1710983283.tar.gz","Bucket":"test-bucket"},"msg":"Uploading snapshot to S3"} {"level":30,"time":1710986006718,"pid":5242,"hostname":"mbp.local","component":"Hub","progress":{"loaded":12582912000,"total":24114175697,"part":12,"Key":"snapshots/MAINNET/DB_SCHEMA_9/snapshot-2024-03-21-1710983283.tar.gz","Bucket":"test-bucket"},"msg":"Uploading snapshot to S3"} ``` <!-- start pr-codex --> --- ## PR-Codex overview This PR enhances the `hubble` app by adding a `snapshot-url` command to retrieve S3 snapshot metadata and statistics. It also includes improvements for snapshot handling and network synchronization. ### Detailed summary - Added `snapshot-url` command to retrieve S3 snapshot metadata - Updated snapshot handling logic with metadata and statistics - Improved network synchronization with Merkle Trie enhancements > The following files were skipped due to too many changes: `apps/hubble/src/utils/snapshot.ts` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Sanjay
|
7fd6bbb402 |
chore: Release 1.11 (#1834)
## Motivation Release 1.11 ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the version of `@farcaster/hubble` to `1.11.0`, introduces Rust migrations and optimizations, and updates `FARCASTER_VERSION` in `hubble.ts`. ### Detailed summary - Updated `@farcaster/hubble` version to `1.11.0` - Migrated verifications store, username proof store, cast store, link store to Rust - Added stats for hub restarts - Updated `FARCASTER_VERSION` in `hubble.ts` to `2024.3.20` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex -->@farcaster/hubble@1.11.0 |
||
|
Sanjay
|
cfa701c904 |
feat: Log hub restarts (#1830)
## Motivation Log reason for hub restarts ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR introduces hub restart stats and enhances hub shutdown handling in the `@farcaster/hubble` package. ### Detailed summary - Added `HubShutdownReason` enum for shutdown reasons - Updated shutdown handling in various job schedulers and tests - Improved shutdown logic in the `Hub` class for graceful exits > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
eb46f044f5 |
test: Extend timeout for prune test (#1832)
## Motivation Increase timeout for prune test since it sometimes times out in CI ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR increases the timeout for a test in `pruneMessagesJob.test.ts`. ### Detailed summary - Increased timeout from 15 seconds to 30 seconds for a test in `pruneMessagesJob.test.ts`. > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
d2b2f726d3 |
chore: Add rustfmt check for rust files before git commit (#1831)
## Motivation Ensure consistent formatting of rust files. ## Change Summary Run `yarn lint:rust` to format all the rust files ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [X] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR adds a Rust code formatter check before Git commit, updates linting scripts, and refactors code in the `LinkStore` module. ### Detailed summary - Added Rustfmt check before Git commit - Updated linting scripts in `package.json` - Refactored code in the `LinkStore` module > The following files were skipped due to too many changes: `apps/hubble/src/addon/src/store/link_store.rs` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
0b523281eb |
fix: Read data_bytes properly when pruning (#1828)
## Motivation When pruning, read the data_bytes properly to avoid warnings ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR fixes data handling issues in various modules. It ensures proper data decoding and storage consistency. ### Detailed summary - Improved error handling for missing message data - Updated data decoding and encoding methods - Enhanced logging for data retrieval and storage > The following files were skipped due to too many changes: `apps/hubble/src/addon/src/store/store.rs`, `apps/hubble/src/addon/src/store/cast_store.rs` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |