mirror of
https://github.com/farcasterxyz/hub-monorepo.git
synced 2026-01-24 20:48:00 -05:00
@farcaster/hubble@1.11.3
1294 Commits
| Author | SHA1 | Message | Date | |
|---|---|---|---|---|
Wasif Iqbal
|
3dad8049b4 |
core: release(hubble): v1.11.3 (#1849)
## Motivation
- release hubble 1.11.3
## Change Summary
-
@farcaster/hubble@1.11.3
|
||
|
Wasif Iqbal
|
e3f4997615 |
fix: handle edge cases of rocksdb instantiation (#1844)
## Motivation - There were certain edge cases in instantiation that could cause snapshots to be uploaded with 0 messages - If snapshot flag is enabled but zero messages are found, we now return an error - path checks for trie db uses normalized paths and properly checks in cases where there's prefix of `.rocks` - If the trie DB directory exists, but hasn't loaded any messages yet, we catch the error in getting root node and return 0 ## Change Summary - If snapshot flag is enabled but zero messages are found, we now return an error - path checks for trie db uses normalized paths and properly checks in cases where there's prefix of `.rocks` - If the trie DB directory exists, but hasn't loaded any messages yet, we catch the error in getting root node and return 0 ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview The focus of this PR is to enhance the `hubble` app by handling edge cases of rocksdb instantiation for snapshot uploads. ### Detailed summary - Handle edge cases of rocksdb instantiation for snapshot uploads in `hubble` - Synchronously fetch the number of elements in the trie DB - Throw an error if message count is not obtained for snapshot upload - Support catch up sync with snapshot only on mainnet - Improve logging for catchup sync using snapshot - Refactor trie database instantiation for consistency and error handling > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
0e26c7643b |
feat: Add trie node rust code + tests (#1846)
## Motivation Add the rust code for the trie node + tests. This PR contains only the rust code, it is not connected to the merkle trie yet. Pushing this PR early to avoid merge conflicts. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR introduces new dependencies, adds `trie` module, updates `HubError` struct, and refactors code in the `trie_node_tests`. ### Detailed summary - Added `tempfile`, `rand`, and `hex` dependencies - Introduced `trie` module in `lib.rs` - Updated `HubError` struct with `PartialEq` - Refactored code in `trie_node_tests.rs` > The following files were skipped due to too many changes: `apps/hubble/src/addon/src/trie/trie_node_tests.rs`, `apps/hubble/src/addon/src/trie/trie_node.rs` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Wasif Iqbal
|
6ef0638492 |
chore: release hubble 1.11.2 (#1841)
## Motivation - Set default catch up sync to true for install script ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the version of `@farcaster/hubble` to `1.11.2` and includes a fix for catch-up sync in the install script and docker compose. ### Detailed summary - Updated `@farcaster/hubble` version to `1.11.2` - Added fix for catch-up sync in install script and docker compose - Modified `pm2.config.cjs` to set `CATCHUP_SYNC_WITH_SNAPSHOT` environment variable to `true` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex -->@farcaster/hubble@1.11.2 |
||
|
Wasif Iqbal
|
568e605f50 |
chore: release hubble 1.11.1 (#1840)
## Motivation Describe why this issue should be fixed and link to any relevant design docs, issues or other relevant items. ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [x] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR updates version numbers and dependencies in multiple packages, including bug fixes and feature enhancements. ### Detailed summary - Updated `@farcaster/core` and `@farcaster/hub-nodejs` versions - Bug fix enforcing protobuf oneof constraints - Added support for using S3 snapshot for "catch up" sync - Updated dependencies in `hub-nodejs` package - Updated version numbers in `hubble` package to 1.11.1 > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Wasif Iqbal
|
8a35af34cb |
Revert "chore: release hubble 1.11.1" (#1839)
Reverts farcasterxyz/hub-monorepo#1838 <!-- start pr-codex --> --- ## PR-Codex overview This PR focuses on updating versions and adding features related to the `@farcaster/hubble` package. ### Detailed summary - Added feature to run full validation every 14 days - Enforced protobuf oneof constraints - Added support for using S3 snapshot for "catch up" sync - Updated S3 snapshot metadata with database statistics - Updated versions of `@farcaster/core` and `@farcaster/hub-nodejs` to `0.14.7` and `0.11.7` respectively > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Wasif Iqbal
|
236a8cdd04 |
chore: release hubble 1.11.1 (#1838)
## Motivation - Release hubble 1.11.1 ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [x] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR updates version numbers and dependencies for various packages. ### Detailed summary - Updated version numbers for `@farcaster/core` and `@farcaster/hub-nodejs` - Enforced protobuf oneof constraints - Added new features and fixes in `@farcaster/hub-nodejs` and `apps/hubble` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex -->@farcaster/hubble@1.11.1 @farcaster/hub-nodejs@0.11.8 @farcaster/core@0.14.8 |
||
|
Wasif Iqbal
|
c178662d74 |
fix(hubble): path checking for num items (#1837)
## Motivation - Path resolution was not working correctly, returning 0 for rocksdb path since rocksdb creates its own subdirectory on instantiation ## Change Summary - Fix path resolution to check if directory empty ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR enhances logging and handles empty directories more efficiently in the Hubble application. ### Detailed summary - Added logging with message count when creating tar.gz file - Improved handling of empty directories in RocksDB - Refactored logic for uploading snapshot to S3 > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
751ed729c3 |
fix: ValidateOrRevoke an fid's messages every 14 days (#1836)
## Motivation Every 14 days, check all messages of an fid and revoke any invalid ones. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the `validateOrRevokeMessagesJob` to run a full scan for all FIDs every 14 days and adds throttling to match the schedule. ### Detailed summary - Adjusted cron schedule for full scan every 14 days - Implemented throttling to match the schedule - Added logging and sleeping logic for job throttling - Fixed test cases for job execution based on FID and timestamps > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Wasif Iqbal
|
935246bde7 |
feat(hubble): catchup sync with s3 snapshot (#1833)
## Motivation - If there is a large gap in message count for a hub compared to the latest snapshot, it is faster to sync from s3 snapshot which is publicly available online - **NOTE**: Catchup sync using snapshot WILL RESET THE DATABASE ## Change Summary - Add `--catchup-sync-with-snapshot` and `--catchup-sync-snapshot-message-limit <number>` - By default, `--catchup-sync-with-snapshot` is disabled, and will be used if message difference is greater than `3_000_000` - Add logic for using s3 snapshot for "catch up" sync. Snapshot metadata is used to determine whether snapshot should be used. If metadata JSON is missing attribute for message count, an error is returned - Fix small bug where HTTP API was reporting incorrect sync status - **NOTE**: Catchup sync using snapshot **WILL RESET THE DATABASE** ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [x] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context Confirmed upload and download working: ``` {"level":30,"time":1710988900433,"pid":18800,"hostname":"mbp.local","component":"Hub","downloadedSize":1073751179,"totalSize":24114175697,"msg":"Downloading snapshot..."} {"level":30,"time":1710988921461,"pid":18800,"hostname":"mbp.local","component":"Hub","downloadedSize":2147499571,"totalSize":24114175697,"msg":"Downloading snapshot..."} {"level":30,"time":1710988941068,"pid":18800,"hostname":"mbp.local","component":"Hub","downloadedSize":3221242283,"totalSize":24114175697,"msg":"Downloading snapshot..."} ``` This is using test bucket with transfer acceleration enabled. **NOTE:** If the s3-bucket-name isn't valid DNS endpoint, the snapshot sync fails. This was issue before, but was not problem because we hardcoded download.farcaster.xyz: ``` {"level":30,"time":1710988763240,"pid":18380,"hostname":"mbp.local","component":"Hub","db_location":".rocks/rocks.hub._default","file_count":1,"overwrite":true,"msg":"DB is empty or overwrite is true, fetching snapshot from S3"} {"level":50,"time":1710988763292,"pid":18380,"hostname":"mbp.local","component":"Hub","error":{"message":"getaddrinfo ENOTFOUND wasif-test3","name":"Error","stack":"Error: getaddrinfo ENOTFOUND wasif-test3 ``` For now, it shouldn't be concern since default is download.farcaster.xyz which is public and available to everyone --- ## PR-Codex overview The focus of this PR is to enhance catchup sync functionality and snapshot handling in the Hubble application. ### Detailed summary - Improved catchup sync with snapshot feature - Added option to enable catchup sync using S3 snapshot - Added message limit trigger for catchup sync - Updated default configuration settings for catchup sync - Refactored code for snapshot handling and sync process > The following files were skipped due to too many changes: `apps/hubble/src/hubble.ts` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> <!-- start pr-codex --> --- ## PR-Codex overview This PR introduces support for catch up sync using S3 snapshot in the `Hubble` app. ### Detailed summary - Added support for catch up sync with S3 snapshot - Updated CLI options for catch up sync with snapshot - Implemented catch up sync logic with snapshot - Defined catch up sync snapshot message limit - Modified default configuration for catch up sync snapshot message limit > The following files were skipped due to too many changes: `apps/hubble/src/hubble.ts` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> <!-- start pr-codex --> --- ## PR-Codex overview The focus of this PR is to introduce support for using S3 snapshots for "catch up" sync in the Hubble app. ### Detailed summary - Added support for catch up sync using S3 snapshot - Modified CLI options for enabling catch up sync with snapshot - Implemented logic for catch up sync with snapshot based on message count difference - Updated default configuration for catch up sync with snapshot - Implemented functions for handling snapshot metadata and uploading to S3 > The following files were skipped due to too many changes: `apps/hubble/src/hubble.ts` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` |
||
|
adityapk00
|
e30297b905 |
bug: Enforce protobuf oneof constraints (#1835)
## Motivation When protobufs have fields that are defined `oneof`, the compiler doesn't enforce that exactly one of the fields is set. We need to manually validate these ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview The focus of this PR is to enforce protobuf oneof constraints in the `validateMessage` function and ensure only one body can be set in a message. ### Detailed summary - Enforced protobuf oneof constraints in `validateMessage` - Added validation for setting only one body in a message > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Wasif Iqbal
|
c678742ff8 |
feat(hubble): update s3 snapshot metadata to include database statistics (#1829)
## Motivation - As part of improvements to scaling Hub sync, we want to use snapshots more often - Determining whether to use s3 snapshot for catch up sync requires additional information in metadata JSON ## Change Summary - Update s3 snapshot metadata to include database statistics - Add `snapshot-url` command to print latest snapshot URL for convenience - Within `apps/hubble` run `yarn snapshot-url` or `node build/cli.js snapshot-url` ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [x] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context Confirmed upload and download working ``` {"level":30,"time":1710985820939,"pid":5242,"hostname":"mbp.local","component":"Hub","progress":{"loaded":10485760000,"total":24114175697,"part":10,"Key":"snapshots/MAINNET/DB_SCHEMA_9/snapshot-2024-03-21-1710983283.tar.gz","Bucket":"test-bucket"},"msg":"Uploading snapshot to S3"} {"level":30,"time":1710985925021,"pid":5242,"hostname":"mbp.local","component":"Hub","progress":{"loaded":11534336000,"total":24114175697,"part":11,"Key":"snapshots/MAINNET/DB_SCHEMA_9/snapshot-2024-03-21-1710983283.tar.gz","Bucket":"test-bucket"},"msg":"Uploading snapshot to S3"} {"level":30,"time":1710986006718,"pid":5242,"hostname":"mbp.local","component":"Hub","progress":{"loaded":12582912000,"total":24114175697,"part":12,"Key":"snapshots/MAINNET/DB_SCHEMA_9/snapshot-2024-03-21-1710983283.tar.gz","Bucket":"test-bucket"},"msg":"Uploading snapshot to S3"} ``` <!-- start pr-codex --> --- ## PR-Codex overview This PR enhances the `hubble` app by adding a `snapshot-url` command to retrieve S3 snapshot metadata and statistics. It also includes improvements for snapshot handling and network synchronization. ### Detailed summary - Added `snapshot-url` command to retrieve S3 snapshot metadata - Updated snapshot handling logic with metadata and statistics - Improved network synchronization with Merkle Trie enhancements > The following files were skipped due to too many changes: `apps/hubble/src/utils/snapshot.ts` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Sanjay
|
7fd6bbb402 |
chore: Release 1.11 (#1834)
## Motivation Release 1.11 ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the version of `@farcaster/hubble` to `1.11.0`, introduces Rust migrations and optimizations, and updates `FARCASTER_VERSION` in `hubble.ts`. ### Detailed summary - Updated `@farcaster/hubble` version to `1.11.0` - Migrated verifications store, username proof store, cast store, link store to Rust - Added stats for hub restarts - Updated `FARCASTER_VERSION` in `hubble.ts` to `2024.3.20` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex -->@farcaster/hubble@1.11.0 |
||
|
Sanjay
|
cfa701c904 |
feat: Log hub restarts (#1830)
## Motivation Log reason for hub restarts ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR introduces hub restart stats and enhances hub shutdown handling in the `@farcaster/hubble` package. ### Detailed summary - Added `HubShutdownReason` enum for shutdown reasons - Updated shutdown handling in various job schedulers and tests - Improved shutdown logic in the `Hub` class for graceful exits > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
eb46f044f5 |
test: Extend timeout for prune test (#1832)
## Motivation Increase timeout for prune test since it sometimes times out in CI ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR increases the timeout for a test in `pruneMessagesJob.test.ts`. ### Detailed summary - Increased timeout from 15 seconds to 30 seconds for a test in `pruneMessagesJob.test.ts`. > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
d2b2f726d3 |
chore: Add rustfmt check for rust files before git commit (#1831)
## Motivation Ensure consistent formatting of rust files. ## Change Summary Run `yarn lint:rust` to format all the rust files ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [X] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR adds a Rust code formatter check before Git commit, updates linting scripts, and refactors code in the `LinkStore` module. ### Detailed summary - Added Rustfmt check before Git commit - Updated linting scripts in `package.json` - Refactored code in the `LinkStore` module > The following files were skipped due to too many changes: `apps/hubble/src/addon/src/store/link_store.rs` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
0b523281eb |
fix: Read data_bytes properly when pruning (#1828)
## Motivation When pruning, read the data_bytes properly to avoid warnings ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR fixes data handling issues in various modules. It ensures proper data decoding and storage consistency. ### Detailed summary - Improved error handling for missing message data - Updated data decoding and encoding methods - Enhanced logging for data retrieval and storage > The following files were skipped due to too many changes: `apps/hubble/src/addon/src/store/store.rs`, `apps/hubble/src/addon/src/store/cast_store.rs` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
70603192b5 |
perf: Throttle prune job (#1827)
## Motivation The prune job is running too fast, causing spikes in merge latency. This PR throttles the job ## Change Summary // We prune at the rate of 1000 fids per second. If we are running ahead of schedule, we sleep to catch up // We do this so that: // 1. Each fid is pruned at the same time at every hub, reducing thrash // 2. Don't overload the DB or Sync Trie, causing spikes in latency ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview The focus of this PR is to improve the performance of the prune job in the `@farcaster/hubble` module. ### Detailed summary - Throttled the prune job to avoid overloading the system - Removed unnecessary parameter in `PruneMessagesJobScheduler` constructor - Added logic to sleep and catch up if pruning is ahead of schedule > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
63e2abe6ff |
perf: Move username proof store to rust (#1826)
## Motivation Move the username proof store to rust. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR focuses on moving the username proof store to Rust for performance improvement. ### Detailed summary - Moved username proof store to Rust for performance enhancement - Updated functions to interact with the new username proof store - Added Rust functions to create, get, and manage username proofs > The following files were skipped due to too many changes: `apps/hubble/src/storage/stores/usernameProofStore.ts`, `apps/hubble/src/addon/src/store/username_proof_store.rs` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
432570cff2 |
chore: Bump follow-redirects version (#1824)
## Motivation
Pick depandabot fix for `follow-redirects`
<!-- start pr-codex -->
---
## PR-Codex overview
This PR updates the `follow-redirects` package to version 1.15.6 in
multiple examples.
### Detailed summary
- Updated `follow-redirects` to version 1.15.6 in various yarn.lock
files
- Updated `form-data` to version 4.0.0 in the examples
> ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your
question}`
<!-- end pr-codex -->
|
||
|
adityapk00
|
f115bce142 |
feat: Generate grpc rust code from protobufs (#1804)
## Motivation In prep for moving grpc server to rust, auto gen the server rpc code. ## Change Summary - switch to 2021 edition of compiler - Switch to tonic-build to gen rust code - Upgrade neon to 1.0.0 ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR introduces a feature to generate grpc rust code from protobufs in the `@farcaster/hubble` package. ### Detailed summary - Added feature to generate grpc rust code from protobufs - Updated Cargo.toml edition to 2021 - Replaced `prost` with `tonic` and `tokio` - Updated dependencies and build scripts > The following files were skipped due to too many changes: `apps/hubble/src/addon/Cargo.lock`, `apps/hubble/src/addon/src/proto/protobufs.rs` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
dd1a3e46dc |
chore: Migrate verifications store to rust (#1798)
## Motivation Migrate the verifications store to rust ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR migrates the verifications store to Rust, adds verification store methods, and updates key generation functions. ### Detailed summary - Migrated verifications store to Rust - Added verification store methods for CRUD operations - Updated key generation functions for verification store > The following files were skipped due to too many changes: `apps/hubble/src/storage/stores/verificationStore.ts`, `apps/hubble/src/addon/src/store/verification_store.rs` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
dependabot[bot]
|
3d20b0cd21 |
chore(deps): bump google.golang.org/protobuf from 1.31.0 to 1.33.0 in /packages/hub-web/examples/golang-submitmessage (#1814)
Bumps google.golang.org/protobuf from 1.31.0 to 1.33.0. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/farcasterxyz/hub-monorepo/network/alerts). </details> <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the `google.golang.org/protobuf` dependency from v1.31.0 to v1.33.0 in the `go.mod` and `go.sum` files. ### Detailed summary - Updated `google.golang.org/protobuf` dependency to v1.33.0 in `go.mod` - Updated corresponding checksum in `go.sum` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> |
||
|
Bryan Stitt
|
b3a3a0a62c |
add check for SKIP_CRONTAB=true (#1815)
## Motivation We handle our upgrades manually. ## Change Summary Add a check for `SKIP_CRONTAB=true` into the upgrade script. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [ ] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [ ] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR increases the version of the script to 5 and introduces a feature to skip installing the autoupgrade crontab by setting `SKIP_CRONTAB` in the `.env` file. ### Detailed summary - Updated `CURRENT_VERSION` to "5" - Added check to skip crontab setup if `SKIP_CRONTAB` is set in `.env` - Display message when skipping crontab setup - Updated help message to include instructions for skipping crontab installation > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Sanjay
|
ca42eaf0a7 |
perf: Migrate cast store to rust (#1813)
## Motivation Migrate the cast store to rust ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR migrates the Cast Store to Rust for performance improvement. ### Detailed summary - Migrated Cast Store to Rust for performance (`apps/hubble/src/addon/src/store/mod.rs`, `apps/hubble/src/addon/src/store/message.rs`) - Added Rust linter script (`apps/hubble/package.json`) - Updated conflict functions with RocksDB (`apps/hubble/src/addon/src/store/user_data_store.rs`, `apps/hubble/src/addon/src/store/link_store.rs`) - Added Rust functions for Cast Store (`apps/hubble/src/addon/src/lib.rs`, `apps/hubble/src/rustfunctions.ts`) - Optimized iteration methods in Rust (`apps/hubble/src/addon/src/db/rocksdb.rs`, `apps/hubble/src/addon/src/store/reaction_store.rs`, `apps/hubble/src/addon/src/store/store.rs`) - Minor code cleanup and refactoring. > The following files were skipped due to too many changes: `apps/hubble/src/storage/stores/castStore.ts`, `apps/hubble/src/addon/src/store/cast_store.rs` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Wasif Iqbal
|
eb2b0e1d4b |
perf: migrate link store to Rust (#1806)
## Motivation - Move link store to rust for improved Hub performance ## Change Summary - Add link store rust code - Add convenience methods for Stores type conversions ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR migrates the link store to Rust, adds new methods, implements traits, and refactors error handling. ### Detailed summary - Migrated link store to Rust - Added new methods to the link store - Implemented traits for `IntoU8` and `IntoI32` - Refactored error handling in the store - Updated dependencies and imports > The following files were skipped due to too many changes: `apps/hubble/src/rustfunctions.ts`, `apps/hubble/src/storage/stores/linkStore.ts`, `apps/hubble/src/addon/src/store/link_store.rs` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Wasif Iqbal
|
b53a76f0f1 |
chore: replicator v0.3.7 (#1812)
## Motivation
- Release replicator v0.3.7
## Change Summary
-
@farcaster/replicator@0.3.7
@latest-replicator
|
||
|
Jean Prat
|
02bca881b1 |
fix(replicator): handle Hub errors in backfill (#1809)
## Motivation I tried multiple times to sync the replicator. I found that we may have loss of data on the initial backfill: If the grpc request has an error, they seems to be no retried and forgotten. ## Change Summary I added an exponential backoff on backfill jobs. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context I had a bunch if this kind of errors during the initial backfill in the logs: ``` ERROR (1): Job failed {"jobName":"BackfillFidRegistration","jobId":"246281","reason":"Unable to backfill","errorName":"Error","errorMessage":"Unable to backfill","errorStack":"Error: Unable to backfill\n at getOnChainEventsByFidInBatchesOf (/home/node/app/apps/replicator/build/hub.js:18:23)\n at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async Object.run (/home/node/app/apps/replicator/build/jobs/backfillFidRegistration.js:19:26)\n at async /home/node/app/node_modules/bullmq/dist/cjs/classes/child-processor.js:69:33"} ERROR (1): Job failed {"jobName":"BackfillFidUserData","jobId":"5069991","reason":"Unable to fetch UserData messages for FID 69477","errorName":"Error","errorMessage":"Unable to fetch UserData messages for FID 69477","errorStack":"Error: Unable to fetch UserData messages for FID 69477\n at getUserDataByFidInBatchesOf (/home/node/app/apps/replicator/build/hub.js:129:19)\n at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async Object.run (/home/node/app/apps/replicator/build/jobs/backfillFidUserData.js:12:26)\n at async /home/node/app/node_modules/bullmq/dist/cjs/classes/child-processor.js:69:33"} ``` Errors on constraints still appear after the backfill, but we need a more resilient in the initial backfill. <!-- start pr-codex --> --- ## PR-Codex overview The focus of this PR is to enhance error handling in the `replicator` app when interacting with the Hub. ### Detailed summary - Added `retryHubCallWithExponentialBackoff` function for handling errors with exponential backoff strategy. - Updated functions to retry calls to Hub methods with backoff mechanism in case of errors. - Improved error messages for backfilling events, proofs, casts, reactions, links, verifications, and user data. - Added logging for error warnings during the retry process. > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
horsefacts
|
4fe57f84b8 |
chore: release packages (#1808)
## Change Summary Add `address` field to frame messages. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR updates version numbers in various packages to `0.14.7`, `0.8.5`, and `1.10.11`, and includes changes related to dependencies and address addition to frame message. ### Detailed summary - Bumped versions to `0.14.7`, `0.8.5`, and `1.10.11` - Added address to frame message - Updated dependencies in different packages > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex -->@farcaster/hubble@1.10.11 @farcaster/core@0.14.7 @farcaster/hub-nodejs@0.11.7 @farcaster/hub-web@0.8.5 |
||
|
horsefacts
|
22615b3c3a |
feat: add address to frame message (#1807)
## Motivation It's useful for frames to know: 1) the current connected address, to generate transaction calldata 2) the actual address that executed a tx, in the post transaction callback We should pass this as part of the frame message. ## Change Summary - Add `address` field to `FrameActionBody` - Limit length to 64 bytes. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR updates message schemas and validations to include a chain-specific address for transaction actions. ### Detailed summary - Added `address` field to message schemas - Updated validations to check address length - Updated message serialization and deserialization functions to handle the `address` field > The following files were skipped due to too many changes: `packages/hub-web/src/generated/rpc.ts` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
miles
|
465a45ff3b |
docs: fix issues (#1805)
## Motivation I re-pull request #1802 and signed the commitment ## Change Summary I signed the commitment now ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [x] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context No <!-- start pr-codex --> --- ## PR-Codex overview This PR improves code consistency by fixing typos and enhancing readability across various files. ### Detailed summary - Fixed typos in method descriptions and comments - Improved consistency in spelling and grammar in multiple files > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Sanjay
|
0662959e95 |
chore: release 1.10.10 (#1803)
## Motivation Release 1.10.10 ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR updates version numbers and includes various patches and fixes for the `@farcaster/hubble` and `@farcaster/replicator` packages. ### Detailed summary - Updated `@farcaster/hubble` version to `1.10.10` - Updated `@farcaster/replicator` version to `0.3.6` - Various patches and fixes for CPU usage, HTTP API requests, Docker Compose restart policy, timeout settings, and code refactoring. > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex -->@farcaster/hubble@1.10.10 @farcaster/replicator@0.3.6 |
||
|
adityapk00
|
c4ca31efa3 |
fix: Migrate fnameUserNameProofByFid prefix 25 -> 27 (#1800)
## Motivation Up until now, the RootPrefix.FNameUserNameProofByFid and RootPrefix.VerificationByAddress both had the value of 25. This migration will change the value of RootPrefix.FNameUserNameProofByFid to 27 ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the prefix value for `FNameUserNameProofByFid` from 25 to 27 to avoid conflicts with `VerificationsByAddress`. ### Detailed summary - Updated `FNameUserNameProofByFid` prefix value from 25 to 27 - Added migration script to handle prefix change - Added test cases for migration functionality > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
6cb4c995a4 |
fix: Catch and log errors if conflict messages are not found while merging (#1801)
## Motivation Catch errors if there is an inconsistency in the DB and log it so we can get to the bottom of it. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR fixes the issue of inconsistent database entries by handling exceptions and logging warnings for missing messages in the store. ### Detailed summary - Renamed `existing_remove` to `maybe_existing_remove` and `existing_add` to `maybe_existing_add` - Added handling for missing messages in the store with logging warnings - Updated error handling for `existingRemove` and `existingAdd` in TypeScript code > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
b51c15b27d |
fix: Use default page size for prune job (#1797)
## Motivation Use default page size for prune job so we don't unnecessarily page. This was causing 100% CPU for a short time. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR focuses on fixing a bug in the `pruneMessagesJob.ts` file by removing the `pageSize` parameter from the `getFids` function call. ### Detailed summary - Removed `pageSize` parameter from `getFids` function call in `pruneMessagesJob.ts` - Ensured default page size is used for prune job > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
4ec6c6074f |
fix: Don't return '0x' for empty addresses. (#1787)
Fixes #1780 ## Motivation Don't return "0x" for empty addresses, just return "" instead ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview The focus of this PR is to fix the issue of returning '0x' for empty addresses in the `convertB64ToHex` and `convertB64ToB58` functions. ### Detailed summary - Fixed issue with returning '0x' for empty addresses - Added export to `convertB64ToHex` and `convertB64ToB58` functions - Added tests for conversions using base58 and hex encoding > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Shane da Silva
|
a14b0dfbd3 |
fix: Reduce default chunk size from 10000 to 9999 (#1796)
## Motivation This allows the default settings to work with Infura, which doesn't like chunk sizes >= 10000. Fixes #1703. ## Change Summary Decrease default chunk size to 9999. ## Merge Checklist - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR reduces the default chunk size in `@farcaster/hubble` from 10000 to 9999 to accommodate Infura's restrictions. ### Detailed summary - Updated default chunk size to 9999 in `apps/hubble/src/cli.ts` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Shane da Silva
|
d359ebcdfa |
fix: Resolve more deprecation warnings in GitHub Actions (#1795)
## Motivation
Missed some in
|
||
|
Shane da Silva
|
7165aabf2c |
fix: Resolve more deprecation warnings in GitHub Actions (#1794)
## Motivation Deprecation warnings are noisy. ## Change Summary Upgrade versions of various actions. ## Merge Checklist - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR updates GitHub Actions versions, optimizes caching strategies, and improves retry behavior for a Node.js project's CI workflow. ### Detailed summary - Updated `actions/checkout` from v3 to v4 - Updated `docker/setup-buildx-action` from v2 to v3 - Adjusted retry behavior in a command - Enhanced caching with `actions/cache` from v3 to v4 - Updated `codecov/codecov-action` from v3 to v4 > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Shane da Silva
|
18800701d0 |
fix: Change restart policy to always (#1793)
## Motivation Now that we're running via PM2, add another layer of protection by ensuring we always restart the container if it isn't explicitly stopped. Closes #1647. ## Change Summary Change policy to `always`. ## Merge Checklist - [ ] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [ ] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview The focus of this PR is to change the Docker Compose restart policy to `always` for the `@farcaster/hubble` app. ### Detailed summary - Changed Docker Compose restart policy to `always` in `apps/hubble/docker-compose.yml` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
9c5c762808 |
docs: Fix broken link on http api (#1791)
## Motivation Broken link on http api page. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [X] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview The focus of this PR is to update dependencies, fix a broken link on the docs site, and rename an API endpoint in the documentation. ### Detailed summary - Updated `vitepress` dependency to `^1.0.0-rc.45` - Fixed broken link on the docs site - Renamed API endpoint from "SubmitMessage" to "Message" in documentation > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Shane da Silva
|
451ae8476b |
fix: Increase read timeout for Fname Registry server requests 2.5s → 5s (#1790)
## Motivation Fixes #1784. (or at least reduces frequency substantially) ## Change Summary Increase timeout. ## Merge Checklist - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the `DEFAULT_READ_TIMEOUT_IN_MS` value in `fnameRegistryEventsProvider.ts` from 2,500 to 5,000. ### Detailed summary - Updated `DEFAULT_READ_TIMEOUT_IN_MS` value from 2,500 to 5,000 > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Shane da Silva
|
d23b0b2247 |
chore: Update GH Actions versions to avoid deprecation warnings (#1789)
## Motivation Remove deprecation warnings. ## Change Summary Update the actions so they run on Node 20. ## Merge Checklist - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the GitHub Actions workflows to use version 4 of `actions/checkout` and `actions/setup-node`. ### Detailed summary - Updated `actions/checkout` to version 4. - Updated `actions/setup-node` to version 4 with specified `node-version`. > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Bryan Stitt
|
dbcd8a2185 |
chore: Update docker-compose.yml to avoid port conflicts (#1788)
## Motivation These ports are conflicting with things already on our systems (datadog) ## Change Summary allow environment variable overrides ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [ ] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [x] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the `docker-compose.yml` file to dynamically set the StatsD and StatsD admin ports using environment variables. ### Detailed summary - Dynamically set StatsD port using `${STATSD_PUBLISH:-8125}` - Dynamically set StatsD admin port using `${STATSD_ADMIN_PUBLISH:-8126}` - Removed specific port numbers for StatsD and StatsD admin > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Jean Prat
|
0b1a6862d3 |
fix(replicator): updateTableMetrics is using too much postgresql CPU (#1781)
## Motivation
the [updateTableMetrics
function](
|
||
|
adityapk00
|
498ec9bb50 |
test: Setup testing in rust (#1786)
## Motivation Setup testing for rust code. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR sets up a testing framework for Rust in the `@farcaster/hubble` package. ### Detailed summary - Added testing framework for Rust - Updated test scripts in `package.json` - Added unit tests for utility functions - Modified a migration test script > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
280946d0ef |
fix: When creating a snapshot, tar file first to speedup (#1785)
## Motivation `keats` is taking > 15mins to startup because it takes so long to create a snapshot. Fix this by: - Creating just the tar file first (no gzip), which is faster - gzip while uploading using multi-threaded gzp lib in rust ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR focuses on improving snapshotting speed by tar-ing files before gzip. ### Detailed summary - Added `gzp` dependency for faster snapshotting - Created `rsCreateTarGzip` function for tar-gzip operation - Updated Dockerfile dependencies for compilation - Updated CI workflow to run on an ARM architecture - Modified file paths and exports in `hubble.ts` - Implemented `uploadToS3` method to upload tar.gz files - Added `dbCreateTarGzip` function for creating tar.gz files - Updated `RocksDB` methods for tarball creation - Added `create_tar_gzip` and `js_create_tar_gzip` functions in `rocksdb.rs` - Updated dependencies in `Cargo.lock` > The following files were skipped due to too many changes: `apps/hubble/src/addon/Cargo.lock` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
aedde2590c |
chore: Move get_merge_conflicts to trait default impl (#1783)
## Motivation Move the get_merge_conflicts to the trait with default implementation to make verifications store migration easier. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR refactors `store.rs` in `@farcaster/hubble` to simplify migrating verifications store. ### Detailed summary - Added `get_merge_conflicts` method to `StoreDef` trait - Removed `get_merge_conflicts` function from `impl Store` - Moved `message_compare` method to `StoreDef` trait > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
adityapk00
|
3e0f195cff |
fix: Run prune job in thread (#1782)
## Motivation Run the prune job in a thread so as to not block the NodeJS main thread ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [X] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [X] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [X] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [X] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) <!-- start pr-codex --> --- ## PR-Codex overview This PR optimizes the `pruneMessagesJob` in `@farcaster/hubble` by running it in a thread to prevent blocking the NodeJS main thread. ### Detailed summary - Moved `pool` field out of `Store` struct - Added `messagePostFix` check in `index.ts` - Added `once_cell` dependency in `store.rs` - Improved error handling in `store.rs` - Implemented threadpool for `prune_messages` in `store.rs` > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex --> |
||
|
Wasif Iqbal
|
66cef07909 |
fix: solana base58 instead of text decode to avoid null bytes (#1779)
## Motivation - Fix encoding for Solana on message processing such that it is base58 encoded for block hash and address, since text encoding can yield null bytes which will throw error in postgres ## Change Summary Describe the changes being made in 1-2 concise sentences. ## Merge Checklist _Choose all relevant options below by adding an `x` now or at any time before submitting for review_ - [x] PR title adheres to the [conventional commits](https://www.conventionalcommits.org/en/v1.0.0/) standard - [x] PR has a [changeset](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#35-adding-changesets) - [ ] PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore) - [ ] PR includes [documentation](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#32-writing-docs) if necessary. - [x] All [commits have been signed](https://github.com/farcasterxyz/hub-monorepo/blob/main/CONTRIBUTING.md#22-signing-commits) ## Additional Context If this is a relatively large or complex change, provide more details here that will help reviewers <!-- start pr-codex --> --- ## PR-Codex overview This PR updates the replicator package to version 0.3.5, introducing Base58 encoding for Solana data in the util.ts file. ### Detailed summary - Bumps replicator package version to 0.3.5 - Adds Base58 encoding for Solana data in util.ts > ✨ Ask PR-Codex anything about this PR by commenting with `/codex {your question}` <!-- end pr-codex -->@farcaster/replicator@0.3.5 |