Commit Graph

4 Commits

Author SHA1 Message Date
Shane da Silva
32e660a181 fix: Reduce memory consumption of replication example (#943)
We had a report of one user on modern MacBook with 16GB of memory who
was running into heap allocation issues. This was likely due to the
excessive number of promises we were creating (as well as buffering all
data for each call).

Change the logic to fetch in batches of 1K records at most. This slows
down the initial sync but should reduce the likelihood that someone will
hit a memory limit.

We also specify a custom limit in the `yarn start` command so that when
we test locally we are using the same limit as everyone else.
2023-05-05 15:53:56 -07:00
Shane da Silva
987e1c460b chore: Remove some unused code from replication example (#941) 2023-05-05 11:14:34 -07:00
Shane da Silva
22f53d6c2b Fix handling of conflicts on UserData insertion (#940)
We were using hash as the conflict ID instead of FID + type. Fix this.
2023-05-05 10:26:48 -07:00
Shane da Silva
cc2f5a4fae Add syncing/replication example for Postgres (#938)
Provide a working end-to-end example of syncing data from hubs to a
Postgres database.

This should work with no additional dependencies besides what you
install with `yarn install` and Docker.
2023-05-05 09:56:48 -07:00