Vikhyath Mondreti
be3cdcf981
Merge pull request #3179 from simstudioai/improvement/file-download-timeouts
...
improvement(timeouts): files/base64 should use max timeouts + auth centralization
2026-02-10 15:57:06 -08:00
Siddharth Ganesan
190f12fd77
feat(copilot): copilot mcp + server side copilot execution ( #3173 )
...
* v0
* v1
* Basic ss tes
* Ss tests
* Stuff
* Add mcp
* mcp v1
* Improvement
* Fix
* BROKEN
* Checkpoint
* Streaming
* Fix abort
* Things are broken
* Streaming seems to work but copilot is dumb
* Fix edge issue
* LUAAAA
* Fix stream buffer
* Fix lint
* Checkpoint
* Initial temp state, in the middle of a refactor
* Initial test shows diff store still working
* Tool refactor
* First cleanup pass complete - untested
* Continued cleanup
* Refactor
* Refactor complete - no testing yet
* Fix - cursor makes me sad
* Fix mcp
* Clean up mcp
* Updated mcp
* Add respond to subagents
* Fix definitions
* Add tools
* Add tools
* Add copilot mcp tracking
* Fix lint
* Fix mcp
* Fix
* Updates
* Clean up mcp
* Fix copilot mcp tool names to be sim prefixed
* Add opus 4.6
* Fix discovery tool
* Fix
* Remove logs
* Fix go side tool rendering
* Update docs
* Fix hydration
* Fix tool call resolution
* Fix
* Fix lint
* Fix superagent and autoallow integrations
* Fix always allow
* Update block
* Remove plan docs
* Fix hardcoded ff
* Fix dropped provider
* Fix lint
* Fix tests
* Fix dead messages array
* Fix discovery
* Fix run workflow
* Fix run block
* Fix run from block in copilot
* Fix lint
* Fix skip and mtb
* Fix typing
* Fix tool call
* Bump api version
* Fix bun lock
* Nuke bad files
2026-02-09 19:33:29 -08:00
Waleed
2bc403972c
feat(a2a): added a2a protocol ( #2784 )
...
* feat(a2a): a2a added
* feat(a2a): added a2a protocol
* remove migrations
* readd migrations
* consolidated permissions utils
* consolidated tag-input, output select -> combobox, added tags for A2A
* cleanup up utils, share same deployed state as other tabs
* ack PR comments
* more
* updated code examples
* solely rely on tanstack query to vend data and invalidate query key's, remove custom caching
---------
Co-authored-by: Emir Karabeg <emirkarabeg@berkeley.edu >
2026-01-13 11:43:02 -08:00
Waleed
5145ce1684
improvement(response): removed nested response block output, add docs for webhook block, styling improvements for subblocks ( #2700 )
...
* improvement(response): removed nested response block output, add docs for webhook block, styling improvements for subblocks
* remove outdated block docs
* updated docs
* remove outdated tests
2026-01-06 19:43:25 -08:00
Waleed
d707d18ee6
fix(build): update dockerfile to contain testing package deps ( #2591 )
...
* fix(build): update dockerfile to contain testing package deps
* added logger package
2025-12-26 12:20:38 -08:00
Waleed
da7eca9590
fix(change-detection): move change detection logic to client-side to prevent unnecessary API calls, consolidate utils ( #2576 )
...
* fix(change-detection): move change detection logic to client-side to prevent unnecessary API calls, consolidate utils
* added tests
* ack PR comments
* added isPublished to API response
2025-12-24 17:16:35 -08:00
Vikhyath Mondreti
bf8fbebe22
improvement(code-quality): centralize regex checks, normalization ( #2554 )
...
* improvement(code-quality): centralize regex checks, normalization
* simplify resolution
* fix(copilot): don't allow duplicate name blocks
* centralize uuid check
2025-12-23 15:12:04 -08:00
Waleed
3a33ec929f
fix(authentication): added auth checks for various routes, mysql and postgres query validation, csp improvements ( #2472 )
2025-12-19 00:44:52 -08:00
Vikhyath Mondreti
39d5d797ec
fix(workflow-changes): changes detected in autolayout ( #2313 )
2025-12-11 12:45:48 -08:00
Waleed
41c068c023
improvement(lib): refactored lib/ to be more aligned with queries and api directory ( #2160 )
...
* fix(lib): consolidate into core dir in lib/
* refactored lib/
2025-12-02 14:17:41 -08:00
Vikhyath Mondreti
fe9ebbf81b
improvement(api-keys): move to workspace level ( #1765 )
...
* fix(billing): should allow restoring subscription (#1728 )
* fix(already-cancelled-sub): UI should allow restoring subscription
* restore functionality fixed
* fix
* improvement(api-keys): move to workspace level
* remove migration to prep merge
* remove two more unused cols
* prep staging merge
* add migration back
---------
Co-authored-by: Waleed <walif6@gmail.com >
Co-authored-by: Siddharth Ganesan <33737564+Sg312@users.noreply.github.com >
2025-10-30 11:42:58 -07:00
Waleed
67e681dd7c
feat(webhooks): added optioanl input format to webhooks, added support for file uploads ( #1654 )
...
* feat(webhooks): added optioanl input format to webhooks, added support for file uploads
* feat(webhooks): added input format component to generic webhook trigger, added file support
* consolidated execution files utils, extended presigned URL duration for async tasks
2025-10-16 12:16:12 -07:00
Vikhyath Mondreti
82fa4e8bbb
fix(input-format): allow value field to be cleared ( #1658 )
...
* fix(input-format): allow value field to be cleared
* don't let value field be detected as deployment change
* fix zep icon in docs
* exclude collapsed state
2025-10-16 11:11:27 -07:00
Vikhyath Mondreti
eb4821ff30
fix(chat-subs): always use getBaseUrl helper to fetch base url ( #1643 )
...
* fix(chat-subs): always use next public app url env
* use getBaseUrl everywhere
* move remaining uses
* fix test
* change auth.ts and make getBaseUrl() call not top level for emails
* change remaining uses
* revert csp
* cleanup
* fix
2025-10-15 14:13:23 -07:00
Waleed
e83d3a6b9f
fix(tool-calls): remove redundant input/output fields in favor of arguments/response, exclude isExpanded for tools in agents in workflow change detection ( #1630 )
2025-10-14 17:21:17 -07:00
Waleed
2d49892aaa
feat(deployed-chat): added file upload to workflow execute API, added to deployed chat, updated chat panel ( #1588 )
...
* feat(deployed-chat): updated chat panel UI, deployed chat and API can now accept files
* added nested tag dropdown for files
* added duplicate file validation to chat panel
* update docs & SDKs
* fixed build
* rm extraneous comments
* ack PR comments, cut multiple DB roundtrips for permissions & api key checks in api/workflows
* allow read-only users to access deployment info, but not take actions
* add downloadable file to logs for files passed in via API
* protect files/serve route that is only used client-side
---------
Co-authored-by: waleed <waleed>
2025-10-10 17:19:51 -07:00
Waleed
bcc75376e5
feat(permissions): allow users to deploy workflows in all workspaces they are an admin in ( #1463 )
...
* feat(permissions): allow admin workspace users to deploy workflows in workspaces they don't own
* fixed failing test
* added additional routes
* remove overly complex, unecessary test and fixed docs formatting
* follow DRY
2025-09-26 19:58:11 -07:00
Vikhyath Mondreti
928581f387
feat(deployments): make deployed state source of truth for non-manual executions + versioning ( #1242 )
...
* feat(deployments): make deployed state source of truth for non-manual executions + versioning
* fix lint
* fix test
* add script to migrate to deployed vesions
* fix deployed chat
* address greptile commands
* Remove 84th migration files to prepare for regeneration
* fix script + update migration
* fix script
* cleanup typing
* use shared helper
* fix tests
* fix duplicate route
* revert migrations prep
* add migration back
* add workflow in workflow block func
* fix UI
* fix lint
* make migration idempotent
* remove migrations
* add migrations back'
* adjust script to reuse helper
* add test webhook URL functionality
* consolidate test URL + prod URL code for webhooks
* fixes
* update trigger config save with correct dependencies
* make frozen canvas respect trigger mode
* chore(db): remove latest migration 0088, snapshot, journal entry; delete migrate-deployment-versions script
* separate parent id cleanup migration
* chore(db): remove 0089 migration, snapshot, and prune journal entry
* chore(db): generate 0090 migration after removing 0089 and merging staging
* fix
* chore(db): remove 0090 migration, snapshot, and prune journal entry
* chore(db): generate 0091 migration after merging staging and restoring idempotency flow
* fix some imports
* remove dead code
* fix tests
* remove comment
* working test url functionality restored
* works
* some styling changes
* make deploy text accurate
* chore(db): remove latest migration 0091 and snapshot; update journal before merging staging
* db(migrations): generate 0093_medical_sentinel and snapshots after merging staging
* reconcile with other merge
* fix trigger test
* remove extra use effect
* fix test url"
* don't swallow serializer errors
* fix lint
* fix tests
* fix tests
* expose root for generic webhook
* root access for webhook
* add is workflow ready check correctly
2025-09-24 20:28:09 -07:00
Vikhyath Mondreti
9de7a00373
improvement(code-structure): move db into separate package ( #1364 )
...
* improvement(code-structure): move db into separate package
* make db separate package
* remake bun lock
* update imports to not maintain two separate ones
* fix CI for tests by adding dummy url
* vercel build fix attempt
* update bun lock
* regenerate bun lock
* fix mocks
* remove db commands from apps/sim package json
2025-09-17 15:41:13 -07:00
Waleed
065fc5b87b
feat(api-keys): add workspace level api keys to share with other workspace members, add encryption for api keys ( #1323 )
...
* update infra and remove railway
* feat(api-keys): add workspace-level api keys
* encrypt api keys
* Revert "update infra and remove railway"
This reverts commit b23258a5a1 .
* reran migrations
* tested workspace keys
* consolidated code
* more consolidation
* cleanup
* consolidate, remove unused code
* add dummy key for ci
* continue with regular path for self-hosted folks that don't have key set
* fix tests
* fix test
* remove tests
* removed ci additions
2025-09-12 11:46:47 -07:00
Vikhyath Mondreti
56543dafb4
fix(billing): usage tracking cleanup, shared pool of limits for team/enterprise ( #1131 )
...
* fix(billing): team usage tracking cleanup, shared pool of limits for team
* address greptile commments
* fix lint
* remove usage of deprecated cols"
* update periodStart and periodEnd correctly
* fix lint
* fix type issue
* fix(billing): cleaned up billing, still more work to do on UI and population of data and consolidation
* fix upgrade
* cleanup
* progress
* works
* Remove 78th migration to prepare for merge with staging
* fix migration conflict
* remove useless test file
* fix
* Fix undefined seat pricing display and handle cancelled subscription seat updates
* cleanup code
* cleanup to use helpers for pulling pricing limits
* cleanup more things
* cleanup
* restore environment ts file
* remove unused files
* fix(team-management): fix team management UI, consolidate components
* use session data instead of subscription data in settings navigation
* remove unused code
* fix UI for enterprise plans
* added enterprise plan support
* progress
* billing state machine
* split overage and base into separate invoices
* fix badge logic
---------
Co-authored-by: waleedlatif1 <walif6@gmail.com >
2025-08-28 17:00:48 -07:00
Waleed Latif
da04ea0e9f
fix(subflows): added change detection for parallels, updated deploy and status schemas to match parallel/loop ( #956 )
2025-08-13 21:18:07 -07:00
Waleed Latif
93f68a9092
refactor(logger): code cleanup for new execution logger ( #798 )
...
* refactor(logger): code hygiene with new logger
* modify remaining files
* simplify code structure
---------
Co-authored-by: waleedlatif <waleedlatif@waleedlatifs-MacBook-Pro.local >
2025-07-26 15:05:33 -07:00
Waleed Latif
a217daca3c
fix(envvars): use getEnv on the client-side when we need to inject vars for docker runtime, fix folder container & removed folder/subfolder creation modals ( #751 )
...
* use getEnv on the client-side when we need to inject vars for docker runtime, fix folder container & removed folder/subfolder creation modals
* consolidated naming utils
* additional type safety
2025-07-22 16:08:04 -07:00
Waleed Latif
8a9bc4e929
fix(permissions): make permissions check case insensitive, resolve hydration issues by consolidating environment checking function ( #678 )
...
* fix(permissions): make permissions check case insensitive
* consolidated use of helpers to fetch environment
* use import aliases
* fix(voice): added voice functionality back to chat client (#676 )
* fix(voice): added voice functioanlity back to chat clinet
* add logic to support deployed chat in staging
* fix(api-timeout): increase timeout for API block to 2 min (#677 )
* feat(wealthbox): added wealthbox crm (#669 )
* feat: wealthbox
* feat: added tools
* feat: tested and finished tools
* feat: tested and finished tools
* feat: added refresh token
* fix: added docs
* bun lint
* feat: removed files #669
* fix: greptile comments
* fix: stringified messages #669
* add visibilty to params
---------
Co-authored-by: Adam Gough <adamgough@Adams-MacBook-Pro.local >
Co-authored-by: Adam Gough <adamgough@Mac.attlocal.net >
Co-authored-by: Vikhyath Mondreti <vikhyath@simstudio.ai >
---------
Co-authored-by: Vikhyath Mondreti <vikhyathvikku@gmail.com >
Co-authored-by: Adam Gough <77861281+aadamgough@users.noreply.github.com >
Co-authored-by: Adam Gough <adamgough@Adams-MacBook-Pro.local >
Co-authored-by: Adam Gough <adamgough@Mac.attlocal.net >
Co-authored-by: Vikhyath Mondreti <vikhyath@simstudio.ai >
2025-07-14 13:42:06 -07:00
Waleed Latif
76df2b9cd9
fix(sockets): added throttling, refactor entire socket server, added tests ( #534 )
...
* refactor(kb): use chonkie locally (#475 )
* feat(parsers): text and markdown parsers (#473 )
* feat: text and markdown parsers
* fix: don't readfile on buffer, convert buffer to string instead
* fix(knowledge-wh): fixed authentication error on webhook trigger
fix(knowledge-wh): fixed authentication error on webhook trigger
* feat(tools): add huggingface tools/blcok (#472 )
* add hugging face tool
* docs: add Hugging Face tool documentation
* fix: format and lint Hugging Face integration files
* docs: add manual intro section to Hugging Face documentation
* feat: replace Record<string, any> with proper HuggingFaceRequestBody interface
* accidental local files added
* restore some docs
* make layout full for model field
* change huggingface logo
* add manual content
* fix lint
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
* fix(knowledge-ux): fixed ux for knowledge base (#478 )
fix(knowledge-ux): fixed ux for knowledge base (#478 )
* fix(billing): bump better-auth version & fix existing subscription issue when adding seats (#484 )
* bump better-auth version & fix existing subscription issue Bwhen adding seats
* ack PR comments
* fix(env): added NEXT_PUBLIC_APP_URL to .env.example (#485 )
* feat(subworkflows): workflows as a block within workflows (#480 )
* feat(subworkflows) workflows in workflows
* revert sync changes
* working output vars
* fix greptile comments
* add cycle detection
* add tests
* working tests
* works
* fix formatting
* fix input var handling
* add images
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
* fix(kb): fixed kb race condition resulting in no chunks found (#487 )
* fix: added all blocks activeExecutionPath (#486 )
* refactor(chunker): replace chonkie with custom TextChunker (#479 )
* refactor(chunker): replace chonkie with custom TextChunker implementation and update document processing logic
* chore: cleanup unimplemented types
* fix: KB tests updated
* fix(tab-sync): sync between tabs on change (#489 )
* fix(tab-sync): sync between tabs on change
* refactor: optimize JSON.stringify operations that are redundant
* fix(file-upload): upload presigned url to kb for file upload instead of the whole file, circumvents 4.5MB serverless func limit (#491 )
* feat(folders): folders to manage workflows (#490 )
* feat(subworkflows) workflows in workflows
* revert sync changes
* working output vars
* fix greptile comments
* add cycle detection
* add tests
* working tests
* works
* fix formatting
* fix input var handling
* fix(tab-sync): sync between tabs on change
* feat(folders): folders to organize workflows
* address comments
* change schema types
* fix lint error
* fix typing error
* fix race cond
* delete unused files
* improved UI
* updated naming conventions
* revert unrelated changes to db schema
* fixed collapsed sidebar subfolders
* add logs filters for folders
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: Waleed Latif <walif6@gmail.com >
* revert tab sync
* improvement(folders): added multi-select for moving folders (#493 )
* added multi-select for folders
* allow drag into root
* remove extraneous comments
* instantly create worfklow on plus
* styling improvements, fixed flicker
* small improvement to dragover container
* ack PR comments
* fix(deployed-chat): made the chat mobile friendly (#494 )
* improvement(ui/ux): chat deploy (#496 )
* improvement(ui/ux): chat deploy experience
* improvement(ui/ux): chat fontweight
* feat(gmail): added option to access raw gmail from gmail polling service (#495 )
* added option to grab raw gmail from gmail polling service
* safe json parse for function block execution to prevent vars in raw email from being resolved as sim studio vars
* added tests
* remove extraneous comments
* fix(ui): fix the UI for folder deletion, huggingface icon, workflow block icon, standardized alert dialog (#498 )
* fixed folder delete UI
* fixed UI for workflow block, huggingface, & added alert dialog for deleting folders
* consistently style all alert dialogs
* fix(reset-data): remove reset all data button from settings modal along with logic (#499 )
* fix(airtable): fixed airtable oauth token refresh, added tests (#502 )
* fixed airtable token refresh, added tests
* added helpers for refreshOAuthToken function
* feat(registration): disable registration + handle env booleans (#501 )
* feat: disable registration + handle env booleans
* chore: removing pre-process because we need to use util
* chore: format
* feat(providers): added azure openai (#503 )
* added azure openai
* fix request params being passed through agent block for azure
* remove o1 from azure-openai models list
* fix: add vscode settings to gitignore
* feat(file-upload): generalized storage to support azure blob, enhanced error logging in kb, added xlsx parser (#506 )
* added blob storage option for azure, refactored storage client to be provider agnostic, tested kb & file upload and s3 is undisrupted, still have to test blob
* updated CORS policy for blob, added azure blob-specific headers
* remove extraneous comments
* add file size limit and timeout
* added some extra error handling in kb add documents
* grouped envvars
* ack PR comments
* added sheetjs and xlsx parser
* fix(folders): modified folder deletion to delete subfolders & workflows in it instead of moving to root (#508 )
* modified folder deletion to delete subfolders & workflows in it instead of moving to root
* added additional testing utils
* ack PR comments
* feat: api response block and implementation
* improvement(local-storage): remove use of local storage except for oauth and last active workspace id (#497 )
* remove local storage usage
* remove migration for last active workspace id
* Update apps/sim/app/w/[id]/components/workflow-block/components/sub-block/components/file-selector/components/jira-issue-selector.tsx
Add fallback for required scopes
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* add url builder util
* fi
* fix lint
* lint
* modify pre commit hook
* fix oauth
* get last active workspace working again
* new workspace logic works
* fetch locks
* works now
* remove empty useEffect
* fix loading issue
* skip empty workflow syncs
* use isWorkspace in transition flag
* add logging
* add data initialized flag
* fix lint
* fix: build error by create a server-side utils
* remove migration snapshots
* reverse search for workspace based on workflow id
* fix lint
* improvement: loading check and animation
* remove unused utils
* remove console logs
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
Co-authored-by: Emir Karabeg <emirkarabeg@berkeley.edu >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
* feat(multi-select): simplified chat to always return readable stream, can select multiple outputs and get response streamed back in chat panel & deployed chat (#507 )
* improvement: all workflow executions return ReadableStream & use sse to support multiple streamed outputs in chats
* fixed build
* remove extraneous comments
* general improvemetns
* ack PR comments
* fixed built
* improvement(workflow-state): split workflow state into separate tables (#511 )
* new tables to track workflow state
* fix lint
* refactor into separate tables
* fix typing
* fix lint
* add tests
* fix lint
* add correct foreign key constraint
* add self ref
* remove unused checks
* fix types
* fix type
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
* feat(models): added new openai models, updated model pricing, added new groq model (#513 )
* fix(autocomplete): fixed extra closing tag on tag dropdown autocomplete (#514 )
* chore: enable input format again
* fix: process the input made on api calls with proper extraction
* feat: add json-object for ai generation for response block and others
* chore: add documentation for response block
* chore: rollback temp fix and uncomment original input handler
* chore: add missing mock for response handler
* chore: add missing mock
* chore: greptile recommendations
* added cost tracking for router & evaluator blocks, consolidated model information into a single file, hosted keys for evaluator & router, parallelized unit tests (#516 )
* fix(deployState): deploy not persisting bug (#518 )
* fix(undeploy-bug): fix deployment persistence failing bug
* fix lint
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
* fix decimal entry issues
* remove unused files
* fix(db): decimal position entry issues (#520 )
* fix decimal entry issues
* remove unused files
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
* fix lint
* fix test
* improvement(kb): added configurability for chunks, query across multiple knowledge bases (#512 )
* refactor: consolidate create modal file
* fix: identify dead processes
* fix: mark failed in DB after processing timeout
* improvement: added overlap chunks and fixed modal UI
* feat: multiselect logic
* fix: biome changes for css ordering warn instead of error
* improvement: create chunk ui
* fix: removed unused schema columns
* fix: removed references to deleted columns
* improvement: sped up vector search time
* feat: multi-kb search
* add bulk endpoint to disable/delete multiple chunks
* add bulk endpoint to disable/delete multiple chunks
* fix: removed unused schema columns
* fix: removed references to deleted columns
* made endpoints for knowledge more RESTful, added tests
* added batch operations for delete/enable/disable docs, alr have this for chunks
* added migrations
* added migrations
---------
Co-authored-by: Waleed Latif <walif6@gmail.com >
* fix(models): remove temp from models that don't support it
* feat(sdk): added ts and python SDKs + docs (#524 )
* added ts & python sdk, renamed cli from simstudio to cli
* added docs
* ack PR comments
* improvements
* fixed issue where it goes to random workspace when you click reload
fixed lint issue
* feat: better response builder + doc update
* fix(auth): added preview URLs to list of trusted origins (#525 )
* trusted origins
* lint error
* removed localhost
* ran lint
---------
Co-authored-by: Waleed Latif <walif6@gmail.com >
* fix(sdk): remove dev script from SDK
* PR: changes for migration
* add changes on top of db migration changes
* fix: allow removing single input field
* improvement(permissions): workspace permissions improvements, added provider and reduced API calls by 85% (#530 )
* improved permissions UI & access patterns, show outstanding invites
* added logger
* added provider for workspace permissions, 85% reduction in API calls to get user permissions and improved performance for invitations
* ack PR comments
* cleanup
* fix disabled tooltips
* improvement(tests): parallelized tests and build fixes (#531 )
* added provider for workspace permissions, 85% reduction in API calls to get user permissions and improved performance for invitations
* parallelized more tests, fixed test warnings
* removed waitlist verification route, use more utils in tests
* fixed build
* ack PR comments
* fix
* fix(kb): reduced params in kb block, added advanced mode to starter block, updated docs
* feat(realtime): sockets + normalized tables + deprecate sync (#523 )
* feat: implement real-time collaborative workflow editing with Socket.IO
- Add Socket.IO server with room-based architecture for workflow collaboration
- Implement socket context for client-side real-time communication
- Add collaborative workflow hook for synchronized state management
- Update CSP to allow socket connections to localhost:3002
- Add fallback authentication for testing collaborative features
- Enable real-time broadcasting of workflow operations between tabs
- Support multi-user editing of blocks, edges, and workflow state
Key components:
- socket-server/: Complete Socket.IO server with authentication and room management
- contexts/socket-context.tsx: Client-side socket connection and state management
- hooks/use-collaborative-workflow.ts: Hook for collaborative workflow operations
- Workflow store integration for real-time state synchronization
Status: Basic collaborative features working, authentication bypass enabled for testing
* feat: complete collaborative subblock editing implementation
✅ All collaborative features now working perfectly:
- Real-time block movement and positioning
- Real-time subblock value editing (text fields, inputs)
- Real-time edge operations and parent updates
- Multi-user workflow rooms with proper broadcasting
- Socket.IO server with room-based architecture
- Permission bypass system for testing
🔧 Technical improvements:
- Modified useSubBlockValue hook to use collaborative event system
- All subblock setValue calls now dispatch 'update-subblock-value' events
- Collaborative workflow hook handles all real-time operations
- Socket server processes and persists all operations to database
- Clean separation between local and collaborative state management
🧪 Tested and verified:
- Multiple browser tabs with different fallback users
- Block dragging and positioning updates in real-time
- Subblock text editing reflects immediately across tabs
- Workflow room management and user presence
- Database persistence of all collaborative operations
Status: Full collaborative workflow editing working with fallback authentication
* feat: implement proper authentication for collaborative Socket.IO server
✅ **Authentication System Complete**:
- Removed all fallback authentication code and bypasses
- Socket server now requires valid Better Auth session cookies
- Proper session validation using auth.api.getSession()
- Authentication errors properly handled and logged
- User info extracted from session: userId, userName, email, organizationId
🔧 **Technical Implementation**:
- Updated CSP to allow WebSocket connections (ws://localhost:3002)
- Socket authentication middleware validates session tokens
- Proper error handling for missing/invalid sessions
- Permission system enforces workflow access controls
- Clean separation between authenticated and unauthenticated states
🧪 **Testing Status**:
- Socket server properly rejects unauthenticated connections
- Authentication errors logged with clear messages
- CSP updated to allow both HTTP and WebSocket protocols
- Ready for testing with authenticated users
Status: Production-ready collaborative authentication system
* feat: complete authentication integration for collaborative Socket.IO system
🎉 **PRODUCTION-READY COLLABORATIVE SYSTEM**
✅ **Authentication Integration Complete**:
- Fixed Socket.IO client to send credentials (withCredentials: true)
- Updated server CORS to accept credentials with specific origin
- Removed all fallback authentication bypasses
- Proper Better Auth session validation working
🔧 **Technical Fixes**:
- Socket client: Enable withCredentials for cookie transmission
- Socket server: Accept credentials with origin 'http://localhost:3000 '
- Better Auth cookie utility integration for session parsing
- Comprehensive authentication middleware with proper error handling
🧪 **Verified Working Features**:
- ✅ Real user authentication (Vikhyath Mondreti authenticated)
- ✅ Multi-user workflow rooms (2+ users in same workflow)
- ✅ Permission system enforcing workflow access controls
- ✅ Real-time subblock editing across browser tabs
- ✅ Block movement and positioning updates
- ✅ Automatic room cleanup and management
- ✅ Database persistence of all collaborative operations
🚀 **Status**: Complete enterprise-grade collaborative workflow editing system
- No more fallback users - production authentication
- Multi-tab collaboration working perfectly
- Secure access control with Better Auth integration
- Real-time updates for all workflow operations
* remove sync system and move to server side
* fix lint
* delete unused file
* added socketio dep
* fix subblock persistence bug
* working deletion of workflows
* fix lint
* added railway
* add debug logging for railway deployment
* improve typing
* fix lint
* working subflow persistence
* fix lint
* working cascade deletion
* fix lint
* working subflow inside subflow
* works
* fix lint
* prevent subflow in subflow
* fix lint
* add additional logs, add localhost as allowedOrigin
* add additional logs, add localhost as allowedOrigin
* fix type error
* remove unused code
* fix lint
* fix tests
* fix lint
* fix build error
* workign folder updates
* fix typing issue
* fix lint
* fix typing issues
* lib/
* fix tests
* added old presence component back, updated to use one-time-token better auth plugin for socket server auth, tested
* fix errors
* fix bugs
* add migration scripts to run
* fix lint
* fix deploy tests
* fix lint
* fix minor issues
* fix lint
* fix migration script
* allow comma separateds id file input to migration script
* fix lint
* fixed
* fix lint
* fix fallback case
* fix type errors
* address greptile comments
* fix lint
* fix script to generate new block ids
* fix lint
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
Co-authored-by: Waleed Latif <walif6@gmail.com >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
* fix(sockets): updated CSP
* remove unecessary logs
* fix lint
* added throttling, refactor entire socket server, added tests
* improvements
* remove self monitoring func, add block name event
* working isWide, isAdvanced toggles with sockets
* fix lint
* fix duplicate key issue for user avatar
* fix lint
* fix user presence
* working parallel badges / loop badges updates
* working connection output persistence
* fix lint
* fix build errors
* fix lint
* logs removed
* fix cascade var name update bug
* works
* fix lint
* fix parallel blocks
* fix placeholder
* fix test
* fixed tests
---------
Co-authored-by: Aditya Tripathi <aditya@climactic.co >
Co-authored-by: Adam Gough <77861281+aadamgough@users.noreply.github.com >
Co-authored-by: Vikhyath Mondreti <vikhyathvikku@gmail.com >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: Emir Karabeg <emirkarabeg@berkeley.edu >
Co-authored-by: Emir Karabeg <78010029+emir-karabeg@users.noreply.github.com >
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
Co-authored-by: Ajit Kadaveru <ajit.kadaveru@berkeley.edu >
2025-06-24 17:44:30 -07:00
Waleed Latif
8c268e23dd
chore(biome): removed prettier, added biome ( #407 )
...
* chore: replace prettier with biome and add linting
* chore: update devcontainer settings to use biome for linting and remove eslint, prettier
* chore: update docker-compose to use Postgres 17-alpine and standardize quotes
* chore: fixed more BUT disabled most rules due to limit
* added additional rules, fixed linting & ts errors
* added additional rules
* rebased & linted
* fixed oauth
* updated biome & minor modifications
---------
Co-authored-by: Aditya Tripathi <aditya@climactic.co >
2025-05-24 03:11:38 -07:00
Waleed Latif
717e17d02a
feat(bun): upgrade to bun, reduce docker image size by 95%, upgrade docs & ci ( #371 )
...
* migrate to bun
* added envvars to drizzle
* upgrade bun devcontainer feature to a valid one
* added bun, docker not working
* updated envvars, updated to bunder and esnext modules
* fixed build, reinstated otel
* feat: optimized multi-stage docker images
* add coerce for boolean envvar
* feat: add docker-compose configuration for local LLM services and remove legacy Dockerfile and entrypoint script
* feat: add docker-compose files for local and production environments, and implement GitHub Actions for Docker image build and publish
* refactor: remove unused generateStaticParams function from various API routes and maintain dynamic rendering
* cleanup
* upgraded bun
* updated ci
* fixed build
---------
Co-authored-by: Aditya Tripathi <aditya@climactic.co >
2025-05-18 01:01:32 -07:00
Waleed Latif
43cb4cbf15
improvement(subscriptions): added log retention cron, enterprise plan & refactored subscriptions logic ( #357 )
...
* added cron to cleanup logs for free users
* added log retention cron, admin dashboard, & enterprise plan. refactored subscriptions logic & ui
* added more type safety & added total chat executions to user stats table
* removed waitlist + admin
* added tests, fixed edge cases
* removed migrations
* acknowledged PR comments
* added heplers, removed duplicate logic
* removed extraneous comments
2025-05-14 18:25:48 -07:00
Waleed Latif
a92ee8bf46
feat(turbo): restructured repo to be a standard turborepo monorepo ( #341 )
...
* added turborepo
* finished turbo migration
* updated gitignore
* use dotenv & run format
* fixed error in docs
* remove standalone deployment in prod
* fix ts error, remove ignore ts errors during build
* added formatter to the end of the docs generator
2025-05-09 21:45:49 -07:00