Waleed
86ed32ea10
feat(kb): added json/yaml parser+chunker, added dedicated csv chunker ( #1539 )
...
* feat(kb): added json/yaml parser+chunker, added dedicated csv chunker
* ack PR comments
* improved kb upload
2025-10-04 14:59:21 -07:00
Waleed
065fc5b87b
feat(api-keys): add workspace level api keys to share with other workspace members, add encryption for api keys ( #1323 )
...
* update infra and remove railway
* feat(api-keys): add workspace-level api keys
* encrypt api keys
* Revert "update infra and remove railway"
This reverts commit b23258a5a1
2025-09-12 11:46:47 -07:00
Waleed
8f7b11f089
feat(account): added user profile pictures in settings ( #1297 )
...
* update infra and remove railway
* feat(account): add profile pictures
* Revert "update infra and remove railway"
This reverts commit e3f0c49456
2025-09-09 16:09:31 -07:00
Waleed
43cb124d97
fix(parsers): fix md, pptx, html kb uploads ( #1209 )
...
* fix md, pptx, html
* consolidate consts
2025-08-31 00:52:42 -07:00
Siddharth Ganesan
cadfcdbfbd
Fix ( #1176 )
2025-08-28 19:21:29 -07:00
Waleed
51b1e97fa2
fix(kb-uploads): created knowledge, chunks, tags services and use redis for queueing docs in kb ( #1143 )
...
* improvement(kb): created knowledge, chunks, tags services and use redis for queueing docs in kb
* moved directories around
* cleanup
* bulk create docuemnt records after upload is completed
* fix(copilot): send api key to sim agent (#1142 )
* Fix api key auth
* Lint
* ack PR comments
* added sort by functionality for headers in kb table
* updated
* test fallback from redis, fix styling
* cleanup copilot, fixed tooltips
* feat: local auto layout (#1144 )
* feat: added llms.txt and robots.txt (#1145 )
* fix(condition-block): edges not following blocks, duplicate issues (#1146 )
* fix(condition-block): edges not following blocks, duplicate issues
* add subblock update to setActiveWorkflow
* Update apps/sim/app/workspace/[workspaceId]/w/[workflowId]/components/workflow-block/components/sub-block/components/condition-input.tsx
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
---------
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* fix dependency array
* fix(copilot-cleanup): support azure blob upload in copilot, remove dead code & consolidate other copilot files (#1147 )
* cleanup
* support azure blob image upload
* imports cleanup
* PR comments
* ack PR comments
* fix key validation
* improvement(forwarding+excel): added forwarding and improve excel read (#1136 )
* added forwarding for outlook
* lint
* improved excel sheet read
* addressed greptile
* fixed bodytext getting truncated
* fixed any type
* added html func
---------
Co-authored-by: Adam Gough <adamgough@Mac.attlocal.net >
* revert agent const
* update docs
---------
Co-authored-by: Siddharth Ganesan <33737564+Sg312@users.noreply.github.com >
Co-authored-by: Emir Karabeg <78010029+emir-karabeg@users.noreply.github.com >
Co-authored-by: Vikhyath Mondreti <vikhyathvikku@gmail.com >
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
Co-authored-by: Vikhyath Mondreti <vikhyath@simstudio.ai >
Co-authored-by: Adam Gough <77861281+aadamgough@users.noreply.github.com >
Co-authored-by: Adam Gough <adamgough@Mac.attlocal.net >
2025-08-26 22:55:18 -07:00
Waleed
8226e7b40a
fix(copilot-cleanup): support azure blob upload in copilot, remove dead code & consolidate other copilot files ( #1147 )
...
* cleanup
* support azure blob image upload
* imports cleanup
* PR comments
* ack PR comments
* fix key validation
2025-08-26 20:06:43 -07:00
Vikhyath Mondreti
de93e167af
feat(execution-filesystem): system to pass files between blocks ( #866 )
...
* feat(files): pass files between blocks
* presigned URL for downloads
* Remove latest migration before merge
* starter block file upload wasn't getting logged
* checkpoint in human readable form
* checkpoint files / file type outputs
* file downloads working for block outputs
* checkpoint file download
* fix type issues
* remove filereference interface with simpler user file interface
* show files in the tag dropdown for start block
* more migration to simple url object, reduce presigned time to 5 min
* Remove migration 0065_parallel_nightmare and related files
- Deleted apps/sim/db/migrations/0065_parallel_nightmare.sql
- Deleted apps/sim/db/migrations/meta/0065_snapshot.json
- Removed 0065 entry from apps/sim/db/migrations/meta/_journal.json
Preparing for merge with origin/staging and migration regeneration
* add migration files
* fix tests
* Update apps/sim/lib/uploads/setup.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* Update apps/sim/lib/workflows/execution-file-storage.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* Update apps/sim/lib/workflows/execution-file-storage.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* cleanup types
* fix lint
* fix logs typing for file refs
* open download in new tab
* fixed
* Update apps/sim/tools/index.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* fix file block
* cleanup unused code
* fix bugs
* remove hacky file id logic
* fix drag and drop
* fix tests
---------
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2025-08-07 12:51:30 -07:00
Siddharth Ganesan
94368eb1c2
Feat/copilot files ( #886 )
...
* Connects to s3
* Checkpoint
* File shows in message
* Make files clickable
* User input image
* Persist thumbnails
* Drag and drop files
* Lint
* Fix isdev
* Dont re-download files on rerender
2025-08-05 17:01:53 -07:00
waleedlatif
63f3871f60
feat(deploy-chat): added a logo upload for the chat, incr font size
2025-08-01 12:48:47 -07:00
Waleed Latif
0414aa5f6d
refactor(imports): added aliased imports everywhere ( #799 )
...
* refactor(imports): added aliased imports everywhere
* more aliased imports
* add barrel exports
* add more barrel exports
* cleanup
---------
Co-authored-by: waleedlatif <waleedlatif@waleedlatifs-MacBook-Pro.local >
2025-07-26 16:10:32 -07:00
Waleed Latif
93f68a9092
refactor(logger): code cleanup for new execution logger ( #798 )
...
* refactor(logger): code hygiene with new logger
* modify remaining files
* simplify code structure
---------
Co-authored-by: waleedlatif <waleedlatif@waleedlatifs-MacBook-Pro.local >
2025-07-26 15:05:33 -07:00
Waleed Latif
d13a06e2c5
improvement(imports): changed relative to absolute imports ( #681 )
...
* improvement(imports): replace relative imports with aliases
* replace console.log with logger
2025-07-14 15:55:04 -07:00
Waleed Latif
8a9bc4e929
fix(permissions): make permissions check case insensitive, resolve hydration issues by consolidating environment checking function ( #678 )
...
* fix(permissions): make permissions check case insensitive
* consolidated use of helpers to fetch environment
* use import aliases
* fix(voice): added voice functionality back to chat client (#676 )
* fix(voice): added voice functioanlity back to chat clinet
* add logic to support deployed chat in staging
* fix(api-timeout): increase timeout for API block to 2 min (#677 )
* feat(wealthbox): added wealthbox crm (#669 )
* feat: wealthbox
* feat: added tools
* feat: tested and finished tools
* feat: tested and finished tools
* feat: added refresh token
* fix: added docs
* bun lint
* feat: removed files #669
* fix: greptile comments
* fix: stringified messages #669
* add visibilty to params
---------
Co-authored-by: Adam Gough <adamgough@Adams-MacBook-Pro.local >
Co-authored-by: Adam Gough <adamgough@Mac.attlocal.net >
Co-authored-by: Vikhyath Mondreti <vikhyath@simstudio.ai >
---------
Co-authored-by: Vikhyath Mondreti <vikhyathvikku@gmail.com >
Co-authored-by: Adam Gough <77861281+aadamgough@users.noreply.github.com >
Co-authored-by: Adam Gough <adamgough@Adams-MacBook-Pro.local >
Co-authored-by: Adam Gough <adamgough@Mac.attlocal.net >
Co-authored-by: Vikhyath Mondreti <vikhyath@simstudio.ai >
2025-07-14 13:42:06 -07:00
Vikhyath Mondreti
016cd6750c
v0.2.6: fix + feat + improvement ( #612 )
...
* feat(function): added more granular error logs for function execution for easier debugging (#593 )
* added more granular error logs for function execution
* added tests
* fixed syntax error reporting
* feat(models): added temp controls for gpt-4.1 family of models (#594 )
* improvement(knowledge-upload): create and upload document to KB (#579 )
* improvement: added knowledge upload
* improvement: added greptile comments (#579 )
* improvement: changed to text to doc (#579 )
* improvement: removed comment (#579 )
* added input validation, tested persistence of KB selector
* update docs
---------
Co-authored-by: Adam Gough <adamgough@Mac.attlocal.net >
Co-authored-by: Waleed Latif <walif6@gmail.com >
* fix(remove workflow.state usage): no more usage of deprecated state column in any routes (#586 )
* fix(remove workflow.state usage): no more usage of deprecated state col in routes
* fix lint
* fix chat route to only use deployed state
* fix lint
* better typing
* remove useless logs
* fix lint
* restore workflow handler file
* removed all other usages of deprecated 'state' column from workflows table, updated tests
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Waleed Latif <walif6@gmail.com >
* fix(doc-selector-kb): enable doc selector when kb is selected (#596 )
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
* fix(unload): remove beforeunload warning since we communicate via wss (#597 )
* fix(executor): fix dependency resolution, allow blocks with multiple inputs to execute (#598 )
* feat(billing): added migrations for usage-based billing (#601 )
* feat(billing): added migrations for usage-based billing
* lint
* lint
* feat(logging): add new schemas + types for new logging system (#599 )
* feat(logging): add new schemas + types for logging
* fix lint
* update migration
* fix lint
* Remove migration 48 to avoid conflict with staging
* fixed merge conflict
* fix lint
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
* fix(createWorkflow): cleanup create workflow to prevent re-renders (#607 )
* fix(createWorkflow): no more client side id, duplicate schedules calls
* fix lint
* more cleanup
* fix lint
* fix spamming of create button causing issues
* fix lint
* add more colors + default workflow name changed
* Update apps/sim/stores/workflows/registry/utils.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* fix(telegram): added markdown text rendering (#611 )
* fix: added proper markdown
* fix: reverted route.ts file
---------
Co-authored-by: Adam Gough <adamgough@Adams-MacBook-Pro.local >
* fix(kb-upload): fix and consolidate KB file uploads logic (#610 )
* fix(kb-upload): fix and consolidate logic
* fix lint
* consolidated presigned routes, fixed temp id kb store issue, added nav to next/prev chunk on edit chunk modal
* fix ci test
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
Co-authored-by: Waleed Latif <walif6@gmail.com >
---------
Co-authored-by: Waleed Latif <walif6@gmail.com >
Co-authored-by: Adam Gough <77861281+aadamgough@users.noreply.github.com >
Co-authored-by: Adam Gough <adamgough@Mac.attlocal.net >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
Co-authored-by: Adam Gough <adamgough@Adams-MacBook-Pro.local >
2025-07-03 12:53:14 -07:00
Waleed Latif
76df2b9cd9
fix(sockets): added throttling, refactor entire socket server, added tests ( #534 )
...
* refactor(kb): use chonkie locally (#475 )
* feat(parsers): text and markdown parsers (#473 )
* feat: text and markdown parsers
* fix: don't readfile on buffer, convert buffer to string instead
* fix(knowledge-wh): fixed authentication error on webhook trigger
fix(knowledge-wh): fixed authentication error on webhook trigger
* feat(tools): add huggingface tools/blcok (#472 )
* add hugging face tool
* docs: add Hugging Face tool documentation
* fix: format and lint Hugging Face integration files
* docs: add manual intro section to Hugging Face documentation
* feat: replace Record<string, any> with proper HuggingFaceRequestBody interface
* accidental local files added
* restore some docs
* make layout full for model field
* change huggingface logo
* add manual content
* fix lint
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
* fix(knowledge-ux): fixed ux for knowledge base (#478 )
fix(knowledge-ux): fixed ux for knowledge base (#478 )
* fix(billing): bump better-auth version & fix existing subscription issue when adding seats (#484 )
* bump better-auth version & fix existing subscription issue Bwhen adding seats
* ack PR comments
* fix(env): added NEXT_PUBLIC_APP_URL to .env.example (#485 )
* feat(subworkflows): workflows as a block within workflows (#480 )
* feat(subworkflows) workflows in workflows
* revert sync changes
* working output vars
* fix greptile comments
* add cycle detection
* add tests
* working tests
* works
* fix formatting
* fix input var handling
* add images
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
* fix(kb): fixed kb race condition resulting in no chunks found (#487 )
* fix: added all blocks activeExecutionPath (#486 )
* refactor(chunker): replace chonkie with custom TextChunker (#479 )
* refactor(chunker): replace chonkie with custom TextChunker implementation and update document processing logic
* chore: cleanup unimplemented types
* fix: KB tests updated
* fix(tab-sync): sync between tabs on change (#489 )
* fix(tab-sync): sync between tabs on change
* refactor: optimize JSON.stringify operations that are redundant
* fix(file-upload): upload presigned url to kb for file upload instead of the whole file, circumvents 4.5MB serverless func limit (#491 )
* feat(folders): folders to manage workflows (#490 )
* feat(subworkflows) workflows in workflows
* revert sync changes
* working output vars
* fix greptile comments
* add cycle detection
* add tests
* working tests
* works
* fix formatting
* fix input var handling
* fix(tab-sync): sync between tabs on change
* feat(folders): folders to organize workflows
* address comments
* change schema types
* fix lint error
* fix typing error
* fix race cond
* delete unused files
* improved UI
* updated naming conventions
* revert unrelated changes to db schema
* fixed collapsed sidebar subfolders
* add logs filters for folders
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: Waleed Latif <walif6@gmail.com >
* revert tab sync
* improvement(folders): added multi-select for moving folders (#493 )
* added multi-select for folders
* allow drag into root
* remove extraneous comments
* instantly create worfklow on plus
* styling improvements, fixed flicker
* small improvement to dragover container
* ack PR comments
* fix(deployed-chat): made the chat mobile friendly (#494 )
* improvement(ui/ux): chat deploy (#496 )
* improvement(ui/ux): chat deploy experience
* improvement(ui/ux): chat fontweight
* feat(gmail): added option to access raw gmail from gmail polling service (#495 )
* added option to grab raw gmail from gmail polling service
* safe json parse for function block execution to prevent vars in raw email from being resolved as sim studio vars
* added tests
* remove extraneous comments
* fix(ui): fix the UI for folder deletion, huggingface icon, workflow block icon, standardized alert dialog (#498 )
* fixed folder delete UI
* fixed UI for workflow block, huggingface, & added alert dialog for deleting folders
* consistently style all alert dialogs
* fix(reset-data): remove reset all data button from settings modal along with logic (#499 )
* fix(airtable): fixed airtable oauth token refresh, added tests (#502 )
* fixed airtable token refresh, added tests
* added helpers for refreshOAuthToken function
* feat(registration): disable registration + handle env booleans (#501 )
* feat: disable registration + handle env booleans
* chore: removing pre-process because we need to use util
* chore: format
* feat(providers): added azure openai (#503 )
* added azure openai
* fix request params being passed through agent block for azure
* remove o1 from azure-openai models list
* fix: add vscode settings to gitignore
* feat(file-upload): generalized storage to support azure blob, enhanced error logging in kb, added xlsx parser (#506 )
* added blob storage option for azure, refactored storage client to be provider agnostic, tested kb & file upload and s3 is undisrupted, still have to test blob
* updated CORS policy for blob, added azure blob-specific headers
* remove extraneous comments
* add file size limit and timeout
* added some extra error handling in kb add documents
* grouped envvars
* ack PR comments
* added sheetjs and xlsx parser
* fix(folders): modified folder deletion to delete subfolders & workflows in it instead of moving to root (#508 )
* modified folder deletion to delete subfolders & workflows in it instead of moving to root
* added additional testing utils
* ack PR comments
* feat: api response block and implementation
* improvement(local-storage): remove use of local storage except for oauth and last active workspace id (#497 )
* remove local storage usage
* remove migration for last active workspace id
* Update apps/sim/app/w/[id]/components/workflow-block/components/sub-block/components/file-selector/components/jira-issue-selector.tsx
Add fallback for required scopes
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* add url builder util
* fi
* fix lint
* lint
* modify pre commit hook
* fix oauth
* get last active workspace working again
* new workspace logic works
* fetch locks
* works now
* remove empty useEffect
* fix loading issue
* skip empty workflow syncs
* use isWorkspace in transition flag
* add logging
* add data initialized flag
* fix lint
* fix: build error by create a server-side utils
* remove migration snapshots
* reverse search for workspace based on workflow id
* fix lint
* improvement: loading check and animation
* remove unused utils
* remove console logs
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
Co-authored-by: Emir Karabeg <emirkarabeg@berkeley.edu >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
* feat(multi-select): simplified chat to always return readable stream, can select multiple outputs and get response streamed back in chat panel & deployed chat (#507 )
* improvement: all workflow executions return ReadableStream & use sse to support multiple streamed outputs in chats
* fixed build
* remove extraneous comments
* general improvemetns
* ack PR comments
* fixed built
* improvement(workflow-state): split workflow state into separate tables (#511 )
* new tables to track workflow state
* fix lint
* refactor into separate tables
* fix typing
* fix lint
* add tests
* fix lint
* add correct foreign key constraint
* add self ref
* remove unused checks
* fix types
* fix type
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
* feat(models): added new openai models, updated model pricing, added new groq model (#513 )
* fix(autocomplete): fixed extra closing tag on tag dropdown autocomplete (#514 )
* chore: enable input format again
* fix: process the input made on api calls with proper extraction
* feat: add json-object for ai generation for response block and others
* chore: add documentation for response block
* chore: rollback temp fix and uncomment original input handler
* chore: add missing mock for response handler
* chore: add missing mock
* chore: greptile recommendations
* added cost tracking for router & evaluator blocks, consolidated model information into a single file, hosted keys for evaluator & router, parallelized unit tests (#516 )
* fix(deployState): deploy not persisting bug (#518 )
* fix(undeploy-bug): fix deployment persistence failing bug
* fix lint
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
* fix decimal entry issues
* remove unused files
* fix(db): decimal position entry issues (#520 )
* fix decimal entry issues
* remove unused files
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
* fix lint
* fix test
* improvement(kb): added configurability for chunks, query across multiple knowledge bases (#512 )
* refactor: consolidate create modal file
* fix: identify dead processes
* fix: mark failed in DB after processing timeout
* improvement: added overlap chunks and fixed modal UI
* feat: multiselect logic
* fix: biome changes for css ordering warn instead of error
* improvement: create chunk ui
* fix: removed unused schema columns
* fix: removed references to deleted columns
* improvement: sped up vector search time
* feat: multi-kb search
* add bulk endpoint to disable/delete multiple chunks
* add bulk endpoint to disable/delete multiple chunks
* fix: removed unused schema columns
* fix: removed references to deleted columns
* made endpoints for knowledge more RESTful, added tests
* added batch operations for delete/enable/disable docs, alr have this for chunks
* added migrations
* added migrations
---------
Co-authored-by: Waleed Latif <walif6@gmail.com >
* fix(models): remove temp from models that don't support it
* feat(sdk): added ts and python SDKs + docs (#524 )
* added ts & python sdk, renamed cli from simstudio to cli
* added docs
* ack PR comments
* improvements
* fixed issue where it goes to random workspace when you click reload
fixed lint issue
* feat: better response builder + doc update
* fix(auth): added preview URLs to list of trusted origins (#525 )
* trusted origins
* lint error
* removed localhost
* ran lint
---------
Co-authored-by: Waleed Latif <walif6@gmail.com >
* fix(sdk): remove dev script from SDK
* PR: changes for migration
* add changes on top of db migration changes
* fix: allow removing single input field
* improvement(permissions): workspace permissions improvements, added provider and reduced API calls by 85% (#530 )
* improved permissions UI & access patterns, show outstanding invites
* added logger
* added provider for workspace permissions, 85% reduction in API calls to get user permissions and improved performance for invitations
* ack PR comments
* cleanup
* fix disabled tooltips
* improvement(tests): parallelized tests and build fixes (#531 )
* added provider for workspace permissions, 85% reduction in API calls to get user permissions and improved performance for invitations
* parallelized more tests, fixed test warnings
* removed waitlist verification route, use more utils in tests
* fixed build
* ack PR comments
* fix
* fix(kb): reduced params in kb block, added advanced mode to starter block, updated docs
* feat(realtime): sockets + normalized tables + deprecate sync (#523 )
* feat: implement real-time collaborative workflow editing with Socket.IO
- Add Socket.IO server with room-based architecture for workflow collaboration
- Implement socket context for client-side real-time communication
- Add collaborative workflow hook for synchronized state management
- Update CSP to allow socket connections to localhost:3002
- Add fallback authentication for testing collaborative features
- Enable real-time broadcasting of workflow operations between tabs
- Support multi-user editing of blocks, edges, and workflow state
Key components:
- socket-server/: Complete Socket.IO server with authentication and room management
- contexts/socket-context.tsx: Client-side socket connection and state management
- hooks/use-collaborative-workflow.ts: Hook for collaborative workflow operations
- Workflow store integration for real-time state synchronization
Status: Basic collaborative features working, authentication bypass enabled for testing
* feat: complete collaborative subblock editing implementation
✅ All collaborative features now working perfectly:
- Real-time block movement and positioning
- Real-time subblock value editing (text fields, inputs)
- Real-time edge operations and parent updates
- Multi-user workflow rooms with proper broadcasting
- Socket.IO server with room-based architecture
- Permission bypass system for testing
🔧 Technical improvements:
- Modified useSubBlockValue hook to use collaborative event system
- All subblock setValue calls now dispatch 'update-subblock-value' events
- Collaborative workflow hook handles all real-time operations
- Socket server processes and persists all operations to database
- Clean separation between local and collaborative state management
🧪 Tested and verified:
- Multiple browser tabs with different fallback users
- Block dragging and positioning updates in real-time
- Subblock text editing reflects immediately across tabs
- Workflow room management and user presence
- Database persistence of all collaborative operations
Status: Full collaborative workflow editing working with fallback authentication
* feat: implement proper authentication for collaborative Socket.IO server
✅ **Authentication System Complete**:
- Removed all fallback authentication code and bypasses
- Socket server now requires valid Better Auth session cookies
- Proper session validation using auth.api.getSession()
- Authentication errors properly handled and logged
- User info extracted from session: userId, userName, email, organizationId
🔧 **Technical Implementation**:
- Updated CSP to allow WebSocket connections (ws://localhost:3002)
- Socket authentication middleware validates session tokens
- Proper error handling for missing/invalid sessions
- Permission system enforces workflow access controls
- Clean separation between authenticated and unauthenticated states
🧪 **Testing Status**:
- Socket server properly rejects unauthenticated connections
- Authentication errors logged with clear messages
- CSP updated to allow both HTTP and WebSocket protocols
- Ready for testing with authenticated users
Status: Production-ready collaborative authentication system
* feat: complete authentication integration for collaborative Socket.IO system
🎉 **PRODUCTION-READY COLLABORATIVE SYSTEM**
✅ **Authentication Integration Complete**:
- Fixed Socket.IO client to send credentials (withCredentials: true)
- Updated server CORS to accept credentials with specific origin
- Removed all fallback authentication bypasses
- Proper Better Auth session validation working
🔧 **Technical Fixes**:
- Socket client: Enable withCredentials for cookie transmission
- Socket server: Accept credentials with origin 'http://localhost:3000 '
- Better Auth cookie utility integration for session parsing
- Comprehensive authentication middleware with proper error handling
🧪 **Verified Working Features**:
- ✅ Real user authentication (Vikhyath Mondreti authenticated)
- ✅ Multi-user workflow rooms (2+ users in same workflow)
- ✅ Permission system enforcing workflow access controls
- ✅ Real-time subblock editing across browser tabs
- ✅ Block movement and positioning updates
- ✅ Automatic room cleanup and management
- ✅ Database persistence of all collaborative operations
🚀 **Status**: Complete enterprise-grade collaborative workflow editing system
- No more fallback users - production authentication
- Multi-tab collaboration working perfectly
- Secure access control with Better Auth integration
- Real-time updates for all workflow operations
* remove sync system and move to server side
* fix lint
* delete unused file
* added socketio dep
* fix subblock persistence bug
* working deletion of workflows
* fix lint
* added railway
* add debug logging for railway deployment
* improve typing
* fix lint
* working subflow persistence
* fix lint
* working cascade deletion
* fix lint
* working subflow inside subflow
* works
* fix lint
* prevent subflow in subflow
* fix lint
* add additional logs, add localhost as allowedOrigin
* add additional logs, add localhost as allowedOrigin
* fix type error
* remove unused code
* fix lint
* fix tests
* fix lint
* fix build error
* workign folder updates
* fix typing issue
* fix lint
* fix typing issues
* lib/
* fix tests
* added old presence component back, updated to use one-time-token better auth plugin for socket server auth, tested
* fix errors
* fix bugs
* add migration scripts to run
* fix lint
* fix deploy tests
* fix lint
* fix minor issues
* fix lint
* fix migration script
* allow comma separateds id file input to migration script
* fix lint
* fixed
* fix lint
* fix fallback case
* fix type errors
* address greptile comments
* fix lint
* fix script to generate new block ids
* fix lint
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
Co-authored-by: Waleed Latif <walif6@gmail.com >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
* fix(sockets): updated CSP
* remove unecessary logs
* fix lint
* added throttling, refactor entire socket server, added tests
* improvements
* remove self monitoring func, add block name event
* working isWide, isAdvanced toggles with sockets
* fix lint
* fix duplicate key issue for user avatar
* fix lint
* fix user presence
* working parallel badges / loop badges updates
* working connection output persistence
* fix lint
* fix build errors
* fix lint
* logs removed
* fix cascade var name update bug
* works
* fix lint
* fix parallel blocks
* fix placeholder
* fix test
* fixed tests
---------
Co-authored-by: Aditya Tripathi <aditya@climactic.co >
Co-authored-by: Adam Gough <77861281+aadamgough@users.noreply.github.com >
Co-authored-by: Vikhyath Mondreti <vikhyathvikku@gmail.com >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: Emir Karabeg <emirkarabeg@berkeley.edu >
Co-authored-by: Emir Karabeg <78010029+emir-karabeg@users.noreply.github.com >
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
Co-authored-by: Ajit Kadaveru <ajit.kadaveru@berkeley.edu >
2025-06-24 17:44:30 -07:00
Emir Karabeg
f3a405364f
improvements(knowledge): ui/ux
2025-06-03 01:57:08 -07:00
Waleed Latif
1eda44d605
imrpovement(kb): added client-side store, shared utils, background processing, retry with exponential backoff to knowledge base ( #453 )
...
* added background processing for file upload to knowledge base, added retry with exponential backoff, individual file retry, statuses
* added knowledge store
* added knowledge base selector and docs for knowledge block
* fixed build
* fix contributors page
* significantly improved error handling, typing, fault tolerance
* standardize file icon size
2025-06-02 23:12:47 -07:00
Emir Karabeg
d9e99a4fab
feat(knowledge) ( #449 )
...
* feat(knowledge): setup knowledge and base UI
* improvement(knowledge): empty state UI
* feat(knowledge): created schema
* added s3 bucket for kbs
* fix: remove dummy values
* feat(knowledge): embedding view; schema adjustments; migration history; navigation
* feat(knowledge): block/tool for vector search
---------
Co-authored-by: Waleed Latif <walif6@gmail.com >
2025-06-02 03:41:23 -07:00
Waleed Latif
ef8ae60afd
fix(file-upload): fixed file upload for mistral parse
2025-05-24 22:44:18 -07:00
Waleed Latif
950e055a8d
fix(file-upload): re-enabled file upload for mistral & url for file upload ( #408 )
...
* re-enabled file upload for mistral & url for file upload
* consolidated env checks
2025-05-24 20:58:49 -07:00
Waleed Latif
8c268e23dd
chore(biome): removed prettier, added biome ( #407 )
...
* chore: replace prettier with biome and add linting
* chore: update devcontainer settings to use biome for linting and remove eslint, prettier
* chore: update docker-compose to use Postgres 17-alpine and standardize quotes
* chore: fixed more BUT disabled most rules due to limit
* added additional rules, fixed linting & ts errors
* added additional rules
* rebased & linted
* fixed oauth
* updated biome & minor modifications
---------
Co-authored-by: Aditya Tripathi <aditya@climactic.co >
2025-05-24 03:11:38 -07:00
Waleed Latif
717e17d02a
feat(bun): upgrade to bun, reduce docker image size by 95%, upgrade docs & ci ( #371 )
...
* migrate to bun
* added envvars to drizzle
* upgrade bun devcontainer feature to a valid one
* added bun, docker not working
* updated envvars, updated to bunder and esnext modules
* fixed build, reinstated otel
* feat: optimized multi-stage docker images
* add coerce for boolean envvar
* feat: add docker-compose configuration for local LLM services and remove legacy Dockerfile and entrypoint script
* feat: add docker-compose files for local and production environments, and implement GitHub Actions for Docker image build and publish
* refactor: remove unused generateStaticParams function from various API routes and maintain dynamic rendering
* cleanup
* upgraded bun
* updated ci
* fixed build
---------
Co-authored-by: Aditya Tripathi <aditya@climactic.co >
2025-05-18 01:01:32 -07:00
Waleed Latif
a92ee8bf46
feat(turbo): restructured repo to be a standard turborepo monorepo ( #341 )
...
* added turborepo
* finished turbo migration
* updated gitignore
* use dotenv & run format
* fixed error in docs
* remove standalone deployment in prod
* fix ts error, remove ignore ts errors during build
* added formatter to the end of the docs generator
2025-05-09 21:45:49 -07:00
