Siddharth Ganesan
850447a604
Initial commit
2025-07-08 15:36:25 -07:00
Vikhyath Mondreti
60e2e6c735
fix(reddit): update to oauth endpoints ( #627 )
...
* fix(reddit): change tool to use oauth token
* fix lint
* add contact info
* Update apps/sim/tools/reddit/get_comments.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* Update apps/sim/tools/reddit/hot_posts.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* Update apps/sim/tools/reddit/get_posts.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* fix type error
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2025-07-07 13:32:23 -07:00
Vikhyath Mondreti
0bf9ce0b9e
feat(enhanced logs): integration + log visualizer canvas ( #618 )
...
* feat(logs): enhanced logging system with cleanup and theme fixes
- Implement enhanced logging cleanup with S3 archival and retention policies
- Fix error propagation in trace spans for manual executions
- Add theme-aware styling for frozen canvas modal
- Integrate enhanced logging system across all execution pathways
- Add comprehensive trace span processing and iteration navigation
- Fix boolean parameter types in enhanced logs API
* add warning for old logs
* fix lint
* added cost for streaming outputs
* fix overflow issue
* fix lint
* fix selection on closing sidebar
* tooltips z index increase
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
Co-authored-by: Waleed Latif <walif6@gmail.com >
2025-07-06 20:01:28 -07:00
Aditya Tripathi
e22f0123a3
fix(envvars): t3-env standardization ( #606 )
...
* chore: use t3-env as source of truth
* chore: update mock env for failing tests
2025-07-06 20:01:28 -07:00
Vikhyath Mondreti
78b5ae7b3d
v0.2.7: fix + feat ( #615 )
...
* feat(logging): add additional logs for proxy routes
* fix(blocks): workflow handler not working outside gui (#609 )
* fix: key to call api internally for workflow block
* feat: use jwt for internal auth to avoid a static key
* chore: formatter
* fix(sidebar): added loop & parallel subblcoks to sidebar search
* merged improvement/connection into staging (#604 )
* merged improvement/connection into staging
* fix: merge conflicts and improved block path calculation
* fix: removed migration
* fix: removed duplicate call
* fix: resolver and merge conflicts
* fix: knowledge base folder
* fix: settings modal
* fix: typeform block
* fix: parallel handler
* fix: stores index
* fix: tests
* fix: tag-dropdown
* improvement: start block input and tag dropdown
* fix block id resolution + missing bracket
* fix lint
* fix test
* works
* fix
* fix lint
* Revert "fix lint"
This reverts commit 433e2f9cfc .
---------
Co-authored-by: Vikhyath Mondreti <vikhyathvikku@gmail.com >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
* fix(autopan): migration missing (#614 )
* add autopan migration
* fix lint
* fix linter
* fix tests
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
---------
Co-authored-by: Waleed Latif <walif6@gmail.com >
Co-authored-by: Aditya Tripathi <aditya@climactic.co >
Co-authored-by: Emir Karabeg <78010029+emir-karabeg@users.noreply.github.com >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
2025-07-04 13:48:17 -07:00
Vikhyath Mondreti
016cd6750c
v0.2.6: fix + feat + improvement ( #612 )
...
* feat(function): added more granular error logs for function execution for easier debugging (#593 )
* added more granular error logs for function execution
* added tests
* fixed syntax error reporting
* feat(models): added temp controls for gpt-4.1 family of models (#594 )
* improvement(knowledge-upload): create and upload document to KB (#579 )
* improvement: added knowledge upload
* improvement: added greptile comments (#579 )
* improvement: changed to text to doc (#579 )
* improvement: removed comment (#579 )
* added input validation, tested persistence of KB selector
* update docs
---------
Co-authored-by: Adam Gough <adamgough@Mac.attlocal.net >
Co-authored-by: Waleed Latif <walif6@gmail.com >
* fix(remove workflow.state usage): no more usage of deprecated state column in any routes (#586 )
* fix(remove workflow.state usage): no more usage of deprecated state col in routes
* fix lint
* fix chat route to only use deployed state
* fix lint
* better typing
* remove useless logs
* fix lint
* restore workflow handler file
* removed all other usages of deprecated 'state' column from workflows table, updated tests
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Waleed Latif <walif6@gmail.com >
* fix(doc-selector-kb): enable doc selector when kb is selected (#596 )
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
* fix(unload): remove beforeunload warning since we communicate via wss (#597 )
* fix(executor): fix dependency resolution, allow blocks with multiple inputs to execute (#598 )
* feat(billing): added migrations for usage-based billing (#601 )
* feat(billing): added migrations for usage-based billing
* lint
* lint
* feat(logging): add new schemas + types for new logging system (#599 )
* feat(logging): add new schemas + types for logging
* fix lint
* update migration
* fix lint
* Remove migration 48 to avoid conflict with staging
* fixed merge conflict
* fix lint
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
* fix(createWorkflow): cleanup create workflow to prevent re-renders (#607 )
* fix(createWorkflow): no more client side id, duplicate schedules calls
* fix lint
* more cleanup
* fix lint
* fix spamming of create button causing issues
* fix lint
* add more colors + default workflow name changed
* Update apps/sim/stores/workflows/registry/utils.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* fix(telegram): added markdown text rendering (#611 )
* fix: added proper markdown
* fix: reverted route.ts file
---------
Co-authored-by: Adam Gough <adamgough@Adams-MacBook-Pro.local >
* fix(kb-upload): fix and consolidate KB file uploads logic (#610 )
* fix(kb-upload): fix and consolidate logic
* fix lint
* consolidated presigned routes, fixed temp id kb store issue, added nav to next/prev chunk on edit chunk modal
* fix ci test
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
Co-authored-by: Waleed Latif <walif6@gmail.com >
---------
Co-authored-by: Waleed Latif <walif6@gmail.com >
Co-authored-by: Adam Gough <77861281+aadamgough@users.noreply.github.com >
Co-authored-by: Adam Gough <adamgough@Mac.attlocal.net >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
Co-authored-by: Adam Gough <adamgough@Adams-MacBook-Pro.local >
2025-07-03 12:53:14 -07:00
Waleed Latif
3b982533d1
v0.2.5: feat, improvement, fix ( #595 ) ( #603 )
...
* feat(function): added more granular error logs for function execution for easier debugging (#593 )
* added more granular error logs for function execution
* added tests
* fixed syntax error reporting
* feat(models): added temp controls for gpt-4.1 family of models (#594 )
* improvement(knowledge-upload): create and upload document to KB (#579 )
* improvement: added knowledge upload
* improvement: added greptile comments (#579 )
* improvement: changed to text to doc (#579 )
* improvement: removed comment (#579 )
* added input validation, tested persistence of KB selector
* update docs
---------
Co-authored-by: Adam Gough <adamgough@Mac.attlocal.net >
Co-authored-by: Waleed Latif <walif6@gmail.com >
* fix(remove workflow.state usage): no more usage of deprecated state column in any routes (#586 )
* fix(remove workflow.state usage): no more usage of deprecated state col in routes
* fix lint
* fix chat route to only use deployed state
* fix lint
* better typing
* remove useless logs
* fix lint
* restore workflow handler file
* removed all other usages of deprecated 'state' column from workflows table, updated tests
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Waleed Latif <walif6@gmail.com >
* fix(doc-selector-kb): enable doc selector when kb is selected (#596 )
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
* fix(unload): remove beforeunload warning since we communicate via wss (#597 )
* fix(executor): fix dependency resolution, allow blocks with multiple inputs to execute (#598 )
* feat(billing): added migrations for usage-based billing (#601 )
* feat(billing): added migrations for usage-based billing
* lint
* lint
* feat(logging): add new schemas + types for new logging system (#599 )
* feat(logging): add new schemas + types for logging
* fix lint
* update migration
* fix lint
* Remove migration 48 to avoid conflict with staging
* fixed merge conflict
* fix lint
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
---------
Co-authored-by: Adam Gough <77861281+aadamgough@users.noreply.github.com >
Co-authored-by: Adam Gough <adamgough@Mac.attlocal.net >
Co-authored-by: Vikhyath Mondreti <vikhyathvikku@gmail.com >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
2025-07-02 08:40:41 -07:00
Vikhyath Mondreti
1604ce4d7c
v0.2.4: feat, improvement, fix ( #595 )
...
* feat(function): added more granular error logs for function execution for easier debugging (#593 )
* added more granular error logs for function execution
* added tests
* fixed syntax error reporting
* feat(models): added temp controls for gpt-4.1 family of models (#594 )
* improvement(knowledge-upload): create and upload document to KB (#579 )
* improvement: added knowledge upload
* improvement: added greptile comments (#579 )
* improvement: changed to text to doc (#579 )
* improvement: removed comment (#579 )
* added input validation, tested persistence of KB selector
* update docs
---------
Co-authored-by: Adam Gough <adamgough@Mac.attlocal.net >
Co-authored-by: Waleed Latif <walif6@gmail.com >
* fix(remove workflow.state usage): no more usage of deprecated state column in any routes (#586 )
* fix(remove workflow.state usage): no more usage of deprecated state col in routes
* fix lint
* fix chat route to only use deployed state
* fix lint
* better typing
* remove useless logs
* fix lint
* restore workflow handler file
* removed all other usages of deprecated 'state' column from workflows table, updated tests
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Waleed Latif <walif6@gmail.com >
---------
Co-authored-by: Waleed Latif <walif6@gmail.com >
Co-authored-by: Adam Gough <77861281+aadamgough@users.noreply.github.com >
Co-authored-by: Adam Gough <adamgough@Mac.attlocal.net >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
2025-06-30 19:23:37 -07:00
Vikhyath Mondreti
82d491d1b6
fix sockets token refresh
2025-06-27 17:34:58 -07:00
Waleed Latif
02cecd5745
fix(sockets): implement longer token expiration for OTT, preventitive token refresh with retries ( #566 )
...
* fix(sockets): implement longer token expiration for OTT, preventitive token refresh with retries
* cleanup tests
* make websocket first choice transport
* fix lint
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
2025-06-27 10:42:41 -07:00
Waleed Latif
7182f35702
feat(workspace): add workspaceId to url ( #544 )
...
* refactor(kb): use chonkie locally (#475 )
* feat(parsers): text and markdown parsers (#473 )
* feat: text and markdown parsers
* fix: don't readfile on buffer, convert buffer to string instead
* fix(knowledge-wh): fixed authentication error on webhook trigger
fix(knowledge-wh): fixed authentication error on webhook trigger
* feat(tools): add huggingface tools/blcok (#472 )
* add hugging face tool
* docs: add Hugging Face tool documentation
* fix: format and lint Hugging Face integration files
* docs: add manual intro section to Hugging Face documentation
* feat: replace Record<string, any> with proper HuggingFaceRequestBody interface
* accidental local files added
* restore some docs
* make layout full for model field
* change huggingface logo
* add manual content
* fix lint
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
* fix(knowledge-ux): fixed ux for knowledge base (#478 )
fix(knowledge-ux): fixed ux for knowledge base (#478 )
* fix(billing): bump better-auth version & fix existing subscription issue when adding seats (#484 )
* bump better-auth version & fix existing subscription issue Bwhen adding seats
* ack PR comments
* fix(env): added NEXT_PUBLIC_APP_URL to .env.example (#485 )
* feat(subworkflows): workflows as a block within workflows (#480 )
* feat(subworkflows) workflows in workflows
* revert sync changes
* working output vars
* fix greptile comments
* add cycle detection
* add tests
* working tests
* works
* fix formatting
* fix input var handling
* add images
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
* fix(kb): fixed kb race condition resulting in no chunks found (#487 )
* fix: added all blocks activeExecutionPath (#486 )
* refactor(chunker): replace chonkie with custom TextChunker (#479 )
* refactor(chunker): replace chonkie with custom TextChunker implementation and update document processing logic
* chore: cleanup unimplemented types
* fix: KB tests updated
* fix(tab-sync): sync between tabs on change (#489 )
* fix(tab-sync): sync between tabs on change
* refactor: optimize JSON.stringify operations that are redundant
* fix(file-upload): upload presigned url to kb for file upload instead of the whole file, circumvents 4.5MB serverless func limit (#491 )
* feat(folders): folders to manage workflows (#490 )
* feat(subworkflows) workflows in workflows
* revert sync changes
* working output vars
* fix greptile comments
* add cycle detection
* add tests
* working tests
* works
* fix formatting
* fix input var handling
* fix(tab-sync): sync between tabs on change
* feat(folders): folders to organize workflows
* address comments
* change schema types
* fix lint error
* fix typing error
* fix race cond
* delete unused files
* improved UI
* updated naming conventions
* revert unrelated changes to db schema
* fixed collapsed sidebar subfolders
* add logs filters for folders
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: Waleed Latif <walif6@gmail.com >
* revert tab sync
* improvement(folders): added multi-select for moving folders (#493 )
* added multi-select for folders
* allow drag into root
* remove extraneous comments
* instantly create worfklow on plus
* styling improvements, fixed flicker
* small improvement to dragover container
* ack PR comments
* fix(deployed-chat): made the chat mobile friendly (#494 )
* improvement(ui/ux): chat deploy (#496 )
* improvement(ui/ux): chat deploy experience
* improvement(ui/ux): chat fontweight
* feat(gmail): added option to access raw gmail from gmail polling service (#495 )
* added option to grab raw gmail from gmail polling service
* safe json parse for function block execution to prevent vars in raw email from being resolved as sim studio vars
* added tests
* remove extraneous comments
* fix(ui): fix the UI for folder deletion, huggingface icon, workflow block icon, standardized alert dialog (#498 )
* fixed folder delete UI
* fixed UI for workflow block, huggingface, & added alert dialog for deleting folders
* consistently style all alert dialogs
* fix(reset-data): remove reset all data button from settings modal along with logic (#499 )
* fix(airtable): fixed airtable oauth token refresh, added tests (#502 )
* fixed airtable token refresh, added tests
* added helpers for refreshOAuthToken function
* feat(registration): disable registration + handle env booleans (#501 )
* feat: disable registration + handle env booleans
* chore: removing pre-process because we need to use util
* chore: format
* feat(providers): added azure openai (#503 )
* added azure openai
* fix request params being passed through agent block for azure
* remove o1 from azure-openai models list
* fix: add vscode settings to gitignore
* feat(file-upload): generalized storage to support azure blob, enhanced error logging in kb, added xlsx parser (#506 )
* added blob storage option for azure, refactored storage client to be provider agnostic, tested kb & file upload and s3 is undisrupted, still have to test blob
* updated CORS policy for blob, added azure blob-specific headers
* remove extraneous comments
* add file size limit and timeout
* added some extra error handling in kb add documents
* grouped envvars
* ack PR comments
* added sheetjs and xlsx parser
* fix(folders): modified folder deletion to delete subfolders & workflows in it instead of moving to root (#508 )
* modified folder deletion to delete subfolders & workflows in it instead of moving to root
* added additional testing utils
* ack PR comments
* feat: api response block and implementation
* improvement(local-storage): remove use of local storage except for oauth and last active workspace id (#497 )
* remove local storage usage
* remove migration for last active workspace id
* Update apps/sim/app/w/[id]/components/workflow-block/components/sub-block/components/file-selector/components/jira-issue-selector.tsx
Add fallback for required scopes
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* add url builder util
* fi
* fix lint
* lint
* modify pre commit hook
* fix oauth
* get last active workspace working again
* new workspace logic works
* fetch locks
* works now
* remove empty useEffect
* fix loading issue
* skip empty workflow syncs
* use isWorkspace in transition flag
* add logging
* add data initialized flag
* fix lint
* fix: build error by create a server-side utils
* remove migration snapshots
* reverse search for workspace based on workflow id
* fix lint
* improvement: loading check and animation
* remove unused utils
* remove console logs
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
Co-authored-by: Emir Karabeg <emirkarabeg@berkeley.edu >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
* feat(multi-select): simplified chat to always return readable stream, can select multiple outputs and get response streamed back in chat panel & deployed chat (#507 )
* improvement: all workflow executions return ReadableStream & use sse to support multiple streamed outputs in chats
* fixed build
* remove extraneous comments
* general improvemetns
* ack PR comments
* fixed built
* improvement(workflow-state): split workflow state into separate tables (#511 )
* new tables to track workflow state
* fix lint
* refactor into separate tables
* fix typing
* fix lint
* add tests
* fix lint
* add correct foreign key constraint
* add self ref
* remove unused checks
* fix types
* fix type
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
* feat(models): added new openai models, updated model pricing, added new groq model (#513 )
* fix(autocomplete): fixed extra closing tag on tag dropdown autocomplete (#514 )
* chore: enable input format again
* fix: process the input made on api calls with proper extraction
* feat: add json-object for ai generation for response block and others
* chore: add documentation for response block
* chore: rollback temp fix and uncomment original input handler
* chore: add missing mock for response handler
* chore: add missing mock
* chore: greptile recommendations
* added cost tracking for router & evaluator blocks, consolidated model information into a single file, hosted keys for evaluator & router, parallelized unit tests (#516 )
* fix(deployState): deploy not persisting bug (#518 )
* fix(undeploy-bug): fix deployment persistence failing bug
* fix lint
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
* fix decimal entry issues
* remove unused files
* fix(db): decimal position entry issues (#520 )
* fix decimal entry issues
* remove unused files
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
* fix lint
* fix test
* improvement(kb): added configurability for chunks, query across multiple knowledge bases (#512 )
* refactor: consolidate create modal file
* fix: identify dead processes
* fix: mark failed in DB after processing timeout
* improvement: added overlap chunks and fixed modal UI
* feat: multiselect logic
* fix: biome changes for css ordering warn instead of error
* improvement: create chunk ui
* fix: removed unused schema columns
* fix: removed references to deleted columns
* improvement: sped up vector search time
* feat: multi-kb search
* add bulk endpoint to disable/delete multiple chunks
* add bulk endpoint to disable/delete multiple chunks
* fix: removed unused schema columns
* fix: removed references to deleted columns
* made endpoints for knowledge more RESTful, added tests
* added batch operations for delete/enable/disable docs, alr have this for chunks
* added migrations
* added migrations
---------
Co-authored-by: Waleed Latif <walif6@gmail.com >
* fix(models): remove temp from models that don't support it
* feat(sdk): added ts and python SDKs + docs (#524 )
* added ts & python sdk, renamed cli from simstudio to cli
* added docs
* ack PR comments
* improvements
* fixed issue where it goes to random workspace when you click reload
fixed lint issue
* feat: better response builder + doc update
* fix(auth): added preview URLs to list of trusted origins (#525 )
* trusted origins
* lint error
* removed localhost
* ran lint
---------
Co-authored-by: Waleed Latif <walif6@gmail.com >
* fix(sdk): remove dev script from SDK
* PR: changes for migration
* add changes on top of db migration changes
* fix: allow removing single input field
* improvement(permissions): workspace permissions improvements, added provider and reduced API calls by 85% (#530 )
* improved permissions UI & access patterns, show outstanding invites
* added logger
* added provider for workspace permissions, 85% reduction in API calls to get user permissions and improved performance for invitations
* ack PR comments
* cleanup
* fix disabled tooltips
* improvement(tests): parallelized tests and build fixes (#531 )
* added provider for workspace permissions, 85% reduction in API calls to get user permissions and improved performance for invitations
* parallelized more tests, fixed test warnings
* removed waitlist verification route, use more utils in tests
* fixed build
* ack PR comments
* fix
* fix(kb): reduced params in kb block, added advanced mode to starter block, updated docs
* feat(realtime): sockets + normalized tables + deprecate sync (#523 )
* feat: implement real-time collaborative workflow editing with Socket.IO
- Add Socket.IO server with room-based architecture for workflow collaboration
- Implement socket context for client-side real-time communication
- Add collaborative workflow hook for synchronized state management
- Update CSP to allow socket connections to localhost:3002
- Add fallback authentication for testing collaborative features
- Enable real-time broadcasting of workflow operations between tabs
- Support multi-user editing of blocks, edges, and workflow state
Key components:
- socket-server/: Complete Socket.IO server with authentication and room management
- contexts/socket-context.tsx: Client-side socket connection and state management
- hooks/use-collaborative-workflow.ts: Hook for collaborative workflow operations
- Workflow store integration for real-time state synchronization
Status: Basic collaborative features working, authentication bypass enabled for testing
* feat: complete collaborative subblock editing implementation
✅ All collaborative features now working perfectly:
- Real-time block movement and positioning
- Real-time subblock value editing (text fields, inputs)
- Real-time edge operations and parent updates
- Multi-user workflow rooms with proper broadcasting
- Socket.IO server with room-based architecture
- Permission bypass system for testing
🔧 Technical improvements:
- Modified useSubBlockValue hook to use collaborative event system
- All subblock setValue calls now dispatch 'update-subblock-value' events
- Collaborative workflow hook handles all real-time operations
- Socket server processes and persists all operations to database
- Clean separation between local and collaborative state management
🧪 Tested and verified:
- Multiple browser tabs with different fallback users
- Block dragging and positioning updates in real-time
- Subblock text editing reflects immediately across tabs
- Workflow room management and user presence
- Database persistence of all collaborative operations
Status: Full collaborative workflow editing working with fallback authentication
* feat: implement proper authentication for collaborative Socket.IO server
✅ **Authentication System Complete**:
- Removed all fallback authentication code and bypasses
- Socket server now requires valid Better Auth session cookies
- Proper session validation using auth.api.getSession()
- Authentication errors properly handled and logged
- User info extracted from session: userId, userName, email, organizationId
🔧 **Technical Implementation**:
- Updated CSP to allow WebSocket connections (ws://localhost:3002)
- Socket authentication middleware validates session tokens
- Proper error handling for missing/invalid sessions
- Permission system enforces workflow access controls
- Clean separation between authenticated and unauthenticated states
🧪 **Testing Status**:
- Socket server properly rejects unauthenticated connections
- Authentication errors logged with clear messages
- CSP updated to allow both HTTP and WebSocket protocols
- Ready for testing with authenticated users
Status: Production-ready collaborative authentication system
* feat: complete authentication integration for collaborative Socket.IO system
🎉 **PRODUCTION-READY COLLABORATIVE SYSTEM**
✅ **Authentication Integration Complete**:
- Fixed Socket.IO client to send credentials (withCredentials: true)
- Updated server CORS to accept credentials with specific origin
- Removed all fallback authentication bypasses
- Proper Better Auth session validation working
🔧 **Technical Fixes**:
- Socket client: Enable withCredentials for cookie transmission
- Socket server: Accept credentials with origin 'http://localhost:3000 '
- Better Auth cookie utility integration for session parsing
- Comprehensive authentication middleware with proper error handling
🧪 **Verified Working Features**:
- ✅ Real user authentication (Vikhyath Mondreti authenticated)
- ✅ Multi-user workflow rooms (2+ users in same workflow)
- ✅ Permission system enforcing workflow access controls
- ✅ Real-time subblock editing across browser tabs
- ✅ Block movement and positioning updates
- ✅ Automatic room cleanup and management
- ✅ Database persistence of all collaborative operations
🚀 **Status**: Complete enterprise-grade collaborative workflow editing system
- No more fallback users - production authentication
- Multi-tab collaboration working perfectly
- Secure access control with Better Auth integration
- Real-time updates for all workflow operations
* remove sync system and move to server side
* fix lint
* delete unused file
* added socketio dep
* fix subblock persistence bug
* working deletion of workflows
* fix lint
* added railway
* add debug logging for railway deployment
* improve typing
* fix lint
* working subflow persistence
* fix lint
* working cascade deletion
* fix lint
* working subflow inside subflow
* works
* fix lint
* prevent subflow in subflow
* fix lint
* add additional logs, add localhost as allowedOrigin
* add additional logs, add localhost as allowedOrigin
* fix type error
* remove unused code
* fix lint
* fix tests
* fix lint
* fix build error
* workign folder updates
* fix typing issue
* fix lint
* fix typing issues
* lib/
* fix tests
* added old presence component back, updated to use one-time-token better auth plugin for socket server auth, tested
* fix errors
* fix bugs
* add migration scripts to run
* fix lint
* fix deploy tests
* fix lint
* fix minor issues
* fix lint
* fix migration script
* allow comma separateds id file input to migration script
* fix lint
* fixed
* fix lint
* fix fallback case
* fix type errors
* address greptile comments
* fix lint
* fix script to generate new block ids
* fix lint
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
Co-authored-by: Waleed Latif <walif6@gmail.com >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
* fix(sockets): updated CSP
* remove unecessary logs
* fix lint
* refactor: get started with workspace id in url
* refactor: get rid of the old local way of storing active workspace and depend on params
* fix: import path
* fix: missing function and type issue
* chore: requested changes
* chore: refactor /w/[id] to /w/[workflowId]
* refactor: move knowledge base, logs, marketplace to workspace
* fix: on creation redirect to new workflow, on delete redirect to lastest workflow, update loading animation
* replace generic loading spinner with loading agent on workspace init
* chore: cleanup leftover component
* rm html socket test
* fix in sidebar
* more sidebar fix
* fixed string interpolation issues
* fixed broken invite route
* fixed broken invite route
---------
Co-authored-by: Aditya Tripathi <aditya@climactic.co >
Co-authored-by: Adam Gough <77861281+aadamgough@users.noreply.github.com >
Co-authored-by: Vikhyath Mondreti <vikhyathvikku@gmail.com >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: Emir Karabeg <emirkarabeg@berkeley.edu >
Co-authored-by: Emir Karabeg <78010029+emir-karabeg@users.noreply.github.com >
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
Co-authored-by: Ajit Kadaveru <ajit.kadaveru@berkeley.edu >
2025-06-25 16:28:48 -07:00
Waleed Latif
76df2b9cd9
fix(sockets): added throttling, refactor entire socket server, added tests ( #534 )
...
* refactor(kb): use chonkie locally (#475 )
* feat(parsers): text and markdown parsers (#473 )
* feat: text and markdown parsers
* fix: don't readfile on buffer, convert buffer to string instead
* fix(knowledge-wh): fixed authentication error on webhook trigger
fix(knowledge-wh): fixed authentication error on webhook trigger
* feat(tools): add huggingface tools/blcok (#472 )
* add hugging face tool
* docs: add Hugging Face tool documentation
* fix: format and lint Hugging Face integration files
* docs: add manual intro section to Hugging Face documentation
* feat: replace Record<string, any> with proper HuggingFaceRequestBody interface
* accidental local files added
* restore some docs
* make layout full for model field
* change huggingface logo
* add manual content
* fix lint
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
* fix(knowledge-ux): fixed ux for knowledge base (#478 )
fix(knowledge-ux): fixed ux for knowledge base (#478 )
* fix(billing): bump better-auth version & fix existing subscription issue when adding seats (#484 )
* bump better-auth version & fix existing subscription issue Bwhen adding seats
* ack PR comments
* fix(env): added NEXT_PUBLIC_APP_URL to .env.example (#485 )
* feat(subworkflows): workflows as a block within workflows (#480 )
* feat(subworkflows) workflows in workflows
* revert sync changes
* working output vars
* fix greptile comments
* add cycle detection
* add tests
* working tests
* works
* fix formatting
* fix input var handling
* add images
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
* fix(kb): fixed kb race condition resulting in no chunks found (#487 )
* fix: added all blocks activeExecutionPath (#486 )
* refactor(chunker): replace chonkie with custom TextChunker (#479 )
* refactor(chunker): replace chonkie with custom TextChunker implementation and update document processing logic
* chore: cleanup unimplemented types
* fix: KB tests updated
* fix(tab-sync): sync between tabs on change (#489 )
* fix(tab-sync): sync between tabs on change
* refactor: optimize JSON.stringify operations that are redundant
* fix(file-upload): upload presigned url to kb for file upload instead of the whole file, circumvents 4.5MB serverless func limit (#491 )
* feat(folders): folders to manage workflows (#490 )
* feat(subworkflows) workflows in workflows
* revert sync changes
* working output vars
* fix greptile comments
* add cycle detection
* add tests
* working tests
* works
* fix formatting
* fix input var handling
* fix(tab-sync): sync between tabs on change
* feat(folders): folders to organize workflows
* address comments
* change schema types
* fix lint error
* fix typing error
* fix race cond
* delete unused files
* improved UI
* updated naming conventions
* revert unrelated changes to db schema
* fixed collapsed sidebar subfolders
* add logs filters for folders
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: Waleed Latif <walif6@gmail.com >
* revert tab sync
* improvement(folders): added multi-select for moving folders (#493 )
* added multi-select for folders
* allow drag into root
* remove extraneous comments
* instantly create worfklow on plus
* styling improvements, fixed flicker
* small improvement to dragover container
* ack PR comments
* fix(deployed-chat): made the chat mobile friendly (#494 )
* improvement(ui/ux): chat deploy (#496 )
* improvement(ui/ux): chat deploy experience
* improvement(ui/ux): chat fontweight
* feat(gmail): added option to access raw gmail from gmail polling service (#495 )
* added option to grab raw gmail from gmail polling service
* safe json parse for function block execution to prevent vars in raw email from being resolved as sim studio vars
* added tests
* remove extraneous comments
* fix(ui): fix the UI for folder deletion, huggingface icon, workflow block icon, standardized alert dialog (#498 )
* fixed folder delete UI
* fixed UI for workflow block, huggingface, & added alert dialog for deleting folders
* consistently style all alert dialogs
* fix(reset-data): remove reset all data button from settings modal along with logic (#499 )
* fix(airtable): fixed airtable oauth token refresh, added tests (#502 )
* fixed airtable token refresh, added tests
* added helpers for refreshOAuthToken function
* feat(registration): disable registration + handle env booleans (#501 )
* feat: disable registration + handle env booleans
* chore: removing pre-process because we need to use util
* chore: format
* feat(providers): added azure openai (#503 )
* added azure openai
* fix request params being passed through agent block for azure
* remove o1 from azure-openai models list
* fix: add vscode settings to gitignore
* feat(file-upload): generalized storage to support azure blob, enhanced error logging in kb, added xlsx parser (#506 )
* added blob storage option for azure, refactored storage client to be provider agnostic, tested kb & file upload and s3 is undisrupted, still have to test blob
* updated CORS policy for blob, added azure blob-specific headers
* remove extraneous comments
* add file size limit and timeout
* added some extra error handling in kb add documents
* grouped envvars
* ack PR comments
* added sheetjs and xlsx parser
* fix(folders): modified folder deletion to delete subfolders & workflows in it instead of moving to root (#508 )
* modified folder deletion to delete subfolders & workflows in it instead of moving to root
* added additional testing utils
* ack PR comments
* feat: api response block and implementation
* improvement(local-storage): remove use of local storage except for oauth and last active workspace id (#497 )
* remove local storage usage
* remove migration for last active workspace id
* Update apps/sim/app/w/[id]/components/workflow-block/components/sub-block/components/file-selector/components/jira-issue-selector.tsx
Add fallback for required scopes
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* add url builder util
* fi
* fix lint
* lint
* modify pre commit hook
* fix oauth
* get last active workspace working again
* new workspace logic works
* fetch locks
* works now
* remove empty useEffect
* fix loading issue
* skip empty workflow syncs
* use isWorkspace in transition flag
* add logging
* add data initialized flag
* fix lint
* fix: build error by create a server-side utils
* remove migration snapshots
* reverse search for workspace based on workflow id
* fix lint
* improvement: loading check and animation
* remove unused utils
* remove console logs
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
Co-authored-by: Emir Karabeg <emirkarabeg@berkeley.edu >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
* feat(multi-select): simplified chat to always return readable stream, can select multiple outputs and get response streamed back in chat panel & deployed chat (#507 )
* improvement: all workflow executions return ReadableStream & use sse to support multiple streamed outputs in chats
* fixed build
* remove extraneous comments
* general improvemetns
* ack PR comments
* fixed built
* improvement(workflow-state): split workflow state into separate tables (#511 )
* new tables to track workflow state
* fix lint
* refactor into separate tables
* fix typing
* fix lint
* add tests
* fix lint
* add correct foreign key constraint
* add self ref
* remove unused checks
* fix types
* fix type
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
* feat(models): added new openai models, updated model pricing, added new groq model (#513 )
* fix(autocomplete): fixed extra closing tag on tag dropdown autocomplete (#514 )
* chore: enable input format again
* fix: process the input made on api calls with proper extraction
* feat: add json-object for ai generation for response block and others
* chore: add documentation for response block
* chore: rollback temp fix and uncomment original input handler
* chore: add missing mock for response handler
* chore: add missing mock
* chore: greptile recommendations
* added cost tracking for router & evaluator blocks, consolidated model information into a single file, hosted keys for evaluator & router, parallelized unit tests (#516 )
* fix(deployState): deploy not persisting bug (#518 )
* fix(undeploy-bug): fix deployment persistence failing bug
* fix lint
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
* fix decimal entry issues
* remove unused files
* fix(db): decimal position entry issues (#520 )
* fix decimal entry issues
* remove unused files
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
* fix lint
* fix test
* improvement(kb): added configurability for chunks, query across multiple knowledge bases (#512 )
* refactor: consolidate create modal file
* fix: identify dead processes
* fix: mark failed in DB after processing timeout
* improvement: added overlap chunks and fixed modal UI
* feat: multiselect logic
* fix: biome changes for css ordering warn instead of error
* improvement: create chunk ui
* fix: removed unused schema columns
* fix: removed references to deleted columns
* improvement: sped up vector search time
* feat: multi-kb search
* add bulk endpoint to disable/delete multiple chunks
* add bulk endpoint to disable/delete multiple chunks
* fix: removed unused schema columns
* fix: removed references to deleted columns
* made endpoints for knowledge more RESTful, added tests
* added batch operations for delete/enable/disable docs, alr have this for chunks
* added migrations
* added migrations
---------
Co-authored-by: Waleed Latif <walif6@gmail.com >
* fix(models): remove temp from models that don't support it
* feat(sdk): added ts and python SDKs + docs (#524 )
* added ts & python sdk, renamed cli from simstudio to cli
* added docs
* ack PR comments
* improvements
* fixed issue where it goes to random workspace when you click reload
fixed lint issue
* feat: better response builder + doc update
* fix(auth): added preview URLs to list of trusted origins (#525 )
* trusted origins
* lint error
* removed localhost
* ran lint
---------
Co-authored-by: Waleed Latif <walif6@gmail.com >
* fix(sdk): remove dev script from SDK
* PR: changes for migration
* add changes on top of db migration changes
* fix: allow removing single input field
* improvement(permissions): workspace permissions improvements, added provider and reduced API calls by 85% (#530 )
* improved permissions UI & access patterns, show outstanding invites
* added logger
* added provider for workspace permissions, 85% reduction in API calls to get user permissions and improved performance for invitations
* ack PR comments
* cleanup
* fix disabled tooltips
* improvement(tests): parallelized tests and build fixes (#531 )
* added provider for workspace permissions, 85% reduction in API calls to get user permissions and improved performance for invitations
* parallelized more tests, fixed test warnings
* removed waitlist verification route, use more utils in tests
* fixed build
* ack PR comments
* fix
* fix(kb): reduced params in kb block, added advanced mode to starter block, updated docs
* feat(realtime): sockets + normalized tables + deprecate sync (#523 )
* feat: implement real-time collaborative workflow editing with Socket.IO
- Add Socket.IO server with room-based architecture for workflow collaboration
- Implement socket context for client-side real-time communication
- Add collaborative workflow hook for synchronized state management
- Update CSP to allow socket connections to localhost:3002
- Add fallback authentication for testing collaborative features
- Enable real-time broadcasting of workflow operations between tabs
- Support multi-user editing of blocks, edges, and workflow state
Key components:
- socket-server/: Complete Socket.IO server with authentication and room management
- contexts/socket-context.tsx: Client-side socket connection and state management
- hooks/use-collaborative-workflow.ts: Hook for collaborative workflow operations
- Workflow store integration for real-time state synchronization
Status: Basic collaborative features working, authentication bypass enabled for testing
* feat: complete collaborative subblock editing implementation
✅ All collaborative features now working perfectly:
- Real-time block movement and positioning
- Real-time subblock value editing (text fields, inputs)
- Real-time edge operations and parent updates
- Multi-user workflow rooms with proper broadcasting
- Socket.IO server with room-based architecture
- Permission bypass system for testing
🔧 Technical improvements:
- Modified useSubBlockValue hook to use collaborative event system
- All subblock setValue calls now dispatch 'update-subblock-value' events
- Collaborative workflow hook handles all real-time operations
- Socket server processes and persists all operations to database
- Clean separation between local and collaborative state management
🧪 Tested and verified:
- Multiple browser tabs with different fallback users
- Block dragging and positioning updates in real-time
- Subblock text editing reflects immediately across tabs
- Workflow room management and user presence
- Database persistence of all collaborative operations
Status: Full collaborative workflow editing working with fallback authentication
* feat: implement proper authentication for collaborative Socket.IO server
✅ **Authentication System Complete**:
- Removed all fallback authentication code and bypasses
- Socket server now requires valid Better Auth session cookies
- Proper session validation using auth.api.getSession()
- Authentication errors properly handled and logged
- User info extracted from session: userId, userName, email, organizationId
🔧 **Technical Implementation**:
- Updated CSP to allow WebSocket connections (ws://localhost:3002)
- Socket authentication middleware validates session tokens
- Proper error handling for missing/invalid sessions
- Permission system enforces workflow access controls
- Clean separation between authenticated and unauthenticated states
🧪 **Testing Status**:
- Socket server properly rejects unauthenticated connections
- Authentication errors logged with clear messages
- CSP updated to allow both HTTP and WebSocket protocols
- Ready for testing with authenticated users
Status: Production-ready collaborative authentication system
* feat: complete authentication integration for collaborative Socket.IO system
🎉 **PRODUCTION-READY COLLABORATIVE SYSTEM**
✅ **Authentication Integration Complete**:
- Fixed Socket.IO client to send credentials (withCredentials: true)
- Updated server CORS to accept credentials with specific origin
- Removed all fallback authentication bypasses
- Proper Better Auth session validation working
🔧 **Technical Fixes**:
- Socket client: Enable withCredentials for cookie transmission
- Socket server: Accept credentials with origin 'http://localhost:3000 '
- Better Auth cookie utility integration for session parsing
- Comprehensive authentication middleware with proper error handling
🧪 **Verified Working Features**:
- ✅ Real user authentication (Vikhyath Mondreti authenticated)
- ✅ Multi-user workflow rooms (2+ users in same workflow)
- ✅ Permission system enforcing workflow access controls
- ✅ Real-time subblock editing across browser tabs
- ✅ Block movement and positioning updates
- ✅ Automatic room cleanup and management
- ✅ Database persistence of all collaborative operations
🚀 **Status**: Complete enterprise-grade collaborative workflow editing system
- No more fallback users - production authentication
- Multi-tab collaboration working perfectly
- Secure access control with Better Auth integration
- Real-time updates for all workflow operations
* remove sync system and move to server side
* fix lint
* delete unused file
* added socketio dep
* fix subblock persistence bug
* working deletion of workflows
* fix lint
* added railway
* add debug logging for railway deployment
* improve typing
* fix lint
* working subflow persistence
* fix lint
* working cascade deletion
* fix lint
* working subflow inside subflow
* works
* fix lint
* prevent subflow in subflow
* fix lint
* add additional logs, add localhost as allowedOrigin
* add additional logs, add localhost as allowedOrigin
* fix type error
* remove unused code
* fix lint
* fix tests
* fix lint
* fix build error
* workign folder updates
* fix typing issue
* fix lint
* fix typing issues
* lib/
* fix tests
* added old presence component back, updated to use one-time-token better auth plugin for socket server auth, tested
* fix errors
* fix bugs
* add migration scripts to run
* fix lint
* fix deploy tests
* fix lint
* fix minor issues
* fix lint
* fix migration script
* allow comma separateds id file input to migration script
* fix lint
* fixed
* fix lint
* fix fallback case
* fix type errors
* address greptile comments
* fix lint
* fix script to generate new block ids
* fix lint
---------
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
Co-authored-by: Waleed Latif <walif6@gmail.com >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
* fix(sockets): updated CSP
* remove unecessary logs
* fix lint
* added throttling, refactor entire socket server, added tests
* improvements
* remove self monitoring func, add block name event
* working isWide, isAdvanced toggles with sockets
* fix lint
* fix duplicate key issue for user avatar
* fix lint
* fix user presence
* working parallel badges / loop badges updates
* working connection output persistence
* fix lint
* fix build errors
* fix lint
* logs removed
* fix cascade var name update bug
* works
* fix lint
* fix parallel blocks
* fix placeholder
* fix test
* fixed tests
---------
Co-authored-by: Aditya Tripathi <aditya@climactic.co >
Co-authored-by: Adam Gough <77861281+aadamgough@users.noreply.github.com >
Co-authored-by: Vikhyath Mondreti <vikhyathvikku@gmail.com >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-MacBook-Air.local >
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@Vikhyaths-Air.attlocal.net >
Co-authored-by: Emir Karabeg <emirkarabeg@berkeley.edu >
Co-authored-by: Emir Karabeg <78010029+emir-karabeg@users.noreply.github.com >
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
Co-authored-by: Vikhyath Mondreti <vikhyathmondreti@vikhyaths-air.lan >
Co-authored-by: Ajit Kadaveru <ajit.kadaveru@berkeley.edu >
2025-06-24 17:44:30 -07:00
Waleed Latif
726901cb31
feat(voice): speech to speech mode for deployed chat ( #467 )
...
* finished barebones, optimized speech to speech chat deploy
* better visualization, interruption still not good
* fixed some turn detection, still not ideal. have to press mute + unmute to process successive queries
* improvements
* removed MediaSource in favor of blob, simplified echo cancellation and overall logic
* simplified
* cleanups
* ack PR comments
2025-06-09 19:11:59 -07:00
Waleed Latif
49a8a0551d
fix(email): added unsubscribe from email functionality ( #468 )
...
* added unsubscribe from email functionality
* added tests
* ack PR comments
2025-06-09 19:04:20 -07:00
Adam Gough
567f7a5e10
feat(telegram-bot): removed trigger phrase
...
feat(telegram-bot): removed trigger phrase
2025-06-06 13:36:26 -07:00
Waleed Latif
10ab1b4041
feat(tools): added google calendar tools/block, and gcal selector subblock ( #454 )
...
* added google calendar picker, tools, & block
* added attendees list to quick add for gcal
* added docs for gcal
* cleanup
* consolidated utils, additional type safety
2025-06-03 15:20:54 -07:00
Emir Karabeg
f3a405364f
improvements(knowledge): ui/ux
2025-06-03 01:57:08 -07:00
Waleed Latif
1eda44d605
imrpovement(kb): added client-side store, shared utils, background processing, retry with exponential backoff to knowledge base ( #453 )
...
* added background processing for file upload to knowledge base, added retry with exponential backoff, individual file retry, statuses
* added knowledge store
* added knowledge base selector and docs for knowledge block
* fixed build
* fix contributors page
* significantly improved error handling, typing, fault tolerance
* standardize file icon size
2025-06-02 23:12:47 -07:00
Waleed Latif
282345b983
fix(emails): fix base URL
2025-06-02 18:03:46 -07:00
Emir Karabeg
d9e99a4fab
feat(knowledge) ( #449 )
...
* feat(knowledge): setup knowledge and base UI
* improvement(knowledge): empty state UI
* feat(knowledge): created schema
* added s3 bucket for kbs
* fix: remove dummy values
* feat(knowledge): embedding view; schema adjustments; migration history; navigation
* feat(knowledge): block/tool for vector search
---------
Co-authored-by: Waleed Latif <walif6@gmail.com >
2025-06-02 03:41:23 -07:00
Waleed Latif
7d640823c3
fix(variables): added block/variable name validation to prevent invalid characters, fixed block renaming issue with drag handler ( #448 )
...
* added block name and variable name validation to prevent invalid characters, fixed block renaming issue with drag handler
* also collapse multiple whitespaces into one
2025-06-01 23:51:07 -07:00
Waleed Latif
de2ce6fcb7
feat(slack): added slack oauth for sim bot & maintained old custom bot, fixed markdown rendering ( #445 )
...
* fix formatting of contributors chart
* added slack oauth, removed hardcoded localhosts and use NEXT_PUBLIC_APP_URL instead
* remove conditional rendering of subblocks for tools in an agent blcok
* updated tests
* added permission to read private channels that bot was invited to
* acknowledge PR comments, added additional typing & fallbacks
* fixed build error
* remove fallback logic for password fields
* reverted changes to middleware
* cleanup
2025-06-01 20:34:19 -07:00
Waleed Latif
2e77d4625a
feat(email): add customizable "FROM" email for resend ( #447 )
...
* add customizable from email on resend via envvar
* use existing getBaseDomain utility
2025-06-01 14:33:10 -07:00
Adam Gough
c5727ef018
feat(tools): added microsoft excel tools/block ( #441 )
...
* got the read excel tool working
* added read manual ID insertion
* write working
* tool finished
* removed old logic
* removed logic that was causing credential error
* cleaned up
* ran bun lint
* removed logger
* added back merging logic
* fix: removed comments
* fix: added greptile changes
* ran bun lint
* removed function
* added microsoft excel docs
* fix: icon format
* fix: docs
* ran lint
---------
Co-authored-by: Adam Gough <adamgough@Adams-MacBook-Pro.local >
2025-05-30 19:11:45 -07:00
Waleed Latif
a9196314d7
fix(tools): fix linear block
2025-05-30 00:47:02 -07:00
Waleed Latif
88d8a1b104
feat(tools): added linear tools/block ( #439 )
...
* feat(linear): add Linear Issue Reader and Writer tools with types
* chore(tools): register Linear tools in global tool registry
* feat(icons): add LinearIcon for Linear block
* feat(blocks): register Linear block in global block registry
* feat(linear): implement OAuth integration for Linear block
* feat(linear): add dynamic team and project selectors for Linear block
* feat(linear): add backend API endpoints for teams and projects
* feat(linear): update UI components for Linear selectors and modal
* refactor(linear): update create/read issue tools and types
* chore(linear): update block config for Linear integration
* fix(auth): update auth and oauth logic for Linear
* minor fix
* improvement[linear]: require teamId and projectId for all tools and types
* style[lint]: fix code style and lint errors
* chore(linear): install @linear/sdk package
* fix[linear]: address greptile-apps feedback for type safety and error handling
* fix[linear]: handle teams API response errors
* modified icon, added docs
---------
Co-authored-by: sriram2k4 <sriramthehacker01@gmail.com >
2025-05-30 00:10:37 -07:00
Waleed Latif
ca6884cdc2
fix(memories): simplified memories, added memories subblock for agent ( #432 )
...
* fix(memories): simplified memories, added memories subblock for agent
* removed raw data from memory block, simplified memory config
* fix(persistence): persist collapsed state for responseFormat code subblock (#429 )
* fix(persistence): persist collapsed state for responseFormat code subblock
* add additional type safety
* acknowledged PR comments
2025-05-28 17:48:43 -07:00
Waleed Latif
84b9d766e9
fix(subscriptions): fix disabled subs
2025-05-28 08:19:36 -07:00
Waleed Latif
b1126e3d6a
feat(loop): added loop block & parallel block logic ( #411 )
...
* feat(subflows): implement parallel and loop nodes
* fixed linter errors
* added loop block logic
* added parallel executioon
* added input resolution for collections for parallel & loop blocks
* refactored tests, cleaned up some unnecessary logic
* prevent self connections now that we have loop blocks
* refactored path tracker
* lint
* acknowledged PR comments, added tests
* added tests for loops
---------
Co-authored-by: Emir Karabeg <emirkarabeg@berkeley.edu >
2025-05-25 14:39:56 -07:00
Waleed Latif
ef8ae60afd
fix(file-upload): fixed file upload for mistral parse
2025-05-24 22:44:18 -07:00
Waleed Latif
950e055a8d
fix(file-upload): re-enabled file upload for mistral & url for file upload ( #408 )
...
* re-enabled file upload for mistral & url for file upload
* consolidated env checks
2025-05-24 20:58:49 -07:00
Adam Gough
79b761c022
feat(tools): created outlook tools/block ( #409 )
...
* feat: first round of tools for outlook
* added more
* outlook finished
* added bun and docs
* fix: added greptile comments
* added greptile and bun lint
* got rid of HTML
---------
Co-authored-by: Adam Gough <adamgough@Adams-MacBook-Pro.local >
2025-05-24 20:57:49 -07:00
Adam Gough
45c92067e2
feat(tools): added microsoft teams tools/block ( #405 )
...
* feat: microsoft teams block added
* updated name
* oauth working
* fixing accessToken
* saving accessToken spot
* all four tools are working
* display name better
* finished teams tool
* Remove package-lock.json from PR
* added greptile comments
* added scopes, removed ;, removed loggers
* solved credential bug
* added docs and rebased
* fixed lint checks
* more bun lint
* bun lint errors solved
---------
Co-authored-by: Adam Gough <adamgough@Adams-MacBook-Pro.local >
2025-05-24 14:02:37 -07:00
Waleed Latif
8c268e23dd
chore(biome): removed prettier, added biome ( #407 )
...
* chore: replace prettier with biome and add linting
* chore: update devcontainer settings to use biome for linting and remove eslint, prettier
* chore: update docker-compose to use Postgres 17-alpine and standardize quotes
* chore: fixed more BUT disabled most rules due to limit
* added additional rules, fixed linting & ts errors
* added additional rules
* rebased & linted
* fixed oauth
* updated biome & minor modifications
---------
Co-authored-by: Aditya Tripathi <aditya@climactic.co >
2025-05-24 03:11:38 -07:00
Aditya Tripathi
6d380c28e3
refactor(ollama): ollama host -> url (convention) + readme and compose to reflect the same ( #394 )
...
* chore(docker): add OLLAMA_HOST environment variable to local and production configurations; update README for docker compose commands
* refactor(env): rename OLLAMA_HOST to OLLAMA_URL in configuration files and update related references
2025-05-21 14:28:10 -07:00
Waleed Latif
b29827c4ee
fix(errors): fix error handling for signup/signin
2025-05-19 01:26:00 -07:00
Waleed Latif
1ec9770df3
fix(errors): fix error handling for signup/signin
2025-05-19 00:32:41 -07:00
Waleed Latif
fd82b99c5c
feat(waitlist): remove waitlist, update login/signup/verify styling to match landing, remove OTP in dev/docker ( #377 )
...
* removed waitlist on landing
* remove OTP in dev or docker, remove invite members from sidebar in dev/docker
* modified signup, login, verify, and reset password to match landing
* add README for npm package
* acknowledged PR comments
* restore cmd+enter functionality
2025-05-18 23:04:22 -07:00
Waleed Latif
717e17d02a
feat(bun): upgrade to bun, reduce docker image size by 95%, upgrade docs & ci ( #371 )
...
* migrate to bun
* added envvars to drizzle
* upgrade bun devcontainer feature to a valid one
* added bun, docker not working
* updated envvars, updated to bunder and esnext modules
* fixed build, reinstated otel
* feat: optimized multi-stage docker images
* add coerce for boolean envvar
* feat: add docker-compose configuration for local LLM services and remove legacy Dockerfile and entrypoint script
* feat: add docker-compose files for local and production environments, and implement GitHub Actions for Docker image build and publish
* refactor: remove unused generateStaticParams function from various API routes and maintain dynamic rendering
* cleanup
* upgraded bun
* updated ci
* fixed build
---------
Co-authored-by: Aditya Tripathi <aditya@climactic.co >
2025-05-18 01:01:32 -07:00
Waleed Latif
f07cffd264
improvement(logs): added infinite scroll, markdown rendering, and individual block input to logs ( #364 )
...
* add performant infinite scroll
* added markdown rendering in the logs
* added individual block input to logs
* fixed markdown render
* consolidate redactApiKeys to utils
* acknowledged PR comments
2025-05-15 14:14:12 -07:00
Waleed Latif
1152a264bc
fix(subscriptions): fixed organization creation failure introduced by subscription updates ( #361 )
...
* fix(subscriptions): fixed organization creation failure introduced by subscription updates
* cleaned up tests
* run format
2025-05-15 12:28:46 -07:00
Waleed Latif
43cb4cbf15
improvement(subscriptions): added log retention cron, enterprise plan & refactored subscriptions logic ( #357 )
...
* added cron to cleanup logs for free users
* added log retention cron, admin dashboard, & enterprise plan. refactored subscriptions logic & ui
* added more type safety & added total chat executions to user stats table
* removed waitlist + admin
* added tests, fixed edge cases
* removed migrations
* acknowledged PR comments
* added heplers, removed duplicate logic
* removed extraneous comments
2025-05-14 18:25:48 -07:00
Adam Gough
76c22e9164
feat(docs): added tutorial videos & telegram logic added for user-agent ( #348 )
...
* telegram logic added for user-agent
* telegram and clay updated
* added more tool videos and descriptions
* Update apps/docs/content/docs/tools/google_search.mdx
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* Update apps/docs/content/docs/tools/google_drive.mdx
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* Update apps/docs/content/docs/tools/google_docs.mdx
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* Update apps/docs/content/docs/tools/google_docs.mdx
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* Update apps/docs/content/docs/tools/google_docs.mdx
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* docs update
* added new google docs youtube vid
---------
Co-authored-by: Adam Gough <adamgough@Adams-MacBook-Pro.local >
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2025-05-12 13:24:10 -07:00
Waleed Latif
626dafae49
fix(db): fix slow db connection, add redis cache for gmail polling
2025-05-12 13:13:21 -07:00
Emir Karabeg
230143af3c
improvement(variables): variable experience and removed execution time ( #349 )
...
* improvement(variables): removed string type and kept plaintext without processing input
* improvement(function): removed execution time
* fix(variables): inputting variables and validating format
* fix(variables): sync
* fix(tests): upgraded tests
* Apply suggestions from code review
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
---------
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2025-05-11 22:03:07 -07:00
Waleed Latif
3580241d93
feat(discord): added discord block/tools ( #347 )
...
* feat(tools): added discord oauth, block, and tools
* added docs
* remove extraneous comments/logs
* added tooltips for disabled subblocks, acknowledged PR comments
* added tools and blocks for new repo structure
* added docs
* added more type safety, fixed some styling
* updated docs
* fixed style of dropdown in tool-input
* acknowledged PR comments
2025-05-11 18:32:04 -07:00
Waleed Latif
0fc0f683a6
feat(gmail): added gmail polling service to trigger workflow on incoming emails ( #344 )
...
* setup gmail polling service, not tested
* general improvements to gmail polling and error handling, receive message but triggers wrong wrokflow
* finished gmail polling service, works when I send multiple emails in a single polling period (triggers the workflow for each new email)
* remove unread messages
* remove unread messages
* modified to process all incoming emails as individual workflow executions, enhance dedupe, general improvements
* replaced desc w tooltips
* added cron job for polling gmail
* remove unused props, simplify naming convention
* renoved extraneous comments, removed unused processIncomingEmails
* fixed build issues
* acknowledged PR comments
2025-05-11 12:46:09 -07:00
Emir Karabeg
d79cad4c52
feat(sidebar-controls): added ability to expand on hover ( #343 )
2025-05-09 22:51:27 -07:00
Waleed Latif
a92ee8bf46
feat(turbo): restructured repo to be a standard turborepo monorepo ( #341 )
...
* added turborepo
* finished turbo migration
* updated gitignore
* use dotenv & run format
* fixed error in docs
* remove standalone deployment in prod
* fix ts error, remove ignore ts errors during build
* added formatter to the end of the docs generator
2025-05-09 21:45:49 -07:00