mirror of
https://github.com/simstudioai/sim.git
synced 2026-01-09 15:07:55 -05:00
8f06aec68b
* fix(vulns): fix SSRF vulnerabilities * cleanup * cleanup * regen docs * remove unused deps * fix failing tests * cleanup * update deps * regen bun lock
78 lines
4.6 KiB
Plaintext
78 lines
4.6 KiB
Plaintext
---
|
|
title: Embeddings
|
|
description: Generate Open AI embeddings
|
|
---
|
|
|
|
import { BlockInfoCard } from "@/components/ui/block-info-card"
|
|
|
|
<BlockInfoCard
|
|
type="openai"
|
|
color="#10a37f"
|
|
icon={true}
|
|
iconSvg={`<svg className="block-icon"
|
|
|
|
|
|
|
|
viewBox='0 0 24 24'
|
|
role='img'
|
|
xmlns='http://www.w3.org/2000/svg'
|
|
>
|
|
<path
|
|
d='M22.2819 9.8211a5.9847 5.9847 0 0 0-.5157-4.9108 6.0462 6.0462 0 0 0-6.5098-2.9A6.0651 6.0651 0 0 0 4.9807 4.1818a5.9847 5.9847 0 0 0-3.9977 2.9 6.0462 6.0462 0 0 0 .7427 7.0966 5.98 5.98 0 0 0 .511 4.9107 6.051 6.051 0 0 0 6.5146 2.9001A5.9847 5.9847 0 0 0 13.2599 24a6.0557 6.0557 0 0 0 5.7718-4.2058 5.9894 5.9894 0 0 0 3.9977-2.9001 6.0557 6.0557 0 0 0-.7475-7.0729zm-9.022 12.6081a4.4755 4.4755 0 0 1-2.8764-1.0408l.1419-.0804 4.7783-2.7582a.7948.7948 0 0 0 .3927-.6813v-6.7369l2.02 1.1686a.071.071 0 0 1 .038.052v5.5826a4.504 4.504 0 0 1-4.4945 4.4944zm-9.6607-4.1254a4.4708 4.4708 0 0 1-.5346-3.0137l.142.0852 4.783 2.7582a.7712.7712 0 0 0 .7806 0l5.8428-3.3685v2.3324a.0804.0804 0 0 1-.0332.0615L9.74 19.9502a4.4992 4.4992 0 0 1-6.1408-1.6464zM2.3408 7.8956a4.485 4.485 0 0 1 2.3655-1.9728V11.6a.7664.7664 0 0 0 .3879.6765l5.8144 3.3543-2.0201 1.1685a.0757.0757 0 0 1-.071 0l-4.8303-2.7865A4.504 4.504 0 0 1 2.3408 7.872zm16.5963 3.8558L13.1038 8.364 15.1192 7.2a.0757.0757 0 0 1 .071 0l4.8303 2.7913a4.4944 4.4944 0 0 1-.6765 8.1042v-5.6772a.79.79 0 0 0-.407-.667zm2.0107-3.0231l-.142-.0852-4.7735-2.7818a.7759.7759 0 0 0-.7854 0L9.409 9.2297V6.8974a.0662.0662 0 0 1 .0284-.0615l4.8303-2.7866a4.4992 4.4992 0 0 1 6.6802 4.66zM8.3065 12.863l-2.02-1.1638a.0804.0804 0 0 1-.038-.0567V6.0742a4.4992 4.4992 0 0 1 7.3757-3.4537l-.142.0805L8.704 5.459a.7948.7948 0 0 0-.3927.6813zm1.0976-2.3654l2.602-1.4998 2.6069 1.4998v2.9994l-2.5974 1.4997-2.6067-1.4997Z'
|
|
fill='currentColor'
|
|
/>
|
|
</svg>`}
|
|
/>
|
|
|
|
{/* MANUAL-CONTENT-START:intro */}
|
|
[OpenAI](https://www.openai.com) is a leading AI research and deployment company that offers a suite of powerful AI models and APIs. OpenAI provides cutting-edge technologies including large language models (like GPT-4), image generation (DALL-E), and embeddings that enable developers to build sophisticated AI-powered applications.
|
|
|
|
With OpenAI, you can:
|
|
|
|
- **Generate text**: Create human-like text for various applications using GPT models
|
|
- **Create images**: Transform text descriptions into visual content with DALL-E
|
|
- **Produce embeddings**: Convert text into numerical vectors for semantic search and analysis
|
|
- **Build AI assistants**: Develop conversational agents with specialized knowledge
|
|
- **Process and analyze data**: Extract insights and patterns from unstructured text
|
|
- **Translate languages**: Convert content between different languages with high accuracy
|
|
- **Summarize content**: Condense long-form text while preserving key information
|
|
|
|
In Sim, the OpenAI integration enables your agents to leverage these powerful AI capabilities programmatically as part of their workflows. This allows for sophisticated automation scenarios that combine natural language understanding, content generation, and semantic analysis. Your agents can generate vector embeddings from text, which are numerical representations that capture semantic meaning, enabling advanced search, classification, and recommendation systems. Additionally, through the DALL-E integration, agents can create images from text descriptions, opening up possibilities for visual content generation. This integration bridges the gap between your workflow automation and state-of-the-art AI capabilities, enabling your agents to understand context, generate relevant content, and make intelligent decisions based on semantic understanding. By connecting Sim with OpenAI, you can create agents that process information more intelligently, generate creative content, and deliver more personalized experiences to users.
|
|
{/* MANUAL-CONTENT-END */}
|
|
|
|
|
|
## Usage Instructions
|
|
|
|
Integrate Embeddings into the workflow. Can generate embeddings from text.
|
|
|
|
|
|
|
|
## Tools
|
|
|
|
### `openai_embeddings`
|
|
|
|
Generate embeddings from text using OpenAI
|
|
|
|
#### Input
|
|
|
|
| Parameter | Type | Required | Description |
|
|
| --------- | ---- | -------- | ----------- |
|
|
| `input` | string | Yes | Text to generate embeddings for |
|
|
| `model` | string | No | Model to use for embeddings |
|
|
| `encodingFormat` | string | No | The format to return the embeddings in |
|
|
| `apiKey` | string | Yes | OpenAI API key |
|
|
|
|
#### Output
|
|
|
|
| Parameter | Type | Description |
|
|
| --------- | ---- | ----------- |
|
|
| `success` | boolean | Operation success status |
|
|
| `output` | object | Embeddings generation results |
|
|
|
|
|
|
|
|
## Notes
|
|
|
|
- Category: `tools`
|
|
- Type: `openai`
|