Inference Connector - Mule 4
home
MuleSoft Inference Connector Overview
Inference Connector allows MuleSoft customers to integrate with various large language models (LLMs) and AI models for tasks like text generation, summarization, and sentiment analysis. It acts as a bridge, enabling your Mule applications to send prompts to LLMs and receive generated responses.
Key Features
Inference Connector simplifies taking advantage of the power of modern LLMs directly from within Mule applications by:
- Configuration-based integration: Seamlessly connect to the model best suited for your use
- Image generation and processing: Incorporate the creation and analysis of images into your integrated workflows
- Governance and management of LLM use: Monitor toxic inputs and outputs as well as tracking token usage to control costs associated with LLM consumption
- Ability to surface tooling to LLMs: Allow the model to reason and connect with other APIs based on identified steps to solve particular request
Associated Use Cases
Streamline a variety of business processes by integrating your Mule applications with market-leading LLMs. Possibilities include:
- Customer service optimization - Streamline operations by offloading time-consuming tasks such as analyzing reported issues, identifying potential resolution paths, and drafting customer communications
- Sales efficiency - Empower sales teams to focus on high-value activities by integrating LLMs into the flow of their daily operations fast-tracking previous time intensive processes, including contract authoring and prospect research
- Marketing personalization - Empower marketing teams by infusing AI capabilities natively in the execution of their core responsibilities, such as drafting social media copy, synthesizing market research, and completing campaign analysis
NOTE: This MuleSoft Inference Connector is a Select Connector and is licensed under the terms of Customer's Main Services Agreement with Salesforce.
For the avoidance of doubt, this MuleSoft Inference Connector is separate and distinct from the open source MuleSoft Inference connector which may be available on Github. The terms governing the use, modification, and contributions to the MuleSoft Inference connector which may be available on GitHub are exclusively subject to the applicable open-source license(s) associated therewith, and any such use, modification, or contribution is not supported by Salesforce.