Overview
ElevenLabs is an industry leader in synthetic speech quality and emotional realism. In BrokerOS, the ElevenLabs integration is implemented inintegrations/voice/agents/elevenlabs/src/index.ts under the Turborepo workspace package @brokeros/int-agent-elevenlabs.
BrokerOS administrators configure ElevenLabs accounts directly inside the Web UI at Dashboard -> Marketing -> Voice -> Settings. All credentials are encrypted using AES-256-GCM and stored in PostgreSQL (VoiceAgentIntegration).
Architecture and Dispatch Sequence
The ElevenLabs integration implements theIVoiceAgentProvider contract from @brokeros/types. Outbound sessions initialize through the ElevenLabs Conversational AI API and bridge to PSTN carriers.
Step 1: Obtain Credentials from ElevenLabs
- Log into your account at elevenlabs.io.
- Click your profile avatar in the bottom-left corner and navigate to API Keys.
- Create and copy your API key.
- Navigate to Conversational AI in the left menu to inspect or create an agent persona.
Step 2: Connect in the BrokerOS Web Dashboard
In your BrokerOS dashboard:- Navigate to Dashboard -> Marketing -> Voice -> Settings.
- Select the Gateways & Voice Platforms tab (
/dashboard/marketing/voice/settings?tab=providers). - Click the AI Voice Platforms sub-tab.
- Click Add Platform and select ElevenLabs Conversational.
- Fill in the modal connection fields:
- Click Save & Verify Engine. BrokerOS tests the key against
GET https://api.elevenlabs.io/v1/models, encrypts it using AES-256-GCM, and saves it inVoiceAgentIntegration.
Luxury Real Estate Voice Cloning
For flagship developments (villas and penthouses priced above 5 Crores INR), firms can clone the voice of the Managing Director or Chief Architect:- Executive VIP Touch: Delivers a tailored personal greeting: βGood afternoon Mr. Singhania, this is Vikram from Prestige Sanctuary. I wanted to personally update you on our limited release of golf-facing villasβ¦β
- Acoustic Fidelity: Neural voice stability and similarity settings prevent robotic artifacts.
- Dynamic Variable Injection: Automatically inserts lead name, enquired property, and budget targets directly into the conversational flow.
Integration Implementation Details
The ElevenLabs integration logic is defined inintegrations/voice/agents/elevenlabs/src/index.ts and integrations/voice/agents/elevenlabs/src/elevenlabs-dispatcher.ts.
Live Verification Engine
When tested in the UI,ElevenLabsAgentClient.validateCredentials() executes an authenticated health check:
Conversational AI Dispatch
Outbound conversations are initiated viaPOST /v1/convai/conversations, injecting lead attributes and unit details into dynamic variables: