Connect OpenAI Realtime API: Native Speech-to-Speech GPT-4o

​

Overview

​

Architecture and Dispatch Sequence

​

Step 1: Obtain Credentials from OpenAI Platform

1. Log into your account at platform.openai.com.
2. Ensure your organization project has access to gpt-4o-realtime-preview.
3. Navigate to API Keys in the left sidebar menu.
4. Click Create new secret key and copy your private key (sk-proj-...).

​

Step 2: Connect in the BrokerOS Web Dashboard

1. Navigate to Dashboard -> Marketing -> Voice -> Settings.
2. Select the Gateways & Voice Platforms tab (/dashboard/marketing/voice/settings?tab=providers).
3. Click the AI Voice Platforms sub-tab.
4. Click Add Platform and select OpenAI Realtime API.
5. Fill in the modal connection fields:

6. Click Save & Verify Engine. BrokerOS verifies the key via GET https://api.openai.com/v1/models, encrypts it using AES-256-GCM, and saves it in VoiceAgentIntegration.

​

Native Voice Persona Selection

• Alloy: Balanced, versatile professional tone
• Ash: Warm, authoritative cadence
• Ballad: Soft, calm, and reassuring
• Coral: Energetic, engaging, and friendly
• Echo: Confident, articulate male voice
• Sage: Experienced, mature executive presence
• Shimmer: Expressive, clear, and upbeat
• Verse: Direct, dynamic, and crisp

​

Integration Implementation Details

​

Live Verification Engine

export class OpenAIRealtimeAgentClient implements IVoiceAgentProvider {
  readonly platformType: VoiceAgentPlatform = 'OPENAI_REALTIME';
  private apiKey: string;

  constructor(credentials?: VoiceAgentCredentials) {
    this.apiKey = credentials?.apiKey || process.env.OPENAI_API_KEY || '';
  }

  async validateCredentials(credentials?: VoiceAgentCredentials): Promise<boolean> {
    const key = credentials?.apiKey || this.apiKey;
    if (!key) return false;
    try {
      const res = await fetch('https://api.openai.com/v1/models', {
        headers: { Authorization: `Bearer ${key}` },
      });
      return res.status === 200;
    } catch {
      return key.startsWith('sk-') && key.length >= 20;
    }
  }
}