I need a developer to build a browser-based application that enables natural, real-time, two-way voice conversations between a user and an AI model. The application should be lightweight, embeddable into an existing website, and have the following capabilities:
Core Features: 1. Live Two-Way Audio • User clicks a “Start Conversation” button to initiate a voice session. • AI and user can speak back and forth with minimal latency. • AI can respond while the user is speaking (interruptions allowed).
2. Streaming Speech-to-Text & Text-to-Speech • User’s voice is continuously transcribed in real time. • AI responses are converted to natural-sounding speech and played instantly.
3. Custom AI Model & Knowledge Base • The AI will be fine-tuned or configured to follow a specific role/persona and to operate within a defined knowledge base. • This role/persona will be predefined but should be easy to adjust in the code.
4. User-Uploaded Documents for Context • Users can upload documents (PDF, Word, or text) before or during the session. • The AI should be able to reference and incorporate this content dynamically into the conversation. • Uploaded files should be processed so the AI can search and quote relevant sections when replying.
5. Embeddable UI • Simple, single-screen interface with: • “Start Conversation” / “End Conversation” controls • Optional transcript display of the conversation • File upload area for session-specific documents • Minimal styling but easy to theme for my brand.
6. Optional Data Passing • Ability to load additional text/data into the AI’s context before the session starts.
Technical Requirements: • Must use OpenAI’s Realtime API (or similar low-latency LLM service) for voice streaming. • Browser-based microphone access via WebRTC (or equivalent). • Clean, well-commented HTML/JavaScript (or minimal React) that can be embedded into a Wix site. • Clear instructions for changing system prompt, voice, and any AI settings.
Deliverables: • Fully functional prototype that runs in Chrome and Edge without extra installs. • Code files and documentation for setup and configuration.
Nice-to-Have (future scope, not required now): • Session recording and playback • Multiple AI personas selectable at start • Visual indicators when AI is listening or speaking
This is a short project — I’m looking for a working prototype ready for testing within a week.
Lead-Generating Social Media Management Category: Analytics, Content Creation, Facebook Marketing, Instagram Marketing, Internet Marketing, Social Media Management, Social Media Marketing, Twitter Budget: ₹1500 - ₹12500 INR