ElevenLabs Introduces Medical Transcription Tool, Expands AI Models & Capabilities

ElevenLabs has launched Scribe v3 Medical, a transcription model optimised for healthcare, and outlined plans to develop specialised models for other sectors.

ElevenLabs, a UK-based AI research and product company, has expanded its AI models and enterprise agent capabilities, introducing healthcare-focused transcription, tools for customising AI systems and upgrades designed to help businesses automate conversations and related tasks.

The developments also include new enterprise partnerships and a marketplace for industry-specific AI agents.

The company's enterprise expansion follows its recent engagement with the Indian government.

A month ago, ElevenLabs signed an MoU with the Karnataka government to promote the responsible use of Voice AI across citizen services, accessibility and social impact, committing to restoring 1 million voices for people who have permanently lost their ability to speak due to conditions including ALS, cerebral palsy, throat cancer, and multiple sclerosis.

ElevenLabs has now launched Scribe v3 Medical, a transcription model optimised for healthcare, and outlined plans to develop specialised models for other sectors, including financial services.

ElevenLabs has also introduced three voice models: Scribe v3 for speech-to-text transcription, Eleven v4 for expressive text-to-speech generation and Eleven Realtime for speech-to-speech interactions.

Selected enterprise customers will be able to work with ElevenLabs' research team to fine-tune audio models and large language models (LLMs) for specific requirements.

Businesses can also use data from live deployments and reinforcement learning to improve performance against measures such as customer satisfaction and reliability.

To manage computing costs, ElevenLabs has introduced Interaction Engine, which coordinates voice models and LLMs throughout conversations. The system is designed to select models based on individual tasks, balancing response quality, reliability and token expenditure.

The company has also upgraded ElevenAgents, its platform for deploying voice and chat agents across customer support, sales, recruitment and operations.

Its new Memory feature allows agents to recall information from previous customer interactions, while Routines automates multi-step tasks before, during and after conversations.

Another addition, Architect, helps teams create and refine agents through voice or text instructions. Proposed changes are tested in simulation and presented for approval before implementation.

For enterprise deployment, ElevenLabs has launched a partner programme involving more than 550 firms across 44 countries. It has also announced an alliance with McKinsey to help organisations build and scale AI agents.

Its expanded partnership with Nvidia includes the availability of Nemotron 3.5 Super VL in ElevenAgents and plans to add 15 MW of Vera Rubin computing capacity. The companies will also work on an on-premises voice agent for Poland's national e-Health platform.

ElevenLabs is additionally launching a marketplace featuring industry-specific agents developed by more than 20 partners.

Stay tuned for more such updates on Digital Health News