OpenVoice :Open-Source AI Voice Cloning Technology
OpenVoice:MyShell, the California-based startup founded in 2023, has unveiled OpenVoice, a groundbreaking open-source AI that allows for rapid and highly accurate voice cloning. Developed in collaboration with researchers from MIT and Tsinghua University, OpenVoice utilizes a dual AI model system for text-to-speech conversion and voice tone cloning, offering users unprecedented control over various vocal attributes.
This innovative technology, as detailed in a recently pre-reviewed research paper, enables voice cloning with remarkable speed and precision, requiring only seconds of audio input. OpenVoice’s first model, trained on 30,000 diverse audio samples in English, Chinese, and Japanese, focuses on language style, accents, emotions, and other speech patterns. The second model, known as the “tone converter,” draws insights from a dataset of over 300,000 samples representing 20,000 voices.
The synergy between the universal speech model and user-provided voice samples allows OpenVoice to achieve voice cloning with minimal data, outpacing alternatives such as Meta’s Voicebox. The technology’s practicality is demonstrated on demo sites hosted by MyShell and HuggingFace, where users can experience the capabilities of OpenVoice firsthand.
MyShell, backed by $5.6 million in early funding and boasting over 400,000 users, positions itself as a decentralized platform for AI app creation and discovery. In addition to its groundbreaking voice cloning technology, MyShell offers original text-based chatbot personalities, meme generators, user-created text RPGs, and more. While some content is behind a subscription fee, the company also monetizes its platform by charging bot creators for promotional opportunities.
By open-sourcing OpenVoice through platforms like HuggingFace, MyShell aims to contribute to the advancement of an open model of AI development. This strategic move not only enhances user engagement across both voice cloning and its broader app ecosystem but also aligns with MyShell’s commitment to fostering innovation in the AI community.
Must Read..
AI Impact on Judiciary: Transformation, Challenges, and Opportunities