Meta reveals new ‘Voicebox’ AI that is too risky to release
Meta has created a new system that it says can generate convincing speech in a variety of styles – but will not release it for fear of the risks. The new tool is called “Voicebox” and can be set to create outputs in different styles, new voices from scratch as well as with a sample. It makes speech across six languages, as well as a variety of other tools such as noise removal. It says that it is a major development on previous speech systems that required specific training for each task. Instead, Voicebox can just be given raw audio and a transcription, and then be used to modify an audio sample. It is far more effective than its competitors, Meta claimed in its announcement. It can generate words with a 5.9 per cent error rate compared to 1.9 per cent from competitor Vall-E, for instance, and do so as much as 20 times more quickly. Meta said that it had been built on the foundation of a new model it called “Flow Matching”. That allows the system to learn from speech that has not been carefully labelled, so that it can be trained on more and more diverse data. Voicebox was trained on 50,000 hours of speech and transcripts that came from public domain audiobooks in English, French, Spanish, German, Polish, and Portuguese, Meta said. Now that it has been trained, it can be given an audio recording and fill in the speech from the context, Meta said. That could be used to create a realistic sounding voice from just two seconds of speech, for instance, potentially being used to bring voices to people who cannot speak or to add people’s voices into games. It could also be used to translate a passage of speech from one lanagueg to another in a way that keeps the style, Meta said, allowing people to talk to each other authentically even if they don’t speak the same language. It could also be useful in more technical scenarios, such as audio editing, where it can be used to replace words that were not properly recorded, for instance. But Meta said that the risks were such that it would not be releasing the model. It did not point to specific harms, but said that “as with other powerful new AI innovations, we recognize that this technology brings the potential for misuse and unintended harm”. Numerous reports have warned that such systems could be used to copy people’s voices without their consent and in ways that could be harmful, such as creating fake videos of news events or using people’s voices to pose as them during scam calls, for instance. “There are many exciting use cases for generative speech models, but because of the potential risks of misuse, we are not making the Voicebox model or code publicly available at this time,” Meta said in a statement. “While we believe it is important to be open with the AI community and to share our research to advance the state of the art in AI, it’s also necessary to strike the right balance between openness with responsibility.” It also pointed to a separate paper, published on its website, in which it detailed how it had built a “highly effective” system that can distinguish between authentic speech and audio that had been generated with Voicebox. Read More Mark Zuckerberg reveals what he thinks about Apple’s headset – and it’s not good Meta scrambles to fix Instagram algorithm connecting ‘vast paedophile network’ Reddit user’s protests against the site’s rules have taken an even more bizarre turn
2023-06-20 01:59
Mood Brightens as Chinese Equities Erase Losses: Markets Wrap
Stocks in Asia climbed as sentiment improved in the property sector and on gains among electric vehicle markers.
2023-09-12 13:15
Angels left-hander Reid Detmers has no-hitter through 7 innings at Texas
Los Angeles Angels left-hander Reid Detmers hasn’t allowed a hit through seven innings Wednesday night against the AL West-leading Texas Rangers
2023-08-17 09:55
Dylan Mulvaney blasts Bud Light as trans influencer claims brand did not stand by her amid controversy
Bud Light beer faced a drop in their sale after their controversial tie-up with trans influencer Dylan Mulvaney
2023-06-30 07:29
Israel's war with Hamas will cause deep and wide political shockwaves
Cataclysmic events like the Hamas onslaught on Israel trigger profound political shocks and strategic transformations that no one could predict at the time.
2023-10-10 12:25
Biden on speakerphone in son's business calls, Congress hears
But Joe Biden only discussed topics like the weather with his son's associates, a Democratic lawmaker says.
2023-08-01 11:53
Everton vs Man Utd - Premier League: TV channel, team news, lineups and prediction
Everton host Man Utd in the Premier League on Sunday. Preview includes team news, predicted lineups, how to watch on TV and live stream and more.
2023-11-24 00:25
Disney scraps $867m Florida plan amid Ron DeSantis feud
The company makes the decision amid an escalating legal battle with Florida Governor Ron DeSantis.
2023-05-19 03:22
Sexton's boot and Springbok forward power a potent World Cup cocktail
Ireland and South Africa will meet for the first time in a Rugby World Cup on Saturday in a blockbuster that pitches the world number...
2023-09-22 10:17
‘Transformers: Rise of the Beasts’: Shades of ‘Avengers Endgame’ echo throughout the film
The universe at threat, the Earth at center of it, and an alien race, all of it seems to be a page out of the 'Avengers' playbook
2023-06-09 15:48
American who filmed tourist carving name in Colosseum 'dumbfounded' as hunt for culprit intensifies
An American tourist tells The Associated Press he was “dumbfounded” when he found a fellow tourist carving graffiti in the wall of Rome's Colosseum
2023-06-27 23:24
Decoupling from China 'an illusion', French finance minister says
France's finance minister said during a visit to Beijing on Sunday that cutting all economic ties with China was "an illusion", as some Western countries question...
2023-07-30 14:55
You Might Like...
'What’s with the other?’: Fans slam 'villain' James Holzhaeur for playing mind games with Andrew He ahead of ‘Jeopardy! Masters' semifinals
Julia Ormond sues Harvey Weinstein for battery along with Disney, CAA and Miramax for negligence
John Travolta praises daughter Ella Bleu as she recreates Tom Cruise's holiday gift cake: 'This is delicious'
E. Jean Carroll can pursue $10 million lawsuit against Donald Trump--judge
P&G Alumni Global Conference 2023: Meeting the Moment as a Force for Growth and Good
Judge rejects attempt to temporarily block Connecticut's landmark gun law passed after Sandy Hook
Watch live: Japan and Norway fans gear up for World Cup clash
Trump White House official Navarro convicted of contempt after defying House Jan. 6 subpoena
