Here Come the AI Deepfake Tracks...

[Joyrex]

The Guardian has an article on OpenAI's latest accomplishment - getting Frank Sinatra to sing a song he never sang:

 

[Hugh Mughnus]

Crazy! So cool though. 

[Psychotronic]

Thicc Deepsong. Is there any way we can feed that beast ourselves?

[chim]

Can somebody more savvy explain how these waveforms are made? Is it sampling a gargantuan library and connecting the dots? Is anything synthesized? 

[Rubin Farr]

17 minutes ago, chim said:

Can somebody more savvy explain how these waveforms are made? Is it sampling a gargantuan library and connecting the dots? Is anything synthesized? 

is it something like the AI is using trillions of sample points, and adapting that voiceprint to the existing track’s original melody and vocal cadence, like autotune?

[hijexx]

26 minutes ago, chim said:

Can somebody more savvy explain how these waveforms are made? Is it sampling a gargantuan library and connecting the dots? Is anything synthesized? 

 

[ghsotword]

37 minutes ago, Psychotronic said:

Thicc Deepsong. Is there any way we can feed that beast ourselves?

Yes. 

Colab notebook:
https://colab.research.google.com/github/openai/jukebox/blob/master/jukebox/Interacting_with_Jukebox.ipynb
You can upload any audio in the Colab notebook and use it as the seed for the neural network for generating new audio

Github:
https://github.com/openai/jukebox

[hijexx]

Also DataBots have a few papers on their method with more tech details about how they create model inputs and how they train:

https://dadabots.com/science.php

 

[hijexx]

DadaBots did a Frank Sinatra sings Britney Spears 'Toxic' wow

https://futurism.com/mind-melting-ai-frank-sinatra-toxic-britney-spears