Home / Technology / Algoriddim’s Djay Pro AI can transfer vocals and rhythms between songs

Algoriddim’s Djay Pro AI can transfer vocals and rhythms between songs

Algoriddim’s live DJ mixing and editing app Djay Pro has been a standout on iPads, iPhones, and Macs for years, enabling songs to be slowed down, sped up, scratched, and blurred together with ease. Today, the company’s bringing AI features to evolve the iOS version of the app, using a trained neural network to transfer one song’s vocals or rhythms to another song in real time.

Previously, Djay Pro focused on synchronizing the speeds of two different tracks, rebalancing their volume levels or equalization, and playing with each song as it “spun” on a virtual turntable. Algoriddim’s new Neural Mix feature goes deeper, isolating and pulling out vocals — a trick best suited to hip hop tracks — or percussive/harmonic components, ideal for electronic music. DJs could use the AI-powered feature to create either background-free acapellas or voice-free instrumentals from tracks, or place one song’s words on another song’s background.

Neural Mix’s AI processing is pretty impressive, using deep convolutional networks to simultaneously analyze millions of audio frames per second and render multiple track waveforms or DJ display graphics in real time. Algoriddim suggests that the feature relies on advanced AI chip features found in Apple’s iOS devices, including the A12Z Bionic in the 2020 iPad Pro.

Algoriddim is debuting the AI feature with 30 Neural Mix-specific commands that can be mapped to MIDI-based DJ hardware accessories, as well as a refreshed user interface that visually separates out vocals, drums, and harmonic components for each track. The app also includes AI-assisted crossfades, and an Automix AI feature that self-selects vocal elements or rhythmic patterns from songs, then transitions them automatically without the need for user intervention.

VB Transform 2020 Online – July 15-17. Join leading AI executives: Register for the free livestream.

Neural Mix is built using Apple’s Core ML, and works with iOS devices containing Apple’s A12 Bionic or later chipsets. Users of the existing Djay app for iOS unfortunately only have the ability to upgrade to Djay Pro AI using a $ 5 monthly subscription option that provides access to Neural Mix and a library of additional content.

Let’s block ads! (Why?)

VentureBeat

About

Check Also

SAG-AFTRA hits out at AI Taylor Swift deepfakes and George Carlin special, calls to make nonconsensual ‘fake images’ illegal

The Screen Actors Guild – American Federation of Television and Radio Artists (SAG-AFTRA) put out …