Join us at TNW Conference 2022 for insights into the future of tech →

Human-centric AI news and analysis

This article was published on October 22, 2020

Adobe’s new AI experiment syncs your dance moves perfectly to the beat

Adobe’s new AI experiment syncs your dance moves perfectly to the beat
Ivan Mehta
Story by

Ivan Mehta

Ivan covers Big Tech, India, policy, AI, security, platforms, and apps for TNW. That's one heck of a mixed bag. He likes to say "Bleh." Ivan covers Big Tech, India, policy, AI, security, platforms, and apps for TNW. That's one heck of a mixed bag. He likes to say "Bleh."

TikTok has made on-beat dances and movements mainstream. But what if you went offbeat or the video you recorded had some lag to your perfect dance moves. Adobe can fix that for you.

The company showed off an AI-powered experiment at its Adobe Max conference that syncs your off-beat movement to the beat of the music. Researchers used computer vision to follow the body movement of the person in the video. As shown below, the algorithm also analyzes dance moves through popping orange circles to determine the time of movements.

[Read: How Photoshop’s new Neural Filters harness AI to generate new pixels]

The researchers also mark beats of the music track with orange lines and plot them against the orange dots to determine if dance moves are in sync with the music.

Adobe uses this analysis to match beats of the song with corresponding movements to make a perfectly synced video. The company said that the algorithm can take random videos of people dancing and sync them with a track, making it look like they’re dancing to the same song.

While this is just an experiment, it could be handy for creators to video editors. I wouldn’t be surprised if we see such functionality making it to TikTok or Instagram Reels in a few years.

Get the Neural newsletter

Greetings Humanoids! Did you know we have a newsletter all about AI? You can subscribe to it right here.

Also tagged with