La Nuit des Chercheur·es: AI and music

Analysis: Source Separation

Using the Demucs neural network [Rouard, 2023]


Original Audio - Come Together, The Beatles

Vocals

Guitar

Drums

Bass

Generation by text prompt

This song was obtaiined using the site udio

Prompt: "une chanson à propos d'un évènement de vulgarisation scientifique appelé 'la nuit des chercheurs' ayant lieu à Océanopolis à Brest."

Some tags were also added: longing, warm, french pop, happy, sensual, uplifting, love, rhythmic, melodic, female vocalist

(NB: I remember adding some of these tags, but not all actually, "Love" for instance. Because I copied some tags from a different song, I liked, I may have unintenionally added them. Some tags are hence not suited for the context, sorry about that.)

Fun stuff

Guess what's happening





Spoiler: It replaces the singer by a cat! And it's called Meowify [Melistas, 2020]

Original YouTube link, and a video with some details

Credits

This work was presented at the "Nuit des Chercheur·es", in Sep. 2024, in Brest, France, by Axel Marmoret (https://ax-le.github.io/).

The website was coded using ChatGPT 4o.

A little bit of context

"La Nuit des Chercheur·es" (Night of researchers) is a scientific vulgarization event which aims at introducing researchers' work to a wide audience of general public.

This page was generated in this context, with the goal of presenting some tools using AI (Artificial Intelligence) in relation to music.

Technical Details

You can also refer to the literature below for more comprehensive details:

[Rouard, 2023] Rouard S, Massa F, Défossez A. "Hybrid transformers for music source separation." ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2023 Jun 4. IEEE.

[Melistas, 2020] Thomas Melistas. "Meowify". HAMR Hackathon, 2020. Code link