Music2Fail: Transfer Music to Failed Recorder Style

Abstract: The goal of music style transfer is to convert a music performance by one instrument into another while keeping the musical contents unchanged. In this paper, we investigate another style transfer scenario called ''failed-music style transfer''. Unlike the usual music style transfer where the content remains the same and only the instrumental characteristics are changed, this scenario seeks to transfer the music from the source instrument to the target instrument, with deliberately performed off-pitch. Our work attempts to transfer normally played music into off-pitch recorder music, which we call ''failed-style recorder'', and study the results of the conversion. To carry out this work, we have also proposed a dataset of failed-style recorders for this task, called ''FR109 Dataset''. Such an experiment explores the music style transfer task in a more expressive setting, as the generated audio should sound like an ''off-pitch recorder'' while maintaining a certain degree of naturalness.

For more details of our work, please refer to the paper.

FR109 Dataset

Our ''FR109 Dataset'' is avaliable for downloading, you can find more information in FR109 Dataset's zenodo page.

 

Violin to Recorder


Origin VAE-GAN StarGAN DDSP
Sample 1
Sample 2
Sample 3


Clarinet to Recorder


Origin VAE-GAN StarGAN DDSP
Sample 1
Sample 2
Sample 3


Saxophone to Recorder


Origin VAE-GAN StarGAN DDSP
Sample 1
Sample 2
Sample 3