The Interruptor - Dub Voyage

[interruptor]

A Dub track I created inspired by a night spent in nature under an open sky.
Mixed live on a Midi Controller (BCR2000) with SonicCore Scope soundcard and some tasty outboard: Fisher Spacexpander, Tape Delay (DIY), Ibanez BBD. Instruments: Modular Synth, Moog Voyager, Karp Odyssey, MFB-522 Analog Drumcomputer.
The video was created using artificial intelligence only. No actual paint brushes involved.

Song Streaming und Download: https://song.link/dubvoyage

[kevingham]

Hey man, this is a lovely track, really enjoying those 808 style beats, lovely electro dub atmosphere. Great work

How do you make the AI video, what application did you do that with? It's really nice!

[interruptor]

Thanks for your kind words!

The visuals were created using two different A.I. tools:

1. VQGAN+CLIP
   This is a method to create images from text prompts. Optionally a photograph can be used as a starting point to guide the artificial intelligence. The process involves improving the picture over many iterations. The animation is created by slightly zooming or shifting the generated images between the iterations.
   I did not do any programming myself but used the script "pytti5" by sportsracer48 which is run on a google colab server.
2. AnimationKit AI
   This is another script run on google colab. It uses artificial intelligence to double the image resolution and also to create additional image frames to achieve a smoother look of the movements in the video (interpolation).
   The underlying image processing techniques are called "Practical-RIFE 4.0" or "Real-ESRGAN"

If this all sounds very theoretical you could check this video. It is not about the exact same script that I used but about a very similar one:

[interruptor]

For further illustration here is a behind the scenes look at how the opening sequence of the video evolved from a real life picture of oasis huacachina in Peru:

315433152_1938392799686151_8399444223813569309_n.jpg (83.43 KiB) Viewed 12695 times

[kevingham]

This is fantastic, thank you for posting this info, I'm going to play with this this week, the results are really amazing, looks like a lot of fun and perfect way to create music videos for our music!

[interruptor]

I think the same. For me, creating moving images worthy of a music video was simply not possible before AI. I wanted to create a video for this tune years ago already. Trying with real life video and also with images scanned from art books was frustrating and only proved how little I knew about filming and moving images in general.
Working with AI is time consuming as well. For reference: I rented access to google colab servers for 3 months last summer (total cost of ca. 30.- USD). The actual time needed for the rendering of a 12 seconds segment of this video was ca. 30 minutes and there was a lot of trial and error needed to find good text prompts and animation parameters.