The Interruptor - Dub Voyage

Moderator: interruptor

Post Reply
User avatar
interruptor
Posts: 1195
Joined: Sun Sep 04, 2005 11:46 pm
Location: Switzerland
Contact:

The Interruptor - Dub Voyage

Post by interruptor » Fri Nov 11, 2022 5:51 pm

A Dub track I created inspired by a night spent in nature under an open sky.
Mixed live on a Midi Controller (BCR2000) with SonicCore Scope soundcard and some tasty outboard: Fisher Spacexpander, Tape Delay (DIY), Ibanez BBD. Instruments: Modular Synth, Moog Voyager, Karp Odyssey, MFB-522 Analog Drumcomputer.
The video was created using artificial intelligence only. No actual paint brushes involved.

Song Streaming und Download: https://song.link/dubvoyage


User avatar
kevingham
Posts: 7
Joined: Thu Sep 22, 2022 10:25 pm

Re: The Interruptor - Dub Voyage

Post by kevingham » Sat Jan 07, 2023 12:08 pm

Hey man, this is a lovely track, really enjoying those 808 style beats, lovely electro dub atmosphere. Great work :)

How do you make the AI video, what application did you do that with? It's really nice!

User avatar
interruptor
Posts: 1195
Joined: Sun Sep 04, 2005 11:46 pm
Location: Switzerland
Contact:

Re: The Interruptor - Dub Voyage

Post by interruptor » Sun Jan 08, 2023 1:54 pm

Thanks for your kind words! :D

The visuals were created using two different A.I. tools:
  1. VQGAN+CLIP
    This is a method to create images from text prompts. Optionally a photograph can be used as a starting point to guide the artificial intelligence. The process involves improving the picture over many iterations. The animation is created by slightly zooming or shifting the generated images between the iterations.
    I did not do any programming myself but used the script "pytti5" by sportsracer48 which is run on a google colab server.
  2. AnimationKit AI
    This is another script run on google colab. It uses artificial intelligence to double the image resolution and also to create additional image frames to achieve a smoother look of the movements in the video (interpolation).
    The underlying image processing techniques are called "Practical-RIFE 4.0" or "Real-ESRGAN"
If this all sounds very theoretical you could check this video. It is not about the exact same script that I used but about a very similar one:

User avatar
interruptor
Posts: 1195
Joined: Sun Sep 04, 2005 11:46 pm
Location: Switzerland
Contact:

Re: The Interruptor - Dub Voyage

Post by interruptor » Sun Jan 08, 2023 2:03 pm

For further illustration here is a behind the scenes look at how the opening sequence of the video evolved from a real life picture of oasis huacachina in Peru:
315433152_1938392799686151_8399444223813569309_n.jpg
315433152_1938392799686151_8399444223813569309_n.jpg (83.43 KiB) Viewed 2952 times

User avatar
kevingham
Posts: 7
Joined: Thu Sep 22, 2022 10:25 pm

Re: The Interruptor - Dub Voyage

Post by kevingham » Mon Jan 09, 2023 9:48 am

This is fantastic, thank you for posting this info, I'm going to play with this this week, the results are really amazing, looks like a lot of fun and perfect way to create music videos for our music!

User avatar
interruptor
Posts: 1195
Joined: Sun Sep 04, 2005 11:46 pm
Location: Switzerland
Contact:

Re: The Interruptor - Dub Voyage

Post by interruptor » Mon Jan 09, 2023 12:16 pm

I think the same. For me, creating moving images worthy of a music video was simply not possible before AI. I wanted to create a video for this tune years ago already. Trying with real life video and also with images scanned from art books was frustrating and only proved how little I knew about filming and moving images in general.
Working with AI is time consuming as well. For reference: I rented access to google colab servers for 3 months last summer (total cost of ca. 30.- USD). The actual time needed for the rendering of a 12 seconds segment of this video was ca. 30 minutes and there was a lot of trial and error needed to find good text prompts and animation parameters.

Post Reply