vid2midi: converts videos to midi files

Programming applications for making music on Linux.

Moderators: MattKingUSA, khz

Post Reply
User avatar
lucidbeaming
Established Member
Posts: 34
Joined: Tue Mar 21, 2017 8:44 am
Location: San Jose, CA
Contact:

vid2midi: converts videos to midi files

Post by lucidbeaming »

I just released this Python script which generates midi files based on brightness values in video frames.

https://github.com/lucidbeaming/vid2midi

The idea came from a need to sync music themes and notes to scene changes in art videos I make. It is also useful for soundtracking videos in a DAW setup that doesn't offer video playback. In the past two days I have been using for more creative outlets.

It grabs the center portion of a video, averages the pixels, and returns a brightness value. That gets mapped to one of 12 notes on the chromatic scale. Time is synced to the frame duration and tick per quarternote value of the midi file.

Future plans include using hue instead of brightness and a wider range of notes/octaves.

In this example, the notes are driving the low synth in the background of the audio track for this video.

https://www.instagram.com/p/CB71eNejN9w/
nils
Established Member
Posts: 537
Joined: Wed Oct 22, 2008 9:05 pm
Has thanked: 35 times
Been thanked: 94 times
Contact:

Re: vid2midi: converts videos to midi files

Post by nils »

Cool. "Starred" on github for later review and use :)
User avatar
milo
Established Member
Posts: 1242
Joined: Wed Sep 06, 2017 2:55 am
Location: Southern Utah, USA
Has thanked: 275 times
Been thanked: 218 times
Contact:

Re: vid2midi: converts videos to midi files

Post by milo »

Cool video. Makes 1960-70s computer technology look pretty sinister.
Post Reply