I just released this Python script which generates midi files based on brightness values in video frames.
https://github.com/lucidbeaming/vid2midi
The idea came from a need to sync music themes and notes to scene changes in art videos I make. It is also useful for soundtracking videos in a DAW setup that doesn't offer video playback. In the past two days I have been using for more creative outlets.
It grabs the center portion of a video, averages the pixels, and returns a brightness value. That gets mapped to one of 12 notes on the chromatic scale. Time is synced to the frame duration and tick per quarternote value of the midi file.
Future plans include using hue instead of brightness and a wider range of notes/octaves.
In this example, the notes are driving the low synth in the background of the audio track for this video.
https://www.instagram.com/p/CB71eNejN9w/
vid2midi: converts videos to midi files
Moderators: MattKingUSA, khz
- lucidbeaming
- Established Member
- Posts: 34
- Joined: Tue Mar 21, 2017 8:44 am
- Location: San Jose, CA
- Contact:
- milo
- Established Member
- Posts: 1242
- Joined: Wed Sep 06, 2017 2:55 am
- Location: Southern Utah, USA
- Has thanked: 275 times
- Been thanked: 218 times
- Contact:
Re: vid2midi: converts videos to midi files
Cool video. Makes 1960-70s computer technology look pretty sinister.