Give Your Synth Finger with MIDI Controller
OpenCV + MediaPipe caused big stir some 4 years ago, but never got around trying it myself. Until today and of course we're sharing results with you. This Open Source software can detect gestures, poses and facial expressions and transform them to so called landmarks that can easily be used for all kinds of shenanigans (in this example: controlling your synths). Timecodes: 00:00 - Introduction 00:38 - Demo 01: Playing Chords + Bass + Controlling Filters 01:32 - Hardware Needed 02:12 - Installation 02:56 - What are OpenCV & MediaPipe? 03:55 - This Example Explained: Reading Landmarks, Converting to MIDI 06:35 - Demo 02: Controlling Arpeggiator 07:37 - Demo 03: Controlling Filter Cutoff Frequency & Pitch Bend With Eyebrows 09:21 - Demo 04: Playing Pads on AKAI MPC Live III with Backing Track 10:10 - Conclusion Installation Instructions: sudo apt update sudo apt upgrade pip install mediapipe opencv-python --break-system-packages git clone https://github.com/mrfloydst/eyebrowraisingmidi then: python3 ./hand.py or: python3 ./eyebrow.py Innomaker USB 2.0 UVC Mini Camera: www.inno-maker.com/product-category/products/uvc-cameras/ Raspberry Pi Zero 2: www.raspberrypi.com/products/raspberry-pi-zero-2-w/ Playlists: https://rutube.ru/plst/955555 https://vkvideo.ru/playlist/-235081080_40 #MIDI | #Controller | #Raspberry | #MediaPipe | #OpenCV Original video: https://youtu.be/tJ2n_Egjhzk
OpenCV + MediaPipe caused big stir some 4 years ago, but never got around trying it myself. Until today and of course we're sharing results with you. This Open Source software can detect gestures, poses and facial expressions and transform them to so called landmarks that can easily be used for all kinds of shenanigans (in this example: controlling your synths). Timecodes: 00:00 - Introduction 00:38 - Demo 01: Playing Chords + Bass + Controlling Filters 01:32 - Hardware Needed 02:12 - Installation 02:56 - What are OpenCV & MediaPipe? 03:55 - This Example Explained: Reading Landmarks, Converting to MIDI 06:35 - Demo 02: Controlling Arpeggiator 07:37 - Demo 03: Controlling Filter Cutoff Frequency & Pitch Bend With Eyebrows 09:21 - Demo 04: Playing Pads on AKAI MPC Live III with Backing Track 10:10 - Conclusion Installation Instructions: sudo apt update sudo apt upgrade pip install mediapipe opencv-python --break-system-packages git clone https://github.com/mrfloydst/eyebrowraisingmidi then: python3 ./hand.py or: python3 ./eyebrow.py Innomaker USB 2.0 UVC Mini Camera: www.inno-maker.com/product-category/products/uvc-cameras/ Raspberry Pi Zero 2: www.raspberrypi.com/products/raspberry-pi-zero-2-w/ Playlists: https://rutube.ru/plst/955555 https://vkvideo.ru/playlist/-235081080_40 #MIDI | #Controller | #Raspberry | #MediaPipe | #OpenCV Original video: https://youtu.be/tJ2n_Egjhzk