How I Turned QR-Coded Chips Into a Multi-Track Musical Instrument on iOS Without Core ML
My phone is lying face-up on a flat board. The board has a small transparent window cut into it. I slide a plastic chip underneath the window. A drum loop starts playing. I slide another chip in. A bass line joins. I pull one out and the drum track fades away over the next second.
That is the whole idea. Physical objects on a table become tracks in a mixer. No buttons, no touchscreen, no MIDI controller. Just chips with QR codes and a phone looking at them through a hole.
Each chip is a regular QR code containing a two-digit number, 01 through 24. That number maps to a track in a 24-channel audio mixer running inside the app. The camera scans the chips, the app fades the corresponding loops in and out. No Core ML. No neural network. The entire recognition pipeline is a single AVFoundation class that...
Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE
