A/V Synth Controlled by Gamepad

Posted October 20, 2006 // Tagged as Quartz Composer, Software // 12 Comments ↓

Here’s something I’ve been working on for the last couple of days – an A/V synth controlled via a Logitech gamepad, generating video through Quartz Composer and audio through Ableton Live.

This is just the first step – a proof of concept. Now I’m going to flesh it out and assign many more variables to the onscreen graphics (right now I am only controlling two variables). One idea I have had is to use 4 cheap joysticks to control the lights, which would allow for a nicer feel. Also, a full keyboard would work nicely – perhaps I could stick to 4 lights, and simply choose which light to play based on whether the user is going up or down in pitch, and by how much.

Technical Bits:
I use Junxion to do two things to the HID signals coming from the Gamepad. First, I convert all buttons and thumbstick axes into MIDI CC controllers so that Quartz Composer can use them. I also convert the 4 button inputs to specific MIDI notes that will be read by Ableton Live. In this way, a single button press on the controller registers a CC controller and a MIDI note on/off through the same virtual port, read by two different programs.
Let me know your thoughts!

d2cacd2016154da32e363e75d7728cb8->

a8814f8eabd39c7b847af2e765dffd02->

12 Responses

  1. [...] A/V Synth Controlled by Gamepad [The Lava Flow] [...]

  2. Drunkoala

    November 14th, 2006 at 5:25 am

    Wow! That’s amazing!! Is this possible to be done in a Windows enviroment?
    I would like to know if you can send me some pages to research about this.

    thanks!
    John

  3. Momo the Monster

    November 14th, 2006 at 6:13 pm

    Thanks! As far as I know, there is not currently a straight analogue to Quartz Composer in Windows. You could try building something in Salvation, Processing or Max/MSP.

  4. atish

    December 18th, 2006 at 11:34 pm

    I’ve been trying to do some MIDI/visualizations in quartz composer, but it doesn’t always pick up my midi signals (i think the drum hits may be too quick), have you dealt with this at all?

  5. David Friedman

    February 24th, 2007 at 10:19 am

    Awesome site.
    Disney Orb stuff is magic.
    Do you know about upcoming SIGGRAPH VJ event?

    Please confirm if you get this… I want to forward you some info (etc) on “The Photon Ballet” coming March 13. Do you already know of this?
    David

  6. canadian

    February 26th, 2007 at 7:50 pm

    You are doing a wonderful thing here on the Internet. I wish you the very best. Kindest regards.

  7. Cyzh01

    February 27th, 2007 at 7:31 pm

    Great work… here in Mexico City at National Center of Arts we are working on this kind of meta-instruments and I would like to keep in touch with you. Besides that, can you explain about your Live “song” or better, can you post your patch?
    Best regards,

    a.i.

  8. [...] This system builds upon the work I started here: A/V Synth Controlled by Game Pad, and the graphics were inspired by the Interface Design of Battlestar Galactica. Watch the video above and come back for Nitty-Gritty technical details. [...]

Leave a Reply