Скачать или смотреть Interactive Media Performance (MUS 448) Final

Using the software Max MSP, I was able to create a “patch” in which the main video's brightness and volume affect what happens to the outbound audio.

I'm able to change the brightness of the video using an app called "Syntien" on my iPad. By connecting my iPad to a school computer using WiFi, I was able to use my iPad as a slider. Due to the width of my iPad, I'm given an average brightness range of 105 to 255 units. I then scaled the average brightness into a frequency range of (20, 2,000 hZ). By converting brightness into a frequency range, I can then send the output numbers into a bandpass filter which controls the frequencies that are heard. As the average brightness of the video changes, so does the range of frequencies being heard. This audio parameter can be heard in your right ear (if wearing headphones).

By capturing the maximum (peak) amplitude of the video every 125 milliseconds, the volume becomes an integer that controls the parameters of an external plug-in. On a scale of 0 to 1, that "peak amplitude" integer is scaled into two different functions of Logic's DAW "Decapitator" plug-in, "Tone" and "Punish", scaling it to (-2., 2.), and (0., 1.) respectively. The decimals allow for non-whole numbers to be let through, and produced into your left ear (if wearing headphones).