Interactive Voices





This two-part project is called Interactive Voices - it is an exploration of the meaningful integration of sound, movement and interactivity. The student will create an work of generative art combining audio, motion and interactivity.

This project will utilize skills covered in Lectures 4 and 5, and Exercise 4 (Hour of Code, In-Class Demos, and review of sketch examples of former students).



Theme: The content of the project is entirely at your discretion, and the audio and visual elements may be objective or non-objective. Sound sources may be found online, sampled from audio CDs, or recorded by you. Visual elements may be taken from parts of paintings or other images, or may be created from scratch. What is most important is that the sounds interact meaningfully with the appearance and movement of the visual objects.

Avoid using simple narrative. Do not approach the project as a music video or cartoon. Rather than telling a story, try to create an abstract experience. Think of this as poetry, rather than prose.

Part 1 Sound Design: Create sound samples. Explore how texture, rhythm, pitch and volume can be manipulated to evoke responses from the listener.

Use and explore the non-melodious qualities of sound (pitch, rhythm, tempo, amplitude, texture, tonality) to create harmony, dissonance or cacophony. Do not use any unmodified recorded music.

Part 2 Processing: Once the sound design is complete, create an interactive animated interface in response to your sound art, within which the sound will be presented. Color, texture, compositional elements, line, and motion should relate thematically to the sounds they accompany.

The work will involve a performative component. Over time and with interactive input, composition, rhythm, speed, repetition, scale, rotation, position, color, opacity, balance, and perspective can be changed so that objects move and evolve as the sounds are triggered.



  • Proposal Consultation: discuss your theme and an outline of your ideas.
  • Sound Design Critique: present your audio work in progress.
  • Processing Critique: present your interface work in progress, with sound and enough animation/interactivity to get your message across.
  • Final Submission: Upload your files to CourseWork. Include an artist’s statement with proper credits listing the title of the piece, if any, and the origins of any appropriated source material.




  • Sound may play as an ambient accompaniment (non-diegetic, or background) to the movement on screen.
  • Sound may appear to be generated by the objects on screen, or as a result of user interaction (diegetic).
  • At least three (3) separate sound files must be created, and each of these sound files must contain at least 2 different sources of audio.
  • At least one of your tracks that you generate must be a stereo file (with different L/R channels, at least to some degree).
  • Sounds may be recorded by you or found online (at least one segment must be recorded).
  • All sounds must be manipulated so that they have enough difference than the original. One easy way around this is to use multiple sound elements from different sources (layered). This also ends up being more satisfying.
  • You MUST create a separate folder in your project file that contains all of your original sound clips.
  • All audio content MUST must be keep track of using a text file. This is to prove you are not plagiarizing. (Using the program TextEdit on a Mac is just fine as it is quick to open.)
  • You should not be exporting any tracks from audacity with audio that is peaking (Red indicator), even if the source audio was peaking originally.


  • Your project folder MUST be titled as “First_Last_Title” and sketch MUST be named “First_Last_Title.pde”
  • Must include vector objects generated within Processing.
  • May also include raster images.
  • Objects may appear at rest, but must, at some point move within or out of the frame.
  • Objects must undergo a translation through time—a change in color, size, shape, or any combination of these.
  • Objects and or sound must be made to change at some point based on input from mouse or keyboard.
  • Objects and their movement must relate meaningfully to the audio.
  • Code must be commented. Begin each sketch with a comment that explains your intentions, and how to interact, if necessary.
  • You may “borrow” code from other sources to supplement your own code (unless copyright or other notices prohibit it.) Borrowed code may not be used for your entire sketch – the majority of the work must be your own. Any code borrowed from other sources MUST be credited within the comments. You must also fully understand and explain what the code is doing, and how to alter it to your own unique usage.
  • Scenes may be used, jumping from one frame to another, allowing different effects or styles to happen all within one sketch.



This project will be graded on (in order of importance):

• creative and effective approach to your subject matter
• demonstration of technical proficiency with Audacity/Processing and its procedures
• fulfillment of project requirements (each project detailed above)
• involvement in group critique
• oral presentation of solution
• overall completion of both projects (individually and unified)
• punctuality

Note: I do not have a formal breakdown of the projects. Grading of both the audio and processing projects happens after class ends. If you are overly concerned, please see me.