MPM307 – Art Apps for Inter Spaces

Group Members: Simone Roth , Kelly Truong, Jeffrey Leung

For this project, we couldn’t decide on an idea so we decided to fuse aspects of each of our proof of concepts together. Hats from mine, falling snow from Simone’s, and split screen from Kelly’s. Since we are not experts with processing and its integration with kinect motion detection, we didn’t want to do something that was too hard for us to handle.

^Please watch in 720p HD

Thus, we created a fun interactive piece that places a hat on the subject’s head. We added a feature where every time the subject claps his / her hands, the hat changes randomly. With 14 different hats stored, the subject can browse through them and do funny poses accordingly.


Our code uses OpenNI and Kinect to detect the subject’s head and body. We used arrays to organized and displays the hats. If statements were used to determine what happens when the subject claps his or her hands together. Also, we used if statements to determine when the subject is on the left or right side of the screen to activate the snowfall. We made it so the snowflakes fall at a random speed and location so it is more realistic. Sometimes the subject’s skeleton when calibrated is a bit off to the side, and sometimes it’s spot on. We don’t know why there is such inconsistency with the outcome, but we tried to adjust the positioning of the hat accordingly so it will somewhat fit properly on the subject’s head.


We had the idea to do only do winter themed hats which will go well with snowflakes falling, but we found that there are very limited amount of winter-hats. Since we already created the code for the falling snowflakes, we wanted to keep it but only activate the snow when the subject is on one side of the screen.

DSCF144123 We wanted to do something that is commercial, and that will appeal to the masses. We want our idea to be something you can see at a local store or mall, not specifically at an art gallery. At a grander scale, we would hope to have more than 50 different hats, and have alignment flawlessly executed every time.


We had a lot of fun creating this and will most definitely explore into Kinect in Processing for future projects.


The object that I will be projecting on is my family’s white Mercedes Benz. I want my piece to showcase the evolution of transportation throughout history. I plan to create a hand drawn animation of a boy travelling along the different
lines and crevasses that define the shape of the car. The method of transport evolves as the boy continues his long journey around the car. Starting with the earliest forms of conveyance like crawling and walking and gradually building towards technological creations that helped mobilize our race like bicycles and trains. The different aspects of the car will represent different terrains and obstacles the boy will face. For example, the shape of the wheel is a big hill which he must climb; and the windows represent water he must pass. The animation will close with the boy reaching the final destination at the Mercedes Benz logo at the very front, ending as the actual car starts and the lights lit up. This idea was inspired by my life as a commuter living uptown studying downtown and the number of different methods of travel I have experienced in the past years. This piece will be video documented and shown in class. The image is just a rough sketch and is subject to change upon more research and brainstorming.

Since I am new to processing and is not at the comfortable level to swim in deep waters, I decided to not do anything too complicated I can not handle. I knew I wanted to film the footage straight on, so I didn’t have much opportunity to play around skewing the proportions of a video to fit a certain space. However, surface mapping really helped me with adjusting the size of the videos to fit with the background of each scene.