I think the above project’s code which I found here is very relevant to what I need to use myself with analogue input going from the aruino into processing… here the fulla is using an infrared sensor and LED to scramble the output on his screen… hmmmmm… gonna start testing this asap! 😀
Gamuza is a d3cod3 open source software project, based on/developed with openframeworks creative coding c++ framework, by Emanuele Mazza. It can be used under CC-GNU GPL license and is basically a bridge over c++ programming designed for developing purpose-independent interactive installation mainly based on video tracking techniques.
Many parts of the code comes from different people, sometimes modified depending on needs, and always commented into the code.
The basic idea of this project is to offer a specific tool designed for non-professional or absolute beginners programmers working on art/interaction/design field, and to provide an easy-to-use fast-approaching tool to cover computer vision interaction design teaching needs(otras).
This software is the practical part of a research project funded by Spanish Ministry of Science and Innovation [Ref: HAR2008-02169], about the space/technical characteristics of computer vision based artistic interactive installation of the last forty years. From the analysis of artist reference, and through the models recognized, this paths are the base of the idea(recorridos).
this is GAMUZA’s interface… I don’t know exactly what goes on here… but I must finish my processing code and simple light sensor switch testing before I even open it again!
hacking a regular web cam into an infra red cam looks TOO easy too…
reminds me of childhood 😀
ha ha wanting now to get my desktop clear of open web pages… here are some hacks for touch tables… I’m looking at touch tables for IR camera relevance… but I’ve just had the thought that my game concept could easily be used with a touch table interface? it could definitely coul cross over with the same objective to promote interparticipatory ludic experience… I think!
the above diagram comes from here and uses a regular webcam…
the above – on vimeo here – is from here and uses the FTIR screen. An FTIR (short for Frustrated Total Internal Reflection) setup involves three vital components: a sheet of transparent acrylic, a chain of infrared LEDs, and a camera with an IR filter. The LEDs are arranged around the outside of the sheet of acrylic so that they shine directly into the thin side surfaces. Once the IR light is inside the acrylic, it strikes the top and bottom surfaces of the acrylic at a near-parallel angle, and is subject to the effect known as total internal reflection.
this looks like SO much fun to make that I almost want to change my project just to make it!
another table following the smame design here…
Sociograma interactivo
Installation project to display the relationships that are established between individuals who share a common physical space. The participants are the nodes of a network, around which graphics are generated, representing the role and the links established between them. Via body movements, captured with an overhead camera, the users make choices or preferences between themselves. This data is processed and an image is projected upon the participants themselves as the events unfold. This is an interactive sociogram which is created and dynamically modified in real time.
unfortunately most links on this project are in spanish – which sucks as the setup – below is identical to mine >_<
I was kinda avoiding this direction with my project for no real reason really… I think it sounded too digital and slightly freaky? the idea of using light sensors seemed slightly more simple and kinda analogue? but it does look to be the best option at this stage… it has been hard to find direct routes into the online research of this field as used in interactive projects – as most motion tracking technology is being used in films and 3D animation… touch tables too…
Camera motion tacking is founded on video and computer vision. It has to have subroutines that define the characteristics in the array of pixels that comes from a camera. The camera captures the scene including the audiences and this data is input to the computer. This video data is organized as frames and are distinguished by a programming tool.
When creating motion tracking applications, that designer may apply the following methods: object tracking, frame differencing, background subtraction and brightness thresholding. These are basic detection methods and have been used in the examples that I mentioned in first section.
frame differencing
this method relies upon suitable consistent lighting conditions.
background subtraction
the background subtraction algorithm compares the frame with the presence of people or other object and a specific frame stored as a background. this algorithm needs to capture at a point in time when the scene was known to be empty first and then subtract it from each subsequent frame. if moving people or objects have the same color as the background, this algorithm cannot detect the motion.
in this method, the illumination of backlighting or surface treatments such as retroreflective surfaces is effective in ensuring the difference of the brightness values.
an infrared camera, which can detect infrared rays that is invisible to the human eye, can supplement the light detected by conventional black and white security cameras. it enables capturing the scene of a low light environment or even totally dark environment because ambient light level does not matter. this camera is useful for tracking the location of moving people, even in the darkness, however, it is not good at detecting the exact silhouette of objects because its resolution is considerably lower than an optical camera’s.
from Real-time Interactive Media Design with Camera Motion Tracking by Jieun Kwon and Yuncheol Baek
Directional Thermal Imaging Cameras – These sensors are mounted overhead and will maintain separate counts for multiple people in two directions simultaneously (in and out). They are best suited for entrances where multiple people are likely to enter and/or exit simultaneously when accuracy is important or where side mounting is not an option. They are not easily fooled since they respond to heat off the human body and can sense from distances of 8ft – 42ft. They are not affected by changes in ambient light nor can they be blocked by a person or thing standing in the sensing area.
Non-Directional Passive Infrared Sensors (Motion Sensors) – These sensors can be mounted on the front, side, or overhead to detect a person or thing passing through it’s sensing area. They are best suited for entrances where people are not likely to enter and/or exit simultaneously when accuracy is important. They detect heat emitted from objects passing through the sensing area. They will only count once for two or more people passing in front of or beneath the beam at the same time. These sensors are available in low voltage line powered or long lasting battery powered versions and can sense up to 50ft in narrow beam or 17ft in fan pattern modes.
PIR [passive infra red] sensors are an electronic device that measures infrared (IR) light radiating from objects in its field of view. PIR sensors are often used in the construction of PIR-based motion detectors. Apparent motion is detected when an infrared source with one temperature, such as a human, passes in front of an infrared source with another temperature, such as a wall. All objects emit what is known as black body radiation. It is usually infrared radiation that is invisible to the human eye but can be detected by electronic devices designed for such a purpose. The term passive in this instance means that the PIR device does not emit an infrared beam but merely passively accepts incoming infrared radiation. “Infra” meaning below our ability to detect it visually, and “Red” because this color represents the lowest energy level that our eyes can sense before it becomes invisible. Thus, infrared means below the energy level of the color red, and applies to many sources of invisible energy.
I was thinking of using PIR sensors next – as they seemed in my mind to be the simplest motion detector device… with a fresnel lense like the one below the range of detection can be quite big and I imagined being able to use the feedback from the sensor to activate information on an array in processing – where the floor space the sensor covered had a virtual grid determining human interaction back to the programmed array… ‘for many basic projects or products that need to detect when a person has left or entered the area, or has approached, PIR sensors are great. They are low power and low cost, pretty rugged, have a wide lens range, and are easy to interface with…’
code for PIR sensors and Arduino… more code…
PIR sensors are used extensively in smart housing…
the above diagrams are from an essay called ‘development of PIR sensor based indoor location-aware system using bayesian classifier’
rain
The installation started as a vision: “What a poetic/magical/eerie/weird/awesome feeling it would be to unfold an umbrella indoors, and hear the drumming of rain on it! You could bring that cozy, protected-personal-sphere feeling with you anywhere. It would also mess with your mind to think that you were outdoors, when you were indoors”
During the course of realizing the project, the idea changed from a portable rain-umbrella to an installation that let many people simultaneously experience the sounds and ambience of rain on umbrellas.
The hardest part of the project was to create a seamless experience for installation visitors. The motion sensor switches only stayed closed as long as something was moving, and when people stood still under the umbrellas, the sound stopped. We solved that problem by imposing a delay before the sounds stopped, even if the program received a “stop” signal from the sensor. We also made the sounds fade in and out rather than being turned on and off abruptly.
Another problem we had was that some sensors were tripped by the umbrellas dangling (they detected the relative motion of the floor). For the second iteration, we made this better by hanging each umbrella from two lines, thus stabilizing them.
This is an interactive book installed permanently into the Nobel Peace Center in Oslo, Norway. It tells the story of Alfred Nobel, inventor of dynamite and founder of the Nobel Prize Foundation. It is a blank, white book, and all the words and pictures are projected from above. Using RFID and InfraRed sensors the book knows what page it is on and where the reader is pointingor touching. Using this information the book projects the page-appropriate content and allows the reader to interact with the story elements.
I can’t seem to embed from vimeo… however… this was one of the first projects I found using arduino + PING))) Ultrasonic Range Sensors + flash… the PING))) Ultrasonic Range Sensors sense an object’s distance away from them… I am still curious as to how the sensors are what appears to be different buttons within flash through arduino… I didn’t think that this could be done? maybe I’m retarded and that’s not what’s happening at all 😛
this is totally awsome.
“HYPERSKY is an augmented reality window looking upwards, revealing the current natural conditions and manmade objects zooming through the airspace above the house”.
this last image is when it is raining heavily outside = win!
solid 
