Clickable Reality is an interface for rendering the world clickable.
I developed an iOS app that uses image recognition to identify different networked devices. The user points her mobile app with camera view towards the device of choice—lamps, speakers, etc. Once recognized, the user simply taps on the image of the device on their touch screen to alter its state. The app unifies control of multiple devices into a single gesture.
I was fascinated by the idea that the information already embedded in our environment could be decoded to create a new communication protocol. For my prototype, I embedded patterns on my devices that were more readily identifiable by the computer vision algorithm used in my app. I am working to implement edge detection to recognize objects using their spatial dimensions to make this prototype more robust.
Role: Concept, Design, Programming, Fabrication.