OCTOBER 2010: A car game is projected on a wall remote-controlled by human movement. The car runs faster and smoother on collecting ‘Castrol’ fuel packs. Whether you are a gaming freak or not, nearly every passerby would give the game a shot, with many even taking multiple attempts to collect more oil packs to finish first.
At the launch of their new product range, Castrol used this fun and interactive medium, called TouchMagix, to draw and engage crowds of all ages with their brand. TouchMagix, developed by Pune-based startup TouchMagix, makes any projection surface, be it a wall or floor, or even an LCD screen, react to your body gestures or touch.
TouchMagix hardware comprises a high-end PC, a projector and its proprietary TouchMagix sensor. The sensor feeds signals to the PC software, which recognises human gestures/touch and generates an XML feed on loopback interface.
TouchMagix is available in two versions: MotionMagix and MagixTouch. MotionMagix is a gesture-sensing product that recognises free space movements, like the movement of a hand, and converts the hand location/movement into coordinates for the application to use and perform the action as per instructions. It has two sub-categories called MagixFloor and MagixWall.
MagixTouch, on the other hand, creates multiple touch-interactive displays using optical touch technology.
“Our TouchMagix will help brand owners create a long-lasting impression in the consumers’ mind. We have successfully reached over 20 countries with our product, replacing numerous traditional and modern advertising/branding technologies. Today, we have 20 direct distributors globally, with three in India (Mumbai, Ahmedabad and Bengaluru),” says Anup Tapadia, founder, TouchMagix.
What’s the tech magic?
But what is so unique in the technology powering TouchMagix that makes it change the way brands communicate with end customer? The accuracy, ability to distinguish between different parts of the human body, content development suite, analytics and cost make TouchMagix a cut above the rest. An R&D team of 20 people—electronics, graphics and content, and software development professionals—put in three years of extensive R&D to develop TouchMagix.
High accuracy results in seamless user experience. TouchMagix uses a combination of hardware and software to take the user experience to greater heights. The MotionMagix product uses a specialised high-speed camera kit, which uses a combination of infrared spectrum and visible light to track movement at a high speed. Thereafter, the software written on top of the hardware performs background subtraction; elimination and detection that helps the system differentiate between the projection in motion and the real person movement. This makes the product highly accurate giving a good user experience.
“Our hardware, with MagixSense sensors as the main ingredient, coupled with software, has helped us achieve high precisions. The sensor technology provides high-quality multi-point gesture recognition. Customers can link up to four projectors and four sensors on one computer, creating larger projection areas with a single licence and application,” says Tapadia.
The MagixTouch product too has elevated the multi-touch user experience to another level. “It creates multitouch interaction displays ranging from 81.3 cm (32 inches) to 3.8 metres (150 inches). Instead of using the same camera chips for touch sensing, we chose optical touch technology that could first turn any surface, be it an LCD or projected surface, into a multi-touch system by just mounting a glass on the surface. Further, the multi-touch technology allowed us to do 40-point simultaneous touch detection on a surface. These touches are tracked at 50 frames per second rate. This provides a brilliant user experience,” says Tapadia.
Ability to distinguish between parts of the human body. Further, TouchMagix has intelligence embedded into it that allows it to distinguish between movements by different parts of the body. “Unlike competing products, TouchMagix doesn’t detect the full body as a single interactive zone. Intelligence has been embedded that helps the sensor distinguish between the hand, feet, body and head. Our hardware detects better images at a fast speed. Based on that, we use different classification algorithms that allow us to categorise different parts of the body and build skeleton structures for mapping and tracking body parts. This helps the sensor recognise the hand, body, head and feet in separate frames and provide the information to the developers, who, in turn, can develop applications around the movement of different body parts too,” explains Tapadia.
Suitable for any commercial environment. Installing and running such interactive systems could face challenges like changing light conditions and irregular surfaces in a commercial environment. Has TouchMagix been able to overcome them?
“Yes, we have. Taking this project from our labs to the commercial grid environment involved challenges regarding robustness, lighting, etc. Our automated algorithms for background sensing, rebuilding of backgrounds and adapting to the changing light conditions provide the robustness needed for a commercial environment. Further, our sensor elimination system tackles the ambient light problem and automatically changes according to the ambient light. The three installations in the Mumbai airport that are used as 24/7 advertising media by multiple agencies speak of our success in overcoming such issues,” says Tapadia. They also couple with third-party software vendors for geometric corrections to achieve seamless user experience even on irregular surfaces.