Skip to main content

Projection Mapping System - Lumipen

Lumipen is the projection mapping system developed by the Ishikawa Oku Laboratory at the University of Tokyo. It can track moving objects and it keeps them in the center of the screen continuously. Also, this mechatronic camera system can project images onto a moving object.

Lumipen is a system based on the optical high-speed gaze controller - Saccade Mirror. Saccade Mirror is composed of two important parts:

  1. two galvanometer mirrors,
  2. pupil shift lenses.

 

The projector, camera and lenses are fixed. The pan/tilt mirrors are mounted on a rotational base with two-axis actuators and they control the camera's gaze optically. For millisecond-order control, the weight of the rotating parts must be reduced as much as possible.

Using a rotating mirror is a common method, but usually, the mirror is in front of the camera, so a very large mirror is needed. But a feature of this system is, it can even capture wide-angle images with a small mirror. That's because the system contains special optics called a pupil shift system.

This system does very fast image processing to recognize the subject. It captures and processes an image every 1/1000th of a second. General principle of operation is shown in the following videos.

Research papers:

Kohei Okumura, Hiromasa Oku, Masatoshi Ishikawa: High-speed Gaze Controller for Millisecond-order Pan/tilt Camera, 2011 IEEE International Conference on Robotics and Automation. Link.

Kohei Okumura, Hiromasa Oku, Masatoshi Ishikawa: Lumipen: Projection-based mixed reality for dynamic objects, 2012 IEEE International Conference on Multimedia and Expo. Link.

Comments

You might also like

    Popular posts

    What is Mechatronics?

    Mechatronics definition Mechatronics is a synergistic combination of precision engineering, electronic control and mechanic systems. It is the science, that exists at the interface among the other five disciplines: mechanics, electronics, informatics, automation, robotics. It is one of the most dynamically developing fields of technology and science. The word 'mechatronics' appeared for the first time in Japan in 1969. mechatronics = mecha nics + elec tronics + computing

    Ascento - The Two-Wheeled Jumping Robot

    All-terrain capabilities are required to extend beyond flat surfaces the application range of wheeled robots. First think is four or six-legged robots which have been well known for years. Nowadays, thanks to more and more perfect gait algorithms, the two-legged (bipedal) robots appears more and more often. ETH Zürich students combine the advantages of wheeled robot and two-legged robot.

    Automatic Sorting of Skittles or M&Ms by Colour

    Do you sort M&Ms or Skittles by colour before eating them?  For example, eat all the yellow ones first, then the red ones, then the blue and so on. Brian Egenriether, an electrical engineer, decided to make a small machine that looked like an appliance, which could perform these tasks automatically. This mechatronics project took him about 5 weekends to make. The use of the machine is very simple: pour Skittles or M&Ms into it, push a button and have candies sorted. Let us look at the construction.

    Mechatronics System as the Future of Cooking at Home

    Do you get up in the morning and don't feel like making breakfast? One of the solutions is food delivery service, which leaves your takeout order outside of your front door. Other solution is a private chef who is responsible for shopping for food, menu planning, preparing and cooking meals for you. But if you love mechatronics systems, your solution is a mechatronic kitchen. It allows you to save time, free up your day from routine cooking, plan and adapt your menu according to different diets and lifestyles.

    Three Wheels Balancing Robot

    The three wheels balancing robot is similar to a ballbot from the point of view of the goal. In comparison to ballbot which balance itself on a single ball, three wheels balancing robot is designed to balance itself on a single rod. The common characteristics of this kind of robots is that there’s one sole contact point to the ground.

    Stretch - Boston Dynamics Unveils New Robot for Warehouse Automation

    Boston Dynamics is the global leader in mobile robotics. Their popular robots are SpotMini, Spot, Atlas and Handle. Now they has revealed 'Stretch', which is a new box-moving robot designed to support the growing demand for flexible automation solutions in the logistics industry. A Massachusetts company well known for its humanoid robots and dog-like androids is preparing to muscle its way into the warehouse automation industry with its latest mechatronic solution. Warehouse automation is a fast-growing market fueled by increased demand in e-commerce. The robot called Stretch is Boston Dynamics’ first commercial robot specifically designed for warehouse facilities and distribution centers. Robert Playter, CEO of Boston Dynamics said: Warehouses are struggling to meet rapidly increasing demand as the world relies more on just-in-time delivery of goods. Mobile robots enable the flexible movement of materials and improve working conditions for employees. Stretch

    DIY Low Cost 6-Axis Desktop Robot

    Learning how to build a robot is a long way. It is the way by mechanics, electronics and programming. Such a mechatronics project is associated with problems such as stiffness (mechanics), overvoltage (electronics) or bug (software). Of course, if something is wrong, we always say 'it's not a bug, it's a feature', but finally a robot has to start working properly.