Skip to main content

Projection Mapping System - Lumipen

Lumipen is the projection mapping system developed by the Ishikawa Oku Laboratory at the University of Tokyo. It can track moving objects and it keeps them in the center of the screen continuously. Also, this mechatronic camera system can project images onto a moving object.

Lumipen is a system based on the optical high-speed gaze controller - Saccade Mirror. Saccade Mirror is composed of two important parts:

  1. two galvanometer mirrors,
  2. pupil shift lenses.

 

The projector, camera and lenses are fixed. The pan/tilt mirrors are mounted on a rotational base with two-axis actuators and they control the camera's gaze optically. For millisecond-order control, the weight of the rotating parts must be reduced as much as possible.

Using a rotating mirror is a common method, but usually, the mirror is in front of the camera, so a very large mirror is needed. But a feature of this system is, it can even capture wide-angle images with a small mirror. That's because the system contains special optics called a pupil shift system.

This system does very fast image processing to recognize the subject. It captures and processes an image every 1/1000th of a second. General principle of operation is shown in the following videos.

Research papers:

Kohei Okumura, Hiromasa Oku, Masatoshi Ishikawa: High-speed Gaze Controller for Millisecond-order Pan/tilt Camera, 2011 IEEE International Conference on Robotics and Automation. Link.

Kohei Okumura, Hiromasa Oku, Masatoshi Ishikawa: Lumipen: Projection-based mixed reality for dynamic objects, 2012 IEEE International Conference on Multimedia and Expo. Link.

Comments

You might also like

    Popular posts

    What is Mechatronics?

    Mechatronics definition Mechatronics is a synergistic combination of precision engineering, electronic control and mechanic systems. It is the science, that exists at the interface among the other five disciplines: mechanics, electronics, informatics, automation, robotics. It is one of the most dynamically developing fields of technology and science. The word 'mechatronics' appeared for the first time in Japan in 1969. mechatronics = mecha nics + elec tronics + computing

    Intro to Mechatronics [e-book pdf]

    Intro to Mechatronics - lecture by Professor Vikram Kapila, New York University Mechatronics Defined Mechatronics: Working Definition for us Product Realization Paradigm Disciplinary Foundations of Mechatronics Multi-/Cross-/Inter-Disciplinary Sequential/Concurrent Product Realization Mechatronics-based Product Realization Mechatronic Design Process

    DIY Low Cost 6-Axis Desktop Robot

    Learning how to build a robot is a long way. It is the way by mechanics, electronics and programming. Such a mechatronics project is associated with problems such as stiffness (mechanics), overvoltage (electronics) or bug (software). Of course, if something is wrong, we always say 'it's not a bug, it's a feature', but finally a robot has to start working properly.

    Ascento - The Two-Wheeled Jumping Robot

    All-terrain capabilities are required to extend beyond flat surfaces the application range of wheeled robots. First think is four or six-legged robots which have been well known for years. Nowadays, thanks to more and more perfect gait algorithms, the two-legged (bipedal) robots appears more and more often. ETH Zürich students combine the advantages of wheeled robot and two-legged robot.

    How 6-Axis Industrial Robots Work

    6-axis industrial robots are commonly used in the manufacturing industry due to their flexibility, powerful programming software, payload capacities ranging from 5kg up to 1000kg and accuracy to 0.1mm or better. Here is a basic breakdown of how a standard 6-axis robot works. The way it rotates, how it is programmed, and the different types of tooling and grippers.

    How Automated Parking System Works

    An automated car parking system is a mechatronic system designed to transport and park cars automatically. The first semi-automated parking system was used in Paris, France in 1905 at the Garage Rue de Ponthieu (the car was transported to selected level using an internal elevator and the vehicle was parked by attendants). An automated storage and retrieval system for cars is a solution to cities' parking problems, such as the space wasting in a multi-story parking.

    Mechatronic Systems Applications [e-book pdf]

    Mechatronics is the synergistic blend of mechanics, electronics, and computer science. This book is concerned with applications of mechatronic systems in various fields, like robotics, medical and assistive technology, human-machine interaction, unmanned vehicles, manufacturing, and education.

    Smart Home Makes Your Life Easier

    Smart homes are also called intelligent, automated or autonomous houses. Nowadays, you can also automate the flats. Dynamic development of automation technology gives you opportunities that were only seen in sci-fi movies in the past. Soon, probably only your imagination will be the limit. What gives us the smart home system?

    Automatic Sorting of Skittles or M&Ms by Colour

    Do you sort M&Ms or Skittles by colour before eating them?  For example, eat all the yellow ones first, then the red ones, then the blue and so on. Brian Egenriether, an electrical engineer, decided to make a small machine that looked like an appliance, which could perform these tasks automatically. This mechatronics project took him about 5 weekends to make. The use of the machine is very simple: pour Skittles or M&Ms into it, push a button and have candies sorted. Let us look at the construction.