(19)
(11) EP 2 015 227 A3

(12) EUROPEAN PATENT APPLICATION

(88) Date of publication A3:
01.06.2011 Bulletin 2011/22

(43) Date of publication A2:
14.01.2009 Bulletin 2009/03

(21) Application number: 08252377.0

(22) Date of filing: 11.07.2008
(51) International Patent Classification (IPC): 
G06K 9/22(2006.01)
G06F 3/048(2006.01)
(84) Designated Contracting States:
AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR
Designated Extension States:
AL BA MK RS

(30) Priority: 11.07.2007 US 827530

(71) Applicant: Ricoh Company, Ltd.
Tokyo 143-8555 (JP)

(72) Inventors:
  • Ke, Qifa
    Menlo Park, CA 94025-7054 (US)
  • Hart, Peter E.
    Menlo Park, CA 94025-7054 (US)
  • Hull, Jonathan, Jr.
    Menlo Park, CA 94025-7054 (US)
  • Kishi, Hidenobu c/o Ricoh Innovations, Inc.
    Menlo Park, CA 94024-7054 (US)

(74) Representative: Mounteney, Simon James 
Marks & Clerk LLP 90 Long Acre
London WC2E 9RA
London WC2E 9RA (GB)

   


(54) User interface for three-dimensional navigation


(57) The present invention uses invisible junctions which are a set of local features unique to every page of the electronic document to match the captured image to a part of an electronic document. The present invention includes: an image capture device, a feature extraction and recognition system and database. When an electronic document is printed, the feature extraction and recognition system captures an image of the document page. The features in the captured image are then extracted, indexed and stored in the database. Given a query image, usually a small patch of some document page captured by a low resolution image capture device, the features in the query image are extracted and compared against those stored in the database to identify the query image. The present invention also includes methods for recognizing and tracking the viewing region and look at point corresponding to the input query image. This information is combined with a rendering of the original input document to generate a new graphical user interface to the user. This user interface can be displayed on a conventional browser or even on the display of an image capture device.







Search report