Global Patent Index - EP 3340166 A1

EP 3340166 A1 20180627 - COMPLETING AN IMAGE

Title (en)

COMPLETING AN IMAGE

Title (de)

VERVOLLSTÄNDIGUNG EINES BILDES

Title (fr)

COMPLÉTION D'UNE IMAGE

Publication

EP 3340166 A1 20180627 (EN)

Application

EP 16306754 A 20161221

Priority

EP 16306754 A 20161221

Abstract (en)

The invention notably relates to a computer-implemented method for completing an image having at least one hole, the method comprising providing (S10) a dictionary of atoms representative of the known part of the image; determining (S20) an optimal distribution of atom linear combinations with a process comprising at least one minimization (S22-S28) of a respective energy defined on a respective Markov Random Field having nodes and labels, each node corresponding to a respective location of the hole and being associated to a respective label; and filling (S30) the hole with the optimal distribution. The invention improves the field of image completion.

IPC 8 full level

G06T 5/00 (2006.01); G06T 5/50 (2006.01)

CPC (source: CN EP US)

G06F 18/23213 (2023.01 - US); G06T 5/30 (2013.01 - CN); G06T 5/50 (2013.01 - EP US); G06T 5/77 (2024.01 - CN EP US); G06T 2207/10016 (2013.01 - EP US); G06T 2207/20016 (2013.01 - EP US); G06T 2207/20072 (2013.01 - US)

Citation (applicant)

  • BERTALMIO, MARCELO; ANDREA L. BERTOZZI; GUILLERMO SAPIRO: "Navierstokes, fluid dynamics, and image and video inpainting", CVPR, 2001
  • CHAN, TONY F.; JIANHONG SHEN: "Nontexture inpainting by curvaturedriven diffusions", JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2001
  • AUROUX, DIDIER; MOHAMED MASMOUDI.: "A one-shot inpainting algorithm based on the topological asymptotic analysis.", COMPUTATIONAL & APPLIED MATHEMATICS, 2006
  • PIETRO PERONA; JITENDRA MALIK: "Scale-space and edge detection using anisotropic diffusion", IEEE TRANS., 1990
  • IVARS PETERSON: "Filling in blanks: Automating the restoration of a picture's missing pieces", SCIENCE NEWS, 2002
  • PORTILLA, JAVIER; EERO P. SIMONCELLI.: "A parametric texture model based on joint statistics of complex wavelet coefficients.", IJCV, 2000
  • HEEGER, DAVID J.; JAMES R. BERGEN.: "Pyramid-based texture analysis/synthesis", SIGGRAPH, 1995
  • LI-YI WEI; MARC LEVOY.: "Fast texture synthesis using tree-structured vector quantization.", SIGGRAPH, 2000, pages 479 - 488
  • CRIMINISI; PEREZ; TOYAMA: "Region filling and object removal by exemplar-based image inpainting", IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004
  • XIAOWU CHEN; BIN ZHOU; FANG XU; QINPING ZHAO, AUTOMATIC IMAGE COMPLETION WITH STRUCTURE PROPAGATION AND TEXTURE SYNTHESIS, 2010
  • DRORI, IDDO; DANIEL COHEN-OR; HEZY YESHURUN: "Fragment-based image completion", ACM TRANSACTIONS ON GRAPHICS, 2003
  • ALEXEI A. EFROS; THOMAS K. LEUNG: "Texture synthesis by non-parametric sampling.", ICCV, 1999, pages 1033 - 1038
  • YONATAN WEXLER; ELI SHECHTMAN; MICHAL IRANI: "Space-time video completion", CVPR, 2004, pages 120 - 127
  • KAIMING HE; JIAN SUN: "Computing nearest-neighbor fields via propagation-assisted kd-trees", IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION., 2012
  • KAIMING HE; JIAN SUN: "Statistics of patch offsets for image completion", COMPUTER VISION - ECCV, 2012
  • CONNELLY BARNES; ELI SHECHTMAN; ADAM FINKELSTEIN; DAN B. GOLDMAN: "Patch-match: a randomized correspondence algorithm for structural image editing.", ACM TRANS. GRAPH., vol. 28, no. 3, 2009
  • ELAD M; AHARON M.: "K-svd: An algorithm for designing overcomplete dictionaries for sparse representation", IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006
  • RODOLPHE JENATTON; JULIEN MAIRAL; GUILLAUME OBOZINSKI; FRANCIS BACH: "Proximal methods for hierarchical sparse coding", JOURNAL OF MACHINE LEARNING RESEARCH., 2011
  • A.CUTLER; L.BREIMAN.: "Archetypal analysis", TECHNOMETRICS, vol. 36, no. 4, 1994, pages 338 - 347
  • KOLMOGOROV, V.: "Pattern Analysis and Machine Intelligence", 2006, IEEE, article "Convergent tree-reweighted message passing for energy minimization"
  • J. KAPPES ET AL.: "A Comparative Study of Modern Inference Techniques for Discrete Minimization Problems", CVPR, 2013
  • ELAD M; AHARON M., K-SVD: AN ALGORITHM FOR DESIGNING OVERCOMPLETE DICTIONARIES FOR SPARSE REPRESENTATION, 2006
  • RODOLPHE JENATTON; JULIEN MAIRAL; GUILLAUME OBOZINSKI; FRANCIS BACH, PROXIMAL METHODS FOR HIERARCHICAL SPARSE CODING. JOURNAL OF MACHINE LEARNING RESEARCH, 2011
  • MAIRAL JULIEN; FRANCIS BACH; JEAN PONCE, SPARSE MODELING FOR IMAGE AND VISION PROCESSING, 2014

Citation (search report)

  • [XAI] KOMODAKIS N ET AL: "Image Completion Using Efficient Belief Propagation Via Priority Scheduling and Dynamic Pruning", IEEE TRANSACTIONS ON IMAGE PROCESSING, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 16, no. 11, 1 November 2007 (2007-11-01), pages 2649 - 2661, XP011193294, ISSN: 1057-7149, DOI: 10.1109/TIP.2007.906269
  • [XI] RUZIC TIJANA ET AL: "Context-Aware Patch-Based Image Inpainting Using Markov Random Field Modeling", IEEE TRANSACTIONS ON IMAGE PROCESSING, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 24, no. 1, 1 January 2015 (2015-01-01), pages 444 - 456, XP011569003, ISSN: 1057-7149, [retrieved on 20141223], DOI: 10.1109/TIP.2014.2372479

Designated contracting state (EPC)

AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

Designated extension state (EPC)

BA ME

DOCDB simple family (publication)

EP 3340166 A1 20180627; CN 108230268 A 20180629; CN 108230268 B 20230718; JP 2018129036 A 20180816; JP 7029283 B2 20220303; US 10621705 B2 20200414; US 2018174276 A1 20180621

DOCDB simple family (application)

EP 16306754 A 20161221; CN 201711391028 A 20171221; JP 2017237566 A 20171212; US 201715841837 A 20171214