EP 3539218 A1 20190918 - METHOD AND SYSTEM OF SIMILARITY-BASED DEDUPLICATION
Title (en)
METHOD AND SYSTEM OF SIMILARITY-BASED DEDUPLICATION
Title (de)
VERFAHREN UND SYSTEM ZUR ÄHNLICHKEITSBASIERTEN ENTDUPLIZIERUNG
Title (fr)
PROCÉDÉ ET SYSTÈME DE DÉDUPLICATION À BASE DE SIMILARITÉS
Publication
Application
Priority
RU 2016000888 W 20161215
Abstract (en)
[origin: WO2018111133A1] A method of similarity-based deduplication is disclosed, comprising the steps of: receiving an input data block; computing discrete wavelet transform, DWT, coefficients based on the input data block; extracting feature-related DWT data from the computed DWT coefficients; applying quantization to the extracted feature-related DWT data to obtain keys as results of the quantization; constructing a locality- sensitive fingerprint of the input data block based on the keys; computing a similarity degree between the locality-sensitive fingerprint of the input data block and a locality- sensitive fingerprint of each data block in the plurality of the data blocks in a cache memory; selecting an optimal reference data block as the data block which has the biggest similarity degree with the input data block among all data blocks in the cache memory; determining whether a differential compression is required to be applied based on the similarity degree between the input data block and the optimal reference data block; and if the differential compression is required, applying the differential compression to the input data block and the optimal reference data block. A similarity- based deduplication system is further provided.
IPC 8 full level
CPC (source: EP US)
G06F 3/0608 (2013.01 - EP US); G06F 3/0641 (2013.01 - EP US); G06F 3/0673 (2013.01 - EP); G06F 12/0895 (2013.01 - EP); G06F 17/148 (2013.01 - US); G06F 18/21347 (2023.01 - US); H03M 7/3091 (2013.01 - EP US); G06F 3/0673 (2013.01 - US); G06F 16/152 (2018.12 - US); G06F 16/1748 (2018.12 - US); G06F 2212/401 (2013.01 - EP)
Citation (search report)
See references of WO 2018111133A1
Designated contracting state (EPC)
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
Designated extension state (EPC)
BA ME
DOCDB simple family (publication)
WO 2018111133 A1 20180621; CN 109716658 A 20190503; CN 109716658 B 20210820; EP 3539218 A1 20190918; EP 3539218 B1 20210407; US 11514666 B2 20221129; US 2019294589 A1 20190926
DOCDB simple family (application)
RU 2016000888 W 20161215; CN 201680087037 A 20161215; EP 16838094 A 20161215; US 201916442102 A 20190614