Share on LinkedInShare on LinkedIn

ARTICLE · 26 MAY 2020

Advanced Deduplication, Twins Beyond Fingerprints

Technology is used to support investigations and review projects in many ways, including saving time and money through data reduction.

SwitzerlandLaw Department Performance

Introduction

Technology is used to support investigations and review projects in many ways, including saving time and money through data reduction. While basic duplicate removal through hash value comparison is well accepted, it has limitations that powerful tools and creative workflows can overcome. Here is an overview of some of those techniques.

Data reduction relevance

Before debating the pros and cons of the various data reduction approaches, let's first consider why we are doing this. A larger volume of data requires more storage, more powerful hardware, more data preparation time, and more review time, with the risk of missing relevant information because it is obscured by background noise. Time is money, and therefore more data has a double impact for costs in terms of hardware and both personnel and machine processing time.

We operate a free-to-view policy, asking only that you register in order to read all of our content. Please login or register to view the rest of this article.

See more popular content from