One of many greatest challenges confronted by corporations who work with giant quantities of information is that their databases might find yourself with a number of cases of duplicate information, resulting in an inaccurate total image of their prospects.
Based on Tim Sidor, knowledge high quality analyst at Melissa, there are a selection of the explanation why duplicate information might find yourself in a database. They are often added unintentionally through the knowledge entry course of when knowledge is entered throughout a number of transactions in several methods. Modifications in how names are formatted, abbreviations of firm names, or unstandardized addresses are widespread methods these points could make their manner right into a database, he defined throughout an SD Instances microwebinar in October.
This turns into an issue if the database is merged with one other supply as a result of most database programs solely present fundamental string-matching choices and won’t catch these refined variations.
One other manner that these issues enter a database is that the database software program itself provides each transaction as a brand new distinct document. There’s additionally the prospect {that a} gross sales consultant is deliberately altering contact data when getting into it in order that it seems like they’ve entered a brand-new contact.
Regardless of how duplicate information find yourself in a database, it “ends in an inaccurate view of the client” as a result of there will likely be a number of representations of a single contact, defined Sidor. Due to this fact, it’s vital that corporations have processes and programs in place to cope with these errors.
One beneficial option to cope with that is by creating what is known as a “Golden File,” which is the “most correct, full illustration of that entity,” mentioned Sidor. This may be achieved by linking associated gadgets and selecting one to behave because the Golden File. As soon as established, duplicates which were used to replace the Golden File will be deleted from the database.
That is arrange by first figuring out what constitutes an identical document, which Sidor defined in higher element in the microwebinar on Oct. 26. That episode targeted extra on matching methods. As soon as the foundations are established, an organization can go in and determine matches and decide which document ought to be chosen because the Golden File. That call relies on metrics equivalent to a Greatest Knowledge High quality rating – derived from the verification ranges of the information factors, most just lately up to date, the least lacking knowledge parts, or different customized strategies.
“The top aim right here is to get the very best values in each area or knowledge kind and have probably the most correct document, possibly retain the information or discard outdated or undesirable knowledge, to create a single, correct grasp database document,” Sidor mentioned within the microwebinar.
And as soon as the present state of the database is addressed, there’s additionally a necessity to stop new duplicates from getting into the system sooner or later. Sidor recommends having some extent of entry process that makes use of that very same matching criterion.
Melissa might help corporations cope with this challenge by means of its MatchUp resolution, which automates the method of linking information and deduplicating the database.