--- title: Announcing the Deduplication Model description: We’ve noticed that data from aggregators including Plaid and MX return duplicate transactions across multiple accounts for a user. These erroneous transactions result in incorrect insights, features, and scores. As a result, we updated our model to remove duplicate transactions while computing insights to correct these duplicate errors.   Why this matters We found that […] image: https://hs.pavefi.com/hubfs/Imported_Blog_Media/Models-Attributes-Medium-Oct-17-2024-09-29-56-4774-PM.png --- [Skip to content](https://hs.pavefi.com/pave-blog/blog/announcing-the-deduplication-model#main-content) Pave Financial, Inc. Open main navigation Close main navigation - [Contact us](https://hs.pavefi.com/pave-blog/blog/announcing-the-deduplication-model#contact) [Contact us](https://hs.pavefi.com/pave-blog/blog/announcing-the-deduplication-model#contact) Jan 17, 2023 3:22:10 AM # Announcing the Deduplication Model [Admin](https://hs.pavefi.com/pave-blog/author/admin) Share: [facebook-f icon](http://www.facebook.com/share.php?u=https://hs.pavefi.com/pave-blog/blog/announcing-the-deduplication-model) [linkedin-in icon](http://www.linkedin.com/shareArticle?mini=true&url=https://hs.pavefi.com/pave-blog/blog/announcing-the-deduplication-model) [Twitter icon](https://twitter.com/intent/tweet?url=https://hs.pavefi.com/pave-blog/blog/announcing-the-deduplication-model) [pinterest-p icon](http://pinterest.com/pin/create/link/?url=https://hs.pavefi.com/pave-blog/blog/announcing-the-deduplication-model) [envelope icon](mailto:?body=https://hs.pavefi.com/pave-blog/blog/announcing-the-deduplication-model) We’ve noticed that data from aggregators including Plaid and MX return duplicate transactions across multiple accounts for a user. These erroneous transactions result in incorrect insights, features, and scores. As a result, we updated our model to remove duplicate transactions while computing insights to correct these duplicate errors.   ### Why this matters We found that **3.6%** of transactions were duplicated by these data aggregators. In some cases, we saw transactions duplicated up to **5 times**! When duplication errors occur, individuals can be seriously impacted. For example, if an income transaction is duplicated multiple times, the total income that shows up for a user will be wrong by a factor of 2, 3, or more. Someone’s income could appear to be $500,000 when it’s $100,000! Deduplicating transactions means that insights, features, and scores will be more accurate as a result. ### Here are some FAQs to get you started. **How are duplicate transactions from Plaid created?**  A duplicate Plaid [Item](https://plaid.com/docs/quickstart/glossary/#item) is created if the end user logs into the same institution using the same credentials again using Plaid Link, and if an access token is requested for the item. A user may do this when they: - forget that they’ve already connected to a bank - may believe they have to connect twice to add multiple accounts (like checking or savings) - are trying to get past an error Therefore, a duplicate account with duplicated transactions is ingested by Plaid.  **How can I prevent duplicate transactions from being sent from my application?** - [Implement pre-link messaging](https://plaid.com/docs/link/duplicate-items/#implement-pre-link-messaging) - Displaying a list of accounts that users have already connected to your application can help prevent end them from inadvertently linking the same accounts again. - [Use Link’s update mode](https://plaid.com/docs/link/duplicate-items/#use-links-update-mode) - [Use the onSuccess callback metadata](https://plaid.com/docs/link/duplicate-items/#use-the-onsuccess-callback-metadata) - The [onSuccess](https://plaid.com/docs/link/web/#onsuccess) callback is called when a user successfully links an Item using Plaid Link. This callback provides metadata that customers can use to prevent duplicate Items. You can read more about preventing duplicate transactions [here](https://plaid.com/docs/link/duplicate-items/).  **What should I do if I’m unable to resolve duplicated Plaid Items in my application?** No action is required! Our deduplication model will remove the duplicated account and its accompanying duplicate transactions.  **Will Pave resolve duplicate accounts in addition to duplicate transactions?** Yes, we’re working on further improvements to resolve two or more Account IDs from Plaid that are actually the same Account.  [Product Features](https://hs.pavefi.com/pave-blog/tag/product-features), [cashflow insights](https://hs.pavefi.com/pave-blog/tag/cashflow-insights) ## Related posts [![](https://hs.pavefi.com/hs-fs/hubfs/Imported_Blog_Media/Integration-Medium.png?height=200&name=Integration-Medium.png)](https://hs.pavefi.com/pave-blog/blog/unit-integration) [Product Features](https://hs.pavefi.com/pave-blog/tag/product-features), [cashflow insights](https://hs.pavefi.com/pave-blog/tag/cashflow-insights) ## [Announcing our Unit Integration](https://hs.pavefi.com/pave-blog/blog/unit-integration) [Lennon Chimbumu](https://hs.pavefi.com/pave-blog/author/lennon-chimbumu) Nov 15, 2022 7:22:50 AM We’ve launched a new Unit integration that allows you to upload bank transaction data from your... [Read more](https://hs.pavefi.com/pave-blog/blog/unit-integration) [crypto](https://hs.pavefi.com/pave-blog/tag/crypto), [Product Features](https://hs.pavefi.com/pave-blog/tag/product-features), [cryptocurrency](https://hs.pavefi.com/pave-blog/tag/cryptocurrency) ## [Detecting Crypto Transactions](https://hs.pavefi.com/pave-blog/blog/detecting-cryptocurrency-transactions) [Eusebio Salinas](https://hs.pavefi.com/pave-blog/author/eusebio-salinas) Nov 2, 2022 1:38:35 AM We’re excited to announce that we launched “Crypto” as a new tag for our recurring\_outflows and... [Read more](https://hs.pavefi.com/pave-blog/blog/detecting-cryptocurrency-transactions) [![](https://hs.pavefi.com/hs-fs/hubfs/Imported_Blog_Media/Scoring-Dark-3.png?height=200&name=Scoring-Dark-3.png)](https://hs.pavefi.com/pave-blog/blog/announcing-the-payroll-prediction-model-dashboard) [Product Features](https://hs.pavefi.com/pave-blog/tag/product-features), [equitable finance](https://hs.pavefi.com/pave-blog/tag/equitable-finance), [fintech](https://hs.pavefi.com/pave-blog/tag/fintech), [cashflow insights](https://hs.pavefi.com/pave-blog/tag/cashflow-insights) ## [Announcing the Payroll Prediction Model Dashboard](https://hs.pavefi.com/pave-blog/blog/announcing-the-payroll-prediction-model-dashboard) [Amelia Chikota](https://hs.pavefi.com/pave-blog/author/amelia-chikota) Nov 6, 2023 8:00:24 AM We’re excited to announce the launch of our new Payroll Prediction Model dashboard! This dashboard... [Read more](https://hs.pavefi.com/pave-blog/blog/announcing-the-payroll-prediction-model-dashboard) facebook-f icon linkedin-in icon Twitter icon instagram icon - Menu Item 1 - Sub-menu Item 1 - Another Item - Sub-menu Item 2 - Menu Item 2 - Yet Another Item - Menu Item 3 - Menu Item 4 --- # Pave Financial, Inc. 123 Main Street, City, State 11111 Copyright © 2026, Pave Financial, Inc ```json { "@context" : "https://schema.org", "@type" : "BlogPosting", "author" : { "@type" : "Person", "name" : "Admin", "url" : "https://hs.pavefi.com/pave-blog/author/admin" }, "dateModified" : "2024-10-17T21:32:02.606Z", "datePublished" : "2023-01-17T11:22:10.000Z", "headline" : "Announcing the Deduplication Model", "image" : [ "https://hs.pavefi.com/hubfs/Imported_Blog_Media/Models-Attributes-Medium-Oct-17-2024-09-29-56-4774-PM.png" ], "mainEntityOfPage" : { "@id" : "https://hs.pavefi.com/pave-blog/blog/announcing-the-deduplication-model", "@type" : "WebPage" }, "publisher" : { "@type" : "Organization", "logo" : { "@type" : "ImageObject", "url" : "https://hs.pavefi.com/hubfs/PaveLogo-t.png" }, "name" : "Pave Financial, Inc" } } ```