Duplicate Results overview listing every detection run with duplicates to review, merged and failed counts

Stop Duplicate Leads from Marketing Forms in Dynamics 365 Customer Insights – Journeys

Your marketing team launches a webinar, a newsletter sign-up and a contact form. The campaign works. A month later, sales opens a contact and finds three leads for the same person, one for each form they filled in. Lead scoring is split across records, the same person gets the same email twice, and nobody knows which lead to work.

In short

  • Customer Insights – Journeys forms that target leads create a new lead on every submission by default, because their duplicate setting is “Always create a new record”.
  • Switch lead forms to a matching rule, for example email OR mobile phone plus last name with a High match, and make every matching field required.
  • Form matching starts with an exact check and only covers forms and journeys, so add a nightly Data Quality App detection run comparing new leads with existing contacts.

This is not a user mistake. It is how marketing forms in Dynamics 365 Customer Insights – Journeys behave out of the box. Here is why forms create duplicate leads and contacts, the settings that fix most of it, and what to add for the duplicates the form can’t catch.

Why marketing forms create duplicate leads

Every Customer Insights – Journeys form has a target audience: Contact, Lead, or Lead & Contact. Each one handles existing records differently by default:

  • Contact: if a contact with the same email address exists, it is updated. No duplicate is created.
  • Lead: every submission creates a new lead, even if the same email address is used.
  • Lead & Contact: the contact is matched on email and updated, but a new lead is always created.

So any form that targets leads creates a new lead for every submission unless you change it. A person who downloads two e-books and registers for a webinar becomes three leads.

Even with matching turned on, three more things let duplicates through:

  • People use more than one email address. A work address on one form and a private one on the next do not match.
  • Typos and formats. “anna.jensen@contoso.com” and “ana.jensen@contoso.com” are two different people to an exact match.
  • Existing duplicates make it worse. If the matching rule finds several records, Microsoft updates the most recently modified one. The form keeps adding data to whichever copy was touched last, so the history ends up split across records.

Six settings to check today

1. Change the default for lead forms

Open the form, go to Settings and look at how the audience handles duplicate records. For lead forms, replace “Always create a new record” with a matching rule, for example on email. You can change the default for all new forms in the form default settings, so new forms start right.

Some sales teams want one lead per request, for example one per quote request. In that case, keep new leads but use the Lead & Contact audience, so every lead is linked to the same contact.

2. Build a custom matching rule

Go to Settings > Matching rules and create a rule for leads and one for contacts. A rule has a main condition and optional additional conditions:

  • The main condition is always an exact match. Attributes in it are combined with OR, for example email OR mobile phone.
  • Additional conditions are combined with AND, and here you can set a degree of match: Exact, High, Medium or Low. For example: email OR mobile phone, AND last name with a High match.

3. Make the matching fields required

Every field used in the matching rule must be on the form, or the form won’t publish. Make those fields required too. Matching on empty values gives unexpected results.

4. Turn on “Ignore empty values”

If someone leaves the phone field blank, this toggle keeps the phone number you already have instead of overwriting it with nothing.

5. Turn on prefill for known visitors

Form prefill fills in what you already know about a visitor, so they don’t type a new email address or a different spelling of their name.

6. Preset the phone country code

If most of your customers are in one country, preset the country code on the phone field. Phone numbers are then stored in the same international format, which makes them usable for matching.

What form matching can’t do

These settings stop most new duplicates from forms. They don’t solve everything:

  • The first check is exact. The main condition is a direct database lookup, so fuzzy matching only applies after an exact hit on email or another main attribute. A new email address still creates a new record.
  • It only covers forms and journeys. Leads created by sales, imports, event lists and integrations are not checked by your form matching rules.
  • It doesn’t clean what is already there. Duplicates from before you changed the settings stay, and as described above, they make matching less reliable.
  • It can’t compare names that sound alike or company names. “Jon” and “John”, or “Contoso A/S” and “Contoso”, need smarter matching than exact or character-based comparison. Read more in our guide to phonetic matching in Dynamics 365.

The duplicate detection rules in Dynamics 365 don’t close this gap either. Our article on why duplicate detection rules don’t work explains why.

Add a safety net inside Dynamics 365

The form decides what happens at the moment of submission. Something still has to look at the whole database afterwards. That is what the Data Quality App does, inside Dynamics 365:

  • Nightly detection runs. Schedule a duplicate detection run on leads and contacts that repeats every night, so records from forms, imports and integrations are all checked.
  • Leads checked against contacts. One rule can compare new leads with existing contacts, so marketing doesn’t create a lead for someone who is already a customer.
  • Matching for messy data. Typo-tolerant matching per field, sounds-like names, phone numbers normalised with country codes, company names without legal forms like A/S or Ltd, and email domains.
  • A match score. Each pair gets a score out of 100. Strong matches can merge automatically in the background. Weaker ones land in a review list.
  • Remembered decisions. Pairs marked as not duplicates don’t come back in the next run.

Want to see it first? The interactive product tour walks through a duplicate rule for contacts and a bulk detection run, inside Dynamics 365. For a full comparison with the built-in features, see Data Quality App vs Dynamics 365 native duplicate detection.

A setup that works

  1. Forms: lead forms match on email instead of always creating a new lead, or use Lead & Contact so leads share one contact.
  2. Matching rules: email OR mobile phone as the main condition, last name with a High match as an additional condition.
  3. Form settings: matching fields required, Ignore empty values on, prefill on, phone country code preset.
  4. Dynamics 365: a nightly detection run on leads and contacts, with auto-merge only for strong matches.
  5. Cleanup first: merge the duplicates you already have, so form matching updates the right record. Our guide to merging duplicate records shows how.

Frequently asked questions

Why does Customer Insights – Journeys create a new lead every time a form is submitted?

Because that is the default for forms that target leads: “Always create a new record”. Change it in the form settings by choosing a matching rule, for example on email.

Can Customer Insights – Journeys forms use fuzzy matching?

Partly. The main condition of a matching rule is always an exact match. Additional conditions can use a degree of match from Exact to Low, but only on records that already passed the exact main condition.

Which record is updated if several records match?

The most recently modified record. That is why existing duplicates should be merged before you rely on form matching.

Do marketing form matching rules work for leads created by sales or imports?

No. Matching rules apply to marketing forms, event registration forms and leads created in journeys. Leads from sales, imports and integrations need duplicate detection in Dynamics 365 itself.

How do I stop marketing from creating leads for existing customers?

Use the Lead & Contact audience so leads are linked to a matched contact, and run a duplicate check that compares new leads with existing contacts.

Keep your campaigns from creating cleanup work

Change the form defaults today, and add a nightly safety net for everything the form can’t see. Want to know how many duplicate leads your campaigns have already created? Start a free 15-day trial of the Data Quality App, or book a demo and we’ll look at your data together.

Improve your data quality in Dynamics 365

The Data Quality App keeps records complete and correct with data quality rules at the point of entry, finds duplicates with fuzzy and phonetic matching, resolves them with bulk merge and measures your data health over 30, 60 and 90 days. Native in your own environment, free for 15 days.

Start free 15-day trial See the Data Quality App

Hasret Smajlović is the co-founder of Techdio, a Microsoft Certified Global ISV building data quality and migration solutions for Dynamics 365 and Power Apps. Working in the Microsoft business applications ecosystem since 2009, Hasret has delivered more than 100 end-to-end Dynamics 365 implementations, upgrades and migrations across cloud and on-premises environments. In 2024, Microsoft selected Hasret for its Partner Advisory Council as one of the world's top 25 Business Applications professionals among Microsoft partners. Hasret studied strategic management at Harvard Business School Online and holds a Mini MBA in organizational leadership.