To help ensure the quality of its data, IATE offers various ways to identify potential duplicates:
Read more on user groups and access rights.
AUTOMATIC DUPLICATE DETECTION
Potential duplicates will be suggested automatically by IATE:
- at entry creation, and
- at entry modification.
![]() |
The warning message ‘This term might be a duplicate. Please check.’ is displayed in orange under the term field if there are potential duplicates in the same language. Click on the message to view the list of potential duplicates in a separate browser tab.
![]() Entries with ‘Raw’ status, on the other hand, are retrieved as potential duplicates. |
ADVANCED DUPLICATE DETECTION
Duplicates can also be identified for a specific entry:
- on the results page, by clicking on the ‘Manage entry’
icon and selecting ‘Find duplicates’, or
- in full entry view, by right-clicking on the LIL and selecting ‘Find duplicates’.
![]() |
The advanced duplicate detection search is run as an ‘Exact match’ search to see if any of the terms in any languages on the current entry exist elsewhere in IATE. Results are sorted in descending order of exact matches. Various metadata (domain, LIL owner, primarity and term reliability) are displayed to facilitate the analysis of potential duplicates.
Select the relevant duplicates (as well as the current entry) by clicking on the plus icon and compile them in a list for further action, such as:
- obtaining a list of IDs by clicking on ‘Show list of IDs’ or ‘Save IDs to file’ buttons,
- adding them to a merge operation, or
- adding them to the ‘Table view’.
You can also remove any suggested duplicate from the list by clicking on the bin icon which appears when you hover your mouse over the first row of each duplicate.
(*) User GROUPs and access rights
Check the access rights for each IATE user group below:
User group | Automatic duplicate detection | Advanced duplicate detection |
---|---|---|
NON-LOGGED-IN USER | No | No |
BASIC USER | No | No |
EXTERNAL COLLABORATOR | Yes | No |
TRANSLATOR (limited) and above | Yes | Yes |