Skip to content
IATE logo 🖶
lorem ipsum

Duplicate detection (*)

To help ensure the quality of its data, IATE offers various ways to identify potential duplicates:

  • automatic duplicate detection, and
  • advanced duplicate detection.

Read more on user groups and access rights.

AUTOMATIC DUPLICATE DETECTION

Potential duplicates will be suggested automatically by IATE:

  • at entry creation, and
  • at entry modification.
Only exact matches are identified as potential duplicates (i.e., plural forms are not recognised).

The warning message ‘This term might be a duplicate. Please check.’ is displayed in orange under the term field if there are potential duplicates in the same language. Click on the message to view the list of potential duplicates in a separate browser tab.

Duplicate detection is not launched if the term type is ‘abbreviation’ or ‘lookup form’.
Entries with ‘Raw’ status, on the other hand, are retrieved as potential duplicates.
ADVANCED DUPLICATE DETECTION

Duplicates can also be identified for a specific entry:

  • on the results page, by clicking on the ‘Manage entry’ Manage entry icon and selecting ‘Find duplicates’, or
  • in full entry view, by right-clicking on the LIL and selecting ‘Find duplicates’.
Activate the ‘Display management options’ in your user preferences to see the ‘Find duplicates’ button by default in the results list and in the full entry view.

The advanced duplicate detection search is run as an ‘Exact match’ search to see if any of the terms in any languages on the current entry exist elsewhere in IATE. Results are sorted in descending order of exact matches. Various metadata (domain, LIL owner, primarity and term reliability) are displayed to facilitate the analysis of potential duplicates.

Select the relevant duplicates (as well as the current entry) by clicking on the plus icon and compile them in a list for further action, such as:

  • obtaining a list of IDs by clicking on ‘Show list of IDs’ or ‘Save IDs to file’ buttons,
  • adding them to a merge operation, or
  • adding them to the ‘Table view’.

You can also remove any suggested duplicate from the list by clicking on the bin icon which appears when you hover your mouse over the first row of each duplicate.

(*) User GROUPs and access rights

Check the access rights for each IATE user group below:

User groupAutomatic duplicate detectionAdvanced duplicate detection
NON-LOGGED-IN USERNoNo
BASIC USERNoNo
EXTERNAL COLLABORATORYesNo
TRANSLATOR (limited) and aboveYesYes

Related Pages

Entry creation
Data modification
Full entry view
Results lists
User preferences

  • General information
    • Introduction to the IATE Online Help
    • About IATE
    • Multilingual interface
    • Accessibility statement
    • Create an IATE account and log on/off
    • Local storage and browser cache
    • Contact
  • User dashboard (*)
    • User preferences (*)
    • Bookmarks (*)
    • Watch lists (*)
    • Notifications (*)
  • Search
    • Main search
      • Expanded search
        • Matching options
        • Search by term types
        • Search in specific fields
        • Filters
    • Search by collection
    • Search by URL
    • Results
      • Standard view vs interpreters’ view
    • Exports (*)
  • Entry overview
    • Full entry view
    • Entry structure
      • Language-Independent Level
      • Language Level
      • Term Level
    • Feedback on an entry (*)
  • Entry management (*)
    • General input criteria
    • List of fields
      • Domains
      • Collections
      • Field completion score (*)
    • References
      • Best practices related to references (*)
      • Types of references
      • Entry-to-entry links
      • Clipboard
    • General editing features
      • Action buttons
      • Contextual menu
      • Formatting
    • Entry creation (*)
    • Data modification (*)
    • Duplicate detection (*)
    • Deletion (*)
    • Undeletion (*)
    • History/audit
  • Advanced features (*)
    • Table view (*)
    • Experimental features (*)
    • Post-adoption checks (*)
  • Terminology projects (*)
    • Project list (*)
    • Create and edit a project (*)
    • Preparatory material (*)
    • Project entries (*)
    • Project assignments (*)
    • My assignments (*)
    • My assigned entries (*)
    • Internal forum (*)
    • External forum (*)
  • Document processing (*)
    • Term Extraction Module (TEM) (*)
      • TEM candidate management (*)
  • Documentation
    • Documentation & tutorials
    • Useful shortcuts
  • Technical info (*)
    • Download IATE (*)
  • Statistics

This handbook is part of IATE, the European Union terminology portal.

Powered by PressBook WordPress theme