Duplicate Detection — MDDB API

Find duplicate and similar documents #

POST /v1/find-duplicates

Scans a collection for duplicate and similar documents using content hashes and embedding vectors. Exact mode groups documents with identical content hashes. Similar mode compares embedding vectors pairwise and clusters documents above the similarity threshold using transitive clustering.

Authorization: BearerAuth or APIKeyAuth or none

Request body #

Required.

Content type application/json: FindDuplicatesRequest

{
  "collection": "string",
  "distanceMetric": "cosine",
  "includeContent": false,
  "maxDocs": 5000,
  "mode": "both",
  "threshold": 0.9
}

Responses #

Status	Description	Body
200	Duplicate detection results	FindDuplicatesResponse (application/json)
400	Invalid request	ErrorResponse (application/json)