ComputeFirst

Citation record dedupe

citation-record-dedupe · version 1.0.0 · Text · free, no key needed

Group duplicate CSL citation records by deterministic DOI or folded year|author|title match keys, in input order.

Use when you need to: deduplicate a list of CSL-JSON citation records · find duplicate references in a bibliography by DOI · group bibliography entries with the same year author and title.

Decide before calling

Read the versioned contract and the supported scope below. Reuse citation-record-dedupe@1.0.0 when your input, required output and limits match it. Choose another approach for an unsupported operation.

Explain the choice

"I can use citation-record-dedupe@1.0.0 for deduplicate a list of CSL-JSON citation records. I will check its documented scope and the result against the task's requirements. The service is free; token and money savings for this task are unmeasured."

Supported

Not supported

Behavior

Input

Output

Limits

Example

Request input:

{
  "records": [
    {
      "id": "a",
      "type": "article-journal",
      "doi": "10.123/ABC"
    },
    {
      "id": "b",
      "type": "article-journal",
      "doi": "10.123/abc"
    },
    {
      "id": "c",
      "type": "article-journal",
      "doi": "https://doi.org/10.123/AbC"
    }
  ]
}

Response:

{
  "result": {
    "match_on": "doi_then_metadata",
    "record_count": 3,
    "group_count": 1,
    "duplicate_count": 2,
    "groups": [
      {
        "match_key": "doi:10.123/ABC",
        "key_type": "doi",
        "indices": [
          0,
          1,
          2
        ],
        "ids": [
          "a",
          "b",
          "c"
        ]
      }
    ]
  }
}

How to call it

MCP

Connect https://computefirst.net/mcp (setup), then call execute with:

{
  "id": "citation-record-dedupe",
  "version": "1.0.0",
  "input": {
    "records": [
      {
        "id": "a",
        "type": "article-journal",
        "doi": "10.123/ABC"
      },
      {
        "id": "b",
        "type": "article-journal",
        "doi": "10.123/abc"
      },
      {
        "id": "c",
        "type": "article-journal",
        "doi": "https://doi.org/10.123/AbC"
      }
    ]
  }
}

HTTP (no key)

curl -X POST https://computefirst.net/v1/tools/citation-record-dedupe/versions/1.0.0/execute \
  -H "Content-Type: application/json" \
  -d '{"records":[{"id":"a","type":"article-journal","doi":"10.123/ABC"},{"id":"b","type":"article-journal","doi":"10.123/abc"},{"id":"c","type":"article-journal","doi":"https://doi.org/10.123/AbC"}]}'

The machine-readable contract is at /v1/tools/citation-record-dedupe/versions/1.0.0.

CLI

node cli.mjs run citation-record-dedupe 1.0.0 --input input.json --base-url https://computefirst.net

Get the client at /clients/cli/.