{
  "schema_version": "declawd.source-review/v1",
  "reviewed_at": "2026-11-05T12:25:38Z",
  "scope": "Recheck the single due variation-selector study. Read the pinned and current README in full, read the cited scaling table in FINDINGS section 14 and check the stored long-context summary counts.",
  "limitations": [
    "This is a reading and stored-table check. No model generation, detector scoring or private production detector was run.",
    "The README describes the completed gpt-oss-120b follow-up, while FINDINGS section 14 retains the earlier partial run. Those are distinct records.",
    "The stored long-context zero-insertion scores round to 14.85 for all seven Qwen lengths and 27.95 for all four gpt-oss-20b lengths. Counting stored threshold crossings does not establish baseline reliability.",
    "Raw third-party files remain in private capture storage and are excluded from publication. Earlier captures and experiment revisions retain their bytes."
  ],
  "sources": [
    {
      "source_id": "claude-awm-variation-selector-study",
      "reviewed_at": "2026-11-05T12:25:38Z",
      "review_method": "Fresh authenticated GitHub API capture, full README reading, targeted FINDINGS reading and counting stored summary rows. Current and pinned documentation bytes were compared.",
      "repository": "aloshdenny/claude-awm",
      "default_branch": "main",
      "current_head": "9476e1a966c85ad82147f7f5c6ffead018ffae06",
      "article_revision_retained": "90f39752ff06c16460cfb58f8e37827dc397c419",
      "captures": [
        {
          "requested_url": "https://api.github.com/repos/aloshdenny/claude-awm",
          "access_method": "authenticated_github_api",
          "captured_at": "2026-11-05T12:22:33.238316+00:00",
          "timestamp_scope": "Local capture completion",
          "http_status": 200,
          "response_bytes": 5419,
          "response_sha256": "72bb56331eca835ac58b574661ec97bea931ce7c475d3ac73e6b5de96df27f5b"
        },
        {
          "requested_url": "https://api.github.com/repos/aloshdenny/claude-awm/commits/main",
          "access_method": "authenticated_github_api",
          "captured_at": "2026-11-05T12:22:33.815237+00:00",
          "timestamp_scope": "Local capture completion",
          "http_status": 200,
          "response_bytes": 18657,
          "response_sha256": "8e3cbf197f82b084bda62ff1e41229245210343d8b1cb661aa1b9225b4655a86"
        },
        {
          "requested_url": "https://github.com/aloshdenny/claude-awm/blob/90f39752ff06c16460cfb58f8e37827dc397c419/README.md",
          "access_method": "authenticated_github_contents_api_raw",
          "captured_at": "2026-11-05T12:22:33.815430+00:00",
          "http_status": 200,
          "revision": "90f39752ff06c16460cfb58f8e37827dc397c419",
          "path": "README.md",
          "response_bytes": 17384,
          "response_sha256": "85127b40114557ba8284173d1b8bb22cf521cf9af7f997a7dafe5427af10f068"
        },
        {
          "requested_url": "https://github.com/aloshdenny/claude-awm/blob/90f39752ff06c16460cfb58f8e37827dc397c419/docs/FINDINGS.md",
          "access_method": "authenticated_github_contents_api_raw",
          "captured_at": "2026-11-05T12:22:34.328006+00:00",
          "http_status": 200,
          "revision": "90f39752ff06c16460cfb58f8e37827dc397c419",
          "path": "docs/FINDINGS.md",
          "response_bytes": 26595,
          "response_sha256": "fb7d720825a6fda6d760e3f89a97e6336175bbaf7ee19f2dd464054dd06b0526"
        },
        {
          "requested_url": "https://github.com/aloshdenny/claude-awm/blob/9476e1a966c85ad82147f7f5c6ffead018ffae06/README.md",
          "access_method": "authenticated_github_contents_api_raw",
          "captured_at": "2026-11-05T12:22:34.785323+00:00",
          "http_status": 200,
          "revision": "9476e1a966c85ad82147f7f5c6ffead018ffae06",
          "path": "README.md",
          "response_bytes": 17384,
          "response_sha256": "85127b40114557ba8284173d1b8bb22cf521cf9af7f997a7dafe5427af10f068"
        },
        {
          "requested_url": "https://github.com/aloshdenny/claude-awm/blob/9476e1a966c85ad82147f7f5c6ffead018ffae06/docs/FINDINGS.md",
          "access_method": "authenticated_github_contents_api_raw",
          "captured_at": "2026-11-05T12:22:35.311394+00:00",
          "http_status": 200,
          "revision": "9476e1a966c85ad82147f7f5c6ffead018ffae06",
          "path": "docs/FINDINGS.md",
          "response_bytes": 26595,
          "response_sha256": "fb7d720825a6fda6d760e3f89a97e6336175bbaf7ee19f2dd464054dd06b0526"
        },
        {
          "requested_url": "https://github.com/aloshdenny/claude-awm/blob/90f39752ff06c16460cfb58f8e37827dc397c419/results/all_1m_runs.json",
          "access_method": "authenticated_github_contents_api_raw",
          "captured_at": "2026-11-05T12:23:43.032154+00:00",
          "http_status": 200,
          "revision": "90f39752ff06c16460cfb58f8e37827dc397c419",
          "path": "results/all_1m_runs.json",
          "response_bytes": 15074,
          "response_sha256": "2c6962fb6eb616ef084b8a4c797d2a9aa2eda72b35dbfcb6233918dff7ab6da6"
        }
      ],
      "access_failures": [
        {
          "requested_url": "https://github.com/aloshdenny/claude-awm/tree/90f39752ff06c16460cfb58f8e37827dc397c419",
          "access_method": "web reader",
          "outcome": "Cache miss. Authenticated GitHub API capture succeeded afterwards."
        }
      ],
      "comparison": {
        "readme_bytes_identical_at_pinned_and_current_revisions": true,
        "findings_bytes_identical_at_pinned_and_current_revisions": true
      },
      "findings": [
        "The README still lists seven open models and reports 440 main cells, with a separate sweep reaching 1,048,576 tokens.",
        "FINDINGS section 14 retains gpt-oss-20b rates of 9.3 per cent at 1,024 tokens and 25 per cent at 131,072 tokens.",
        "The README retains the 45 cells at insertion rates of 35 per cent or above below its 2.33 threshold, and its warning about the Qwen baseline.",
        "The repository describes an untrained mean-g detector and operator-controlled keys. These results do not establish Anthropic production compatibility."
      ],
      "stored_table_check": {
        "path": "results/all_1m_runs.json",
        "revision": "90f39752ff06c16460cfb58f8e37827dc397c419",
        "rows_including_baselines": 150,
        "attack_rows": 135,
        "rows_at_or_above_35_per_cent": 45,
        "all_45_stored_scores_below_2_33": true,
        "largest_score_in_those_rows": 0.5951155132435144,
        "maximum_context_tokens": 1048576,
        "baseline_scores": {
          "gpt-oss-20b": [
            {
              "length": 16384,
              "z": 27.94821497499859
            },
            {
              "length": 32768,
              "z": 27.94821497499859
            },
            {
              "length": 65536,
              "z": 27.94821497499859
            },
            {
              "length": 131072,
              "z": 27.948264501024905
            }
          ],
          "gpt-oss-120b": [
            {
              "length": 16384,
              "z": 32.353173474557906
            },
            {
              "length": 32768,
              "z": 39.08717251879784
            },
            {
              "length": 65536,
              "z": 61.3551849230794
            },
            {
              "length": 131072,
              "z": 62.470965394424844
            }
          ],
          "Qwen3.8-27B": [
            {
              "length": 16384,
              "z": 14.845331744976043
            },
            {
              "length": 32768,
              "z": 14.845331744976043
            },
            {
              "length": 65536,
              "z": 14.845331744976043
            },
            {
              "length": 131072,
              "z": 14.845331744976043
            },
            {
              "length": 262144,
              "z": 14.845331744976043
            },
            {
              "length": 524288,
              "z": 14.845331744976043
            },
            {
              "length": 1048576,
              "z": 14.845363974006078
            }
          ]
        },
        "scope": "Arithmetic over the published summary only. Sample-level values, calibration and model outputs were not regenerated or independently validated."
      },
      "assessment": "The cited figures remain present in the reviewed records. Retain their author-reported classification, historical citation and baseline caveats."
    }
  ]
}
