Files
ds4/gguf-tools/quality-testing/data
antirez 3c63c06c5a qa: add DeepSeek V4 Pro 0813 oracle
Keep the preview oracle intact, add the 100-case official 0813 fixture, and record the source, conversion, safety, quality, hash, and publication results.
2026-08-23 15:05:13 +02:00
..
2026-08-23 15:05:13 +02:00

Official Quality Fixtures

This directory contains curated hosted-model continuation fixtures that are safe to commit and use in release QA.

  • glm52-openrouter-100: 100 GLM 5.2 OpenRouter continuations with API top-logprob slices.
  • flash: 100 DeepSeek V4 Flash 0731 continuations from the official DeepSeek API, with API top-logprob slices.
  • pro: 100 DeepSeek V4 PRO preview continuations with API top-logprob slices.
  • pro-0813: 100 DeepSeek V4 PRO 0813 continuations with API top-logprob slices.

Each fixture directory contains:

  • prompts/case_*.txt: exact user prompts.
  • continuations/case_*.txt: deterministic hosted-model continuations.
  • responses/case_*.json: raw hosted responses, including logprob slices.
  • manifest.tsv: paths consumed by score_official.

DeepSeek V4 Flash smoke vectors are also tracked in tests/test-vectors/ and are run by ./ds4_test --logprob-vectors.