{
"display": {
"vendor": "Kimi / Moonshot AI",
"officialDate": "2026-10-24",
"previousAttempts": 36,
"modeLabels": {
"default": {
"zh": "请求默认参数（文档为 max）",
"en": "Requested default (documented max)"
},
"low": {
"zh": "请求参数 · low",
"en": "Requested parameter · low"
},
"max": {
"zh": "请求参数 · max",
"en": "Requested parameter · max"
}
},
"methodZh": "本轮通过 Kimi Coding Plan 原生 Anthropic Messages 协议调用 k3.1-pro，地址 https://api.kimi.com/coding/v1/messages。每组计划 23 题，default / low / max 三组请求参数最多并发 3 个请求；每组内逐题执行。5 小时订阅额度耗尽后停止新请求，未派发任务不伪造记录，额度错误不计为模型答题失败。默认 effort 的文档值为 max；这两组保留独立请求，不当作两个不同能力档位。low / max 使用原生 output_config.effort；不把 thinking 预算当成 effort。输入 token 合计为原生 input_tokens、cache_read_input_tokens 与 cache_creation_input_tokens 之和，原 usage 字段完整保留。初轮 max_tokens=12,288，包含思考和正文；超时 600 秒，temperature / top_p 省略，没有独立设置 thinking.budget_tokens。按订阅额度消耗，不能按官方按量标价换算成实际账单。此前停止的 Chat Completions 子集单独保留。静态与动图源自模型原始 SVG，未修复源码；点评是 AI 助手的定性视觉检查。单次耗时受服务端排队、三个请求的并发和输出长度影响，不能据此建立稳定速度排名。逐次保留请求与返回模型 ID；可变 API 路由不构成内部固定 checkpoint 的独立证明。服务端接受了非法 effort 负向探针，因此无法独立确认 low/max 实际生效。本页仅按实际请求参数分组，不称为已确认的有效档位比较。",
"methodEn": "This batch calls k3.1-pro through Kimi Coding Plan’s native Anthropic Messages endpoint https://api.kimi.com/coding/v1/messages. Each requested default/low/max configuration plans 23 tasks; at most three requests run concurrently, sequentially within each configuration. New dispatches stopped when the five-hour subscription quota was exhausted. Unsent tasks have no fabricated attempt, and quota failures are not scored as model-answer failures. Default is documented as max; omitted-default and explicit-max requests are independent records and are not treated as distinct capability levels. Low/max use native output_config.effort, not a thinking budget. Prompt-token totals sum native input_tokens, cache_read_input_tokens and cache_creation_input_tokens; raw usage is retained. Initial max_tokens=12,288 covers thinking plus final output; timeout 600 seconds. Temperature/top_p omitted; no thinking.budget_tokens configured. Requests consume subscription quota; metered list prices are not the actual invoice. The stopped Chat Completions subset stays separate. Images and animation directly render the model’s unchanged SVG. Assessments are qualitative AI-assistant visual inspection. Single-request timings include queueing, concurrency and output-length effects; they do not establish a stable speed ranking. Requested and returned IDs are preserved; a mutable API route is not independent proof of a fixed internal checkpoint. The server accepted the invalid-effort negative control, so the effective low/max semantics are not independently confirmed. Results are grouped by requested parameters, not claimed as a verified effort-level comparison.",
"officialIntroZh": "官方与 Artificial Analysis 原图分别展示，不能当作本站复现。",
"officialIntroEn": "Vendor and Artificial Analysis originals are shown separately and were not reproduced by TOKRACE."
},
"tasks": [
{
"id": "pelican",
"title": "鹈鹕骑自行车",
"titleEn": "Pelican riding a bicycle",
"source": "https://simonwillison.net/2024/Oct/25/pelicans-on-a-bicycle/",
"prompt": "Generate an SVG of a pelican riding a bicycle",
"rubricZh": [
"能辨认出鹈鹕的长喙与喉囊",
"自行车有两轮和连贯的车架",
"身体、车座、脚踏、车把之间的位置合理"
],
"rubricEn": [
"Recognizable pelican bill and pouch",
"Two wheels and a connected bicycle frame",
"Coherent rider, saddle, pedals and handlebar relationships"
]
},
{
"id": "clock",
"title": "9:41 模拟钟表",
"titleEn": "An analog clock at 9:41",
"prompt": "Return only a complete, self-contained static SVG with viewBox=\"0 0 800 600\". Draw a clear analog clock showing exactly 9:41, with all twelve numbers 1 through 12. The hour hand must be correctly positioned between 9 and 10, not exactly on 9. The minute hand must indicate minute 41. Use a shorter hour hand and a longer minute hand, no second hand. Add a small label \"09:41\" below the dial. Do not use scripts, external assets or embedded images.",
"rubricZh": [
"12 个数字完整、顺序正确",
"分针指向第 41 分钟（从 12 点顺时针 246°）",
"时针指向 9 点后 41 分钟（290.5°），且短于分针"
],
"rubricEn": [
"Twelve numbers in the correct order",
"Minute hand at 246 degrees clockwise from 12",
"Shorter hour hand at 290.5 degrees, between 9 and 10"
]
},
{
"id": "dashboard",
"title": "数据图表与比例",
"titleEn": "Data chart and proportional bars",
"prompt": "Return only a complete, self-contained static SVG with viewBox=\"0 0 800 600\". Design a polished dashboard card titled \"Quarterly Revenue\". Draw a vertical bar chart for Q1=12, Q2=24, Q3=18, Q4=30, in that left-to-right order. All four bars must share a zero baseline, and bar heights must be exactly proportional to the values. Show a y-axis labeled 0, 10, 20, 30 and show the value above each bar. Add summary labels \"Total: 84\" and \"Best: Q4\". Use a light background and readable typography. Do not use scripts, external assets or embedded images.",
"rubricZh": [
"Q1 到 Q4 的顺序、数值与总计 84 正确",
"四柱共享零基线，高度比例为 2:4:3:5",
"刻度、柱顶数字与摘要清楚，无遮挡"
],
"rubricEn": [
"Correct quarter order, values and total of 84",
"Shared zero baseline and heights in the ratio 2:4:3:5",
"Readable axis, values and summaries without overlap"
]
},
{
"id": "poster",
"title": "中文海报与排版约束",
"titleEn": "Chinese poster and layout constraints",
"prompt": "只输出一个完整、自包含的静态 SVG，viewBox=\"0 0 800 600\"。设计一张清晰、精致的中文活动海报。必须且仅包含以下六段文字，每段出现一次，不能增删字或改写：主标题“周末骑行计划”；副标题“慢一点，看见城市”；时间“10月24日 09:00”；地点“滨江公园东门”；说明“自备头盔 · 全程12公里”；按钮文字“立即报名”。画一个简洁的自行车图标。主标题最大，时间地点次之，说明最小。背景浅色，留足边距，所有文字保持在画布内，不重叠，不使用脚本、外部素材或嵌入图片。",
"rubricZh": [
"六段指定文字各一次，字词与数字不改写",
"标题、信息和按钮层次清晰",
"边距充足，文字在画布内且不重叠，自行车可辨识"
],
"rubricEn": [
"All six exact Chinese strings appear once",
"Clear hierarchy of heading, details and button",
"Adequate margins, no clipping or overlaps, recognizable bicycle"
]
}
],
"attempts": [
{
"id": "clock",
"title": "9:41 模拟钟表",
"titleEn": "An analog clock at 9:41",
"prompt": "Return only a complete, self-contained static SVG with viewBox=\"0 0 800 600\". Draw a clear analog clock showing exactly 9:41, with all twelve numbers 1 through 12. The hour hand must be correctly positioned between 9 and 10, not exactly on 9. The minute hand must indicate minute 41. Use a shorter hour hand and a longer minute hand, no second hand. Add a small label \"09:41\" below the dial. Do not use scripts, external assets or embedded images.",
"rubricZh": [
"12 个数字完整、顺序正确",
"分针指向第 41 分钟（从 12 点顺时针 246°）",
"时针指向 9 点后 41 分钟（290.5°），且短于分针"
],
"rubricEn": [
"Twelve numbers in the correct order",
"Minute hand at 246 degrees clockwise from 12",
"Shorter hour hand at 290.5 degrees, between 9 and 10"
],
"mode": "default",
"status": "done",
"text": "",
"startedAt": "2026-10-24T01:30:01.926Z",
"request": {
"model": "k3.1-pro",
"messages": [
{
"role": "user",
"content": "Return only a complete, self-contained static SVG with viewBox=\"0 0 800 600\". Draw a clear analog clock showing exactly 9:41, with all twelve numbers 1 through 12. The hour hand must be correctly positioned between 9 and 10, not exactly on 9. The minute hand must indicate minute 41. Use a shorter hour hand and a longer minute hand, no second hand. Add a small label \"09:41\" below the dial. Do not use scripts, external assets or embedded images."
}
],
"max_tokens": 12288,
"stream": true
},
"firstContentMs": 139619.04224999997,
"firstReasoningMs": 2105.5897919999843,
"firstEventMs": 2105.5544170000067,
"usage": {
"input_tokens": 196,
"cache_creation_input_tokens": 0,
"cache_read_input_tokens": 0,
"output_tokens": 10049,
"service_tier": "standard",
"inference_geo": "not_available",
"output_tokens_details": {
"thinking_tokens": 8701
}
},
"finishReason": "end_turn",
"error": null,
"returnedModel": "k3.1-pro",
"httpStatus": 200,
"transport": "node:https",
"finishedAt": "2026-10-24T01:32:36.547Z",
"totalMs": 154621.464709,
"promptTokens": 196,
"outputTokens": 10049,
"reasoningTokens": 8701,
"renderable": true,
"svgPath": "/evaluations/kimi-k3-1-pro-anthropic-clock-default-1/assets/clock-default.svg",
"svgSha256": "93b43c37f304732158badcd82e905a4cec6b9bcfcf4ac4aab52061cf1023c207",
"extraction": "Exact first SVG element from response; surrounding prose or code fence omitted, SVG bytes unchanged.",
"viewBox": "0 0 800 600",
"texts": [
"12",
"1",
"2",
"3",
"4",
"5",
"6",
"7",
"8",
"9",
"10",
"11",
"09:41"
],
"pngPath": "/evaluations/kimi-k3-1-pro-anthropic-clock-default-1/assets/clock-default.png",
"width": 1200,
"height": 900,
"pngSha256": "4992226a7a38471c0b50df9c72f8b1f9835abe76f18a457e7c2ed78420391ca5",
"renderer": "sharp/libvips SVG rasterization at 1200px width; no visual edits",
"attemptNumber": 1,
"kind": "static",
"sourceEvidence": "/evaluations/kimi-k3-1-pro-anthropic-first.json",
"localEvidence": "output/kimi-k3-1-pro-anthro-20261024/first-default/evidence.json",
"timeoutMs": 600000,
"visuallyInspected": true,
"sourceInspected": true,
"verdict": "meets-static-rubric",
"assessmentZh": "12 个数字与分钟刻度完整且顺序正确，短时针指在 9 与 10 之间，分针略过 8。源码角度严格为 290.5° 和 246°，长度 96 与 132；下方 09:41 标签独立清晰，没有秒针或遮挡。",
"assessmentEn": "All twelve numbers and minute ticks are complete and correctly ordered. The short hour hand sits between nine and ten and the minute hand just past eight. Source angles are exactly 290.5° and 246°, with lengths 96 and 132. The separate 09:41 label is clear, with no second hand or overlap.",
"checks": {
"allTwelveNumbersExactlyOnce": true,
"correctNumberOrder": true,
"hourAngleCorrect": true,
"minuteAngleCorrect": true,
"hourShorterThanMinute": true,
"noSecondHand": true,
"labelCorrectAndUnclipped": true
},
"sourceChecks": {
"center": [
400,
270
],
"hourDegreesClockwiseFromTwelve": 290.5,
"minuteDegreesClockwiseFromTwelve": 246,
"hourLength": 96,
"minuteLength": 132,
"minuteTickCount": 60,
"label": "09:41",
"viewBox": "0 0 800 600"
},
"altZh": "Kimi K3.1 Pro default：9:41 模拟钟表",
"altEn": "Kimi K3.1 Pro default: An analog clock at 9:41"
},
{
"id": "clock",
"title": "9:41 模拟钟表",
"titleEn": "An analog clock at 9:41",
"prompt": "Return only a complete, self-contained static SVG with viewBox=\"0 0 800 600\". Draw a clear analog clock showing exactly 9:41, with all twelve numbers 1 through 12. The hour hand must be correctly positioned between 9 and 10, not exactly on 9. The minute hand must indicate minute 41. Use a shorter hour hand and a longer minute hand, no second hand. Add a small label \"09:41\" below the dial. Do not use scripts, external assets or embedded images.",
"rubricZh": [
"12 个数字完整、顺序正确",
"分针指向第 41 分钟（从 12 点顺时针 246°）",
"时针指向 9 点后 41 分钟（290.5°），且短于分针"
],
"rubricEn": [
"Twelve numbers in the correct order",
"Minute hand at 246 degrees clockwise from 12",
"Shorter hour hand at 290.5 degrees, between 9 and 10"
],
"mode": "low",
"status": "done",
"text": "",
"startedAt": "2026-10-24T01:27:28.712Z",
"request": {
"model": "k3.1-pro",
"messages": [
{
"role": "user",
"content": "Return only a complete, self-contained static SVG with viewBox=\"0 0 800 600\". Draw a clear analog clock showing exactly 9:41, with all twelve numbers 1 through 12. The hour hand must be correctly positioned between 9 and 10, not exactly on 9. The minute hand must indicate minute 41. Use a shorter hour hand and a longer minute hand, no second hand. Add a small label \"09:41\" below the dial. Do not use scripts, external assets or embedded images."
}
],
"max_tokens": 12288,
"stream": true,
"output_config": {
"effort": "low"
}
},
"firstContentMs": 64433.838082999995,
"firstReasoningMs": 1285.036917000005,
"firstEventMs": 1285.0269169999956,
"usage": {
"input_tokens": 197,
"cache_creation_input_tokens": 0,
"cache_read_input_tokens": 0,
"output_tokens": 4852,
"service_tier": "standard",
"inference_geo": "not_available",
"output_tokens_details": {
"thinking_tokens": 3810
}
},
"finishReason": "end_turn",
"error": null,
"returnedModel": "k3.1-pro",
"httpStatus": 200,
"transport": "node:https",
"finishedAt": "2026-10-24T01:28:43.462Z",
"totalMs": 74749.681875,
"promptTokens": 197,
"outputTokens": 4852,
"reasoningTokens": 3810,
"renderable": true,
"svgPath": "/evaluations/kimi-k3-1-pro-anthropic-clock-low-1/assets/clock-low.svg",
"svgSha256": "d6a7bf26ff3a78da25b6489e0a52a2eec257d58a93a9079ef8f461cfd714c687",
"extraction": "Exact first SVG element from response; surrounding prose or code fence omitted, SVG bytes unchanged.",
"viewBox": "0 0 800 600",
"texts": [
"12",
"1",
"2",
"3",
"4",
"5",
"6",
"7",
"8",
"9",
"10",
"11",
"09:41"
],
"pngPath": "/evaluations/kimi-k3-1-pro-anthropic-clock-low-1/assets/clock-low.png",
"width": 1200,
"height": 900,
"pngSha256": "e9a95f2cbf332e9924a7fb832e12481d1d9c51e92a504b8a5b34f8f4363bf79b",
"renderer": "sharp/libvips SVG rasterization at 1200px width; no visual edits",
"attemptNumber": 1,
"kind": "static",
"sourceEvidence": "/evaluations/kimi-k3-1-pro-anthropic-first.json",
"localEvidence": "output/kimi-k3-1-pro-anthro-20261024/first-low/evidence.json",
"timeoutMs": 600000,
"visuallyInspected": true,
"sourceInspected": true,
"verdict": "meets-static-rubric",
"assessmentZh": "12 个数字顺时针排列完整，钟面与下方 09:41 标签清楚。源码将时针从朝上方向旋转 290.5°、分针旋转 246°，长度分别为 118 和 170，准确表现 9:41；没有多余秒针，留白和对比度良好。",
"assessmentEn": "All twelve numbers appear in the correct clockwise order, with a clear 09:41 label below the dial. The source rotates the hour hand 290.5° and the minute hand 246° from twelve, with lengths 118 and 170 respectively. It shows 9:41 correctly, has no extra second hand, and keeps generous spacing and strong contrast.",
"checks": {
"allTwelveNumbersExactlyOnce": true,
"correctNumberOrder": true,
"hourAngleCorrect": true,
"minuteAngleCorrect": true,
"hourShorterThanMinute": true,
"noSecondHand": true,
"labelCorrectAndUnclipped": true
},
"sourceChecks": {
"center": [
400,
270
],
"hourDegreesClockwiseFromTwelve": 290.5,
"minuteDegreesClockwiseFromTwelve": 246,
"hourLength": 118,
"minuteLength": 170,
"label": "09:41",
"viewBox": "0 0 800 600"
},
"altZh": "Kimi K3.1 Pro low：9:41 模拟钟表",
"altEn": "Kimi K3.1 Pro low: An analog clock at 9:41"
},
{
"id": "clock",
"title": "9:41 模拟钟表",
"titleEn": "An analog clock at 9:41",
"prompt": "Return only a complete, self-contained static SVG with viewBox=\"0 0 800 600\". Draw a clear analog clock showing exactly 9:41, with all twelve numbers 1 through 12. The hour hand must be correctly positioned between 9 and 10, not exactly on 9. The minute hand must indicate minute 41. Use a shorter hour hand and a longer minute hand, no second hand. Add a small label \"09:41\" below the dial. Do not use scripts, external assets or embedded images.",
"rubricZh": [
"12 个数字完整、顺序正确",
"分针指向第 41 分钟（从 12 点顺时针 246°）",
"时针指向 9 点后 41 分钟（290.5°），且短于分针"
],
"rubricEn": [
"Twelve numbers in the correct order",
"Minute hand at 246 degrees clockwise from 12",
"Shorter hour hand at 290.5 degrees, between 9 and 10"
],
"mode": "max",
"status": "done",
"text": "",
"startedAt": "2026-10-24T01:28:38.643Z",
"request": {
"model": "k3.1-pro",
"messages": [
{
"role": "user",
"content": "Return only a complete, self-contained static SVG with viewBox=\"0 0 800 600\". Draw a clear analog clock showing exactly 9:41, with all twelve numbers 1 through 12. The hour hand must be correctly positioned between 9 and 10, not exactly on 9. The minute hand must indicate minute 41. Use a shorter hour hand and a longer minute hand, no second hand. Add a small label \"09:41\" below the dial. Do not use scripts, external assets or embedded images."
}
],
"max_tokens": 12288,
"stream": true,
"output_config": {
"effort": "max"
}
},
"firstContentMs": 118126.324375,
"firstReasoningMs": 1136.7009160000016,
"firstEventMs": 1136.6892079999961,
"usage": {
"input_tokens": 196,
"cache_creation_input_tokens": 0,
"cache_read_input_tokens": 0,
"output_tokens": 8357,
"service_tier": "standard",
"inference_geo": "not_available",
"output_tokens_details": {
"thinking_tokens": 7212
}
},
"finishReason": "end_turn",
"error": null,
"returnedModel": "k3.1-pro",
"httpStatus": 200,
"transport": "node:https",
"finishedAt": "2026-10-24T01:30:49.388Z",
"totalMs": 130745.65966599996,
"promptTokens": 196,
"outputTokens": 8357,
"reasoningTokens": 7212,
"renderable": true,
"svgPath": "/evaluations/kimi-k3-1-pro-anthropic-clock-max-1/assets/clock-max.svg",
"svgSha256": "ead8c1e13f5ba8881d43dffdb342c1783970c9d3b2e5839f1c84627c2c7d7423",
"extraction": "Exact first SVG element from response; surrounding prose or code fence omitted, SVG bytes unchanged.",
"viewBox": "0 0 800 600",
"texts": [
"12",
"1",
"2",
"3",
"4",
"5",
"6",
"7",
"8",
"9",
"10",
"11",
"09:41"
],
"pngPath": "/evaluations/kimi-k3-1-pro-anthropic-clock-max-1/assets/clock-max.png",
"width": 1200,
"height": 900,
"pngSha256": "4e50412f717f79bb0ba4e8a2033ce6e7f8c44aa646f66ccb905904bbea6907b3",
"renderer": "sharp/libvips SVG rasterization at 1200px width; no visual edits",
"attemptNumber": 1,
"kind": "static",
"sourceEvidence": "/evaluations/kimi-k3-1-pro-anthropic-first.json",
"localEvidence": "output/kimi-k3-1-pro-anthro-20261024/first-max/evidence.json",
"timeoutMs": 600000,
"visuallyInspected": true,
"sourceInspected": true,
"verdict": "meets-static-rubric",
"assessmentZh": "钟面包含顺序正确的 12 个数字和完整分钟刻度，09:41 标签与钟面分离清楚。源码两针旋转角为 290.5° 与 246°，时针长 100、分针长 140，读数和长短均正确；无秒针，也没有文字遮挡。",
"assessmentEn": "The dial contains all twelve numbers in the correct order and a full minute scale, with a separate readable 09:41 label. Source rotations are 290.5° and 246°, and the hour/minute lengths are 100 and 140, so both the time and relative lengths are correct. There is no second hand or overlapping text.",
"checks": {
"allTwelveNumbersExactlyOnce": true,
"correctNumberOrder": true,
"hourAngleCorrect": true,
"minuteAngleCorrect": true,
"hourShorterThanMinute": true,
"noSecondHand": true,
"labelCorrectAndUnclipped": true
},
"sourceChecks": {
"center": [
400,
270
],
"hourDegreesClockwiseFromTwelve": 290.5,
"minuteDegreesClockwiseFromTwelve": 246,
"hourLength": 100,
"minuteLength": 140,
"minuteTickCount": 60,
"label": "09:41",
"viewBox": "0 0 800 600"
},
"altZh": "Kimi K3.1 Pro max：9:41 模拟钟表",
"altEn": "Kimi K3.1 Pro max: An analog clock at 9:41"
},
{
"id": "dashboard",
"title": "数据图表与比例",
"titleEn": "Data chart and proportional bars",
"prompt": "Return only a complete, self-contained static SVG with viewBox=\"0 0 800 600\". Design a polished dashboard card titled \"Quarterly Revenue\". Draw a vertical bar chart for Q1=12, Q2=24, Q3=18, Q4=30, in that left-to-right order. All four bars must share a zero baseline, and bar heights must be exactly proportional to the values. Show a y-axis labeled 0, 10, 20, 30 and show the value above each bar. Add summary labels \"Total: 84\" and \"Best: Q4\". Use a light background and readable typography. Do not use scripts, external assets or embedded images.",
"rubricZh": [
"Q1 到 Q4 的顺序、数值与总计 84 正确",
"四柱共享零基线，高度比例为 2:4:3:5",
"刻度、柱顶数字与摘要清楚，无遮挡"
],
"rubricEn": [
"Correct quarter order, values and total of 84",
"Shared zero baseline and heights in the ratio 2:4:3:5",
"Readable axis, values and summaries without overlap"
],
"mode": "default",
"status": "done",
"text": "",
"startedAt": "2026-10-24T01:32:36.550Z",
"request": {
"model": "k3.1-pro",
"messages": [
{
"role": "user",
"content": "Return only a complete, self-contained static SVG with viewBox=\"0 0 800 600\". Design a polished dashboard card titled \"Quarterly Revenue\". Draw a vertical bar chart for Q1=12, Q2=24, Q3=18, Q4=30, in that left-to-right order. All four bars must share a zero baseline, and bar heights must be exactly proportional to the values. Show a y-axis labeled 0, 10, 20, 30 and show the value above each bar. Add summary labels \"Total: 84\" and \"Best: Q4\". Use a light background and readable typography. Do not use scripts, external assets or embedded images."
}
],
"max_tokens": 12288,
"stream": true
},
"firstContentMs": 167006.86200000002,
"firstReasoningMs": 2665.542666000023,
"firstEventMs": 2665.541957999987,
"usage": {
"input_tokens": 229,
"cache_creation_input_tokens": 0,
"cache_read_input_tokens": 0,
"output_tokens": 9631,
"service_tier": "standard",
"inference_geo": "not_available",
"output_tokens_details": {
"thinking_tokens": 8213
}
},
"finishReason": "end_turn",
"error": null,
"returnedModel": "k3.1-pro",
"httpStatus": 200,
"transport": "node:https",
"finishedAt": "2026-10-24T01:35:42.584Z",
"totalMs": 186035.74225000007,
"promptTokens": 229,
"outputTokens": 9631,
"reasoningTokens": 8213,
"renderable": true,
"svgPath": "/evaluations/kimi-k3-1-pro-anthropic-dashboard-default-1/assets/dashboard-default.svg",
"svgSha256": "52b62ea0bef7134d9153e4f138295404b468fd9e755b193d6999bde40d060f45",
"extraction": "Exact first SVG element from response; surrounding prose or code fence omitted, SVG bytes unchanged.",
"viewBox": "0 0 800 600",
"texts": [
"Quarterly Revenue",
"Revenue by quarter",
"Total: 84",
"Best: Q4",
"30",
"20",
"10",
"0",
"12",
"24",
"18",
"30",
"Q1",
"Q2",
"Q3",
"Q4"
],
"pngPath": "/evaluations/kimi-k3-1-pro-anthropic-dashboard-default-1/assets/dashboard-default.png",
"width": 1200,
"height": 900,
"pngSha256": "e9887cfb658529cd0aaa3e8a2056ed73de64a98028799588990dd47b3696a635",
"renderer": "sharp/libvips SVG rasterization at 1200px width; no visual edits",
"attemptNumber": 1,
"kind": "static",
"sourceEvidence": "/evaluations/kimi-k3-1-pro-anthropic-first.json",
"localEvidence": "output/kimi-k3-1-pro-anthro-20261024/first-default/evidence.json",
"timeoutMs": 600000,
"visuallyInspected": true,
"sourceInspected": true,
"verdict": "meets-static-rubric",
"assessmentZh": "标题、总计 84、最佳 Q4 与四季度数值全部正确。源码主图四柱底部均为 y=478，高度 96、192、144、240，比例精确为 2:4:3:5；纵轴每 10 单位间距 80 像素，与柱高吻合。柱顶数值和季度标签清楚，无重叠或越界。",
"assessmentEn": "The title, total of 84, best quarter Q4 and all four values are correct. Main-chart bars share y=478 as their bottom and have heights 96, 192, 144 and 240, exactly 2:4:3:5. Ten-unit axis intervals span 80 pixels, matching the bars. Value and quarter labels are readable without overlap or clipping.",
"checks": {
"quarterOrderAndValuesCorrect": true,
"totalAndBestCorrect": true,
"sharedZeroBaseline": true,
"exactHeightRatio": true,
"axisScaleConsistent": true,
"readableWithoutOverlap": true
},
"sourceChecks": {
"barTopY": [
382,
286,
334,
238
],
"barHeights": [
96,
192,
144,
240
],
"barBottomY": [
478,
478,
478,
478
],
"ratio": [
2,
4,
3,
5
],
"pixelsPerUnit": 8,
"axisValues": [
0,
10,
20,
30
],
"total": 84,
"best": "Q4",
"viewBox": "0 0 800 600"
},
"altZh": "Kimi K3.1 Pro default：数据图表与比例",
"altEn": "Kimi K3.1 Pro default: Data chart and proportional bars"
},
{
"id": "dashboard",
"title": "数据图表与比例",
"titleEn": "Data chart and proportional bars",
"prompt": "Return only a complete, self-contained static SVG with viewBox=\"0 0 800 600\". Design a polished dashboard card titled \"Quarterly Revenue\". Draw a vertical bar chart for Q1=12, Q2=24, Q3=18, Q4=30, in that left-to-right order. All four bars must share a zero baseline, and bar heights must be exactly proportional to the values. Show a y-axis labeled 0, 10, 20, 30 and show the value above each bar. Add summary labels \"Total: 84\" and \"Best: Q4\". Use a light background and readable typography. Do not use scripts, external assets or embedded images.",
"rubricZh": [
"Q1 到 Q4 的顺序、数值与总计 84 正确",
"四柱共享零基线，高度比例为 2:4:3:5",
"刻度、柱顶数字与摘要清楚，无遮挡"
],
"rubricEn": [
"Correct quarter order, values and total of 84",
"Shared zero baseline and heights in the ratio 2:4:3:5",
"Readable axis, values and summaries without overlap"
],
"mode": "low",
"status": "done",
"text": "",
"startedAt": "2026-10-24T01:28:43.467Z",
"request": {
"model": "k3.1-pro",
"messages": [
{
"role": "user",
"content": "Return only a complete, self-contained static SVG with viewBox=\"0 0 800 600\". Design a polished dashboard card titled \"Quarterly Revenue\". Draw a vertical bar chart for Q1=12, Q2=24, Q3=18, Q4=30, in that left-to-right order. All four bars must share a zero baseline, and bar heights must be exactly proportional to the values. Show a y-axis labeled 0, 10, 20, 30 and show the value above each bar. Add summary labels \"Total: 84\" and \"Best: Q4\". Use a light background and readable typography. Do not use scripts, external assets or embedded images."
}
],
"max_tokens": 12288,
"stream": true,
"output_config": {
"effort": "low"
}
},
"firstContentMs": 32175.79795800001,
"firstReasoningMs": 1579.054124999995,
"firstEventMs": 1579.053500000009,
"usage": {
"input_tokens": 230,
"cache_creation_input_tokens": 0,
"cache_read_input_tokens": 0,
"output_tokens": 2812,
"service_tier": "standard",
"inference_geo": "not_available",
"output_tokens_details": {
"thinking_tokens": 1405
}
},
"finishReason": "end_turn",
"error": null,
"returnedModel": "k3.1-pro",
"httpStatus": 200,
"transport": "node:https",
"finishedAt": "2026-10-24T01:29:33.340Z",
"totalMs": 49873.374332999985,
"promptTokens": 230,
"outputTokens": 2812,
"reasoningTokens": 1405,
"renderable": true,
"svgPath": "/evaluations/kimi-k3-1-pro-anthropic-dashboard-low-1/assets/dashboard-low.svg",
"svgSha256": "dd2d9eb4ae136f6a7c783db6abdd6b1d05f6e264054eee6a8c1f3591206495f7",
"extraction": "Exact first SVG element from response; surrounding prose or code fence omitted, SVG bytes unchanged.",
"viewBox": "0 0 800 600",
"texts": [
"Quarterly Revenue",
"Performance across all four quarters",
"Total: 84",
"Best: Q4",
"30",
"20",
"10",
"0",
"12",
"24",
"18",
"30",
"Q1",
"Q2",
"Q3",
"Q4",
"Q4 delivered the highest quarterly revenue"
],
"pngPath": "/evaluations/kimi-k3-1-pro-anthropic-dashboard-low-1/assets/dashboard-low.png",
"width": 1200,
"height": 900,
"pngSha256": "ab451e4c741ecaa619418e554956198e853dd455234c26240c461c2cbcaa083d",
"renderer": "sharp/libvips SVG rasterization at 1200px width; no visual edits",
"attemptNumber": 1,
"kind": "static",
"sourceEvidence": "/evaluations/kimi-k3-1-pro-anthropic-first.json",
"localEvidence": "output/kimi-k3-1-pro-anthro-20261024/first-low/evidence.json",
"timeoutMs": 600000,
"visuallyInspected": true,
"sourceInspected": true,
"verdict": "meets-static-rubric",
"assessmentZh": "Q1–Q4 与 12、24、18、30 对应正确，Total: 84 和 Best: Q4 均齐全。源码四柱底部都在 y=450，高度 108、216、162、270，严格满足 2:4:3:5；0/10/20/30 刻度使用统一的每单位 9 像素比例。柱顶数值、摘要和轴标签无遮挡，浅色卡片层次清楚。",
"assessmentEn": "Q1–Q4 correctly show 12, 24, 18 and 30, with Total: 84 and Best: Q4. All four source rectangles end at y=450 and have heights 108, 216, 162 and 270, exactly 2:4:3:5. The 0/10/20/30 ticks share the same nine-pixels-per-unit scale. Values, summaries and axis labels remain clear without overlap.",
"checks": {
"quarterOrderAndValuesCorrect": true,
"totalAndBestCorrect": true,
"sharedZeroBaseline": true,
"exactHeightRatio": true,
"axisScaleConsistent": true,
"readableWithoutOverlap": true
},
"sourceChecks": {
"barTopY": [
342,
234,
288,
180
],
"barHeights": [
108,
216,
162,
270
],
"barBottomY": [
450,
450,
450,
450
],
"ratio": [
2,
4,
3,
5
],
"pixelsPerUnit": 9,
"axisValues": [
0,
10,
20,
30
],
"total": 84,
"best": "Q4",
"viewBox": "0 0 800 600"
},
"altZh": "Kimi K3.1 Pro low：数据图表与比例",
"altEn": "Kimi K3.1 Pro low: Data chart and proportional bars"
},
{
"id": "dashboard",
"title": "数据图表与比例",
"titleEn": "Data chart and proportional bars",
"prompt": "Return only a complete, self-contained static SVG with viewBox=\"0 0 800 600\". Design a polished dashboard card titled \"Quarterly Revenue\". Draw a vertical bar chart for Q1=12, Q2=24, Q3=18, Q4=30, in that left-to-right order. All four bars must share a zero baseline, and bar heights must be exactly proportional to the values. Show a y-axis labeled 0, 10, 20, 30 and show the value above each bar. Add summary labels \"Total: 84\" and \"Best: Q4\". Use a light background and readable typography. Do not use scripts, external assets or embedded images.",
"rubricZh": [
"Q1 到 Q4 的顺序、数值与总计 84 正确",
"四柱共享零基线，高度比例为 2:4:3:5",
"刻度、柱顶数字与摘要清楚，无遮挡"
],
"rubricEn": [
"Correct quarter order, values and total of 84",
"Shared zero baseline and heights in the ratio 2:4:3:5",
"Readable axis, values and summaries without overlap"
],
"mode": "max",
"status": "done",
"text": "",
"startedAt": "2026-10-24T01:30:49.393Z",
"request": {
"model": "k3.1-pro",
"messages": [
{
"role": "user",
"content": "Return only a complete, self-contained static SVG with viewBox=\"0 0 800 600\". Design a polished dashboard card titled \"Quarterly Revenue\". Draw a vertical bar chart for Q1=12, Q2=24, Q3=18, Q4=30, in that left-to-right order. All four bars must share a zero baseline, and bar heights must be exactly proportional to the values. Show a y-axis labeled 0, 10, 20, 30 and show the value above each bar. Add summary labels \"Total: 84\" and \"Best: Q4\". Use a light background and readable typography. Do not use scripts, external assets or embedded images."
}
],
"max_tokens": 12288,
"stream": true,
"output_config": {
"effort": "max"
}
},
"firstContentMs": 111357.13974999997,
"firstReasoningMs": 1680.4650419999962,
"firstEventMs": 1680.4645829999936,
"usage": {
"input_tokens": 229,
"cache_creation_input_tokens": 0,
"cache_read_input_tokens": 0,
"output_tokens": 6813,
"service_tier": "standard",
"inference_geo": "not_available",
"output_tokens_details": {
"thinking_tokens": 5320
}
},
"finishReason": "end_turn",
"error": null,
"returnedModel": "k3.1-pro",
"httpStatus": 200,
"transport": "node:https",
"finishedAt": "2026-10-24T01:32:58.784Z",
"totalMs": 129391.34237500001,
"promptTokens": 229,
"outputTokens": 6813,
"reasoningTokens": 5320,
"renderable": true,
"svgPath": "/evaluations/kimi-k3-1-pro-anthropic-dashboard-max-1/assets/dashboard-max.svg",
"svgSha256": "91351fe1bdd2c63aef6c603fd1d8555baa8eddcd2c346d5657eeccb78316ef39",
"extraction": "Exact first SVG element from response; surrounding prose or code fence omitted, SVG bytes unchanged.",
"viewBox": "0 0 800 600",
"texts": [
"Quarterly Revenue",
"Performance overview",
"Total: 84",
"Best: Q4",
"30",
"20",
"10",
"0",
"12",
"24",
"18",
"30",
"Q1",
"Q2",
"Q3",
"Q4"
],
"pngPath": "/evaluations/kimi-k3-1-pro-anthropic-dashboard-max-1/assets/dashboard-max.png",
"width": 1200,
"height": 900,
"pngSha256": "62cfa94396c84169a5697494c0298f08c049a31424ea61704c779d7b64ff557c",
"renderer": "sharp/libvips SVG rasterization at 1200px width; no visual edits",
"attemptNumber": 1,
"kind": "static",
"sourceEvidence": "/evaluations/kimi-k3-1-pro-anthropic-first.json",
"localEvidence": "output/kimi-k3-1-pro-anthro-20261024/first-max/evidence.json",
"timeoutMs": 600000,
"visuallyInspected": true,
"sourceInspected": true,
"verdict": "meets-static-rubric",
"assessmentZh": "四季度顺序与柱顶数值正确，Total: 84、Best: Q4 清楚。源码四柱统一落到 y=460，高度为 96、192、144、240，比例精确为 2:4:3:5；刻度每 10 单位相差 80 像素，与柱高一致。摘要、轴与数值没有挤在一起，Q4 用独立色突出。",
"assessmentEn": "Quarter order, values, Total: 84 and Best: Q4 are correct and readable. All bars end at y=460, with heights 96, 192, 144 and 240, exactly 2:4:3:5. Each ten-unit tick interval is 80 pixels, consistent with the bars. Summaries and labels do not overlap, and a separate color highlights Q4.",
"checks": {
"quarterOrderAndValuesCorrect": true,
"totalAndBestCorrect": true,
"sharedZeroBaseline": true,
"exactHeightRatio": true,
"axisScaleConsistent": true,
"readableWithoutOverlap": true
},
"sourceChecks": {
"barTopY": [
364,
268,
316,
220
],
"barHeights": [
96,
192,
144,
240
],
"barBottomY": [
460,
460,
460,
460
],
"ratio": [
2,
4,
3,
5
],
"pixelsPerUnit": 8,
"axisValues": [
0,
10,
20,
30
],
"total": 84,
"best": "Q4",
"viewBox": "0 0 800 600"
},
"altZh": "Kimi K3.1 Pro max：数据图表与比例",
"altEn": "Kimi K3.1 Pro max: Data chart and proportional bars"
},
{
"id": "pelican",
"title": "鹈鹕骑自行车",
"titleEn": "Pelican riding a bicycle",
"source": "https://simonwillison.net/2024/Oct/25/pelicans-on-a-bicycle/",
"prompt": "Generate an SVG of a pelican riding a bicycle",
"rubricZh": [
"能辨认出鹈鹕的长喙与喉囊",
"自行车有两轮和连贯的车架",
"身体、车座、脚踏、车把之间的位置合理"
],
"rubricEn": [
"Recognizable pelican bill and pouch",
"Two wheels and a connected bicycle frame",
"Coherent rider, saddle, pedals and handlebar relationships"
],
"mode": "default",
"status": "truncated",
"text": "```svg\n