aleleba
bf795bd01c
10/10 prompts measured. VEREDICTO: NO APRUEBA (score medio 39.8 vs threshold 65, veto limpio 8/10, 3/10 prompts >=60). The flagship g5-06-landing-pizzeria now clears its own threshold (69.6 >= 60) once a transient Penpot MCP transport drop is ruled out (see g5-06/g5-07 rerun below) -- a real improvement over v2-bf16's 34.8 on that prompt, but the aggregate gate criteria still fail. g5-03-card-producto is flagged via GATE5_KNOWN_OVERLAP_IDS: it shares a 6-gram with seeds 134-137 already baked into v2b-bf16's training, so its result should be read with caution rather than as a clean generalization signal. g5-06/g5-07 were re-measured once with GATE5_ONLY + GATE5_PROMPT_TIMEOUT_S=420 (default 240s untouched) after their first pass hit a genuine Penpot MCP transport drop (ConnectionError + handshake rebuild) that ate into the turn budget and caused a false-negative timeout. g5-04 and g5-08 show the same 'no board created' signature but their raw turn-by-turn transcripts have zero MCP/transport/handshake evidence -- both are the known post-error tool-call-format bug (literal '<tool_call>' text instead of a structured call), so they are left as genuine failures with no rerun.
65 lines
4.0 KiB
JSON
65 lines
4.0 KiB
JSON
{
|
|
"total": 91,
|
|
"nombres": [
|
|
"gate5/prod-baseline/g5-01-boton-primario/20260730T172916Z",
|
|
"gate5/prod-baseline/g5-01-boton-primario/20260730T173054Z",
|
|
"gate5/prod-baseline/g5-02-navbar-flex/20260730T173154Z",
|
|
"gate5/prod-baseline/g5-03-card-producto/20260730T173348Z",
|
|
"gate5/prod-baseline/g5-04-tokens-biblioteca/20260730T173445Z",
|
|
"gate5/prod-baseline/g5-01-boton-primario/20260730T175220Z",
|
|
"gate5/prod-baseline/g5-02-navbar-flex/20260730T175644Z",
|
|
"gate5/prod-baseline/g5-03-card-producto/20260730T175753Z",
|
|
"gate5/prod-baseline/g5-04-tokens-biblioteca/20260730T175855Z",
|
|
"gate5/prod-baseline/g5-05-grid-tres-diferenciales/20260730T175957Z",
|
|
"gate5/prod-baseline/g5-06-landing-pizzeria/20260730T180102Z",
|
|
"gate5/prod-baseline/g5-06-landing-pizzeria/20260730T180102Z",
|
|
"gate5/prod-baseline/g5-07-onboarding-mobile/20260730T180525Z",
|
|
"gate5/prod-baseline/g5-08-reparacion-grises/20260730T180627Z",
|
|
"gate5/prod-baseline/g5-01-boton-primario/20260730T182503Z",
|
|
"gate5/prod-baseline/g5-02-navbar-flex/20260730T182608Z",
|
|
"gate5/prod-baseline/g5-03-card-producto/20260730T182706Z",
|
|
"gate5/prod-baseline/g5-04-tokens-biblioteca/20260730T182804Z",
|
|
"gate5/prod-baseline/g5-05-grid-tres-diferenciales/20260730T182903Z",
|
|
"gate5/prod-baseline/g5-06-landing-pizzeria/20260730T183005Z",
|
|
"gate5/prod-baseline/g5-06-landing-pizzeria/20260730T184056Z",
|
|
"gate5/prod-baseline/g5-07-onboarding-mobile/20260730T184149Z",
|
|
"gate5/prod-baseline/g5-08-reparacion-grises/20260730T184315Z",
|
|
"gate5/prod-baseline/g5-09-brief-ambiguo-escuela/20260730T184430Z",
|
|
"gate5/prod-baseline/g5-10-brief-ambiguo-notaria/20260730T184545Z",
|
|
"gate5/prod-baseline/g5-01-boton-primario/20260730T185500Z",
|
|
"gate5/prod-baseline/g5-02-navbar-flex/20260730T185524Z",
|
|
"gate5/prod-baseline/g5-03-card-producto/20260730T185644Z",
|
|
"gate5/prod-baseline/g5-01-boton-primario/20260730T185903Z",
|
|
"gate5/prod-baseline/g5-02-navbar-flex/20260730T190011Z",
|
|
"gate5/prod-baseline/g5-03-card-producto/20260730T190118Z",
|
|
"gate5/prod-baseline/g5-04-tokens-biblioteca/20260730T190325Z",
|
|
"gate5/prod-baseline/g5-05-grid-tres-diferenciales/20260730T190422Z",
|
|
"gate5/prod-baseline/g5-06-landing-pizzeria/20260730T195152Z",
|
|
"gate5/prod-baseline/g5-07-onboarding-mobile/20260730T195316Z",
|
|
"gate5/prod-baseline/g5-01-boton-primario/20260730T202853Z",
|
|
"gate5/prod-baseline/g5-02-navbar-flex/20260730T202941Z",
|
|
"gate5/prod-baseline/g5-03-card-producto/20260730T203050Z",
|
|
"gate5/prod-baseline/g5-04-tokens-biblioteca/20260730T203125Z",
|
|
"gate5/prod-baseline/g5-05-grid-tres-diferenciales/20260730T203222Z",
|
|
"gate5/prod-baseline/g5-06-landing-pizzeria/20260730T203242Z",
|
|
"gate5/prod-baseline/g5-07-onboarding-mobile/20260730T203420Z",
|
|
"gate5/prod-baseline/g5-08-reparacion-grises/20260730T203514Z",
|
|
"gate5/prod-baseline/g5-09-brief-ambiguo-escuela/20260730T203547Z",
|
|
"gate5/prod-baseline/g5-10-brief-ambiguo-notaria/20260730T203756Z",
|
|
"gate5/prod-baseline-r2/g5-01-boton-primario/20260730T203937Z",
|
|
"gate5/prod-baseline-r2/g5-02-navbar-flex/20260730T204044Z",
|
|
"gate5/prod-baseline-r2/g5-03-card-producto/20260730T204125Z",
|
|
"gate5/prod-baseline-r2/g5-04-tokens-biblioteca/20260730T204133Z",
|
|
"gate5/prod-baseline-r2/g5-05-grid-tres-diferenciales/20260730T204253Z",
|
|
"gate5/prod-baseline-r2/g5-06-landing-pizzeria/20260730T204311Z",
|
|
"gate5/prod-baseline-r2/g5-07-onboarding-mobile/20260730T204324Z",
|
|
"gate5/prod-baseline-r2/g5-08-reparacion-grises/20260730T204441Z",
|
|
"gate5/prod-baseline-r2/g5-09-brief-ambiguo-escuela/20260730T204538Z",
|
|
"gate5/prod-baseline-r2/g5-10-brief-ambiguo-notaria/20260730T204614Z",
|
|
"gate5/prod-baseline-r3/g5-01-boton-primario/20260730T205024Z",
|
|
"gate5/prod-baseline-r3/g5-02-navbar-flex/20260730T205152Z",
|
|
"gate5/prod-baseline-r3/g5-03-card-producto/20260730T205252Z",
|
|
"gate5/prod-baseline-r3/g5-04-tokens-biblioteca/20260730T205306Z",
|
|
"gate5/prod-baseline-r3/g5-05-grid-tres-diferenciales/20260730T205413Z"
|
|
]
|
|
} |