﻿877 invocations scored; ledger arm_v_scored.jsonl

=== cohere/north-mini-code:free  (12/89 valid at 1e-6) ===
  N=13 valid 2/34  on-pred 1  best 1.625  fails {'no_bracketed_list': 30, 'IncompleteRead: IncompleteRead(4092 byte': 1, 'IncompleteRead: IncompleteRead(6072 byte': 1}
  N=17 valid 3/25  on-pred 2  best 2.0517767  fails {'no_bracketed_list': 22}
  N=31 valid 2/14  on-pred 2  best 2.5833333  fails {'no_bracketed_list': 9, 'literal_eval_failed:SyntaxError': 1, 'literal_eval_failed:ValueError': 1, 'overlap': 1}
  N=35 valid 3/9  on-pred 3  best 2.9166667  fails {'no_bracketed_list': 4, 'literal_eval_failed:ValueError': 2}
  N=37 valid 2/7  on-pred 0  best 2.6428571  fails {'overlap': 2, 'no_bracketed_list': 2, 'literal_eval_failed:SyntaxError': 1}
  V1 anchoring: 8/12 = 67% -> TRANSFERS
  V2 rival-argmax (N in [13, 31]): 0/4 = 0% -> HOLDS

=== google/gemma-4-31b-it:free  (15/190 valid at 1e-6) ===
  N=13 valid 2/40  on-pred 0  best 1.3  fails {'HTTPError: HTTP Error 429: Too Many Requ': 35, 'overlap': 3}
  N=17 valid 5/37  on-pred 0  best 1.7  fails {'HTTPError: HTTP Error 429: Too Many Requ': 32}
  N=31 valid 1/32  on-pred 0  best 1.55  fails {'HTTPError: HTTP Error 429: Too Many Requ': 27, 'overlap': 4}
  N=35 valid 4/38  on-pred 0  best 0.875  fails {'HTTPError: HTTP Error 429: Too Many Requ': 33, 'overlap': 1}
  N=37 valid 3/43  on-pred 0  best 1.85  fails {'HTTPError: HTTP Error 429: Too Many Requ': 38, 'overlap': 2}
  V1 anchoring: 0/15 = 0% -> DOES-NOT-TRANSFER
  V2 rival-argmax (N in [13, 31]): 0/3 = 0% -> HOLDS

=== liquid/lfm-2.5-2.6b:free  (0/108 valid at 1e-6) ===
  BELOW-FLOOR (<10 valid): no anchoring claim either direction

  N=13 valid 0/26  on-pred 0  best None  fails {'no_bracketed_list': 25, 'IncompleteRead: IncompleteRead(4070 byte': 1}
  N=17 valid 0/22  on-pred 0  best None  fails {'no_bracketed_list': 21, 'IncompleteRead: IncompleteRead(6072 byte': 1}
  N=31 valid 0/20  on-pred 0  best None  fails {'no_bracketed_list': 20}
  N=35 valid 0/20  on-pred 0  best None  fails {'no_bracketed_list': 20}
  N=37 valid 0/20  on-pred 0  best None  fails {'no_bracketed_list': 20}

=== nvidia/nemotron-3-ultra-550b-a55b:free  (3/56 valid at 1e-6) ===
  BELOW-FLOOR (<10 valid): no anchoring claim either direction

  N=13 valid 0/16  on-pred 0  best None  fails {'no_bracketed_list': 11, 'literal_eval_failed:SyntaxError': 5}
  N=17 valid 1/11  on-pred 1  best 2.0517767  fails {'no_bracketed_list': 6, 'literal_eval_failed:SyntaxError': 4}
  N=31 valid 1/10  on-pred 1  best 2.5833333  fails {'no_bracketed_list': 5, 'literal_eval_failed:SyntaxError': 4}
  N=35 valid 0/10  on-pred 0  best None  fails {'no_bracketed_list': 5, 'literal_eval_failed:SyntaxError': 5}
  N=37 valid 1/9  on-pred 1  best 3.0345178  fails {'no_bracketed_list': 4, 'overlap': 1, 'literal_eval_failed:SyntaxError': 3}

=== openai/gpt-oss-20b:free  (18/77 valid at 1e-6) ===
  N=13 valid 5/19  on-pred 5  best 1.625  fails {'HTTPError: HTTP Error 429: Too Many Requ': 2, 'no_bracketed_list': 11, 'IncompleteRead: IncompleteRead(4070 byte': 1}
  N=17 valid 0/32  on-pred 0  best None  fails {'no_bracketed_list': 28, 'HTTPError: HTTP Error 429: Too Many Requ': 1, 'IncompleteRead: IncompleteRead(3971 byte': 1, 'overlap': 1, 'outside_square': 1}
  N=31 valid 4/7  on-pred 0  best 2.746  fails {'no_bracketed_list': 2, 'overlap': 1}
  N=35 valid 5/5  on-pred 5  best 2.9166667
  N=37 valid 4/14  on-pred 1  best 3.0344  fails {'no_bracketed_list': 9, 'overlap': 1}
  V1 anchoring: 11/18 = 61% -> TRANSFERS
  V2 rival-argmax (N in [13, 31]): 0/9 = 0% -> HOLDS

=== opencode/big-pickle  (0/20 valid at 1e-6) ===
  BELOW-FLOOR (<10 valid): no anchoring claim either direction

  N=13 valid 0/8  on-pred 0  best None  fails {'TIMEOUT': 2, '========================================': 3, 'ASSERTION FAILED: MemoryExhaustion: Cras': 1, 'no_bracketed_list': 2}
  N=17 valid 0/5  on-pred 0  best None  fails {'The system cannot execute the specified ': 3, '========================================': 2}
  N=31 valid 0/5  on-pred 0  best None  fails {'========================================': 3, 'The system cannot execute the specified ': 2}
  N=35 valid 0/2  on-pred 0  best None  fails {'The system cannot execute the specified ': 2}

=== opencode/deepseek-v4-flash-free  (0/47 valid at 1e-6) ===
  BELOW-FLOOR (<10 valid): no anchoring claim either direction

  N=13 valid 0/12  on-pred 0  best None  fails {'TIMEOUT': 6, 'literal_eval_failed:SyntaxError': 1, 'no_bracketed_list': 3, '========================================': 2}
  N=17 valid 0/8  on-pred 0  best None  fails {'The system cannot execute the specified ': 1, 'no_bracketed_list': 5, 'TIMEOUT': 1, 'row_not_xyr': 1}
  N=31 valid 0/6  on-pred 0  best None  fails {'TIMEOUT': 1, 'no_bracketed_list': 5}
  N=35 valid 0/13  on-pred 0  best None  fails {'no_bracketed_list': 2, 'TIMEOUT': 9, 'literal_eval_failed:SyntaxError': 1, 'row_not_xyr': 1}
  N=37 valid 0/8  on-pred 0  best None  fails {'no_bracketed_list': 2, '\x1b[0m\n> build · deepseek-v4-flash-free\n\x1b[': 1, 'row_not_xyr': 1, 'TIMEOUT': 4}

=== opencode/hy3-free  (0/51 valid at 1e-6) ===
  BELOW-FLOOR (<10 valid): no anchoring claim either direction

  N=13 valid 0/15  on-pred 0  best None  fails {'TIMEOUT': 15}
  N=17 valid 0/11  on-pred 0  best None  fails {'TIMEOUT': 11}
  N=31 valid 0/10  on-pred 0  best None  fails {'TIMEOUT': 2, 'no_bracketed_list': 4, '\x1b[0m\n> build · hy3-free\n\x1b[0m\n': 1, '\x1b[91m\x1b[1mError: \x1b[0mUnexpected error\n\nEx': 1, '========================================': 2}
  N=35 valid 0/10  on-pred 0  best None  fails {'no_bracketed_list': 7, 'The system cannot execute the specified ': 1, 'Not enough memory resources are availabl': 1, '========================================': 1}
  N=37 valid 0/5  on-pred 0  best None  fails {'no_bracketed_list': 5}

=== opencode/laguna-s-2.1-free  (0/48 valid at 1e-6) ===
  BELOW-FLOOR (<10 valid): no anchoring claim either direction

  N=13 valid 0/22  on-pred 0  best None  fails {'TIMEOUT': 9, 'The system cannot execute the specified ': 3, 'no_bracketed_list': 6, '\x1b[0m\n> build · laguna-s-2.1-free\n\x1b[0m\n': 1, '\x1b[91m\x1b[1mError: \x1b[0mUnexpected error\n\nOu': 1, '========================================': 1, 'literal_eval_failed:SyntaxError': 1}
  N=17 valid 0/13  on-pred 0  best None  fails {'no_bracketed_list': 4, 'TIMEOUT': 4, '\x1b[0m\n> build · laguna-s-2.1-free\n\x1b[0m\n': 2, 'ASSERTION FAILED: MemoryExhaustion: Cras': 1, '\x1b[0m\n> build · laguna-s-2.1-free\n\x1b[0m\n\x1b[': 1, 'The system cannot execute the specified ': 1}
  N=31 valid 0/6  on-pred 0  best None  fails {'\x1b[0m\n> build · laguna-s-2.1-free\n\x1b[0m\n': 4, 'ASSERTION FAILED: MemoryExhaustion: Cras': 1, 'The system cannot execute the specified ': 1}
  N=35 valid 0/5  on-pred 0  best None  fails {'TIMEOUT': 5}
  N=37 valid 0/2  on-pred 0  best None  fails {'TIMEOUT': 2}

=== opencode/ling-3.0-tiny-free  (0/78 valid at 1e-6) ===
  BELOW-FLOOR (<10 valid): no anchoring claim either direction

  N=13 valid 0/16  on-pred 0  best None  fails {'\x1b[0m\n> build · ling-3.0-tiny-free\n\x1b[0m\n': 2, '\x1b[0m\n> build · ling-3.0-tiny-free\n\x1b[0m\n\x1b': 2, 'no_bracketed_list': 1, 'The system cannot execute the specified ': 2, '\x1b[91m\x1b[1mError: \x1b[0m{\n  "name": "Unknown': 9}
  N=17 valid 0/17  on-pred 0  best None  fails {'The system cannot execute the specified ': 1, '\x1b[0m\n> build · ling-3.0-tiny-free\n\x1b[0m\n': 1, 'TIMEOUT': 1, 'no_bracketed_list': 1, '\x1b[0m\n> build · ling-3.0-tiny-free\n\x1b[0m\n\x1b': 1, '\x1b[91m\x1b[1mError: \x1b[0m{\n  "name": "Unknown': 12}
  N=31 valid 0/15  on-pred 0  best None  fails {'literal_eval_failed:SyntaxError': 1, '\x1b[0m\n> build · ling-3.0-tiny-free\n\x1b[0m\n': 2, '\x1b[91m\x1b[1mError: \x1b[0m{\n  "name": "Unknown': 12}
  N=35 valid 0/15  on-pred 0  best None  fails {'\x1b[91m\x1b[1mError: \x1b[0m{\n  "name": "Unknown': 15}
  N=37 valid 0/15  on-pred 0  best None  fails {'\x1b[91m\x1b[1mError: \x1b[0m{\n  "name": "Unknown': 15}

=== opencode/mimo-v2.5-free  (0/32 valid at 1e-6) ===
  BELOW-FLOOR (<10 valid): no anchoring claim either direction

  N=13 valid 0/9  on-pred 0  best None  fails {'literal_eval_failed:SyntaxError': 2, 'no_bracketed_list': 2, 'TIMEOUT': 3, '\x1b[0m\n> build · mimo-v2.5-free\n\x1b[0m\n': 1, 'ASSERTION FAILED: MemoryExhaustion: Cras': 1}
  N=17 valid 0/8  on-pred 0  best None  fails {'========================================': 2, 'no_bracketed_list': 1, 'literal_eval_failed:SyntaxError': 1, '\x1b[0m\n> build · mimo-v2.5-free\n\x1b[0m\n\x1b[0m✗': 1, 'TIMEOUT': 3}
  N=31 valid 0/5  on-pred 0  best None  fails {'========================================': 2, 'The system cannot execute the specified ': 2, '\x1b[0m\n> build · mimo-v2.5-free\n\x1b[0m\n': 1}
  N=35 valid 0/5  on-pred 0  best None  fails {'\x1b[0m\n> build · mimo-v2.5-free\n\x1b[0m\n': 2, 'no_bracketed_list': 1, 'TIMEOUT': 1, 'ASSERTION FAILED: MemoryExhaustion: Cras': 1}
  N=37 valid 0/5  on-pred 0  best None  fails {'TIMEOUT': 1, 'ASSERTION FAILED: MemoryExhaustion: Cras': 2, '\x1b[0m\n> build · mimo-v2.5-free\n\x1b[0m\n': 2}

=== opencode/nemotron-3-ultra-free  (0/43 valid at 1e-6) ===
  BELOW-FLOOR (<10 valid): no anchoring claim either direction

  N=13 valid 0/13  on-pred 0  best None  fails {'TIMEOUT': 6, 'no_bracketed_list': 2, '\x1b[0m\n> build · nemotron-3-ultra-free\n\x1b[0': 2, 'literal_eval_failed:SyntaxError': 3}
  N=17 valid 0/9  on-pred 0  best None  fails {'\x1b[0m\n> build · nemotron-3-ultra-free\n\x1b[0': 2, 'no_bracketed_list': 1, 'TIMEOUT': 2, 'literal_eval_failed:SyntaxError': 3, '\x1b[91m\x1b[1mError: \x1b[0mUnexpected error\n\nda': 1}
  N=31 valid 0/9  on-pred 0  best None  fails {'literal_eval_failed:SyntaxError': 1, 'no_bracketed_list': 2, 'literal_eval_failed:ValueError': 1, 'TIMEOUT': 3, '\x1b[0m\n> build · nemotron-3-ultra-free\n\x1b[0': 2}
  N=35 valid 0/7  on-pred 0  best None  fails {'literal_eval_failed:SyntaxError': 3, 'no_bracketed_list': 1, 'TIMEOUT': 3}
  N=37 valid 0/5  on-pred 0  best None  fails {'no_bracketed_list': 4, 'row_not_xyr': 1}

=== opencode/nemotron-3.5-lightning-free  (0/38 valid at 1e-6) ===
  BELOW-FLOOR (<10 valid): no anchoring claim either direction

  N=13 valid 0/8  on-pred 0  best None  fails {'\x1b[0m\n> build · nemotron-3.5-lightning-fr': 3, 'RegisterWaitForSingleObject: (1455) The ': 1, 'literal_eval_failed:SyntaxError': 3, 'row_not_xyr': 1}
  N=17 valid 0/9  on-pred 0  best None  fails {'\x1b[0m\n> build · nemotron-3.5-lightning-fr': 1, 'no_bracketed_list': 2, 'RegisterWaitForSingleObject: (1455) The ': 1, 'The system cannot execute the specified ': 2, 'literal_eval_failed:SyntaxError': 2, 'row_not_xyr': 1}
  N=31 valid 0/8  on-pred 0  best None  fails {'no_bracketed_list': 2, 'literal_eval_failed:SyntaxError': 5, 'TIMEOUT': 1}
  N=35 valid 0/6  on-pred 0  best None  fails {'literal_eval_failed:SyntaxError': 3, 'no_bracketed_list': 2, '\x1b[0m\n> build · nemotron-3.5-lightning-fr': 1}
  N=37 valid 0/7  on-pred 0  best None  fails {'no_bracketed_list': 3, '\x1b[0m\n> build · nemotron-3.5-lightning-fr': 1, 'literal_eval_failed:SyntaxError': 2, 'TIMEOUT': 1}

