Issues

• longbook_choice_eng and code_debug scoring count an explicit wrong answer as correct when the response's first word starts with the true label letter

  OpenBMB/InfiniteBench#37 · Filter by author shaurya416 opened on Sep 30, 2026

• En.MC (longbook_choice_eng): Name-substitution artifacts — questions reference names absent from the substituted book text, and option strings/book text contain corrupted lexical items

  OpenBMB/InfiniteBench#36 · Filter by author uditaspatel opened on Jul 30, 2026

• Request for Supporting Evidence Sentences in QA Tasks

  OpenBMB/InfiniteBench#34 · Filter by author ZhuohanX opened on Jul 15, 2025

• An issue related to newer transformers

  OpenBMB/InfiniteBench#33 · Filter by author LI-SUJU opened on May 25, 2025

• Evaluation index calculation

  OpenBMB/InfiniteBench#32 · Filter by author scar-on opened on Mar 27, 2025
  1

• Suprisingly low perf on code.Debug

  OpenBMB/InfiniteBench#31 · Filter by author seyuboglu opened on Jan 9, 2025
  1

• How to deal with the generate response is None, which the model directly generate the <im_end> token.

  OpenBMB/InfiniteBench#30 · Filter by author unicorneeee opened on Dec 11, 2024
  1

• [Question] 请问repo首页的examples size是最新的吗？

  OpenBMB/InfiniteBench#29 · Filter by author pengdan1129 opened on Dec 5, 2024
  1

• 样本输入截断

  OpenBMB/InfiniteBench#28 · Filter by author Dori-Nilou opened on Dec 1, 2024
  1

• Support LLaMA Model

  OpenBMB/InfiniteBench#27 · Filter by author ydyhello opened on Nov 25, 2024
  2

• found some annotation errors in 'longbook_qa_chn'

  OpenBMB/InfiniteBench#26 · Filter by author Zeyu1994 opened on Oct 27, 2024
  1