Issues

• 运行create_service_qwen2.5_math_hf.sh无法启动RM服务

  bug
  openreasoner/openr#97 · Filter by author LGAG opened on Apr 26, 2025
  1

• Value Error

  bug
  openreasoner/openr#96 · Filter by author neverswift opened on Apr 15, 2025

• MCTS performs not good enough (a comparison with CoT, and best-of-N)

  openreasoner/openr#95 · Filter by author rtarikt opened on Feb 5, 2025

• questions about the math-aps dataset

  openreasoner/openr#94 · Filter by author yanan1116 opened on Jan 15, 2025
  1

• LM generation with strange behavior

  bug
  openreasoner/openr#93 · Filter by author hyuenmin-choi opened on Jan 3, 2025

• prm训练代码用到的测试集../../datasets/prm800k_test.json麻烦提供一下，谢谢

  enhancement
  openreasoner/openr#91 · Filter by author zhangyanbo2007 opened on Dec 19, 2024
  1

• RL训练得到的adapter文件是空的

  bug
  openreasoner/openr#89 · Filter by author linyaoyang opened on Dec 17, 2024
  2

• Adding Diverse Verifier Tree Search (DVTS)

  enhancement
  openreasoner/openr#88 · Filter by author ShayekhBinIslam opened on Dec 16, 2024
  1

• MCTS result on MATH

  bug
  openreasoner/openr#87 · Filter by author upup-wei opened on Dec 16, 2024
  1

• Executing bash train_1lm.sh resulted in an IndexError error: index -1 is out of bounds for dimension 0 with size 0

  bug
  openreasoner/openr#86 · Filter by author tju-hwh opened on Dec 15, 2024
  2

• prm数据转换代码有问题？

  openreasoner/openr#85 · Filter by author ccp123456789 opened on Dec 10, 2024

• Process hangs when using the given metrics to evaluate in PRM multi-gpu training.

  bug
  openreasoner/openr#83 · Filter by author great-luao opened on Dec 9, 2024
  

• Supporting Multi-modality

  enhancement
  openreasoner/openr#82 · Filter by author kaka-Cao opened on Dec 9, 2024
  2

• Is there a bug in rStar's A2 operation

  bug
  openreasoner/openr#81 · Filter by author windks opened on Dec 9, 2024
  1

  

• train_math.py model file save error

  bug
  openreasoner/openr#78 · Filter by author Tshiyao opened on Dec 6, 2024
  3

• RL training , Critic MCTS : supported already ? or on the roadmap ?

  enhancement
  openreasoner/openr#73 · Filter by author BerenLuthien opened on Dec 6, 2024
  1

• Pad token issue with MATH-psa and Qwen2.5-math-7B ins

  bug
  openreasoner/openr#71 · Filter by author LUMO666 opened on Dec 4, 2024
  1

  

• IndexError: index 621236954739970 is out of bounds for dimension 0 with size 151936 while running sh scripts/eval/cot_greedy.sh

  bug
  openreasoner/openr#66 · Filter by author Lolo1222 opened on Nov 29, 2024
  3

• Configuration of the experiments on the paper

  openreasoner/openr#65 · Filter by author CownowAn opened on Nov 28, 2024

• Error in reproducing train_math.py: input_ids里没有step_tag_id

  bug
  openreasoner/openr#64 · Filter by author zeroxleo opened on Nov 26, 2024
  1

• Question about the model size

  bug
  openreasoner/openr#63 · Filter by author yitianlian opened on Nov 26, 2024
  1

• 7B模型RL训练需要多少显存

  question
  openreasoner/openr#60 · Filter by author linyaoyang opened on Nov 21, 2024
  2

  

• Will this project support prm training of soft label?

  enhancement
  openreasoner/openr#57 · Filter by author Dada-Cloudzxy opened on Nov 13, 2024
  1

• Officially remove OmegaPRM-v1

  openreasoner/openr#56 · Filter by author gzqaq opened on Nov 13, 2024
  2

• Json decoding failed. A bug with about a 20% chance of occurring.

  bug
  openreasoner/openr#50 · Filter by author Dada-Cloudzxy opened on Nov 9, 2024
  9