Issues

• Is EulerDiscreteScheduler mandatory for MLPerf SDXL?

  mlcommons/policies#205 · Filter by author xihajun opened on Jul 1, 2025

• Allow for larger scale submissions in Inference when moving from Preview to Available

  Next Meeting
  mlcommons/policies#176 · Filter by author psyhtest opened on May 14, 2024
  9

  

• In https://mlcommons.org/en/training-normal-30/, an link for result guidelines is broken

  mlcommons/policies#158 · Filter by author kcoms555 opened on Jul 8, 2023

• Submitter and non-submitter definition for unverified result disclosures

  mlcommons/policies#157 · Filter by author psyhtest opened on Jun 27, 2023

• Starting weights filename field is URL or not?

  mlcommons/policies#149 · Filter by author arjunsuresh opened on Apr 4, 2023

• Open/Preview submissions from Inference v2.1

  mlcommons/policies#140 · Filter by author psyhtest opened on Dec 20, 2022
  3

• training submission directory structure in benchmarks/

  mlcommons/policies#132 · Filter by author plvlnisse opened on Oct 12, 2022

• Allowing Software Preview Submissions

  mlcommons/policies#122 · Filter by author arjunsuresh opened on Aug 25, 2022
  22

• Add Paper Citations to Repos

  mlcommons/policies#86 · Filter by author codyaustun opened on Jun 27, 2021
  1

• how to generate submission_checker_log.txt for training v1.0 submission

  mlcommons/policies#85 · Filter by author tkunlin opened on May 20, 2021

• Clarify dates at which software must be available for the available category

  mlcommons/policies#83 · Filter by author johntran-nv opened on May 14, 2021
  1

• Contributing instructions are wrong

  mlcommons/policies#81 · Filter by author TheKanter opened on May 11, 2021
  2

  

• Update review committee

  mlcommons/policies#78 · Filter by author TheKanter opened on Mar 14, 2021

• Updating submission rules

  mlcommons/policies#77 · Filter by author TheKanter opened on Mar 14, 2021

• Update table's field names in measurements JSON file

  mlcommons/policies#76 · Filter by author mthmsn opened on Mar 10, 2021

• adding visualization to the results table

  mlcommons/policies#65 · Filter by author christ1ne opened on Jan 12, 2021
  1

• allowing compliance testing results to be submitted one week after submission deadline

  mlcommons/policies#60 · Filter by author christ1ne opened on Sep 15, 2020
  2

• Allow placing NOTES.txt under measurements/

  mlcommons/policies#59 · Filter by author psyhtest opened on Sep 11, 2020
  1

• submission rules did not specify the need of truncating the accuracy logs

  mlcommons/policies#58 · Filter by author christ1ne opened on Sep 10, 2020
  1

  

• Allow placing user.conf under results/

  mlcommons/policies#57 · Filter by author psyhtest opened on Sep 9, 2020

• Software updates for submission

  mlcommons/policies#40 · Filter by author TheKanter opened on Jul 16, 2020
  1

• Update section 5.7 (system description json)

  mlcommons/policies#39 · Filter by author TheKanter opened on Jul 16, 2020

• Require package verifier, no more human readable summaries.

  Next MeetingRec: Rules Change
  mlcommons/policies#29 · Filter by author petermattson opened on Jun 17, 2020
  2

  

• Require disclosure of Accuracy when quoting Open division results

  Next Meeting
  mlcommons/policies#24 · Filter by author DilipSequeira opened on Apr 3, 2020
  2

  

• Schedule deadline for public-facing materials

  Next Meeting
  mlcommons/policies#21 · Filter by author DilipSequeira opened on Nov 4, 2019
  2