Skip to content

Configuration: Remove costly model #214

Closed

Description

@Ayush8923

Is your feature request related to a problem?
The GPT-5.4-Pro model is too costly, and its presence in the config may lead to unnecessary expenses. Additionally, some dataset names exceed a manageable length, causing issues during evaluation.

Describe the solution you'd like

  • Remove the GPT-5.4-Pro model from the config.
  • Add a max-length restriction for dataset and eval names to handle long names effectively.
Original issue

Describe the enhancement you'd like

  • Need to remove the GPT-5.4-Pro model from the config, becasue this model is too constly. we can add this model later.
  • Need to add the max-length in dataset and evals name field, becasue some of the dataset name is too long.

Activity

  1. self-assigned this
    on Jun 16, 2026
  2. changed the title [-]Remove GPT-5.4-Pro Model from Config & UI Updates[/-] [+]Configuration: Remove costly model[/+] on Jun 16, 2026
  3. moved this from To Do to In Progress in Kaapi-devon Jun 16, 2026
  4. moved this from In Progress to Closed in Kaapi-devon Jun 16, 2026
  5. github-actions commented on Jun 17, 2026

    @github-actions

    🎉 This issue has been resolved in version 0.2.1 🎉

    The release is available on GitHub release

    Your semantic-release bot 📦🚀

  6. github-actions commented on Jun 17, 2026

    @github-actions

    🎉 This issue has been resolved in version 0.3.0-main.1 🎉

    The release is available on GitHub release

    Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

  • Status
    Closed

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions