Skip to content

test: add lodash deduplication analyzer eval - #99005

Draft
wbinnssmith wants to merge 1 commit into
codex/analyzer-markdown-server-evalfrom
codex/analyzer-lodash-dedupe-eval
Draft

wbinnssmith wants to merge 1 commit into
codex/analyzer-markdown-server-evalfrom
codex/analyzer-lodash-dedupe-eval

Conversation

@wbinnssmith

Copy link
Copy Markdown
Member

What?

  • adds a standalone bundle-analyzer eval with two shipped lodash 4.17 patch versions
  • grades dependency and lockfile consolidation while preserving both client behaviors
  • includes the browser-initial-load optimizer skill variant

Why?

Duplicate package versions need an isolated scenario so the eval can measure whether an agent uses analyzer package/source evidence and safely consolidates compatible runtime dependencies.

How?

The app imports lodash directly and through a local legacy package pinned to an older patch. Source, environment, and transcript assertions require one installed runtime version, preserve both transformed labels, and require before/after analyzer evidence plus a production build.

Verification

  • pnpm eval agent-061-dedupe-lodash-runtime --dry
  • starting fixture production build with Webpack
  • unsolved duplicate-version grader fails while behavior grader passes
  • reference deduplication solution passes source graders
  • Prettier and ESLint

Stacked on #99004.

@github-actions

github-actions Bot commented Sep 21, 2026

Copy link
Copy Markdown
Contributor

Tests Passed

Commit: d642c70

@wbinnssmith
wbinnssmith force-pushed the codex/analyzer-lodash-dedupe-eval branch from ba23f24 to 737ed5b Compare September 21, 2026 21:25
@wbinnssmith
wbinnssmith force-pushed the codex/analyzer-lodash-dedupe-eval branch from 737ed5b to a340a3d Compare September 21, 2026 21:29
@wbinnssmith
wbinnssmith force-pushed the codex/analyzer-lodash-dedupe-eval branch from a340a3d to 4bff809 Compare September 21, 2026 22:23
@wbinnssmith
wbinnssmith force-pushed the codex/analyzer-lodash-dedupe-eval branch from 4bff809 to d4130c7 Compare September 22, 2026 16:53
@wbinnssmith
wbinnssmith force-pushed the codex/analyzer-lodash-dedupe-eval branch from d4130c7 to 93c9650 Compare September 22, 2026 17:15
@wbinnssmith
wbinnssmith added this pull request to stack #98901 September 22, 2026 17:27
@wbinnssmith
wbinnssmith force-pushed the codex/analyzer-lodash-dedupe-eval branch from 93c9650 to 1a23787 Compare September 22, 2026 23:56
@wbinnssmith
wbinnssmith force-pushed the codex/analyzer-lodash-dedupe-eval branch from 1a23787 to 67c7af0 Compare September 23, 2026 01:29
@wbinnssmith
wbinnssmith force-pushed the codex/analyzer-lodash-dedupe-eval branch from 67c7af0 to f00cce6 Compare September 23, 2026 21:31
Co-authored-by: Will Binns-Smith <755844+wbinnssmith@users.noreply.github.com>
@wbinnssmith
wbinnssmith force-pushed the codex/analyzer-lodash-dedupe-eval branch from f00cce6 to d642c70 Compare September 23, 2026 21:52

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant