Skip to content

Request for Metric^2D / Metric^3D evaluation code (IS/FID/KID/P/R) #20

Description

@zlsbksdxl

Hi, thanks for releasing DynamicCity.

I checked the released repository, but could not find the evaluation code for the paper's Metric^2D and Metric^3D results. The current code seems to include VAE training metrics such as mIoU/binIoU, but I could not find scripts/configs for the paper's feature-based generation metrics:

  • Metric^2D: rendering 3D/4D occupancy into 2D semantic images, then extracting features with 2D networks such as InceptionV3 / VGG-16.
  • Metric^3D: extracting features directly from 3D occupancy with a 3D network such as MinkowskiUNet.
  • Computing IS, FID, KID, Precision, and Recall in those 2D/3D feature spaces, including the exact pretrained checkpoints/features used.

Could you please release the evaluation scripts, pretrained feature extractors, rendering settings, and command examples needed to reproduce the 2D and 3D metrics reported in the paper?

I saw earlier general requests about FID/metrics, but this request is specifically about the Metric^2D / Metric^3D protocols and feature extractors used in the paper.

This would be very helpful for comparing follow-up 4D occupancy generation methods under the same protocol. Thanks!

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions