When running benchmark against deephaven builds, there is nothing to distinguish between two deephaven builds but deephaven version. This is problematic when running nightly or adhoc builds, because you don't know what run went with what build when they have the same version.
We can tell what benchmarks ran together in the same run with Benchmark run-id. We should be able to tell what deephaven build the benchmarks ran against. Deephaven needs a build number, but in the meantime, we can create a temporary one until that happens.
- Create a "deephaven-build" property to the platform csv along side the existing deephaven.version.
- This is especially important when looking at iterations, because you may have multiple runs on the same deephaven build and want to pick the median of the set
- A separate ticket is to add more implementation details to the Deephaven build metadata
When running benchmark against deephaven builds, there is nothing to distinguish between two deephaven builds but deephaven version. This is problematic when running nightly or adhoc builds, because you don't know what run went with what build when they have the same version.
We can tell what benchmarks ran together in the same run with Benchmark run-id. We should be able to tell what deephaven build the benchmarks ran against. Deephaven needs a build number, but in the meantime, we can create a temporary one until that happens.