Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,10 @@ The **Multiverse** is an expanded archive for multivariate time series classific
datasets from the original UEA MTSC archive, newer MTSC collections, donated
standalone datasets, and associated benchmark results into a single open repository.

**Leaderboards:** [Multiverse-core](#multiverse-core-leaderboard) (66 datasets) ·
[Full archive](docs/leaderboard_full.md) (the paper's 100 datasets) ·
[EEG](docs/leaderboard_eeg.md) (26 datasets)

The archive is described in
[The Multiverse of Time Series Machine Learning: an Archive for Multivariate Time Series
Classification](https://arxiv.org/abs/2603.20352) (arXiv:2603.20352). If you use the
Expand Down
85 changes: 85 additions & 0 deletions docs/leaderboard_eeg.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,85 @@
# EEG leaderboard

The EEG classification archive, `eeg2026` in aeon, has 28 datasets. Twenty-six are
multivariate and part of the Multiverse; the other two, EpilepticSeizures and Sleep, are
univariate. This ranks estimators with a resample-0 result on all 26 multivariate EEG
datasets, from the same runs as the other leaderboards.

A sortable version, with an average rank beside every metric, is in
[`results/multiverse/leaderboard_eeg.html`](../results/multiverse/leaderboard_eeg.html)
([preview](https://raw.githack.com/aeon-toolkit/multiverse/main/results/multiverse/leaderboard_eeg.html)).

<!-- EEG_LEADERBOARD:START -->
| # | Estimator | Accuracy rank | Accuracy | Balanced accuracy | AUROC | F1 | Log loss &darr; | Sensitivity | Specificity |
|---|---|---|---|---|---|---|---|---|---|
| 1 | HC2 | **4.02** | **0.5956** | 0.5812 | **0.6952** | 0.5632 | 0.7669 | 0.5803 | **0.5935** |
| 2 | DrCIF-500 | 5.15 | 0.5949 | **0.5826** | 0.6912 | 0.5681 | 0.7670 | 0.5869 | 0.5858 |
| 3 | CIF-500 | 6.10 | 0.5866 | 0.5722 | 0.6917 | 0.5554 | **0.7655** | 0.5771 | 0.5761 |
| 4 | MRHydra | 6.44 | 0.5856 | 0.5789 | 0.6388 | **0.5747** | 14.9380 | **0.5958** | 0.5661 |
| 5 | STC | 6.50 | 0.5805 | 0.5692 | 0.6776 | 0.5598 | 0.7908 | 0.5783 | 0.5677 |
| 6 | RIST | 6.60 | 0.5823 | 0.5671 | 0.6868 | 0.5461 | 0.7753 | 0.5658 | 0.5785 |
| 7 | Arsenal | 6.77 | 0.5864 | 0.5762 | 0.6760 | 0.5604 | 4.6306 | 0.5671 | 0.5920 |
| 8 | QUANT | 6.92 | 0.5784 | 0.5699 | 0.6884 | 0.5611 | 0.7936 | 0.5885 | 0.5532 |
| 9 | ROCKET | 6.94 | 0.5837 | 0.5745 | 0.6354 | 0.5619 | 15.0033 | 0.5699 | 0.5846 |
| 10 | TDE | 8.73 | 0.5513 | 0.5381 | 0.6429 | 0.5213 | 0.8573 | 0.5457 | 0.5416 |
| 11 | LITETime-MV | 9.25 | 0.5438 | 0.5435 | 0.6443 | 0.4863 | 3.1224 | 0.5064 | 0.5776 |
| 12 | RDST | 9.46 | 0.5429 | 0.5293 | 0.5970 | 0.4969 | 16.4763 | 0.5005 | 0.5683 |
| 13 | Catch22 | 10.13 | 0.5325 | 0.5172 | 0.6224 | 0.4976 | 0.8102 | 0.5324 | 0.5124 |
| 14 | Dummy | 11.98 | 0.4409 | 0.4276 | 0.5000 | 0.3172 | 0.8893 | 0.5094 | 0.3555 |

Average over the 26 EEG datasets with results for every estimator on every metric, ordered by average accuracy rank. Best in each column in bold.
<!-- EEG_LEADERBOARD:END -->

## Not yet complete

Estimators in the Multiverse-core table that do not yet have a result on all 26 EEG
datasets, so are not ranked above. The same gaps are in
[`results/multiverse/pending_eeg.csv`](../results/multiverse/pending_eeg.csv), one
`estimator,dataset` row per missing run.

<!-- EEG_PENDING:START -->
| Estimator | Completed | Missing datasets |
|---|---|---|
| H-InceptionTime | 24 of 26 | ShortIntervalTask, SitStand |
| PatchMTSC | 12 of 26 | ButtonPress, FeedbackButton, FeetHands, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech |
| TimesNet | 12 of 26 | ButtonPress, FeedbackButton, FeetHands, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech |
| TimesURL | 12 of 26 | ButtonPress, FeedbackButton, FeetHands, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech |
| CIF | 10 of 26 | ButtonPress, FeedbackButton, FeetHands, FingerMovements, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, SelfRegulationSCP2, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech |
| ConvTran | 10 of 26 | Alzheimers, ButtonPress, FeedbackButton, FeetHands, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PhotoStimulation, PronouncedSpeech, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech |
| DisjointCNN | 10 of 26 | ButtonPress, FeedbackButton, FeetHands, FingerMovements, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, SelfRegulationSCP2, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech |
| DrCIF | 10 of 26 | ButtonPress, FeedbackButton, FeetHands, FingerMovements, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, SelfRegulationSCP2, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech |
| STSF | 10 of 26 | ButtonPress, FeedbackButton, FeetHands, FingerMovements, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, SelfRegulationSCP2, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech |
| Summary | 10 of 26 | ButtonPress, FeedbackButton, FeetHands, FingerMovements, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, SelfRegulationSCP2, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech |
| TS2Vec | 10 of 26 | ButtonPress, FeedbackButton, FeetHands, FingerMovements, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, SelfRegulationSCP2, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech |
| TSF | 10 of 26 | ButtonPress, FeedbackButton, FeetHands, FingerMovements, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, SelfRegulationSCP2, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech |
| XCM | 10 of 26 | ButtonPress, FeedbackButton, FeetHands, FingerMovements, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, SelfRegulationSCP2, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech |
<!-- EEG_PENDING:END -->

## EEG archive study results

These are the averaged results held in [`results/eeg`](../results/eeg), for twelve
estimators including the EEG-specific CSP-SVM, R-KNN and R-MDM. They come from a separate
study, not the resample-0 runs above, so the two tables are not directly comparable.
Their 26 datasets also differ: they include the univariate Sleep and leave out
FeedbackButton.

<!-- EEG_ARCHIVE:START -->
| # | Estimator | Accuracy rank | Accuracy | Balanced accuracy |
|---|---|---|---|---|
| 1 | HC2 | **3.21** | **0.5929** | **0.5721** |
| 2 | DrCIF | 4.52 | 0.5856 | 0.5661 |
| 3 | Arsenal | 4.71 | 0.5799 | 0.5675 |
| 4 | STC | 4.87 | 0.5771 | 0.5617 |
| 5 | MRHydra | 5.62 | 0.5685 | 0.5556 |
| 6 | SVM | 6.48 | 0.5443 | 0.5180 |
| 7 | TDE | 6.96 | 0.5481 | 0.5273 |
| 8 | IT | 7.33 | 0.5344 | 0.5283 |
| 9 | CNN | 8.27 | 0.5119 | 0.4917 |
| 10 | CSP-SVM | 8.46 | 0.5076 | 0.4802 |
| 11 | R-KNN | 8.62 | 0.4779 | 0.4684 |
| 12 | R-MDM | 8.96 | 0.4690 | 0.4679 |

Average over the 26 datasets in `results/eeg`, ordered by average accuracy rank. Best in each column in bold.
<!-- EEG_ARCHIVE:END -->

All four blocks are rebuilt with `python -m multiverse.experiments.tables`.
70 changes: 70 additions & 0 deletions docs/leaderboard_full.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,70 @@
# Full-archive leaderboard

This ranks estimators on the 100 datasets used for the full-archive comparison in the
Multiverse archive paper. Those are the Multiverse datasets on which all 17 of the
paper's classifiers have a resample-0 result. The list is fixed, in
[`results/multiverse/paper_datasets.txt`](../results/multiverse/paper_datasets.txt), so
this table keeps describing the paper's comparison as new results arrive.

An estimator is ranked here only if it has a result on all 100 datasets, on every
metric. That differs from the [Multiverse-core leaderboard](../README.md#multiverse-core-leaderboard)
in two ways:

- **CIF-500** and **DrCIF-500** are the configurations the paper reports as CIF and
DrCIF. The core table reports the default CIF and DrCIF instead.
- **FreshPRINCE** and **1NN-DTW** are ranked here. They are held out of the core table
because each fails on core datasets outside these 100.

A sortable version, with an average rank beside every metric, is in
[`results/multiverse/leaderboard_full.html`](../results/multiverse/leaderboard_full.html)
([preview](https://raw.githack.com/aeon-toolkit/multiverse/main/results/multiverse/leaderboard_full.html)).

<!-- FULL_LEADERBOARD:START -->
| # | Estimator | Accuracy rank | Accuracy | Balanced accuracy | AUROC | F1 | Log loss &darr; | Sensitivity | Specificity |
|---|---|---|---|---|---|---|---|---|---|
| 1 | HC2 | **6.31** | **0.7609** | 0.7038 | **0.8440** | 0.6421 | **0.5816** | 0.6785 | **0.7736** |
| 2 | MRHydra | 6.86 | 0.7591 | **0.7145** | 0.7601 | 0.6568 | 8.6836 | 0.6925 | 0.7695 |
| 3 | RDST | 7.51 | 0.7500 | 0.6974 | 0.7474 | 0.6314 | 9.0100 | 0.6560 | 0.7718 |
| 4 | FreshPRINCE | 7.66 | 0.7473 | 0.7102 | 0.8435 | **0.6571** | 0.6086 | **0.6951** | 0.7570 |
| 5 | CIF-500 | 7.88 | 0.7465 | 0.7000 | 0.8413 | 0.6379 | 0.6084 | 0.6746 | 0.7612 |
| 6 | Arsenal | 8.00 | 0.7524 | 0.6966 | 0.7886 | 0.6316 | 4.4938 | 0.6679 | 0.7684 |
| 7 | ROCKET | 8.07 | 0.7530 | 0.6961 | 0.7456 | 0.6285 | 8.9011 | 0.6605 | 0.7714 |
| 8 | DrCIF-500 | 8.20 | 0.7314 | 0.6907 | 0.8279 | 0.6243 | 0.6299 | 0.6680 | 0.7471 |
| 9 | RIST | 8.31 | 0.7351 | 0.6935 | 0.8183 | 0.6246 | 0.6271 | 0.6660 | 0.7443 |
| 10 | QUANT | 8.73 | 0.7374 | 0.6977 | 0.8344 | 0.6384 | 0.6224 | 0.6831 | 0.7421 |
| 11 | LITETime-MV | 9.01 | 0.7161 | 0.6862 | 0.8141 | 0.6109 | 1.6554 | 0.6501 | 0.7515 |
| 12 | STC | 9.61 | 0.7334 | 0.6796 | 0.8175 | 0.6230 | 0.7178 | 0.6542 | 0.7479 |
| 13 | Catch22 | 9.67 | 0.7201 | 0.6818 | 0.8313 | 0.6188 | 0.6781 | 0.6728 | 0.7261 |
| 14 | H-InceptionTime | 10.05 | 0.6970 | 0.6672 | 0.7988 | 0.5925 | 1.7675 | 0.6494 | 0.7165 |
| 15 | TDE | 10.16 | 0.7161 | 0.6561 | 0.7811 | 0.5810 | 1.4773 | 0.6286 | 0.7306 |
| 16 | 1NN-DTW | 12.64 | 0.6467 | 0.6191 | 0.6802 | 0.5610 | 12.7343 | 0.6287 | 0.6432 |
| 17 | Dummy | 14.32 | 0.4489 | 0.3720 | 0.5000 | 0.2219 | 1.1562 | 0.3831 | 0.4231 |

Average over the 100 paper datasets with results for every estimator on every metric, ordered by average accuracy rank. Best in each column in bold.
<!-- FULL_LEADERBOARD:END -->

## Not yet complete

Estimators in the Multiverse-core table that do not yet have a result on all 100
datasets, so are not ranked above. The same gaps are in
[`results/multiverse/pending_full.csv`](../results/multiverse/pending_full.csv), one
`estimator,dataset` row per missing run, to queue runs from.

<!-- FULL_PENDING:START -->
| Estimator | Completed | Missing datasets |
|---|---|---|
| PatchMTSC | 60 of 100 | AsphaltPavementTypeCoordinates, ButtonPress, FeedbackButton, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech |
| TimesNet | 60 of 100 | AsphaltPavementTypeCoordinates, ButtonPress, FeedbackButton, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech |
| TimesURL | 60 of 100 | AsphaltPavementTypeCoordinates, ButtonPress, FeedbackButton, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech |
| CIF | 57 of 100 | AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech |
| ConvTran | 57 of 100 | Alzheimers, AsphaltPavementTypeCoordinates, ButtonPress, EigenWorms, FeedbackButton, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PhotoStimulation, PronouncedSpeech, SPHERE-WUS, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech |
| DisjointCNN | 57 of 100 | AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech |
| DrCIF | 57 of 100 | AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech |
| STSF | 57 of 100 | AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech |
| Summary | 57 of 100 | AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech |
| TSF | 57 of 100 | AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech |
| XCM | 57 of 100 | AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech |
| TS2Vec | 56 of 100 | AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, Locust2022, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech |
<!-- FULL_PENDING:END -->

All three blocks are rebuilt with `python -m multiverse.experiments.tables`.
Loading
Loading