diff --git a/README.md b/README.md index 51081f1..ae01abd 100644 --- a/README.md +++ b/README.md @@ -18,6 +18,10 @@ The **Multiverse** is an expanded archive for multivariate time series classific datasets from the original UEA MTSC archive, newer MTSC collections, donated standalone datasets, and associated benchmark results into a single open repository. +**Leaderboards:** [Multiverse-core](#multiverse-core-leaderboard) (66 datasets) · +[Full archive](docs/leaderboard_full.md) (the paper's 100 datasets) · +[EEG](docs/leaderboard_eeg.md) (26 datasets) + The archive is described in [The Multiverse of Time Series Machine Learning: an Archive for Multivariate Time Series Classification](https://arxiv.org/abs/2603.20352) (arXiv:2603.20352). If you use the diff --git a/docs/leaderboard_eeg.md b/docs/leaderboard_eeg.md new file mode 100644 index 0000000..e356583 --- /dev/null +++ b/docs/leaderboard_eeg.md @@ -0,0 +1,85 @@ +# EEG leaderboard + +The EEG classification archive, `eeg2026` in aeon, has 28 datasets. Twenty-six are +multivariate and part of the Multiverse; the other two, EpilepticSeizures and Sleep, are +univariate. This ranks estimators with a resample-0 result on all 26 multivariate EEG +datasets, from the same runs as the other leaderboards. + +A sortable version, with an average rank beside every metric, is in +[`results/multiverse/leaderboard_eeg.html`](../results/multiverse/leaderboard_eeg.html) +([preview](https://raw.githack.com/aeon-toolkit/multiverse/main/results/multiverse/leaderboard_eeg.html)). + + +| # | Estimator | Accuracy rank | Accuracy | Balanced accuracy | AUROC | F1 | Log loss ↓ | Sensitivity | Specificity | +|---|---|---|---|---|---|---|---|---|---| +| 1 | HC2 | **4.02** | **0.5956** | 0.5812 | **0.6952** | 0.5632 | 0.7669 | 0.5803 | **0.5935** | +| 2 | DrCIF-500 | 5.15 | 0.5949 | **0.5826** | 0.6912 | 0.5681 | 0.7670 | 0.5869 | 0.5858 | +| 3 | CIF-500 | 6.10 | 0.5866 | 0.5722 | 0.6917 | 0.5554 | **0.7655** | 0.5771 | 0.5761 | +| 4 | MRHydra | 6.44 | 0.5856 | 0.5789 | 0.6388 | **0.5747** | 14.9380 | **0.5958** | 0.5661 | +| 5 | STC | 6.50 | 0.5805 | 0.5692 | 0.6776 | 0.5598 | 0.7908 | 0.5783 | 0.5677 | +| 6 | RIST | 6.60 | 0.5823 | 0.5671 | 0.6868 | 0.5461 | 0.7753 | 0.5658 | 0.5785 | +| 7 | Arsenal | 6.77 | 0.5864 | 0.5762 | 0.6760 | 0.5604 | 4.6306 | 0.5671 | 0.5920 | +| 8 | QUANT | 6.92 | 0.5784 | 0.5699 | 0.6884 | 0.5611 | 0.7936 | 0.5885 | 0.5532 | +| 9 | ROCKET | 6.94 | 0.5837 | 0.5745 | 0.6354 | 0.5619 | 15.0033 | 0.5699 | 0.5846 | +| 10 | TDE | 8.73 | 0.5513 | 0.5381 | 0.6429 | 0.5213 | 0.8573 | 0.5457 | 0.5416 | +| 11 | LITETime-MV | 9.25 | 0.5438 | 0.5435 | 0.6443 | 0.4863 | 3.1224 | 0.5064 | 0.5776 | +| 12 | RDST | 9.46 | 0.5429 | 0.5293 | 0.5970 | 0.4969 | 16.4763 | 0.5005 | 0.5683 | +| 13 | Catch22 | 10.13 | 0.5325 | 0.5172 | 0.6224 | 0.4976 | 0.8102 | 0.5324 | 0.5124 | +| 14 | Dummy | 11.98 | 0.4409 | 0.4276 | 0.5000 | 0.3172 | 0.8893 | 0.5094 | 0.3555 | + +Average over the 26 EEG datasets with results for every estimator on every metric, ordered by average accuracy rank. Best in each column in bold. + + +## Not yet complete + +Estimators in the Multiverse-core table that do not yet have a result on all 26 EEG +datasets, so are not ranked above. The same gaps are in +[`results/multiverse/pending_eeg.csv`](../results/multiverse/pending_eeg.csv), one +`estimator,dataset` row per missing run. + + +| Estimator | Completed | Missing datasets | +|---|---|---| +| H-InceptionTime | 24 of 26 | ShortIntervalTask, SitStand | +| PatchMTSC | 12 of 26 | ButtonPress, FeedbackButton, FeetHands, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech | +| TimesNet | 12 of 26 | ButtonPress, FeedbackButton, FeetHands, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech | +| TimesURL | 12 of 26 | ButtonPress, FeedbackButton, FeetHands, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech | +| CIF | 10 of 26 | ButtonPress, FeedbackButton, FeetHands, FingerMovements, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, SelfRegulationSCP2, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech | +| ConvTran | 10 of 26 | Alzheimers, ButtonPress, FeedbackButton, FeetHands, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PhotoStimulation, PronouncedSpeech, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech | +| DisjointCNN | 10 of 26 | ButtonPress, FeedbackButton, FeetHands, FingerMovements, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, SelfRegulationSCP2, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech | +| DrCIF | 10 of 26 | ButtonPress, FeedbackButton, FeetHands, FingerMovements, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, SelfRegulationSCP2, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech | +| STSF | 10 of 26 | ButtonPress, FeedbackButton, FeetHands, FingerMovements, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, SelfRegulationSCP2, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech | +| Summary | 10 of 26 | ButtonPress, FeedbackButton, FeetHands, FingerMovements, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, SelfRegulationSCP2, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech | +| TS2Vec | 10 of 26 | ButtonPress, FeedbackButton, FeetHands, FingerMovements, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, SelfRegulationSCP2, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech | +| TSF | 10 of 26 | ButtonPress, FeedbackButton, FeetHands, FingerMovements, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, SelfRegulationSCP2, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech | +| XCM | 10 of 26 | ButtonPress, FeedbackButton, FeetHands, FingerMovements, ImaginedFeetHands, ImaginedOpenCloseFist, InnerSpeech, LongIntervalTask, MatchingPennies, OpenCloseFist, PronouncedSpeech, SelfRegulationSCP2, ShortIntervalTask, SitStand, SongFamiliarity, VisualSpeech | + + +## EEG archive study results + +These are the averaged results held in [`results/eeg`](../results/eeg), for twelve +estimators including the EEG-specific CSP-SVM, R-KNN and R-MDM. They come from a separate +study, not the resample-0 runs above, so the two tables are not directly comparable. +Their 26 datasets also differ: they include the univariate Sleep and leave out +FeedbackButton. + + +| # | Estimator | Accuracy rank | Accuracy | Balanced accuracy | +|---|---|---|---|---| +| 1 | HC2 | **3.21** | **0.5929** | **0.5721** | +| 2 | DrCIF | 4.52 | 0.5856 | 0.5661 | +| 3 | Arsenal | 4.71 | 0.5799 | 0.5675 | +| 4 | STC | 4.87 | 0.5771 | 0.5617 | +| 5 | MRHydra | 5.62 | 0.5685 | 0.5556 | +| 6 | SVM | 6.48 | 0.5443 | 0.5180 | +| 7 | TDE | 6.96 | 0.5481 | 0.5273 | +| 8 | IT | 7.33 | 0.5344 | 0.5283 | +| 9 | CNN | 8.27 | 0.5119 | 0.4917 | +| 10 | CSP-SVM | 8.46 | 0.5076 | 0.4802 | +| 11 | R-KNN | 8.62 | 0.4779 | 0.4684 | +| 12 | R-MDM | 8.96 | 0.4690 | 0.4679 | + +Average over the 26 datasets in `results/eeg`, ordered by average accuracy rank. Best in each column in bold. + + +All four blocks are rebuilt with `python -m multiverse.experiments.tables`. diff --git a/docs/leaderboard_full.md b/docs/leaderboard_full.md new file mode 100644 index 0000000..713db44 --- /dev/null +++ b/docs/leaderboard_full.md @@ -0,0 +1,70 @@ +# Full-archive leaderboard + +This ranks estimators on the 100 datasets used for the full-archive comparison in the +Multiverse archive paper. Those are the Multiverse datasets on which all 17 of the +paper's classifiers have a resample-0 result. The list is fixed, in +[`results/multiverse/paper_datasets.txt`](../results/multiverse/paper_datasets.txt), so +this table keeps describing the paper's comparison as new results arrive. + +An estimator is ranked here only if it has a result on all 100 datasets, on every +metric. That differs from the [Multiverse-core leaderboard](../README.md#multiverse-core-leaderboard) +in two ways: + +- **CIF-500** and **DrCIF-500** are the configurations the paper reports as CIF and + DrCIF. The core table reports the default CIF and DrCIF instead. +- **FreshPRINCE** and **1NN-DTW** are ranked here. They are held out of the core table + because each fails on core datasets outside these 100. + +A sortable version, with an average rank beside every metric, is in +[`results/multiverse/leaderboard_full.html`](../results/multiverse/leaderboard_full.html) +([preview](https://raw.githack.com/aeon-toolkit/multiverse/main/results/multiverse/leaderboard_full.html)). + + +| # | Estimator | Accuracy rank | Accuracy | Balanced accuracy | AUROC | F1 | Log loss ↓ | Sensitivity | Specificity | +|---|---|---|---|---|---|---|---|---|---| +| 1 | HC2 | **6.31** | **0.7609** | 0.7038 | **0.8440** | 0.6421 | **0.5816** | 0.6785 | **0.7736** | +| 2 | MRHydra | 6.86 | 0.7591 | **0.7145** | 0.7601 | 0.6568 | 8.6836 | 0.6925 | 0.7695 | +| 3 | RDST | 7.51 | 0.7500 | 0.6974 | 0.7474 | 0.6314 | 9.0100 | 0.6560 | 0.7718 | +| 4 | FreshPRINCE | 7.66 | 0.7473 | 0.7102 | 0.8435 | **0.6571** | 0.6086 | **0.6951** | 0.7570 | +| 5 | CIF-500 | 7.88 | 0.7465 | 0.7000 | 0.8413 | 0.6379 | 0.6084 | 0.6746 | 0.7612 | +| 6 | Arsenal | 8.00 | 0.7524 | 0.6966 | 0.7886 | 0.6316 | 4.4938 | 0.6679 | 0.7684 | +| 7 | ROCKET | 8.07 | 0.7530 | 0.6961 | 0.7456 | 0.6285 | 8.9011 | 0.6605 | 0.7714 | +| 8 | DrCIF-500 | 8.20 | 0.7314 | 0.6907 | 0.8279 | 0.6243 | 0.6299 | 0.6680 | 0.7471 | +| 9 | RIST | 8.31 | 0.7351 | 0.6935 | 0.8183 | 0.6246 | 0.6271 | 0.6660 | 0.7443 | +| 10 | QUANT | 8.73 | 0.7374 | 0.6977 | 0.8344 | 0.6384 | 0.6224 | 0.6831 | 0.7421 | +| 11 | LITETime-MV | 9.01 | 0.7161 | 0.6862 | 0.8141 | 0.6109 | 1.6554 | 0.6501 | 0.7515 | +| 12 | STC | 9.61 | 0.7334 | 0.6796 | 0.8175 | 0.6230 | 0.7178 | 0.6542 | 0.7479 | +| 13 | Catch22 | 9.67 | 0.7201 | 0.6818 | 0.8313 | 0.6188 | 0.6781 | 0.6728 | 0.7261 | +| 14 | H-InceptionTime | 10.05 | 0.6970 | 0.6672 | 0.7988 | 0.5925 | 1.7675 | 0.6494 | 0.7165 | +| 15 | TDE | 10.16 | 0.7161 | 0.6561 | 0.7811 | 0.5810 | 1.4773 | 0.6286 | 0.7306 | +| 16 | 1NN-DTW | 12.64 | 0.6467 | 0.6191 | 0.6802 | 0.5610 | 12.7343 | 0.6287 | 0.6432 | +| 17 | Dummy | 14.32 | 0.4489 | 0.3720 | 0.5000 | 0.2219 | 1.1562 | 0.3831 | 0.4231 | + +Average over the 100 paper datasets with results for every estimator on every metric, ordered by average accuracy rank. Best in each column in bold. + + +## Not yet complete + +Estimators in the Multiverse-core table that do not yet have a result on all 100 +datasets, so are not ranked above. The same gaps are in +[`results/multiverse/pending_full.csv`](../results/multiverse/pending_full.csv), one +`estimator,dataset` row per missing run, to queue runs from. + + +| Estimator | Completed | Missing datasets | +|---|---|---| +| PatchMTSC | 60 of 100 | AsphaltPavementTypeCoordinates, ButtonPress, FeedbackButton, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech | +| TimesNet | 60 of 100 | AsphaltPavementTypeCoordinates, ButtonPress, FeedbackButton, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech | +| TimesURL | 60 of 100 | AsphaltPavementTypeCoordinates, ButtonPress, FeedbackButton, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech | +| CIF | 57 of 100 | AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech | +| ConvTran | 57 of 100 | Alzheimers, AsphaltPavementTypeCoordinates, ButtonPress, EigenWorms, FeedbackButton, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PhotoStimulation, PronouncedSpeech, SPHERE-WUS, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech | +| DisjointCNN | 57 of 100 | AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech | +| DrCIF | 57 of 100 | AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech | +| STSF | 57 of 100 | AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech | +| Summary | 57 of 100 | AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech | +| TSF | 57 of 100 | AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech | +| XCM | 57 of 100 | AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech | +| TS2Vec | 56 of 100 | AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, Locust2022, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech | + + +All three blocks are rebuilt with `python -m multiverse.experiments.tables`. diff --git a/multiverse/experiments/ingest.py b/multiverse/experiments/ingest.py index aec23f6..f93887b 100644 --- a/multiverse/experiments/ingest.py +++ b/multiverse/experiments/ingest.py @@ -20,6 +20,7 @@ from pathlib import Path +import numpy as np import pandas as pd from aeon.datasets.tsc_datasets import multiverse_core from tsml_eval.evaluation.storage import load_classifier_results @@ -38,6 +39,40 @@ results_path = Path(__file__).resolve().parents[2] / "results" / "multiverse" +def _load_results(path): + """Load one prediction file with its statistics calculated by tsml-eval. + + tsml-eval cannot score a test split that is missing a class the model was + trained on: log loss and the one-vs-rest AUROC both expect a probability + column per class present, so they raise. Several archive problems split this + way, the KERAAL multiclass datasets among them. For those the two metrics are + computed here with the full label set given explicitly: log loss over every + class, and AUROC as the prevalence-weighted one-vs-rest average over the + classes present, which is what tsml-eval computes when every class is present. + Every other metric is tsml-eval's own. + """ + from sklearn.metrics import log_loss, roc_auc_score + + try: + return load_classifier_results(str(path)) + except ValueError: + results = load_classifier_results(str(path), calculate_stats=False) + # stored as floats, but they are the column indices of the probabilities + labels = np.asarray(results.class_labels).astype(int) + probabilities = np.clip(np.asarray(results.probabilities), 0.0, 1.0) + n_classes = probabilities.shape[1] + results.log_loss = log_loss(labels, probabilities, labels=list(range(n_classes))) + present = np.unique(labels) + results.auroc_score = float( + np.average( + [roc_auc_score(labels == c, probabilities[:, c]) for c in present], + weights=[np.sum(labels == c) for c in present], + ) + ) + results.calculate_statistics() + return results + + def ingest(classifier, predictions_path, datasets=None, resample=0): """Write one file per metric for a classifier, and return the datasets used. @@ -51,10 +86,7 @@ def ingest(classifier, predictions_path, datasets=None, resample=0): scores = {name: [] for name in metrics} for dataset in found: - results = load_classifier_results( - str(predictions / dataset / f"testResample{resample}.csv") - ) - results.calculate_statistics() + results = _load_results(predictions / dataset / f"testResample{resample}.csv") for name, attribute in metrics.items(): scores[name].append(getattr(results, attribute)) diff --git a/multiverse/experiments/tables.py b/multiverse/experiments/tables.py index 26f0c1d..5256552 100644 --- a/multiverse/experiments/tables.py +++ b/multiverse/experiments/tables.py @@ -32,6 +32,11 @@ "available_estimators", "load_metric", "load_missing_reasons", + "paper_datasets", + "complete_estimators", + "pending_results", + "pending_markdown", + "eeg_archive_markdown", ] import base64 @@ -44,6 +49,9 @@ import pandas as pd DEFAULT_RESULTS_DIR = Path(__file__).resolve().parents[2] / "results" / "multiverse" +# Mean scores from the EEG archive study, one file per metric with a column per +# estimator. A different layout from results/multiverse, so read separately. +DEFAULT_EEG_ARCHIVE_DIR = DEFAULT_RESULTS_DIR.parent / "eeg" #: A dataset whose best estimator gains no more than this over the baseline #: shows little signal; one whose best reaches SATURATED_BEST is solved. @@ -361,6 +369,17 @@ def _missing_by_estimator(frames, estimators, common, datasets): "cannot complete the archive within the walltime available: exceeded the " "limit on BIDMC32HR_disc, with no result recorded for BIDMC32SpO2_disc" ), + "CIF-500": ( + "the 500-tree configuration run for the Multiverse archive paper's " + "full-archive benchmark, where it is reported as CIF. This table reports " + "the default CIF; the full-archive leaderboard reports CIF-500" + ), + "DrCIF-500": ( + "the 500-tree configuration HC2 uses internally, run for the Multiverse " + "archive paper's full-archive benchmark, where it is reported as DrCIF. " + "This table reports the default DrCIF; the full-archive leaderboard " + "reports DrCIF-500" + ), "DisjointCNN-Aeon": ( "aeon's implementation applies a Permute after the final block, so its " "pooling reduces the wrong axes and the classifier head receives one " @@ -456,11 +475,19 @@ def _withheld_html() -> str: ) +def _core_datasets() -> set[str]: + """Return Multiverse-core, or an empty set if this aeon does not list it.""" + from aeon.datasets import tsc_datasets + + return set(getattr(tsc_datasets, "multiverse_core", ())) + + def _excluded_html(missing, reasons, common, dropped) -> str: """Render a one-line summary of what each estimator is missing.""" lookup = { (row.estimator, row.dataset): row.reason for row in reasons.itertuples() } + core = _core_datasets() lines = [] for estimator, gaps in missing.items(): @@ -469,7 +496,15 @@ def _excluded_html(missing, reasons, common, dropped) -> str: # group the datasets by reason, preserving the order they appear in grouped: dict[str, list[str]] = {} for dataset in gaps: - reason = lookup.get((estimator, dataset), "reason not recorded") + reason = lookup.get((estimator, dataset)) + if reason is None: + # Several estimators were only ever run on Multiverse-core, so a + # gap outside it is not a failure and has no log to cite. + reason = ( + "not run outside Multiverse-core" + if core and dataset not in core + else "reason not recorded" + ) grouped.setdefault(reason, []).append(dataset) summary = "; ".join( f"{escape(', '.join(names))} ({escape(reason)})" @@ -527,6 +562,10 @@ def _snippet_html( datasets_expr = f"[...] # {n_datasets} datasets" if "multiverse_core" in datasets_expr: imports.insert(0, "from aeon.datasets.tsc_datasets import multiverse_core") + if "paper_datasets" in datasets_expr: + imports[0] = ( + "from multiverse.experiments.tables import leaderboard, paper_datasets" + ) estimator_list = ", ".join(f'"{name}"' for name in estimators) metric_list = ", ".join(f'"{name}"' for name in metrics) @@ -680,6 +719,8 @@ def leaderboard( decimals: int = 4, max_cd_estimators: int | None = 6, datasets_expr: str | None = None, + core_sections: bool = True, + extra_html: str = "", ) -> Path: """Write a single-table HTML leaderboard. @@ -736,6 +777,13 @@ def leaderboard( How ``datasets`` was written, for the "Reproducing this page" snippet, for example ``"sorted(multiverse_core)"``. When None, a well-known aeon dataset list is recognised automatically. Only affects that snippet. + core_sections : bool, default=True + Whether to list the datasets and estimators held out of the + Multiverse-core table. Those lists explain the core table's choices, so + a page built over another collection turns them off. + extra_html : str, default="" + HTML placed after the missing-results section, for example + :func:`pending_html` output. Returns ------- @@ -823,9 +871,11 @@ def leaderboard( ) parts.append(_excluded_html(missing, reasons, common, dropped)) + parts.append(extra_html) parts.append(_estimator_notes_html(set(summary.index))) - parts.append(_deferred_html()) - parts.append(_withheld_html()) + if core_sections: + parts.append(_deferred_html()) + parts.append(_withheld_html()) parts.append( _snippet_html( datasets_expr if datasets_expr is not None else _describe_datasets(datasets), @@ -1261,6 +1311,199 @@ def number(value): return "\n".join(rows) +def paper_datasets(results_dir: Path | str = DEFAULT_RESULTS_DIR) -> list[str]: + """Return the 100 datasets of the paper's full-archive comparison. + + These are the Multiverse datasets on which all 17 classifiers in the + Multiverse archive paper have a resample-0 result. The list is stored rather + than recomputed so the full-archive leaderboard keeps describing the paper's + comparison as new results arrive. + """ + path = Path(results_dir) / "paper_datasets.txt" + return [ + line.strip() + for line in path.read_text(encoding="utf-8").splitlines() + if line.strip() and not line.startswith("#") + ] + + +def _datasets_with_all_metrics(estimator, results_dir) -> set[str]: + """Datasets for which ``estimator`` has a score on every metric it reports.""" + common = None + for metric in METRIC_LABELS: + path = Path(results_dir) / estimator / f"{estimator}_{metric}.csv" + if not path.is_file(): + continue + scored = set(load_metric(estimator, metric, results_dir).dropna().index) + common = scored if common is None else common & scored + return common or set() + + +def complete_estimators( + datasets, + candidates, + results_dir: Path | str = DEFAULT_RESULTS_DIR, +) -> list[str]: + """Return the candidates with a result on every dataset, on every metric. + + Parameters + ---------- + datasets : list of str + Datasets that must all be present. + candidates : list of str + Estimator names, matching their results directories. + results_dir : Path or str + Directory holding one sub-directory per estimator. + + Returns + ------- + list of str + The complete candidates, in the order given. + """ + required = set(datasets) + return [ + estimator + for estimator in candidates + if required <= _datasets_with_all_metrics(estimator, results_dir) + ] + + +def pending_results( + datasets, + estimators, + results_dir: Path | str = DEFAULT_RESULTS_DIR, +) -> pd.DataFrame: + """List what each estimator still needs to cover ``datasets``. + + Returns + ------- + pd.DataFrame + One row per estimator with ``completed``, ``total`` and ``missing``, the + datasets it has no complete result for, in the order given. Estimators + with nothing missing are left out. + """ + rows = [] + for estimator in estimators: + have = _datasets_with_all_metrics(estimator, results_dir) + missing = [name for name in datasets if name not in have] + if missing: + rows.append( + { + "estimator": estimator, + "completed": len(datasets) - len(missing), + "total": len(datasets), + "missing": missing, + } + ) + columns = ["estimator", "completed", "total", "missing"] + if not rows: + return pd.DataFrame(columns=columns) + return ( + pd.DataFrame(rows, columns=columns) + .sort_values(["completed", "estimator"], ascending=[False, True]) + .reset_index(drop=True) + ) + + +def pending_markdown(pending: pd.DataFrame) -> str: + """Render :func:`pending_results` as a Markdown table.""" + if pending.empty: + return "Every estimator in the Multiverse-core table has completed these datasets." + rows = [ + "| Estimator | Completed | Missing datasets |", + "|---|---|---|", + ] + for row in pending.itertuples(): + rows.append( + f"| {row.estimator} | {row.completed} of {row.total} | " + f"{', '.join(row.missing)} |" + ) + return "\n".join(rows) + + +def pending_html(pending: pd.DataFrame, collection: str) -> str: + """Render :func:`pending_results` as a page section.""" + if pending.empty: + return "" + items = "".join( + f"
  • {escape(row.estimator)} — {row.completed} of " + f"{row.total}; missing {escape(', '.join(row.missing))}
    • " + for row in pending.itertuples() + ) + return ( + "

    Not yet complete

    " + f'

    Estimators in the Multiverse-core table that do not ' + f"yet have a result on every {escape(collection)} dataset, so are not " + "ranked above.

    " + f'' + ) + + +def write_pending_csv(pending: pd.DataFrame, path: Path | str) -> Path: + """Write one ``estimator,dataset`` row per missing result, to queue runs from.""" + path = Path(path) + rows = [ + (row.estimator, dataset) + for row in pending.itertuples() + for dataset in row.missing + ] + pd.DataFrame(rows, columns=["estimator", "dataset"]).to_csv(path, index=False) + return path + + +def eeg_archive_markdown( + archive_dir: Path | str = DEFAULT_EEG_ARCHIVE_DIR, + decimals: int = 4, +) -> str: + """Return the EEG archive study's mean results as a Markdown leaderboard. + + ``results/eeg`` holds one file per metric, ``_mean.csv``, with a row + per dataset and a column per estimator. Estimators are ranked on accuracy + over the datasets every one of them has a result for. + """ + archive_dir = Path(archive_dir) + labels = {"accuracy": "Accuracy", "balacc": "Balanced accuracy"} + frames = { + metric: pd.read_csv(archive_dir / f"{metric}_mean.csv", index_col=0) + for metric in labels + if (archive_dir / f"{metric}_mean.csv").is_file() + } + if "accuracy" not in frames: + raise FileNotFoundError(f"no accuracy_mean.csv in {archive_dir}") + common = frames["accuracy"].dropna().index + for frame in frames.values(): + common = common.intersection(frame.dropna().index) + frames = {metric: frame.loc[common] for metric, frame in frames.items()} + + ranks = frames["accuracy"].rank(axis=1, ascending=False).mean() + order = ranks.sort_values().index + means = {metric: frame.mean() for metric, frame in frames.items()} + best = {metric: values.max() for metric, values in means.items()} + + header = ["#", "Estimator", "Accuracy rank"] + [labels[m] for m in frames] + rows = ["| " + " | ".join(header) + " |", "|" + "---|" * len(header)] + for position, estimator in enumerate(order, 1): + rank = ranks[estimator] + cells = [ + str(position), + estimator, + f"**{rank:.2f}**" if np.isclose(rank, ranks.min()) else f"{rank:.2f}", + ] + for metric in frames: + text = f"{means[metric][estimator]:.{decimals}f}" + cells.append( + f"**{text}**" if np.isclose(means[metric][estimator], best[metric]) + else text + ) + rows.append("| " + " | ".join(cells) + " |") + rows.append("") + rows.append( + f"Average over the {len(common)} datasets in `results/eeg`, ordered by average " + "accuracy rank. Best in each column in bold." + ) + return "\n".join(rows) + + def main() -> None: """Build the Multiverse-core leaderboard. @@ -1336,6 +1579,88 @@ def main() -> None: else: print(f"no LEADERBOARD markers in {readme}; Markdown table not written") + _collection_pages( + datasets=paper_datasets(), + core_estimators=estimators, + name="full", + title="Multiverse leaderboard: the paper's 100 datasets", + collection="paper", + datasets_expr="paper_datasets()", + ) + + from aeon.datasets.tsc_datasets import eeg2026, multiverse2026 + + # The EEG archive's two univariate problems are not part of the Multiverse, + # so no Multiverse run covers them. + _collection_pages( + datasets=sorted(set(eeg2026) & set(multiverse2026)), + core_estimators=estimators, + name="eeg", + title="EEG leaderboard", + collection="EEG", + datasets_expr="sorted(set(eeg2026) & set(multiverse2026))", + ) + docs = Path(__file__).resolve().parents[2] / "docs" / "leaderboard_eeg.md" + if write_markdown_table(docs, eeg_archive_markdown(), marker="EEG_ARCHIVE"): + print(f"updated the EEG archive table in {docs}") + + +def _collection_pages( + datasets, core_estimators, name, title, collection, datasets_expr +) -> None: + """Build the leaderboard pages for a collection other than Multiverse-core. + + Ranks every estimator with a result on all of ``datasets``, which can include + ones held out of the core table, then lists the core-table estimators that + are not there yet. Writes ``leaderboard_.html``, ``pending_.csv`` + and the ``_LEADERBOARD`` and ``_PENDING`` blocks of + ``docs/leaderboard_.md``. + """ + # LiteTIME is univariate and DisjointCNN-Aeon is known to be broken, so + # neither belongs in any table; the others withheld from the core table are + # withheld only because they cannot finish it. + unsuitable = {"LiteTIME", "DisjointCNN-Aeon"} + candidates = [ + estimator + for estimator in available_estimators() + if estimator not in unsuitable + ] + complete = complete_estimators(datasets, candidates) + pending = pending_results( + datasets, [e for e in core_estimators if e not in complete] + ) + print( + f"{name}: {len(complete)} estimators complete on {len(datasets)} datasets, " + f"{len(pending)} core-table estimators pending" + ) + + path = leaderboard( + datasets, + complete, + sort_by="accuracy", + title=title, + output_path=Path(DEFAULT_RESULTS_DIR) / f"leaderboard_{name}.html", + datasets_expr=datasets_expr, + core_sections=False, + extra_html=pending_html(pending, collection), + ) + print(f"wrote {path}") + csv_path = write_pending_csv( + pending, Path(DEFAULT_RESULTS_DIR) / f"pending_{name}.csv" + ) + print(f"wrote {csv_path}") + + docs = Path(__file__).resolve().parents[2] / "docs" / f"leaderboard_{name}.md" + table = leaderboard_markdown( + datasets, complete, sort_by="accuracy", collection=collection + ) + marker = name.upper() + if write_markdown_table(docs, table, marker=f"{marker}_LEADERBOARD"): + write_markdown_table(docs, pending_markdown(pending), marker=f"{marker}_PENDING") + print(f"updated {docs}") + else: + print(f"no {marker}_LEADERBOARD markers in {docs}; Markdown not written") + if __name__ == "__main__": main() diff --git a/multiverse/experiments/tests/test_ingest.py b/multiverse/experiments/tests/test_ingest.py index 7883565..6764297 100644 --- a/multiverse/experiments/tests/test_ingest.py +++ b/multiverse/experiments/tests/test_ingest.py @@ -99,3 +99,34 @@ def test_ingest_output_is_readable_by_the_leaderboard(predictions, tmp_path, mon assert series.name == "Alice" assert list(series.index) == ["d1", "d2"] assert series["d1"] == pytest.approx(1.0) + + +def test_ingest_scores_a_test_split_missing_a_class(tmp_path, monkeypatch): + """Three classes trained, two in the test split: log loss and AUROC still score. + + tsml-eval raises on such a file; ingest falls back to computing those two + metrics with the full label set. + """ + from tsml_eval.evaluation.storage import ClassifierResults + + labels = np.array([0, 0, 1, 1]) + probabilities = np.array( + [[0.8, 0.1, 0.1], [0.6, 0.3, 0.1], [0.2, 0.7, 0.1], [0.3, 0.6, 0.1]] + ) + results = ClassifierResults( + dataset_name="d1", classifier_name="Alice", split="TEST", resample_id=0, + n_classes=3, class_labels=labels, predictions=probabilities.argmax(axis=1), + probabilities=probabilities, fit_time=1.0, predict_time=1.0, + ) + directory = tmp_path / "Alice" / "Predictions" / "d1" + directory.mkdir(parents=True) + results.save_to_file(str(directory) + "/") + + out = tmp_path / "out" + monkeypatch.setattr(ingest_module, "results_path", out) + assert ingest("Alice", tmp_path, datasets=["d1"]) == ["d1"] + + auroc = pd.read_csv(out / "Alice" / "Alice_auroc.csv", index_col=0).iloc[0, 0] + logloss = pd.read_csv(out / "Alice" / "Alice_logloss.csv", index_col=0).iloc[0, 0] + assert auroc == pytest.approx(1.0) + assert np.isfinite(logloss) and logloss > 0 diff --git a/multiverse/experiments/tests/test_tables.py b/multiverse/experiments/tests/test_tables.py index b580ec2..1d19fc9 100644 --- a/multiverse/experiments/tests/test_tables.py +++ b/multiverse/experiments/tests/test_tables.py @@ -12,6 +12,7 @@ LOWER_IS_BETTER, METRIC_LABELS, available_estimators, + complete_estimators, dataset_markdown, dataset_page, dataset_summary, @@ -19,6 +20,10 @@ leaderboard_markdown, load_metric, load_missing_reasons, + eeg_archive_markdown, + paper_datasets, + pending_markdown, + pending_results, write_markdown_table, ) @@ -293,3 +298,67 @@ def test_dataset_markdown_marks_the_best(results_dir): assert "| d1 |" in table assert "**0.9000**" in table assert "Alice" in table + + +def test_complete_estimators_needs_every_dataset(results_dir): + """Carol lacks d3, so she is complete on d1 and d2 but not on all three.""" + assert complete_estimators(["d1", "d2", "d3"], ["Alice", "Bob", "Carol"], results_dir) == [ + "Alice", + "Bob", + ] + assert complete_estimators(["d1", "d2"], ["Alice", "Carol"], results_dir) == [ + "Alice", + "Carol", + ] + + +def test_pending_results_lists_the_gaps(results_dir): + pending = pending_results(["d1", "d2", "d3"], ["Alice", "Carol"], results_dir) + + assert list(pending["estimator"]) == ["Carol"] + row = pending.iloc[0] + assert (row["completed"], row["total"], row["missing"]) == (2, 3, ["d3"]) + assert "| Carol | 2 of 3 | d3 |" in pending_markdown(pending) + + +def test_pending_results_empty_when_all_complete(results_dir): + pending = pending_results(["d1", "d2"], ["Alice", "Bob"], results_dir) + + assert pending.empty + assert "Every estimator" in pending_markdown(pending) + + +def test_core_sections_can_be_left_out(results_dir, tmp_path): + """A page over another collection omits the core table's held-out lists.""" + with_core = leaderboard( + ["d1", "d2"], ["Alice", "Bob"], results_dir=results_dir, + output_path=tmp_path / "with.html", + ).read_text(encoding="utf-8") + without = leaderboard( + ["d1", "d2"], ["Alice", "Bob"], results_dir=results_dir, + output_path=tmp_path / "without.html", core_sections=False, + extra_html="

    Extra section

    ", + ).read_text(encoding="utf-8") + + assert "Estimators not listed" in with_core + assert "Estimators not listed" not in without + assert "Extra section" in without + + +def test_paper_datasets_skips_comments(tmp_path): + (tmp_path / "paper_datasets.txt").write_text("# header\nd1\n\nd2\n", encoding="utf-8") + + assert paper_datasets(tmp_path) == ["d1", "d2"] + + +def test_eeg_archive_markdown_ranks_on_accuracy(tmp_path): + frame = pd.DataFrame( + {"A": [0.9, 0.8], "B": [0.5, 0.6]}, index=pd.Index(["e1", "e2"], name="Estimators:") + ) + frame.to_csv(tmp_path / "accuracy_mean.csv") + frame.to_csv(tmp_path / "balacc_mean.csv") + + table = eeg_archive_markdown(tmp_path) + + assert table.splitlines()[2].startswith("| 1 | A | **1.00** |") + assert "Average over the 2 datasets" in table diff --git a/results/multiverse/1NN-DTW/1NN-DTW_accuracy.csv b/results/multiverse/1NN-DTW/1NN-DTW_accuracy.csv index 37bf47f..4f98fe1 100644 --- a/results/multiverse/1NN-DTW/1NN-DTW_accuracy.csv +++ b/results/multiverse/1NN-DTW/1NN-DTW_accuracy.csv @@ -3,16 +3,19 @@ Alzheimers,0.27906976744186046 AppliancesEnergy_disc,0.6428571428571429 ArticularyWordRecognition,0.9866666666666667 AsphaltObstaclesCoordinates,0.578005115089514 +AsphaltPavementTypeCoordinates,0.5833333333333334 AsphaltRegularityCoordinates,0.7030625832223701 AtrialFibrillation,0.2 AustraliaRainfall_disc,0.692706058526237 AutomotiveRoadTrials,0.6623376623376623 +BasicMotions,0.975 BeijingPM10Quality_disc,0.741283676703645 BeijingPM25Quality_disc,0.813985736925515 BenzeneConcentration_disc,0.8206469107108271 Blink,0.5844444444444444 BoneIntensitiesAgeGroup,0.5235955056179775 BoneProbAgeGroup,0.5191011235955056 +ButtonPress,0.5666666666666667 CharacterTrajectories,0.9881615598885793 CounterMovementJump,0.5754189944134078 Cricket,1.0 @@ -25,6 +28,8 @@ Epilepsy,0.9637681159420289 EthanolConcentration,0.3231939163498099 EyesOpenShut,0.47619047619047616 FaceDetection,0.5286606129398411 +FeedbackButton,0.52 +FingerMovements,0.53 FordChallenge,0.6552247036118004 HandMovementDirection,0.1891891891891892 Handwriting,0.6070588235294118 @@ -32,34 +37,77 @@ Heartbeat,0.7170731707317073 HouseholdPowerConsumption1_disc,0.7638483965014577 HouseholdPowerConsumption2_disc,0.6457725947521866 IEEEPPG_disc,0.3878012048192771 +IRDS-EFL,0.6538461538461539 +IRDS-EFR,0.8 +IRDS-SAL,0.32142857142857145 +IRDS-SAR,0.12121212121212122 +IRDS-SFE,1.0 IRDS-SFL,0.49137931034482757 +IRDS-SFR,0.8666666666666667 +IRDS-STL,0.5263157894736842 +IRDS-STR,0.18333333333333332 +ImaginedFeetHands,0.5596899224806201 +InnerSpeech,0.25 JapaneseVowels,0.9594594594594594 +KERAAL-CTK,0.9285714285714286 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.6428571428571429 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,0.42857142857142855 +KIMORE-LT-C,0.42857142857142855 KIMORE-PR-C,0.2857142857142857 +KIMORE-Sq-C,0.5714285714285714 +KIMORE-TR-C,0.14285714285714285 +KINECAL-3WFV,0.9166666666666666 +KINECAL-GGFV,1.0 +KINECAL-QSEC,0.8888888888888888 KINECAL-QSEO,0.8823529411764706 LSST,0.551094890510949 Libras,0.8722222222222222 +LiveFuelMoistureContent_disc,0.7284768211920529 Locust2022,0.8754167929675659 LowCost,0.5383333333333333 MindReading,0.4104134762633997 MotionSenseHAR,0.9471698113207547 MotorImagery,0.5 NATOPS,0.8833333333333333 +NewsHeadlineSentiment_disc,0.4273576209370366 +NewsTitleSentiment_disc,0.45276742415133664 +Opportunity,0.7381776239907728 PEMS-SF,0.7109826589595376 PenDigits,0.9771297884505432 PhonemeSpectra,0.15120787354607815 PhotoStimulation,0.25 +PronouncedSpeech,0.23 RacketSports,0.8026315789473685 +SPHERE-WUS,0.75 STEW,0.6506734006734006 SelfRegulationSCP1,0.7747440273037542 +SelfRegulationSCP2,0.5388888888888889 Skoda,0.9543685886098338 SpokenArabicDigits,0.9722601182355616 StandWalkJump,0.2 TactileTextureRecognition,0.9838472834067548 Tiselac,0.7660262891809909 +UCDHE-MP,0.5 +UCDHE-MP-MC,0.3812154696132597 +UCDHE-Rowing,0.6636363636363637 UCDHE-Rowing-MC,0.4909090909090909 UCIActivity,0.9745939192003332 UIPRMD-DS-C,0.75 +UIPRMD-HS-C,0.7777777777777778 +UIPRMD-IL-C,0.5 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.7777777777777778 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.6666666666666666 +UIPRMD-SSIER-C,0.65 +UIPRMD-SSS-C,0.8888888888888888 +UIPRMD-STS-C,0.8055555555555556 USCActivity,0.6193803159173754 UWaveGestureLibrary,0.903125 +VisualSpeech,0.255 WISDM,0.8305968707745799 +WISDM2,0.5488614055751865 diff --git a/results/multiverse/1NN-DTW/1NN-DTW_auroc.csv b/results/multiverse/1NN-DTW/1NN-DTW_auroc.csv index 9a9e1f9..b7c865a 100644 --- a/results/multiverse/1NN-DTW/1NN-DTW_auroc.csv +++ b/results/multiverse/1NN-DTW/1NN-DTW_auroc.csv @@ -3,16 +3,19 @@ Alzheimers,0.4497198275862069 AppliancesEnergy_disc,0.44485294117647056 ArticularyWordRecognition,0.9930555555555556 AsphaltObstaclesCoordinates,0.7243987890818997 +AsphaltPavementTypeCoordinates,0.66912177328844 AsphaltRegularityCoordinates,0.7000922182024544 AtrialFibrillation,0.4 AustraliaRainfall_disc,0.6403427651769513 AutomotiveRoadTrials,0.545825771324864 +BasicMotions,0.9833333333333334 BeijingPM10Quality_disc,0.6735074184883326 BeijingPM25Quality_disc,0.7846204311710775 BenzeneConcentration_disc,0.7863625081117012 Blink,0.6004999999999999 BoneIntensitiesAgeGroup,0.6224033270495455 BoneProbAgeGroup,0.6180769537613523 +ButtonPress,0.5114052379611377 CharacterTrajectories,0.9937944529646192 CounterMovementJump,0.6809873949579832 Cricket,1.0 @@ -25,6 +28,8 @@ Epilepsy,0.975853995655976 EthanolConcentration,0.5486976362610881 EyesOpenShut,0.47619047619047616 FaceDetection,0.5286606129398411 +FeedbackButton,0.52 +FingerMovements,0.5300120048019207 FordChallenge,0.6257238145393458 HandMovementDirection,0.47758089368258866 Handwriting,0.795726495604407 @@ -32,34 +37,77 @@ Heartbeat,0.6044926505452821 HouseholdPowerConsumption1_disc,0.7111063420280949 HouseholdPowerConsumption2_disc,0.5518797587272891 IEEEPPG_disc,0.5373930154896306 +IRDS-EFL,0.625 +IRDS-EFR,0.7 +IRDS-SAL,0.5 +IRDS-SAR,0.5 +IRDS-SFE,1.0 IRDS-SFL,0.6793478260869565 +IRDS-SFR,0.5 +IRDS-STL,0.5050505050505051 +IRDS-STR,0.5545454545454546 +ImaginedFeetHands,0.5596892707273923 +InnerSpeech,0.5041174306367138 JapaneseVowels,0.9771341117563801 +KERAAL-CTK,0.9285714285714286 +KERAAL-CTK-MC,0.9017857142857143 +KERAAL-ELK,0.3125 +KERAAL-ELK-MC,0.5 KERAAL-RTK,0.6666666666666666 +KERAAL-RTK-MC,0.4166666666666667 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.4583333333333333 KIMORE-PR-C,0.5833333333333333 +KIMORE-Sq-C,0.7 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.5 +KINECAL-GGFV,1.0 +KINECAL-QSEC,0.47058823529411764 KINECAL-QSEO,0.46875 LSST,0.7263593281144675 Libras,0.931547619047619 +LiveFuelMoistureContent_disc,0.505725065616798 Locust2022,0.6297672005250023 LowCost,0.5383333333333334 MindReading,0.6279810446160394 MotionSenseHAR,0.9644581011377836 MotorImagery,0.5 NATOPS,0.93 +NewsHeadlineSentiment_disc,0.5026193009747513 +NewsTitleSentiment_disc,0.5005651532291809 +Opportunity,0.7850756817966174 PEMS-SF,0.8324666689920395 PenDigits,0.9872867545212423 PhonemeSpectra,0.5644349170275508 PhotoStimulation,0.4425274725274725 +PronouncedSpeech,0.4940989538304975 RacketSports,0.8640505455299033 +SPHERE-WUS,0.75 STEW,0.6506734006734007 SelfRegulationSCP1,0.7753238281614017 +SelfRegulationSCP2,0.5388888888888889 Skoda,0.9724443356240564 SpokenArabicDigits,0.9845897070758112 StandWalkJump,0.4 TactileTextureRecognition,0.9915346980420825 Tiselac,0.8537316372178202 +UCDHE-MP,0.5 +UCDHE-MP-MC,0.581756709776109 +UCDHE-Rowing,0.6152380952380951 UCDHE-Rowing-MC,0.6791976430211724 UCIActivity,0.9845828702351841 UIPRMD-DS-C,0.75 +UIPRMD-HS-C,0.7777777777777777 +UIPRMD-IL-C,0.5 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.7777777777777778 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.6666666666666666 +UIPRMD-SSIER-C,0.65 +UIPRMD-SSS-C,0.8888888888888888 +UIPRMD-STS-C,0.8055555555555556 USCActivity,0.7918563587542018 UWaveGestureLibrary,0.9446428571428569 +VisualSpeech,0.49991109530583216 WISDM,0.8843626764890137 +WISDM2,0.7384258073321831 diff --git a/results/multiverse/1NN-DTW/1NN-DTW_balacc.csv b/results/multiverse/1NN-DTW/1NN-DTW_balacc.csv index 104d0bb..a5e6b02 100644 --- a/results/multiverse/1NN-DTW/1NN-DTW_balacc.csv +++ b/results/multiverse/1NN-DTW/1NN-DTW_balacc.csv @@ -3,16 +3,19 @@ Alzheimers,0.2893217893217893 AppliancesEnergy_disc,0.44485294117647056 ArticularyWordRecognition,0.9866666666666666 AsphaltObstaclesCoordinates,0.600988264961067 +AsphaltPavementTypeCoordinates,0.5337613265002971 AsphaltRegularityCoordinates,0.7000922182024545 AtrialFibrillation,0.20000000000000004 AustraliaRainfall_disc,0.37805344637015503 AutomotiveRoadTrials,0.5458257713248639 +BasicMotions,0.975 BeijingPM10Quality_disc,0.6735074184883325 BeijingPM25Quality_disc,0.7846204311710774 BenzeneConcentration_disc,0.7863625081117012 Blink,0.6005 BoneIntensitiesAgeGroup,0.5181387293774496 BoneProbAgeGroup,0.5327420850090371 +ButtonPress,0.5114052379611377 CharacterTrajectories,0.9872630595211239 CounterMovementJump,0.5763653483992467 Cricket,1.0 @@ -25,6 +28,8 @@ Epilepsy,0.9644276629570747 EthanolConcentration,0.3232517482517483 EyesOpenShut,0.47619047619047616 FaceDetection,0.5286606129398411 +FeedbackButton,0.52 +FingerMovements,0.5300120048019208 FordChallenge,0.6257238145393458 HandMovementDirection,0.20595238095238094 Handwriting,0.6008723240380003 @@ -32,34 +37,77 @@ Heartbeat,0.6044926505452821 HouseholdPowerConsumption1_disc,0.6426853808328903 HouseholdPowerConsumption2_disc,0.49856556431898896 IEEEPPG_disc,0.38219582290400195 +IRDS-EFL,0.625 +IRDS-EFR,0.7 +IRDS-SAL,0.5 +IRDS-SAR,0.5 +IRDS-SFE,1.0 IRDS-SFL,0.6793478260869565 +IRDS-SFR,0.5 +IRDS-STL,0.5050505050505051 +IRDS-STR,0.5545454545454546 +ImaginedFeetHands,0.5596892707273924 +InnerSpeech,0.25648610508033 JapaneseVowels,0.9586300314442694 +KERAAL-CTK,0.9285714285714286 +KERAAL-CTK-MC,0.6190476190476191 +KERAAL-ELK,0.3125 +KERAAL-ELK-MC,0.5 KERAAL-RTK,0.6666666666666667 +KERAAL-RTK-MC,0.24761904761904763 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.4583333333333333 KIMORE-PR-C,0.5833333333333334 +KIMORE-Sq-C,0.7 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.5 +KINECAL-GGFV,1.0 +KINECAL-QSEC,0.47058823529411764 KINECAL-QSEO,0.46875 LSST,0.429618717474448 Libras,0.8722222222222221 +LiveFuelMoistureContent_disc,0.5057250656167979 Locust2022,0.6297672005250023 LowCost,0.5383333333333333 MindReading,0.4059163225555123 MotionSenseHAR,0.9470659167025773 MotorImagery,0.5 NATOPS,0.8833333333333333 +NewsHeadlineSentiment_disc,0.3363558568860247 +NewsTitleSentiment_disc,0.335999113879392 +Opportunity,0.7682058596426741 PEMS-SF,0.7133619681445768 PenDigits,0.9772541773016672 PhonemeSpectra,0.15125749763232665 PhotoStimulation,0.24646464646464641 +PronouncedSpeech,0.24090923995016067 RacketSports,0.8177325581395349 +SPHERE-WUS,0.75 STEW,0.6506734006734007 SelfRegulationSCP1,0.7753238281614016 +SelfRegulationSCP2,0.538888888888889 Skoda,0.9505984286489515 SpokenArabicDigits,0.9722706517227065 StandWalkJump,0.20000000000000004 TactileTextureRecognition,0.9823493077039656 Tiselac,0.586739034914989 +UCDHE-MP,0.5 +UCDHE-MP-MC,0.3815066425120773 +UCDHE-Rowing,0.6152380952380953 UCDHE-Rowing-MC,0.5078095238095238 UCIActivity,0.9750292482827144 UIPRMD-DS-C,0.75 +UIPRMD-HS-C,0.7777777777777778 +UIPRMD-IL-C,0.5 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.7777777777777778 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.6666666666666666 +UIPRMD-SSIER-C,0.65 +UIPRMD-SSS-C,0.8888888888888888 +UIPRMD-STS-C,0.8055555555555556 USCActivity,0.613469460648695 UWaveGestureLibrary,0.903125 +VisualSpeech,0.250400641025641 WISDM,0.5062416462865531 +WISDM2,0.49685485855283823 diff --git a/results/multiverse/1NN-DTW/1NN-DTW_f1.csv b/results/multiverse/1NN-DTW/1NN-DTW_f1.csv index 290f5e9..d49f04e 100644 --- a/results/multiverse/1NN-DTW/1NN-DTW_f1.csv +++ b/results/multiverse/1NN-DTW/1NN-DTW_f1.csv @@ -3,16 +3,19 @@ Alzheimers,0.2712539547930461 AppliancesEnergy_disc,0.11764705882352941 ArticularyWordRecognition,0.9868896321070235 AsphaltObstaclesCoordinates,0.5820220716736432 +AsphaltPavementTypeCoordinates,0.5417482008365183 AsphaltRegularityCoordinates,0.622673434856176 AtrialFibrillation,0.21794871794871795 AustraliaRainfall_disc,0.6807217171495441 AutomotiveRoadTrials,0.3157894736842105 +BasicMotions,0.974937343358396 BeijingPM10Quality_disc,0.5339043540328337 BeijingPM25Quality_disc,0.6977792082394593 BenzeneConcentration_disc,0.7065906210392903 Blink,0.6144329896907217 BoneIntensitiesAgeGroup,0.5315835306406432 BoneProbAgeGroup,0.5238440525434598 +ButtonPress,0.07142857142857142 CharacterTrajectories,0.9881049483281434 CounterMovementJump,0.5655168907363639 Cricket,1.0 @@ -25,6 +28,8 @@ Epilepsy,0.963557125278809 EthanolConcentration,0.3237317080074347 EyesOpenShut,0.5416666666666666 FaceDetection,0.5247496423462089 +FeedbackButton,0.4935779816513762 +FingerMovements,0.5252525252525253 FordChallenge,0.5251566356559711 HandMovementDirection,0.18727144163190673 Handwriting,0.5923386307744966 @@ -32,34 +37,77 @@ Heartbeat,0.40816326530612246 HouseholdPowerConsumption1_disc,0.7662258226531378 HouseholdPowerConsumption2_disc,0.6270850514429548 IEEEPPG_disc,0.39046014375099575 +IRDS-EFL,0.4 +IRDS-EFR,0.5714285714285714 +IRDS-SAL,0.3870967741935484 +IRDS-SAR,0.21621621621621623 +IRDS-SFE,1.0 IRDS-SFL,0.4485981308411215 +IRDS-SFR,0.0 +IRDS-STL,0.35714285714285715 +IRDS-STR,0.1694915254237288 +ImaginedFeetHands,0.5590062111801242 +InnerSpeech,0.20735263802490692 JapaneseVowels,0.9598041728010116 +KERAAL-CTK,0.9230769230769231 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.8941798941798941 KERAAL-RTK,0.6666666666666666 +KERAAL-RTK-MC,0.2725274725274725 +KIMORE-LA-C,0.6 +KIMORE-LT-C,0.5 KIMORE-PR-C,0.2857142857142857 +KIMORE-Sq-C,0.5714285714285714 +KIMORE-TR-C,0.25 +KINECAL-3WFV,0.0 +KINECAL-GGFV,1.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.5503866191828247 Libras,0.86916688786254 +LiveFuelMoistureContent_disc,0.17338709677419356 Locust2022,0.32066115702479336 LowCost,0.5062388591800356 MindReading,0.4010245862657408 MotionSenseHAR,0.9468961296821594 MotorImagery,0.4444444444444444 NATOPS,0.8849632560768796 +NewsHeadlineSentiment_disc,0.41975232602021895 +NewsTitleSentiment_disc,0.45654536906058796 +Opportunity,0.7319584846421386 PEMS-SF,0.7077945012075944 PenDigits,0.9770979979070428 PhonemeSpectra,0.1518990262460969 PhotoStimulation,0.25728905597326646 +PronouncedSpeech,0.1727106227106227 RacketSports,0.7999663958169884 +SPHERE-WUS,0.6666666666666666 STEW,0.6636952998379254 SelfRegulationSCP1,0.8070175438596491 +SelfRegulationSCP2,0.5310734463276836 Skoda,0.9543496460899471 SpokenArabicDigits,0.9723126544544615 StandWalkJump,0.19047619047619044 TactileTextureRecognition,0.9837276385630812 Tiselac,0.7626100308354514 +UCDHE-MP,0.35587188612099646 +UCDHE-MP-MC,0.37269489712120635 +UCDHE-Rowing,0.39344262295081966 UCDHE-Rowing-MC,0.4977654544958299 UCIActivity,0.9745931762904378 UIPRMD-DS-C,0.8 +UIPRMD-HS-C,0.7777777777777778 +UIPRMD-IL-C,0.0 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.8181818181818182 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.75 +UIPRMD-SSIER-C,0.7407407407407407 +UIPRMD-SSS-C,0.9 +UIPRMD-STS-C,0.8372093023255814 USCActivity,0.6184666978498292 UWaveGestureLibrary,0.9022173742274735 +VisualSpeech,0.1614952515659729 WISDM,0.8106117725242419 +WISDM2,0.5659194992200115 diff --git a/results/multiverse/1NN-DTW/1NN-DTW_logloss.csv b/results/multiverse/1NN-DTW/1NN-DTW_logloss.csv index f24ccbb..8818885 100644 --- a/results/multiverse/1NN-DTW/1NN-DTW_logloss.csv +++ b/results/multiverse/1NN-DTW/1NN-DTW_logloss.csv @@ -3,16 +3,19 @@ Alzheimers,25.984959420061205 AppliancesEnergy_disc,12.872733353256127 ArticularyWordRecognition,0.4805820451882289 AsphaltObstaclesCoordinates,15.210237363693937 +AsphaltPavementTypeCoordinates,15.018188912132146 AsphaltRegularityCoordinates,10.702709328592709 AtrialFibrillation,28.834922711293718 AustraliaRainfall_disc,11.075996315055963 AutomotiveRoadTrials,12.170584261260336 +BasicMotions,0.901091334727929 BeijingPM10Quality_disc,9.325081483000593 BeijingPM25Quality_disc,6.70463362368879 BenzeneConcentration_disc,6.464540584606329 Blink,14.978140408366459 BoneIntensitiesAgeGroup,17.171358468523227 BoneProbAgeGroup,17.33335241633948 +ButtonPress,15.618916468617432 CharacterTrajectories,0.42670063204386616 CounterMovementJump,15.303450600965938 Cricket,2.220446049250313e-16 @@ -25,6 +28,8 @@ Epilepsy,1.3059294706201867 EthanolConcentration,24.39456389073328 EyesOpenShut,18.880008918108985 FaceDetection,16.988793495835296 +FeedbackButton,17.300953626776234 +FingerMovements,16.94051709288506 FordChallenge,12.426961280146399 HandMovementDirection,29.224583829013902 Handwriting,14.163035567017799 @@ -32,34 +37,77 @@ Heartbeat,10.197716568628268 HouseholdPowerConsumption1_disc,8.511766543785685 HouseholdPowerConsumption2_disc,12.767649815678524 IEEEPPG_disc,22.065881178729096 +IRDS-EFL,12.476649250079014 +IRDS-EFR,7.20873067782343 +IRDS-SAL,24.45819337118664 +IRDS-SAR,31.674725705587807 +IRDS-SFE,2.220446049250313e-16 IRDS-SFL,18.332547844464756 +IRDS-SFR,4.805820451882287 +IRDS-STL,17.073309500108124 +IRDS-STR,29.43565026777901 +ImaginedFeetHands,15.87038381784383 +InnerSpeech,27.03274004183786 JapaneseVowels,1.4612291914506954 +KERAAL-CTK,2.5745466706512254 +KERAAL-CTK-MC,5.149093341302451 +KERAAL-ELK,18.021826694558577 +KERAAL-ELK-MC,2.5745466706512254 KERAAL-RTK,12.872733353256125 +KERAAL-RTK-MC,24.953298500158024 +KIMORE-LA-C,20.596373365209804 +KIMORE-LT-C,20.596373365209804 KIMORE-PR-C,25.74546670651225 +KIMORE-Sq-C,15.447280023907352 +KIMORE-TR-C,30.8945600478147 +KINECAL-3WFV,3.0036377824264293 +KINECAL-GGFV,2.220446049250313e-16 +KINECAL-QSEC,4.004850376568573 KINECAL-QSEO,4.240429810484371 LSST,16.18018017102704 Libras,4.605577933053858 +LiveFuelMoistureContent_disc,9.786687344064921 Locust2022,4.490433932381676 LowCost,16.64015331464242 MindReading,21.25085230445651 MotionSenseHAR,1.9041930092363781 MotorImagery,18.021826694558573 NATOPS,4.2050928953970015 +NewsHeadlineSentiment_disc,20.640123426864886 +NewsTitleSentiment_disc,19.724261287122978 +Opportunity,9.437034970391686 PEMS-SF,10.417240863906692 PenDigits,0.8243259780244062 PhonemeSpectra,30.59356920531685 PhotoStimulation,27.03274004183787 +PronouncedSpeech,27.7536131096202 RacketSports,7.113878958378386 +SPHERE-WUS,9.010913347279288 STEW,12.59100686572695 SelfRegulationSCP1,8.119048203691918 +SelfRegulationSCP2,16.620129062759574 Skoda,1.6447227758033653 SpokenArabicDigits,0.9998466833725087 StandWalkJump,28.834922711293718 TactileTextureRecognition,0.5822029181795724 Tiselac,8.433267334925894 +UCDHE-MP,18.021826694558577 +UCDHE-MP-MC,22.303255135807294 +UCDHE-Rowing,12.12377432179395 UCDHE-Rowing-MC,18.349496270823273 UCIActivity,0.9157279703190948 UIPRMD-DS-C,9.010913347279288 +UIPRMD-HS-C,8.009700753137146 +UIPRMD-IL-C,18.021826694558577 +UIPRMD-SASLR-C,2.220446049250313e-16 +UIPRMD-SL-C,8.009700753137146 +UIPRMD-SSA-C,2.220446049250313e-16 +UIPRMD-SSE-C,12.014551129705715 +UIPRMD-SSIER-C,12.615278686191004 +UIPRMD-SSS-C,4.004850376568573 +UIPRMD-STS-C,7.008488158995003 USCActivity,13.718923966149388 UWaveGestureLibrary,3.491728922070724 +VisualSpeech,26.85252177489227 WISDM,6.105907672832864 +WISDM2,16.260683127901476 diff --git a/results/multiverse/1NN-DTW/1NN-DTW_sensitivity.csv b/results/multiverse/1NN-DTW/1NN-DTW_sensitivity.csv index b896226..774ac15 100644 --- a/results/multiverse/1NN-DTW/1NN-DTW_sensitivity.csv +++ b/results/multiverse/1NN-DTW/1NN-DTW_sensitivity.csv @@ -3,16 +3,19 @@ Alzheimers,0.27906976744186046 AppliancesEnergy_disc,0.125 ArticularyWordRecognition,0.9866666666666667 AsphaltObstaclesCoordinates,0.578005115089514 +AsphaltPavementTypeCoordinates,0.5833333333333334 AsphaltRegularityCoordinates,0.4972972972972973 AtrialFibrillation,0.2 AustraliaRainfall_disc,0.692706058526237 AutomotiveRoadTrials,0.3157894736842105 +BasicMotions,0.975 BeijingPM10Quality_disc,0.5130315500685871 BeijingPM25Quality_disc,0.7103538663171691 BenzeneConcentration_disc,0.6960049937578028 Blink,0.745 BoneIntensitiesAgeGroup,0.5235955056179775 BoneProbAgeGroup,0.5191011235955056 +ButtonPress,0.03773584905660377 CharacterTrajectories,0.9881615598885793 CounterMovementJump,0.5754189944134078 Cricket,1.0 @@ -25,6 +28,8 @@ Epilepsy,0.9637681159420289 EthanolConcentration,0.3231939163498099 EyesOpenShut,0.6190476190476191 FaceDetection,0.5204313280363224 +FeedbackButton,0.4678260869565217 +FingerMovements,0.5306122448979592 FordChallenge,0.5060373216245884 HandMovementDirection,0.1891891891891892 Handwriting,0.6070588235294118 @@ -32,34 +37,77 @@ Heartbeat,0.3508771929824561 HouseholdPowerConsumption1_disc,0.7638483965014577 HouseholdPowerConsumption2_disc,0.6457725947521866 IEEEPPG_disc,0.3878012048192771 +IRDS-EFL,0.25 +IRDS-EFR,0.4 +IRDS-SAL,0.8571428571428571 +IRDS-SAR,1.0 +IRDS-SFE,1.0 IRDS-SFL,1.0 +IRDS-SFR,0.0 +IRDS-STL,0.45454545454545453 +IRDS-STR,1.0 +ImaginedFeetHands,0.5584281282316442 +InnerSpeech,0.25 JapaneseVowels,0.9594594594594594 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.8333333333333334 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,1.0 +KIMORE-LT-C,0.6666666666666666 KIMORE-PR-C,1.0 +KIMORE-Sq-C,1.0 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.0 +KINECAL-GGFV,1.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.551094890510949 Libras,0.8722222222222222 +LiveFuelMoistureContent_disc,0.17916666666666667 Locust2022,0.3310580204778157 LowCost,0.47333333333333333 MindReading,0.4104134762633997 MotionSenseHAR,0.9471698113207547 MotorImagery,0.4 NATOPS,0.8833333333333333 +NewsHeadlineSentiment_disc,0.4273576209370366 +NewsTitleSentiment_disc,0.45276742415133664 +Opportunity,0.7381776239907728 PEMS-SF,0.7109826589595376 PenDigits,0.9771297884505432 PhonemeSpectra,0.15120787354607815 PhotoStimulation,0.25 +PronouncedSpeech,0.23 RacketSports,0.8026315789473685 +SPHERE-WUS,0.5 STEW,0.6893939393939394 SelfRegulationSCP1,0.9452054794520548 +SelfRegulationSCP2,0.5222222222222223 Skoda,0.9543685886098338 SpokenArabicDigits,0.9722601182355616 StandWalkJump,0.2 TactileTextureRecognition,0.9838472834067548 Tiselac,0.7660262891809909 +UCDHE-MP,0.5 +UCDHE-MP-MC,0.3812154696132597 +UCDHE-Rowing,0.5333333333333333 UCDHE-Rowing-MC,0.4909090909090909 UCIActivity,0.9745939192003332 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,0.7777777777777778 +UIPRMD-IL-C,0.0 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,1.0 USCActivity,0.6193803159173754 UWaveGestureLibrary,0.903125 +VisualSpeech,0.255 WISDM,0.8305968707745799 +WISDM2,0.5488614055751865 diff --git a/results/multiverse/1NN-DTW/1NN-DTW_specificity.csv b/results/multiverse/1NN-DTW/1NN-DTW_specificity.csv index c606311..32a8bca 100644 --- a/results/multiverse/1NN-DTW/1NN-DTW_specificity.csv +++ b/results/multiverse/1NN-DTW/1NN-DTW_specificity.csv @@ -3,16 +3,19 @@ Alzheimers,0.27906976744186046 AppliancesEnergy_disc,0.7647058823529411 ArticularyWordRecognition,0.9866666666666667 AsphaltObstaclesCoordinates,0.578005115089514 +AsphaltPavementTypeCoordinates,0.5833333333333334 AsphaltRegularityCoordinates,0.9028871391076115 AtrialFibrillation,0.2 AustraliaRainfall_disc,0.692706058526237 AutomotiveRoadTrials,0.7758620689655172 +BasicMotions,0.975 BeijingPM10Quality_disc,0.833983286908078 BeijingPM25Quality_disc,0.8588869960249857 BenzeneConcentration_disc,0.8767200224655995 Blink,0.456 BoneIntensitiesAgeGroup,0.5235955056179775 BoneProbAgeGroup,0.5191011235955056 +ButtonPress,0.9850746268656716 CharacterTrajectories,0.9881615598885793 CounterMovementJump,0.5754189944134078 Cricket,1.0 @@ -25,6 +28,8 @@ Epilepsy,0.9637681159420289 EthanolConcentration,0.3231939163498099 EyesOpenShut,0.3333333333333333 FaceDetection,0.5368898978433598 +FeedbackButton,0.5721739130434783 +FingerMovements,0.5294117647058824 FordChallenge,0.7454103074541031 HandMovementDirection,0.1891891891891892 Handwriting,0.6070588235294118 @@ -32,34 +37,77 @@ Heartbeat,0.8581081081081081 HouseholdPowerConsumption1_disc,0.7638483965014577 HouseholdPowerConsumption2_disc,0.6457725947521866 IEEEPPG_disc,0.3878012048192771 +IRDS-EFL,1.0 +IRDS-EFR,1.0 +IRDS-SAL,0.14285714285714285 +IRDS-SAR,0.0 +IRDS-SFE,1.0 IRDS-SFL,0.358695652173913 +IRDS-SFR,1.0 +IRDS-STL,0.5555555555555556 +IRDS-STR,0.10909090909090909 +ImaginedFeetHands,0.5609504132231405 +InnerSpeech,0.25 JapaneseVowels,0.9594594594594594 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,0.625 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.5 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,0.0 +KIMORE-LT-C,0.25 KIMORE-PR-C,0.16666666666666666 +KIMORE-Sq-C,0.4 +KIMORE-TR-C,0.0 +KINECAL-3WFV,1.0 +KINECAL-GGFV,1.0 +KINECAL-QSEC,0.9411764705882353 KINECAL-QSEO,0.9375 LSST,0.551094890510949 Libras,0.8722222222222222 +LiveFuelMoistureContent_disc,0.8322834645669291 Locust2022,0.928476380572189 LowCost,0.6033333333333334 MindReading,0.4104134762633997 MotionSenseHAR,0.9471698113207547 MotorImagery,0.6 NATOPS,0.8833333333333333 +NewsHeadlineSentiment_disc,0.4273576209370366 +NewsTitleSentiment_disc,0.45276742415133664 +Opportunity,0.7381776239907728 PEMS-SF,0.7109826589595376 PenDigits,0.9771297884505432 PhonemeSpectra,0.15120787354607815 PhotoStimulation,0.25 +PronouncedSpeech,0.23 RacketSports,0.8026315789473685 +SPHERE-WUS,1.0 STEW,0.6119528619528619 SelfRegulationSCP1,0.6054421768707483 +SelfRegulationSCP2,0.5555555555555556 Skoda,0.9543685886098338 SpokenArabicDigits,0.9722601182355616 StandWalkJump,0.2 TactileTextureRecognition,0.9838472834067548 Tiselac,0.7660262891809909 +UCDHE-MP,0.5 +UCDHE-MP-MC,0.3812154696132597 +UCDHE-Rowing,0.6971428571428572 UCDHE-Rowing-MC,0.4909090909090909 UCIActivity,0.9745939192003332 UIPRMD-DS-C,0.5 +UIPRMD-HS-C,0.7777777777777778 +UIPRMD-IL-C,1.0 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.5555555555555556 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.3333333333333333 +UIPRMD-SSIER-C,0.3 +UIPRMD-SSS-C,0.7777777777777778 +UIPRMD-STS-C,0.6111111111111112 USCActivity,0.6193803159173754 UWaveGestureLibrary,0.903125 +VisualSpeech,0.255 WISDM,0.8305968707745799 +WISDM2,0.5488614055751865 diff --git a/results/multiverse/Arsenal/Arsenal_accuracy.csv b/results/multiverse/Arsenal/Arsenal_accuracy.csv index 92d80ab..919675e 100644 --- a/results/multiverse/Arsenal/Arsenal_accuracy.csv +++ b/results/multiverse/Arsenal/Arsenal_accuracy.csv @@ -3,18 +3,22 @@ Alzheimers,0.4418604651162791 AppliancesEnergy_disc,0.8095238095238095 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8593350383631714 +AsphaltPavementTypeCoordinates,0.8589015151515151 AsphaltRegularityCoordinates,0.948069241011984 AtrialFibrillation,0.06666666666666667 AustraliaRainfall_disc,0.7643975790852936 AutomotiveRoadTrials,0.7662337662337663 BIDMC32HR_disc,0.8928720300125053 +BIDMC32RR_disc,0.6923718215923301 BIDMC32SpO2_disc,0.5760733639016257 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7812995245641838 BeijingPM25Quality_disc,0.8082408874801902 BenzeneConcentration_disc,0.6194073213248111 Blink,1.0 BoneIntensitiesAgeGroup,0.8044943820224719 BoneProbAgeGroup,0.6719101123595506 +ButtonPress,0.9833333333333333 CharacterTrajectories,0.9930362116991643 CounterMovementJump,0.9273743016759777 Cricket,1.0 @@ -27,6 +31,9 @@ Epilepsy,0.9855072463768116 EthanolConcentration,0.42585551330798477 EyesOpenShut,0.5238095238095238 FaceDetection,0.6398978433598184 +FeedbackButton,0.5313043478260869 +FeetHands,0.6666666666666666 +FingerMovements,0.56 FordChallenge,0.8395368072787428 HandMovementDirection,0.5 Handwriting,0.591764705882353 @@ -34,34 +41,86 @@ Heartbeat,0.7609756097560976 HouseholdPowerConsumption1_disc,0.8848396501457726 HouseholdPowerConsumption2_disc,0.7711370262390671 IEEEPPG_disc,0.6137048192771084 +IRDS-EFL,0.6153846153846154 +IRDS-EFR,0.6666666666666666 +IRDS-SAL,0.5178571428571429 +IRDS-SAR,0.30303030303030304 +IRDS-SFE,0.6666666666666666 IRDS-SFL,0.8103448275862069 +IRDS-SFR,0.8 +IRDS-STL,0.7368421052631579 +IRDS-STR,0.9166666666666666 +ImaginedFeetHands,0.6759689922480621 +ImaginedOpenCloseFist,0.7216931216931217 +InnerSpeech,0.26 JapaneseVowels,0.8324324324324325 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,0.7 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.8571428571428571 +KERAAL-RTK-MC,0.5384615384615384 +KIMORE-LA-C,0.42857142857142855 +KIMORE-LT-C,0.42857142857142855 KIMORE-PR-C,0.5714285714285714 +KIMORE-Sq-C,0.7142857142857143 +KIMORE-TR-C,0.2857142857142857 +KINECAL-3WFV,0.8333333333333334 +KINECAL-GGFV,0.9230769230769231 +KINECAL-QSEC,0.9444444444444444 KINECAL-QSEO,0.9411764705882353 LSST,0.656934306569343 Libras,0.9 +LiveFuelMoistureContent_disc,0.6635761589403973 Locust2022,0.8996665656259473 +LongIntervalTask,0.6928571428571428 LowCost,0.6266666666666667 +MatchingPennies,0.6328571428571429 MindReading,0.47473200612557426 MotionSenseHAR,0.9886792452830189 MotorImagery,0.5 NATOPS,0.8833333333333333 +NewsHeadlineSentiment_disc,0.5491162678850547 +NewsTitleSentiment_disc,0.6246242635565709 +OpenCloseFist,0.7296296296296296 +Opportunity,0.825836216839677 +PAMAP2,0.8552804446690248 PEMS-SF,0.8265895953757225 +PPGDalia_disc,0.8157061726096266 PenDigits,0.9817038307604345 PhonemeSpectra,0.298836862511184 PhotoStimulation,0.5555555555555556 +PronouncedSpeech,0.295 RacketSports,0.9013157894736842 +SPHERE-WUS,1.0 STEW,0.8385241301907969 SelfRegulationSCP1,0.8532423208191127 +SelfRegulationSCP2,0.55 +ShortIntervalTask,0.6946428571428571 +SitStand,0.398125 Skoda,0.9306685532366467 +SongFamiliarity,0.504 SpokenArabicDigits,0.9913597089586176 StandWalkJump,0.4666666666666667 TactileTextureRecognition,0.9985315712187959 Tiselac,0.6884732052578362 +UCDHE-MP,0.8535911602209945 +UCDHE-MP-MC,0.7569060773480663 +UCDHE-Rowing,0.7909090909090909 UCDHE-Rowing-MC,0.7386363636363636 UCIActivity,0.9521032902957102 UIPRMD-DS-C,0.8333333333333334 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.7222222222222222 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.9444444444444444 +UIPRMD-SSIER-C,0.9 +UIPRMD-SSS-C,0.9444444444444444 +UIPRMD-STS-C,1.0 USCActivity,0.7200789793438639 UWaveGestureLibrary,0.940625 +VisualSpeech,0.235 WISDM,0.8910565964844505 +WISDM2,0.6179426776599921 diff --git a/results/multiverse/Arsenal/Arsenal_auroc.csv b/results/multiverse/Arsenal/Arsenal_auroc.csv index 4070081..724ea8a 100644 --- a/results/multiverse/Arsenal/Arsenal_auroc.csv +++ b/results/multiverse/Arsenal/Arsenal_auroc.csv @@ -3,18 +3,22 @@ Alzheimers,0.6103067361668003 AppliancesEnergy_disc,0.854779411764706 ArticularyWordRecognition,0.9982523148148149 AsphaltObstaclesCoordinates,0.9494140645444262 +AsphaltPavementTypeCoordinates,0.9548831574409622 AsphaltRegularityCoordinates,0.9797049017521458 AtrialFibrillation,0.26999999999999996 AustraliaRainfall_disc,0.7719326723806222 AutomotiveRoadTrials,0.8148820326678766 BIDMC32HR_disc,0.9674109091711595 +BIDMC32RR_disc,0.47607316172425673 BIDMC32SpO2_disc,0.41517352827748144 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8131123644019549 BeijingPM25Quality_disc,0.8541755510950454 BenzeneConcentration_disc,0.5947125907274711 Blink,1.0 BoneIntensitiesAgeGroup,0.9072314148625059 BoneProbAgeGroup,0.8378695548426419 +ButtonPress,0.9902844269219938 CharacterTrajectories,0.9978099852155501 CounterMovementJump,0.9849830993850053 Cricket,1.0 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.6750773352798021 EyesOpenShut,0.5464852607709751 FaceDetection,0.6892453691953087 +FeedbackButton,0.5373338374291116 +FeetHands,0.715179610307729 +FingerMovements,0.5818327330932374 FordChallenge,0.8900599899982947 HandMovementDirection,0.7263307028137536 Handwriting,0.8505891534875232 @@ -34,34 +41,86 @@ Heartbeat,0.7139639639639639 HouseholdPowerConsumption1_disc,0.8893223037334842 HouseholdPowerConsumption2_disc,0.6870292433772359 IEEEPPG_disc,0.8344768520172102 +IRDS-EFL,0.6666666666666666 +IRDS-EFR,0.5 +IRDS-SAL,0.5289115646258504 +IRDS-SAR,0.6724137931034483 +IRDS-SFE,0.5 IRDS-SFL,0.9123641304347827 +IRDS-SFR,0.34615384615384615 +IRDS-STL,0.6195286195286195 +IRDS-STR,0.5690909090909091 +ImaginedFeetHands,0.7353192544035827 +ImaginedOpenCloseFist,0.8037740307091411 +InnerSpeech,0.5032872829490962 JapaneseVowels,0.9599187061351363 +KERAAL-CTK,0.9285714285714286 +KERAAL-CTK-MC,0.9141483516483516 +KERAAL-ELK,0.59375 +KERAAL-ELK-MC,0.315934065934066 KERAAL-RTK,0.9166666666666667 +KERAAL-RTK-MC,0.6730769230769231 +KIMORE-LA-C,0.625 +KIMORE-LT-C,0.4583333333333333 KIMORE-PR-C,0.8333333333333334 +KIMORE-Sq-C,0.8 +KIMORE-TR-C,0.5833333333333333 +KINECAL-3WFV,0.45454545454545453 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.5 LSST,0.8486202253943097 Libras,0.9643187830687832 +LiveFuelMoistureContent_disc,0.48923556430446197 Locust2022,0.7747014503416375 +LongIntervalTask,0.6636896929824562 LowCost,0.6829611111111111 +MatchingPennies,0.6599888975966561 MindReading,0.7764482998633778 MotionSenseHAR,0.9997936795095083 MotorImagery,0.4804 NATOPS,0.9740370370370369 +NewsHeadlineSentiment_disc,0.5008283537074154 +NewsTitleSentiment_disc,0.5035344215898659 +OpenCloseFist,0.8022359981366681 +Opportunity,0.9286004384952513 +PAMAP2,0.9674792102724625 PEMS-SF,0.9441543595731383 +PPGDalia_disc,0.9008212636837315 PenDigits,0.9956499531587623 PhonemeSpectra,0.7583601353028917 PhotoStimulation,0.6051098901098901 +PronouncedSpeech,0.5512465282767296 RacketSports,0.9606362523280678 +SPHERE-WUS,1.0 STEW,0.9106335678773014 SelfRegulationSCP1,0.9212095797222999 +SelfRegulationSCP2,0.5570987654320988 +ShortIntervalTask,0.7485902777777779 +SitStand,0.6594626953125001 Skoda,0.9850280483797296 +SongFamiliarity,0.5175960805816463 SpokenArabicDigits,0.9988446215963386 StandWalkJump,0.6133333333333333 TactileTextureRecognition,1.0 Tiselac,0.881979448070573 +UCDHE-MP,0.9279770992366412 +UCDHE-MP-MC,0.9138468736028518 +UCDHE-Rowing,0.6745396825396827 UCDHE-Rowing-MC,0.9134642871481106 UCIActivity,0.9935493041017873 UIPRMD-DS-C,0.9398148148148149 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.7777777777777778 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.9938271604938271 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,1.0 USCActivity,0.9460009889406951 UWaveGestureLibrary,0.9765066964285716 +VisualSpeech,0.5093693320343239 WISDM,0.9683437507528998 +WISDM2,0.8119265514640388 diff --git a/results/multiverse/Arsenal/Arsenal_balacc.csv b/results/multiverse/Arsenal/Arsenal_balacc.csv index 8928a98..20129eb 100644 --- a/results/multiverse/Arsenal/Arsenal_balacc.csv +++ b/results/multiverse/Arsenal/Arsenal_balacc.csv @@ -3,18 +3,22 @@ Alzheimers,0.41895141895141896 AppliancesEnergy_disc,0.7389705882352942 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8592092795324429 +AsphaltPavementTypeCoordinates,0.8436803698752229 AsphaltRegularityCoordinates,0.9483897283109881 AtrialFibrillation,0.06666666666666667 AustraliaRainfall_disc,0.3641183554595466 AutomotiveRoadTrials,0.6678765880217785 BIDMC32HR_disc,0.8265564893557625 +BIDMC32RR_disc,0.3068047909940461 BIDMC32SpO2_disc,0.4467495657100342 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6741470553396686 BeijingPM25Quality_disc,0.739466137954799 BenzeneConcentration_disc,0.576432471205433 Blink,1.0 BoneIntensitiesAgeGroup,0.8213805353804154 BoneProbAgeGroup,0.6869351794420323 +ButtonPress,0.9831033511686849 CharacterTrajectories,0.9927498468973225 CounterMovementJump,0.9268361581920904 Cricket,1.0 @@ -27,6 +31,9 @@ Epilepsy,0.9852941176470589 EthanolConcentration,0.4268065268065268 EyesOpenShut,0.5238095238095237 FaceDetection,0.6398978433598184 +FeedbackButton,0.531304347826087 +FeetHands,0.6667950783964809 +FingerMovements,0.5622248899559824 FordChallenge,0.807016943251289 HandMovementDirection,0.4869047619047619 Handwriting,0.5850099180126466 @@ -34,34 +41,86 @@ Heartbeat,0.6402916073968705 HouseholdPowerConsumption1_disc,0.6897591996384823 HouseholdPowerConsumption2_disc,0.5645265439785987 IEEEPPG_disc,0.6302396268994864 +IRDS-EFL,0.5833333333333334 +IRDS-EFR,0.5 +IRDS-SAL,0.4642857142857143 +IRDS-SAR,0.603448275862069 +IRDS-SFE,0.5 IRDS-SFL,0.865036231884058 +IRDS-SFR,0.46153846153846156 +IRDS-STL,0.5454545454545454 +IRDS-STR,0.5 +ImaginedFeetHands,0.675968104472382 +ImaginedOpenCloseFist,0.7217376016769986 +InnerSpeech,0.2579661979358028 JapaneseVowels,0.8282348325674245 +KERAAL-CTK,0.8571428571428572 +KERAAL-CTK-MC,0.6190476190476191 +KERAAL-ELK,0.4375 +KERAAL-ELK-MC,0.5 KERAAL-RTK,0.875 +KERAAL-RTK-MC,0.40952380952380957 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.4583333333333333 KIMORE-PR-C,0.75 +KIMORE-Sq-C,0.8 +KIMORE-TR-C,0.5833333333333334 +KINECAL-3WFV,0.45454545454545453 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.5 LSST,0.3705609041454892 Libras,0.8999999999999999 +LiveFuelMoistureContent_disc,0.5076935695538058 Locust2022,0.6353731672037041 +LongIntervalTask,0.5858187134502923 LowCost,0.6266666666666667 +MatchingPennies,0.6330492424242424 MindReading,0.459287573042462 MotionSenseHAR,0.9934935701163502 MotorImagery,0.5 NATOPS,0.8833333333333333 +NewsHeadlineSentiment_disc,0.3331558012687939 +NewsTitleSentiment_disc,0.3332050541979347 +OpenCloseFist,0.729627647185294 +Opportunity,0.810511136612571 +PAMAP2,0.858143789623636 PEMS-SF,0.8201307549133636 +PPGDalia_disc,0.7362999821876987 PenDigits,0.9820597635065071 PhonemeSpectra,0.2988810551054053 PhotoStimulation,0.5191919191919192 +PronouncedSpeech,0.2994294707849695 RacketSports,0.9093023255813953 +SPHERE-WUS,1.0 STEW,0.8385241301907969 SelfRegulationSCP1,0.8531357748578883 +SelfRegulationSCP2,0.55 +ShortIntervalTask,0.6230555555555556 +SitStand,0.39812499999999995 Skoda,0.9234056156829173 +SongFamiliarity,0.5016129147113488 SpokenArabicDigits,0.9913636363636364 StandWalkJump,0.46666666666666673 TactileTextureRecognition,0.9985994397759103 Tiselac,0.5092630260273595 +UCDHE-MP,0.8370229007633587 +UCDHE-MP-MC,0.7547252415458937 +UCDHE-Rowing,0.6209523809523809 UCDHE-Rowing-MC,0.7416111111111112 UCIActivity,0.955970339218421 UIPRMD-DS-C,0.8333333333333333 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.7222222222222222 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.9444444444444444 +UIPRMD-SSIER-C,0.9 +UIPRMD-SSS-C,0.9444444444444444 +UIPRMD-STS-C,1.0 USCActivity,0.747507933396351 UWaveGestureLibrary,0.940625 +VisualSpeech,0.23273347800658725 WISDM,0.6541600286010752 +WISDM2,0.4509277765789239 diff --git a/results/multiverse/Arsenal/Arsenal_f1.csv b/results/multiverse/Arsenal/Arsenal_f1.csv index e895a5f..ea037b2 100644 --- a/results/multiverse/Arsenal/Arsenal_f1.csv +++ b/results/multiverse/Arsenal/Arsenal_f1.csv @@ -3,18 +3,22 @@ Alzheimers,0.4439950567351983 AppliancesEnergy_disc,0.5555555555555556 ArticularyWordRecognition,0.9933217391304349 AsphaltObstaclesCoordinates,0.8590837940627573 +AsphaltPavementTypeCoordinates,0.8592218112858435 AsphaltRegularityCoordinates,0.9484808454425363 AtrialFibrillation,0.05555555555555555 AustraliaRainfall_disc,0.7411809930212727 AutomotiveRoadTrials,0.5 BIDMC32HR_disc,0.8855317090598989 +BIDMC32RR_disc,0.6575832135286377 BIDMC32SpO2_disc,0.16433853738701726 +BasicMotions,1.0 BeijingPM10Quality_disc,0.5261802575107296 BeijingPM25Quality_disc,0.6406829992576095 BenzeneConcentration_disc,0.43026964337489126 Blink,1.0 BoneIntensitiesAgeGroup,0.8020686043131018 BoneProbAgeGroup,0.6764176755402533 +ButtonPress,0.9811320754716981 CharacterTrajectories,0.9930366417008013 CounterMovementJump,0.9266586953557578 Cricket,1.0 @@ -27,6 +31,9 @@ Epilepsy,0.9853953649106892 EthanolConcentration,0.4233700112347921 EyesOpenShut,0.6153846153846154 FaceDetection,0.6352400114975568 +FeedbackButton,0.5259454705364995 +FeetHands,0.6698113207547169 +FingerMovements,0.6 FordChallenge,0.7601977750309024 HandMovementDirection,0.49889858510548174 Handwriting,0.5658190434507209 @@ -34,34 +41,86 @@ Heartbeat,0.46153846153846156 HouseholdPowerConsumption1_disc,0.8741036981048415 HouseholdPowerConsumption2_disc,0.7265140452457579 IEEEPPG_disc,0.626274468496864 +IRDS-EFL,0.2857142857142857 +IRDS-EFR,0.0 +IRDS-SAL,0.2702702702702703 +IRDS-SAR,0.25806451612903225 +IRDS-SFE,0.0 IRDS-SFL,0.6764705882352942 +IRDS-SFR,0.0 +IRDS-STL,0.16666666666666666 +IRDS-STR,0.0 +ImaginedFeetHands,0.675297773174521 +ImaginedOpenCloseFist,0.7327235772357723 +InnerSpeech,0.21239684959349595 JapaneseVowels,0.826755431187093 +KERAAL-CTK,0.8333333333333334 +KERAAL-CTK-MC,0.8288854003139717 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.8941798941798941 KERAAL-RTK,0.8571428571428571 +KERAAL-RTK-MC,0.5134865134865134 +KIMORE-LA-C,0.6 +KIMORE-LT-C,0.5 KIMORE-PR-C,0.4 +KIMORE-Sq-C,0.6666666666666666 +KIMORE-TR-C,0.2857142857142857 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.6031608851928645 Libras,0.900361196025364 +LiveFuelMoistureContent_disc,0.2087227414330218 Locust2022,0.3572815533980582 +LongIntervalTask,0.37454545454545457 LowCost,0.6097560975609756 +MatchingPennies,0.6435506241331485 MindReading,0.4218440312861138 MotionSenseHAR,0.9886696973971161 MotorImagery,0.4791666666666667 NATOPS,0.8798610441675976 +NewsHeadlineSentiment_disc,0.39477950460193156 +NewsTitleSentiment_disc,0.48049916827978273 +OpenCloseFist,0.7289124668435013 +Opportunity,0.8244824666986782 +PAMAP2,0.8560239577974429 PEMS-SF,0.821389746047209 +PPGDalia_disc,0.8103587319844963 PenDigits,0.981665221288063 PhonemeSpectra,0.2909527830297557 PhotoStimulation,0.5039568672997654 +PronouncedSpeech,0.28037700035114504 RacketSports,0.9012583564979668 +SPHERE-WUS,1.0 STEW,0.8315527586711547 SelfRegulationSCP1,0.8480565371024735 +SelfRegulationSCP2,0.547486033519553 +ShortIntervalTask,0.465625 +SitStand,0.3984112932425329 Skoda,0.9304722544182739 +SongFamiliarity,0.45930232558139533 SpokenArabicDigits,0.9913410255990966 StandWalkJump,0.4336996336996337 TactileTextureRecognition,0.9985309538428107 Tiselac,0.6755964722202751 +UCDHE-MP,0.7511737089201878 +UCDHE-MP-MC,0.7533503138676014 +UCDHE-Rowing,0.39473684210526316 UCDHE-Rowing-MC,0.7295639440007692 UCIActivity,0.9518872680302418 UIPRMD-DS-C,0.8 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.782608695652174 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.9411764705882353 +UIPRMD-SSIER-C,0.8888888888888888 +UIPRMD-SSS-C,0.9473684210526315 +UIPRMD-STS-C,1.0 USCActivity,0.7001370022683769 UWaveGestureLibrary,0.9403994940982429 +VisualSpeech,0.2191397422048191 WISDM,0.8797767249327081 +WISDM2,0.5697851824476239 diff --git a/results/multiverse/Arsenal/Arsenal_logloss.csv b/results/multiverse/Arsenal/Arsenal_logloss.csv index b7ec395..5be3748 100644 --- a/results/multiverse/Arsenal/Arsenal_logloss.csv +++ b/results/multiverse/Arsenal/Arsenal_logloss.csv @@ -3,18 +3,22 @@ Alzheimers,14.621431153672608 AppliancesEnergy_disc,1.9141514556040182 ArticularyWordRecognition,0.12897861878961592 AsphaltObstaclesCoordinates,2.2257547922744814 +AsphaltPavementTypeCoordinates,1.1645093656038803 AsphaltRegularityCoordinates,0.5675244419620414 AtrialFibrillation,33.640743163176005 AustraliaRainfall_disc,4.9892312516150215 AutomotiveRoadTrials,2.1872403091446544 BIDMC32HR_disc,0.48706325351266194 +BIDMC32RR_disc,1.6765304958505023 BIDMC32SpO2_disc,0.6938736492854484 +BasicMotions,2.220446049250313e-16 BeijingPM10Quality_disc,0.8404469084667157 BeijingPM25Quality_disc,0.7312569579921624 BenzeneConcentration_disc,0.6536979234935866 Blink,0.0005688830581897497 BoneIntensitiesAgeGroup,2.9994625882059265 BoneProbAgeGroup,2.171763247410876 +ButtonPress,0.3163301371817045 CharacterTrajectories,0.15928234000193617 CounterMovementJump,0.7310770388282447 Cricket,0.000566972146114874 @@ -27,6 +31,9 @@ Epilepsy,0.014469966507758326 EthanolConcentration,9.38411930032623 EyesOpenShut,12.273719199307951 FaceDetection,0.6441984239105549 +FeedbackButton,0.8059503416249661 +FeetHands,0.624514065919941 +FingerMovements,3.9449184349872515 FordChallenge,1.1591925292681795 HandMovementDirection,6.588205152041607 Handwriting,10.356631566242136 @@ -34,34 +41,86 @@ Heartbeat,3.9930753795846403 HouseholdPowerConsumption1_disc,1.6309393637831864 HouseholdPowerConsumption2_disc,5.011471075594067 IEEEPPG_disc,3.1462991095596697 +IRDS-EFL,11.214337918681146 +IRDS-EFR,12.014551129705717 +IRDS-SAL,5.660671419641943 +IRDS-SAR,21.001535769360498 +IRDS-SFE,12.014551129705717 IRDS-SFL,3.6278003326755104 +IRDS-SFR,7.2516482049697 +IRDS-STL,7.724434678238516 +IRDS-STR,2.4632021638416313 +ImaginedFeetHands,0.6054164389057348 +ImaginedOpenCloseFist,0.5643264635571777 +InnerSpeech,9.849386085560715 JapaneseVowels,2.439658443066612 +KERAAL-CTK,0.49916754395069124 +KERAAL-CTK-MC,2.803264981505996 +KERAAL-ELK,3.9472006574535747 +KERAAL-ELK-MC,2.6489670778891896 KERAAL-RTK,2.684193312553767 +KERAAL-RTK-MC,6.2944868966969905 +KIMORE-LA-C,15.75017481479308 +KIMORE-LT-C,20.596373365209804 KIMORE-PR-C,10.673919485529385 +KIMORE-Sq-C,10.412122133565338 +KIMORE-TR-C,25.777344356699995 +KINECAL-3WFV,3.2718774344987795 +KINECAL-GGFV,2.772588722239781 +KINECAL-QSEC,2.0024251882842865 KINECAL-QSEO,2.1202149052421855 LSST,6.660065877453233 Libras,2.4715168634174947 +LiveFuelMoistureContent_disc,0.6797563194218107 Locust2022,0.6321247301562677 +LongIntervalTask,2.530178139393349 LowCost,1.2483653757084126 +MatchingPennies,3.1712493120124385 MindReading,4.919728606667286 MotionSenseHAR,0.031180294454894883 MotorImagery,2.002267416085803 NATOPS,1.341332497177382 +NewsHeadlineSentiment_disc,13.82966193378667 +NewsTitleSentiment_disc,13.033773424770192 +OpenCloseFist,0.549167824753245 +Opportunity,2.002025035379219 +PAMAP2,2.0924153991085657 PEMS-SF,2.9406646160001144 +PPGDalia_disc,2.483913882807519 PenDigits,0.323517208837726 PhonemeSpectra,15.674137889010263 PhotoStimulation,14.165582252738933 +PronouncedSpeech,12.432064597549543 RacketSports,1.7643337729072799 +SPHERE-WUS,0.10662111883306005 STEW,0.7441700480198925 SelfRegulationSCP1,1.5873668599522848 +SelfRegulationSCP2,5.081029463722116 +ShortIntervalTask,1.0333498170881787 +SitStand,8.19559548841791 Skoda,0.8520265926657475 +SongFamiliarity,2.300796360027928 SpokenArabicDigits,0.09598796083164217 StandWalkJump,17.024610444285482 TactileTextureRecognition,0.0021162371264467138 Tiselac,4.885017291076485 +UCDHE-MP,0.3152581903473721 +UCDHE-MP-MC,3.5380380594637337 +UCDHE-Rowing,0.5710698297367459 UCDHE-Rowing-MC,2.761517911904249 UCIActivity,0.27315024174468755 UIPRMD-DS-C,2.222329769341206 +UIPRMD-HS-C,2.220446049250313e-16 +UIPRMD-IL-C,8.094102511167586 +UIPRMD-SASLR-C,2.220446049250313e-16 +UIPRMD-SL-C,0.02661894041663894 +UIPRMD-SSA-C,2.220446049250313e-16 +UIPRMD-SSE-C,0.14721845820930912 +UIPRMD-SSIER-C,0.24305837810866912 +UIPRMD-SSS-C,0.18851273400072122 +UIPRMD-STS-C,0.008757190006167306 USCActivity,2.7267852272793722 UWaveGestureLibrary,1.5184731993176808 +VisualSpeech,10.340964013711826 WISDM,1.5770752433542288 +WISDM2,7.144186562213325 diff --git a/results/multiverse/Arsenal/Arsenal_sensitivity.csv b/results/multiverse/Arsenal/Arsenal_sensitivity.csv index 4dea3e7..134f898 100644 --- a/results/multiverse/Arsenal/Arsenal_sensitivity.csv +++ b/results/multiverse/Arsenal/Arsenal_sensitivity.csv @@ -3,18 +3,22 @@ Alzheimers,0.4418604651162791 AppliancesEnergy_disc,0.625 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8593350383631714 +AsphaltPavementTypeCoordinates,0.8589015151515151 AsphaltRegularityCoordinates,0.9702702702702702 AtrialFibrillation,0.06666666666666667 AustraliaRainfall_disc,0.7643975790852936 AutomotiveRoadTrials,0.47368421052631576 BIDMC32HR_disc,0.8928720300125053 +BIDMC32RR_disc,0.6923718215923301 BIDMC32SpO2_disc,0.14641288433382138 +BasicMotions,1.0 BeijingPM10Quality_disc,0.4204389574759945 BeijingPM25Quality_disc,0.5655307994757536 BenzeneConcentration_disc,0.4631710362047441 Blink,1.0 BoneIntensitiesAgeGroup,0.8044943820224719 BoneProbAgeGroup,0.6719101123595506 +ButtonPress,0.9811320754716981 CharacterTrajectories,0.9930362116991643 CounterMovementJump,0.9273743016759777 Cricket,1.0 @@ -27,6 +31,9 @@ Epilepsy,0.9855072463768116 EthanolConcentration,0.42585551330798477 EyesOpenShut,0.7619047619047619 FaceDetection,0.6271282633371169 +FeedbackButton,0.52 +FeetHands,0.6819637139807898 +FingerMovements,0.673469387755102 FordChallenge,0.6750823271130626 HandMovementDirection,0.5 Handwriting,0.591764705882353 @@ -34,34 +41,86 @@ Heartbeat,0.3684210526315789 HouseholdPowerConsumption1_disc,0.8848396501457726 HouseholdPowerConsumption2_disc,0.7711370262390671 IEEEPPG_disc,0.6137048192771084 +IRDS-EFL,0.16666666666666666 +IRDS-EFR,0.0 +IRDS-SAL,0.35714285714285715 +IRDS-SAR,1.0 +IRDS-SFE,0.0 IRDS-SFL,0.9583333333333334 +IRDS-SFR,0.0 +IRDS-STL,0.09090909090909091 +IRDS-STR,0.0 +ImaginedFeetHands,0.6742502585315409 +ImaginedOpenCloseFist,0.763771186440678 +InnerSpeech,0.26 JapaneseVowels,0.8324324324324325 +KERAAL-CTK,0.7142857142857143 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,1.0 +KERAAL-RTK-MC,0.5384615384615384 +KIMORE-LA-C,1.0 +KIMORE-LT-C,0.6666666666666666 KIMORE-PR-C,1.0 +KIMORE-Sq-C,1.0 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.656934306569343 Libras,0.9 +LiveFuelMoistureContent_disc,0.2791666666666667 Locust2022,0.31399317406143346 +LongIntervalTask,0.2861111111111111 LowCost,0.5833333333333334 +MatchingPennies,0.6666666666666666 MindReading,0.47473200612557426 MotionSenseHAR,0.9886792452830189 MotorImagery,0.46 NATOPS,0.8833333333333333 +NewsHeadlineSentiment_disc,0.5491162678850547 +NewsTitleSentiment_disc,0.6246242635565709 +OpenCloseFist,0.7277542372881356 +Opportunity,0.825836216839677 +PAMAP2,0.8552804446690248 PEMS-SF,0.8265895953757225 +PPGDalia_disc,0.8157061726096266 PenDigits,0.9817038307604345 PhonemeSpectra,0.298836862511184 PhotoStimulation,0.5555555555555556 +PronouncedSpeech,0.295 RacketSports,0.9013157894736842 +SPHERE-WUS,1.0 STEW,0.7971380471380471 SelfRegulationSCP1,0.821917808219178 +SelfRegulationSCP2,0.5444444444444444 +ShortIntervalTask,0.3725 +SitStand,0.398125 Skoda,0.9306685532366467 +SongFamiliarity,0.4376731301939058 SpokenArabicDigits,0.9913597089586176 StandWalkJump,0.4666666666666667 TactileTextureRecognition,0.9985315712187959 Tiselac,0.6884732052578362 +UCDHE-MP,0.8 +UCDHE-MP-MC,0.7569060773480663 +UCDHE-Rowing,0.3333333333333333 UCDHE-Rowing-MC,0.7386363636363636 UCIActivity,0.9521032902957102 UIPRMD-DS-C,0.6666666666666666 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,1.0 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.8888888888888888 +UIPRMD-SSIER-C,0.8 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,1.0 USCActivity,0.7200789793438639 UWaveGestureLibrary,0.940625 +VisualSpeech,0.235 WISDM,0.8910565964844505 +WISDM2,0.6179426776599921 diff --git a/results/multiverse/Arsenal/Arsenal_specificity.csv b/results/multiverse/Arsenal/Arsenal_specificity.csv index 252ccf3..d5f0715 100644 --- a/results/multiverse/Arsenal/Arsenal_specificity.csv +++ b/results/multiverse/Arsenal/Arsenal_specificity.csv @@ -3,18 +3,22 @@ Alzheimers,0.4418604651162791 AppliancesEnergy_disc,0.8529411764705882 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8593350383631714 +AsphaltPavementTypeCoordinates,0.8589015151515151 AsphaltRegularityCoordinates,0.926509186351706 AtrialFibrillation,0.06666666666666667 AustraliaRainfall_disc,0.7643975790852936 AutomotiveRoadTrials,0.8620689655172413 BIDMC32HR_disc,0.8928720300125053 +BIDMC32RR_disc,0.6923718215923301 BIDMC32SpO2_disc,0.747086247086247 +BasicMotions,1.0 BeijingPM10Quality_disc,0.9278551532033427 BeijingPM25Quality_disc,0.9134014764338444 BenzeneConcentration_disc,0.6896939062061219 Blink,1.0 BoneIntensitiesAgeGroup,0.8044943820224719 BoneProbAgeGroup,0.6719101123595506 +ButtonPress,0.9850746268656716 CharacterTrajectories,0.9930362116991643 CounterMovementJump,0.9273743016759777 Cricket,1.0 @@ -27,6 +31,9 @@ Epilepsy,0.9855072463768116 EthanolConcentration,0.42585551330798477 EyesOpenShut,0.2857142857142857 FaceDetection,0.6526674233825198 +FeedbackButton,0.542608695652174 +FeetHands,0.6516264428121721 +FingerMovements,0.45098039215686275 FordChallenge,0.9389515593895156 HandMovementDirection,0.5 Handwriting,0.591764705882353 @@ -34,34 +41,86 @@ Heartbeat,0.9121621621621622 HouseholdPowerConsumption1_disc,0.8848396501457726 HouseholdPowerConsumption2_disc,0.7711370262390671 IEEEPPG_disc,0.6137048192771084 +IRDS-EFL,1.0 +IRDS-EFR,1.0 +IRDS-SAL,0.5714285714285714 +IRDS-SAR,0.20689655172413793 +IRDS-SFE,1.0 IRDS-SFL,0.7717391304347826 +IRDS-SFR,0.9230769230769231 +IRDS-STL,1.0 +IRDS-STR,1.0 +ImaginedFeetHands,0.6776859504132231 +ImaginedOpenCloseFist,0.6797040169133193 +InnerSpeech,0.26 JapaneseVowels,0.8324324324324325 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,0.875 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.75 +KERAAL-RTK-MC,0.5384615384615384 +KIMORE-LA-C,0.0 +KIMORE-LT-C,0.25 KIMORE-PR-C,0.5 +KIMORE-Sq-C,0.6 +KIMORE-TR-C,0.16666666666666666 +KINECAL-3WFV,0.9090909090909091 +KINECAL-GGFV,1.0 +KINECAL-QSEC,1.0 KINECAL-QSEO,1.0 LSST,0.656934306569343 Libras,0.9 +LiveFuelMoistureContent_disc,0.7362204724409449 Locust2022,0.9567531603459747 +LongIntervalTask,0.8855263157894737 LowCost,0.67 +MatchingPennies,0.5994318181818182 MindReading,0.47473200612557426 MotionSenseHAR,0.9886792452830189 MotorImagery,0.54 NATOPS,0.8833333333333333 +NewsHeadlineSentiment_disc,0.5491162678850547 +NewsTitleSentiment_disc,0.6246242635565709 +OpenCloseFist,0.7315010570824524 +Opportunity,0.825836216839677 +PAMAP2,0.8552804446690248 PEMS-SF,0.8265895953757225 +PPGDalia_disc,0.8157061726096266 PenDigits,0.9817038307604345 PhonemeSpectra,0.298836862511184 PhotoStimulation,0.5555555555555556 +PronouncedSpeech,0.295 RacketSports,0.9013157894736842 +SPHERE-WUS,1.0 STEW,0.8799102132435466 SelfRegulationSCP1,0.8843537414965986 +SelfRegulationSCP2,0.5555555555555556 +ShortIntervalTask,0.8736111111111111 +SitStand,0.398125 Skoda,0.9306685532366467 +SongFamiliarity,0.5655526992287918 SpokenArabicDigits,0.9913597089586176 StandWalkJump,0.4666666666666667 TactileTextureRecognition,0.9985315712187959 Tiselac,0.6884732052578362 +UCDHE-MP,0.8740458015267175 +UCDHE-MP-MC,0.7569060773480663 +UCDHE-Rowing,0.9085714285714286 UCDHE-Rowing-MC,0.7386363636363636 UCIActivity,0.9521032902957102 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.4444444444444444 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,0.8888888888888888 +UIPRMD-STS-C,1.0 USCActivity,0.7200789793438639 UWaveGestureLibrary,0.940625 +VisualSpeech,0.235 WISDM,0.8910565964844505 +WISDM2,0.6179426776599921 diff --git a/results/multiverse/CIF-500/CIF-500_accuracy.csv b/results/multiverse/CIF-500/CIF-500_accuracy.csv new file mode 100644 index 0000000..6187337 --- /dev/null +++ b/results/multiverse/CIF-500/CIF-500_accuracy.csv @@ -0,0 +1,126 @@ +Resamples:,0 +Alzheimers,0.3953488372093023 +AppliancesEnergy_disc,0.9047619047619048 +ArticularyWordRecognition,0.9833333333333333 +AsphaltObstaclesCoordinates,0.8260869565217391 +AsphaltPavementTypeCoordinates,0.915719696969697 +AsphaltRegularityCoordinates,0.9773635153129161 +AtrialFibrillation,0.4666666666666667 +AustraliaRainfall_disc,0.7699091117073272 +AutomotiveRoadTrials,0.8051948051948052 +BIDMC32HR_disc,0.8941225510629429 +BIDMC32RR_disc,0.7940808670279283 +BIDMC32SpO2_disc,0.5785744060025011 +BasicMotions,1.0 +BeijingPM10Quality_disc,0.8232963549920761 +BeijingPM25Quality_disc,0.8688589540412044 +BenzeneConcentration_disc,0.8185163664536123 +Blink,1.0 +BoneIntensitiesAgeGroup,0.8089887640449438 +BoneProbAgeGroup,0.6629213483146067 +ButtonPress,1.0 +CharacterTrajectories,0.9853760445682451 +CounterMovementJump,0.7653631284916201 +Cricket,0.9861111111111112 +CrowdSourced,0.7620896576067773 +DuckDuckGeese,0.44 +ERing,0.9740740740740741 +EigenWorms,0.8854961832061069 +EmoPain,0.8253521126760563 +Epilepsy,0.9855072463768116 +EthanolConcentration,0.7186311787072244 +EyesOpenShut,0.5 +FaceDetection,0.6498297389330306 +FeedbackButton,0.5295652173913044 +FeetHands,0.6793650793650794 +FingerMovements,0.54 +FordChallenge,0.913564929693962 +HandMovementDirection,0.4594594594594595 +Handwriting,0.3847058823529412 +Heartbeat,0.775609756097561 +HouseholdPowerConsumption1_disc,0.9591836734693877 +HouseholdPowerConsumption2_disc,0.7725947521865889 +IEEEPPG_disc,0.4375 +IRDS-EFL,0.6538461538461539 +IRDS-EFR,0.6666666666666666 +IRDS-SAL,0.35714285714285715 +IRDS-SAR,0.36363636363636365 +IRDS-SFE,0.6666666666666666 +IRDS-SFL,0.8103448275862069 +IRDS-SFR,0.6 +IRDS-STL,0.7631578947368421 +IRDS-STR,0.9666666666666667 +ImaginedFeetHands,0.7023255813953488 +ImaginedOpenCloseFist,0.7571428571428571 +InnerSpeech,0.285 +JapaneseVowels,0.9702702702702702 +KERAAL-CTK,0.9285714285714286 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.8 +KERAAL-ELK-MC,0.8571428571428571 +KERAAL-RTK,0.7857142857142857 +KERAAL-RTK-MC,0.46153846153846156 +KIMORE-LA-C,0.42857142857142855 +KIMORE-LT-C,0.14285714285714285 +KIMORE-PR-C,0.2857142857142857 +KIMORE-Sq-C,0.2857142857142857 +KIMORE-TR-C,0.14285714285714285 +KINECAL-3WFV,0.9166666666666666 +KINECAL-GGFV,0.9230769230769231 +KINECAL-QSEC,0.9444444444444444 +KINECAL-QSEO,0.9411764705882353 +LSST,0.6338199513381995 +Libras,0.9111111111111111 +LiveFuelMoistureContent_disc,0.8370860927152318 +Locust2022,0.9087602303728403 +LongIntervalTask,0.6616071428571428 +LowCost,0.725 +MatchingPennies,0.6057142857142858 +MindReading,0.5834609494640123 +MotionSenseHAR,0.9886792452830189 +MotorImagery,0.5 +NATOPS,0.8722222222222222 +NewsHeadlineSentiment_disc,0.5395775720412007 +NewsTitleSentiment_disc,0.6148450963889223 +OpenCloseFist,0.764021164021164 +Opportunity,0.8467896962706651 +PAMAP2,0.8676099039919151 +PEMS-SF,1.0 +PPGDalia_disc,0.7737175309561494 +PenDigits,0.9662664379645511 +PhonemeSpectra,0.2651356993736952 +PhotoStimulation,0.3611111111111111 +PronouncedSpeech,0.335 +RacketSports,0.8881578947368421 +SPHERE-WUS,0.5 +STEW,0.7964365881032548 +SelfRegulationSCP1,0.8668941979522184 +SelfRegulationSCP2,0.5166666666666667 +ShortIntervalTask,0.6553571428571429 +SitStand,0.3978125 +Skoda,0.9515387336399009 +SongFamiliarity,0.5146666666666667 +SpokenArabicDigits,0.9777171441564347 +StandWalkJump,0.4666666666666667 +TactileTextureRecognition,0.9985315712187959 +Tiselac,0.8359453993933266 +UCDHE-MP,0.8342541436464088 +UCDHE-MP-MC,0.7292817679558011 +UCDHE-Rowing,0.8340909090909091 +UCDHE-Rowing-MC,0.8022727272727272 +UCIActivity,0.9546022490628905 +UIPRMD-DS-C,0.9166666666666666 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.8888888888888888 +UIPRMD-SASLR-C,0.95 +UIPRMD-SL-C,0.8333333333333334 +UIPRMD-SSA-C,0.9444444444444444 +UIPRMD-SSE-C,0.8888888888888888 +UIPRMD-SSIER-C,0.8 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9444444444444444 +USCActivity,0.6873481166464156 +UWaveGestureLibrary,0.921875 +VisualSpeech,0.265 +WISDM,0.8296310604597257 +WISDM2,0.686592069100903 diff --git a/results/multiverse/CIF-500/CIF-500_auroc.csv b/results/multiverse/CIF-500/CIF-500_auroc.csv new file mode 100644 index 0000000..d11be5d --- /dev/null +++ b/results/multiverse/CIF-500/CIF-500_auroc.csv @@ -0,0 +1,126 @@ +Resamples:,0 +Alzheimers,0.5925796912590218 +AppliancesEnergy_disc,0.9154411764705882 +ArticularyWordRecognition,0.9990046296296295 +AsphaltObstaclesCoordinates,0.9586309582427333 +AsphaltPavementTypeCoordinates,0.9827122991580063 +AsphaltRegularityCoordinates,0.9979641058381216 +AtrialFibrillation,0.4233333333333333 +AustraliaRainfall_disc,0.8528264750903982 +AutomotiveRoadTrials,0.8457350272232305 +BIDMC32HR_disc,0.9770242273908071 +BIDMC32RR_disc,0.56360686267563 +BIDMC32SpO2_disc,0.40730127607872846 +BasicMotions,1.0 +BeijingPM10Quality_disc,0.8921260474340016 +BeijingPM25Quality_disc,0.9351507431661534 +BenzeneConcentration_disc,0.9162273814569755 +Blink,1.0 +BoneIntensitiesAgeGroup,0.9279463683549678 +BoneProbAgeGroup,0.8143813873065419 +ButtonPress,0.9999999999999999 +CharacterTrajectories,0.9998853259613878 +CounterMovementJump,0.9262229472794705 +Cricket,0.9991582491582491 +CrowdSourced,0.7571992033778693 +DuckDuckGeese,0.79025 +ERing,0.9994074074074075 +EigenWorms,0.9853178192018991 +EmoPain,0.9201483052831415 +Epilepsy,0.9998565073898694 +EthanolConcentration,0.90466295621089 +EyesOpenShut,0.481859410430839 +FaceDetection,0.7078909852466176 +FeedbackButton,0.5417406427221172 +FeetHands,0.764732726289278 +FingerMovements,0.5520208083233293 +FordChallenge,0.9684988774182488 +HandMovementDirection,0.7632136759255402 +Handwriting,0.8289144920345443 +Heartbeat,0.7550972024656235 +HouseholdPowerConsumption1_disc,0.9904710309667152 +HouseholdPowerConsumption2_disc,0.8058395526570311 +IEEEPPG_disc,0.7536917839170257 +IRDS-EFL,1.0 +IRDS-EFR,0.8 +IRDS-SAL,0.4897959183673469 +IRDS-SAR,0.9310344827586207 +IRDS-SFE,1.0 +IRDS-SFL,0.9171195652173914 +IRDS-SFR,0.6153846153846154 +IRDS-STL,0.3939393939393939 +IRDS-STR,0.9854545454545455 +ImaginedFeetHands,0.7763873101609305 +ImaginedOpenCloseFist,0.8568963432113806 +InnerSpeech,0.5143371107765342 +JapaneseVowels,0.9995745599607667 +KERAAL-CTK,0.979591836734694 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.25 +KERAAL-ELK-MC,0.7692307692307693 +KERAAL-RTK,0.9791666666666667 +KERAAL-RTK-MC,0.5160256410256411 +KIMORE-LA-C,0.9166666666666666 +KIMORE-LT-C,0.25 +KIMORE-PR-C,1.0 +KIMORE-Sq-C,0.4 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.2727272727272727 +KINECAL-GGFV,1.0 +KINECAL-QSEC,0.5 +KINECAL-QSEO,0.875 +LSST,0.9015980169692505 +Libras,0.9957010582010584 +LiveFuelMoistureContent_disc,0.49855314960629926 +Locust2022,0.8363239391524118 +LongIntervalTask,0.6807803362573099 +LowCost,0.8065555555555555 +MatchingPennies,0.6357146355799375 +MindReading,0.9010581270923606 +MotionSenseHAR,1.0 +MotorImagery,0.5156 +NATOPS,0.981574074074074 +NewsHeadlineSentiment_disc,0.504052988728383 +NewsTitleSentiment_disc,0.5046610187723295 +OpenCloseFist,0.8598957026910811 +Opportunity,0.9599985406263406 +PAMAP2,0.9903070066307549 +PEMS-SF,0.9999208171668382 +PPGDalia_disc,0.8770846307266027 +PenDigits,0.9990264518085763 +PhonemeSpectra,0.8835678900162556 +PhotoStimulation,0.4625824175824176 +PronouncedSpeech,0.5881176663894786 +RacketSports,0.9655626487376698 +SPHERE-WUS,1.0 +STEW,0.8820578902883429 +SelfRegulationSCP1,0.9661494734880253 +SelfRegulationSCP2,0.5158024691358024 +ShortIntervalTask,0.786345486111111 +SitStand,0.7091438151041668 +Skoda,0.9940967342745941 +SongFamiliarity,0.513287853648463 +SpokenArabicDigits,0.9986271343871819 +StandWalkJump,0.6433333333333334 +TactileTextureRecognition,0.9999954747957436 +Tiselac,0.9738810765813702 +UCDHE-MP,0.9008206106870228 +UCDHE-MP-MC,0.9082880889904933 +UCDHE-Rowing,0.9221428571428572 +UCDHE-Rowing-MC,0.9633067014684661 +UCIActivity,0.9986379609198204 +UIPRMD-DS-C,0.9814814814814815 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.9135802469135802 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9753086419753086 +USCActivity,0.964195296446873 +UWaveGestureLibrary,0.9954799107142858 +VisualSpeech,0.49114545070345145 +WISDM,0.969546378421698 +WISDM2,0.9452869580344501 diff --git a/results/multiverse/CIF-500/CIF-500_balacc.csv b/results/multiverse/CIF-500/CIF-500_balacc.csv new file mode 100644 index 0000000..1de7f8d --- /dev/null +++ b/results/multiverse/CIF-500/CIF-500_balacc.csv @@ -0,0 +1,126 @@ +Resamples:,0 +Alzheimers,0.3648388648388649 +AppliancesEnergy_disc,0.8455882352941176 +ArticularyWordRecognition,0.9833333333333333 +AsphaltObstaclesCoordinates,0.827478404237236 +AsphaltPavementTypeCoordinates,0.9058925653594772 +AsphaltRegularityCoordinates,0.9776902887139107 +AtrialFibrillation,0.4666666666666666 +AustraliaRainfall_disc,0.3613983104309072 +AutomotiveRoadTrials,0.7468239564428312 +BIDMC32HR_disc,0.8036247800780116 +BIDMC32RR_disc,0.3333333333333333 +BIDMC32SpO2_disc,0.4128019979044869 +BasicMotions,1.0 +BeijingPM10Quality_disc,0.7435908311075958 +BeijingPM25Quality_disc,0.8207879622786707 +BenzeneConcentration_disc,0.7269551434758784 +Blink,1.0 +BoneIntensitiesAgeGroup,0.8306194157101539 +BoneProbAgeGroup,0.6797627225656998 +ButtonPress,1.0 +CharacterTrajectories,0.9847058040467089 +CounterMovementJump,0.7654425612052731 +Cricket,0.9861111111111112 +CrowdSourced,0.7621546674959829 +DuckDuckGeese,0.44000000000000006 +ERing,0.9740740740740742 +EigenWorms,0.8795074490726664 +EmoPain,0.5566901317655553 +Epilepsy,0.9852941176470589 +EthanolConcentration,0.7192307692307692 +EyesOpenShut,0.5 +FaceDetection,0.6498297389330306 +FeedbackButton,0.5295652173913044 +FeetHands,0.679978184937528 +FingerMovements,0.5406162464985994 +FordChallenge,0.8916580533677332 +HandMovementDirection,0.43690476190476185 +Handwriting,0.37968264937125584 +Heartbeat,0.6666073968705548 +HouseholdPowerConsumption1_disc,0.8955460336705885 +HouseholdPowerConsumption2_disc,0.5886213735528804 +IEEEPPG_disc,0.48642579605509234 +IRDS-EFL,0.625 +IRDS-EFR,0.5 +IRDS-SAL,0.47619047619047616 +IRDS-SAR,0.6379310344827587 +IRDS-SFE,0.5 +IRDS-SFL,0.818840579710145 +IRDS-SFR,0.5576923076923077 +IRDS-STL,0.5909090909090909 +IRDS-STR,0.8 +ImaginedFeetHands,0.702320694488364 +ImaginedOpenCloseFist,0.7571800981832515 +InnerSpeech,0.289830989679014 +JapaneseVowels,0.9686751994760893 +KERAAL-CTK,0.9285714285714286 +KERAAL-CTK-MC,0.6666666666666666 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.46153846153846156 +KERAAL-RTK,0.75 +KERAAL-RTK-MC,0.3238095238095238 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.16666666666666666 +KIMORE-PR-C,0.5833333333333334 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.5 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 +KINECAL-QSEO,0.5 +LSST,0.4245404062478132 +Libras,0.9111111111111112 +LiveFuelMoistureContent_disc,0.49763779527559054 +Locust2022,0.6203412288051883 +LongIntervalTask,0.5196637426900584 +LowCost,0.725 +MatchingPennies,0.6056687565308255 +MindReading,0.5657747305544735 +MotionSenseHAR,0.9929577464788734 +MotorImagery,0.5 +NATOPS,0.8722222222222222 +NewsHeadlineSentiment_disc,0.33486517578593933 +NewsTitleSentiment_disc,0.33348246672532494 +OpenCloseFist,0.7640041029132476 +Opportunity,0.848601330480274 +PAMAP2,0.8645402956752739 +PEMS-SF,1.0 +PPGDalia_disc,0.6584173847805155 +PenDigits,0.9664919572738434 +PhonemeSpectra,0.26520397067592694 +PhotoStimulation,0.30808080808080807 +PronouncedSpeech,0.3388009049773756 +RacketSports,0.8954941860465117 +SPHERE-WUS,0.5 +STEW,0.7964365881032548 +SelfRegulationSCP1,0.8671372658652502 +SelfRegulationSCP2,0.5166666666666667 +ShortIntervalTask,0.5447222222222222 +SitStand,0.3978125 +Skoda,0.949337158004412 +SongFamiliarity,0.5072100492063605 +SpokenArabicDigits,0.9777189705271898 +StandWalkJump,0.4666666666666666 +TactileTextureRecognition,0.9985119047619048 +Tiselac,0.624826643033592 +UCDHE-MP,0.7432824427480916 +UCDHE-MP-MC,0.7257397342995169 +UCDHE-Rowing,0.6026984126984127 +UCDHE-Rowing-MC,0.809142857142857 +UCIActivity,0.9545420569818202 +UIPRMD-DS-C,0.9166666666666666 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.8888888888888888 +UIPRMD-SASLR-C,0.95 +UIPRMD-SL-C,0.8333333333333333 +UIPRMD-SSA-C,0.9444444444444444 +UIPRMD-SSE-C,0.8888888888888888 +UIPRMD-SSIER-C,0.8 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9444444444444444 +USCActivity,0.6987445646018654 +UWaveGestureLibrary,0.921875 +VisualSpeech,0.2661997491304214 +WISDM,0.5863638103242669 +WISDM2,0.5862771666213576 diff --git a/results/multiverse/CIF-500/CIF-500_f1.csv b/results/multiverse/CIF-500/CIF-500_f1.csv new file mode 100644 index 0000000..1d70732 --- /dev/null +++ b/results/multiverse/CIF-500/CIF-500_f1.csv @@ -0,0 +1,126 @@ +Resamples:,0 +Alzheimers,0.3922480620155039 +AppliancesEnergy_disc,0.75 +ArticularyWordRecognition,0.9834274247491639 +AsphaltObstaclesCoordinates,0.8237078350193267 +AsphaltPavementTypeCoordinates,0.9155876141720389 +AsphaltRegularityCoordinates,0.9775429326287979 +AtrialFibrillation,0.47835497835497837 +AustraliaRainfall_disc,0.7450455262875428 +AutomotiveRoadTrials,0.6153846153846154 +BIDMC32HR_disc,0.8897669253246299 +BIDMC32RR_disc,0.702938685728719 +BIDMC32SpO2_disc,0.03622497616777884 +BasicMotions,1.0 +BeijingPM10Quality_disc,0.6446215139442231 +BeijingPM25Quality_disc,0.7632331902718169 +BenzeneConcentration_disc,0.6241476133172884 +Blink,1.0 +BoneIntensitiesAgeGroup,0.8078215067730582 +BoneProbAgeGroup,0.6650062751070943 +ButtonPress,1.0 +CharacterTrajectories,0.9853689203586439 +CounterMovementJump,0.7713141793030062 +Cricket,0.9860139860139859 +CrowdSourced,0.7990459153249851 +DuckDuckGeese,0.4118601398601399 +ERing,0.974158889410016 +EigenWorms,0.8849745482893345 +EmoPain,0.8160758684534819 +Epilepsy,0.9854783533273235 +EthanolConcentration,0.7138537080475489 +EyesOpenShut,0.6037735849056604 +FaceDetection,0.6431463273568536 +FeedbackButton,0.5480367585630743 +FeetHands,0.6994047619047619 +FingerMovements,0.5490196078431373 +FordChallenge,0.8749750747756729 +HandMovementDirection,0.4627088478439829 +Handwriting,0.3556296330715075 +Heartbeat,0.5106382978723404 +HouseholdPowerConsumption1_disc,0.9582398790370376 +HouseholdPowerConsumption2_disc,0.7315998653043502 +IEEEPPG_disc,0.4159390180245437 +IRDS-EFL,0.4 +IRDS-EFR,0.0 +IRDS-SAL,0.35714285714285715 +IRDS-SAR,0.27586206896551724 +IRDS-SFE,0.0 +IRDS-SFL,0.6451612903225806 +IRDS-SFR,0.25 +IRDS-STL,0.3076923076923077 +IRDS-STR,0.75 +ImaginedFeetHands,0.6993736951983298 +ImaginedOpenCloseFist,0.7652173913043478 +InnerSpeech,0.24973994564160332 +JapaneseVowels,0.9705143575486676 +KERAAL-CTK,0.9333333333333333 +KERAAL-CTK-MC,0.8952380952380953 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.8571428571428571 +KERAAL-RTK,0.6666666666666666 +KERAAL-RTK-MC,0.44755244755244755 +KIMORE-LA-C,0.6 +KIMORE-LT-C,0.25 +KIMORE-PR-C,0.2857142857142857 +KIMORE-Sq-C,0.4444444444444444 +KIMORE-TR-C,0.25 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 +KINECAL-QSEO,0.0 +LSST,0.5639369347773078 +Libras,0.9112492445825778 +LiveFuelMoistureContent_disc,0.0 +Locust2022,0.3442265795206972 +LongIntervalTask,0.18843683083511778 +LowCost,0.703770197486535 +MatchingPennies,0.6011560693641619 +MindReading,0.55218248297444 +MotionSenseHAR,0.9886478870581268 +MotorImagery,0.6621621621621622 +NATOPS,0.8714914209173368 +NewsHeadlineSentiment_disc,0.408038359865594 +NewsTitleSentiment_disc,0.4845372955055096 +OpenCloseFist,0.759956942949408 +Opportunity,0.8460258584684991 +PAMAP2,0.8693328542883253 +PEMS-SF,1.0 +PPGDalia_disc,0.7615302695864999 +PenDigits,0.9663317525995677 +PhonemeSpectra,0.25425432615921 +PhotoStimulation,0.3060303893637227 +PronouncedSpeech,0.3267423014010383 +RacketSports,0.8863670945339628 +SPHERE-WUS,0.0 +STEW,0.7862089288345366 +SelfRegulationSCP1,0.8753993610223643 +SelfRegulationSCP2,0.5714285714285714 +ShortIntervalTask,0.24609375 +SitStand,0.39208399611909317 +Skoda,0.9516478894576278 +SongFamiliarity,0.378839590443686 +SpokenArabicDigits,0.9777314884217968 +StandWalkJump,0.44696969696969696 +TactileTextureRecognition,0.9985312126281289 +Tiselac,0.8233146965712069 +UCDHE-MP,0.6428571428571429 +UCDHE-MP-MC,0.723848089632717 +UCDHE-Rowing,0.34234234234234234 +UCDHE-Rowing-MC,0.8057452555263882 +UCIActivity,0.9551129461254164 +UIPRMD-DS-C,0.918918918918919 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.875 +UIPRMD-SASLR-C,0.9473684210526315 +UIPRMD-SL-C,0.8571428571428571 +UIPRMD-SSA-C,0.9411764705882353 +UIPRMD-SSE-C,0.875 +UIPRMD-SSIER-C,0.75 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9473684210526315 +USCActivity,0.6785275653092248 +UWaveGestureLibrary,0.9214279092459853 +VisualSpeech,0.26264284207010397 +WISDM,0.8034906384002704 +WISDM2,0.656085347116618 diff --git a/results/multiverse/CIF-500/CIF-500_logloss.csv b/results/multiverse/CIF-500/CIF-500_logloss.csv new file mode 100644 index 0000000..29d49d9 --- /dev/null +++ b/results/multiverse/CIF-500/CIF-500_logloss.csv @@ -0,0 +1,126 @@ +Resamples:,0 +Alzheimers,1.0540806681795496 +AppliancesEnergy_disc,0.3261007753850249 +ArticularyWordRecognition,0.4232904058036344 +AsphaltObstaclesCoordinates,0.5485654880923102 +AsphaltPavementTypeCoordinates,0.288685387019485 +AsphaltRegularityCoordinates,0.08864749171097128 +AtrialFibrillation,1.1582808517320184 +AustraliaRainfall_disc,0.5310681035762301 +AutomotiveRoadTrials,0.43392015151243146 +BIDMC32HR_disc,0.3703412826937068 +BIDMC32RR_disc,1.6468685006642678 +BIDMC32SpO2_disc,0.8501635839429054 +BasicMotions,0.09519647191732124 +BeijingPM10Quality_disc,0.38572594171779484 +BeijingPM25Quality_disc,0.32721510257546854 +BenzeneConcentration_disc,0.41367931194318913 +Blink,0.08565329525163734 +BoneIntensitiesAgeGroup,0.5631644563964084 +BoneProbAgeGroup,0.7987419001420911 +ButtonPress,0.05336440333159503 +CharacterTrajectories,0.1578987811340886 +CounterMovementJump,0.5799905266462284 +Cricket,0.25503181784874346 +CrowdSourced,0.614641926048895 +DuckDuckGeese,1.22988032664577 +ERing,0.4726244785912149 +EigenWorms,0.3643461582029887 +EmoPain,0.4110091916584252 +Epilepsy,0.12109733398310427 +EthanolConcentration,0.8324385185060089 +EyesOpenShut,0.7455956832896616 +FaceDetection,0.6604431588741906 +FeedbackButton,0.6912847116156514 +FeetHands,0.6011976344127455 +FingerMovements,0.6929493377411595 +FordChallenge,0.30729106477248985 +HandMovementDirection,1.2333996368730022 +Handwriting,2.7686648054509804 +Heartbeat,0.5025033242867045 +HouseholdPowerConsumption1_disc,0.1836830028818533 +HouseholdPowerConsumption2_disc,0.5193890368002572 +IEEEPPG_disc,1.1063590071591305 +IRDS-EFL,0.48356806449215617 +IRDS-EFR,0.6871844455809833 +IRDS-SAL,1.1465500963510071 +IRDS-SAR,1.0645935444841206 +IRDS-SFE,0.45969561747222437 +IRDS-SFL,0.4911594913216511 +IRDS-SFR,0.6517443027431377 +IRDS-STL,0.7540999574768927 +IRDS-STR,0.304922569630345 +ImaginedFeetHands,0.5871889139494856 +ImaginedOpenCloseFist,0.518198536461617 +InnerSpeech,1.3891161481663332 +JapaneseVowels,0.49556221813791224 +KERAAL-CTK,0.36003335818770615 +KERAAL-CTK-MC,0.6110735497375588 +KERAAL-ELK,0.6166725535404636 +KERAAL-ELK-MC,0.38374549966074206 +KERAAL-RTK,0.4525368463429995 +KERAAL-RTK-MC,0.948425684809898 +KIMORE-LA-C,1.1023606295445234 +KIMORE-LT-C,0.9328690831746537 +KIMORE-PR-C,0.9140594310971414 +KIMORE-Sq-C,1.0491358927618457 +KIMORE-TR-C,1.5933107601913983 +KINECAL-3WFV,0.33557766598003175 +KINECAL-GGFV,0.2454771765889787 +KINECAL-QSEC,0.22324140368304712 +KINECAL-QSEO,0.17862593423516723 +LSST,1.2322630336149023 +Libras,0.480379479329134 +LiveFuelMoistureContent_disc,0.47419031429471986 +Locust2022,0.2515245010662527 +LongIntervalTask,0.588470860357348 +LowCost,0.592377882854545 +MatchingPennies,0.6625930461912234 +MindReading,0.9733490750701419 +MotionSenseHAR,0.056728055833273464 +MotorImagery,0.7068156993340847 +NATOPS,0.37008503371763846 +NewsHeadlineSentiment_disc,1.0160024289373681 +NewsTitleSentiment_disc,0.9499484313277926 +OpenCloseFist,0.5370045343805687 +Opportunity,0.44307799012442217 +PAMAP2,0.6951808538265336 +PEMS-SF,0.12264359287156665 +PPGDalia_disc,0.563265597169308 +PenDigits,0.23415172643205612 +PhonemeSpectra,2.6893415623270744 +PhotoStimulation,1.201425495030796 +PronouncedSpeech,1.3587714120362304 +RacketSports,0.5921255025807218 +SPHERE-WUS,0.5058377965027515 +STEW,0.48743890129075607 +SelfRegulationSCP1,0.35376014615539775 +SelfRegulationSCP2,0.7028986204435219 +ShortIntervalTask,0.5585520942163568 +SitStand,1.2426748532048189 +Skoda,0.39511780998457263 +SongFamiliarity,0.7084426472017312 +SpokenArabicDigits,0.33562749513227336 +StandWalkJump,1.0518285526107325 +TactileTextureRecognition,0.12840357529677432 +Tiselac,0.5814054991137642 +UCDHE-MP,0.40005153764701507 +UCDHE-MP-MC,0.8004218069738988 +UCDHE-Rowing,0.3591264912483719 +UCDHE-Rowing-MC,0.7183885044918754 +UCIActivity,0.25198454832067685 +UIPRMD-DS-C,0.36408965414083405 +UIPRMD-HS-C,0.09936516368009231 +UIPRMD-IL-C,0.5514881688417607 +UIPRMD-SASLR-C,0.3540749474454825 +UIPRMD-SL-C,0.37784261342946096 +UIPRMD-SSA-C,0.16826760235332108 +UIPRMD-SSE-C,0.30966648996011986 +UIPRMD-SSIER-C,0.39242775428422044 +UIPRMD-SSS-C,0.2062440705035906 +UIPRMD-STS-C,0.22450518731546742 +USCActivity,0.8937427568004791 +UWaveGestureLibrary,0.5521402891087197 +VisualSpeech,1.4029951370312779 +WISDM,0.5814129290885145 +WISDM2,0.7933878558871237 diff --git a/results/multiverse/CIF-500/CIF-500_sensitivity.csv b/results/multiverse/CIF-500/CIF-500_sensitivity.csv new file mode 100644 index 0000000..a7d5783 --- /dev/null +++ b/results/multiverse/CIF-500/CIF-500_sensitivity.csv @@ -0,0 +1,126 @@ +Resamples:,0 +Alzheimers,0.3953488372093023 +AppliancesEnergy_disc,0.75 +ArticularyWordRecognition,0.9833333333333333 +AsphaltObstaclesCoordinates,0.8260869565217391 +AsphaltPavementTypeCoordinates,0.915719696969697 +AsphaltRegularityCoordinates,1.0 +AtrialFibrillation,0.4666666666666667 +AustraliaRainfall_disc,0.7699091117073272 +AutomotiveRoadTrials,0.631578947368421 +BIDMC32HR_disc,0.8941225510629429 +BIDMC32RR_disc,0.7940808670279283 +BIDMC32SpO2_disc,0.027818448023426062 +BasicMotions,1.0 +BeijingPM10Quality_disc,0.5548696844993142 +BeijingPM25Quality_disc,0.6992136304062909 +BenzeneConcentration_disc,0.48564294631710364 +Blink,1.0 +BoneIntensitiesAgeGroup,0.8089887640449438 +BoneProbAgeGroup,0.6629213483146067 +ButtonPress,1.0 +CharacterTrajectories,0.9853760445682451 +CounterMovementJump,0.7653631284916201 +Cricket,0.9861111111111112 +CrowdSourced,0.9463276836158192 +DuckDuckGeese,0.44 +ERing,0.9740740740740741 +EigenWorms,0.8854961832061069 +EmoPain,0.8253521126760563 +Epilepsy,0.9855072463768116 +EthanolConcentration,0.7186311787072244 +EyesOpenShut,0.7619047619047619 +FaceDetection,0.6311010215664018 +FeedbackButton,0.5704347826086956 +FeetHands,0.7524012806830309 +FingerMovements,0.5714285714285714 +FordChallenge,0.8027808269301134 +HandMovementDirection,0.4594594594594595 +Handwriting,0.3847058823529412 +Heartbeat,0.42105263157894735 +HouseholdPowerConsumption1_disc,0.9591836734693877 +HouseholdPowerConsumption2_disc,0.7725947521865889 +IEEEPPG_disc,0.4375 +IRDS-EFL,0.25 +IRDS-EFR,0.0 +IRDS-SAL,0.7142857142857143 +IRDS-SAR,1.0 +IRDS-SFE,0.0 +IRDS-SFL,0.8333333333333334 +IRDS-SFR,0.5 +IRDS-STL,0.18181818181818182 +IRDS-STR,0.6 +ImaginedFeetHands,0.6928645294725957 +ImaginedOpenCloseFist,0.7923728813559322 +InnerSpeech,0.285 +JapaneseVowels,0.9702702702702702 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.8571428571428571 +KERAAL-RTK,0.5 +KERAAL-RTK-MC,0.46153846153846156 +KIMORE-LA-C,1.0 +KIMORE-LT-C,0.3333333333333333 +KIMORE-PR-C,1.0 +KIMORE-Sq-C,1.0 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 +KINECAL-QSEO,0.0 +LSST,0.6338199513381995 +Libras,0.9111111111111111 +LiveFuelMoistureContent_disc,0.0 +Locust2022,0.2696245733788396 +LongIntervalTask,0.12222222222222222 +LowCost,0.6533333333333333 +MatchingPennies,0.5977011494252874 +MindReading,0.5834609494640123 +MotionSenseHAR,0.9886792452830189 +MotorImagery,0.98 +NATOPS,0.8722222222222222 +NewsHeadlineSentiment_disc,0.5395775720412007 +NewsTitleSentiment_disc,0.6148450963889223 +OpenCloseFist,0.7478813559322034 +Opportunity,0.8467896962706651 +PAMAP2,0.8676099039919151 +PEMS-SF,1.0 +PPGDalia_disc,0.7737175309561494 +PenDigits,0.9662664379645511 +PhonemeSpectra,0.2651356993736952 +PhotoStimulation,0.3611111111111111 +PronouncedSpeech,0.335 +RacketSports,0.8881578947368421 +SPHERE-WUS,0.0 +STEW,0.7485970819304153 +SelfRegulationSCP1,0.9383561643835616 +SelfRegulationSCP2,0.6444444444444445 +ShortIntervalTask,0.1575 +SitStand,0.3978125 +Skoda,0.9515387336399009 +SongFamiliarity,0.3074792243767313 +SpokenArabicDigits,0.9777171441564347 +StandWalkJump,0.4666666666666667 +TactileTextureRecognition,0.9985315712187959 +Tiselac,0.8359453993933266 +UCDHE-MP,0.54 +UCDHE-MP-MC,0.7292817679558011 +UCDHE-Rowing,0.2111111111111111 +UCDHE-Rowing-MC,0.8022727272727272 +UCIActivity,0.9546022490628905 +UIPRMD-DS-C,0.9444444444444444 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.7777777777777778 +UIPRMD-SASLR-C,0.9 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,0.8888888888888888 +UIPRMD-SSE-C,0.7777777777777778 +UIPRMD-SSIER-C,0.6 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,1.0 +USCActivity,0.6873481166464156 +UWaveGestureLibrary,0.921875 +VisualSpeech,0.265 +WISDM,0.8296310604597257 +WISDM2,0.686592069100903 diff --git a/results/multiverse/CIF-500/CIF-500_specificity.csv b/results/multiverse/CIF-500/CIF-500_specificity.csv new file mode 100644 index 0000000..45a5c55 --- /dev/null +++ b/results/multiverse/CIF-500/CIF-500_specificity.csv @@ -0,0 +1,126 @@ +Resamples:,0 +Alzheimers,0.3953488372093023 +AppliancesEnergy_disc,0.9411764705882353 +ArticularyWordRecognition,0.9833333333333333 +AsphaltObstaclesCoordinates,0.8260869565217391 +AsphaltPavementTypeCoordinates,0.915719696969697 +AsphaltRegularityCoordinates,0.9553805774278216 +AtrialFibrillation,0.4666666666666667 +AustraliaRainfall_disc,0.7699091117073272 +AutomotiveRoadTrials,0.8620689655172413 +BIDMC32HR_disc,0.8941225510629429 +BIDMC32RR_disc,0.7940808670279283 +BIDMC32SpO2_disc,0.7977855477855478 +BasicMotions,1.0 +BeijingPM10Quality_disc,0.9323119777158775 +BeijingPM25Quality_disc,0.9423622941510506 +BenzeneConcentration_disc,0.9682673406346531 +Blink,1.0 +BoneIntensitiesAgeGroup,0.8089887640449438 +BoneProbAgeGroup,0.6629213483146067 +ButtonPress,1.0 +CharacterTrajectories,0.9853760445682451 +CounterMovementJump,0.7653631284916201 +Cricket,0.9861111111111112 +CrowdSourced,0.5779816513761468 +DuckDuckGeese,0.44 +ERing,0.9740740740740741 +EigenWorms,0.8854961832061069 +EmoPain,0.8253521126760563 +Epilepsy,0.9855072463768116 +EthanolConcentration,0.7186311787072244 +EyesOpenShut,0.23809523809523808 +FaceDetection,0.6685584562996595 +FeedbackButton,0.48869565217391303 +FeetHands,0.6075550891920252 +FingerMovements,0.5098039215686274 +FordChallenge,0.9805352798053528 +HandMovementDirection,0.4594594594594595 +Handwriting,0.3847058823529412 +Heartbeat,0.9121621621621622 +HouseholdPowerConsumption1_disc,0.9591836734693877 +HouseholdPowerConsumption2_disc,0.7725947521865889 +IEEEPPG_disc,0.4375 +IRDS-EFL,1.0 +IRDS-EFR,1.0 +IRDS-SAL,0.23809523809523808 +IRDS-SAR,0.27586206896551724 +IRDS-SFE,1.0 +IRDS-SFL,0.8043478260869565 +IRDS-SFR,0.6153846153846154 +IRDS-STL,1.0 +IRDS-STR,1.0 +ImaginedFeetHands,0.7117768595041323 +ImaginedOpenCloseFist,0.7219873150105708 +InnerSpeech,0.285 +JapaneseVowels,0.9702702702702702 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,1.0 +KERAAL-ELK-MC,0.8571428571428571 +KERAAL-RTK,1.0 +KERAAL-RTK-MC,0.46153846153846156 +KIMORE-LA-C,0.0 +KIMORE-LT-C,0.0 +KIMORE-PR-C,0.16666666666666666 +KIMORE-Sq-C,0.0 +KIMORE-TR-C,0.0 +KINECAL-3WFV,1.0 +KINECAL-GGFV,1.0 +KINECAL-QSEC,1.0 +KINECAL-QSEO,1.0 +LSST,0.6338199513381995 +Libras,0.9111111111111111 +LiveFuelMoistureContent_disc,0.9952755905511811 +Locust2022,0.9710578842315369 +LongIntervalTask,0.9171052631578948 +LowCost,0.7966666666666666 +MatchingPennies,0.6136363636363636 +MindReading,0.5834609494640123 +MotionSenseHAR,0.9886792452830189 +MotorImagery,0.02 +NATOPS,0.8722222222222222 +NewsHeadlineSentiment_disc,0.5395775720412007 +NewsTitleSentiment_disc,0.6148450963889223 +OpenCloseFist,0.7801268498942917 +Opportunity,0.8467896962706651 +PAMAP2,0.8676099039919151 +PEMS-SF,1.0 +PPGDalia_disc,0.7737175309561494 +PenDigits,0.9662664379645511 +PhonemeSpectra,0.2651356993736952 +PhotoStimulation,0.3611111111111111 +PronouncedSpeech,0.335 +RacketSports,0.8881578947368421 +SPHERE-WUS,1.0 +STEW,0.8442760942760943 +SelfRegulationSCP1,0.7959183673469388 +SelfRegulationSCP2,0.3888888888888889 +ShortIntervalTask,0.9319444444444445 +SitStand,0.3978125 +Skoda,0.9515387336399009 +SongFamiliarity,0.7069408740359897 +SpokenArabicDigits,0.9777171441564347 +StandWalkJump,0.4666666666666667 +TactileTextureRecognition,0.9985315712187959 +Tiselac,0.8359453993933266 +UCDHE-MP,0.9465648854961832 +UCDHE-MP-MC,0.7292817679558011 +UCDHE-Rowing,0.9942857142857143 +UCDHE-Rowing-MC,0.8022727272727272 +UCIActivity,0.9546022490628905 +UIPRMD-DS-C,0.8888888888888888 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,1.0 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.6666666666666666 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.8888888888888888 +USCActivity,0.6873481166464156 +UWaveGestureLibrary,0.921875 +VisualSpeech,0.265 +WISDM,0.8296310604597257 +WISDM2,0.686592069100903 diff --git a/results/multiverse/Catch22/Catch22_accuracy.csv b/results/multiverse/Catch22/Catch22_accuracy.csv index 7e9a29c..add7740 100644 --- a/results/multiverse/Catch22/Catch22_accuracy.csv +++ b/results/multiverse/Catch22/Catch22_accuracy.csv @@ -3,18 +3,22 @@ Alzheimers,0.4186046511627907 AppliancesEnergy_disc,0.8809523809523809 ArticularyWordRecognition,0.98 AsphaltObstaclesCoordinates,0.8081841432225064 +AsphaltPavementTypeCoordinates,0.9223484848484849 AsphaltRegularityCoordinates,0.9760319573901465 AtrialFibrillation,0.13333333333333333 AustraliaRainfall_disc,0.7631288866704103 AutomotiveRoadTrials,0.8311688311688312 BIDMC32HR_disc,0.7907461442267611 +BIDMC32RR_disc,0.7940808670279283 BIDMC32SpO2_disc,0.6473530637765735 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8322107765451664 BeijingPM25Quality_disc,0.8791600633914421 BenzeneConcentration_disc,0.5000968429207825 Blink,0.9977777777777778 BoneIntensitiesAgeGroup,0.7325842696629213 BoneProbAgeGroup,0.6494382022471911 +ButtonPress,1.0 CharacterTrajectories,0.9798050139275766 CounterMovementJump,0.7430167597765364 Cricket,0.9861111111111112 @@ -27,6 +31,9 @@ Epilepsy,0.9855072463768116 EthanolConcentration,0.3574144486692015 EyesOpenShut,0.5 FaceDetection,0.5559023836549376 +FeedbackButton,0.5243478260869565 +FeetHands,0.5936507936507937 +FingerMovements,0.51 FordChallenge,0.9087400055141991 HandMovementDirection,0.25675675675675674 Handwriting,0.2635294117647059 @@ -34,34 +41,86 @@ Heartbeat,0.7560975609756098 HouseholdPowerConsumption1_disc,0.9752186588921283 HouseholdPowerConsumption2_disc,0.7332361516034985 IEEEPPG_disc,0.49623493975903615 +IRDS-EFL,0.7307692307692307 +IRDS-EFR,0.6666666666666666 +IRDS-SAL,0.4107142857142857 +IRDS-SAR,0.21212121212121213 +IRDS-SFE,0.7333333333333333 IRDS-SFL,0.7844827586206896 +IRDS-SFR,0.4 +IRDS-STL,0.7368421052631579 +IRDS-STR,0.48333333333333334 +ImaginedFeetHands,0.5674418604651162 +ImaginedOpenCloseFist,0.5439153439153439 +InnerSpeech,0.22 JapaneseVowels,0.9513513513513514 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.8 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.7857142857142857 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,0.42857142857142855 +KIMORE-LT-C,0.42857142857142855 KIMORE-PR-C,0.42857142857142855 +KIMORE-Sq-C,0.2857142857142857 +KIMORE-TR-C,0.14285714285714285 +KINECAL-3WFV,0.9166666666666666 +KINECAL-GGFV,0.9230769230769231 +KINECAL-QSEC,0.9444444444444444 KINECAL-QSEO,0.9411764705882353 LSST,0.6678832116788321 Libras,0.8222222222222222 +LiveFuelMoistureContent_disc,0.8086092715231789 Locust2022,0.9127008184298272 +LongIntervalTask,0.6473214285714286 LowCost,0.5533333333333333 +MatchingPennies,0.5328571428571428 MindReading,0.5635528330781011 MotionSenseHAR,0.9886792452830189 MotorImagery,0.53 NATOPS,0.8722222222222222 +NewsHeadlineSentiment_disc,0.525229449721454 +NewsTitleSentiment_disc,0.6078714279988778 +OpenCloseFist,0.5714285714285714 +Opportunity,0.8367935409457901 +PAMAP2,0.8633653360282971 PEMS-SF,0.9826589595375722 +PPGDalia_disc,0.7723675635415697 PenDigits,0.948256146369354 PhonemeSpectra,0.25350432448553534 PhotoStimulation,0.3333333333333333 +PronouncedSpeech,0.325 RacketSports,0.8223684210526315 +SPHERE-WUS,0.75 STEW,0.7906846240179574 SelfRegulationSCP1,0.7713310580204779 +SelfRegulationSCP2,0.55 +ShortIntervalTask,0.6607142857142857 +SitStand,0.383125 Skoda,0.9370357269189954 +SongFamiliarity,0.49866666666666665 SpokenArabicDigits,0.9627103228740337 StandWalkJump,0.4666666666666667 TactileTextureRecognition,0.9970631424375918 Tiselac,0.8271486349848332 +UCDHE-MP,0.7817679558011049 +UCDHE-MP-MC,0.6132596685082873 +UCDHE-Rowing,0.8090909090909091 UCDHE-Rowing-MC,0.7295454545454545 UCIActivity,0.9479383590170762 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.9444444444444444 +UIPRMD-SASLR-C,0.85 +UIPRMD-SL-C,0.8333333333333334 +UIPRMD-SSA-C,0.9444444444444444 +UIPRMD-SSE-C,0.9444444444444444 +UIPRMD-SSIER-C,0.8 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9444444444444444 USCActivity,0.7282806804374241 UWaveGestureLibrary,0.875 +VisualSpeech,0.235 WISDM,0.8416071083639173 +WISDM2,0.6531802120141342 diff --git a/results/multiverse/Catch22/Catch22_auroc.csv b/results/multiverse/Catch22/Catch22_auroc.csv index ba400b7..4fc5947 100644 --- a/results/multiverse/Catch22/Catch22_auroc.csv +++ b/results/multiverse/Catch22/Catch22_auroc.csv @@ -3,18 +3,22 @@ Alzheimers,0.5054976944667201 AppliancesEnergy_disc,0.9283088235294117 ArticularyWordRecognition,0.9991840277777779 AsphaltObstaclesCoordinates,0.9498177098662607 +AsphaltPavementTypeCoordinates,0.9866043007713621 AsphaltRegularityCoordinates,0.997283109881535 AtrialFibrillation,0.31 AustraliaRainfall_disc,0.8400530949896929 AutomotiveRoadTrials,0.8430127041742287 BIDMC32HR_disc,0.8912031732342167 +BIDMC32RR_disc,0.6134943410682664 BIDMC32SpO2_disc,0.3784222731880126 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8930775741180157 BeijingPM25Quality_disc,0.9369511655997911 BenzeneConcentration_disc,0.5293654099183098 Blink,0.99996 BoneIntensitiesAgeGroup,0.8563003037105893 BoneProbAgeGroup,0.7814404800300564 +ButtonPress,1.0 CharacterTrajectories,0.999696018599527 CounterMovementJump,0.9523543495610536 Cricket,0.9989478114478114 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.6245620981777396 EyesOpenShut,0.5634920634920634 FaceDetection,0.5815599147599531 +FeedbackButton,0.5186298676748582 +FeetHands,0.6261471665615854 +FingerMovements,0.5510204081632653 FordChallenge,0.9592986520682883 HandMovementDirection,0.5169659837032718 Handwriting,0.7831982433374373 @@ -34,34 +41,86 @@ Heartbeat,0.7622095779990516 HouseholdPowerConsumption1_disc,0.9932933183455105 HouseholdPowerConsumption2_disc,0.751563054673872 IEEEPPG_disc,0.7231307690916294 +IRDS-EFL,0.9821428571428571 +IRDS-EFR,0.91 +IRDS-SAL,0.48469387755102045 +IRDS-SAR,0.9224137931034483 +IRDS-SFE,1.0 IRDS-SFL,0.9096467391304347 +IRDS-SFR,0.7307692307692307 +IRDS-STL,0.367003367003367 +IRDS-STR,0.769090909090909 +ImaginedFeetHands,0.5954697154871076 +ImaginedOpenCloseFist,0.5612928655892787 +InnerSpeech,0.5144792218689278 JapaneseVowels,0.9986806054470503 +KERAAL-CTK,0.9693877551020408 +KERAAL-CTK-MC,0.9416208791208792 +KERAAL-ELK,0.25 +KERAAL-ELK-MC,0.7692307692307693 KERAAL-RTK,1.0 +KERAAL-RTK-MC,0.6025641025641025 +KIMORE-LA-C,0.75 +KIMORE-LT-C,0.20833333333333331 KIMORE-PR-C,1.0 +KIMORE-Sq-C,0.6 +KIMORE-TR-C,0.8333333333333334 +KINECAL-3WFV,1.0 +KINECAL-GGFV,0.9583333333333334 +KINECAL-QSEC,0.6176470588235294 KINECAL-QSEO,0.9375 LSST,0.9171523419053583 Libras,0.991385582010582 +LiveFuelMoistureContent_disc,0.5065206692913387 Locust2022,0.841062471189589 +LongIntervalTask,0.6128344298245614 LowCost,0.5785611111111111 +MatchingPennies,0.5680920193312434 MindReading,0.8943535508977911 MotionSenseHAR,1.0 MotorImagery,0.6076 NATOPS,0.9760555555555556 +NewsHeadlineSentiment_disc,0.5001614831413059 +NewsTitleSentiment_disc,0.4994582516495174 +OpenCloseFist,0.5953513007489161 +Opportunity,0.9543773389935045 +PAMAP2,0.9888895373195501 PEMS-SF,0.9996040858341911 +PPGDalia_disc,0.8734979099127627 PenDigits,0.9983504499793706 PhonemeSpectra,0.8587138764494517 PhotoStimulation,0.43454314204314204 +PronouncedSpeech,0.5465715186772234 RacketSports,0.9563174445470647 +SPHERE-WUS,1.0 STEW,0.8715628900930996 SelfRegulationSCP1,0.8962818003913895 +SelfRegulationSCP2,0.5711728395061729 +ShortIntervalTask,0.6689861111111112 +SitStand,0.6757453125 Skoda,0.9937263444029237 +SongFamiliarity,0.5185609809939542 SpokenArabicDigits,0.9981749794795645 StandWalkJump,0.6933333333333334 TactileTextureRecognition,0.9999954747957436 Tiselac,0.9708386139436407 +UCDHE-MP,0.7773473282442748 +UCDHE-MP-MC,0.8482104098188913 +UCDHE-Rowing,0.874 UCDHE-Rowing-MC,0.9474360548478195 UCIActivity,0.9987236337524041 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.9876543209876543 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.96 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9845679012345678 USCActivity,0.9691352263026572 UWaveGestureLibrary,0.9802064732142857 +VisualSpeech,0.47810414037209936 WISDM,0.9680415494570436 +WISDM2,0.9402078177073212 diff --git a/results/multiverse/Catch22/Catch22_balacc.csv b/results/multiverse/Catch22/Catch22_balacc.csv index 9418240..499ae0a 100644 --- a/results/multiverse/Catch22/Catch22_balacc.csv +++ b/results/multiverse/Catch22/Catch22_balacc.csv @@ -3,18 +3,22 @@ Alzheimers,0.360990860990861 AppliancesEnergy_disc,0.8308823529411764 ArticularyWordRecognition,0.98 AsphaltObstaclesCoordinates,0.8073588680511101 +AsphaltPavementTypeCoordinates,0.9127580956625074 AsphaltRegularityCoordinates,0.9763779527559056 AtrialFibrillation,0.13333333333333333 AustraliaRainfall_disc,0.36416143663807826 AutomotiveRoadTrials,0.7463702359346642 BIDMC32HR_disc,0.6257772649682564 +BIDMC32RR_disc,0.3333333333333333 BIDMC32SpO2_disc,0.4533872057664151 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7714461753613719 BeijingPM25Quality_disc,0.842096821849256 BenzeneConcentration_disc,0.5194722897978201 Blink,0.998 BoneIntensitiesAgeGroup,0.7400469308220563 BoneProbAgeGroup,0.6159275784718471 +ButtonPress,1.0 CharacterTrajectories,0.9788713820824153 CounterMovementJump,0.7427495291902071 Cricket,0.9861111111111112 @@ -27,6 +31,9 @@ Epilepsy,0.9852941176470589 EthanolConcentration,0.35710955710955716 EyesOpenShut,0.5 FaceDetection,0.5559023836549376 +FeedbackButton,0.5243478260869565 +FeetHands,0.5944279761378157 +FingerMovements,0.5104041616646658 FordChallenge,0.887931936607091 HandMovementDirection,0.2642857142857143 Handwriting,0.2624473346809047 @@ -34,34 +41,86 @@ Heartbeat,0.6261261261261262 HouseholdPowerConsumption1_disc,0.9404051640530531 HouseholdPowerConsumption2_disc,0.5408744984087449 IEEEPPG_disc,0.543140938229374 +IRDS-EFL,0.7083333333333334 +IRDS-EFR,0.5 +IRDS-SAL,0.5357142857142857 +IRDS-SAR,0.5517241379310345 +IRDS-SFE,0.6 IRDS-SFL,0.802536231884058 +IRDS-SFR,0.6538461538461539 +IRDS-STL,0.5454545454545454 +IRDS-STR,0.7181818181818181 +ImaginedFeetHands,0.567425453178015 +ImaginedOpenCloseFist,0.5439159529867059 +InnerSpeech,0.2224335315140786 JapaneseVowels,0.9528666210813042 +KERAAL-CTK,0.8571428571428572 +KERAAL-CTK-MC,0.6666666666666666 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.5 KERAAL-RTK,0.75 +KERAAL-RTK-MC,0.27619047619047615 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.5 KIMORE-PR-C,0.6666666666666666 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.5 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.5 LSST,0.43057687176186626 Libras,0.8222222222222222 +LiveFuelMoistureContent_disc,0.49929461942257214 Locust2022,0.6024816124292939 +LongIntervalTask,0.5040204678362573 LowCost,0.5533333333333333 +MatchingPennies,0.5337480407523512 MindReading,0.5404432671081677 MotionSenseHAR,0.9929577464788734 MotorImagery,0.53 NATOPS,0.8722222222222222 +NewsHeadlineSentiment_disc,0.3328529259757857 +NewsTitleSentiment_disc,0.3335153482035198 +OpenCloseFist,0.5714348102626581 +Opportunity,0.8484347876596097 +PAMAP2,0.8650753004946141 PEMS-SF,0.982924482924483 +PPGDalia_disc,0.6723560043664082 PenDigits,0.9479886232040234 PhonemeSpectra,0.25356904837069 PhotoStimulation,0.26666666666666666 +PronouncedSpeech,0.32783707128336287 RacketSports,0.8329477721321087 +SPHERE-WUS,0.75 STEW,0.7906846240179574 SelfRegulationSCP1,0.7720156555772995 +SelfRegulationSCP2,0.55 +ShortIntervalTask,0.5477777777777778 +SitStand,0.38312500000000005 Skoda,0.9328580423652331 +SongFamiliarity,0.4901907725612231 SpokenArabicDigits,0.9627127438771275 StandWalkJump,0.4666666666666666 TactileTextureRecognition,0.9967482363315696 Tiselac,0.6256228971953681 +UCDHE-MP,0.6513740458015267 +UCDHE-MP-MC,0.6129408212560387 +UCDHE-Rowing,0.5580952380952381 UCDHE-Rowing-MC,0.7385317460317461 UCIActivity,0.9480992667861695 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.9444444444444444 +UIPRMD-SASLR-C,0.85 +UIPRMD-SL-C,0.8333333333333333 +UIPRMD-SSA-C,0.9444444444444444 +UIPRMD-SSE-C,0.9444444444444444 +UIPRMD-SSIER-C,0.8 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9444444444444444 USCActivity,0.7354240046274758 UWaveGestureLibrary,0.875 +VisualSpeech,0.23388922876843043 WISDM,0.6226182288902851 +WISDM2,0.5797247501361248 diff --git a/results/multiverse/Catch22/Catch22_f1.csv b/results/multiverse/Catch22/Catch22_f1.csv index a309de1..dab0b2e 100644 --- a/results/multiverse/Catch22/Catch22_f1.csv +++ b/results/multiverse/Catch22/Catch22_f1.csv @@ -3,18 +3,22 @@ Alzheimers,0.36827217954790215 AppliancesEnergy_disc,0.7058823529411765 ArticularyWordRecognition,0.9798296756383714 AsphaltObstaclesCoordinates,0.804951828160386 +AsphaltPavementTypeCoordinates,0.9223744510417111 AsphaltRegularityCoordinates,0.9762532981530343 AtrialFibrillation,0.1465201465201465 AustraliaRainfall_disc,0.7411522467542357 AutomotiveRoadTrials,0.6285714285714286 BIDMC32HR_disc,0.7665567638106812 +BIDMC32RR_disc,0.7260494608534693 BIDMC32SpO2_disc,0.004705882352941176 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6836010459469556 BeijingPM25Quality_disc,0.7892190739460954 BenzeneConcentration_disc,0.4146064867316852 Blink,0.9975062344139651 BoneIntensitiesAgeGroup,0.7328370085662387 BoneProbAgeGroup,0.6454181496293835 +ButtonPress,1.0 CharacterTrajectories,0.9797908179854864 CounterMovementJump,0.739490477755348 Cricket,0.9860139860139859 @@ -27,6 +31,9 @@ Epilepsy,0.9854783533273235 EthanolConcentration,0.3551505987731701 EyesOpenShut,0.6181818181818182 FaceDetection,0.5438647624599242 +FeedbackButton,0.545303408146301 +FeetHands,0.626095423563778 +FingerMovements,0.5148514851485149 FordChallenge,0.8690146418678275 HandMovementDirection,0.2592589965815118 Handwriting,0.229067372801246 @@ -34,34 +41,86 @@ Heartbeat,0.4318181818181818 HouseholdPowerConsumption1_disc,0.9749504298880127 HouseholdPowerConsumption2_disc,0.6852333956065242 IEEEPPG_disc,0.47010077988184523 +IRDS-EFL,0.5882352941176471 +IRDS-EFR,0.0 +IRDS-SAL,0.4 +IRDS-SAR,0.23529411764705882 +IRDS-SFE,0.3333333333333333 IRDS-SFL,0.6153846153846154 +IRDS-SFR,0.3076923076923077 +IRDS-STL,0.16666666666666666 +IRDS-STR,0.24390243902439024 +ImaginedFeetHands,0.5531233315536572 +ImaginedOpenCloseFist,0.5439153439153439 +InnerSpeech,0.20240468157712882 JapaneseVowels,0.9514243354266378 +KERAAL-CTK,0.875 +KERAAL-CTK-MC,0.8956043956043956 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.8941798941798941 KERAAL-RTK,0.6666666666666666 +KERAAL-RTK-MC,0.37672583826429984 +KIMORE-LA-C,0.6 +KIMORE-LT-C,0.6 KIMORE-PR-C,0.3333333333333333 +KIMORE-Sq-C,0.4444444444444444 +KIMORE-TR-C,0.25 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.6148050615916968 Libras,0.8193489833319919 +LiveFuelMoistureContent_disc,0.0707395498392283 Locust2022,0.3142857142857143 +LongIntervalTask,0.15778251599147122 LowCost,0.5562913907284768 +MatchingPennies,0.5947955390334573 MindReading,0.5141529383746355 MotionSenseHAR,0.9886478870581268 MotorImagery,0.6713286713286714 NATOPS,0.8716750436629221 +NewsHeadlineSentiment_disc,0.4143061384866744 +NewsTitleSentiment_disc,0.48646872759700466 +OpenCloseFist,0.5736842105263158 +Opportunity,0.8365994219443176 +PAMAP2,0.8622700552671029 PEMS-SF,0.9826504725126725 +PPGDalia_disc,0.7641604399900055 PenDigits,0.9483021858648114 PhonemeSpectra,0.2504432394928168 PhotoStimulation,0.21739130434782608 +PronouncedSpeech,0.31599387125666323 RacketSports,0.8208824445436324 +SPHERE-WUS,0.6666666666666666 STEW,0.783076475719686 SelfRegulationSCP1,0.8091168091168092 +SelfRegulationSCP2,0.5803108808290155 +ShortIntervalTask,0.24302788844621515 +SitStand,0.3808088549598432 Skoda,0.9371371093864921 +SongFamiliarity,0.33568904593639576 SpokenArabicDigits,0.9625697548293948 StandWalkJump,0.45 TactileTextureRecognition,0.9970618116994363 Tiselac,0.8150042198066995 +UCDHE-MP,0.4768211920529801 +UCDHE-MP-MC,0.6153897569725413 +UCDHE-Rowing,0.2222222222222222 UCDHE-Rowing-MC,0.7290373076267356 UCIActivity,0.9485965994433709 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.9411764705882353 +UIPRMD-SASLR-C,0.8235294117647058 +UIPRMD-SL-C,0.8571428571428571 +UIPRMD-SSA-C,0.9411764705882353 +UIPRMD-SSE-C,0.9411764705882353 +UIPRMD-SSIER-C,0.75 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9473684210526315 USCActivity,0.7299438299357325 UWaveGestureLibrary,0.8740102617135138 +VisualSpeech,0.21565666622550433 WISDM,0.8194675781340203 +WISDM2,0.6376700935795805 diff --git a/results/multiverse/Catch22/Catch22_logloss.csv b/results/multiverse/Catch22/Catch22_logloss.csv index 0e1c330..df47a72 100644 --- a/results/multiverse/Catch22/Catch22_logloss.csv +++ b/results/multiverse/Catch22/Catch22_logloss.csv @@ -3,18 +3,22 @@ Alzheimers,1.1122287889268692 AppliancesEnergy_disc,0.34762917813923017 ArticularyWordRecognition,0.7163141072034667 AsphaltObstaclesCoordinates,0.5709858523434743 +AsphaltPavementTypeCoordinates,0.2576058655592423 AsphaltRegularityCoordinates,0.08019859173309755 AtrialFibrillation,1.2670160545732143 AustraliaRainfall_disc,0.5640851950963203 AutomotiveRoadTrials,0.42577223846237605 BIDMC32HR_disc,0.5032351471664644 +BIDMC32RR_disc,1.7908881903182527 BIDMC32SpO2_disc,0.831104427139128 +BasicMotions,0.10550141527058617 BeijingPM10Quality_disc,0.37203314101819746 BeijingPM25Quality_disc,0.3035585618005549 BenzeneConcentration_disc,0.6923641812209692 Blink,0.10005761999998895 BoneIntensitiesAgeGroup,0.733511137409169 BoneProbAgeGroup,0.8479535364256804 +ButtonPress,0.059278828252907916 CharacterTrajectories,0.25198144518827675 CounterMovementJump,0.6198343103929415 Cricket,0.3922985453184733 @@ -27,6 +31,9 @@ Epilepsy,0.16667271255258664 EthanolConcentration,1.3373811768111 EyesOpenShut,0.7152580064208962 FaceDetection,0.6840545124166357 +FeedbackButton,0.6959394790985212 +FeetHands,0.6720437852711922 +FingerMovements,0.6894121529526228 FordChallenge,0.2776480302393388 HandMovementDirection,1.3970634595599276 Handwriting,3.7911949738381603 @@ -34,34 +41,86 @@ Heartbeat,0.5004334803147749 HouseholdPowerConsumption1_disc,0.1695282985746932 HouseholdPowerConsumption2_disc,0.5922948002658613 IEEEPPG_disc,1.003883928959501 +IRDS-EFL,0.49713558782678197 +IRDS-EFR,0.6119726260714161 +IRDS-SAL,1.0962954812544985 +IRDS-SAR,1.1638542669145666 +IRDS-SFE,0.34632314358173377 IRDS-SFL,0.4774403716630312 +IRDS-SFR,1.0378913945656605 +IRDS-STL,0.7169239557010583 +IRDS-STR,0.6998140729936944 +ImaginedFeetHands,0.6805921618883459 +ImaginedOpenCloseFist,0.6867663487952949 +InnerSpeech,1.3992381908272682 JapaneseVowels,0.5534661538143435 +KERAAL-CTK,0.5463653742248817 +KERAAL-CTK-MC,0.7053821950495112 +KERAAL-ELK,0.5705808273494791 +KERAAL-ELK-MC,0.4725311137919282 KERAAL-RTK,0.536919022172935 +KERAAL-RTK-MC,0.8832450491330357 +KIMORE-LA-C,1.2534914402864652 +KIMORE-LT-C,0.8984787236696633 KIMORE-PR-C,0.8458338744333623 +KIMORE-Sq-C,1.060252684811021 +KIMORE-TR-C,1.6878231835515147 +KINECAL-3WFV,0.23016112766523386 +KINECAL-GGFV,0.2156485002181793 +KINECAL-QSEC,0.2307161544537976 KINECAL-QSEO,0.1580082537617935 LSST,1.1249433034248246 Libras,0.5832964026952243 +LiveFuelMoistureContent_disc,0.5186032003947362 Locust2022,0.25307325406756986 +LongIntervalTask,0.6228540124876856 LowCost,0.6868227117509256 +MatchingPennies,0.687685813672448 MindReading,1.0015724739224043 MotionSenseHAR,0.08069080438496559 MotorImagery,0.68156341599724 NATOPS,0.3872404410792394 +NewsHeadlineSentiment_disc,1.1738733092058666 +NewsTitleSentiment_disc,1.1103454766106038 +OpenCloseFist,0.6799724149181551 +Opportunity,0.46180834968242507 +PAMAP2,0.6869560503598602 PEMS-SF,0.3298982962061515 +PPGDalia_disc,0.5671869637248028 PenDigits,0.24683937085312369 PhonemeSpectra,3.6310914821889866 PhotoStimulation,1.1936214581537774 +PronouncedSpeech,1.3759558531689315 RacketSports,0.6690383289697058 +SPHERE-WUS,0.45723982822856063 STEW,0.4814962611252463 SelfRegulationSCP1,0.5548317510989597 +SelfRegulationSCP2,0.6917658858774309 +ShortIntervalTask,0.6089359338120447 +SitStand,1.2789480829017075 Skoda,0.3749097041569002 +SongFamiliarity,0.7024910321590027 SpokenArabicDigits,0.4279414776326756 StandWalkJump,1.0104563806049665 TactileTextureRecognition,0.15733705029141337 Tiselac,0.6096575712810199 +UCDHE-MP,0.49087080519662835 +UCDHE-MP-MC,0.9480186483465589 +UCDHE-Rowing,0.38820118911850676 UCDHE-Rowing-MC,0.7931127675117233 UCIActivity,0.21000807265781948 UIPRMD-DS-C,0.388044591892416 +UIPRMD-HS-C,0.1481272494384626 +UIPRMD-IL-C,0.48792410667819514 +UIPRMD-SASLR-C,0.45640146066454274 +UIPRMD-SL-C,0.38733251475433456 +UIPRMD-SSA-C,0.2516924238004298 +UIPRMD-SSE-C,0.38309791409974747 +UIPRMD-SSIER-C,0.37606528559079266 +UIPRMD-SSS-C,0.21780140686187097 +UIPRMD-STS-C,0.18845927017640618 USCActivity,0.7880034499819444 UWaveGestureLibrary,0.781713853460141 +VisualSpeech,1.4070446527093525 WISDM,0.8713652304195361 +WISDM2,0.9085953218542945 diff --git a/results/multiverse/Catch22/Catch22_sensitivity.csv b/results/multiverse/Catch22/Catch22_sensitivity.csv index 5e7c118..74904ed 100644 --- a/results/multiverse/Catch22/Catch22_sensitivity.csv +++ b/results/multiverse/Catch22/Catch22_sensitivity.csv @@ -3,18 +3,22 @@ Alzheimers,0.4186046511627907 AppliancesEnergy_disc,0.75 ArticularyWordRecognition,0.98 AsphaltObstaclesCoordinates,0.8081841432225064 +AsphaltPavementTypeCoordinates,0.9223484848484849 AsphaltRegularityCoordinates,1.0 AtrialFibrillation,0.13333333333333333 AustraliaRainfall_disc,0.7631288866704103 AutomotiveRoadTrials,0.5789473684210527 BIDMC32HR_disc,0.7907461442267611 +BIDMC32RR_disc,0.7940808670279283 BIDMC32SpO2_disc,0.0029282576866764276 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6275720164609053 BeijingPM25Quality_disc,0.7483617300131061 BenzeneConcentration_disc,0.5705368289637952 Blink,1.0 BoneIntensitiesAgeGroup,0.7325842696629213 BoneProbAgeGroup,0.6494382022471911 +ButtonPress,1.0 CharacterTrajectories,0.9798050139275766 CounterMovementJump,0.7430167597765364 Cricket,0.9861111111111112 @@ -27,6 +31,9 @@ Epilepsy,0.9855072463768116 EthanolConcentration,0.3574144486692015 EyesOpenShut,0.8095238095238095 FaceDetection,0.5295119182746879 +FeedbackButton,0.5704347826086956 +FeetHands,0.6862326574172892 +FingerMovements,0.5306122448979592 FordChallenge,0.8035126234906695 HandMovementDirection,0.25675675675675674 Handwriting,0.2635294117647059 @@ -34,34 +41,86 @@ Heartbeat,0.3333333333333333 HouseholdPowerConsumption1_disc,0.9752186588921283 HouseholdPowerConsumption2_disc,0.7332361516034985 IEEEPPG_disc,0.49623493975903615 +IRDS-EFL,0.4166666666666667 +IRDS-EFR,0.0 +IRDS-SAL,0.7857142857142857 +IRDS-SAR,1.0 +IRDS-SFE,0.2 IRDS-SFL,0.8333333333333334 +IRDS-SFR,1.0 +IRDS-STL,0.09090909090909091 +IRDS-STR,1.0 +ImaginedFeetHands,0.5356773526370218 +ImaginedOpenCloseFist,0.5444915254237288 +InnerSpeech,0.22 JapaneseVowels,0.9513513513513514 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.5 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,1.0 +KIMORE-LT-C,1.0 KIMORE-PR-C,1.0 +KIMORE-Sq-C,1.0 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.6678832116788321 Libras,0.8222222222222222 +LiveFuelMoistureContent_disc,0.04583333333333333 Locust2022,0.22525597269624573 +LongIntervalTask,0.10277777777777777 LowCost,0.56 +MatchingPennies,0.6896551724137931 MindReading,0.5635528330781011 MotionSenseHAR,0.9886792452830189 MotorImagery,0.96 NATOPS,0.8722222222222222 +NewsHeadlineSentiment_disc,0.525229449721454 +NewsTitleSentiment_disc,0.6078714279988778 +OpenCloseFist,0.5773305084745762 +Opportunity,0.8367935409457901 +PAMAP2,0.8633653360282971 PEMS-SF,0.9826589595375722 +PPGDalia_disc,0.7723675635415697 PenDigits,0.948256146369354 PhonemeSpectra,0.25350432448553534 PhotoStimulation,0.3333333333333333 +PronouncedSpeech,0.325 RacketSports,0.8223684210526315 +SPHERE-WUS,0.5 STEW,0.7556116722783389 SelfRegulationSCP1,0.9726027397260274 +SelfRegulationSCP2,0.6222222222222222 +ShortIntervalTask,0.1525 +SitStand,0.383125 Skoda,0.9370357269189954 +SongFamiliarity,0.2631578947368421 SpokenArabicDigits,0.9627103228740337 StandWalkJump,0.4666666666666667 TactileTextureRecognition,0.9970631424375918 Tiselac,0.8271486349848332 +UCDHE-MP,0.36 +UCDHE-MP-MC,0.6132596685082873 +UCDHE-Rowing,0.13333333333333333 UCDHE-Rowing-MC,0.7295454545454545 UCIActivity,0.9479383590170762 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.8888888888888888 +UIPRMD-SASLR-C,0.7 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,0.8888888888888888 +UIPRMD-SSE-C,0.8888888888888888 +UIPRMD-SSIER-C,0.6 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,1.0 USCActivity,0.7282806804374241 UWaveGestureLibrary,0.875 +VisualSpeech,0.235 WISDM,0.8416071083639173 +WISDM2,0.6531802120141342 diff --git a/results/multiverse/Catch22/Catch22_specificity.csv b/results/multiverse/Catch22/Catch22_specificity.csv index cc2b460..ae156e8 100644 --- a/results/multiverse/Catch22/Catch22_specificity.csv +++ b/results/multiverse/Catch22/Catch22_specificity.csv @@ -3,18 +3,22 @@ Alzheimers,0.4186046511627907 AppliancesEnergy_disc,0.9117647058823529 ArticularyWordRecognition,0.98 AsphaltObstaclesCoordinates,0.8081841432225064 +AsphaltPavementTypeCoordinates,0.9223484848484849 AsphaltRegularityCoordinates,0.952755905511811 AtrialFibrillation,0.13333333333333333 AustraliaRainfall_disc,0.7631288866704103 AutomotiveRoadTrials,0.9137931034482759 BIDMC32HR_disc,0.7907461442267611 +BIDMC32RR_disc,0.7940808670279283 BIDMC32SpO2_disc,0.9038461538461539 +BasicMotions,1.0 BeijingPM10Quality_disc,0.9153203342618385 BeijingPM25Quality_disc,0.935831913685406 BenzeneConcentration_disc,0.468407750631845 Blink,0.996 BoneIntensitiesAgeGroup,0.7325842696629213 BoneProbAgeGroup,0.6494382022471911 +ButtonPress,1.0 CharacterTrajectories,0.9798050139275766 CounterMovementJump,0.7430167597765364 Cricket,0.9861111111111112 @@ -27,6 +31,9 @@ Epilepsy,0.9855072463768116 EthanolConcentration,0.3574144486692015 EyesOpenShut,0.19047619047619047 FaceDetection,0.5822928490351873 +FeedbackButton,0.4782608695652174 +FeetHands,0.5026232948583421 +FingerMovements,0.49019607843137253 FordChallenge,0.9723512497235125 HandMovementDirection,0.25675675675675674 Handwriting,0.2635294117647059 @@ -34,34 +41,86 @@ Heartbeat,0.918918918918919 HouseholdPowerConsumption1_disc,0.9752186588921283 HouseholdPowerConsumption2_disc,0.7332361516034985 IEEEPPG_disc,0.49623493975903615 +IRDS-EFL,1.0 +IRDS-EFR,1.0 +IRDS-SAL,0.2857142857142857 +IRDS-SAR,0.10344827586206896 +IRDS-SFE,1.0 IRDS-SFL,0.7717391304347826 +IRDS-SFR,0.3076923076923077 +IRDS-STL,1.0 +IRDS-STR,0.43636363636363634 +ImaginedFeetHands,0.5991735537190083 +ImaginedOpenCloseFist,0.5433403805496829 +InnerSpeech,0.22 JapaneseVowels,0.9513513513513514 +KERAAL-CTK,0.7142857142857143 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,1.0 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,1.0 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,0.0 +KIMORE-LT-C,0.0 KIMORE-PR-C,0.3333333333333333 +KIMORE-Sq-C,0.0 +KIMORE-TR-C,0.0 +KINECAL-3WFV,1.0 +KINECAL-GGFV,1.0 +KINECAL-QSEC,1.0 KINECAL-QSEO,1.0 LSST,0.6678832116788321 Libras,0.8222222222222222 +LiveFuelMoistureContent_disc,0.952755905511811 Locust2022,0.979707252162342 +LongIntervalTask,0.9052631578947369 LowCost,0.5466666666666666 +MatchingPennies,0.3778409090909091 MindReading,0.5635528330781011 MotionSenseHAR,0.9886792452830189 MotorImagery,0.1 NATOPS,0.8722222222222222 +NewsHeadlineSentiment_disc,0.525229449721454 +NewsTitleSentiment_disc,0.6078714279988778 +OpenCloseFist,0.5655391120507399 +Opportunity,0.8367935409457901 +PAMAP2,0.8633653360282971 PEMS-SF,0.9826589595375722 +PPGDalia_disc,0.7723675635415697 PenDigits,0.948256146369354 PhonemeSpectra,0.25350432448553534 PhotoStimulation,0.3333333333333333 +PronouncedSpeech,0.325 RacketSports,0.8223684210526315 +SPHERE-WUS,1.0 STEW,0.8257575757575758 SelfRegulationSCP1,0.5714285714285714 +SelfRegulationSCP2,0.4777777777777778 +ShortIntervalTask,0.9430555555555555 +SitStand,0.383125 Skoda,0.9370357269189954 +SongFamiliarity,0.7172236503856041 SpokenArabicDigits,0.9627103228740337 StandWalkJump,0.4666666666666667 TactileTextureRecognition,0.9970631424375918 Tiselac,0.8271486349848332 +UCDHE-MP,0.9427480916030534 +UCDHE-MP-MC,0.6132596685082873 +UCDHE-Rowing,0.9828571428571429 UCDHE-Rowing-MC,0.7295454545454545 UCIActivity,0.9479383590170762 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,1.0 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.6666666666666666 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.8888888888888888 USCActivity,0.7282806804374241 UWaveGestureLibrary,0.875 +VisualSpeech,0.235 WISDM,0.8416071083639173 +WISDM2,0.6531802120141342 diff --git a/results/multiverse/ConvTran/ConvTran_accuracy.csv b/results/multiverse/ConvTran/ConvTran_accuracy.csv index 989ad31..225166d 100644 --- a/results/multiverse/ConvTran/ConvTran_accuracy.csv +++ b/results/multiverse/ConvTran/ConvTran_accuracy.csv @@ -8,6 +8,7 @@ AustraliaRainfall_disc,0.7794139057007966 AutomotiveRoadTrials,0.6103896103896104 BIDMC32HR_disc,0.8586911213005419 BIDMC32SpO2_disc,0.6857023759899958 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8300316957210776 BeijingPM25Quality_disc,0.8878763866877971 BenzeneConcentration_disc,0.969397637032733 @@ -25,6 +26,7 @@ Epilepsy,0.9565217391304348 EthanolConcentration,0.3155893536121673 EyesOpenShut,0.5 FaceDetection,0.6555051078320091 +FingerMovements,0.58 FordChallenge,0.9040529363110008 HandMovementDirection,0.35135135135135137 Handwriting,0.22588235294117648 @@ -51,6 +53,7 @@ PhonemeSpectra,0.2636444974649568 RacketSports,0.8289473684210527 STEW,0.7856341189674523 SelfRegulationSCP1,0.9010238907849829 +SelfRegulationSCP2,0.5222222222222223 Skoda,0.9472939511850018 SpokenArabicDigits,0.9827194179172352 StandWalkJump,0.26666666666666666 diff --git a/results/multiverse/ConvTran/ConvTran_auroc.csv b/results/multiverse/ConvTran/ConvTran_auroc.csv index 9974c6b..9e66ff2 100644 --- a/results/multiverse/ConvTran/ConvTran_auroc.csv +++ b/results/multiverse/ConvTran/ConvTran_auroc.csv @@ -8,6 +8,7 @@ AustraliaRainfall_disc,0.8638083829689669 AutomotiveRoadTrials,0.6687840290381126 BIDMC32HR_disc,0.9361851214979894 BIDMC32SpO2_disc,0.2646707245901975 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8970119712201627 BeijingPM25Quality_disc,0.9504861038237091 BenzeneConcentration_disc,0.9986505915625686 @@ -25,6 +26,7 @@ Epilepsy,0.9950667516584434 EthanolConcentration,0.5837762309747023 EyesOpenShut,0.6235827664399094 FaceDetection,0.7126569100998374 +FingerMovements,0.6078431372549019 FordChallenge,0.9600291537001818 HandMovementDirection,0.6279539554963284 Handwriting,0.7935821054256722 @@ -51,6 +53,7 @@ PhonemeSpectra,0.9056813391825946 RacketSports,0.9257017615713596 STEW,0.8743449899922028 SelfRegulationSCP1,0.9736278072872985 +SelfRegulationSCP2,0.5074074074074073 Skoda,0.9965096690264398 SpokenArabicDigits,0.9998246719098404 StandWalkJump,0.5133333333333333 diff --git a/results/multiverse/ConvTran/ConvTran_balacc.csv b/results/multiverse/ConvTran/ConvTran_balacc.csv index c49b804..40e4ac5 100644 --- a/results/multiverse/ConvTran/ConvTran_balacc.csv +++ b/results/multiverse/ConvTran/ConvTran_balacc.csv @@ -8,6 +8,7 @@ AustraliaRainfall_disc,0.39382743617460114 AutomotiveRoadTrials,0.617513611615245 BIDMC32HR_disc,0.8021436602269117 BIDMC32SpO2_disc,0.4793123543123543 +BasicMotions,1.0 BeijingPM10Quality_disc,0.759527494067884 BeijingPM25Quality_disc,0.8566992869385692 BenzeneConcentration_disc,0.9524036403526763 @@ -25,6 +26,7 @@ Epilepsy,0.9576709062003179 EthanolConcentration,0.3152680652680653 EyesOpenShut,0.5 FaceDetection,0.6555051078320091 +FingerMovements,0.5786314525810324 FordChallenge,0.896182493648982 HandMovementDirection,0.36071428571428565 Handwriting,0.22069774869865805 @@ -51,6 +53,7 @@ PhonemeSpectra,0.26370269037847693 RacketSports,0.8427325581395348 STEW,0.7856341189674523 SelfRegulationSCP1,0.9012207622775137 +SelfRegulationSCP2,0.5222222222222223 Skoda,0.9514336626909032 SpokenArabicDigits,0.982725197177252 StandWalkJump,0.26666666666666666 diff --git a/results/multiverse/ConvTran/ConvTran_f1.csv b/results/multiverse/ConvTran/ConvTran_f1.csv index 1a16121..ecba2bf 100644 --- a/results/multiverse/ConvTran/ConvTran_f1.csv +++ b/results/multiverse/ConvTran/ConvTran_f1.csv @@ -8,6 +8,7 @@ AustraliaRainfall_disc,0.7647522174378136 AutomotiveRoadTrials,0.4444444444444444 BIDMC32HR_disc,0.8515187847008346 BIDMC32SpO2_disc,0.0 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6682134570765661 BeijingPM25Quality_disc,0.8074829931972789 BenzeneConcentration_disc,0.9484670580560991 @@ -25,6 +26,7 @@ Epilepsy,0.9563529167315983 EthanolConcentration,0.31328733858593627 EyesOpenShut,0.6557377049180327 FaceDetection,0.6582207207207207 +FingerMovements,0.5434782608695652 FordChallenge,0.8715867158671586 HandMovementDirection,0.3393328882050687 Handwriting,0.17132400855913735 @@ -51,6 +53,7 @@ PhonemeSpectra,0.2568874964781285 RacketSports,0.8277473105552486 STEW,0.8020212490282457 SelfRegulationSCP1,0.9061488673139159 +SelfRegulationSCP2,0.44871794871794873 Skoda,0.9476229051993942 SpokenArabicDigits,0.9827367250760114 StandWalkJump,0.2222222222222222 diff --git a/results/multiverse/ConvTran/ConvTran_logloss.csv b/results/multiverse/ConvTran/ConvTran_logloss.csv index 63343f4..2ee5002 100644 --- a/results/multiverse/ConvTran/ConvTran_logloss.csv +++ b/results/multiverse/ConvTran/ConvTran_logloss.csv @@ -8,6 +8,7 @@ AustraliaRainfall_disc,0.49969519676541096 AutomotiveRoadTrials,1.1899729976597377 BIDMC32HR_disc,1.1541421666814118 BIDMC32SpO2_disc,4.866829227138219 +BasicMotions,0.10907373906717913 BeijingPM10Quality_disc,0.37673600352465697 BeijingPM25Quality_disc,0.26139179581041133 BenzeneConcentration_disc,0.0926125311695538 @@ -25,6 +26,7 @@ Epilepsy,0.15984163724218461 EthanolConcentration,1.4544173097170774 EyesOpenShut,0.6982935135605143 FaceDetection,0.6607365147207109 +FingerMovements,0.6918177050126166 FordChallenge,0.25460884604031914 HandMovementDirection,1.3417035345604762 Handwriting,2.6914392494236807 @@ -51,6 +53,7 @@ PhonemeSpectra,2.380101421504811 RacketSports,0.5837424191516809 STEW,1.1011942123452962 SelfRegulationSCP1,0.275681955313803 +SelfRegulationSCP2,0.694354909040822 Skoda,0.1605337442441326 SpokenArabicDigits,0.06581511567398633 StandWalkJump,1.252151396050831 diff --git a/results/multiverse/ConvTran/ConvTran_sensitivity.csv b/results/multiverse/ConvTran/ConvTran_sensitivity.csv index 274c138..63df44d 100644 --- a/results/multiverse/ConvTran/ConvTran_sensitivity.csv +++ b/results/multiverse/ConvTran/ConvTran_sensitivity.csv @@ -8,6 +8,7 @@ AustraliaRainfall_disc,0.7794139057007966 AutomotiveRoadTrials,0.631578947368421 BIDMC32HR_disc,0.8586911213005419 BIDMC32SpO2_disc,0.0 +BasicMotions,1.0 BeijingPM10Quality_disc,0.5925925925925926 BeijingPM25Quality_disc,0.7778505897771952 BenzeneConcentration_disc,0.9076154806491885 @@ -25,6 +26,7 @@ Epilepsy,0.9565217391304348 EthanolConcentration,0.3155893536121673 EyesOpenShut,0.9523809523809523 FaceDetection,0.6634506242905789 +FingerMovements,0.5102040816326531 FordChallenge,0.8642517380168313 HandMovementDirection,0.35135135135135137 Handwriting,0.22588235294117648 @@ -51,6 +53,7 @@ PhonemeSpectra,0.2636444974649568 RacketSports,0.8289473684210527 STEW,0.8684062850729517 SelfRegulationSCP1,0.958904109589041 +SelfRegulationSCP2,0.3888888888888889 Skoda,0.9472939511850018 SpokenArabicDigits,0.9827194179172352 StandWalkJump,0.26666666666666666 diff --git a/results/multiverse/ConvTran/ConvTran_specificity.csv b/results/multiverse/ConvTran/ConvTran_specificity.csv index 70a8817..2079aff 100644 --- a/results/multiverse/ConvTran/ConvTran_specificity.csv +++ b/results/multiverse/ConvTran/ConvTran_specificity.csv @@ -8,6 +8,7 @@ AustraliaRainfall_disc,0.7794139057007966 AutomotiveRoadTrials,0.603448275862069 BIDMC32HR_disc,0.8586911213005419 BIDMC32SpO2_disc,0.9586247086247086 +BasicMotions,1.0 BeijingPM10Quality_disc,0.9264623955431754 BeijingPM25Quality_disc,0.9355479840999432 BenzeneConcentration_disc,0.997191800056164 @@ -25,6 +26,7 @@ Epilepsy,0.9565217391304348 EthanolConcentration,0.3155893536121673 EyesOpenShut,0.047619047619047616 FaceDetection,0.6475595913734393 +FingerMovements,0.6470588235294118 FordChallenge,0.9281132492811325 HandMovementDirection,0.35135135135135137 Handwriting,0.22588235294117648 @@ -51,6 +53,7 @@ PhonemeSpectra,0.2636444974649568 RacketSports,0.8289473684210527 STEW,0.7028619528619529 SelfRegulationSCP1,0.8435374149659864 +SelfRegulationSCP2,0.6555555555555556 Skoda,0.9472939511850018 SpokenArabicDigits,0.9827194179172352 StandWalkJump,0.26666666666666666 diff --git a/results/multiverse/DrCIF-500/DrCIF-500_accuracy.csv b/results/multiverse/DrCIF-500/DrCIF-500_accuracy.csv new file mode 100644 index 0000000..cd55039 --- /dev/null +++ b/results/multiverse/DrCIF-500/DrCIF-500_accuracy.csv @@ -0,0 +1,126 @@ +Resamples:,0 +Alzheimers,0.46511627906976744 +AppliancesEnergy_disc,0.9047619047619048 +ArticularyWordRecognition,0.9866666666666667 +AsphaltObstaclesCoordinates,0.8132992327365729 +AsphaltPavementTypeCoordinates,0.9327651515151515 +AsphaltRegularityCoordinates,0.9866844207723036 +AtrialFibrillation,0.06666666666666667 +AustraliaRainfall_disc,0.7737151889519769 +AutomotiveRoadTrials,0.8181818181818182 +BIDMC32HR_disc,0.8645268862025844 +BIDMC32RR_disc,0.7940808670279283 +BIDMC32SpO2_disc,0.5956648603584827 +BasicMotions,1.0 +BeijingPM10Quality_disc,0.8328050713153724 +BeijingPM25Quality_disc,0.8763866877971473 +BenzeneConcentration_disc,0.8254890567499515 +Blink,0.9822222222222222 +BoneIntensitiesAgeGroup,0.8157303370786517 +BoneProbAgeGroup,0.6359550561797753 +ButtonPress,1.0 +CharacterTrajectories,0.9860724233983287 +CounterMovementJump,0.8379888268156425 +Cricket,0.9583333333333334 +CrowdSourced,0.7289092834451112 +DuckDuckGeese,0.48 +ERing,0.9851851851851852 +EigenWorms,0.9312977099236641 +EmoPain,0.8507042253521127 +Epilepsy,0.9927536231884058 +EthanolConcentration,0.6692015209125475 +EyesOpenShut,0.5238095238095238 +FaceDetection,0.6262769580022701 +FeedbackButton,0.5460869565217391 +FeetHands,0.6798941798941799 +FingerMovements,0.49 +FordChallenge,0.9164598842018197 +HandMovementDirection,0.5135135135135135 +Handwriting,0.3552941176470588 +Heartbeat,0.7853658536585366 +HouseholdPowerConsumption1_disc,0.9416909620991254 +HouseholdPowerConsumption2_disc,0.7798833819241983 +IEEEPPG_disc,0.3147590361445783 +IRDS-EFL,0.5384615384615384 +IRDS-EFR,0.6666666666666666 +IRDS-SAL,0.375 +IRDS-SAR,0.15151515151515152 +IRDS-SFE,0.6666666666666666 +IRDS-SFL,0.8103448275862069 +IRDS-SFR,0.5333333333333333 +IRDS-STL,0.5526315789473685 +IRDS-STR,0.9166666666666666 +ImaginedFeetHands,0.6868217054263566 +ImaginedOpenCloseFist,0.7534391534391535 +InnerSpeech,0.28 +JapaneseVowels,0.9702702702702702 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.8 +KERAAL-ELK-MC,0.7142857142857143 +KERAAL-RTK,0.8571428571428571 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,0.42857142857142855 +KIMORE-LT-C,0.42857142857142855 +KIMORE-PR-C,0.42857142857142855 +KIMORE-Sq-C,0.2857142857142857 +KIMORE-TR-C,0.14285714285714285 +KINECAL-3WFV,0.9166666666666666 +KINECAL-GGFV,0.9230769230769231 +KINECAL-QSEC,0.9444444444444444 +KINECAL-QSEO,0.9411764705882353 +LSST,0.629764801297648 +Libras,0.9055555555555556 +LiveFuelMoistureContent_disc,0.8364238410596027 +Locust2022,0.905122764474083 +LongIntervalTask,0.6785714285714286 +LowCost,0.72 +MatchingPennies,0.5671428571428572 +MindReading,0.5742725880551302 +MotionSenseHAR,1.0 +MotorImagery,0.51 +NATOPS,0.8555555555555555 +NewsHeadlineSentiment_disc,0.5359304236303154 +NewsTitleSentiment_disc,0.6128411686906337 +OpenCloseFist,0.7603174603174603 +Opportunity,0.8492887351018839 +PAMAP2,0.8754926730672057 +PEMS-SF,1.0 +PPGDalia_disc,0.7524439065263941 +PenDigits,0.9722698684962836 +PhonemeSpectra,0.30062630480167013 +PhotoStimulation,0.3888888888888889 +PronouncedSpeech,0.36 +RacketSports,0.8881578947368421 +SPHERE-WUS,0.75 +STEW,0.7063692480359147 +SelfRegulationSCP1,0.8839590443686007 +SelfRegulationSCP2,0.5444444444444444 +ShortIntervalTask,0.7053571428571429 +SitStand,0.418125 +Skoda,0.9458790237000354 +SongFamiliarity,0.5253333333333333 +SpokenArabicDigits,0.9786266484765803 +StandWalkJump,0.4 +TactileTextureRecognition,0.9985315712187959 +Tiselac,0.8365015166835187 +UCDHE-MP,0.8066298342541437 +UCDHE-MP-MC,0.7071823204419889 +UCDHE-Rowing,0.8477272727272728 +UCDHE-Rowing-MC,0.7613636363636364 +UCIActivity,0.9600166597251145 +UIPRMD-DS-C,0.8333333333333334 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.5 +UIPRMD-SASLR-C,0.7 +UIPRMD-SL-C,0.8888888888888888 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.8333333333333334 +UIPRMD-SSIER-C,0.85 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9444444444444444 +USCActivity,0.6606166464155528 +UWaveGestureLibrary,0.90625 +VisualSpeech,0.285 +WISDM,0.8692292833687464 +WISDM2,0.6640361209265803 diff --git a/results/multiverse/DrCIF-500/DrCIF-500_auroc.csv b/results/multiverse/DrCIF-500/DrCIF-500_auroc.csv new file mode 100644 index 0000000..b806162 --- /dev/null +++ b/results/multiverse/DrCIF-500/DrCIF-500_auroc.csv @@ -0,0 +1,126 @@ +Resamples:,0 +Alzheimers,0.6411773255813954 +AppliancesEnergy_disc,0.9227941176470589 +ArticularyWordRecognition,0.9992592592592593 +AsphaltObstaclesCoordinates,0.9633840722799534 +AsphaltPavementTypeCoordinates,0.9892552100224529 +AsphaltRegularityCoordinates,0.9995389089877279 +AtrialFibrillation,0.22333333333333333 +AustraliaRainfall_disc,0.8583808273061446 +AutomotiveRoadTrials,0.8761343012704175 +BIDMC32HR_disc,0.9794225836505398 +BIDMC32RR_disc,0.48785034817363954 +BIDMC32SpO2_disc,0.4035338746173299 +BasicMotions,1.0 +BeijingPM10Quality_disc,0.899126517418068 +BeijingPM25Quality_disc,0.9424199731625141 +BenzeneConcentration_disc,0.9237833149450578 +Blink,1.0 +BoneIntensitiesAgeGroup,0.9311806441581314 +BoneProbAgeGroup,0.8072246080717854 +ButtonPress,1.0 +CharacterTrajectories,0.9998293467533917 +CounterMovementJump,0.971908400231601 +Cricket,0.9987373737373737 +CrowdSourced,0.7216031422317382 +DuckDuckGeese,0.81875 +ERing,0.9997695473251029 +EigenWorms,0.9867672459721778 +EmoPain,0.9372874604124906 +Epilepsy,0.9999303232998885 +EthanolConcentration,0.8802915472300352 +EyesOpenShut,0.4977324263038549 +FaceDetection,0.6745831406112908 +FeedbackButton,0.5495818525519849 +FeetHands,0.7601345411501733 +FingerMovements,0.5140056022408963 +FordChallenge,0.9701213016331559 +HandMovementDirection,0.743319590777218 +Handwriting,0.8357717290936137 +Heartbeat,0.747569938359412 +HouseholdPowerConsumption1_disc,0.9846181471805237 +HouseholdPowerConsumption2_disc,0.8101054390070932 +IEEEPPG_disc,0.6785984755296408 +IRDS-EFL,0.994047619047619 +IRDS-EFR,0.76 +IRDS-SAL,0.4090136054421769 +IRDS-SAR,0.9310344827586207 +IRDS-SFE,1.0 +IRDS-SFL,0.917572463768116 +IRDS-SFR,0.6923076923076923 +IRDS-STL,0.35858585858585856 +IRDS-STR,0.9781818181818182 +ImaginedFeetHands,0.7622407206406453 +ImaginedOpenCloseFist,0.841357007202494 +InnerSpeech,0.5124043019451083 +JapaneseVowels,0.999408805010342 +KERAAL-CTK,0.979591836734694 +KERAAL-CTK-MC,0.9293563579277865 +KERAAL-ELK,0.375 +KERAAL-ELK-MC,0.7692307692307693 +KERAAL-RTK,0.9166666666666667 +KERAAL-RTK-MC,0.5352564102564102 +KIMORE-LA-C,0.75 +KIMORE-LT-C,0.3333333333333333 +KIMORE-PR-C,0.6666666666666667 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,0.8333333333333334 +KINECAL-3WFV,0.36363636363636365 +KINECAL-GGFV,0.75 +KINECAL-QSEC,0.5882352941176471 +KINECAL-QSEO,0.9375 +LSST,0.9058278675825846 +Libras,0.995353835978836 +LiveFuelMoistureContent_disc,0.500602034120735 +Locust2022,0.8398742901001184 +LongIntervalTask,0.7168146929824563 +LowCost,0.7741944444444444 +MatchingPennies,0.6262531021421107 +MindReading,0.9025509777527354 +MotionSenseHAR,1.0 +MotorImagery,0.512 +NATOPS,0.9758518518518519 +NewsHeadlineSentiment_disc,0.5033550585766823 +NewsTitleSentiment_disc,0.5058619656745171 +OpenCloseFist,0.8425691806715162 +Opportunity,0.9633250507863433 +PAMAP2,0.992390130942402 +PEMS-SF,0.9999208171668382 +PPGDalia_disc,0.8517279293836107 +PenDigits,0.9993747638404205 +PhonemeSpectra,0.9010312322240733 +PhotoStimulation,0.46761701261701266 +PronouncedSpeech,0.5778729923486635 +RacketSports,0.9666827619507484 +SPHERE-WUS,1.0 +STEW,0.8064817806447061 +SelfRegulationSCP1,0.9760506942503029 +SelfRegulationSCP2,0.5666666666666668 +ShortIntervalTask,0.775829861111111 +SitStand,0.72389921875 +Skoda,0.9942693741181986 +SongFamiliarity,0.5277827229418425 +SpokenArabicDigits,0.9985113162740356 +StandWalkJump,0.66 +TactileTextureRecognition,1.0 +Tiselac,0.97469869119406 +UCDHE-MP,0.8883969465648854 +UCDHE-MP-MC,0.8825698523570077 +UCDHE-Rowing,0.8683015873015874 +UCDHE-Rowing-MC,0.9468485909515321 +UCIActivity,0.9986472222217295 +UIPRMD-DS-C,0.9567901234567902 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.5 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.99 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9737654320987654 +USCActivity,0.9594090049134748 +UWaveGestureLibrary,0.9946595982142856 +VisualSpeech,0.48453571118887095 +WISDM,0.9759573089607143 +WISDM2,0.9289417336585283 diff --git a/results/multiverse/DrCIF-500/DrCIF-500_balacc.csv b/results/multiverse/DrCIF-500/DrCIF-500_balacc.csv new file mode 100644 index 0000000..bddbb60 --- /dev/null +++ b/results/multiverse/DrCIF-500/DrCIF-500_balacc.csv @@ -0,0 +1,126 @@ +Resamples:,0 +Alzheimers,0.42448292448292446 +AppliancesEnergy_disc,0.7977941176470589 +ArticularyWordRecognition,0.9866666666666667 +AsphaltObstaclesCoordinates,0.8137937453209935 +AsphaltPavementTypeCoordinates,0.9228915998217468 +AsphaltRegularityCoordinates,0.9868376250266014 +AtrialFibrillation,0.06666666666666667 +AustraliaRainfall_disc,0.3685616901641573 +AutomotiveRoadTrials,0.7377495462794919 +BIDMC32HR_disc,0.7654477782355489 +BIDMC32RR_disc,0.3333333333333333 +BIDMC32SpO2_disc,0.42122287180852336 +BasicMotions,1.0 +BeijingPM10Quality_disc,0.76005173645739 +BeijingPM25Quality_disc,0.8313819221325902 +BenzeneConcentration_disc,0.7366457997427394 +Blink,0.984 +BoneIntensitiesAgeGroup,0.8451121693333422 +BoneProbAgeGroup,0.6292292762960443 +ButtonPress,1.0 +CharacterTrajectories,0.9850729761350644 +CounterMovementJump,0.8376647834274952 +Cricket,0.9583333333333334 +CrowdSourced,0.7289884932358887 +DuckDuckGeese,0.48 +ERing,0.9851851851851853 +EigenWorms,0.9219580419580419 +EmoPain,0.6092545318583842 +Epilepsy,0.9932432432432432 +EthanolConcentration,0.6696969696969697 +EyesOpenShut,0.5238095238095237 +FaceDetection,0.6262769580022702 +FeedbackButton,0.5460869565217391 +FeetHands,0.6805207618249844 +FingerMovements,0.490796318527411 +FordChallenge,0.8975982553426126 +HandMovementDirection,0.49880952380952387 +Handwriting,0.3528726885208855 +Heartbeat,0.6895448079658606 +HouseholdPowerConsumption1_disc,0.840834433647307 +HouseholdPowerConsumption2_disc,0.5843688021770214 +IEEEPPG_disc,0.38191399078872684 +IRDS-EFL,0.5 +IRDS-EFR,0.5 +IRDS-SAL,0.5119047619047619 +IRDS-SAR,0.5172413793103449 +IRDS-SFE,0.5 +IRDS-SFL,0.818840579710145 +IRDS-SFR,0.7307692307692308 +IRDS-STL,0.46969696969696967 +IRDS-STR,0.8636363636363636 +ImaginedFeetHands,0.6868232242515405 +ImaginedOpenCloseFist,0.7534702314831404 +InnerSpeech,0.28779768863355487 +JapaneseVowels,0.9658033778111642 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.6666666666666666 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.38461538461538464 +KERAAL-RTK,0.8333333333333333 +KERAAL-RTK-MC,0.27619047619047615 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.5 +KIMORE-PR-C,0.6666666666666666 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.5 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 +KINECAL-QSEO,0.5 +LSST,0.4346256934573442 +Libras,0.9055555555555554 +LiveFuelMoistureContent_disc,0.49724409448818896 +Locust2022,0.6137247688922496 +LongIntervalTask,0.5643274853801169 +LowCost,0.72 +MatchingPennies,0.5673328108672936 +MindReading,0.5549099597454876 +MotionSenseHAR,1.0 +MotorImagery,0.51 +NATOPS,0.8555555555555556 +NewsHeadlineSentiment_disc,0.333405492556102 +NewsTitleSentiment_disc,0.3334575276399223 +OpenCloseFist,0.760297595585337 +Opportunity,0.8420806032316381 +PAMAP2,0.8737323907890467 +PEMS-SF,1.0 +PPGDalia_disc,0.633660966835459 +PenDigits,0.9727317317463179 +PhonemeSpectra,0.30069802518502925 +PhotoStimulation,0.35555555555555557 +PronouncedSpeech,0.3638435307233261 +RacketSports,0.8954941860465117 +SPHERE-WUS,0.75 +STEW,0.7063692480359147 +SelfRegulationSCP1,0.8842372565464542 +SelfRegulationSCP2,0.5444444444444445 +ShortIntervalTask,0.5980555555555556 +SitStand,0.418125 +Skoda,0.9405470386190352 +SongFamiliarity,0.5195864102144144 +SpokenArabicDigits,0.9786322125363223 +StandWalkJump,0.39999999999999997 +TactileTextureRecognition,0.9985119047619048 +Tiselac,0.6253206130707778 +UCDHE-MP,0.6994656488549619 +UCDHE-MP-MC,0.7063979468599035 +UCDHE-Rowing,0.6525396825396825 +UCDHE-Rowing-MC,0.773611111111111 +UCIActivity,0.9600813781423554 +UIPRMD-DS-C,0.8333333333333333 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.5 +UIPRMD-SASLR-C,0.7 +UIPRMD-SL-C,0.8888888888888888 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.8333333333333333 +UIPRMD-SSIER-C,0.85 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9444444444444444 +USCActivity,0.668457915772707 +UWaveGestureLibrary,0.90625 +VisualSpeech,0.283992924092714 +WISDM,0.6341784118794908 +WISDM2,0.5723769460639347 diff --git a/results/multiverse/DrCIF-500/DrCIF-500_f1.csv b/results/multiverse/DrCIF-500/DrCIF-500_f1.csv new file mode 100644 index 0000000..56fa872 --- /dev/null +++ b/results/multiverse/DrCIF-500/DrCIF-500_f1.csv @@ -0,0 +1,126 @@ +Resamples:,0 +Alzheimers,0.43431623456103263 +AppliancesEnergy_disc,0.7142857142857143 +ArticularyWordRecognition,0.9866434782608697 +AsphaltObstaclesCoordinates,0.8115686400842522 +AsphaltPavementTypeCoordinates,0.932608091010456 +AsphaltRegularityCoordinates,0.9866310160427807 +AtrialFibrillation,0.05128205128205129 +AustraliaRainfall_disc,0.7508980192589653 +AutomotiveRoadTrials,0.6111111111111112 +BIDMC32HR_disc,0.8528775595630402 +BIDMC32RR_disc,0.703102045869488 +BIDMC32SpO2_disc,0.02217741935483871 +BasicMotions,1.0 +BeijingPM10Quality_disc,0.6700547302580141 +BeijingPM25Quality_disc,0.7782515991471215 +BenzeneConcentration_disc,0.641178813221824 +Blink,0.9803921568627451 +BoneIntensitiesAgeGroup,0.8144543539396631 +BoneProbAgeGroup,0.6386538505137705 +ButtonPress,1.0 +CharacterTrajectories,0.9860472794093859 +CounterMovementJump,0.8399184738779161 +Cricket,0.9589577089577088 +CrowdSourced,0.7785467128027682 +DuckDuckGeese,0.46517556517556513 +ERing,0.9851778656126482 +EigenWorms,0.9304680601022559 +EmoPain,0.8471146492640442 +Epilepsy,0.9927565004474139 +EthanolConcentration,0.6665252865823773 +EyesOpenShut,0.6153846153846154 +FaceDetection,0.6205704407951599 +FeedbackButton,0.561344537815126 +FeetHands,0.7003467062902426 +FingerMovements,0.5048543689320388 +FordChallenge,0.8810365135453475 +HandMovementDirection,0.5172041789688848 +Handwriting,0.3140561868073636 +Heartbeat,0.5510204081632653 +HouseholdPowerConsumption1_disc,0.9391604255588598 +HouseholdPowerConsumption2_disc,0.7495600722411557 +IEEEPPG_disc,0.2150632712121358 +IRDS-EFL,0.0 +IRDS-EFR,0.0 +IRDS-SAL,0.38596491228070173 +IRDS-SAR,0.2222222222222222 +IRDS-SFE,0.0 +IRDS-SFL,0.6451612903225806 +IRDS-SFR,0.36363636363636365 +IRDS-STL,0.2608695652173913 +IRDS-STR,0.6153846153846154 +ImaginedFeetHands,0.6876288659793814 +ImaginedOpenCloseFist,0.7602880658436214 +InnerSpeech,0.22933792828512625 +JapaneseVowels,0.9701340485561769 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.8952380952380953 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.7738095238095238 +KERAAL-RTK,0.8 +KERAAL-RTK-MC,0.37672583826429984 +KIMORE-LA-C,0.6 +KIMORE-LT-C,0.6 +KIMORE-PR-C,0.3333333333333333 +KIMORE-Sq-C,0.4444444444444444 +KIMORE-TR-C,0.25 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 +KINECAL-QSEO,0.0 +LSST,0.5651586223123873 +Libras,0.9049688711717697 +LiveFuelMoistureContent_disc,0.0 +Locust2022,0.32688172043010755 +LongIntervalTask,0.3283582089552239 +LowCost,0.6877323420074349 +MatchingPennies,0.579750346740638 +MindReading,0.5349595019476082 +MotionSenseHAR,1.0 +MotorImagery,0.6370370370370371 +NATOPS,0.8541963947970623 +NewsHeadlineSentiment_disc,0.40778567840107466 +NewsTitleSentiment_disc,0.48510954629060316 +OpenCloseFist,0.7555315704263357 +Opportunity,0.8483797198340495 +PAMAP2,0.8713784855063835 +PEMS-SF,1.0 +PPGDalia_disc,0.7384689016226587 +PenDigits,0.9722297651455932 +PhonemeSpectra,0.29105664444960355 +PhotoStimulation,0.3252923976608187 +PronouncedSpeech,0.3558334961891733 +RacketSports,0.8863670945339628 +SPHERE-WUS,0.6666666666666666 +STEW,0.6755541776468764 +SelfRegulationSCP1,0.8924050632911392 +SelfRegulationSCP2,0.5858585858585859 +ShortIntervalTask,0.35039370078740156 +SitStand,0.4153590092066624 +Skoda,0.9459332885727638 +SongFamiliarity,0.4258064516129032 +SpokenArabicDigits,0.9786140537263935 +StandWalkJump,0.367032967032967 +TactileTextureRecognition,0.9985305578103894 +Tiselac,0.8233769102226428 +UCDHE-MP,0.5679012345679012 +UCDHE-MP-MC,0.7033250353427184 +UCDHE-Rowing,0.464 +UCDHE-Rowing-MC,0.7631335053266246 +UCIActivity,0.9604240863880914 +UIPRMD-DS-C,0.8571428571428571 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.3076923076923077 +UIPRMD-SASLR-C,0.5714285714285714 +UIPRMD-SL-C,0.9 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.8 +UIPRMD-SSIER-C,0.8235294117647058 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9473684210526315 +USCActivity,0.6537525184187775 +UWaveGestureLibrary,0.906321360776273 +VisualSpeech,0.28365669902031626 +WISDM,0.854473629988918 +WISDM2,0.6481002950908087 diff --git a/results/multiverse/DrCIF-500/DrCIF-500_logloss.csv b/results/multiverse/DrCIF-500/DrCIF-500_logloss.csv new file mode 100644 index 0000000..f69c336 --- /dev/null +++ b/results/multiverse/DrCIF-500/DrCIF-500_logloss.csv @@ -0,0 +1,126 @@ +Resamples:,0 +Alzheimers,1.0206360991014274 +AppliancesEnergy_disc,0.37019258307508673 +ArticularyWordRecognition,0.44449197173800503 +AsphaltObstaclesCoordinates,0.47836080429186656 +AsphaltPavementTypeCoordinates,0.21906509686785136 +AsphaltRegularityCoordinates,0.049473046546008904 +AtrialFibrillation,1.283098784294424 +AustraliaRainfall_disc,0.5199624111245481 +AutomotiveRoadTrials,0.4201034456209513 +BIDMC32HR_disc,0.37485925641213597 +BIDMC32RR_disc,2.037360529967721 +BIDMC32SpO2_disc,0.8598300647789204 +BasicMotions,0.09132216076891606 +BeijingPM10Quality_disc,0.37142522737118727 +BeijingPM25Quality_disc,0.30787032013488064 +BenzeneConcentration_disc,0.39363505943909377 +Blink,0.13326564747237254 +BoneIntensitiesAgeGroup,0.5606274544303633 +BoneProbAgeGroup,0.8301338873039228 +ButtonPress,0.019177080623288947 +CharacterTrajectories,0.17737600517454277 +CounterMovementJump,0.5385905634501292 +Cricket,0.271191100271913 +CrowdSourced,0.6496743710724645 +DuckDuckGeese,1.1763468432084319 +ERing,0.4837457527987229 +EigenWorms,0.31095136419535574 +EmoPain,0.3815596009142511 +Epilepsy,0.09556305369812784 +EthanolConcentration,0.920476372780122 +EyesOpenShut,0.7192380746408071 +FaceDetection,0.6710265731618772 +FeedbackButton,0.6909964203378179 +FeetHands,0.60805232330245 +FingerMovements,0.7067350937290765 +FordChallenge,0.2763841572719305 +HandMovementDirection,1.2694229602367602 +Handwriting,2.9083747199784917 +Heartbeat,0.509638293394407 +HouseholdPowerConsumption1_disc,0.21225590231299854 +HouseholdPowerConsumption2_disc,0.5137765393503049 +IEEEPPG_disc,1.2944892902544414 +IRDS-EFL,0.5652540938631587 +IRDS-EFR,0.6716085900543141 +IRDS-SAL,1.2325761434650995 +IRDS-SAR,1.1115071231330367 +IRDS-SFE,0.6045643738142488 +IRDS-SFL,0.4928872429080576 +IRDS-SFR,0.640854738679962 +IRDS-STL,0.8613848611104837 +IRDS-STR,0.4451537100316377 +ImaginedFeetHands,0.5997013868466634 +ImaginedOpenCloseFist,0.5444166835220804 +InnerSpeech,1.3934876686621285 +JapaneseVowels,0.4419350970260594 +KERAAL-CTK,0.45758970809820154 +KERAAL-CTK-MC,0.6951436129007951 +KERAAL-ELK,0.5853854377855481 +KERAAL-ELK-MC,0.38999065304570174 +KERAAL-RTK,0.4856807430735442 +KERAAL-RTK-MC,0.9461003616779687 +KIMORE-LA-C,1.3841232249077318 +KIMORE-LT-C,0.8559754991071173 +KIMORE-PR-C,1.0299512663965757 +KIMORE-Sq-C,1.1159276372004268 +KIMORE-TR-C,1.733931084126277 +KINECAL-3WFV,0.3129503200569139 +KINECAL-GGFV,0.24976643955517652 +KINECAL-QSEC,0.22809569333024488 +KINECAL-QSEO,0.1701903920328757 +LSST,1.2282138918374546 +Libras,0.4770120543493123 +LiveFuelMoistureContent_disc,0.479986765123491 +Locust2022,0.2509342862608571 +LongIntervalTask,0.5710232763009039 +LowCost,0.6166308405158548 +MatchingPennies,0.6659772438618586 +MindReading,0.959933670487078 +MotionSenseHAR,0.04040874126488842 +MotorImagery,0.694975199701579 +NATOPS,0.43021413026715916 +NewsHeadlineSentiment_disc,1.0915311125477136 +NewsTitleSentiment_disc,1.0257642156257927 +OpenCloseFist,0.5627950342000784 +Opportunity,0.4307231947665427 +PAMAP2,0.6732430666355039 +PEMS-SF,0.1428776028320566 +PPGDalia_disc,0.6159453066530624 +PenDigits,0.14435040713130173 +PhonemeSpectra,2.5975090434222747 +PhotoStimulation,1.2559896887743223 +PronouncedSpeech,1.368189532634126 +RacketSports,0.5931798016438361 +SPHERE-WUS,0.39538972219366486 +STEW,0.5432230128186194 +SelfRegulationSCP1,0.31660953978091166 +SelfRegulationSCP2,0.6874675606830756 +ShortIntervalTask,0.5523504125260758 +SitStand,1.2114661018748234 +Skoda,0.34412506956979727 +SongFamiliarity,0.7074175896552373 +SpokenArabicDigits,0.3710082139993679 +StandWalkJump,1.0436157349395248 +TactileTextureRecognition,0.10785142553242476 +Tiselac,0.5382161218225221 +UCDHE-MP,0.4187594366655531 +UCDHE-MP-MC,0.8634641203669244 +UCDHE-Rowing,0.3817960017026936 +UCDHE-Rowing-MC,0.7892844495793784 +UCIActivity,0.22534104737720528 +UIPRMD-DS-C,0.3815304688061082 +UIPRMD-HS-C,0.14687396614142767 +UIPRMD-IL-C,0.6993408399614546 +UIPRMD-SASLR-C,0.44438179134675515 +UIPRMD-SL-C,0.37643331591240037 +UIPRMD-SSA-C,0.1711214006197613 +UIPRMD-SSE-C,0.40845873435592933 +UIPRMD-SSIER-C,0.40531822059944683 +UIPRMD-SSS-C,0.23012268317773932 +UIPRMD-STS-C,0.21909710537809737 +USCActivity,0.9380261326530738 +UWaveGestureLibrary,0.5816275688247978 +VisualSpeech,1.3952558995112798 +WISDM,0.5838230294531763 +WISDM2,0.9863726362327719 diff --git a/results/multiverse/DrCIF-500/DrCIF-500_sensitivity.csv b/results/multiverse/DrCIF-500/DrCIF-500_sensitivity.csv new file mode 100644 index 0000000..689f842 --- /dev/null +++ b/results/multiverse/DrCIF-500/DrCIF-500_sensitivity.csv @@ -0,0 +1,126 @@ +Resamples:,0 +Alzheimers,0.46511627906976744 +AppliancesEnergy_disc,0.625 +ArticularyWordRecognition,0.9866666666666667 +AsphaltObstaclesCoordinates,0.8132992327365729 +AsphaltPavementTypeCoordinates,0.9327651515151515 +AsphaltRegularityCoordinates,0.9972972972972973 +AtrialFibrillation,0.06666666666666667 +AustraliaRainfall_disc,0.7737151889519769 +AutomotiveRoadTrials,0.5789473684210527 +BIDMC32HR_disc,0.8645268862025844 +BIDMC32RR_disc,0.7940808670279283 +BIDMC32SpO2_disc,0.016105417276720352 +BasicMotions,1.0 +BeijingPM10Quality_disc,0.5877914951989026 +BeijingPM25Quality_disc,0.7175622542595019 +BenzeneConcentration_disc,0.5024968789013733 +Blink,1.0 +BoneIntensitiesAgeGroup,0.8157303370786517 +BoneProbAgeGroup,0.6359550561797753 +ButtonPress,1.0 +CharacterTrajectories,0.9860724233983287 +CounterMovementJump,0.8379888268156425 +Cricket,0.9583333333333334 +CrowdSourced,0.9533898305084746 +DuckDuckGeese,0.48 +ERing,0.9851851851851852 +EigenWorms,0.9312977099236641 +EmoPain,0.8507042253521127 +Epilepsy,0.9927536231884058 +EthanolConcentration,0.6692015209125475 +EyesOpenShut,0.7619047619047619 +FaceDetection,0.6112372304199774 +FeedbackButton,0.5808695652173913 +FeetHands,0.7545357524012807 +FingerMovements,0.5306122448979592 +FordChallenge,0.8210757409440176 +HandMovementDirection,0.5135135135135135 +Handwriting,0.3552941176470588 +Heartbeat,0.47368421052631576 +HouseholdPowerConsumption1_disc,0.9416909620991254 +HouseholdPowerConsumption2_disc,0.7798833819241983 +IEEEPPG_disc,0.3147590361445783 +IRDS-EFL,0.0 +IRDS-EFR,0.0 +IRDS-SAL,0.7857142857142857 +IRDS-SAR,1.0 +IRDS-SFE,0.0 +IRDS-SFL,0.8333333333333334 +IRDS-SFR,1.0 +IRDS-STL,0.2727272727272727 +IRDS-STR,0.8 +ImaginedFeetHands,0.6897621509824199 +ImaginedOpenCloseFist,0.7828389830508474 +InnerSpeech,0.28 +JapaneseVowels,0.9702702702702702 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.7142857142857143 +KERAAL-RTK,0.6666666666666666 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,1.0 +KIMORE-LT-C,1.0 +KIMORE-PR-C,1.0 +KIMORE-Sq-C,1.0 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 +KINECAL-QSEO,0.0 +LSST,0.629764801297648 +Libras,0.9055555555555556 +LiveFuelMoistureContent_disc,0.0 +Locust2022,0.2593856655290102 +LongIntervalTask,0.24444444444444444 +LowCost,0.6166666666666667 +MatchingPennies,0.6005747126436781 +MindReading,0.5742725880551302 +MotionSenseHAR,1.0 +MotorImagery,0.86 +NATOPS,0.8555555555555555 +NewsHeadlineSentiment_disc,0.5359304236303154 +NewsTitleSentiment_disc,0.6128411686906337 +OpenCloseFist,0.7415254237288136 +Opportunity,0.8492887351018839 +PAMAP2,0.8754926730672057 +PEMS-SF,1.0 +PPGDalia_disc,0.7524439065263941 +PenDigits,0.9722698684962836 +PhonemeSpectra,0.30062630480167013 +PhotoStimulation,0.3888888888888889 +PronouncedSpeech,0.36 +RacketSports,0.8881578947368421 +SPHERE-WUS,0.5 +STEW,0.6113916947250281 +SelfRegulationSCP1,0.9657534246575342 +SelfRegulationSCP2,0.6444444444444445 +ShortIntervalTask,0.2225 +SitStand,0.418125 +Skoda,0.9458790237000354 +SongFamiliarity,0.3656509695290859 +SpokenArabicDigits,0.9786266484765803 +StandWalkJump,0.4 +TactileTextureRecognition,0.9985315712187959 +Tiselac,0.8365015166835187 +UCDHE-MP,0.46 +UCDHE-MP-MC,0.7071823204419889 +UCDHE-Rowing,0.32222222222222224 +UCDHE-Rowing-MC,0.7613636363636364 +UCIActivity,0.9600166597251145 +UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.2222222222222222 +UIPRMD-SASLR-C,0.4 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.6666666666666666 +UIPRMD-SSIER-C,0.7 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,1.0 +USCActivity,0.6606166464155528 +UWaveGestureLibrary,0.90625 +VisualSpeech,0.285 +WISDM,0.8692292833687464 +WISDM2,0.6640361209265803 diff --git a/results/multiverse/DrCIF-500/DrCIF-500_specificity.csv b/results/multiverse/DrCIF-500/DrCIF-500_specificity.csv new file mode 100644 index 0000000..b98b091 --- /dev/null +++ b/results/multiverse/DrCIF-500/DrCIF-500_specificity.csv @@ -0,0 +1,126 @@ +Resamples:,0 +Alzheimers,0.46511627906976744 +AppliancesEnergy_disc,0.9705882352941176 +ArticularyWordRecognition,0.9866666666666667 +AsphaltObstaclesCoordinates,0.8132992327365729 +AsphaltPavementTypeCoordinates,0.9327651515151515 +AsphaltRegularityCoordinates,0.9763779527559056 +AtrialFibrillation,0.06666666666666667 +AustraliaRainfall_disc,0.7737151889519769 +AutomotiveRoadTrials,0.896551724137931 +BIDMC32HR_disc,0.8645268862025844 +BIDMC32RR_disc,0.7940808670279283 +BIDMC32SpO2_disc,0.8263403263403264 +BasicMotions,1.0 +BeijingPM10Quality_disc,0.9323119777158775 +BeijingPM25Quality_disc,0.9452015900056786 +BenzeneConcentration_disc,0.9707947205841055 +Blink,0.968 +BoneIntensitiesAgeGroup,0.8157303370786517 +BoneProbAgeGroup,0.6359550561797753 +ButtonPress,1.0 +CharacterTrajectories,0.9860724233983287 +CounterMovementJump,0.8379888268156425 +Cricket,0.9583333333333334 +CrowdSourced,0.5045871559633027 +DuckDuckGeese,0.48 +ERing,0.9851851851851852 +EigenWorms,0.9312977099236641 +EmoPain,0.8507042253521127 +Epilepsy,0.9927536231884058 +EthanolConcentration,0.6692015209125475 +EyesOpenShut,0.2857142857142857 +FaceDetection,0.641316685584563 +FeedbackButton,0.5113043478260869 +FeetHands,0.6065057712486883 +FingerMovements,0.45098039215686275 +FordChallenge,0.9741207697412076 +HandMovementDirection,0.5135135135135135 +Handwriting,0.3552941176470588 +Heartbeat,0.9054054054054054 +HouseholdPowerConsumption1_disc,0.9416909620991254 +HouseholdPowerConsumption2_disc,0.7798833819241983 +IEEEPPG_disc,0.3147590361445783 +IRDS-EFL,1.0 +IRDS-EFR,1.0 +IRDS-SAL,0.23809523809523808 +IRDS-SAR,0.034482758620689655 +IRDS-SFE,1.0 +IRDS-SFL,0.8043478260869565 +IRDS-SFR,0.46153846153846156 +IRDS-STL,0.6666666666666666 +IRDS-STR,0.9272727272727272 +ImaginedFeetHands,0.6838842975206612 +ImaginedOpenCloseFist,0.7241014799154334 +InnerSpeech,0.28 +JapaneseVowels,0.9702702702702702 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,1.0 +KERAAL-ELK-MC,0.7142857142857143 +KERAAL-RTK,1.0 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,0.0 +KIMORE-LT-C,0.0 +KIMORE-PR-C,0.3333333333333333 +KIMORE-Sq-C,0.0 +KIMORE-TR-C,0.0 +KINECAL-3WFV,1.0 +KINECAL-GGFV,1.0 +KINECAL-QSEC,1.0 +KINECAL-QSEO,1.0 +LSST,0.629764801297648 +Libras,0.9055555555555556 +LiveFuelMoistureContent_disc,0.9944881889763779 +Locust2022,0.9680638722554891 +LongIntervalTask,0.8842105263157894 +LowCost,0.8233333333333334 +MatchingPennies,0.5340909090909091 +MindReading,0.5742725880551302 +MotionSenseHAR,1.0 +MotorImagery,0.16 +NATOPS,0.8555555555555555 +NewsHeadlineSentiment_disc,0.5359304236303154 +NewsTitleSentiment_disc,0.6128411686906337 +OpenCloseFist,0.7790697674418605 +Opportunity,0.8492887351018839 +PAMAP2,0.8754926730672057 +PEMS-SF,1.0 +PPGDalia_disc,0.7524439065263941 +PenDigits,0.9722698684962836 +PhonemeSpectra,0.30062630480167013 +PhotoStimulation,0.3888888888888889 +PronouncedSpeech,0.36 +RacketSports,0.8881578947368421 +SPHERE-WUS,1.0 +STEW,0.8013468013468014 +SelfRegulationSCP1,0.8027210884353742 +SelfRegulationSCP2,0.4444444444444444 +ShortIntervalTask,0.9736111111111111 +SitStand,0.418125 +Skoda,0.9458790237000354 +SongFamiliarity,0.6735218508997429 +SpokenArabicDigits,0.9786266484765803 +StandWalkJump,0.4 +TactileTextureRecognition,0.9985315712187959 +Tiselac,0.8365015166835187 +UCDHE-MP,0.9389312977099237 +UCDHE-MP-MC,0.7071823204419889 +UCDHE-Rowing,0.9828571428571429 +UCDHE-Rowing-MC,0.7613636363636364 +UCIActivity,0.9600166597251145 +UIPRMD-DS-C,0.6666666666666666 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.7777777777777778 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.7777777777777778 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.8888888888888888 +USCActivity,0.6606166464155528 +UWaveGestureLibrary,0.90625 +VisualSpeech,0.285 +WISDM,0.8692292833687464 +WISDM2,0.6640361209265803 diff --git a/results/multiverse/Dummy/Dummy_accuracy.csv b/results/multiverse/Dummy/Dummy_accuracy.csv index 6dd24d5..b80fb5a 100644 --- a/results/multiverse/Dummy/Dummy_accuracy.csv +++ b/results/multiverse/Dummy/Dummy_accuracy.csv @@ -3,18 +3,22 @@ Alzheimers,0.4186046511627907 AppliancesEnergy_disc,0.8095238095238095 ArticularyWordRecognition,0.04 AsphaltObstaclesCoordinates,0.28388746803069054 +AsphaltPavementTypeCoordinates,0.38636363636363635 AsphaltRegularityCoordinates,0.507323568575233 AtrialFibrillation,0.3333333333333333 AustraliaRainfall_disc,0.6859882281982488 AutomotiveRoadTrials,0.7532467532467533 BIDMC32HR_disc,0.6506877865777407 +BIDMC32RR_disc,0.7940808670279283 BIDMC32SpO2_disc,0.7152980408503543 +BasicMotions,0.25 BeijingPM10Quality_disc,0.7111727416798732 BeijingPM25Quality_disc,0.6977020602218701 BenzeneConcentration_disc,0.6897152818128994 Blink,0.4444444444444444 BoneIntensitiesAgeGroup,0.4764044943820225 BoneProbAgeGroup,0.4764044943820225 +ButtonPress,0.44166666666666665 CharacterTrajectories,0.06476323119777158 CounterMovementJump,0.33519553072625696 Cricket,0.08333333333333333 @@ -27,6 +31,9 @@ Epilepsy,0.26811594202898553 EthanolConcentration,0.2509505703422053 EyesOpenShut,0.5 FaceDetection,0.5 +FeedbackButton,0.5 +FeetHands,0.5042328042328043 +FingerMovements,0.49 FordChallenge,0.6232423490488007 HandMovementDirection,0.20270270270270271 Handwriting,0.03764705882352941 @@ -34,34 +41,86 @@ Heartbeat,0.7219512195121951 HouseholdPowerConsumption1_disc,0.7784256559766763 HouseholdPowerConsumption2_disc,0.7215743440233237 IEEEPPG_disc,0.2605421686746988 +IRDS-EFL,0.5384615384615384 +IRDS-EFR,0.6666666666666666 +IRDS-SAL,0.75 +IRDS-SAR,0.12121212121212122 +IRDS-SFE,0.6666666666666666 IRDS-SFL,0.20689655172413793 +IRDS-SFR,0.8666666666666667 +IRDS-STL,0.7105263157894737 +IRDS-STR,0.9166666666666666 +ImaginedFeetHands,0.5002583979328166 +ImaginedOpenCloseFist,0.49947089947089945 +InnerSpeech,0.235 JapaneseVowels,0.08378378378378379 +KERAAL-CTK,0.5 +KERAAL-CTK-MC,0.5 +KERAAL-ELK,0.8 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.5714285714285714 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,0.42857142857142855 +KIMORE-LT-C,0.42857142857142855 KIMORE-PR-C,0.14285714285714285 +KIMORE-Sq-C,0.2857142857142857 +KIMORE-TR-C,0.14285714285714285 +KINECAL-3WFV,0.9166666666666666 +KINECAL-GGFV,0.9230769230769231 +KINECAL-QSEC,0.9444444444444444 KINECAL-QSEO,0.9411764705882353 LSST,0.3150851581508516 Libras,0.06666666666666667 +LiveFuelMoistureContent_disc,0.8410596026490066 Locust2022,0.9111852076386784 +LongIntervalTask,0.6785714285714286 LowCost,0.5 +MatchingPennies,0.49714285714285716 MindReading,0.23124042879019907 MotionSenseHAR,0.2037735849056604 MotorImagery,0.5 NATOPS,0.16666666666666666 +NewsHeadlineSentiment_disc,0.551360666907138 +NewsTitleSentiment_disc,0.6248647348803655 +OpenCloseFist,0.5005291005291005 +Opportunity,0.48308342945021143 +PAMAP2,0.10884284992420415 PEMS-SF,0.11560693641618497 +PPGDalia_disc,0.5442230704776092 PenDigits,0.10377358490566038 PhonemeSpectra,0.025648672830301224 PhotoStimulation,0.4166666666666667 +PronouncedSpeech,0.23 RacketSports,0.28289473684210525 +SPHERE-WUS,0.5 STEW,0.5 SelfRegulationSCP1,0.5017064846416383 +SelfRegulationSCP2,0.5 +ShortIntervalTask,0.6428571428571429 +SitStand,0.25 Skoda,0.23558542624690484 +SongFamiliarity,0.5186666666666667 SpokenArabicDigits,0.10004547521600728 StandWalkJump,0.3333333333333333 TactileTextureRecognition,0.0513950073421439 Tiselac,0.06279069767441861 +UCDHE-MP,0.7237569060773481 +UCDHE-MP-MC,0.2541436464088398 +UCDHE-Rowing,0.7954545454545454 UCDHE-Rowing-MC,0.20454545454545456 UCIActivity,0.19158683881715952 UIPRMD-DS-C,0.5 +UIPRMD-HS-C,0.5 +UIPRMD-IL-C,0.5 +UIPRMD-SASLR-C,0.5 +UIPRMD-SL-C,0.5 +UIPRMD-SSA-C,0.5 +UIPRMD-SSE-C,0.5 +UIPRMD-SSIER-C,0.5 +UIPRMD-SSS-C,0.5 +UIPRMD-STS-C,0.5 USCActivity,0.11383657351154314 UWaveGestureLibrary,0.125 +VisualSpeech,0.26 WISDM,0.36642843345566933 +WISDM2,0.35 diff --git a/results/multiverse/Dummy/Dummy_auroc.csv b/results/multiverse/Dummy/Dummy_auroc.csv index 9093bcb..e5e415b 100644 --- a/results/multiverse/Dummy/Dummy_auroc.csv +++ b/results/multiverse/Dummy/Dummy_auroc.csv @@ -3,18 +3,22 @@ Alzheimers,0.5 AppliancesEnergy_disc,0.5 ArticularyWordRecognition,0.5 AsphaltObstaclesCoordinates,0.5 +AsphaltPavementTypeCoordinates,0.5 AsphaltRegularityCoordinates,0.5 AtrialFibrillation,0.5 AustraliaRainfall_disc,0.5 AutomotiveRoadTrials,0.5 BIDMC32HR_disc,0.5 +BIDMC32RR_disc,0.5 BIDMC32SpO2_disc,0.5 +BasicMotions,0.5 BeijingPM10Quality_disc,0.5 BeijingPM25Quality_disc,0.5 BenzeneConcentration_disc,0.5 Blink,0.5 BoneIntensitiesAgeGroup,0.5 BoneProbAgeGroup,0.5 +ButtonPress,0.5 CharacterTrajectories,0.5 CounterMovementJump,0.5 Cricket,0.5 @@ -27,6 +31,9 @@ Epilepsy,0.5 EthanolConcentration,0.5 EyesOpenShut,0.5 FaceDetection,0.5 +FeedbackButton,0.5 +FeetHands,0.5 +FingerMovements,0.5 FordChallenge,0.5 HandMovementDirection,0.5 Handwriting,0.5 @@ -34,34 +41,86 @@ Heartbeat,0.5 HouseholdPowerConsumption1_disc,0.5 HouseholdPowerConsumption2_disc,0.5 IEEEPPG_disc,0.5 +IRDS-EFL,0.5 +IRDS-EFR,0.5 +IRDS-SAL,0.5 +IRDS-SAR,0.5 +IRDS-SFE,0.5 IRDS-SFL,0.5 +IRDS-SFR,0.5 +IRDS-STL,0.5 +IRDS-STR,0.5 +ImaginedFeetHands,0.5 +ImaginedOpenCloseFist,0.5 +InnerSpeech,0.5 JapaneseVowels,0.5 +KERAAL-CTK,0.5 +KERAAL-CTK-MC,0.5 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.5 KERAAL-RTK,0.5 +KERAAL-RTK-MC,0.5 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.5 KIMORE-PR-C,0.5 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.5 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.5 LSST,0.5 Libras,0.5 +LiveFuelMoistureContent_disc,0.5 Locust2022,0.5 +LongIntervalTask,0.5 LowCost,0.5 +MatchingPennies,0.5 MindReading,0.5 MotionSenseHAR,0.5 MotorImagery,0.5 NATOPS,0.5 +NewsHeadlineSentiment_disc,0.5 +NewsTitleSentiment_disc,0.5 +OpenCloseFist,0.5 +Opportunity,0.5 +PAMAP2,0.5 PEMS-SF,0.5 +PPGDalia_disc,0.5 PenDigits,0.5 PhonemeSpectra,0.5 PhotoStimulation,0.5 +PronouncedSpeech,0.5 RacketSports,0.5 +SPHERE-WUS,0.5 STEW,0.5 SelfRegulationSCP1,0.5 +SelfRegulationSCP2,0.5 +ShortIntervalTask,0.5 +SitStand,0.5 Skoda,0.5 +SongFamiliarity,0.5 SpokenArabicDigits,0.5 StandWalkJump,0.5 TactileTextureRecognition,0.5 Tiselac,0.5 +UCDHE-MP,0.5 +UCDHE-MP-MC,0.5 +UCDHE-Rowing,0.5 UCDHE-Rowing-MC,0.5 UCIActivity,0.5 UIPRMD-DS-C,0.5 +UIPRMD-HS-C,0.5 +UIPRMD-IL-C,0.5 +UIPRMD-SASLR-C,0.5 +UIPRMD-SL-C,0.5 +UIPRMD-SSA-C,0.5 +UIPRMD-SSE-C,0.5 +UIPRMD-SSIER-C,0.5 +UIPRMD-SSS-C,0.5 +UIPRMD-STS-C,0.5 USCActivity,0.5 UWaveGestureLibrary,0.5 +VisualSpeech,0.5 WISDM,0.5 +WISDM2,0.5 diff --git a/results/multiverse/Dummy/Dummy_balacc.csv b/results/multiverse/Dummy/Dummy_balacc.csv index 3082d5f..03cdd2b 100644 --- a/results/multiverse/Dummy/Dummy_balacc.csv +++ b/results/multiverse/Dummy/Dummy_balacc.csv @@ -3,18 +3,22 @@ Alzheimers,0.3333333333333333 AppliancesEnergy_disc,0.5 ArticularyWordRecognition,0.04 AsphaltObstaclesCoordinates,0.25 +AsphaltPavementTypeCoordinates,0.3333333333333333 AsphaltRegularityCoordinates,0.5 AtrialFibrillation,0.3333333333333333 AustraliaRainfall_disc,0.25 AutomotiveRoadTrials,0.5 BIDMC32HR_disc,0.3333333333333333 +BIDMC32RR_disc,0.3333333333333333 BIDMC32SpO2_disc,0.5 +BasicMotions,0.25 BeijingPM10Quality_disc,0.5 BeijingPM25Quality_disc,0.5 BenzeneConcentration_disc,0.5 Blink,0.5 BoneIntensitiesAgeGroup,0.3333333333333333 BoneProbAgeGroup,0.3333333333333333 +ButtonPress,0.5 CharacterTrajectories,0.05 CounterMovementJump,0.3333333333333333 Cricket,0.08333333333333333 @@ -27,6 +31,9 @@ Epilepsy,0.25 EthanolConcentration,0.25 EyesOpenShut,0.5 FaceDetection,0.5 +FeedbackButton,0.5 +FeetHands,0.5 +FingerMovements,0.5 FordChallenge,0.5 HandMovementDirection,0.25 Handwriting,0.038461538461538464 @@ -34,34 +41,86 @@ Heartbeat,0.5 HouseholdPowerConsumption1_disc,0.3333333333333333 HouseholdPowerConsumption2_disc,0.3333333333333333 IEEEPPG_disc,0.3333333333333333 +IRDS-EFL,0.5 +IRDS-EFR,0.5 +IRDS-SAL,0.5 +IRDS-SAR,0.5 +IRDS-SFE,0.5 IRDS-SFL,0.5 +IRDS-SFR,0.5 +IRDS-STL,0.5 +IRDS-STR,0.5 +ImaginedFeetHands,0.5 +ImaginedOpenCloseFist,0.5 +InnerSpeech,0.25 JapaneseVowels,0.1111111111111111 +KERAAL-CTK,0.5 +KERAAL-CTK-MC,0.3333333333333333 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.5 KERAAL-RTK,0.5 +KERAAL-RTK-MC,0.3333333333333333 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.5 KIMORE-PR-C,0.5 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.5 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.5 LSST,0.07142857142857142 Libras,0.06666666666666667 +LiveFuelMoistureContent_disc,0.5 Locust2022,0.5 +LongIntervalTask,0.5 LowCost,0.5 +MatchingPennies,0.5 MindReading,0.2 MotionSenseHAR,0.16666666666666666 MotorImagery,0.5 NATOPS,0.16666666666666666 +NewsHeadlineSentiment_disc,0.3333333333333333 +NewsTitleSentiment_disc,0.3333333333333333 +OpenCloseFist,0.5 +Opportunity,0.2 +PAMAP2,0.08333333333333333 PEMS-SF,0.14285714285714285 +PPGDalia_disc,0.3333333333333333 PenDigits,0.1 PhonemeSpectra,0.02564102564102564 PhotoStimulation,0.3333333333333333 +PronouncedSpeech,0.25 RacketSports,0.25 +SPHERE-WUS,0.5 STEW,0.5 SelfRegulationSCP1,0.5 +SelfRegulationSCP2,0.5 +ShortIntervalTask,0.5 +SitStand,0.25 Skoda,0.09090909090909091 +SongFamiliarity,0.5 SpokenArabicDigits,0.1 StandWalkJump,0.3333333333333333 TactileTextureRecognition,0.047619047619047616 Tiselac,0.1111111111111111 +UCDHE-MP,0.5 +UCDHE-MP-MC,0.25 +UCDHE-Rowing,0.5 UCDHE-Rowing-MC,0.2 UCIActivity,0.16666666666666666 UIPRMD-DS-C,0.5 +UIPRMD-HS-C,0.5 +UIPRMD-IL-C,0.5 +UIPRMD-SASLR-C,0.5 +UIPRMD-SL-C,0.5 +UIPRMD-SSA-C,0.5 +UIPRMD-SSE-C,0.5 +UIPRMD-SSIER-C,0.5 +UIPRMD-SSS-C,0.5 +UIPRMD-STS-C,0.5 USCActivity,0.08333333333333333 UWaveGestureLibrary,0.125 +VisualSpeech,0.25 WISDM,0.16666666666666666 +WISDM2,0.16666666666666666 diff --git a/results/multiverse/Dummy/Dummy_f1.csv b/results/multiverse/Dummy/Dummy_f1.csv index 0a74ec4..d6a8b3b 100644 --- a/results/multiverse/Dummy/Dummy_f1.csv +++ b/results/multiverse/Dummy/Dummy_f1.csv @@ -3,18 +3,22 @@ Alzheimers,0.24704536789935186 AppliancesEnergy_disc,0.0 ArticularyWordRecognition,0.003076923076923077 AsphaltObstaclesCoordinates,0.12554386036416992 +AsphaltPavementTypeCoordinates,0.21535022354694486 AsphaltRegularityCoordinates,0.0 AtrialFibrillation,0.16666666666666666 AustraliaRainfall_disc,0.5582243592880402 AutomotiveRoadTrials,0.0 BIDMC32HR_disc,0.5129917347716432 +BIDMC32RR_disc,0.702938685728719 BIDMC32SpO2_disc,0.0 +BasicMotions,0.1 BeijingPM10Quality_disc,0.0 BeijingPM25Quality_disc,0.0 BenzeneConcentration_disc,0.0 Blink,0.6153846153846154 BoneIntensitiesAgeGroup,0.307451302310468 BoneProbAgeGroup,0.307451302310468 +ButtonPress,0.6127167630057804 CharacterTrajectories,0.007878326358917932 CounterMovementJump,0.16829901124330893 Cricket,0.012820512820512822 @@ -27,6 +31,9 @@ Epilepsy,0.11337474120082816 EthanolConcentration,0.10068533521328603 EyesOpenShut,0.6666666666666666 FaceDetection,0.6666666666666666 +FeedbackButton,0.6666666666666666 +FeetHands,0.0 +FingerMovements,0.6577181208053692 FordChallenge,0.0 HandMovementDirection,0.06832675372001214 Handwriting,0.0027317593704148328 @@ -34,34 +41,86 @@ Heartbeat,0.0 HouseholdPowerConsumption1_disc,0.6814414758877789 HouseholdPowerConsumption2_disc,0.6048760377502882 IEEEPPG_disc,0.10770321429085518 +IRDS-EFL,0.0 +IRDS-EFR,0.0 +IRDS-SAL,0.0 +IRDS-SAR,0.21621621621621623 +IRDS-SFE,0.0 IRDS-SFL,0.34285714285714286 +IRDS-SFR,0.0 +IRDS-STL,0.0 +IRDS-STR,0.0 +ImaginedFeetHands,0.0 +ImaginedOpenCloseFist,0.666196189131969 +InnerSpeech,0.08943319838056679 JapaneseVowels,0.01295410123340298 +KERAAL-CTK,0.0 +KERAAL-CTK-MC,0.3333333333333333 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.8941798941798941 KERAAL-RTK,0.0 +KERAAL-RTK-MC,0.21367521367521367 +KIMORE-LA-C,0.6 +KIMORE-LT-C,0.6 KIMORE-PR-C,0.25 +KIMORE-Sq-C,0.4444444444444444 +KIMORE-TR-C,0.25 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.15098437735628223 Libras,0.008333333333333333 +LiveFuelMoistureContent_disc,0.0 Locust2022,0.0 +LongIntervalTask,0.0 LowCost,0.6666666666666666 +MatchingPennies,0.6641221374045801 MindReading,0.08685896703313449 MotionSenseHAR,0.06898917608091322 MotorImagery,0.6666666666666666 NATOPS,0.047619047619047616 +NewsHeadlineSentiment_disc,0.39191219875175665 +NewsTitleSentiment_disc,0.4806011583799408 +OpenCloseFist,0.0 +Opportunity,0.3147086605854521 +PAMAP2,0.021367799739038986 PEMS-SF,0.023959986822007246 +PPGDalia_disc,0.38359581086749633 PenDigits,0.01951298177713272 PhonemeSpectra,0.0012828065503959901 PhotoStimulation,0.2450980392156863 +PronouncedSpeech,0.08601626016260162 RacketSports,0.1247638326585695 +SPHERE-WUS,0.0 STEW,0.6666666666666666 SelfRegulationSCP1,0.0 +SelfRegulationSCP2,0.6666666666666666 +ShortIntervalTask,0.0 +SitStand,0.1 Skoda,0.0898367557288512 +SongFamiliarity,0.0 SpokenArabicDigits,0.018197606074842165 StandWalkJump,0.16666666666666666 TactileTextureRecognition,0.005024651555796192 Tiselac,0.007419469747086662 +UCDHE-MP,0.0 +UCDHE-MP-MC,0.10300094920534476 +UCDHE-Rowing,0.0 UCDHE-Rowing-MC,0.06946826758147512 UCIActivity,0.06160779158049171 UIPRMD-DS-C,0.6666666666666666 +UIPRMD-HS-C,0.6666666666666666 +UIPRMD-IL-C,0.6666666666666666 +UIPRMD-SASLR-C,0.6666666666666666 +UIPRMD-SL-C,0.6666666666666666 +UIPRMD-SSA-C,0.6666666666666666 +UIPRMD-SSE-C,0.6666666666666666 +UIPRMD-SSIER-C,0.6666666666666666 +UIPRMD-SSS-C,0.6666666666666666 +UIPRMD-STS-C,0.6666666666666666 USCActivity,0.023268701669571575 UWaveGestureLibrary,0.02777777777777778 +VisualSpeech,0.10730158730158729 WISDM,0.19652664355821448 +WISDM2,0.18148148148148147 diff --git a/results/multiverse/Dummy/Dummy_logloss.csv b/results/multiverse/Dummy/Dummy_logloss.csv index a5fdd2a..9c989e5 100644 --- a/results/multiverse/Dummy/Dummy_logloss.csv +++ b/results/multiverse/Dummy/Dummy_logloss.csv @@ -3,18 +3,22 @@ Alzheimers,1.0793748710440425 AppliancesEnergy_disc,0.5330692137407785 ArticularyWordRecognition,3.2188758248681997 AsphaltObstaclesCoordinates,1.378655998837593 +AsphaltPavementTypeCoordinates,1.0818524740867625 AsphaltRegularityCoordinates,0.6930399074106954 AtrialFibrillation,1.0986122886681096 AustraliaRainfall_disc,0.7434253116130451 AutomotiveRoadTrials,0.5628426772650879 BIDMC32HR_disc,0.890983928038467 +BIDMC32RR_disc,0.6421668970214294 BIDMC32SpO2_disc,0.627908679389224 +BasicMotions,1.3862943611198906 BeijingPM10Quality_disc,0.6207489774474368 BeijingPM25Quality_disc,0.6222511679204479 BenzeneConcentration_disc,0.6285886951716353 Blink,0.6931471805599453 BoneIntensitiesAgeGroup,1.0409813584196406 BoneProbAgeGroup,1.0409813584196406 +ButtonPress,0.713672850817768 CharacterTrajectories,2.9873893422378415 CounterMovementJump,1.0986313429481223 Cricket,2.4849066497880004 @@ -27,6 +31,9 @@ Epilepsy,1.3828335143967734 EthanolConcentration,1.3863017565881517 EyesOpenShut,0.7093508020373342 FaceDetection,0.6931471805599453 +FeedbackButton,0.6931471805599453 +FeetHands,0.6931143953271881 +FingerMovements,0.6932937937713612 FordChallenge,0.6629213113350118 HandMovementDirection,1.3862943611198908 Handwriting,3.3370733269684636 @@ -34,34 +41,86 @@ Heartbeat,0.5911056274548393 HouseholdPowerConsumption1_disc,0.7077100456496509 HouseholdPowerConsumption2_disc,0.7896685020004609 IEEEPPG_disc,1.3788063101787866 +IRDS-EFL,0.9912955536827842 +IRDS-EFR,0.7612862896379227 +IRDS-SAL,0.599790349280542 +IRDS-SAR,2.8060450703463737 +IRDS-SFE,0.7380172229437107 IRDS-SFL,1.2745459708197528 +IRDS-SFR,0.5093141508510164 +IRDS-STL,0.7570872031750574 +IRDS-STR,0.29463965020934135 +ImaginedFeetHands,0.6931478243680321 +ImaginedOpenCloseFist,0.6932899710021728 +InnerSpeech,1.3922348857254991 JapaneseVowels,2.197224577336219 +KERAAL-CTK,0.7266593439339404 +KERAAL-CTK-MC,1.191181400090801 +KERAAL-ELK,0.5056325306998877 +KERAAL-ELK-MC,1.0006239172112033 KERAAL-RTK,0.6880703381379805 +KERAAL-RTK-MC,1.2385092709926857 +KIMORE-LA-C,1.491688228866306 +KIMORE-LT-C,0.8663957660665371 KIMORE-PR-C,1.0505140440393566 +KIMORE-Sq-C,1.156121274940731 +KIMORE-TR-C,1.913381345907325 +KINECAL-3WFV,0.28931441215261694 +KINECAL-GGFV,0.27491925815268553 +KINECAL-QSEC,0.2146132851891638 KINECAL-QSEO,0.22371807606583374 LSST,2.1321750076663113 Libras,2.70805020110221 +LiveFuelMoistureContent_disc,0.43812361168597996 Locust2022,0.2997872434658028 +LongIntervalTask,0.627975825010641 LowCost,0.6931471805599453 +MatchingPennies,0.6931961607737579 MindReading,1.6020619001366545 MotionSenseHAR,1.6084672799880668 MotorImagery,0.6931471805599453 NATOPS,1.7917594692280547 +NewsHeadlineSentiment_disc,0.9852558596285024 +NewsTitleSentiment_disc,0.9208183857774593 +OpenCloseFist,0.6931506021749693 +Opportunity,1.3375233093895258 +PAMAP2,2.4217512676783968 PEMS-SF,1.9667612445891107 +PPGDalia_disc,0.9704172476238329 PenDigits,2.3017848079087133 PhonemeSpectra,3.6635616461296454 PhotoStimulation,1.0833754191909117 +PronouncedSpeech,1.3893835552665177 RacketSports,1.3817041078077663 +SPHERE-WUS,0.7465166183739191 STEW,0.6931471805599454 SelfRegulationSCP1,0.6931495567879038 +SelfRegulationSCP2,0.6931471805599454 +ShortIntervalTask,0.658957306420971 +SitStand,1.3862943611198904 Skoda,2.2728650106654227 +SongFamiliarity,0.6961417005152436 SpokenArabicDigits,2.3025845758279044 StandWalkJump,1.0986122886681096 TactileTextureRecognition,3.042344635986728 Tiselac,1.9353430848262698 +UCDHE-MP,0.5906304845752604 +UCDHE-MP-MC,1.3857237087306018 +UCDHE-Rowing,0.5066445602183811 UCDHE-Rowing-MC,1.6075189931881748 UCIActivity,1.7854706911346974 UIPRMD-DS-C,0.6931471805599451 +UIPRMD-HS-C,0.6931471805599453 +UIPRMD-IL-C,0.6931471805599453 +UIPRMD-SASLR-C,0.6931471805599453 +UIPRMD-SL-C,0.6931471805599453 +UIPRMD-SSA-C,0.6931471805599453 +UIPRMD-SSE-C,0.6931471805599453 +UIPRMD-SSIER-C,0.6931471805599453 +UIPRMD-SSS-C,0.6931471805599453 +UIPRMD-STS-C,0.6931471805599451 USCActivity,2.4409565814084937 UWaveGestureLibrary,2.0794415416798353 +VisualSpeech,1.3862718643686707 WISDM,1.4052499584631981 +WISDM2,1.6831032978689577 diff --git a/results/multiverse/Dummy/Dummy_sensitivity.csv b/results/multiverse/Dummy/Dummy_sensitivity.csv index 89c3303..a808323 100644 --- a/results/multiverse/Dummy/Dummy_sensitivity.csv +++ b/results/multiverse/Dummy/Dummy_sensitivity.csv @@ -3,18 +3,22 @@ Alzheimers,0.4186046511627907 AppliancesEnergy_disc,0.0 ArticularyWordRecognition,0.04 AsphaltObstaclesCoordinates,0.28388746803069054 +AsphaltPavementTypeCoordinates,0.38636363636363635 AsphaltRegularityCoordinates,0.0 AtrialFibrillation,0.3333333333333333 AustraliaRainfall_disc,0.6859882281982488 AutomotiveRoadTrials,0.0 BIDMC32HR_disc,0.6506877865777407 +BIDMC32RR_disc,0.7940808670279283 BIDMC32SpO2_disc,0.0 +BasicMotions,0.25 BeijingPM10Quality_disc,0.0 BeijingPM25Quality_disc,0.0 BenzeneConcentration_disc,0.0 Blink,1.0 BoneIntensitiesAgeGroup,0.4764044943820225 BoneProbAgeGroup,0.4764044943820225 +ButtonPress,1.0 CharacterTrajectories,0.06476323119777158 CounterMovementJump,0.33519553072625696 Cricket,0.08333333333333333 @@ -27,6 +31,9 @@ Epilepsy,0.26811594202898553 EthanolConcentration,0.2509505703422053 EyesOpenShut,1.0 FaceDetection,1.0 +FeedbackButton,1.0 +FeetHands,0.0 +FingerMovements,1.0 FordChallenge,0.0 HandMovementDirection,0.20270270270270271 Handwriting,0.03764705882352941 @@ -34,34 +41,86 @@ Heartbeat,0.0 HouseholdPowerConsumption1_disc,0.7784256559766763 HouseholdPowerConsumption2_disc,0.7215743440233237 IEEEPPG_disc,0.2605421686746988 +IRDS-EFL,0.0 +IRDS-EFR,0.0 +IRDS-SAL,0.0 +IRDS-SAR,1.0 +IRDS-SFE,0.0 IRDS-SFL,1.0 +IRDS-SFR,0.0 +IRDS-STL,0.0 +IRDS-STR,0.0 +ImaginedFeetHands,0.0 +ImaginedOpenCloseFist,1.0 +InnerSpeech,0.235 JapaneseVowels,0.08378378378378379 +KERAAL-CTK,0.0 +KERAAL-CTK-MC,0.5 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.0 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,1.0 +KIMORE-LT-C,1.0 KIMORE-PR-C,1.0 +KIMORE-Sq-C,1.0 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.3150851581508516 Libras,0.06666666666666667 +LiveFuelMoistureContent_disc,0.0 Locust2022,0.0 +LongIntervalTask,0.0 LowCost,1.0 +MatchingPennies,1.0 MindReading,0.23124042879019907 MotionSenseHAR,0.2037735849056604 MotorImagery,1.0 NATOPS,0.16666666666666666 +NewsHeadlineSentiment_disc,0.551360666907138 +NewsTitleSentiment_disc,0.6248647348803655 +OpenCloseFist,0.0 +Opportunity,0.48308342945021143 +PAMAP2,0.10884284992420415 PEMS-SF,0.11560693641618497 +PPGDalia_disc,0.5442230704776092 PenDigits,0.10377358490566038 PhonemeSpectra,0.025648672830301224 PhotoStimulation,0.4166666666666667 +PronouncedSpeech,0.23 RacketSports,0.28289473684210525 +SPHERE-WUS,0.0 STEW,1.0 SelfRegulationSCP1,0.0 +SelfRegulationSCP2,1.0 +ShortIntervalTask,0.0 +SitStand,0.25 Skoda,0.23558542624690484 +SongFamiliarity,0.0 SpokenArabicDigits,0.10004547521600728 StandWalkJump,0.3333333333333333 TactileTextureRecognition,0.0513950073421439 Tiselac,0.06279069767441861 +UCDHE-MP,0.0 +UCDHE-MP-MC,0.2541436464088398 +UCDHE-Rowing,0.0 UCDHE-Rowing-MC,0.20454545454545456 UCIActivity,0.19158683881715952 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,1.0 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,1.0 USCActivity,0.11383657351154314 UWaveGestureLibrary,0.125 +VisualSpeech,0.26 WISDM,0.36642843345566933 +WISDM2,0.35 diff --git a/results/multiverse/Dummy/Dummy_specificity.csv b/results/multiverse/Dummy/Dummy_specificity.csv index 7cd6f79..77e8b39 100644 --- a/results/multiverse/Dummy/Dummy_specificity.csv +++ b/results/multiverse/Dummy/Dummy_specificity.csv @@ -3,18 +3,22 @@ Alzheimers,0.4186046511627907 AppliancesEnergy_disc,1.0 ArticularyWordRecognition,0.04 AsphaltObstaclesCoordinates,0.28388746803069054 +AsphaltPavementTypeCoordinates,0.38636363636363635 AsphaltRegularityCoordinates,1.0 AtrialFibrillation,0.3333333333333333 AustraliaRainfall_disc,0.6859882281982488 AutomotiveRoadTrials,1.0 BIDMC32HR_disc,0.6506877865777407 +BIDMC32RR_disc,0.7940808670279283 BIDMC32SpO2_disc,1.0 +BasicMotions,0.25 BeijingPM10Quality_disc,1.0 BeijingPM25Quality_disc,1.0 BenzeneConcentration_disc,1.0 Blink,0.0 BoneIntensitiesAgeGroup,0.4764044943820225 BoneProbAgeGroup,0.4764044943820225 +ButtonPress,0.0 CharacterTrajectories,0.06476323119777158 CounterMovementJump,0.33519553072625696 Cricket,0.08333333333333333 @@ -27,6 +31,9 @@ Epilepsy,0.26811594202898553 EthanolConcentration,0.2509505703422053 EyesOpenShut,0.0 FaceDetection,0.0 +FeedbackButton,0.0 +FeetHands,1.0 +FingerMovements,0.0 FordChallenge,1.0 HandMovementDirection,0.20270270270270271 Handwriting,0.03764705882352941 @@ -34,34 +41,86 @@ Heartbeat,1.0 HouseholdPowerConsumption1_disc,0.7784256559766763 HouseholdPowerConsumption2_disc,0.7215743440233237 IEEEPPG_disc,0.2605421686746988 +IRDS-EFL,1.0 +IRDS-EFR,1.0 +IRDS-SAL,1.0 +IRDS-SAR,0.0 +IRDS-SFE,1.0 IRDS-SFL,0.0 +IRDS-SFR,1.0 +IRDS-STL,1.0 +IRDS-STR,1.0 +ImaginedFeetHands,1.0 +ImaginedOpenCloseFist,0.0 +InnerSpeech,0.235 JapaneseVowels,0.08378378378378379 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.5 +KERAAL-ELK,1.0 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,1.0 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,0.0 +KIMORE-LT-C,0.0 KIMORE-PR-C,0.0 +KIMORE-Sq-C,0.0 +KIMORE-TR-C,0.0 +KINECAL-3WFV,1.0 +KINECAL-GGFV,1.0 +KINECAL-QSEC,1.0 KINECAL-QSEO,1.0 LSST,0.3150851581508516 Libras,0.06666666666666667 +LiveFuelMoistureContent_disc,1.0 Locust2022,1.0 +LongIntervalTask,1.0 LowCost,0.0 +MatchingPennies,0.0 MindReading,0.23124042879019907 MotionSenseHAR,0.2037735849056604 MotorImagery,0.0 NATOPS,0.16666666666666666 +NewsHeadlineSentiment_disc,0.551360666907138 +NewsTitleSentiment_disc,0.6248647348803655 +OpenCloseFist,1.0 +Opportunity,0.48308342945021143 +PAMAP2,0.10884284992420415 PEMS-SF,0.11560693641618497 +PPGDalia_disc,0.5442230704776092 PenDigits,0.10377358490566038 PhonemeSpectra,0.025648672830301224 PhotoStimulation,0.4166666666666667 +PronouncedSpeech,0.23 RacketSports,0.28289473684210525 +SPHERE-WUS,1.0 STEW,0.0 SelfRegulationSCP1,1.0 +SelfRegulationSCP2,0.0 +ShortIntervalTask,1.0 +SitStand,0.25 Skoda,0.23558542624690484 +SongFamiliarity,1.0 SpokenArabicDigits,0.10004547521600728 StandWalkJump,0.3333333333333333 TactileTextureRecognition,0.0513950073421439 Tiselac,0.06279069767441861 +UCDHE-MP,1.0 +UCDHE-MP-MC,0.2541436464088398 +UCDHE-Rowing,1.0 UCDHE-Rowing-MC,0.20454545454545456 UCIActivity,0.19158683881715952 UIPRMD-DS-C,0.0 +UIPRMD-HS-C,0.0 +UIPRMD-IL-C,0.0 +UIPRMD-SASLR-C,0.0 +UIPRMD-SL-C,0.0 +UIPRMD-SSA-C,0.0 +UIPRMD-SSE-C,0.0 +UIPRMD-SSIER-C,0.0 +UIPRMD-SSS-C,0.0 +UIPRMD-STS-C,0.0 USCActivity,0.11383657351154314 UWaveGestureLibrary,0.125 +VisualSpeech,0.26 WISDM,0.36642843345566933 +WISDM2,0.35 diff --git a/results/multiverse/FreshPRINCE/FreshPRINCE_accuracy.csv b/results/multiverse/FreshPRINCE/FreshPRINCE_accuracy.csv index cccdb3a..034b84c 100644 --- a/results/multiverse/FreshPRINCE/FreshPRINCE_accuracy.csv +++ b/results/multiverse/FreshPRINCE/FreshPRINCE_accuracy.csv @@ -3,18 +3,22 @@ Alzheimers,0.4418604651162791 AppliancesEnergy_disc,0.9523809523809523 ArticularyWordRecognition,0.9633333333333334 AsphaltObstaclesCoordinates,0.8414322250639387 +AsphaltPavementTypeCoordinates,0.9460227272727273 AsphaltRegularityCoordinates,0.9906790945406125 AtrialFibrillation,0.3333333333333333 AustraliaRainfall_disc,0.7761485826001955 AutomotiveRoadTrials,0.8311688311688312 BIDMC32HR_disc,0.7423926636098375 +BIDMC32RR_disc,0.6781992496873698 BIDMC32SpO2_disc,0.6777824093372239 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8417194928684627 BeijingPM25Quality_disc,0.8847068145800316 BenzeneConcentration_disc,0.8599651365485182 Blink,0.9977777777777778 BoneIntensitiesAgeGroup,0.7842696629213484 BoneProbAgeGroup,0.6539325842696629 +ButtonPress,1.0 CharacterTrajectories,0.9902506963788301 CounterMovementJump,0.8324022346368715 Cricket,0.9583333333333334 @@ -26,38 +30,88 @@ EmoPain,0.8647887323943662 Epilepsy,0.9420289855072463 EthanolConcentration,0.39923954372623577 EyesOpenShut,0.4523809523809524 +FeedbackButton,0.52 +FeetHands,0.6576719576719576 +FingerMovements,0.54 HandMovementDirection,0.4189189189189189 Handwriting,0.3552941176470588 Heartbeat,0.7658536585365854 HouseholdPowerConsumption1_disc,0.9825072886297376 HouseholdPowerConsumption2_disc,0.7696793002915452 IEEEPPG_disc,0.28990963855421686 +IRDS-EFL,0.8846153846153846 +IRDS-EFR,0.6666666666666666 +IRDS-SAL,0.375 +IRDS-SAR,0.24242424242424243 +IRDS-SFE,0.8666666666666667 IRDS-SFL,0.8103448275862069 +IRDS-SFR,0.4 +IRDS-STL,0.8421052631578947 +IRDS-STR,0.9666666666666667 +ImaginedFeetHands,0.6490956072351421 +ImaginedOpenCloseFist,0.708994708994709 +InnerSpeech,0.23 JapaneseVowels,0.9594594594594594 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,0.8 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.7857142857142857 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,0.42857142857142855 +KIMORE-LT-C,0.7142857142857143 KIMORE-PR-C,0.2857142857142857 +KIMORE-Sq-C,0.2857142857142857 +KIMORE-TR-C,0.14285714285714285 +KINECAL-3WFV,0.9166666666666666 +KINECAL-GGFV,0.9230769230769231 +KINECAL-QSEC,0.9444444444444444 KINECAL-QSEO,0.8823529411764706 LSST,0.7039740470397404 Libras,0.8944444444444445 +LiveFuelMoistureContent_disc,0.8324503311258278 Locust2022,0.9090633525310701 LowCost,0.6433333333333333 MindReading,0.6079632465543645 MotionSenseHAR,0.9849056603773585 MotorImagery,0.6 NATOPS,0.9166666666666666 +NewsHeadlineSentiment_disc,0.5349685383351369 +NewsTitleSentiment_disc,0.6119193619494209 +OpenCloseFist,0.7195767195767195 PEMS-SF,0.9884393063583815 +PPGDalia_disc,0.7529559631319244 PenDigits,0.9699828473413379 PhonemeSpectra,0.3265732180137191 PhotoStimulation,0.4444444444444444 +PronouncedSpeech,0.265 RacketSports,0.881578947368421 +SPHERE-WUS,1.0 STEW,0.7268518518518519 SelfRegulationSCP1,0.9215017064846417 +SelfRegulationSCP2,0.5666666666666667 +SitStand,0.4178125 +SongFamiliarity,0.512 SpokenArabicDigits,0.979081400636653 StandWalkJump,0.4666666666666667 TactileTextureRecognition,0.9970631424375918 +UCDHE-MP,0.8425414364640884 +UCDHE-MP-MC,0.7430939226519337 +UCDHE-Rowing,0.8318181818181818 UCDHE-Rowing-MC,0.8204545454545454 UCIActivity,0.9762598917117867 UIPRMD-DS-C,0.9722222222222222 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.8888888888888888 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.6666666666666666 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.7 +UIPRMD-SSS-C,0.8333333333333334 +UIPRMD-STS-C,0.9722222222222222 USCActivity,0.6985115431348724 UWaveGestureLibrary,0.859375 +VisualSpeech,0.27 WISDM,0.8817848174618504 +WISDM2,0.6635060855908912 diff --git a/results/multiverse/FreshPRINCE/FreshPRINCE_auroc.csv b/results/multiverse/FreshPRINCE/FreshPRINCE_auroc.csv index 9a16a44..9cf4988 100644 --- a/results/multiverse/FreshPRINCE/FreshPRINCE_auroc.csv +++ b/results/multiverse/FreshPRINCE/FreshPRINCE_auroc.csv @@ -3,18 +3,22 @@ Alzheimers,0.6134643143544506 AppliancesEnergy_disc,0.9117647058823529 ArticularyWordRecognition,0.997517361111111 AsphaltObstaclesCoordinates,0.9641991486098768 +AsphaltPavementTypeCoordinates,0.9927064605933372 AsphaltRegularityCoordinates,0.9996665957295878 AtrialFibrillation,0.38333333333333336 AustraliaRainfall_disc,0.859133270314598 AutomotiveRoadTrials,0.8933756805807623 BIDMC32HR_disc,0.899928616650157 +BIDMC32RR_disc,0.49053274250917683 BIDMC32SpO2_disc,0.389705280078633 +BasicMotions,1.0 BeijingPM10Quality_disc,0.9040606814386861 BeijingPM25Quality_disc,0.9437994318431309 BenzeneConcentration_disc,0.9399124970506889 Blink,1.0 BoneIntensitiesAgeGroup,0.9193084138235483 BoneProbAgeGroup,0.8150397346773443 +ButtonPress,1.0 CharacterTrajectories,0.9999408399801764 CounterMovementJump,0.9745395364849851 Cricket,0.9997895622895623 @@ -26,38 +30,88 @@ EmoPain,0.9478931206189152 Epilepsy,0.9972370773866683 EthanolConcentration,0.6908051486278118 EyesOpenShut,0.528344671201814 +FeedbackButton,0.5241965973534972 +FeetHands,0.7203612475796816 +FingerMovements,0.6008403361344538 HandMovementDirection,0.6629547883785172 Handwriting,0.8334302441406981 Heartbeat,0.748814604077762 HouseholdPowerConsumption1_disc,0.9956921278419449 HouseholdPowerConsumption2_disc,0.8194612063412757 IEEEPPG_disc,0.644293052441264 +IRDS-EFL,1.0 +IRDS-EFR,1.0 +IRDS-SAL,0.45918367346938777 +IRDS-SAR,0.9137931034482758 +IRDS-SFE,1.0 IRDS-SFL,0.920516304347826 +IRDS-SFR,0.6153846153846154 +IRDS-STL,0.8535353535353536 +IRDS-STR,0.8690909090909091 +ImaginedFeetHands,0.709233742425667 +ImaginedOpenCloseFist,0.7874105287203927 +InnerSpeech,0.5103163308906882 JapaneseVowels,0.9984274174535788 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9107142857142857 +KERAAL-ELK,0.4375 +KERAAL-ELK-MC,0.7747252747252747 KERAAL-RTK,0.9375 +KERAAL-RTK-MC,0.5673076923076923 +KIMORE-LA-C,0.9166666666666666 +KIMORE-LT-C,0.6666666666666666 KIMORE-PR-C,0.5 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,0.8333333333333334 +KINECAL-3WFV,0.8181818181818182 +KINECAL-GGFV,0.9166666666666666 +KINECAL-QSEC,0.7058823529411764 KINECAL-QSEO,0.625 LSST,0.9312983851241199 Libras,0.9975363756613757 +LiveFuelMoistureContent_disc,0.5077477034120735 Locust2022,0.8401428088078677 LowCost,0.6782 MindReading,0.8834916124179638 MotionSenseHAR,1.0 MotorImagery,0.656 NATOPS,0.9917592592592592 +NewsHeadlineSentiment_disc,0.5016046165692053 +NewsTitleSentiment_disc,0.5049198784045936 +OpenCloseFist,0.7937994947504211 PEMS-SF,0.9997624515005147 +PPGDalia_disc,0.8644025198136283 PenDigits,0.9992030350416714 PhonemeSpectra,0.9047623871844567 PhotoStimulation,0.5147425722425722 +PronouncedSpeech,0.5078527612420229 RacketSports,0.9706423863411834 +SPHERE-WUS,1.0 STEW,0.8239822782003852 SelfRegulationSCP1,0.9787531450936537 +SelfRegulationSCP2,0.5328395061728395 +SitStand,0.7138272786458333 +SongFamiliarity,0.5292674590006338 SpokenArabicDigits,0.9994668124869653 StandWalkJump,0.6433333333333333 TactileTextureRecognition,0.9999954678016102 +UCDHE-MP,0.8973282442748092 +UCDHE-MP-MC,0.9222600444263379 +UCDHE-Rowing,0.9018095238095238 UCDHE-Rowing-MC,0.9717915624275918 UCIActivity,0.9996439815989135 UIPRMD-DS-C,0.970679012345679 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.95679012345679 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.8518518518518519 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,0.9876543209876543 +UIPRMD-STS-C,0.9830246913580247 USCActivity,0.9682207749743995 UWaveGestureLibrary,0.9856305803571429 +VisualSpeech,0.5056600407939736 WISDM,0.9687761289383072 +WISDM2,0.9218148935554391 diff --git a/results/multiverse/FreshPRINCE/FreshPRINCE_balacc.csv b/results/multiverse/FreshPRINCE/FreshPRINCE_balacc.csv index f68aa37..35b61d4 100644 --- a/results/multiverse/FreshPRINCE/FreshPRINCE_balacc.csv +++ b/results/multiverse/FreshPRINCE/FreshPRINCE_balacc.csv @@ -3,18 +3,22 @@ Alzheimers,0.41245791245791247 AppliancesEnergy_disc,0.875 ArticularyWordRecognition,0.9633333333333333 AsphaltObstaclesCoordinates,0.8434258827273682 +AsphaltPavementTypeCoordinates,0.9407586898395722 AsphaltRegularityCoordinates,0.9908136482939632 AtrialFibrillation,0.3333333333333333 AustraliaRainfall_disc,0.38227733308136297 AutomotiveRoadTrials,0.7994555353901995 BIDMC32HR_disc,0.536210594306015 +BIDMC32RR_disc,0.2935807802785714 BIDMC32SpO2_disc,0.5447271737535281 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7921839357153502 BeijingPM25Quality_disc,0.8544278502548668 BenzeneConcentration_disc,0.8004429488413283 Blink,0.998 BoneIntensitiesAgeGroup,0.7923916934001168 BoneProbAgeGroup,0.6896918928172054 +ButtonPress,1.0 CharacterTrajectories,0.9900994383321822 CounterMovementJump,0.8317325800376647 Cricket,0.9583333333333334 @@ -26,38 +30,88 @@ EmoPain,0.627781645651221 Epilepsy,0.9453497615262321 EthanolConcentration,0.3988344988344989 EyesOpenShut,0.4523809523809524 +FeedbackButton,0.52 +FeetHands,0.6582969468991366 +FingerMovements,0.539015606242497 HandMovementDirection,0.38928571428571435 Handwriting,0.35189571335927405 Heartbeat,0.6814248458985301 HouseholdPowerConsumption1_disc,0.9537017962748241 HouseholdPowerConsumption2_disc,0.57292099072921 IEEEPPG_disc,0.3506378380041459 +IRDS-EFL,0.875 +IRDS-EFR,0.5 +IRDS-SAL,0.5119047619047619 +IRDS-SAR,0.5689655172413793 +IRDS-SFE,0.8 IRDS-SFL,0.818840579710145 +IRDS-SFR,0.6538461538461539 +IRDS-STL,0.7542087542087541 +IRDS-STR,0.8 +ImaginedFeetHands,0.6491166126812926 +ImaginedOpenCloseFist,0.7090358153868206 +InnerSpeech,0.23249774541567855 JapaneseVowels,0.9579753437762337 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.6111111111111112 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.5 KERAAL-RTK,0.75 +KERAAL-RTK-MC,0.24761904761904763 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.75 KIMORE-PR-C,0.5833333333333334 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.5 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.46875 LSST,0.4872715770900685 Libras,0.8944444444444444 +LiveFuelMoistureContent_disc,0.49826115485564304 Locust2022,0.6004856044452619 LowCost,0.6433333333333333 MindReading,0.599966965329178 MotionSenseHAR,0.9836984872196141 MotorImagery,0.6 NATOPS,0.9166666666666666 +NewsHeadlineSentiment_disc,0.33411072643479073 +NewsTitleSentiment_disc,0.3329728915480126 +OpenCloseFist,0.719552889955925 PEMS-SF,0.9894179894179894 +PPGDalia_disc,0.6629549174045476 PenDigits,0.9702116071400331 PhonemeSpectra,0.3266231716300116 PhotoStimulation,0.4000000000000001 +PronouncedSpeech,0.2715546921109581 RacketSports,0.8883513289036545 +SPHERE-WUS,1.0 STEW,0.7268518518518519 SelfRegulationSCP1,0.9216522225328487 +SelfRegulationSCP2,0.5666666666666667 +SitStand,0.41781250000000003 +SongFamiliarity,0.5045396606114121 SpokenArabicDigits,0.9790763802407637 StandWalkJump,0.4666666666666666 TactileTextureRecognition,0.997111344537815 +UCDHE-MP,0.7768320610687023 +UCDHE-MP-MC,0.7461080917874396 +UCDHE-Rowing,0.6177777777777778 UCDHE-Rowing-MC,0.8263492063492063 UCIActivity,0.9764579270905829 UIPRMD-DS-C,0.9722222222222222 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.8888888888888888 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.6666666666666667 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.7 +UIPRMD-SSS-C,0.8333333333333333 +UIPRMD-STS-C,0.9722222222222222 USCActivity,0.6915929835555813 UWaveGestureLibrary,0.859375 +VisualSpeech,0.268285679656478 WISDM,0.6958292326170024 +WISDM2,0.5939176678524309 diff --git a/results/multiverse/FreshPRINCE/FreshPRINCE_f1.csv b/results/multiverse/FreshPRINCE/FreshPRINCE_f1.csv index 52c90ea..66425c1 100644 --- a/results/multiverse/FreshPRINCE/FreshPRINCE_f1.csv +++ b/results/multiverse/FreshPRINCE/FreshPRINCE_f1.csv @@ -3,18 +3,22 @@ Alzheimers,0.4267985548423305 AppliancesEnergy_disc,0.8571428571428571 ArticularyWordRecognition,0.9633692104996453 AsphaltObstaclesCoordinates,0.8410426873443633 +AsphaltPavementTypeCoordinates,0.9459694833487055 AsphaltRegularityCoordinates,0.9906291834002677 AtrialFibrillation,0.273015873015873 AustraliaRainfall_disc,0.7568239799205708 AutomotiveRoadTrials,0.6829268292682927 BIDMC32HR_disc,0.7111268015625876 +BIDMC32RR_disc,0.6458414586096896 BIDMC32SpO2_disc,0.29406392694063926 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7112396096855801 BeijingPM25Quality_disc,0.8031123139377537 BenzeneConcentration_disc,0.740394973070018 Blink,0.9975062344139651 BoneIntensitiesAgeGroup,0.783743426557772 BoneProbAgeGroup,0.6569028690377005 +ButtonPress,1.0 CharacterTrajectories,0.9902389136950954 CounterMovementJump,0.8342590428889988 Cricket,0.9574425574425575 @@ -26,38 +30,88 @@ EmoPain,0.8717578017551078 Epilepsy,0.9415901640894073 EthanolConcentration,0.40214472404867646 EyesOpenShut,0.5964912280701754 +FeedbackButton,0.5273972602739726 +FeetHands,0.6795443288756811 +FingerMovements,0.5106382978723404 HandMovementDirection,0.4162416031159079 Handwriting,0.31108619264438264 Heartbeat,0.5384615384615384 HouseholdPowerConsumption1_disc,0.9823351613570775 HouseholdPowerConsumption2_disc,0.740475128456151 IEEEPPG_disc,0.1850284155489884 +IRDS-EFL,0.8571428571428571 +IRDS-EFR,0.0 +IRDS-SAL,0.38596491228070173 +IRDS-SAR,0.24242424242424243 +IRDS-SFE,0.75 IRDS-SFL,0.6451612903225806 +IRDS-SFR,0.3076923076923077 +IRDS-STL,0.6666666666666666 +IRDS-STR,0.75 +ImaginedFeetHands,0.6626924987580726 +ImaginedOpenCloseFist,0.7196738022426096 +InnerSpeech,0.22439747345932914 JapaneseVowels,0.9596326103155193 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.8238095238095238 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.8941798941798941 KERAAL-RTK,0.6666666666666666 +KERAAL-RTK-MC,0.26153846153846155 +KIMORE-LA-C,0.6 +KIMORE-LT-C,0.75 KIMORE-PR-C,0.2857142857142857 +KIMORE-Sq-C,0.4444444444444444 +KIMORE-TR-C,0.25 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.6607437112211156 Libras,0.8939883787709875 +LiveFuelMoistureContent_disc,0.01556420233463035 Locust2022,0.3055555555555556 LowCost,0.608058608058608 MindReading,0.5970241791741518 MotionSenseHAR,0.9849102410563297 MotorImagery,0.5918367346938775 NATOPS,0.9166180420487172 +NewsHeadlineSentiment_disc,0.4101055493484331 +NewsTitleSentiment_disc,0.4846924786671131 +OpenCloseFist,0.7128927410617552 PEMS-SF,0.988431072246101 +PPGDalia_disc,0.7474334706789049 PenDigits,0.9700045854163936 PhonemeSpectra,0.317321725305199 PhotoStimulation,0.3632770937832498 +PronouncedSpeech,0.23810010961712713 RacketSports,0.8797881471655418 +SPHERE-WUS,1.0 STEW,0.702974828375286 SelfRegulationSCP1,0.9245901639344263 +SelfRegulationSCP2,0.5760869565217391 +SitStand,0.4162269632850519 +SongFamiliarity,0.37542662116040953 SpokenArabicDigits,0.9790744090262322 StandWalkJump,0.44696969696969696 TactileTextureRecognition,0.9970631424375918 +UCDHE-MP,0.6885245901639344 +UCDHE-MP-MC,0.7404563112945672 +UCDHE-Rowing,0.38333333333333336 UCDHE-Rowing-MC,0.8218361781336418 UCIActivity,0.9763014255559199 UIPRMD-DS-C,0.972972972972973 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.875 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.7 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.5714285714285714 +UIPRMD-SSS-C,0.8 +UIPRMD-STS-C,0.972972972972973 USCActivity,0.688613383514298 UWaveGestureLibrary,0.8583438504236292 +VisualSpeech,0.2693676840834063 WISDM,0.872869850235684 +WISDM2,0.6427361445201396 diff --git a/results/multiverse/FreshPRINCE/FreshPRINCE_logloss.csv b/results/multiverse/FreshPRINCE/FreshPRINCE_logloss.csv index b5d9553..880b595 100644 --- a/results/multiverse/FreshPRINCE/FreshPRINCE_logloss.csv +++ b/results/multiverse/FreshPRINCE/FreshPRINCE_logloss.csv @@ -3,18 +3,22 @@ Alzheimers,1.0559251127350706 AppliancesEnergy_disc,0.2416737746063608 ArticularyWordRecognition,0.35858825318665793 AsphaltObstaclesCoordinates,0.4365490020021185 +AsphaltPavementTypeCoordinates,0.1799754914870881 AsphaltRegularityCoordinates,0.041400557734548316 AtrialFibrillation,1.2569610495316241 AustraliaRainfall_disc,0.5295008375464622 AutomotiveRoadTrials,0.37019162650540555 BIDMC32HR_disc,0.5213387788641175 +BIDMC32RR_disc,2.856452048268124 BIDMC32SpO2_disc,0.9128946150396606 +BasicMotions,0.09790902306170862 BeijingPM10Quality_disc,0.35069320988334385 BeijingPM25Quality_disc,0.284530225735108 BenzeneConcentration_disc,0.3115100910498902 Blink,0.02096352799588857 BoneIntensitiesAgeGroup,0.5707618753633298 BoneProbAgeGroup,0.761819571517228 +ButtonPress,0.007862642601603801 CharacterTrajectories,0.11016605219389211 CounterMovementJump,0.4029861588685452 Cricket,0.2184831699648586 @@ -26,38 +30,88 @@ EmoPain,0.3659306738786136 Epilepsy,0.13537465302410162 EthanolConcentration,1.218588339406212 EyesOpenShut,0.7121753265952178 +FeedbackButton,0.7103526691753378 +FeetHands,0.6217924616346293 +FingerMovements,0.6841166505144272 HandMovementDirection,1.3005607460856397 Handwriting,3.2907317118340726 Heartbeat,0.5121021111528848 HouseholdPowerConsumption1_disc,0.12227636933455313 HouseholdPowerConsumption2_disc,0.49790237381405666 IEEEPPG_disc,1.338883411394866 +IRDS-EFL,0.2650377345648583 +IRDS-EFR,0.5452275441404221 +IRDS-SAL,1.847008420279079 +IRDS-SAR,1.21616423586587 +IRDS-SFE,0.22047383972360696 IRDS-SFL,0.4887348423816806 +IRDS-SFR,1.4778626707658613 +IRDS-STL,0.47396865226428125 +IRDS-STR,0.1348804853578227 +ImaginedFeetHands,0.625159874608325 +ImaginedOpenCloseFist,0.5551980341688117 +InnerSpeech,1.3988593702424237 JapaneseVowels,0.24887597772024453 +KERAAL-CTK,0.33084082875274723 +KERAAL-CTK-MC,0.6430428554352082 +KERAAL-ELK,0.5961922766093247 +KERAAL-ELK-MC,0.3828399943555067 KERAAL-RTK,0.42292198424764066 +KERAAL-RTK-MC,1.1188008032909846 +KIMORE-LA-C,1.272098717697779 +KIMORE-LT-C,0.7234118600563814 KIMORE-PR-C,0.955517973043066 +KIMORE-Sq-C,1.2850720924511436 +KIMORE-TR-C,1.8128732049129828 +KINECAL-3WFV,0.25111372890394573 +KINECAL-GGFV,0.23670603982526175 +KINECAL-QSEC,0.21163042090741863 KINECAL-QSEO,0.3327536357789172 LSST,0.9904530765357933 Libras,0.3349692775176989 +LiveFuelMoistureContent_disc,0.48205220390680414 Locust2022,0.2542188933812299 LowCost,0.6425052013805674 MindReading,0.9567412281374157 MotionSenseHAR,0.03803533714115383 MotorImagery,0.671613136981982 NATOPS,0.2490893971562753 +NewsHeadlineSentiment_disc,1.0862753091550292 +NewsTitleSentiment_disc,1.0211738494859972 +OpenCloseFist,0.5622514786223879 PEMS-SF,0.1374048576734391 +PPGDalia_disc,0.6663086587178119 PenDigits,0.13010610127339478 PhonemeSpectra,2.7809314265568617 PhotoStimulation,1.1743818229774474 +PronouncedSpeech,1.419506883633463 RacketSports,0.3950737656697965 +SPHERE-WUS,0.18802795616301785 STEW,0.5223301378180555 SelfRegulationSCP1,0.28123217078775403 +SelfRegulationSCP2,0.6983659991771944 +SitStand,1.2336412697931334 +SongFamiliarity,0.7052505422623673 SpokenArabicDigits,0.17818018334447056 StandWalkJump,1.0829620209315876 TactileTextureRecognition,0.07993290243547026 +UCDHE-MP,0.3702863566175751 +UCDHE-MP-MC,0.6586405752196127 +UCDHE-Rowing,0.3552440306643846 UCDHE-Rowing-MC,0.6088574432822539 UCIActivity,0.10326043354925285 UIPRMD-DS-C,0.317068465517268 +UIPRMD-HS-C,0.09277712296374163 +UIPRMD-IL-C,0.5305857440971451 +UIPRMD-SASLR-C,0.25725761136222663 +UIPRMD-SL-C,0.5050493385414314 +UIPRMD-SSA-C,0.11134500034672061 +UIPRMD-SSE-C,0.16663503229452173 +UIPRMD-SSIER-C,0.447384915412786 +UIPRMD-SSS-C,0.3409511126170361 +UIPRMD-STS-C,0.1435272212977114 USCActivity,0.9646409267918323 UWaveGestureLibrary,0.6137278345736125 +VisualSpeech,1.4019608356169275 WISDM,0.9977742404429203 +WISDM2,1.1413586059122454 diff --git a/results/multiverse/FreshPRINCE/FreshPRINCE_sensitivity.csv b/results/multiverse/FreshPRINCE/FreshPRINCE_sensitivity.csv index 89c67e1..0786317 100644 --- a/results/multiverse/FreshPRINCE/FreshPRINCE_sensitivity.csv +++ b/results/multiverse/FreshPRINCE/FreshPRINCE_sensitivity.csv @@ -3,18 +3,22 @@ Alzheimers,0.4418604651162791 AppliancesEnergy_disc,0.75 ArticularyWordRecognition,0.9633333333333334 AsphaltObstaclesCoordinates,0.8414322250639387 +AsphaltPavementTypeCoordinates,0.9460227272727273 AsphaltRegularityCoordinates,1.0 AtrialFibrillation,0.3333333333333333 AustraliaRainfall_disc,0.7761485826001955 AutomotiveRoadTrials,0.7368421052631579 BIDMC32HR_disc,0.7423926636098375 +BIDMC32RR_disc,0.6781992496873698 BIDMC32SpO2_disc,0.23572474377745242 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6748971193415638 BeijingPM25Quality_disc,0.7778505897771952 BenzeneConcentration_disc,0.6435705368289638 Blink,1.0 BoneIntensitiesAgeGroup,0.7842696629213484 BoneProbAgeGroup,0.6539325842696629 +ButtonPress,1.0 CharacterTrajectories,0.9902506963788301 CounterMovementJump,0.8324022346368715 Cricket,0.9583333333333334 @@ -26,38 +30,88 @@ EmoPain,0.8647887323943662 Epilepsy,0.9420289855072463 EthanolConcentration,0.39923954372623577 EyesOpenShut,0.8095238095238095 +FeedbackButton,0.5356521739130434 +FeetHands,0.7321237993596584 +FingerMovements,0.4897959183673469 HandMovementDirection,0.4189189189189189 Handwriting,0.3552941176470588 Heartbeat,0.49122807017543857 HouseholdPowerConsumption1_disc,0.9825072886297376 HouseholdPowerConsumption2_disc,0.7696793002915452 IEEEPPG_disc,0.28990963855421686 +IRDS-EFL,0.75 +IRDS-EFR,0.0 +IRDS-SAL,0.7857142857142857 +IRDS-SAR,1.0 +IRDS-SFE,0.6 IRDS-SFL,0.8333333333333334 +IRDS-SFR,1.0 +IRDS-STL,0.5454545454545454 +IRDS-STR,0.6 +ImaginedFeetHands,0.6897621509824199 +ImaginedOpenCloseFist,0.7478813559322034 +InnerSpeech,0.23 JapaneseVowels,0.9594594594594594 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.5 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,1.0 +KIMORE-LT-C,1.0 KIMORE-PR-C,1.0 +KIMORE-Sq-C,1.0 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.7039740470397404 Libras,0.8944444444444445 +LiveFuelMoistureContent_disc,0.008333333333333333 Locust2022,0.22525597269624573 LowCost,0.5533333333333333 MindReading,0.6079632465543645 MotionSenseHAR,0.9849056603773585 MotorImagery,0.58 NATOPS,0.9166666666666666 +NewsHeadlineSentiment_disc,0.5349685383351369 +NewsTitleSentiment_disc,0.6119193619494209 +OpenCloseFist,0.6970338983050848 PEMS-SF,0.9884393063583815 +PPGDalia_disc,0.7529559631319244 PenDigits,0.9699828473413379 PhonemeSpectra,0.3265732180137191 PhotoStimulation,0.4444444444444444 +PronouncedSpeech,0.265 RacketSports,0.881578947368421 +SPHERE-WUS,1.0 STEW,0.6464646464646465 SelfRegulationSCP1,0.9657534246575342 +SelfRegulationSCP2,0.5888888888888889 +SitStand,0.4178125 +SongFamiliarity,0.3047091412742382 SpokenArabicDigits,0.979081400636653 StandWalkJump,0.4666666666666667 TactileTextureRecognition,0.9970631424375918 +UCDHE-MP,0.63 +UCDHE-MP-MC,0.7430939226519337 +UCDHE-Rowing,0.25555555555555554 UCDHE-Rowing-MC,0.8204545454545454 UCIActivity,0.9762598917117867 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.7777777777777778 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.7777777777777778 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.4 +UIPRMD-SSS-C,0.6666666666666666 +UIPRMD-STS-C,1.0 USCActivity,0.6985115431348724 UWaveGestureLibrary,0.859375 +VisualSpeech,0.27 WISDM,0.8817848174618504 +WISDM2,0.6635060855908912 diff --git a/results/multiverse/FreshPRINCE/FreshPRINCE_specificity.csv b/results/multiverse/FreshPRINCE/FreshPRINCE_specificity.csv index 372673c..e55244e 100644 --- a/results/multiverse/FreshPRINCE/FreshPRINCE_specificity.csv +++ b/results/multiverse/FreshPRINCE/FreshPRINCE_specificity.csv @@ -3,18 +3,22 @@ Alzheimers,0.4418604651162791 AppliancesEnergy_disc,1.0 ArticularyWordRecognition,0.9633333333333334 AsphaltObstaclesCoordinates,0.8414322250639387 +AsphaltPavementTypeCoordinates,0.9460227272727273 AsphaltRegularityCoordinates,0.9816272965879265 AtrialFibrillation,0.3333333333333333 AustraliaRainfall_disc,0.7761485826001955 AutomotiveRoadTrials,0.8620689655172413 BIDMC32HR_disc,0.7423926636098375 +BIDMC32RR_disc,0.6781992496873698 BIDMC32SpO2_disc,0.8537296037296037 +BasicMotions,1.0 BeijingPM10Quality_disc,0.9094707520891365 BeijingPM25Quality_disc,0.9310051107325383 BenzeneConcentration_disc,0.9573153608536927 Blink,0.996 BoneIntensitiesAgeGroup,0.7842696629213484 BoneProbAgeGroup,0.6539325842696629 +ButtonPress,1.0 CharacterTrajectories,0.9902506963788301 CounterMovementJump,0.8324022346368715 Cricket,0.9583333333333334 @@ -26,38 +30,88 @@ EmoPain,0.8647887323943662 Epilepsy,0.9420289855072463 EthanolConcentration,0.39923954372623577 EyesOpenShut,0.09523809523809523 +FeedbackButton,0.5043478260869565 +FeetHands,0.5844700944386149 +FingerMovements,0.5882352941176471 HandMovementDirection,0.4189189189189189 Handwriting,0.3552941176470588 Heartbeat,0.8716216216216216 HouseholdPowerConsumption1_disc,0.9825072886297376 HouseholdPowerConsumption2_disc,0.7696793002915452 IEEEPPG_disc,0.28990963855421686 +IRDS-EFL,1.0 +IRDS-EFR,1.0 +IRDS-SAL,0.23809523809523808 +IRDS-SAR,0.13793103448275862 +IRDS-SFE,1.0 IRDS-SFL,0.8043478260869565 +IRDS-SFR,0.3076923076923077 +IRDS-STL,0.9629629629629629 +IRDS-STR,1.0 +ImaginedFeetHands,0.6084710743801653 +ImaginedOpenCloseFist,0.6701902748414377 +InnerSpeech,0.23 JapaneseVowels,0.9594594594594594 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,1.0 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,1.0 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,0.0 +KIMORE-LT-C,0.5 KIMORE-PR-C,0.16666666666666666 +KIMORE-Sq-C,0.0 +KIMORE-TR-C,0.0 +KINECAL-3WFV,1.0 +KINECAL-GGFV,1.0 +KINECAL-QSEC,1.0 KINECAL-QSEO,0.9375 LSST,0.7039740470397404 Libras,0.8944444444444445 +LiveFuelMoistureContent_disc,0.9881889763779528 Locust2022,0.9757152361942781 LowCost,0.7333333333333333 MindReading,0.6079632465543645 MotionSenseHAR,0.9849056603773585 MotorImagery,0.62 NATOPS,0.9166666666666666 +NewsHeadlineSentiment_disc,0.5349685383351369 +NewsTitleSentiment_disc,0.6119193619494209 +OpenCloseFist,0.7420718816067653 PEMS-SF,0.9884393063583815 +PPGDalia_disc,0.7529559631319244 PenDigits,0.9699828473413379 PhonemeSpectra,0.3265732180137191 PhotoStimulation,0.4444444444444444 +PronouncedSpeech,0.265 RacketSports,0.881578947368421 +SPHERE-WUS,1.0 STEW,0.8072390572390572 SelfRegulationSCP1,0.8775510204081632 +SelfRegulationSCP2,0.5444444444444444 +SitStand,0.4178125 +SongFamiliarity,0.7043701799485861 SpokenArabicDigits,0.979081400636653 StandWalkJump,0.4666666666666667 TactileTextureRecognition,0.9970631424375918 +UCDHE-MP,0.9236641221374046 +UCDHE-MP-MC,0.7430939226519337 +UCDHE-Rowing,0.98 UCDHE-Rowing-MC,0.8204545454545454 UCIActivity,0.9762598917117867 UIPRMD-DS-C,0.9444444444444444 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,1.0 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.5555555555555556 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9444444444444444 USCActivity,0.6985115431348724 UWaveGestureLibrary,0.859375 +VisualSpeech,0.27 WISDM,0.8817848174618504 +WISDM2,0.6635060855908912 diff --git a/results/multiverse/H-InceptionTime/H-InceptionTime_accuracy.csv b/results/multiverse/H-InceptionTime/H-InceptionTime_accuracy.csv index e5affdc..950666f 100644 --- a/results/multiverse/H-InceptionTime/H-InceptionTime_accuracy.csv +++ b/results/multiverse/H-InceptionTime/H-InceptionTime_accuracy.csv @@ -3,18 +3,22 @@ Alzheimers,0.32558139534883723 AppliancesEnergy_disc,0.5 ArticularyWordRecognition,0.99 AsphaltObstaclesCoordinates,0.8491048593350383 +AsphaltPavementTypeCoordinates,0.9602272727272727 AsphaltRegularityCoordinates,0.9946737683089214 AtrialFibrillation,0.3333333333333333 AustraliaRainfall_disc,0.7773548803061501 AutomotiveRoadTrials,0.7532467532467533 BIDMC32HR_disc,0.8257607336390163 +BIDMC32RR_disc,0.6077532305127137 BIDMC32SpO2_disc,0.6919549812421842 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8236925515055468 BeijingPM25Quality_disc,0.8797543581616482 BenzeneConcentration_disc,0.9610691458454387 Blink,0.6644444444444444 BoneIntensitiesAgeGroup,0.7865168539325843 BoneProbAgeGroup,0.7123595505617978 +ButtonPress,0.9166666666666666 CharacterTrajectories,0.9958217270194986 CounterMovementJump,0.6536312849162011 Cricket,0.9861111111111112 @@ -27,6 +31,9 @@ Epilepsy,0.9710144927536232 EthanolConcentration,0.23574144486692014 EyesOpenShut,0.42857142857142855 FaceDetection,0.6850170261066969 +FeedbackButton,0.4930434782608696 +FeetHands,0.6042328042328042 +FingerMovements,0.56 FordChallenge,0.779707747449683 HandMovementDirection,0.4189189189189189 Handwriting,0.6529411764705882 @@ -34,34 +41,83 @@ Heartbeat,0.7609756097560976 HouseholdPowerConsumption1_disc,0.9125364431486881 HouseholdPowerConsumption2_disc,0.7682215743440233 IEEEPPG_disc,0.6634036144578314 +IRDS-EFL,0.6538461538461539 +IRDS-EFR,0.6666666666666666 +IRDS-SAL,0.2857142857142857 +IRDS-SAR,0.7272727272727273 +IRDS-SFE,0.6666666666666666 IRDS-SFL,0.5689655172413793 +IRDS-SFR,0.8 +IRDS-STL,0.18421052631578946 +IRDS-STR,0.8833333333333333 +ImaginedFeetHands,0.586046511627907 +ImaginedOpenCloseFist,0.7253968253968254 +InnerSpeech,0.255 JapaneseVowels,0.9891891891891892 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,0.6 +KERAAL-ELK-MC,0.8571428571428571 KERAAL-RTK,0.7142857142857143 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,0.42857142857142855 +KIMORE-LT-C,0.7142857142857143 KIMORE-PR-C,0.5714285714285714 +KIMORE-Sq-C,0.42857142857142855 +KIMORE-TR-C,0.14285714285714285 +KINECAL-3WFV,0.8333333333333334 +KINECAL-GGFV,1.0 +KINECAL-QSEC,0.8888888888888888 KINECAL-QSEO,0.8235294117647058 LSST,0.22303325223033252 Libras,0.8888888888888888 +LiveFuelMoistureContent_disc,0.7847682119205298 Locust2022,0.9102758411639891 +LongIntervalTask,0.6767857142857143 LowCost,0.5483333333333333 +MatchingPennies,0.5242857142857142 MindReading,0.4670750382848392 MotionSenseHAR,0.9660377358490566 MotorImagery,0.53 NATOPS,0.9555555555555556 +NewsHeadlineSentiment_disc,0.5468718688629715 +NewsTitleSentiment_disc,0.6006973668390044 +OpenCloseFist,0.7365079365079366 +Opportunity,0.826797385620915 +PAMAP2,0.8239514906518444 PEMS-SF,0.8034682080924855 +PPGDalia_disc,0.8086304813332093 PenDigits,0.9911377930245855 PhonemeSpectra,0.37458991947509696 PhotoStimulation,0.25 +PronouncedSpeech,0.245 RacketSports,0.881578947368421 +SPHERE-WUS,0.5 STEW,0.7789001122334456 SelfRegulationSCP1,0.8122866894197952 +SelfRegulationSCP2,0.5277777777777778 Skoda,0.9646268128758401 +SongFamiliarity,0.49866666666666665 SpokenArabicDigits,0.9936334697589814 StandWalkJump,0.3333333333333333 TactileTextureRecognition,1.0 Tiselac,0.8086450960566228 +UCDHE-MP,0.7928176795580111 +UCDHE-MP-MC,0.7817679558011049 +UCDHE-Rowing,0.7818181818181819 UCDHE-Rowing-MC,0.7204545454545455 UCIActivity,0.9979175343606831 UIPRMD-DS-C,0.6666666666666666 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.5 +UIPRMD-SASLR-C,0.95 +UIPRMD-SL-C,0.5 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.6666666666666666 +UIPRMD-SSIER-C,0.45 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.6944444444444444 USCActivity,0.7018529769137303 UWaveGestureLibrary,0.909375 +VisualSpeech,0.255 WISDM,0.8628549352907089 diff --git a/results/multiverse/H-InceptionTime/H-InceptionTime_auroc.csv b/results/multiverse/H-InceptionTime/H-InceptionTime_auroc.csv index 270d0a2..24941e1 100644 --- a/results/multiverse/H-InceptionTime/H-InceptionTime_auroc.csv +++ b/results/multiverse/H-InceptionTime/H-InceptionTime_auroc.csv @@ -3,18 +3,22 @@ Alzheimers,0.48679831595829987 AppliancesEnergy_disc,0.4926470588235294 ArticularyWordRecognition,0.9999652777777777 AsphaltObstaclesCoordinates,0.9631725334056871 +AsphaltPavementTypeCoordinates,0.9909508558103888 AsphaltRegularityCoordinates,0.9980846988721005 AtrialFibrillation,0.4733333333333334 AustraliaRainfall_disc,0.8513883792130826 AutomotiveRoadTrials,0.8511796733212341 BIDMC32HR_disc,0.9171473839763852 +BIDMC32RR_disc,0.4987846131396463 BIDMC32SpO2_disc,0.4116975021074582 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8749158422840462 BeijingPM25Quality_disc,0.9370041000474083 BenzeneConcentration_disc,0.9930450598644421 Blink,0.81036 BoneIntensitiesAgeGroup,0.9005098156445251 BoneProbAgeGroup,0.8571464856160137 +ButtonPress,0.9952126161644608 CharacterTrajectories,0.9999888291330311 CounterMovementJump,0.8985505375334492 Cricket,0.9997895622895623 @@ -27,6 +31,9 @@ Epilepsy,0.9992232082740048 EthanolConcentration,0.5166944190510615 EyesOpenShut,0.4852607709750567 FaceDetection,0.7506662599641054 +FeedbackButton,0.47546767485822305 +FeetHands,0.647795928377611 +FingerMovements,0.5782312925170068 FordChallenge,0.8418428761077812 HandMovementDirection,0.6674259775954692 Handwriting,0.9531783233940799 @@ -34,34 +41,83 @@ Heartbeat,0.7821242294926505 HouseholdPowerConsumption1_disc,0.9696616846664688 HouseholdPowerConsumption2_disc,0.7740982685216873 IEEEPPG_disc,0.8424855142347961 +IRDS-EFL,0.47619047619047616 +IRDS-EFR,0.9 +IRDS-SAL,0.4744897959183674 +IRDS-SAR,0.9224137931034483 +IRDS-SFE,1.0 IRDS-SFL,0.7794384057971014 +IRDS-SFR,0.46153846153846156 +IRDS-STL,0.1313131313131313 +IRDS-STR,0.7236363636363636 +ImaginedFeetHands,0.6239973890450998 +ImaginedOpenCloseFist,0.8027158284659763 +InnerSpeech,0.5176455789642389 JapaneseVowels,0.9996878356414742 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.8894230769230769 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.7692307692307693 KERAAL-RTK,0.9375 +KERAAL-RTK-MC,0.2788461538461538 +KIMORE-LA-C,0.3333333333333333 +KIMORE-LT-C,1.0 KIMORE-PR-C,0.5 +KIMORE-Sq-C,0.3 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.9090909090909091 +KINECAL-GGFV,1.0 +KINECAL-QSEC,0.8823529411764706 KINECAL-QSEO,0.625 LSST,0.7576755186691451 Libras,0.9894179894179894 +LiveFuelMoistureContent_disc,0.515748031496063 Locust2022,0.7994097129972138 +LongIntervalTask,0.6266648391812866 LowCost,0.6001000000000001 +MatchingPennies,0.5371032523510972 MindReading,0.7692658886405929 MotionSenseHAR,0.9992121694287444 MotorImagery,0.5564 NATOPS,0.9965925925925926 +NewsHeadlineSentiment_disc,0.49619568680933207 +NewsTitleSentiment_disc,0.49818752167733704 +OpenCloseFist,0.8050785869136776 +Opportunity,0.9429354492583298 +PAMAP2,0.969869874691613 PEMS-SF,0.9666148852028655 +PPGDalia_disc,0.918905971729016 PenDigits,0.9997762236077655 PhonemeSpectra,0.9075794927833467 PhotoStimulation,0.3484961334961335 +PronouncedSpeech,0.5002832605223544 RacketSports,0.9698666103331725 +SPHERE-WUS,1.0 STEW,0.8720450939750415 SelfRegulationSCP1,0.9442968968409282 +SelfRegulationSCP2,0.5308641975308641 Skoda,0.9977777302063513 +SongFamiliarity,0.4827492896766337 SpokenArabicDigits,0.9999648423039459 StandWalkJump,0.5666666666666667 TactileTextureRecognition,1.0 Tiselac,0.9560151720011396 +UCDHE-MP,0.8953053435114504 +UCDHE-MP-MC,0.9312375194984324 +UCDHE-Rowing,0.732031746031746 UCDHE-Rowing-MC,0.9334846250949193 UCIActivity,0.9999932670010516 UIPRMD-DS-C,0.9135802469135802 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.8888888888888888 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.8518518518518519 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.83 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.8209876543209876 USCActivity,0.9656209079850021 UWaveGestureLibrary,0.9890736607142856 +VisualSpeech,0.5007347227128224 WISDM,0.9613886706406866 diff --git a/results/multiverse/H-InceptionTime/H-InceptionTime_balacc.csv b/results/multiverse/H-InceptionTime/H-InceptionTime_balacc.csv index 100ec32..9eb80b5 100644 --- a/results/multiverse/H-InceptionTime/H-InceptionTime_balacc.csv +++ b/results/multiverse/H-InceptionTime/H-InceptionTime_balacc.csv @@ -3,18 +3,22 @@ Alzheimers,0.33814333814333813 AppliancesEnergy_disc,0.40441176470588236 ArticularyWordRecognition,0.99 AsphaltObstaclesCoordinates,0.8459251390591715 +AsphaltPavementTypeCoordinates,0.9555109922756982 AsphaltRegularityCoordinates,0.994750656167979 AtrialFibrillation,0.3333333333333333 AustraliaRainfall_disc,0.4193935166230872 AutomotiveRoadTrials,0.7123411978221416 BIDMC32HR_disc,0.7125495047736533 +BIDMC32RR_disc,0.319782593547488 BIDMC32SpO2_disc,0.48764918585562805 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7931550450687973 BeijingPM25Quality_disc,0.8674050696501973 BenzeneConcentration_disc,0.9594152002498982 Blink,0.698 BoneIntensitiesAgeGroup,0.8144359519887242 BoneProbAgeGroup,0.7049266247379454 +ButtonPress,0.9253731343283582 CharacterTrajectories,0.9955185131848439 CounterMovementJump,0.6546139359698682 Cricket,0.9861111111111112 @@ -27,6 +31,9 @@ Epilepsy,0.9711844197138315 EthanolConcentration,0.23543123543123542 EyesOpenShut,0.42857142857142855 FaceDetection,0.685017026106697 +FeedbackButton,0.4930434782608696 +FeetHands,0.6051720063922165 +FingerMovements,0.5590236094437775 FordChallenge,0.7705953750166015 HandMovementDirection,0.4476190476190476 Handwriting,0.6483463680332924 @@ -34,34 +41,83 @@ Heartbeat,0.7050142247510669 HouseholdPowerConsumption1_disc,0.7549416032473814 HouseholdPowerConsumption2_disc,0.5829251418292515 IEEEPPG_disc,0.6317861355070175 +IRDS-EFL,0.625 +IRDS-EFR,0.75 +IRDS-SAL,0.4523809523809524 +IRDS-SAR,0.8448275862068966 +IRDS-SFE,0.5 IRDS-SFL,0.651268115942029 +IRDS-SFR,0.46153846153846156 +IRDS-STL,0.21043771043771042 +IRDS-STR,0.7545454545454545 +ImaginedFeetHands,0.5860450656798311 +ImaginedOpenCloseFist,0.7254071559107034 +InnerSpeech,0.2604399779551755 JapaneseVowels,0.9898629148629148 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.6190476190476191 +KERAAL-ELK,0.375 +KERAAL-ELK-MC,0.46153846153846156 KERAAL-RTK,0.75 +KERAAL-RTK-MC,0.22857142857142856 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.75 KIMORE-PR-C,0.75 +KIMORE-Sq-C,0.45 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.9090909090909092 +KINECAL-GGFV,1.0 +KINECAL-QSEC,0.47058823529411764 KINECAL-QSEO,0.4375 LSST,0.2561548775117084 Libras,0.888888888888889 +LiveFuelMoistureContent_disc,0.481742125984252 Locust2022,0.6427350078000995 +LongIntervalTask,0.5089181286549708 LowCost,0.5483333333333333 +MatchingPennies,0.5241967084639498 MindReading,0.45666796519932473 MotionSenseHAR,0.979538530161106 MotorImagery,0.53 NATOPS,0.9555555555555556 +NewsHeadlineSentiment_disc,0.3331438989021072 +NewsTitleSentiment_disc,0.33298104183039784 +OpenCloseFist,0.736517719568567 +Opportunity,0.838714087610092 +PAMAP2,0.8346432175480603 PEMS-SF,0.8089407854625245 +PPGDalia_disc,0.7633546534472265 PenDigits,0.9909719893403748 PhonemeSpectra,0.3746536181556701 PhotoStimulation,0.23838383838383836 +PronouncedSpeech,0.25 RacketSports,0.8905523255813954 +SPHERE-WUS,0.5 STEW,0.7789001122334456 SelfRegulationSCP1,0.8128319821079116 +SelfRegulationSCP2,0.5277777777777778 Skoda,0.9636805294728243 +SongFamiliarity,0.4921846627121179 SpokenArabicDigits,0.9936363636363638 StandWalkJump,0.3333333333333333 TactileTextureRecognition,1.0 Tiselac,0.6319677562202566 +UCDHE-MP,0.8012213740458015 +UCDHE-MP-MC,0.786237922705314 +UCDHE-Rowing,0.606984126984127 UCDHE-Rowing-MC,0.7314761904761905 UCIActivity,0.9979871175523348 UIPRMD-DS-C,0.6666666666666666 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.5 +UIPRMD-SASLR-C,0.95 +UIPRMD-SL-C,0.5 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.6666666666666666 +UIPRMD-SSIER-C,0.45 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.6944444444444444 USCActivity,0.7158600942386638 UWaveGestureLibrary,0.909375 +VisualSpeech,0.25 WISDM,0.5581881678567943 diff --git a/results/multiverse/H-InceptionTime/H-InceptionTime_f1.csv b/results/multiverse/H-InceptionTime/H-InceptionTime_f1.csv index c1a032f..492ec77 100644 --- a/results/multiverse/H-InceptionTime/H-InceptionTime_f1.csv +++ b/results/multiverse/H-InceptionTime/H-InceptionTime_f1.csv @@ -3,18 +3,22 @@ Alzheimers,0.319855028692238 AppliancesEnergy_disc,0.16 ArticularyWordRecognition,0.9899826086956522 AsphaltObstaclesCoordinates,0.8490874974926271 +AsphaltPavementTypeCoordinates,0.9602706526208207 AsphaltRegularityCoordinates,0.9946236559139785 AtrialFibrillation,0.3484848484848485 AustraliaRainfall_disc,0.7675622320608678 AutomotiveRoadTrials,0.5581395348837209 BIDMC32HR_disc,0.8139796355504607 +BIDMC32RR_disc,0.6408966018431806 BIDMC32SpO2_disc,0.023778071334214 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7025401069518716 BeijingPM25Quality_disc,0.8078505856283634 BenzeneConcentration_disc,0.9383624655013799 Blink,0.7259528130671506 BoneIntensitiesAgeGroup,0.7849730451856167 BoneProbAgeGroup,0.7150914920974367 +ButtonPress,0.9137931034482759 CharacterTrajectories,0.9958199098383662 CounterMovementJump,0.6600861715112595 Cricket,0.9860139860139859 @@ -27,6 +31,9 @@ Epilepsy,0.9707796424688798 EthanolConcentration,0.23550206735813733 EyesOpenShut,0.5 FaceDetection,0.6860859728506787 +FeedbackButton,0.5046728971962616 +FeetHands,0.6421052631578947 +FingerMovements,0.5319148936170213 FordChallenge,0.7150499286733238 HandMovementDirection,0.41624213264090143 Handwriting,0.6274761735083186 @@ -34,34 +41,83 @@ Heartbeat,0.5739130434782609 HouseholdPowerConsumption1_disc,0.9061576123776045 HouseholdPowerConsumption2_disc,0.7511148511490722 IEEEPPG_disc,0.645273060689789 +IRDS-EFL,0.4 +IRDS-EFR,0.6666666666666666 +IRDS-SAL,0.3548387096774194 +IRDS-SAR,0.47058823529411764 +IRDS-SFE,0.0 IRDS-SFL,0.4318181818181818 +IRDS-SFR,0.0 +IRDS-STL,0.16216216216216217 +IRDS-STR,0.46153846153846156 +ImaginedFeetHands,0.5847589424572317 +ImaginedOpenCloseFist,0.7278447823807027 +InnerSpeech,0.2113749470671454 JapaneseVowels,0.989225259245026 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.8571428571428571 KERAAL-RTK,0.75 +KERAAL-RTK-MC,0.29783037475345164 +KIMORE-LA-C,0.6 +KIMORE-LT-C,0.75 KIMORE-PR-C,0.4 +KIMORE-Sq-C,0.3333333333333333 +KIMORE-TR-C,0.25 +KINECAL-3WFV,0.5 +KINECAL-GGFV,1.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.18541634522766068 Libras,0.8863087883667594 +LiveFuelMoistureContent_disc,0.052478134110787174 Locust2022,0.38589211618257263 +LongIntervalTask,0.07179487179487179 LowCost,0.5117117117117117 +MatchingPennies,0.5152838427947598 MindReading,0.4584930768682323 MotionSenseHAR,0.9679827344959204 MotorImagery,0.25396825396825395 NATOPS,0.9555061179087875 +NewsHeadlineSentiment_disc,0.395783556473119 +NewsTitleSentiment_disc,0.4860772453210679 +OpenCloseFist,0.7387198321091291 +Opportunity,0.8255612114062333 +PAMAP2,0.8219886669796221 PEMS-SF,0.7995330966159976 +PPGDalia_disc,0.8072947458047453 PenDigits,0.9911319662199437 PhonemeSpectra,0.3731852380649604 PhotoStimulation,0.24842976617170168 +PronouncedSpeech,0.16133153031327474 RacketSports,0.8810941828254847 +SPHERE-WUS,0.0 STEW,0.7831590533847 SelfRegulationSCP1,0.8377581120943953 +SelfRegulationSCP2,0.5086705202312138 Skoda,0.9646630912911829 +SongFamiliarity,0.3795379537953795 SpokenArabicDigits,0.9936311779157123 StandWalkJump,0.25 TactileTextureRecognition,1.0 Tiselac,0.7988926688278235 +UCDHE-MP,0.6861924686192469 +UCDHE-MP-MC,0.7827235643954142 +UCDHE-Rowing,0.3684210526315789 UCDHE-Rowing-MC,0.7147183580020188 UCIActivity,0.9979172411584906 UIPRMD-DS-C,0.5714285714285714 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.0 +UIPRMD-SASLR-C,0.9473684210526315 +UIPRMD-SL-C,0.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.75 +UIPRMD-SSIER-C,0.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.6206896551724138 USCActivity,0.6918533209090443 UWaveGestureLibrary,0.9074345038910618 +VisualSpeech,0.10362549800796814 WISDM,0.8556729764795543 diff --git a/results/multiverse/H-InceptionTime/H-InceptionTime_logloss.csv b/results/multiverse/H-InceptionTime/H-InceptionTime_logloss.csv index b95b3fa..2180678 100644 --- a/results/multiverse/H-InceptionTime/H-InceptionTime_logloss.csv +++ b/results/multiverse/H-InceptionTime/H-InceptionTime_logloss.csv @@ -3,18 +3,22 @@ Alzheimers,3.6660255843382825 AppliancesEnergy_disc,0.9294270047897941 ArticularyWordRecognition,0.045216122750524154 AsphaltObstaclesCoordinates,0.7177244308048673 +AsphaltPavementTypeCoordinates,0.24648729151547424 AsphaltRegularityCoordinates,0.05355809797393537 AtrialFibrillation,4.983821348062404 AustraliaRainfall_disc,1.5922507835235549 AutomotiveRoadTrials,0.79359604912544 BIDMC32HR_disc,0.5134856839774707 +BIDMC32RR_disc,5.466348285814428 BIDMC32SpO2_disc,4.268831231811511 +BasicMotions,0.0003690500885742085 BeijingPM10Quality_disc,1.1895607889989415 BeijingPM25Quality_disc,0.8563453323200336 BenzeneConcentration_disc,0.1443841341873484 Blink,3.0466559417182766 BoneIntensitiesAgeGroup,1.0392311297985826 BoneProbAgeGroup,1.0104425323151645 +ButtonPress,0.17936278015692395 CharacterTrajectories,0.01740596430837639 CounterMovementJump,0.9479702228076834 Cricket,0.04630650020490157 @@ -27,6 +31,9 @@ Epilepsy,0.06421620629133257 EthanolConcentration,2.606327254003803 EyesOpenShut,3.2542008329660144 FaceDetection,1.520267061100787 +FeedbackButton,1.5753561147700368 +FeetHands,1.4837527624543072 +FingerMovements,1.6954806097214858 FordChallenge,0.7561931300502198 HandMovementDirection,1.647996783641345 Handwriting,1.3293523021298785 @@ -34,34 +41,83 @@ Heartbeat,0.7461643416047726 HouseholdPowerConsumption1_disc,0.38251742949027334 HouseholdPowerConsumption2_disc,1.347726441773322 IEEEPPG_disc,1.171482608136685 +IRDS-EFL,2.1360818024297754 +IRDS-EFR,0.4241449485657809 +IRDS-SAL,9.310529314581398 +IRDS-SAR,1.1538794554820817 +IRDS-SFE,0.3005901249506453 IRDS-SFL,0.8569880336636466 +IRDS-SFR,0.8037205493089831 +IRDS-STL,5.633572348565037 +IRDS-STR,0.36708851108580665 +ImaginedFeetHands,1.1417337478758087 +ImaginedOpenCloseFist,1.1125073801216232 +InnerSpeech,9.936955573428701 JapaneseVowels,0.058193337840828266 +KERAAL-CTK,0.11077850850595025 +KERAAL-CTK-MC,0.9995658261501804 +KERAAL-ELK,2.3360403541393175 +KERAAL-ELK-MC,0.34355947351582333 KERAAL-RTK,0.49057497983510917 +KERAAL-RTK-MC,2.342187034578217 +KIMORE-LA-C,5.085386033023819 +KIMORE-LT-C,1.0424419800588642 KIMORE-PR-C,2.427628547441349 +KIMORE-Sq-C,3.341927809463168 +KIMORE-TR-C,4.59992570918591 +KINECAL-3WFV,0.31858493249532244 +KINECAL-GGFV,0.04395409125268894 +KINECAL-QSEC,0.3246445379784193 KINECAL-QSEO,0.6900050273633724 LSST,7.366721539476236 Libras,0.4646540818459707 +LiveFuelMoistureContent_disc,2.0346669325466955 Locust2022,0.7776492495979911 +LongIntervalTask,4.186568321431147 LowCost,0.9749530008189443 +MatchingPennies,1.6414446697046676 MindReading,2.4786857092219265 MotionSenseHAR,0.1801613185123995 MotorImagery,3.5090318634806947 NATOPS,0.12334617093600016 +NewsHeadlineSentiment_disc,1.4388749568448127 +NewsTitleSentiment_disc,1.130255486278489 +OpenCloseFist,1.2190435158603243 +Opportunity,1.2510004552314036 +PAMAP2,2.2678119544235904 PEMS-SF,0.8880811825385159 +PPGDalia_disc,1.2515600045574324 PenDigits,0.055182410682489844 PhonemeSpectra,3.4244518880790156 PhotoStimulation,5.389058311001386 +PronouncedSpeech,11.751958251548404 RacketSports,0.4299136521827606 +SPHERE-WUS,0.6310748825425173 STEW,1.3730658390308716 SelfRegulationSCP1,0.9149585134022528 +SelfRegulationSCP2,0.9554449903272183 Skoda,0.25009721063993146 +SongFamiliarity,1.548401574106912 SpokenArabicDigits,0.03162673170034968 StandWalkJump,3.455714765447032 TactileTextureRecognition,0.001861901363115343 Tiselac,2.7229945274077845 +UCDHE-MP,0.7578024980330899 +UCDHE-MP-MC,1.204731651878046 +UCDHE-Rowing,1.7118442260691262 UCDHE-Rowing-MC,1.5332896251149004 UCIActivity,0.00649223724240284 UIPRMD-DS-C,0.4765660852566922 +UIPRMD-HS-C,0.07261664532016704 +UIPRMD-IL-C,2.793634111379028 +UIPRMD-SASLR-C,0.14319708465367825 +UIPRMD-SL-C,2.165792167448702 +UIPRMD-SSA-C,0.01409119866201139 +UIPRMD-SSE-C,0.895084183774038 +UIPRMD-SSIER-C,0.661286809142822 +UIPRMD-SSS-C,0.020331614991519087 +UIPRMD-STS-C,1.8407696662278117 USCActivity,1.982520519627684 UWaveGestureLibrary,0.3632998138946558 +VisualSpeech,13.052923472790935 WISDM,1.6450374825337426 diff --git a/results/multiverse/H-InceptionTime/H-InceptionTime_sensitivity.csv b/results/multiverse/H-InceptionTime/H-InceptionTime_sensitivity.csv index 7f31a83..bf28c3e 100644 --- a/results/multiverse/H-InceptionTime/H-InceptionTime_sensitivity.csv +++ b/results/multiverse/H-InceptionTime/H-InceptionTime_sensitivity.csv @@ -3,18 +3,22 @@ Alzheimers,0.32558139534883723 AppliancesEnergy_disc,0.25 ArticularyWordRecognition,0.99 AsphaltObstaclesCoordinates,0.8491048593350383 +AsphaltPavementTypeCoordinates,0.9602272727272727 AsphaltRegularityCoordinates,1.0 AtrialFibrillation,0.3333333333333333 AustraliaRainfall_disc,0.7773548803061501 AutomotiveRoadTrials,0.631578947368421 BIDMC32HR_disc,0.8257607336390163 +BIDMC32RR_disc,0.6077532305127137 BIDMC32SpO2_disc,0.013177159590043924 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7208504801097394 BeijingPM25Quality_disc,0.836173001310616 BenzeneConcentration_disc,0.9550561797752809 Blink,1.0 BoneIntensitiesAgeGroup,0.7865168539325843 BoneProbAgeGroup,0.7123595505617978 +ButtonPress,1.0 CharacterTrajectories,0.9958217270194986 CounterMovementJump,0.6536312849162011 Cricket,0.9861111111111112 @@ -27,6 +31,9 @@ Epilepsy,0.9710144927536232 EthanolConcentration,0.23574144486692014 EyesOpenShut,0.5714285714285714 FaceDetection,0.688422247446084 +FeedbackButton,0.5165217391304348 +FeetHands,0.7161152614727855 +FingerMovements,0.5102040816326531 FordChallenge,0.7336260519575558 HandMovementDirection,0.4189189189189189 Handwriting,0.6529411764705882 @@ -34,34 +41,83 @@ Heartbeat,0.5789473684210527 HouseholdPowerConsumption1_disc,0.9125364431486881 HouseholdPowerConsumption2_disc,0.7682215743440233 IEEEPPG_disc,0.6634036144578314 +IRDS-EFL,0.25 +IRDS-EFR,1.0 +IRDS-SAL,0.7857142857142857 +IRDS-SAR,1.0 +IRDS-SFE,0.0 IRDS-SFL,0.7916666666666666 +IRDS-SFR,0.0 +IRDS-STL,0.2727272727272727 +IRDS-STR,0.6 +ImaginedFeetHands,0.5832471561530507 +ImaginedOpenCloseFist,0.7351694915254238 +InnerSpeech,0.255 JapaneseVowels,0.9891891891891892 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.8571428571428571 KERAAL-RTK,1.0 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,1.0 +KIMORE-LT-C,1.0 KIMORE-PR-C,1.0 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,1.0 +KINECAL-3WFV,1.0 +KINECAL-GGFV,1.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.22303325223033252 Libras,0.8888888888888888 +LiveFuelMoistureContent_disc,0.0375 Locust2022,0.3174061433447099 +LongIntervalTask,0.03888888888888889 LowCost,0.47333333333333333 +MatchingPennies,0.5086206896551724 MindReading,0.4670750382848392 MotionSenseHAR,0.9660377358490566 MotorImagery,0.16 NATOPS,0.9555555555555556 +NewsHeadlineSentiment_disc,0.5468718688629715 +NewsTitleSentiment_disc,0.6006973668390044 +OpenCloseFist,0.7457627118644068 +Opportunity,0.826797385620915 +PAMAP2,0.8239514906518444 PEMS-SF,0.8034682080924855 +PPGDalia_disc,0.8086304813332093 PenDigits,0.9911377930245855 PhonemeSpectra,0.37458991947509696 PhotoStimulation,0.25 +PronouncedSpeech,0.245 RacketSports,0.881578947368421 +SPHERE-WUS,0.0 STEW,0.7985409652076318 SelfRegulationSCP1,0.9726027397260274 +SelfRegulationSCP2,0.4888888888888889 Skoda,0.9646268128758401 +SongFamiliarity,0.3185595567867036 SpokenArabicDigits,0.9936334697589814 StandWalkJump,0.3333333333333333 TactileTextureRecognition,1.0 Tiselac,0.8086450960566228 +UCDHE-MP,0.82 +UCDHE-MP-MC,0.7817679558011049 +UCDHE-Rowing,0.3111111111111111 UCDHE-Rowing-MC,0.7204545454545455 UCIActivity,0.9979175343606831 UIPRMD-DS-C,0.4444444444444444 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.0 +UIPRMD-SASLR-C,0.9 +UIPRMD-SL-C,0.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.5 USCActivity,0.7018529769137303 UWaveGestureLibrary,0.909375 +VisualSpeech,0.255 WISDM,0.8628549352907089 diff --git a/results/multiverse/H-InceptionTime/H-InceptionTime_specificity.csv b/results/multiverse/H-InceptionTime/H-InceptionTime_specificity.csv index 5f8b1fd..6b27daf 100644 --- a/results/multiverse/H-InceptionTime/H-InceptionTime_specificity.csv +++ b/results/multiverse/H-InceptionTime/H-InceptionTime_specificity.csv @@ -3,18 +3,22 @@ Alzheimers,0.32558139534883723 AppliancesEnergy_disc,0.5588235294117647 ArticularyWordRecognition,0.99 AsphaltObstaclesCoordinates,0.8491048593350383 +AsphaltPavementTypeCoordinates,0.9602272727272727 AsphaltRegularityCoordinates,0.989501312335958 AtrialFibrillation,0.3333333333333333 AustraliaRainfall_disc,0.7773548803061501 AutomotiveRoadTrials,0.7931034482758621 BIDMC32HR_disc,0.8257607336390163 +BIDMC32RR_disc,0.6077532305127137 BIDMC32SpO2_disc,0.9621212121212122 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8654596100278552 BeijingPM25Quality_disc,0.8986371379897785 BenzeneConcentration_disc,0.9637742207245156 Blink,0.396 BoneIntensitiesAgeGroup,0.7865168539325843 BoneProbAgeGroup,0.7123595505617978 +ButtonPress,0.8507462686567164 CharacterTrajectories,0.9958217270194986 CounterMovementJump,0.6536312849162011 Cricket,0.9861111111111112 @@ -27,6 +31,9 @@ Epilepsy,0.9710144927536232 EthanolConcentration,0.23574144486692014 EyesOpenShut,0.2857142857142857 FaceDetection,0.6816118047673099 +FeedbackButton,0.46956521739130436 +FeetHands,0.49422875131164745 +FingerMovements,0.6078431372549019 FordChallenge,0.807564698075647 HandMovementDirection,0.4189189189189189 Handwriting,0.6529411764705882 @@ -34,34 +41,83 @@ Heartbeat,0.831081081081081 HouseholdPowerConsumption1_disc,0.9125364431486881 HouseholdPowerConsumption2_disc,0.7682215743440233 IEEEPPG_disc,0.6634036144578314 +IRDS-EFL,1.0 +IRDS-EFR,0.5 +IRDS-SAL,0.11904761904761904 +IRDS-SAR,0.6896551724137931 +IRDS-SFE,1.0 IRDS-SFL,0.5108695652173914 +IRDS-SFR,0.9230769230769231 +IRDS-STL,0.14814814814814814 +IRDS-STR,0.9090909090909091 +ImaginedFeetHands,0.5888429752066116 +ImaginedOpenCloseFist,0.7156448202959831 +InnerSpeech,0.255 JapaneseVowels,0.9891891891891892 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,0.75 +KERAAL-ELK-MC,0.8571428571428571 KERAAL-RTK,0.5 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,0.0 +KIMORE-LT-C,0.5 KIMORE-PR-C,0.5 +KIMORE-Sq-C,0.4 +KIMORE-TR-C,0.0 +KINECAL-3WFV,0.8181818181818182 +KINECAL-GGFV,1.0 +KINECAL-QSEC,0.9411764705882353 KINECAL-QSEO,0.875 LSST,0.22303325223033252 Libras,0.8888888888888888 +LiveFuelMoistureContent_disc,0.925984251968504 Locust2022,0.9680638722554891 +LongIntervalTask,0.9789473684210527 LowCost,0.6233333333333333 +MatchingPennies,0.5397727272727273 MindReading,0.4670750382848392 MotionSenseHAR,0.9660377358490566 MotorImagery,0.9 NATOPS,0.9555555555555556 +NewsHeadlineSentiment_disc,0.5468718688629715 +NewsTitleSentiment_disc,0.6006973668390044 +OpenCloseFist,0.7272727272727273 +Opportunity,0.826797385620915 +PAMAP2,0.8239514906518444 PEMS-SF,0.8034682080924855 +PPGDalia_disc,0.8086304813332093 PenDigits,0.9911377930245855 PhonemeSpectra,0.37458991947509696 PhotoStimulation,0.25 +PronouncedSpeech,0.245 RacketSports,0.881578947368421 +SPHERE-WUS,1.0 STEW,0.7592592592592593 SelfRegulationSCP1,0.6530612244897959 +SelfRegulationSCP2,0.5666666666666667 Skoda,0.9646268128758401 +SongFamiliarity,0.6658097686375322 SpokenArabicDigits,0.9936334697589814 StandWalkJump,0.3333333333333333 TactileTextureRecognition,1.0 Tiselac,0.8086450960566228 +UCDHE-MP,0.7824427480916031 +UCDHE-MP-MC,0.7817679558011049 +UCDHE-Rowing,0.9028571428571428 UCDHE-Rowing-MC,0.7204545454545455 UCIActivity,0.9979175343606831 UIPRMD-DS-C,0.8888888888888888 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,1.0 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.3333333333333333 +UIPRMD-SSIER-C,0.9 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.8888888888888888 USCActivity,0.7018529769137303 UWaveGestureLibrary,0.909375 +VisualSpeech,0.255 WISDM,0.8628549352907089 diff --git a/results/multiverse/HC2/HC2_accuracy.csv b/results/multiverse/HC2/HC2_accuracy.csv index 513d3fb..1f473df 100644 --- a/results/multiverse/HC2/HC2_accuracy.csv +++ b/results/multiverse/HC2/HC2_accuracy.csv @@ -3,18 +3,21 @@ Alzheimers,0.3953488372093023 AppliancesEnergy_disc,0.8809523809523809 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8567774936061381 +AsphaltPavementTypeCoordinates,0.8920454545454546 AsphaltRegularityCoordinates,0.9720372836218375 AtrialFibrillation,0.3333333333333333 AustraliaRainfall_disc,0.7653958944281525 AutomotiveRoadTrials,0.8311688311688312 BIDMC32HR_disc,0.9362234264276782 BIDMC32SpO2_disc,0.6627761567319717 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7818938193343898 BeijingPM25Quality_disc,0.8328050713153724 BenzeneConcentration_disc,0.7853960875460004 Blink,1.0 BoneIntensitiesAgeGroup,0.8202247191011236 BoneProbAgeGroup,0.6876404494382022 +ButtonPress,1.0 CharacterTrajectories,0.9930362116991643 CounterMovementJump,0.9217877094972067 Cricket,1.0 @@ -27,6 +30,9 @@ Epilepsy,1.0 EthanolConcentration,0.7034220532319392 EyesOpenShut,0.42857142857142855 FaceDetection,0.6503972758229285 +FeedbackButton,0.5365217391304348 +FeetHands,0.6804232804232804 +FingerMovements,0.54 FordChallenge,0.9025365315687897 HandMovementDirection,0.40540540540540543 Handwriting,0.6141176470588235 @@ -34,34 +40,83 @@ Heartbeat,0.7414634146341463 HouseholdPowerConsumption1_disc,0.9008746355685131 HouseholdPowerConsumption2_disc,0.7871720116618076 IEEEPPG_disc,0.6265060240963856 +IRDS-EFL,0.6538461538461539 +IRDS-EFR,0.6666666666666666 +IRDS-SAL,0.5535714285714286 +IRDS-SAR,0.21212121212121213 +IRDS-SFE,0.6666666666666666 IRDS-SFL,0.7931034482758621 +IRDS-SFR,0.7333333333333333 +IRDS-STL,0.7368421052631579 +IRDS-STR,0.9333333333333333 +ImaginedFeetHands,0.7085271317829457 +ImaginedOpenCloseFist,0.7708994708994709 +InnerSpeech,0.32 JapaneseVowels,0.9405405405405406 +KERAAL-CTK,0.9285714285714286 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.8 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.9285714285714286 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,0.42857142857142855 +KIMORE-LT-C,0.2857142857142857 KIMORE-PR-C,0.14285714285714285 +KIMORE-Sq-C,0.2857142857142857 +KIMORE-TR-C,0.14285714285714285 +KINECAL-3WFV,0.9166666666666666 +KINECAL-GGFV,0.9230769230769231 +KINECAL-QSEC,0.9444444444444444 KINECAL-QSEO,0.9411764705882353 LSST,0.6751824817518248 Libras,0.9277777777777778 +LiveFuelMoistureContent_disc,0.8105960264900662 Locust2022,0.9036071536829342 +LongIntervalTask,0.7098214285714286 LowCost,0.69 +MatchingPennies,0.6128571428571429 MindReading,0.5880551301684533 MotionSenseHAR,1.0 MotorImagery,0.59 NATOPS,0.9277777777777778 +NewsHeadlineSentiment_disc,0.5507194100436856 +NewsTitleSentiment_disc,0.6248647348803655 +OpenCloseFist,0.7645502645502645 +Opportunity,0.8337178008458286 PEMS-SF,1.0 PenDigits,0.9797026872498571 PhonemeSpectra,0.31404712198031615 PhotoStimulation,0.4166666666666667 +PronouncedSpeech,0.3 RacketSports,0.9013157894736842 +SPHERE-WUS,1.0 STEW,0.8448372615039281 SelfRegulationSCP1,0.8907849829351536 +SelfRegulationSCP2,0.5555555555555556 +ShortIntervalTask,0.6803571428571429 +SitStand,0.4228125 Skoda,0.960382030420941 +SongFamiliarity,0.5173333333333333 SpokenArabicDigits,0.9881764438381082 StandWalkJump,0.4 TactileTextureRecognition,1.0 Tiselac,0.7703741152679474 +UCDHE-MP,0.8756906077348067 +UCDHE-MP-MC,0.7458563535911602 +UCDHE-Rowing,0.8227272727272728 UCDHE-Rowing-MC,0.7886363636363637 UCIActivity,0.9862557267805081 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.7222222222222222 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.9444444444444444 +UIPRMD-SSIER-C,0.85 +UIPRMD-SSS-C,0.9444444444444444 +UIPRMD-STS-C,0.9722222222222222 USCActivity,0.74726609963548 UWaveGestureLibrary,0.940625 +VisualSpeech,0.31 WISDM,0.8810121692099672 diff --git a/results/multiverse/HC2/HC2_auroc.csv b/results/multiverse/HC2/HC2_auroc.csv index f207251..ac52ffe 100644 --- a/results/multiverse/HC2/HC2_auroc.csv +++ b/results/multiverse/HC2/HC2_auroc.csv @@ -3,18 +3,21 @@ Alzheimers,0.5551062550120288 AppliancesEnergy_disc,0.9338235294117647 ArticularyWordRecognition,0.9997337962962962 AsphaltObstaclesCoordinates,0.9734602114863985 +AsphaltPavementTypeCoordinates,0.9834721039838622 AsphaltRegularityCoordinates,0.9971270483081507 AtrialFibrillation,0.4733333333333334 AustraliaRainfall_disc,0.8493354969968424 AutomotiveRoadTrials,0.9346642468239564 BIDMC32HR_disc,0.9829130420375323 BIDMC32SpO2_disc,0.47559998566587147 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8761825066581076 BeijingPM25Quality_disc,0.9238525411883961 BenzeneConcentration_disc,0.882871067161555 Blink,1.0 BoneIntensitiesAgeGroup,0.9413819898911819 BoneProbAgeGroup,0.854163707256603 +ButtonPress,1.0 CharacterTrajectories,0.9998847083551047 CounterMovementJump,0.9878522917546907 Cricket,1.0 @@ -27,6 +30,9 @@ Epilepsy,1.0 EthanolConcentration,0.8908524163875345 EyesOpenShut,0.42403628117913833 FaceDetection,0.7124633291288791 +FeedbackButton,0.5559017013232515 +FeetHands,0.7569389928563509 +FingerMovements,0.5818327330932374 FordChallenge,0.9677124915212523 HandMovementDirection,0.6639740279570789 Handwriting,0.9198745635960613 @@ -34,34 +40,83 @@ Heartbeat,0.7203651019440493 HouseholdPowerConsumption1_disc,0.9791538140464255 HouseholdPowerConsumption2_disc,0.826091193402577 IEEEPPG_disc,0.897558544535165 +IRDS-EFL,0.9880952380952381 +IRDS-EFR,0.74 +IRDS-SAL,0.5408163265306123 +IRDS-SAR,0.9310344827586207 +IRDS-SFE,0.7799999999999999 IRDS-SFL,0.9334239130434783 +IRDS-SFR,0.3846153846153846 +IRDS-STL,0.37373737373737376 +IRDS-STR,0.9163636363636364 +ImaginedFeetHands,0.7718213440221526 +ImaginedOpenCloseFist,0.8589477998351668 +InnerSpeech,0.5636250498648239 JapaneseVowels,0.9982465360786391 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9107142857142857 +KERAAL-ELK,0.375 +KERAAL-ELK-MC,0.9230769230769231 KERAAL-RTK,0.9375 +KERAAL-RTK-MC,0.608974358974359 +KIMORE-LA-C,0.8333333333333334 +KIMORE-LT-C,0.41666666666666663 KIMORE-PR-C,1.0 +KIMORE-Sq-C,0.9 +KIMORE-TR-C,0.8333333333333334 +KINECAL-3WFV,0.4545454545454546 +KINECAL-GGFV,0.6666666666666667 +KINECAL-QSEC,0.4117647058823529 KINECAL-QSEO,0.9375 LSST,0.9137064442044079 Libras,0.9968584656084657 +LiveFuelMoistureContent_disc,0.4977690288713911 Locust2022,0.8436931597555741 +LongIntervalTask,0.7171600877192982 LowCost,0.7662111111111112 +MatchingPennies,0.6719076541274818 MindReading,0.8955762036501255 MotionSenseHAR,1.0 MotorImagery,0.5927999999999999 NATOPS,0.9900370370370369 +NewsHeadlineSentiment_disc,0.5019437846244287 +NewsTitleSentiment_disc,0.5113016083159508 +OpenCloseFist,0.853174158813201 +Opportunity,0.9509764635889106 PEMS-SF,1.0 PenDigits,0.9994088617415299 PhonemeSpectra,0.9118050226287818 PhotoStimulation,0.5684676434676434 +PronouncedSpeech,0.5589414041427464 RacketSports,0.9745211293715941 +SPHERE-WUS,1.0 STEW,0.9225323915045203 SelfRegulationSCP1,0.9619327182927966 +SelfRegulationSCP2,0.562716049382716 +ShortIntervalTask,0.7506840277777777 +SitStand,0.7116236979166666 Skoda,0.9969445738605183 +SongFamiliarity,0.5236738850237486 SpokenArabicDigits,0.9995223846604337 StandWalkJump,0.5133333333333333 TactileTextureRecognition,1.0 Tiselac,0.9562308908810502 +UCDHE-MP,0.9104580152671756 +UCDHE-MP-MC,0.9293118040672997 +UCDHE-Rowing,0.8113968253968253 UCDHE-Rowing-MC,0.9547150195459019 UCIActivity,0.9998589849536378 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.8765432098765432 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,1.0 USCActivity,0.9729512907764547 UWaveGestureLibrary,0.9972767857142857 +VisualSpeech,0.4967078301314735 WISDM,0.9826859231636664 diff --git a/results/multiverse/HC2/HC2_balacc.csv b/results/multiverse/HC2/HC2_balacc.csv index 7d4ae29..988ba1c 100644 --- a/results/multiverse/HC2/HC2_balacc.csv +++ b/results/multiverse/HC2/HC2_balacc.csv @@ -3,18 +3,21 @@ Alzheimers,0.35425685425685427 AppliancesEnergy_disc,0.7352941176470589 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8583356728366263 +AsphaltPavementTypeCoordinates,0.880361519607843 AsphaltRegularityCoordinates,0.9723238987018514 AtrialFibrillation,0.3333333333333333 AustraliaRainfall_disc,0.3586544279388035 AutomotiveRoadTrials,0.7286751361161524 BIDMC32HR_disc,0.9052044609665427 BIDMC32SpO2_disc,0.46813429371994525 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6533842673789027 BeijingPM25Quality_disc,0.7449999739514142 BenzeneConcentration_disc,0.6649993636850314 Blink,1.0 BoneIntensitiesAgeGroup,0.8412422106173483 BoneProbAgeGroup,0.6969838443257279 +ButtonPress,1.0 CharacterTrajectories,0.9926604214557845 CounterMovementJump,0.9214689265536723 Cricket,1.0 @@ -27,6 +30,9 @@ Epilepsy,1.0 EthanolConcentration,0.703962703962704 EyesOpenShut,0.42857142857142855 FaceDetection,0.6503972758229285 +FeedbackButton,0.5365217391304348 +FeetHands,0.6807587341440444 +FingerMovements,0.5430172068827531 FordChallenge,0.8778180176859738 HandMovementDirection,0.3952380952380952 Handwriting,0.607427671403949 @@ -34,34 +40,83 @@ Heartbeat,0.5620554765291608 HouseholdPowerConsumption1_disc,0.7152145465104187 HouseholdPowerConsumption2_disc,0.5665144596651446 IEEEPPG_disc,0.6576479550243005 +IRDS-EFL,0.625 +IRDS-EFR,0.5 +IRDS-SAL,0.5119047619047619 +IRDS-SAR,0.5517241379310345 +IRDS-SFE,0.5 IRDS-SFL,0.8233695652173914 +IRDS-SFR,0.4230769230769231 +IRDS-STL,0.5454545454545454 +IRDS-STR,0.6 +ImaginedFeetHands,0.7085281222490962 +ImaginedOpenCloseFist,0.77095464399613 +InnerSpeech,0.32574777046661546 JapaneseVowels,0.9367059358883609 +KERAAL-CTK,0.9285714285714286 +KERAAL-CTK-MC,0.6666666666666666 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.5 KERAAL-RTK,0.9375 +KERAAL-RTK-MC,0.26666666666666666 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.3333333333333333 KIMORE-PR-C,0.5 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.5 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.5 LSST,0.3767464947488122 Libras,0.9277777777777776 +LiveFuelMoistureContent_disc,0.4954068241469816 Locust2022,0.6298347559715609 +LongIntervalTask,0.5844298245614035 LowCost,0.69 +MatchingPennies,0.613244514106583 MindReading,0.5708559407869107 MotionSenseHAR,1.0 MotorImagery,0.59 NATOPS,0.9277777777777777 +NewsHeadlineSentiment_disc,0.33385701737137546 +NewsTitleSentiment_disc,0.3333333333333333 +OpenCloseFist,0.7645438420467983 +Opportunity,0.8293002154343186 PEMS-SF,1.0 PenDigits,0.9801359297644916 PhonemeSpectra,0.31409028727770183 PhotoStimulation,0.3333333333333333 +PronouncedSpeech,0.3025772181782412 RacketSports,0.9093023255813953 +SPHERE-WUS,1.0 STEW,0.8448372615039281 SelfRegulationSCP1,0.8908070077346006 +SelfRegulationSCP2,0.5555555555555556 +ShortIntervalTask,0.5825 +SitStand,0.42281250000000004 Skoda,0.9539202462208749 +SongFamiliarity,0.510977077384301 SpokenArabicDigits,0.9881797426317975 StandWalkJump,0.4000000000000001 TactileTextureRecognition,1.0 Tiselac,0.5605762982066498 +UCDHE-MP,0.8368320610687023 +UCDHE-MP-MC,0.7437349033816425 +UCDHE-Rowing,0.612063492063492 UCDHE-Rowing-MC,0.7924444444444444 UCIActivity,0.9866506989269137 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.7222222222222222 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.9444444444444444 +UIPRMD-SSIER-C,0.85 +UIPRMD-SSS-C,0.9444444444444444 +UIPRMD-STS-C,0.9722222222222222 USCActivity,0.7693872599385568 UWaveGestureLibrary,0.940625 +VisualSpeech,0.30593439298796443 WISDM,0.5943050131981966 diff --git a/results/multiverse/HC2/HC2_f1.csv b/results/multiverse/HC2/HC2_f1.csv index a9bdc1e..1e2a8af 100644 --- a/results/multiverse/HC2/HC2_f1.csv +++ b/results/multiverse/HC2/HC2_f1.csv @@ -3,18 +3,21 @@ Alzheimers,0.3666070363744783 AppliancesEnergy_disc,0.6153846153846154 ArticularyWordRecognition,0.9933217391304349 AsphaltObstaclesCoordinates,0.8558648505702661 +AsphaltPavementTypeCoordinates,0.892326049141515 AsphaltRegularityCoordinates,0.9721854304635762 AtrialFibrillation,0.3206349206349206 AustraliaRainfall_disc,0.7390104467553876 AutomotiveRoadTrials,0.6060606060606061 BIDMC32HR_disc,0.9324272452628007 BIDMC32SpO2_disc,0.026474127557160047 +BasicMotions,1.0 BeijingPM10Quality_disc,0.48041529023124113 BeijingPM25Quality_disc,0.6540983606557377 BenzeneConcentration_disc,0.5013501350135013 Blink,1.0 BoneIntensitiesAgeGroup,0.8185887322933294 BoneProbAgeGroup,0.6914798983697945 +ButtonPress,1.0 CharacterTrajectories,0.9930362887412948 CounterMovementJump,0.9218303211980824 Cricket,1.0 @@ -27,6 +30,9 @@ Epilepsy,1.0 EthanolConcentration,0.7006254868539785 EyesOpenShut,0.5714285714285714 FaceDetection,0.649002849002849 +FeedbackButton,0.544054747647562 +FeetHands,0.6908904810644831 +FingerMovements,0.5964912280701754 FordChallenge,0.8573734113375026 HandMovementDirection,0.4093527606052004 Handwriting,0.5918475575565657 @@ -34,34 +40,83 @@ Heartbeat,0.2535211267605634 HouseholdPowerConsumption1_disc,0.8913720330651157 HouseholdPowerConsumption2_disc,0.7449008999060827 IEEEPPG_disc,0.6369818399905348 +IRDS-EFL,0.4 +IRDS-EFR,0.0 +IRDS-SAL,0.32432432432432434 +IRDS-SAR,0.23529411764705882 +IRDS-SFE,0.0 IRDS-SFL,0.6363636363636364 +IRDS-SFR,0.0 +IRDS-STL,0.16666666666666666 +IRDS-STR,0.3333333333333333 +ImaginedFeetHands,0.7089783281733746 +ImaginedOpenCloseFist,0.782083543029693 +InnerSpeech,0.27111424988055427 JapaneseVowels,0.9398432041423861 +KERAAL-CTK,0.9230769230769231 +KERAAL-CTK-MC,0.8956043956043956 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.8941798941798941 KERAAL-RTK,0.9230769230769231 +KERAAL-RTK-MC,0.18099547511312217 +KIMORE-LA-C,0.6 +KIMORE-LT-C,0.4444444444444444 KIMORE-PR-C,0.25 +KIMORE-Sq-C,0.4444444444444444 +KIMORE-TR-C,0.25 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.6123117869788784 Libras,0.9268626639061422 +LiveFuelMoistureContent_disc,0.052980132450331126 Locust2022,0.35365853658536583 +LongIntervalTask,0.3407707910750507 LowCost,0.6690391459074733 +MatchingPennies,0.636241610738255 MindReading,0.5508162058681932 MotionSenseHAR,1.0 MotorImagery,0.6371681415929203 NATOPS,0.9261153736857062 +NewsHeadlineSentiment_disc,0.3943491261243452 +NewsTitleSentiment_disc,0.4806130130741609 +OpenCloseFist,0.7629195524773574 +Opportunity,0.8326847689819318 PEMS-SF,1.0 PenDigits,0.9796541213707934 PhonemeSpectra,0.3059648052811076 PhotoStimulation,0.25510204081632654 +PronouncedSpeech,0.2977684955219388 RacketSports,0.9012583564979668 +SPHERE-WUS,1.0 STEW,0.8410462776659959 SelfRegulationSCP1,0.891156462585034 +SelfRegulationSCP2,0.5402298850574713 +ShortIntervalTask,0.3490909090909091 +SitStand,0.423354095259974 Skoda,0.9606548944216594 +SongFamiliarity,0.40460526315789475 SpokenArabicDigits,0.9881454126634625 StandWalkJump,0.38888888888888895 TactileTextureRecognition,1.0 Tiselac,0.7538778677818783 +UCDHE-MP,0.7692307692307693 +UCDHE-MP-MC,0.7420955530269805 +UCDHE-Rowing,0.3709677419354839 UCDHE-Rowing-MC,0.7867549047609365 UCIActivity,0.9861188502098307 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.782608695652174 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.9411764705882353 +UIPRMD-SSIER-C,0.8235294117647058 +UIPRMD-SSS-C,0.9473684210526315 +UIPRMD-STS-C,0.972972972972973 USCActivity,0.730600284953102 UWaveGestureLibrary,0.9403506309738556 +VisualSpeech,0.2958695418183316 WISDM,0.8693085096317551 diff --git a/results/multiverse/HC2/HC2_logloss.csv b/results/multiverse/HC2/HC2_logloss.csv index 961d4ad..8a711fd 100644 --- a/results/multiverse/HC2/HC2_logloss.csv +++ b/results/multiverse/HC2/HC2_logloss.csv @@ -3,18 +3,21 @@ Alzheimers,1.0879623584021112 AppliancesEnergy_disc,0.3569804629177825 ArticularyWordRecognition,0.1862674632785058 AsphaltObstaclesCoordinates,0.42799098466560875 +AsphaltPavementTypeCoordinates,0.26762578782168855 AsphaltRegularityCoordinates,0.0904744731571356 AtrialFibrillation,1.2255595169970868 AustraliaRainfall_disc,0.5371241660153839 AutomotiveRoadTrials,0.33157119408461455 BIDMC32HR_disc,0.3343770378009419 BIDMC32SpO2_disc,0.6333093836657039 +BasicMotions,0.07155800812177344 BeijingPM10Quality_disc,0.4177610632648378 BeijingPM25Quality_disc,0.36842654399172825 BenzeneConcentration_disc,0.48288828219509516 Blink,0.05097899209782234 BoneIntensitiesAgeGroup,0.4358808192242577 BoneProbAgeGroup,0.6567311539245975 +ButtonPress,0.07133759932052106 CharacterTrajectories,0.08927566759716976 CounterMovementJump,0.4086258413822985 Cricket,0.14388543379964464 @@ -27,6 +30,9 @@ Epilepsy,0.05438758149348314 EthanolConcentration,0.813785392726399 EyesOpenShut,0.7761944197118418 FaceDetection,0.6426781779680745 +FeedbackButton,0.6898305020861688 +FeetHands,0.6011408961801432 +FingerMovements,0.7098055073462267 FordChallenge,0.324129981903647 HandMovementDirection,1.2968353143812053 Handwriting,1.658541640272509 @@ -34,34 +40,83 @@ Heartbeat,0.5280401487326152 HouseholdPowerConsumption1_disc,0.2455193567241523 HouseholdPowerConsumption2_disc,0.5017488907117474 IEEEPPG_disc,0.8361964115606403 +IRDS-EFL,0.6334695429018844 +IRDS-EFR,0.9359624085301644 +IRDS-SAL,0.6674314999815918 +IRDS-SAR,1.6418869306879111 +IRDS-SFE,0.9036033803325828 IRDS-SFL,0.49309715590642156 +IRDS-SFR,0.5313913341776154 +IRDS-STL,0.7727295248807093 +IRDS-STR,0.29113346079399793 +ImaginedFeetHands,0.5843969862856124 +ImaginedOpenCloseFist,0.5106715821046428 +InnerSpeech,1.3975149735765735 JapaneseVowels,0.47300747848791197 +KERAAL-CTK,0.3271025431091136 +KERAAL-CTK-MC,0.652509352273885 +KERAAL-ELK,0.6011986959778601 +KERAAL-ELK-MC,0.33703160516645925 KERAAL-RTK,0.44199204659686886 +KERAAL-RTK-MC,1.1648778406553468 +KIMORE-LA-C,1.655763587466294 +KIMORE-LT-C,0.9604079913506853 KIMORE-PR-C,0.9429871161437521 +KIMORE-Sq-C,1.0996968014031985 +KIMORE-TR-C,2.2242744790442504 +KINECAL-3WFV,0.3658536474426499 +KINECAL-GGFV,0.2500699417144078 +KINECAL-QSEC,0.26483959947237173 KINECAL-QSEO,0.19526268685638315 LSST,1.1079704460039037 Libras,0.36564885060401614 +LiveFuelMoistureContent_disc,0.48550776972315235 Locust2022,0.24578904621525022 +LongIntervalTask,0.5611642811400236 LowCost,0.5984258989614283 +MatchingPennies,0.6502064926767066 MindReading,1.0412021287873625 MotionSenseHAR,0.04858529134559785 MotorImagery,0.6879428458964489 NATOPS,0.3017210681392167 +NewsHeadlineSentiment_disc,1.0234589096964186 +NewsTitleSentiment_disc,0.9469037140457605 +OpenCloseFist,0.5333589149594021 +Opportunity,0.472392163128519 PEMS-SF,0.13048925281680482 PenDigits,0.13733158187254543 PhonemeSpectra,2.35291964631169 PhotoStimulation,1.1126576647106405 +PronouncedSpeech,1.3885149022520802 RacketSports,0.37416977911349175 +SPHERE-WUS,0.2888973352338551 STEW,0.4523506267538209 SelfRegulationSCP1,0.2967984397676627 +SelfRegulationSCP2,0.6989471284993335 +ShortIntervalTask,0.5694303703520626 +SitStand,1.2362348581603932 Skoda,0.2823476491551809 +SongFamiliarity,0.7068931413465113 SpokenArabicDigits,0.18906090756363803 StandWalkJump,1.110307611747587 TactileTextureRecognition,0.08844470538136215 Tiselac,0.7204977347835975 +UCDHE-MP,0.35563893851357775 +UCDHE-MP-MC,0.7110246249308212 +UCDHE-Rowing,0.4090663932855568 UCDHE-Rowing-MC,0.7059100588662615 UCIActivity,0.20648496301861372 UIPRMD-DS-C,0.22566949629880087 +UIPRMD-HS-C,0.05390620740126775 +UIPRMD-IL-C,0.5404857933102043 +UIPRMD-SASLR-C,0.17579119040015442 +UIPRMD-SL-C,0.21378830554780126 +UIPRMD-SSA-C,0.09114330421117056 +UIPRMD-SSE-C,0.20443361204874166 +UIPRMD-SSIER-C,0.28320904479544257 +UIPRMD-SSS-C,0.25485007134077176 +UIPRMD-STS-C,0.1545356448723585 USCActivity,0.845283723163391 UWaveGestureLibrary,0.3302529064972539 +VisualSpeech,1.4384383498816624 WISDM,0.4056622750938158 diff --git a/results/multiverse/HC2/HC2_sensitivity.csv b/results/multiverse/HC2/HC2_sensitivity.csv index 8508e37..40e4c54 100644 --- a/results/multiverse/HC2/HC2_sensitivity.csv +++ b/results/multiverse/HC2/HC2_sensitivity.csv @@ -3,18 +3,21 @@ Alzheimers,0.3953488372093023 AppliancesEnergy_disc,0.5 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8567774936061381 +AsphaltPavementTypeCoordinates,0.8920454545454546 AsphaltRegularityCoordinates,0.9918918918918919 AtrialFibrillation,0.3333333333333333 AustraliaRainfall_disc,0.7653958944281525 AutomotiveRoadTrials,0.5263157894736842 BIDMC32HR_disc,0.9362234264276782 BIDMC32SpO2_disc,0.016105417276720352 +BasicMotions,1.0 BeijingPM10Quality_disc,0.34910836762688613 BeijingPM25Quality_disc,0.5229357798165137 BenzeneConcentration_disc,0.34769038701622973 Blink,1.0 BoneIntensitiesAgeGroup,0.8202247191011236 BoneProbAgeGroup,0.6876404494382022 +ButtonPress,1.0 CharacterTrajectories,0.9930362116991643 CounterMovementJump,0.9217877094972067 Cricket,1.0 @@ -27,6 +30,9 @@ Epilepsy,1.0 EthanolConcentration,0.7034220532319392 EyesOpenShut,0.7619047619047619 FaceDetection,0.6464245175936436 +FeedbackButton,0.5530434782608695 +FeetHands,0.7203842049092849 +FingerMovements,0.6938775510204082 FordChallenge,0.7775338455909258 HandMovementDirection,0.40540540540540543 Handwriting,0.6141176470588235 @@ -34,34 +40,83 @@ Heartbeat,0.15789473684210525 HouseholdPowerConsumption1_disc,0.9008746355685131 HouseholdPowerConsumption2_disc,0.7871720116618076 IEEEPPG_disc,0.6265060240963856 +IRDS-EFL,0.25 +IRDS-EFR,0.0 +IRDS-SAL,0.42857142857142855 +IRDS-SAR,1.0 +IRDS-SFE,0.0 IRDS-SFL,0.875 +IRDS-SFR,0.0 +IRDS-STL,0.09090909090909091 +IRDS-STR,0.2 +ImaginedFeetHands,0.7104446742502585 +ImaginedOpenCloseFist,0.823093220338983 +InnerSpeech,0.32 JapaneseVowels,0.9405405405405406 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,1.0 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,1.0 +KIMORE-LT-C,0.6666666666666666 KIMORE-PR-C,1.0 +KIMORE-Sq-C,1.0 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.6751824817518248 Libras,0.9277777777777778 +LiveFuelMoistureContent_disc,0.03333333333333333 Locust2022,0.29692832764505117 +LongIntervalTask,0.23333333333333334 LowCost,0.6266666666666667 +MatchingPennies,0.6810344827586207 MindReading,0.5880551301684533 MotionSenseHAR,1.0 MotorImagery,0.72 NATOPS,0.9277777777777778 +NewsHeadlineSentiment_disc,0.5507194100436856 +NewsTitleSentiment_disc,0.6248647348803655 +OpenCloseFist,0.7584745762711864 +Opportunity,0.8337178008458286 PEMS-SF,1.0 PenDigits,0.9797026872498571 PhonemeSpectra,0.31404712198031615 PhotoStimulation,0.4166666666666667 +PronouncedSpeech,0.3 RacketSports,0.9013157894736842 +SPHERE-WUS,1.0 STEW,0.8209876543209876 SelfRegulationSCP1,0.8972602739726028 +SelfRegulationSCP2,0.5222222222222223 +ShortIntervalTask,0.24 +SitStand,0.4228125 Skoda,0.960382030420941 +SongFamiliarity,0.3407202216066482 SpokenArabicDigits,0.9881764438381082 StandWalkJump,0.4 TactileTextureRecognition,1.0 Tiselac,0.7703741152679474 +UCDHE-MP,0.75 +UCDHE-MP-MC,0.7458563535911602 +UCDHE-Rowing,0.25555555555555554 UCDHE-Rowing-MC,0.7886363636363637 UCIActivity,0.9862557267805081 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,1.0 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.8888888888888888 +UIPRMD-SSIER-C,0.7 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,1.0 USCActivity,0.74726609963548 UWaveGestureLibrary,0.940625 +VisualSpeech,0.31 WISDM,0.8810121692099672 diff --git a/results/multiverse/HC2/HC2_specificity.csv b/results/multiverse/HC2/HC2_specificity.csv index fa69522..86eb223 100644 --- a/results/multiverse/HC2/HC2_specificity.csv +++ b/results/multiverse/HC2/HC2_specificity.csv @@ -3,18 +3,21 @@ Alzheimers,0.3953488372093023 AppliancesEnergy_disc,0.9705882352941176 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8567774936061381 +AsphaltPavementTypeCoordinates,0.8920454545454546 AsphaltRegularityCoordinates,0.952755905511811 AtrialFibrillation,0.3333333333333333 AustraliaRainfall_disc,0.7653958944281525 AutomotiveRoadTrials,0.9310344827586207 BIDMC32HR_disc,0.9362234264276782 BIDMC32SpO2_disc,0.9201631701631702 +BasicMotions,1.0 BeijingPM10Quality_disc,0.9576601671309192 BeijingPM25Quality_disc,0.9670641680863146 BenzeneConcentration_disc,0.9823083403538332 Blink,1.0 BoneIntensitiesAgeGroup,0.8202247191011236 BoneProbAgeGroup,0.6876404494382022 +ButtonPress,1.0 CharacterTrajectories,0.9930362116991643 CounterMovementJump,0.9217877094972067 Cricket,1.0 @@ -27,6 +30,9 @@ Epilepsy,1.0 EthanolConcentration,0.7034220532319392 EyesOpenShut,0.09523809523809523 FaceDetection,0.6543700340522134 +FeedbackButton,0.52 +FeetHands,0.6411332633788038 +FingerMovements,0.39215686274509803 FordChallenge,0.9781021897810219 HandMovementDirection,0.40540540540540543 Handwriting,0.6141176470588235 @@ -34,34 +40,83 @@ Heartbeat,0.9662162162162162 HouseholdPowerConsumption1_disc,0.9008746355685131 HouseholdPowerConsumption2_disc,0.7871720116618076 IEEEPPG_disc,0.6265060240963856 +IRDS-EFL,1.0 +IRDS-EFR,1.0 +IRDS-SAL,0.5952380952380952 +IRDS-SAR,0.10344827586206896 +IRDS-SFE,1.0 IRDS-SFL,0.7717391304347826 +IRDS-SFR,0.8461538461538461 +IRDS-STL,1.0 +IRDS-STR,1.0 +ImaginedFeetHands,0.7066115702479339 +ImaginedOpenCloseFist,0.718816067653277 +InnerSpeech,0.32 JapaneseVowels,0.9405405405405406 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,1.0 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.875 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,0.0 +KIMORE-LT-C,0.0 KIMORE-PR-C,0.0 +KIMORE-Sq-C,0.0 +KIMORE-TR-C,0.0 +KINECAL-3WFV,1.0 +KINECAL-GGFV,1.0 +KINECAL-QSEC,1.0 KINECAL-QSEO,1.0 LSST,0.6751824817518248 Libras,0.9277777777777778 +LiveFuelMoistureContent_disc,0.9574803149606299 Locust2022,0.9627411842980705 +LongIntervalTask,0.9355263157894737 LowCost,0.7533333333333333 +MatchingPennies,0.5454545454545454 MindReading,0.5880551301684533 MotionSenseHAR,1.0 MotorImagery,0.46 NATOPS,0.9277777777777778 +NewsHeadlineSentiment_disc,0.5507194100436856 +NewsTitleSentiment_disc,0.6248647348803655 +OpenCloseFist,0.7706131078224101 +Opportunity,0.8337178008458286 PEMS-SF,1.0 PenDigits,0.9797026872498571 PhonemeSpectra,0.31404712198031615 PhotoStimulation,0.4166666666666667 +PronouncedSpeech,0.3 RacketSports,0.9013157894736842 +SPHERE-WUS,1.0 STEW,0.8686868686868687 SelfRegulationSCP1,0.8843537414965986 +SelfRegulationSCP2,0.5888888888888889 +ShortIntervalTask,0.925 +SitStand,0.4228125 Skoda,0.960382030420941 +SongFamiliarity,0.6812339331619537 SpokenArabicDigits,0.9881764438381082 StandWalkJump,0.4 TactileTextureRecognition,1.0 Tiselac,0.7703741152679474 +UCDHE-MP,0.9236641221374046 +UCDHE-MP-MC,0.7458563535911602 +UCDHE-Rowing,0.9685714285714285 UCDHE-Rowing-MC,0.7886363636363637 UCIActivity,0.9862557267805081 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.4444444444444444 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,0.8888888888888888 +UIPRMD-STS-C,0.9444444444444444 USCActivity,0.74726609963548 UWaveGestureLibrary,0.940625 +VisualSpeech,0.31 WISDM,0.8810121692099672 diff --git a/results/multiverse/LITETime-MV/LITETime-MV_accuracy.csv b/results/multiverse/LITETime-MV/LITETime-MV_accuracy.csv index c0c616d..32b7824 100644 --- a/results/multiverse/LITETime-MV/LITETime-MV_accuracy.csv +++ b/results/multiverse/LITETime-MV/LITETime-MV_accuracy.csv @@ -3,18 +3,22 @@ Alzheimers,0.37209302325581395 AppliancesEnergy_disc,0.7380952380952381 ArticularyWordRecognition,0.9833333333333333 AsphaltObstaclesCoordinates,0.8465473145780051 +AsphaltPavementTypeCoordinates,0.9649621212121212 AsphaltRegularityCoordinates,0.9946737683089214 AtrialFibrillation,0.2 AustraliaRainfall_disc,0.7807865892972276 AutomotiveRoadTrials,0.8051948051948052 BIDMC32HR_disc,0.7294706127553147 +BIDMC32RR_disc,0.6761150479366402 BIDMC32SpO2_disc,0.7169654022509379 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8171553090332805 BeijingPM25Quality_disc,0.8809429477020603 BenzeneConcentration_disc,0.8781716056556266 Blink,0.6866666666666666 BoneIntensitiesAgeGroup,0.7887640449438202 BoneProbAgeGroup,0.7056179775280899 +ButtonPress,0.9833333333333333 CharacterTrajectories,0.9958217270194986 CounterMovementJump,0.7094972067039106 Cricket,0.9861111111111112 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.27756653992395436 EyesOpenShut,0.4523809523809524 FaceDetection,0.648410896708286 +FeedbackButton,0.52 +FeetHands,0.6105820105820106 +FingerMovements,0.64 FordChallenge,0.8781362007168458 HandMovementDirection,0.35135135135135137 Handwriting,0.6376470588235295 @@ -34,34 +41,86 @@ Heartbeat,0.7317073170731707 HouseholdPowerConsumption1_disc,0.9169096209912536 HouseholdPowerConsumption2_disc,0.7376093294460642 IEEEPPG_disc,0.3757530120481928 +IRDS-EFL,0.6538461538461539 +IRDS-EFR,0.8666666666666667 +IRDS-SAL,0.35714285714285715 +IRDS-SAR,0.7575757575757576 +IRDS-SFE,0.8 IRDS-SFL,0.646551724137931 +IRDS-SFR,0.5333333333333333 +IRDS-STL,0.5526315789473685 +IRDS-STR,0.6666666666666666 +ImaginedFeetHands,0.6191214470284238 +ImaginedOpenCloseFist,0.6941798941798942 +InnerSpeech,0.255 JapaneseVowels,0.9945945945945946 +KERAAL-CTK,0.9285714285714286 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.6 +KERAAL-ELK-MC,0.6428571428571429 KERAAL-RTK,0.8571428571428571 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,0.5714285714285714 +KIMORE-LT-C,0.7142857142857143 KIMORE-PR-C,0.7142857142857143 +KIMORE-Sq-C,0.5714285714285714 +KIMORE-TR-C,0.2857142857142857 +KINECAL-3WFV,1.0 +KINECAL-GGFV,0.9230769230769231 +KINECAL-QSEC,0.8888888888888888 KINECAL-QSEO,0.8235294117647058 LSST,0.2562854825628548 Libras,0.9222222222222223 +LiveFuelMoistureContent_disc,0.7543046357615895 Locust2022,0.9023946650500152 +LongIntervalTask,0.7071428571428572 LowCost,0.5716666666666667 +MatchingPennies,0.54 MindReading,0.7243491577335375 MotionSenseHAR,0.9811320754716981 MotorImagery,0.49 NATOPS,0.9666666666666667 +NewsHeadlineSentiment_disc,0.5396577291491323 +NewsTitleSentiment_disc,0.6125606188128733 +OpenCloseFist,0.7312169312169312 +Opportunity,0.8360246059207997 +PAMAP2,0.8196058615462355 PEMS-SF,0.7283236994219653 +PPGDalia_disc,0.7907085001396518 PenDigits,0.9862778730703259 PhonemeSpectra,0.31673128541604534 PhotoStimulation,0.19444444444444445 +PronouncedSpeech,0.245 RacketSports,0.881578947368421 +SPHERE-WUS,0.75 STEW,0.6285072951739619 SelfRegulationSCP1,0.7986348122866894 +SelfRegulationSCP2,0.5166666666666667 +ShortIntervalTask,0.6875 +SitStand,0.3209375 Skoda,0.9621506897771489 +SongFamiliarity,0.5186666666666667 SpokenArabicDigits,0.9927239654388358 StandWalkJump,0.4666666666666667 TactileTextureRecognition,1.0 Tiselac,0.8046006066734075 +UCDHE-MP,0.8591160220994475 +UCDHE-MP-MC,0.8342541436464088 +UCDHE-Rowing,0.7977272727272727 UCDHE-Rowing-MC,0.725 UCIActivity,0.9983340274885465 UIPRMD-DS-C,0.8611111111111112 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.5 +UIPRMD-SASLR-C,0.9 +UIPRMD-SL-C,0.6111111111111112 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.7777777777777778 +UIPRMD-SSIER-C,0.5 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.6944444444444444 USCActivity,0.7354191980558931 UWaveGestureLibrary,0.915625 +VisualSpeech,0.26 WISDM,0.8514583735754297 +WISDM2,0.5907145661562623 diff --git a/results/multiverse/LITETime-MV/LITETime-MV_auroc.csv b/results/multiverse/LITETime-MV/LITETime-MV_auroc.csv index 072d13f..7579ed8 100644 --- a/results/multiverse/LITETime-MV/LITETime-MV_auroc.csv +++ b/results/multiverse/LITETime-MV/LITETime-MV_auroc.csv @@ -3,18 +3,22 @@ Alzheimers,0.48631214915797916 AppliancesEnergy_disc,0.6691176470588236 ArticularyWordRecognition,0.9999652777777777 AsphaltObstaclesCoordinates,0.9632390208934658 +AsphaltPavementTypeCoordinates,0.9920285638256361 AsphaltRegularityCoordinates,0.9979499184223594 AtrialFibrillation,0.38000000000000006 AustraliaRainfall_disc,0.864305634631017 AutomotiveRoadTrials,0.8774954627949184 BIDMC32HR_disc,0.8726188977281312 +BIDMC32RR_disc,0.6484241114236348 BIDMC32SpO2_disc,0.6625690683157739 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8711186193931475 BeijingPM25Quality_disc,0.9316868394357729 BenzeneConcentration_disc,0.9547261023411833 Blink,0.86422 BoneIntensitiesAgeGroup,0.9135613378526256 BoneProbAgeGroup,0.8587991111073268 +ButtonPress,0.9997183891861448 CharacterTrajectories,0.9999923820862459 CounterMovementJump,0.8896311597264605 Cricket,1.0 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.530595371015359 EyesOpenShut,0.3378684807256236 FaceDetection,0.705325473709707 +FeedbackButton,0.5156506616257088 +FeetHands,0.6536114119205654 +FingerMovements,0.671468587434974 FordChallenge,0.9399187092345329 HandMovementDirection,0.6429146018129069 Handwriting,0.9466923095749503 @@ -34,34 +41,86 @@ Heartbeat,0.7889995258416311 HouseholdPowerConsumption1_disc,0.9572509343341516 HouseholdPowerConsumption2_disc,0.7937213746714066 IEEEPPG_disc,0.7290520650565829 +IRDS-EFL,0.8333333333333333 +IRDS-EFR,0.94 +IRDS-SAL,0.5221088435374149 +IRDS-SAR,0.9310344827586207 +IRDS-SFE,1.0 IRDS-SFL,0.8704710144927537 +IRDS-SFR,0.4230769230769231 +IRDS-STL,0.38383838383838387 +IRDS-STR,0.8509090909090908 +ImaginedFeetHands,0.6677682745476766 +ImaginedOpenCloseFist,0.7818653250080625 +InnerSpeech,0.5006373075451767 JapaneseVowels,0.9999428574256888 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9217032967032966 +KERAAL-ELK,0.375 +KERAAL-ELK-MC,0.4725274725274725 KERAAL-RTK,0.9375 +KERAAL-RTK-MC,0.36217948717948717 +KIMORE-LA-C,0.6666666666666666 +KIMORE-LT-C,0.8333333333333333 KIMORE-PR-C,0.6666666666666667 +KIMORE-Sq-C,0.8 +KIMORE-TR-C,0.6666666666666667 +KINECAL-3WFV,1.0 +KINECAL-GGFV,1.0 +KINECAL-QSEC,0.8823529411764706 KINECAL-QSEO,0.5 LSST,0.7133470369202115 Libras,0.9927579365079364 +LiveFuelMoistureContent_disc,0.4922342519685039 Locust2022,0.8233635118840816 +LongIntervalTask,0.7256231725146199 LowCost,0.6029222222222224 +MatchingPennies,0.5466219305120167 MindReading,0.9082668536217932 MotionSenseHAR,0.9999284628453904 MotorImagery,0.5539999999999999 NATOPS,0.9975555555555555 +NewsHeadlineSentiment_disc,0.5069647173955599 +NewsTitleSentiment_disc,0.5021930161877898 +OpenCloseFist,0.8037409968825027 +Opportunity,0.9391187883264219 +PAMAP2,0.963468694350875 PEMS-SF,0.9546364508335139 +PPGDalia_disc,0.9032820776535296 PenDigits,0.9997620196456621 PhonemeSpectra,0.895882682094638 PhotoStimulation,0.32233414733414734 +PronouncedSpeech,0.5078253555350871 RacketSports,0.9642447575360419 +SPHERE-WUS,1.0 STEW,0.8105854734525703 SelfRegulationSCP1,0.9439940359705526 +SelfRegulationSCP2,0.5458024691358025 +ShortIntervalTask,0.7469079861111111 +SitStand,0.6698041015625 Skoda,0.9964683556185113 +SongFamiliarity,0.5352455689351914 SpokenArabicDigits,0.9999721956636201 StandWalkJump,0.5666666666666667 TactileTextureRecognition,1.0 Tiselac,0.9564817010886152 +UCDHE-MP,0.9155152671755725 +UCDHE-MP-MC,0.9463928831615922 +UCDHE-Rowing,0.8295555555555556 UCDHE-Rowing-MC,0.927240132416603 UCIActivity,0.9999964284902878 UIPRMD-DS-C,0.9722222222222222 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.9506172839506173 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.8271604938271605 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.8900000000000001 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.8055555555555556 USCActivity,0.9679098618494566 UWaveGestureLibrary,0.9905468749999999 +VisualSpeech,0.5123532939183262 WISDM,0.9486283577144307 +WISDM2,0.8917960689078152 diff --git a/results/multiverse/LITETime-MV/LITETime-MV_balacc.csv b/results/multiverse/LITETime-MV/LITETime-MV_balacc.csv index df77ef7..e870b21 100644 --- a/results/multiverse/LITETime-MV/LITETime-MV_balacc.csv +++ b/results/multiverse/LITETime-MV/LITETime-MV_balacc.csv @@ -3,18 +3,22 @@ Alzheimers,0.3975468975468975 AppliancesEnergy_disc,0.5992647058823529 ArticularyWordRecognition,0.9833333333333333 AsphaltObstaclesCoordinates,0.8445456345546671 +AsphaltPavementTypeCoordinates,0.961926247771836 AsphaltRegularityCoordinates,0.994750656167979 AtrialFibrillation,0.20000000000000004 AustraliaRainfall_disc,0.42746826627907747 AutomotiveRoadTrials,0.7999092558983666 BIDMC32HR_disc,0.6553576317196769 +BIDMC32RR_disc,0.4188016320968728 BIDMC32SpO2_disc,0.5553702641916405 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7787832762092537 BeijingPM25Quality_disc,0.8567441277184491 BenzeneConcentration_disc,0.8083187927474818 Blink,0.718 BoneIntensitiesAgeGroup,0.821605074131135 BoneProbAgeGroup,0.7193009953069177 +ButtonPress,0.9850746268656716 CharacterTrajectories,0.9955185131848439 CounterMovementJump,0.7095103578154426 Cricket,0.9861111111111112 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.2776223776223776 EyesOpenShut,0.4523809523809524 FaceDetection,0.648410896708286 +FeedbackButton,0.52 +FeetHands,0.6110916378206888 +FingerMovements,0.6398559423769508 FordChallenge,0.8780677365852877 HandMovementDirection,0.38095238095238093 Handwriting,0.6328252822740965 @@ -34,34 +41,86 @@ Heartbeat,0.7063181602655286 HouseholdPowerConsumption1_disc,0.7703816405501503 HouseholdPowerConsumption2_disc,0.6391817720584844 IEEEPPG_disc,0.4365228499734055 +IRDS-EFL,0.625 +IRDS-EFR,0.8500000000000001 +IRDS-SAL,0.47619047619047616 +IRDS-SAR,0.8620689655172413 +IRDS-SFE,0.7 IRDS-SFL,0.7771739130434783 +IRDS-SFR,0.3076923076923077 +IRDS-STL,0.4158249158249158 +IRDS-STR,0.7272727272727273 +ImaginedFeetHands,0.6190874263932926 +ImaginedOpenCloseFist,0.6940910882574265 +InnerSpeech,0.2589056080697418 JapaneseVowels,0.9962121212121211 +KERAAL-CTK,0.9285714285714286 +KERAAL-CTK-MC,0.6666666666666666 +KERAAL-ELK,0.375 +KERAAL-ELK-MC,0.34615384615384615 KERAAL-RTK,0.875 +KERAAL-RTK-MC,0.29523809523809524 +KIMORE-LA-C,0.625 +KIMORE-LT-C,0.7083333333333333 KIMORE-PR-C,0.8333333333333333 +KIMORE-Sq-C,0.55 +KIMORE-TR-C,0.5833333333333334 +KINECAL-3WFV,1.0 +KINECAL-GGFV,0.9583333333333333 +KINECAL-QSEC,0.47058823529411764 KINECAL-QSEO,0.4375 LSST,0.22315839985987948 Libras,0.922222222222222 +LiveFuelMoistureContent_disc,0.4720800524934383 Locust2022,0.6599724328362615 +LongIntervalTask,0.6672514619883041 LowCost,0.5716666666666667 +MatchingPennies,0.5395441483803552 MindReading,0.7193110505129203 MotionSenseHAR,0.9867849069727005 MotorImagery,0.49 NATOPS,0.9666666666666667 +NewsHeadlineSentiment_disc,0.33300909138361146 +NewsTitleSentiment_disc,0.33568925211311723 +OpenCloseFist,0.73122894793421 +Opportunity,0.8497151423389921 +PAMAP2,0.833226381640572 PEMS-SF,0.7303938251764339 +PPGDalia_disc,0.7408498915196157 PenDigits,0.9863922475082585 PhonemeSpectra,0.31681223473289133 PhotoStimulation,0.18585858585858586 +PronouncedSpeech,0.24019607843137253 RacketSports,0.8909883720930233 +SPHERE-WUS,0.75 STEW,0.6285072951739619 SelfRegulationSCP1,0.7992731339110987 +SelfRegulationSCP2,0.5166666666666666 +ShortIntervalTask,0.6463888888888889 +SitStand,0.3209375 Skoda,0.9626380339844993 +SongFamiliarity,0.5191413454485897 SpokenArabicDigits,0.992725197177252 StandWalkJump,0.4666666666666666 TactileTextureRecognition,1.0 Tiselac,0.6319782136445493 +UCDHE-MP,0.8686641221374045 +UCDHE-MP-MC,0.8359480676328502 +UCDHE-Rowing,0.6747619047619048 UCDHE-Rowing-MC,0.7304206349206349 UCIActivity,0.9984037701429006 UIPRMD-DS-C,0.8611111111111112 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.5 +UIPRMD-SASLR-C,0.9 +UIPRMD-SL-C,0.6111111111111112 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.7777777777777778 +UIPRMD-SSIER-C,0.5 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.6944444444444444 USCActivity,0.7302424161830618 UWaveGestureLibrary,0.915625 +VisualSpeech,0.25730292116846737 WISDM,0.5326272367992533 +WISDM2,0.5528342707234833 diff --git a/results/multiverse/LITETime-MV/LITETime-MV_f1.csv b/results/multiverse/LITETime-MV/LITETime-MV_f1.csv index e27453c..5bb8638 100644 --- a/results/multiverse/LITETime-MV/LITETime-MV_f1.csv +++ b/results/multiverse/LITETime-MV/LITETime-MV_f1.csv @@ -3,18 +3,22 @@ Alzheimers,0.3486164861291252 AppliancesEnergy_disc,0.35294117647058826 ArticularyWordRecognition,0.9832751190838148 AsphaltObstaclesCoordinates,0.8464567165319162 +AsphaltPavementTypeCoordinates,0.9650646669831086 AsphaltRegularityCoordinates,0.9946236559139785 AtrialFibrillation,0.22299922299922298 AustraliaRainfall_disc,0.7707116905532909 AutomotiveRoadTrials,0.6666666666666666 BIDMC32HR_disc,0.727092969217832 +BIDMC32RR_disc,0.6761053361699687 BIDMC32SpO2_disc,0.26594594594594595 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6848753840901332 BeijingPM25Quality_disc,0.8015846814130075 BenzeneConcentration_disc,0.7607455306200076 Blink,0.7393715341959335 BoneIntensitiesAgeGroup,0.7873595930385673 BoneProbAgeGroup,0.7081793526117431 +ButtonPress,0.9814814814814815 CharacterTrajectories,0.9958199098383662 CounterMovementJump,0.7175752760102376 Cricket,0.9860139860139859 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.25700759789535843 EyesOpenShut,0.14814814814814814 FaceDetection,0.6538139145012574 +FeedbackButton,0.5290102389078498 +FeetHands,0.6308926780341023 +FingerMovements,0.6326530612244898 FordChallenge,0.844420978528687 HandMovementDirection,0.3471507576734127 Handwriting,0.617372334194666 @@ -34,34 +41,86 @@ Heartbeat,0.5736434108527132 HouseholdPowerConsumption1_disc,0.9110820941724731 HouseholdPowerConsumption2_disc,0.7422584851427164 IEEEPPG_disc,0.3162689779630223 +IRDS-EFL,0.4 +IRDS-EFR,0.8 +IRDS-SAL,0.35714285714285715 +IRDS-SAR,0.5 +IRDS-SFE,0.5714285714285714 IRDS-SFL,0.5393258426966292 +IRDS-SFR,0.0 +IRDS-STL,0.10526315789473684 +IRDS-STR,0.2857142857142857 +ImaginedFeetHands,0.5921416712783619 +ImaginedOpenCloseFist,0.6658959537572254 +InnerSpeech,0.21328841423790162 JapaneseVowels,0.9946037526466939 +KERAAL-CTK,0.9230769230769231 +KERAAL-CTK-MC,0.8956043956043956 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.7267080745341615 KERAAL-RTK,0.8571428571428571 +KERAAL-RTK-MC,0.36063936063936064 +KIMORE-LA-C,0.6666666666666666 +KIMORE-LT-C,0.6666666666666666 KIMORE-PR-C,0.5 +KIMORE-Sq-C,0.4 +KIMORE-TR-C,0.2857142857142857 +KINECAL-3WFV,1.0 +KINECAL-GGFV,0.6666666666666666 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.2590945075171681 Libras,0.9217052480530743 +LiveFuelMoistureContent_disc,0.07017543859649122 Locust2022,0.39925373134328357 +LongIntervalTask,0.5494505494505495 LowCost,0.482897384305835 +MatchingPennies,0.4984423676012461 MindReading,0.7241043243267065 MotionSenseHAR,0.9818567139482428 MotorImagery,0.0 NATOPS,0.9663299663299664 +NewsHeadlineSentiment_disc,0.40420152960362465 +NewsTitleSentiment_disc,0.48867072151887136 +OpenCloseFist,0.7340314136125654 +Opportunity,0.834480677485966 +PAMAP2,0.8077084331153804 PEMS-SF,0.7233631798909251 +PPGDalia_disc,0.7893089509153219 PenDigits,0.9862512991710674 PhonemeSpectra,0.31398666120895563 PhotoStimulation,0.19217171717171716 +PronouncedSpeech,0.15127970939283863 RacketSports,0.8814064225248435 +SPHERE-WUS,0.6666666666666666 STEW,0.43442973088423753 SelfRegulationSCP1,0.829971181556196 +SelfRegulationSCP2,0.5084745762711864 +ShortIntervalTask,0.5345744680851063 +SitStand,0.27950102695471524 Skoda,0.9621294808571539 +SongFamiliarity,0.5154362416107383 SpokenArabicDigits,0.9927098789144224 StandWalkJump,0.46296296296296297 TactileTextureRecognition,1.0 Tiselac,0.7961055469219475 +UCDHE-MP,0.777292576419214 +UCDHE-MP-MC,0.8320720056375263 +UCDHE-Rowing,0.48554913294797686 UCDHE-Rowing-MC,0.7258363143372564 UCIActivity,0.9983329639690477 UIPRMD-DS-C,0.8387096774193549 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.0 +UIPRMD-SASLR-C,0.8888888888888888 +UIPRMD-SL-C,0.36363636363636365 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.8181818181818182 +UIPRMD-SSIER-C,0.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.6206896551724138 USCActivity,0.733263664261814 UWaveGestureLibrary,0.9136804666474013 +VisualSpeech,0.16088647670737224 WISDM,0.833454301287835 +WISDM2,0.5697098771668044 diff --git a/results/multiverse/LITETime-MV/LITETime-MV_logloss.csv b/results/multiverse/LITETime-MV/LITETime-MV_logloss.csv index 9d271ab..8561d09 100644 --- a/results/multiverse/LITETime-MV/LITETime-MV_logloss.csv +++ b/results/multiverse/LITETime-MV/LITETime-MV_logloss.csv @@ -3,18 +3,22 @@ Alzheimers,2.8925519964041833 AppliancesEnergy_disc,0.7931315410199705 ArticularyWordRecognition,0.0453026303159339 AsphaltObstaclesCoordinates,0.5865963261770253 +AsphaltPavementTypeCoordinates,0.23185166492580125 AsphaltRegularityCoordinates,0.05874106239520328 AtrialFibrillation,4.215465510356132 AustraliaRainfall_disc,0.5013895485455677 AutomotiveRoadTrials,0.6727267956366676 BIDMC32HR_disc,0.7052161341712502 +BIDMC32RR_disc,2.4407039197798857 BIDMC32SpO2_disc,1.7655444897563044 +BasicMotions,0.0017526110723370112 BeijingPM10Quality_disc,1.2368784276373328 BeijingPM25Quality_disc,0.8818793532620074 BenzeneConcentration_disc,0.3402815151632758 Blink,1.6287900401328028 BoneIntensitiesAgeGroup,0.9677021316703888 BoneProbAgeGroup,0.9104343293696944 +ButtonPress,0.06464177090941725 CharacterTrajectories,0.014795605589689727 CounterMovementJump,1.000043509703851 Cricket,0.044517669974765556 @@ -27,6 +31,9 @@ Epilepsy,0.007992343923173962 EthanolConcentration,2.935183730040024 EyesOpenShut,1.9723718641165537 FaceDetection,1.5637312435235962 +FeedbackButton,1.6275315255731233 +FeetHands,1.8142634680240373 +FingerMovements,1.424682277704745 FordChallenge,0.6572025725391105 HandMovementDirection,1.4989165889301135 Handwriting,1.4352221237093838 @@ -34,34 +41,86 @@ Heartbeat,0.7736058057228689 HouseholdPowerConsumption1_disc,0.44804839123602935 HouseholdPowerConsumption2_disc,1.5221068673966152 IEEEPPG_disc,4.598617110573772 +IRDS-EFL,1.265532957443922 +IRDS-EFR,0.44172469865413017 +IRDS-SAL,2.4941878400043214 +IRDS-SAR,0.8478340250589761 +IRDS-SFE,0.26495219578207535 IRDS-SFL,1.6860510580385286 +IRDS-SFR,1.2972618338567619 +IRDS-STL,1.709031013978342 +IRDS-STR,0.6581256446958865 +ImaginedFeetHands,1.0682437672738827 +ImaginedOpenCloseFist,1.353748087915906 +InnerSpeech,15.246935163441663 JapaneseVowels,0.025677144704220112 +KERAAL-CTK,0.14114857785604212 +KERAAL-CTK-MC,0.6747636960805633 +KERAAL-ELK,1.543325463302163 +KERAAL-ELK-MC,0.6831447755478512 KERAAL-RTK,0.406294061651103 +KERAAL-RTK-MC,3.4021069311229253 +KIMORE-LA-C,2.3357668938276426 +KIMORE-LT-C,0.945095056238742 KIMORE-PR-C,1.3004560366116447 +KIMORE-Sq-C,0.9206987775338046 +KIMORE-TR-C,3.92182255495189 +KINECAL-3WFV,0.07677983589064075 +KINECAL-GGFV,0.1148592233997267 +KINECAL-QSEC,0.21595695839205264 KINECAL-QSEO,0.5082707708724866 LSST,9.978445794892213 Libras,0.35278652057185994 +LiveFuelMoistureContent_disc,1.792263238767121 Locust2022,0.8435897080826426 +LongIntervalTask,3.1784656217347993 LowCost,2.06909744069294 +MatchingPennies,1.4560826321417666 MindReading,1.2007299830582472 MotionSenseHAR,0.05927062334900681 MotorImagery,0.9202597744563344 NATOPS,0.10773289583423075 +NewsHeadlineSentiment_disc,1.02772137407309 +NewsTitleSentiment_disc,0.959478135640911 +OpenCloseFist,1.2032034439350678 +Opportunity,1.5093518337395282 +PAMAP2,2.0991876250894905 PEMS-SF,0.8771946410301538 +PPGDalia_disc,1.2072512911670124 PenDigits,0.06040722864852312 PhonemeSpectra,4.176773261582212 PhotoStimulation,3.3490729624635645 +PronouncedSpeech,11.763400646167847 RacketSports,0.40225022624922646 +SPHERE-WUS,0.7163481319724033 STEW,2.914516308229351 SelfRegulationSCP1,0.8194323010781825 +SelfRegulationSCP2,1.1395837932284736 +ShortIntervalTask,1.5686714506721802 +SitStand,4.565706145211944 Skoda,0.29977946688606544 +SongFamiliarity,2.030075611807344 SpokenArabicDigits,0.019838657878749555 StandWalkJump,2.8181260997045907 TactileTextureRecognition,2.009612918797206e-05 Tiselac,2.074973888973312 +UCDHE-MP,0.7795892897065868 +UCDHE-MP-MC,1.3079272949613598 +UCDHE-Rowing,1.2801183278915673 UCDHE-Rowing-MC,1.4178648272007262 UCIActivity,0.006392880331184545 UIPRMD-DS-C,0.301362253522471 +UIPRMD-HS-C,0.07798781296797042 +UIPRMD-IL-C,3.629991296414263 +UIPRMD-SASLR-C,0.21520783131341364 +UIPRMD-SL-C,1.1478705396853106 +UIPRMD-SSA-C,0.0007048819770638357 +UIPRMD-SSE-C,0.2988812562111771 +UIPRMD-SSIER-C,3.73321546874321 +UIPRMD-SSS-C,0.000881720558500288 +UIPRMD-STS-C,1.7140073730476515 USCActivity,2.195948371998758 UWaveGestureLibrary,0.3028806913093815 +VisualSpeech,13.762141720922891 WISDM,1.9153396945443268 +WISDM2,2.4706537626407483 diff --git a/results/multiverse/LITETime-MV/LITETime-MV_sensitivity.csv b/results/multiverse/LITETime-MV/LITETime-MV_sensitivity.csv index 6dfdc30..a00d556 100644 --- a/results/multiverse/LITETime-MV/LITETime-MV_sensitivity.csv +++ b/results/multiverse/LITETime-MV/LITETime-MV_sensitivity.csv @@ -3,18 +3,22 @@ Alzheimers,0.37209302325581395 AppliancesEnergy_disc,0.375 ArticularyWordRecognition,0.9833333333333333 AsphaltObstaclesCoordinates,0.8465473145780051 +AsphaltPavementTypeCoordinates,0.9649621212121212 AsphaltRegularityCoordinates,1.0 AtrialFibrillation,0.2 AustraliaRainfall_disc,0.7807865892972276 AutomotiveRoadTrials,0.7894736842105263 BIDMC32HR_disc,0.7294706127553147 +BIDMC32RR_disc,0.6761150479366402 BIDMC32SpO2_disc,0.1800878477306003 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6879286694101509 BeijingPM25Quality_disc,0.7955439056356488 BenzeneConcentration_disc,0.6242197253433208 Blink,1.0 BoneIntensitiesAgeGroup,0.7887640449438202 BoneProbAgeGroup,0.7056179775280899 +ButtonPress,1.0 CharacterTrajectories,0.9958217270194986 CounterMovementJump,0.7094972067039106 Cricket,0.9861111111111112 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.27756653992395436 EyesOpenShut,0.09523809523809523 FaceDetection,0.6640181611804767 +FeedbackButton,0.5391304347826087 +FeetHands,0.6712913553895411 +FingerMovements,0.6326530612244898 FordChallenge,0.8777899743871204 HandMovementDirection,0.35135135135135137 Handwriting,0.6376470588235295 @@ -34,34 +41,86 @@ Heartbeat,0.6491228070175439 HouseholdPowerConsumption1_disc,0.9169096209912536 HouseholdPowerConsumption2_disc,0.7376093294460642 IEEEPPG_disc,0.3757530120481928 +IRDS-EFL,0.25 +IRDS-EFR,0.8 +IRDS-SAL,0.7142857142857143 +IRDS-SAR,1.0 +IRDS-SFE,0.4 IRDS-SFL,1.0 +IRDS-SFR,0.0 +IRDS-STL,0.09090909090909091 +IRDS-STR,0.8 +ImaginedFeetHands,0.5532574974146846 +ImaginedOpenCloseFist,0.6101694915254238 +InnerSpeech,0.255 JapaneseVowels,0.9945945945945946 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.6428571428571429 KERAAL-RTK,1.0 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,1.0 +KIMORE-LT-C,0.6666666666666666 KIMORE-PR-C,1.0 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,1.0 +KINECAL-3WFV,1.0 +KINECAL-GGFV,1.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.2562854825628548 Libras,0.9222222222222223 +LiveFuelMoistureContent_disc,0.058333333333333334 Locust2022,0.3651877133105802 +LongIntervalTask,0.5555555555555556 LowCost,0.4 +MatchingPennies,0.45977011494252873 MindReading,0.7243491577335375 MotionSenseHAR,0.9811320754716981 MotorImagery,0.0 NATOPS,0.9666666666666667 +NewsHeadlineSentiment_disc,0.5396577291491323 +NewsTitleSentiment_disc,0.6125606188128733 +OpenCloseFist,0.7425847457627118 +Opportunity,0.8360246059207997 +PAMAP2,0.8196058615462355 PEMS-SF,0.7283236994219653 +PPGDalia_disc,0.7907085001396518 PenDigits,0.9862778730703259 PhonemeSpectra,0.31673128541604534 PhotoStimulation,0.19444444444444445 +PronouncedSpeech,0.245 RacketSports,0.881578947368421 +SPHERE-WUS,0.5 STEW,0.28535353535353536 SelfRegulationSCP1,0.9863013698630136 +SelfRegulationSCP2,0.5 +ShortIntervalTask,0.5025 +SitStand,0.3209375 Skoda,0.9621506897771489 +SongFamiliarity,0.5318559556786704 SpokenArabicDigits,0.9927239654388358 StandWalkJump,0.4666666666666667 TactileTextureRecognition,1.0 Tiselac,0.8046006066734075 +UCDHE-MP,0.89 +UCDHE-MP-MC,0.8342541436464088 +UCDHE-Rowing,0.4666666666666667 UCDHE-Rowing-MC,0.725 UCIActivity,0.9983340274885465 UIPRMD-DS-C,0.7222222222222222 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.0 +UIPRMD-SASLR-C,0.8 +UIPRMD-SL-C,0.2222222222222222 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.5 USCActivity,0.7354191980558931 UWaveGestureLibrary,0.915625 +VisualSpeech,0.26 WISDM,0.8514583735754297 +WISDM2,0.5907145661562623 diff --git a/results/multiverse/LITETime-MV/LITETime-MV_specificity.csv b/results/multiverse/LITETime-MV/LITETime-MV_specificity.csv index c115cd7..ab33645 100644 --- a/results/multiverse/LITETime-MV/LITETime-MV_specificity.csv +++ b/results/multiverse/LITETime-MV/LITETime-MV_specificity.csv @@ -3,18 +3,22 @@ Alzheimers,0.37209302325581395 AppliancesEnergy_disc,0.8235294117647058 ArticularyWordRecognition,0.9833333333333333 AsphaltObstaclesCoordinates,0.8465473145780051 +AsphaltPavementTypeCoordinates,0.9649621212121212 AsphaltRegularityCoordinates,0.989501312335958 AtrialFibrillation,0.2 AustraliaRainfall_disc,0.7807865892972276 AutomotiveRoadTrials,0.8103448275862069 BIDMC32HR_disc,0.7294706127553147 +BIDMC32RR_disc,0.6761150479366402 BIDMC32SpO2_disc,0.9306526806526807 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8696378830083565 BeijingPM25Quality_disc,0.9179443498012493 BenzeneConcentration_disc,0.9924178601516428 Blink,0.436 BoneIntensitiesAgeGroup,0.7887640449438202 BoneProbAgeGroup,0.7056179775280899 +ButtonPress,0.9701492537313433 CharacterTrajectories,0.9958217270194986 CounterMovementJump,0.7094972067039106 Cricket,0.9861111111111112 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.27756653992395436 EyesOpenShut,0.8095238095238095 FaceDetection,0.6328036322360954 +FeedbackButton,0.5008695652173913 +FeetHands,0.5508919202518363 +FingerMovements,0.6470588235294118 FordChallenge,0.878345498783455 HandMovementDirection,0.35135135135135137 Handwriting,0.6376470588235295 @@ -34,34 +41,86 @@ Heartbeat,0.7635135135135135 HouseholdPowerConsumption1_disc,0.9169096209912536 HouseholdPowerConsumption2_disc,0.7376093294460642 IEEEPPG_disc,0.3757530120481928 +IRDS-EFL,1.0 +IRDS-EFR,0.9 +IRDS-SAL,0.23809523809523808 +IRDS-SAR,0.7241379310344828 +IRDS-SFE,1.0 IRDS-SFL,0.5543478260869565 +IRDS-SFR,0.6153846153846154 +IRDS-STL,0.7407407407407407 +IRDS-STR,0.6545454545454545 +ImaginedFeetHands,0.6849173553719008 +ImaginedOpenCloseFist,0.7780126849894292 +InnerSpeech,0.255 JapaneseVowels,0.9945945945945946 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.75 +KERAAL-ELK-MC,0.6428571428571429 KERAAL-RTK,0.75 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,0.25 +KIMORE-LT-C,0.75 KIMORE-PR-C,0.6666666666666666 +KIMORE-Sq-C,0.6 +KIMORE-TR-C,0.16666666666666666 +KINECAL-3WFV,1.0 +KINECAL-GGFV,0.9166666666666666 +KINECAL-QSEC,0.9411764705882353 KINECAL-QSEO,0.875 LSST,0.2562854825628548 Libras,0.9222222222222223 +LiveFuelMoistureContent_disc,0.8858267716535433 Locust2022,0.9547571523619428 +LongIntervalTask,0.7789473684210526 LowCost,0.7433333333333333 +MatchingPennies,0.6193181818181818 MindReading,0.7243491577335375 MotionSenseHAR,0.9811320754716981 MotorImagery,0.98 NATOPS,0.9666666666666667 +NewsHeadlineSentiment_disc,0.5396577291491323 +NewsTitleSentiment_disc,0.6125606188128733 +OpenCloseFist,0.7198731501057083 +Opportunity,0.8360246059207997 +PAMAP2,0.8196058615462355 PEMS-SF,0.7283236994219653 +PPGDalia_disc,0.7907085001396518 PenDigits,0.9862778730703259 PhonemeSpectra,0.31673128541604534 PhotoStimulation,0.19444444444444445 +PronouncedSpeech,0.245 RacketSports,0.881578947368421 +SPHERE-WUS,1.0 STEW,0.9716610549943884 SelfRegulationSCP1,0.6122448979591837 +SelfRegulationSCP2,0.5333333333333333 +ShortIntervalTask,0.7902777777777777 +SitStand,0.3209375 Skoda,0.9621506897771489 +SongFamiliarity,0.506426735218509 SpokenArabicDigits,0.9927239654388358 StandWalkJump,0.4666666666666667 TactileTextureRecognition,1.0 Tiselac,0.8046006066734075 +UCDHE-MP,0.8473282442748091 +UCDHE-MP-MC,0.8342541436464088 +UCDHE-Rowing,0.8828571428571429 UCDHE-Rowing-MC,0.725 UCIActivity,0.9983340274885465 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,1.0 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.5555555555555556 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.8888888888888888 USCActivity,0.7354191980558931 UWaveGestureLibrary,0.915625 +VisualSpeech,0.26 WISDM,0.8514583735754297 +WISDM2,0.5907145661562623 diff --git a/results/multiverse/MRHydra/MRHydra_accuracy.csv b/results/multiverse/MRHydra/MRHydra_accuracy.csv index 52d46e1..124d841 100644 --- a/results/multiverse/MRHydra/MRHydra_accuracy.csv +++ b/results/multiverse/MRHydra/MRHydra_accuracy.csv @@ -3,17 +3,21 @@ Alzheimers,0.5581395348837209 AppliancesEnergy_disc,0.8571428571428571 ArticularyWordRecognition,0.99 AsphaltObstaclesCoordinates,0.8670076726342711 +AsphaltPavementTypeCoordinates,0.9195075757575758 AsphaltRegularityCoordinates,0.9906790945406125 AtrialFibrillation,0.06666666666666667 AutomotiveRoadTrials,0.8051948051948052 BIDMC32HR_disc,0.7749062109212171 +BIDMC32RR_disc,0.7761567319716548 BIDMC32SpO2_disc,0.6177573989162151 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7933835182250396 BeijingPM25Quality_disc,0.8472662440570523 BenzeneConcentration_disc,0.5959713344954484 Blink,0.9044444444444445 BoneIntensitiesAgeGroup,0.8044943820224719 BoneProbAgeGroup,0.6898876404494382 +ButtonPress,1.0 CharacterTrajectories,0.9930362116991643 CounterMovementJump,0.9217877094972067 Cricket,0.9861111111111112 @@ -26,6 +30,9 @@ Epilepsy,1.0 EthanolConcentration,0.5817490494296578 EyesOpenShut,0.5476190476190477 FaceDetection,0.6061293984108967 +FeedbackButton,0.5556521739130434 +FeetHands,0.647089947089947 +FingerMovements,0.61 FordChallenge,0.8655913978494624 HandMovementDirection,0.3783783783783784 Handwriting,0.5188235294117647 @@ -33,32 +40,81 @@ Heartbeat,0.7463414634146341 HouseholdPowerConsumption1_disc,0.8979591836734694 HouseholdPowerConsumption2_disc,0.7813411078717201 IEEEPPG_disc,0.526355421686747 +IRDS-EFL,0.7692307692307693 +IRDS-EFR,0.6666666666666666 +IRDS-SAL,0.39285714285714285 +IRDS-SAR,0.42424242424242425 +IRDS-SFE,0.7333333333333333 IRDS-SFL,0.6293103448275862 +IRDS-SFR,0.5333333333333333 +IRDS-STL,0.7368421052631579 +IRDS-STR,0.95 +ImaginedFeetHands,0.648578811369509 +ImaginedOpenCloseFist,0.7031746031746032 +InnerSpeech,0.245 JapaneseVowels,0.9837837837837838 +KERAAL-CTK,0.7857142857142857 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,0.8 +KERAAL-ELK-MC,0.8571428571428571 KERAAL-RTK,0.7857142857142857 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,0.5714285714285714 +KIMORE-LT-C,0.5714285714285714 KIMORE-PR-C,0.7142857142857143 +KIMORE-Sq-C,0.7142857142857143 +KIMORE-TR-C,0.14285714285714285 +KINECAL-3WFV,0.9166666666666666 +KINECAL-GGFV,0.9230769230769231 +KINECAL-QSEC,0.9444444444444444 KINECAL-QSEO,0.9411764705882353 LSST,0.6346309813463098 Libras,0.9333333333333333 +LiveFuelMoistureContent_disc,0.756953642384106 Locust2022,0.9205819945438012 +LongIntervalTask,0.6955357142857143 LowCost,0.6033333333333334 +MatchingPennies,0.5914285714285714 MindReading,0.6401225114854517 MotionSenseHAR,1.0 MotorImagery,0.48 NATOPS,0.9111111111111111 +OpenCloseFist,0.7195767195767195 +Opportunity,0.8225682429834679 +PAMAP2,0.8597271349166246 PEMS-SF,0.815028901734104 +PPGDalia_disc,0.7759519597802812 PhonemeSpectra,0.3313450641216821 PhotoStimulation,0.3888888888888889 +PronouncedSpeech,0.275 RacketSports,0.868421052631579 +SPHERE-WUS,1.0 STEW,0.7549102132435466 SelfRegulationSCP1,0.9453924914675768 +SelfRegulationSCP2,0.55 +ShortIntervalTask,0.7223214285714286 +SitStand,0.4390625 Skoda,0.949770074283693 +SongFamiliarity,0.5146666666666667 SpokenArabicDigits,0.9909049567985448 StandWalkJump,0.6 TactileTextureRecognition,0.9985315712187959 +UCDHE-MP,0.8342541436464088 +UCDHE-MP-MC,0.7817679558011049 +UCDHE-Rowing,0.8159090909090909 UCDHE-Rowing-MC,0.7977272727272727 UCIActivity,0.9933361099541858 UIPRMD-DS-C,0.9444444444444444 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.6666666666666666 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.8888888888888888 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.8 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9722222222222222 USCActivity,0.6784629404617254 UWaveGestureLibrary,0.93125 +VisualSpeech,0.255 WISDM,0.8964651342476337 diff --git a/results/multiverse/MRHydra/MRHydra_auroc.csv b/results/multiverse/MRHydra/MRHydra_auroc.csv index 7ab0913..b69af24 100644 --- a/results/multiverse/MRHydra/MRHydra_auroc.csv +++ b/results/multiverse/MRHydra/MRHydra_auroc.csv @@ -3,17 +3,21 @@ Alzheimers,0.6731681034482758 AppliancesEnergy_disc,0.7683823529411765 ArticularyWordRecognition,0.9947916666666666 AsphaltObstaclesCoordinates,0.9107659745436865 +AsphaltPavementTypeCoordinates,0.9407893418310085 AsphaltRegularityCoordinates,0.9907746329006172 AtrialFibrillation,0.3 AutomotiveRoadTrials,0.7999092558983666 BIDMC32HR_disc,0.702761692580745 +BIDMC32RR_disc,0.5182508395048596 BIDMC32SpO2_disc,0.4318181818181818 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7488322997504879 BeijingPM25Quality_disc,0.8166408413544372 BenzeneConcentration_disc,0.6021961280497105 Blink,0.9079999999999999 BoneIntensitiesAgeGroup,0.848903222572501 BoneProbAgeGroup,0.7464052909905042 +ButtonPress,1.0 CharacterTrajectories,0.9963471204158252 CounterMovementJump,0.9411764705882353 Cricket,0.9924242424242424 @@ -26,6 +30,9 @@ Epilepsy,1.0 EthanolConcentration,0.7209275496077527 EyesOpenShut,0.5476190476190477 FaceDetection,0.6061293984108967 +FeedbackButton,0.5556521739130436 +FeetHands,0.6474185322763256 +FingerMovements,0.6120448179271708 FordChallenge,0.8483232656676454 HandMovementDirection,0.5740241397021059 Handwriting,0.749607732148936 @@ -33,32 +40,81 @@ Heartbeat,0.6463371266002844 HouseholdPowerConsumption1_disc,0.7969505082707252 HouseholdPowerConsumption2_disc,0.7134521198183588 IEEEPPG_disc,0.6552946265891291 +IRDS-EFL,0.75 +IRDS-EFR,0.5 +IRDS-SAL,0.4523809523809524 +IRDS-SAR,0.6724137931034483 +IRDS-SFE,0.6 IRDS-SFL,0.7509057971014493 +IRDS-SFR,0.3076923076923077 +IRDS-STL,0.5993265993265993 +IRDS-STR,0.7 +ImaginedFeetHands,0.6485669660789525 +ImaginedOpenCloseFist,0.7031949869208443 +InnerSpeech,0.49533361760669903 JapaneseVowels,0.9909348619751496 +KERAAL-CTK,0.7857142857142858 +KERAAL-CTK-MC,0.8928571428571429 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.46153846153846156 KERAAL-RTK,0.7708333333333335 +KERAAL-RTK-MC,0.4166666666666667 +KIMORE-LA-C,0.625 +KIMORE-LT-C,0.5833333333333333 KIMORE-PR-C,0.8333333333333334 +KIMORE-Sq-C,0.8 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.5 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.5 LSST,0.7659254822821844 Libras,0.9642857142857143 +LiveFuelMoistureContent_disc,0.4837926509186352 Locust2022,0.6822736779001725 +LongIntervalTask,0.6301900584795321 LowCost,0.6033333333333333 +MatchingPennies,0.5909743991640543 MindReading,0.7719438061718261 MotionSenseHAR,1.0 MotorImagery,0.48 NATOPS,0.9466666666666667 +OpenCloseFist,0.719616718027735 +Opportunity,0.854974145266245 +PAMAP2,0.921903142710672 PEMS-SF,0.8921462047873059 +PPGDalia_disc,0.798491218022091 PhonemeSpectra,0.65687474500204 PhotoStimulation,0.5173626373626373 +PronouncedSpeech,0.519760848619909 RacketSports,0.90955349441588 +SPHERE-WUS,1.0 STEW,0.7549102132435466 SelfRegulationSCP1,0.9455316373124593 +SelfRegulationSCP2,0.5499999999999999 +ShortIntervalTask,0.6590277777777778 +SitStand,0.6260416666666667 Skoda,0.9703359555207995 +SongFamiliarity,0.517279194468379 SpokenArabicDigits,0.9949470705029068 StandWalkJump,0.7 TactileTextureRecognition,0.9992283950617284 +UCDHE-MP,0.8205725190839694 +UCDHE-MP-MC,0.8518427977366393 +UCDHE-Rowing,0.715079365079365 UCDHE-Rowing-MC,0.8716065435183082 UCIActivity,0.9959358911872823 UIPRMD-DS-C,0.9444444444444444 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.6666666666666667 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.8888888888888888 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.8 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9722222222222222 USCActivity,0.8234342861717113 UWaveGestureLibrary,0.9607142857142857 +VisualSpeech,0.5059538484624921 WISDM,0.9323125951398794 diff --git a/results/multiverse/MRHydra/MRHydra_balacc.csv b/results/multiverse/MRHydra/MRHydra_balacc.csv index 1aebec7..3a0f22d 100644 --- a/results/multiverse/MRHydra/MRHydra_balacc.csv +++ b/results/multiverse/MRHydra/MRHydra_balacc.csv @@ -3,17 +3,21 @@ Alzheimers,0.550986050986051 AppliancesEnergy_disc,0.7683823529411764 ArticularyWordRecognition,0.99 AsphaltObstaclesCoordinates,0.8683618345864933 +AsphaltPavementTypeCoordinates,0.9128648618538325 AsphaltRegularityCoordinates,0.9907746329006172 AtrialFibrillation,0.06666666666666667 AutomotiveRoadTrials,0.7999092558983666 BIDMC32HR_disc,0.627472036930753 +BIDMC32RR_disc,0.3500584550824952 BIDMC32SpO2_disc,0.4318181818181818 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7488322997504882 BeijingPM25Quality_disc,0.8166408413544372 BenzeneConcentration_disc,0.6021961280497103 Blink,0.9079999999999999 BoneIntensitiesAgeGroup,0.8353725231263797 BoneProbAgeGroup,0.681342830655542 +ButtonPress,1.0 CharacterTrajectories,0.9926848414802045 CounterMovementJump,0.9213747645951035 Cricket,0.9861111111111112 @@ -26,6 +30,9 @@ Epilepsy,1.0 EthanolConcentration,0.5827505827505828 EyesOpenShut,0.5476190476190476 FaceDetection,0.6061293984108967 +FeedbackButton,0.5556521739130436 +FeetHands,0.6474185322763256 +FingerMovements,0.6120448179271709 FordChallenge,0.8483232656676454 HandMovementDirection,0.3535714285714286 Handwriting,0.515603263520756 @@ -33,32 +40,81 @@ Heartbeat,0.6463371266002844 HouseholdPowerConsumption1_disc,0.7309253297181563 HouseholdPowerConsumption2_disc,0.6400673400673401 IEEEPPG_disc,0.521130232614778 +IRDS-EFL,0.75 +IRDS-EFR,0.5 +IRDS-SAL,0.45238095238095233 +IRDS-SAR,0.6724137931034483 +IRDS-SFE,0.6 IRDS-SFL,0.7509057971014492 +IRDS-SFR,0.3076923076923077 +IRDS-STL,0.5993265993265993 +IRDS-STR,0.7 +ImaginedFeetHands,0.6485669660789526 +ImaginedOpenCloseFist,0.7031949869208443 +InnerSpeech,0.2429836500885133 JapaneseVowels,0.9820323046129498 +KERAAL-CTK,0.7857142857142857 +KERAAL-CTK-MC,0.6190476190476191 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.46153846153846156 KERAAL-RTK,0.7708333333333333 +KERAAL-RTK-MC,0.26666666666666666 +KIMORE-LA-C,0.625 +KIMORE-LT-C,0.5833333333333333 KIMORE-PR-C,0.8333333333333333 +KIMORE-Sq-C,0.8 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.5 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.5 LSST,0.4473748232817911 Libras,0.9333333333333333 +LiveFuelMoistureContent_disc,0.4837926509186352 Locust2022,0.6822736779001723 +LongIntervalTask,0.6301900584795321 LowCost,0.6033333333333333 +MatchingPennies,0.5909743991640544 MindReading,0.6320591092065966 MotionSenseHAR,1.0 MotorImagery,0.48 NATOPS,0.9111111111111111 +OpenCloseFist,0.719616718027735 +Opportunity,0.8362933128637147 +PAMAP2,0.8712942169398671 PEMS-SF,0.8099209647035733 +PPGDalia_disc,0.7389525228184713 PhonemeSpectra,0.33140762566207166 PhotoStimulation,0.3686868686868687 +PronouncedSpeech,0.27985441668306116 RacketSports,0.8789244186046512 +SPHERE-WUS,1.0 STEW,0.7549102132435466 SelfRegulationSCP1,0.9455316373124592 +SelfRegulationSCP2,0.55 +ShortIntervalTask,0.6590277777777778 +SitStand,0.4390625 Skoda,0.9449465962468497 +SongFamiliarity,0.517279194468379 SpokenArabicDigits,0.9909070153590702 StandWalkJump,0.6 TactileTextureRecognition,0.9985994397759103 +UCDHE-MP,0.8205725190839694 +UCDHE-MP-MC,0.7819293478260869 +UCDHE-Rowing,0.715079365079365 UCDHE-Rowing-MC,0.8073333333333335 UCIActivity,0.9935626285740703 UIPRMD-DS-C,0.9444444444444444 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.6666666666666666 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.8888888888888888 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.8 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9722222222222222 USCActivity,0.705453689465036 UWaveGestureLibrary,0.93125 +VisualSpeech,0.2594090520823714 WISDM,0.6921433600310651 diff --git a/results/multiverse/MRHydra/MRHydra_f1.csv b/results/multiverse/MRHydra/MRHydra_f1.csv index 0958b7a..3063c22 100644 --- a/results/multiverse/MRHydra/MRHydra_f1.csv +++ b/results/multiverse/MRHydra/MRHydra_f1.csv @@ -3,17 +3,21 @@ Alzheimers,0.5653276955602538 AppliancesEnergy_disc,0.625 ArticularyWordRecognition,0.9899942028985508 AsphaltObstaclesCoordinates,0.8667221477065438 +AsphaltPavementTypeCoordinates,0.9197068723551837 AsphaltRegularityCoordinates,0.9906040268456375 AtrialFibrillation,0.05128205128205129 AutomotiveRoadTrials,0.6666666666666666 BIDMC32HR_disc,0.7534481008413247 +BIDMC32RR_disc,0.7130894495017321 BIDMC32SpO2_disc,0.0 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6426858513189448 BeijingPM25Quality_disc,0.7452923686818632 BenzeneConcentration_disc,0.4872173058013766 Blink,0.8973747016706444 BoneIntensitiesAgeGroup,0.8027097579890179 BoneProbAgeGroup,0.6932280195438091 +ButtonPress,1.0 CharacterTrajectories,0.9930267552962464 CounterMovementJump,0.9231904357451434 Cricket,0.9860139860139859 @@ -26,6 +30,9 @@ Epilepsy,1.0 EthanolConcentration,0.573699545060833 EyesOpenShut,0.5957446808510638 FaceDetection,0.5969802555168409 +FeedbackButton,0.5665818490245971 +FeetHands,0.65847414234511 +FingerMovements,0.6422018348623854 FordChallenge,0.8135398737808376 HandMovementDirection,0.37794693697965387 Handwriting,0.49275778888416066 @@ -33,32 +40,81 @@ Heartbeat,0.48 HouseholdPowerConsumption1_disc,0.8904623169004832 HouseholdPowerConsumption2_disc,0.774188029130296 IEEEPPG_disc,0.5185637578947263 +IRDS-EFL,0.6666666666666666 +IRDS-EFR,0.0 +IRDS-SAL,0.32 +IRDS-SAR,0.2962962962962963 +IRDS-SFE,0.3333333333333333 IRDS-SFL,0.5168539325842697 +IRDS-SFR,0.0 +IRDS-STL,0.375 +IRDS-STR,0.5714285714285714 +ImaginedFeetHands,0.6402116402116402 +ImaginedOpenCloseFist,0.7085714285714285 +InnerSpeech,0.22082273686337006 JapaneseVowels,0.9837689808522188 +KERAAL-CTK,0.7692307692307693 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.8571428571428571 KERAAL-RTK,0.7272727272727273 +KERAAL-RTK-MC,0.18099547511312217 +KIMORE-LA-C,0.6666666666666666 +KIMORE-LT-C,0.5714285714285714 KIMORE-PR-C,0.5 +KIMORE-Sq-C,0.6666666666666666 +KIMORE-TR-C,0.25 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.6011096417753133 Libras,0.932601388949215 +LiveFuelMoistureContent_disc,0.09828009828009827 Locust2022,0.46747967479674796 +LongIntervalTask,0.4856711915535445 LowCost,0.5688405797101449 +MatchingPennies,0.5545171339563862 MindReading,0.629473007554205 MotionSenseHAR,1.0 MotorImagery,0.6438356164383562 NATOPS,0.9107142857142858 +OpenCloseFist,0.7295918367346939 +Opportunity,0.8216426473793494 +PAMAP2,0.8563592824205959 PEMS-SF,0.8096673609477794 +PPGDalia_disc,0.7760969364586655 PhonemeSpectra,0.327135499406348 PhotoStimulation,0.38018207282913163 +PronouncedSpeech,0.23368813282514672 RacketSports,0.8675275336227893 +SPHERE-WUS,1.0 STEW,0.7343773757032082 SelfRegulationSCP1,0.9473684210526315 +SelfRegulationSCP2,0.5714285714285714 +ShortIntervalTask,0.529500756429652 +SitStand,0.438702837332888 Skoda,0.949697584276012 +SongFamiliarity,0.5380710659898477 SpokenArabicDigits,0.9908882042319275 StandWalkJump,0.5925925925925927 TactileTextureRecognition,0.9985315712187959 +UCDHE-MP,0.7247706422018348 +UCDHE-MP-MC,0.7827498278060291 +UCDHE-Rowing,0.547486033519553 UCDHE-Rowing-MC,0.799944730081221 UCIActivity,0.9933081694342014 UIPRMD-DS-C,0.9411764705882353 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.5 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.9 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.75 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.972972972972973 USCActivity,0.6559708108405085 UWaveGestureLibrary,0.9311919679425225 +VisualSpeech,0.22138716356107666 WISDM,0.8847782642400435 diff --git a/results/multiverse/MRHydra/MRHydra_logloss.csv b/results/multiverse/MRHydra/MRHydra_logloss.csv index 2b85a1e..1832139 100644 --- a/results/multiverse/MRHydra/MRHydra_logloss.csv +++ b/results/multiverse/MRHydra/MRHydra_logloss.csv @@ -3,17 +3,21 @@ Alzheimers,15.926265451005253 AppliancesEnergy_disc,5.149093341302451 ArticularyWordRecognition,0.36043653389117175 AsphaltObstaclesCoordinates,4.7935293509823325 +AsphaltPavementTypeCoordinates,2.9012410398437103 AsphaltRegularityCoordinates,0.33595948565089245 AtrialFibrillation,33.640743163176005 AutomotiveRoadTrials,7.021490919957888 BIDMC32HR_disc,8.11320251359869 +BIDMC32RR_disc,8.06812916630092 BIDMC32SpO2_disc,13.777419824018518 +BasicMotions,2.220446049250313e-16 BeijingPM10Quality_disc,7.447212853575514 BeijingPM25Quality_disc,5.5050825600256195 BenzeneConcentration_disc,14.56266917871361 Blink,3.4441713238489724 BoneIntensitiesAgeGroup,7.046736730007173 BoneProbAgeGroup,11.177582399321723 +ButtonPress,2.220446049250313e-16 CharacterTrajectories,0.2510003717905096 CounterMovementJump,2.819056689651621 Cricket,0.5006062970710717 @@ -26,6 +30,9 @@ Epilepsy,2.220446049250313e-16 EthanolConcentration,15.075292292026182 EyesOpenShut,16.30546224745776 FaceDetection,14.196535443840691 +FeedbackButton,16.015919027685968 +FeetHands,12.720167624624942 +FingerMovements,14.05702482175569 FordChallenge,4.844577068429724 HandMovementDirection,22.40551426891066 Handwriting,17.343357924881076 @@ -33,32 +40,81 @@ Heartbeat,9.14278037187362 HouseholdPowerConsumption1_disc,3.6779238152160363 HouseholdPowerConsumption2_disc,7.881265318320077 IEEEPPG_disc,17.071881010357444 +IRDS-EFL,8.317766166719341 +IRDS-EFR,12.014551129705717 +IRDS-SAL,21.88364670053541 +IRDS-SAR,20.752406496764422 +IRDS-SFE,9.611640903764574 IRDS-SFL,13.361009445965841 +IRDS-SFR,16.820371581588002 +IRDS-STL,9.485171944504513 +IRDS-STR,1.8021826694558576 +ImaginedFeetHands,12.666503516588975 +ImaginedOpenCloseFist,10.698671720261755 +InnerSpeech,27.212958308783445 JapaneseVowels,0.5844916765802783 +KERAAL-CTK,7.723640011953676 +KERAAL-CTK-MC,5.149093341302451 +KERAAL-ELK,7.20873067782343 +KERAAL-ELK-MC,5.149093341302451 KERAAL-RTK,7.723640011953676 +KERAAL-RTK-MC,24.953298500158024 +KIMORE-LA-C,15.447280023907352 +KIMORE-LT-C,15.447280023907352 KIMORE-PR-C,10.298186682604902 +KIMORE-Sq-C,10.298186682604902 +KIMORE-TR-C,30.8945600478147 +KINECAL-3WFV,3.0036377824264293 +KINECAL-GGFV,2.772588722239781 +KINECAL-QSEC,2.0024251882842865 KINECAL-QSEO,2.1202149052421855 LSST,13.169234267475487 Libras,2.4029102259411435 +LiveFuelMoistureContent_disc,8.760278671394698 Locust2022,2.8625150615182458 +LongIntervalTask,10.974005183650847 LowCost,14.297315844349802 +MatchingPennies,14.726406956125007 MindReading,12.971299458564365 MotionSenseHAR,2.220446049250313e-16 MotorImagery,18.742699762340923 NATOPS,3.2038803012548582 +OpenCloseFist,10.107479521815922 +Opportunity,6.395288750125939 +PAMAP2,5.055946528963577 PEMS-SF,6.667034152900283 +PPGDalia_disc,8.075509904190524 PhonemeSpectra,24.100766745720442 PhotoStimulation,22.02667707112715 +PronouncedSpeech,26.13164870710993 RacketSports,4.7425859722522565 +SPHERE-WUS,2.220446049250313e-16 STEW,8.833931323062242 SelfRegulationSCP1,1.9682541099859197 +SelfRegulationSCP2,16.219644025102717 +ShortIntervalTask,10.008550182156636 +SitStand,20.2182368229579 Skoda,1.8104700322796732 +SongFamiliarity,17.493186444851528 SpokenArabicDigits,0.3278185847122981 StandWalkJump,14.417461355646859 TactileTextureRecognition,0.052927538016324965 +UCDHE-MP,5.974086197091241 +UCDHE-MP-MC,7.865880159503467 +UCDHE-Rowing,6.635308919360202 UCDHE-Rowing-MC,7.290648071889606 UCIActivity,0.24019094303451682 UIPRMD-DS-C,2.0024251882842865 +UIPRMD-HS-C,2.220446049250313e-16 +UIPRMD-IL-C,12.014551129705717 +UIPRMD-SASLR-C,2.220446049250313e-16 +UIPRMD-SL-C,4.004850376568573 +UIPRMD-SSA-C,2.220446049250313e-16 +UIPRMD-SSE-C,2.220446049250313e-16 +UIPRMD-SSIER-C,7.20873067782343 +UIPRMD-SSS-C,2.220446049250313e-16 +UIPRMD-STS-C,1.0012125941421433 USCActivity,11.589370325753496 UWaveGestureLibrary,2.478001170501804 +VisualSpeech,26.852521774892274 WISDM,3.731774814867064 diff --git a/results/multiverse/MRHydra/MRHydra_sensitivity.csv b/results/multiverse/MRHydra/MRHydra_sensitivity.csv index 9e006e2..943cd3c 100644 --- a/results/multiverse/MRHydra/MRHydra_sensitivity.csv +++ b/results/multiverse/MRHydra/MRHydra_sensitivity.csv @@ -3,17 +3,21 @@ Alzheimers,0.5581395348837209 AppliancesEnergy_disc,0.625 ArticularyWordRecognition,0.99 AsphaltObstaclesCoordinates,0.8670076726342711 +AsphaltPavementTypeCoordinates,0.9195075757575758 AsphaltRegularityCoordinates,0.9972972972972973 AtrialFibrillation,0.06666666666666667 AutomotiveRoadTrials,0.7894736842105263 BIDMC32HR_disc,0.7749062109212171 +BIDMC32RR_disc,0.7761567319716548 BIDMC32SpO2_disc,0.0 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6433470507544582 BeijingPM25Quality_disc,0.7391874180865007 BenzeneConcentration_disc,0.6186017478152309 Blink,0.94 BoneIntensitiesAgeGroup,0.8044943820224719 BoneProbAgeGroup,0.6898876404494382 +ButtonPress,1.0 CharacterTrajectories,0.9930362116991643 CounterMovementJump,0.9217877094972067 Cricket,0.9861111111111112 @@ -26,6 +30,9 @@ Epilepsy,1.0 EthanolConcentration,0.5817490494296578 EyesOpenShut,0.6666666666666666 FaceDetection,0.583427922814983 +FeedbackButton,0.5808695652173913 +FeetHands,0.6862326574172892 +FingerMovements,0.7142857142857143 FordChallenge,0.7782656421514819 HandMovementDirection,0.3783783783783784 Handwriting,0.5188235294117647 @@ -33,32 +40,81 @@ Heartbeat,0.42105263157894735 HouseholdPowerConsumption1_disc,0.8979591836734694 HouseholdPowerConsumption2_disc,0.7813411078717201 IEEEPPG_disc,0.526355421686747 +IRDS-EFL,0.5 +IRDS-EFR,0.0 +IRDS-SAL,0.5714285714285714 +IRDS-SAR,1.0 +IRDS-SFE,0.2 IRDS-SFL,0.9583333333333334 +IRDS-SFR,0.0 +IRDS-STL,0.2727272727272727 +IRDS-STR,0.4 +ImaginedFeetHands,0.6256463288521199 +ImaginedOpenCloseFist,0.722457627118644 +InnerSpeech,0.245 JapaneseVowels,0.9837837837837838 +KERAAL-CTK,0.7142857142857143 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.8571428571428571 KERAAL-RTK,0.6666666666666666 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,1.0 +KIMORE-LT-C,0.6666666666666666 KIMORE-PR-C,1.0 +KIMORE-Sq-C,1.0 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.6346309813463098 Libras,0.9333333333333333 +LiveFuelMoistureContent_disc,0.08333333333333333 Locust2022,0.3924914675767918 +LongIntervalTask,0.44722222222222224 LowCost,0.5233333333333333 +MatchingPennies,0.5114942528735632 MindReading,0.6401225114854517 MotionSenseHAR,1.0 MotorImagery,0.94 NATOPS,0.9111111111111111 +OpenCloseFist,0.7574152542372882 +Opportunity,0.8225682429834679 +PAMAP2,0.8597271349166246 PEMS-SF,0.815028901734104 +PPGDalia_disc,0.7759519597802812 PhonemeSpectra,0.3313450641216821 PhotoStimulation,0.3888888888888889 +PronouncedSpeech,0.275 RacketSports,0.868421052631579 +SPHERE-WUS,1.0 STEW,0.6776094276094277 SelfRegulationSCP1,0.9863013698630136 +SelfRegulationSCP2,0.6 +ShortIntervalTask,0.4375 +SitStand,0.4390625 Skoda,0.949770074283693 +SongFamiliarity,0.5872576177285319 SpokenArabicDigits,0.9909049567985448 StandWalkJump,0.6 TactileTextureRecognition,0.9985315712187959 +UCDHE-MP,0.79 +UCDHE-MP-MC,0.7817679558011049 +UCDHE-Rowing,0.5444444444444444 UCDHE-Rowing-MC,0.7977272727272727 UCIActivity,0.9933361099541858 UIPRMD-DS-C,0.8888888888888888 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.3333333333333333 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.6 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,1.0 USCActivity,0.6784629404617254 UWaveGestureLibrary,0.93125 +VisualSpeech,0.255 WISDM,0.8964651342476337 diff --git a/results/multiverse/MRHydra/MRHydra_specificity.csv b/results/multiverse/MRHydra/MRHydra_specificity.csv index 62ba70d..989c5ea 100644 --- a/results/multiverse/MRHydra/MRHydra_specificity.csv +++ b/results/multiverse/MRHydra/MRHydra_specificity.csv @@ -3,17 +3,21 @@ Alzheimers,0.5581395348837209 AppliancesEnergy_disc,0.9117647058823529 ArticularyWordRecognition,0.99 AsphaltObstaclesCoordinates,0.8670076726342711 +AsphaltPavementTypeCoordinates,0.9195075757575758 AsphaltRegularityCoordinates,0.984251968503937 AtrialFibrillation,0.06666666666666667 AutomotiveRoadTrials,0.8103448275862069 BIDMC32HR_disc,0.7749062109212171 +BIDMC32RR_disc,0.7761567319716548 BIDMC32SpO2_disc,0.8636363636363636 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8543175487465181 BeijingPM25Quality_disc,0.8940942646223736 BenzeneConcentration_disc,0.5857905082841899 Blink,0.876 BoneIntensitiesAgeGroup,0.8044943820224719 BoneProbAgeGroup,0.6898876404494382 +ButtonPress,1.0 CharacterTrajectories,0.9930362116991643 CounterMovementJump,0.9217877094972067 Cricket,0.9861111111111112 @@ -26,6 +30,9 @@ Epilepsy,1.0 EthanolConcentration,0.5817490494296578 EyesOpenShut,0.42857142857142855 FaceDetection,0.6288308740068105 +FeedbackButton,0.5304347826086957 +FeetHands,0.608604407135362 +FingerMovements,0.5098039215686274 FordChallenge,0.9183808891838089 HandMovementDirection,0.3783783783783784 Handwriting,0.5188235294117647 @@ -33,32 +40,81 @@ Heartbeat,0.8716216216216216 HouseholdPowerConsumption1_disc,0.8979591836734694 HouseholdPowerConsumption2_disc,0.7813411078717201 IEEEPPG_disc,0.526355421686747 +IRDS-EFL,1.0 +IRDS-EFR,1.0 +IRDS-SAL,0.3333333333333333 +IRDS-SAR,0.3448275862068966 +IRDS-SFE,1.0 IRDS-SFL,0.5434782608695652 +IRDS-SFR,0.6153846153846154 +IRDS-STL,0.9259259259259259 +IRDS-STR,1.0 +ImaginedFeetHands,0.6714876033057852 +ImaginedOpenCloseFist,0.6839323467230444 +InnerSpeech,0.245 JapaneseVowels,0.9837837837837838 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.8571428571428571 +KERAAL-ELK,1.0 +KERAAL-ELK-MC,0.8571428571428571 KERAAL-RTK,0.875 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,0.25 +KIMORE-LT-C,0.5 KIMORE-PR-C,0.6666666666666666 +KIMORE-Sq-C,0.6 +KIMORE-TR-C,0.0 +KINECAL-3WFV,1.0 +KINECAL-GGFV,1.0 +KINECAL-QSEC,1.0 KINECAL-QSEO,1.0 LSST,0.6346309813463098 Libras,0.9333333333333333 +LiveFuelMoistureContent_disc,0.8842519685039371 Locust2022,0.9720558882235529 +LongIntervalTask,0.8131578947368421 LowCost,0.6833333333333333 +MatchingPennies,0.6704545454545454 MindReading,0.6401225114854517 MotionSenseHAR,1.0 MotorImagery,0.02 NATOPS,0.9111111111111111 +OpenCloseFist,0.6818181818181818 +Opportunity,0.8225682429834679 +PAMAP2,0.8597271349166246 PEMS-SF,0.815028901734104 +PPGDalia_disc,0.7759519597802812 PhonemeSpectra,0.3313450641216821 PhotoStimulation,0.3888888888888889 +PronouncedSpeech,0.275 RacketSports,0.868421052631579 +SPHERE-WUS,1.0 STEW,0.8322109988776656 SelfRegulationSCP1,0.9047619047619048 +SelfRegulationSCP2,0.5 +ShortIntervalTask,0.8805555555555555 +SitStand,0.4390625 Skoda,0.949770074283693 +SongFamiliarity,0.4473007712082262 SpokenArabicDigits,0.9909049567985448 StandWalkJump,0.6 TactileTextureRecognition,0.9985315712187959 +UCDHE-MP,0.851145038167939 +UCDHE-MP-MC,0.7817679558011049 +UCDHE-Rowing,0.8857142857142857 UCDHE-Rowing-MC,0.7977272727272727 UCIActivity,0.9933361099541858 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,1.0 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.7777777777777778 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9444444444444444 USCActivity,0.6784629404617254 UWaveGestureLibrary,0.93125 +VisualSpeech,0.255 WISDM,0.8964651342476337 diff --git a/results/multiverse/PatchMTSC/PatchMTSC_accuracy.csv b/results/multiverse/PatchMTSC/PatchMTSC_accuracy.csv index 8089385..5fcf36a 100644 --- a/results/multiverse/PatchMTSC/PatchMTSC_accuracy.csv +++ b/results/multiverse/PatchMTSC/PatchMTSC_accuracy.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.7773340820698404 AutomotiveRoadTrials,0.7532467532467533 BIDMC32HR_disc,0.8957899124635265 BIDMC32SpO2_disc,0.6536056690287619 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8328050713153724 BeijingPM25Quality_disc,0.8851030110935024 BenzeneConcentration_disc,0.9440247917877204 @@ -27,6 +28,7 @@ Epilepsy,0.9565217391304348 EthanolConcentration,0.27756653992395436 EyesOpenShut,0.5 FaceDetection,0.6753688989784336 +FingerMovements,0.44 FordChallenge,0.8672456575682382 HandMovementDirection,0.44594594594594594 Handwriting,0.3458823529411765 @@ -54,6 +56,7 @@ PhotoStimulation,0.3888888888888889 RacketSports,0.881578947368421 STEW,0.7808641975308642 SelfRegulationSCP1,0.8532423208191127 +SelfRegulationSCP2,0.4888888888888889 Skoda,0.9363282631765122 SpokenArabicDigits,0.9827194179172352 StandWalkJump,0.5333333333333333 diff --git a/results/multiverse/PatchMTSC/PatchMTSC_auroc.csv b/results/multiverse/PatchMTSC/PatchMTSC_auroc.csv index 140b637..ab1835d 100644 --- a/results/multiverse/PatchMTSC/PatchMTSC_auroc.csv +++ b/results/multiverse/PatchMTSC/PatchMTSC_auroc.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.8599395923274316 AutomotiveRoadTrials,0.5344827586206896 BIDMC32HR_disc,0.9634387001691213 BIDMC32SpO2_disc,0.3023566843112963 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8959287152622549 BeijingPM25Quality_disc,0.9405199148881065 BenzeneConcentration_disc,0.9958181134856352 @@ -27,6 +28,7 @@ Epilepsy,0.9970363257061493 EthanolConcentration,0.5717449338495062 EyesOpenShut,0.6462585034013606 FaceDetection,0.7364448226592164 +FingerMovements,0.4513805522208884 FordChallenge,0.9326641951334477 HandMovementDirection,0.6930815252849152 Handwriting,0.8028797677434466 @@ -54,6 +56,7 @@ PhotoStimulation,0.4755433455433456 RacketSports,0.9715355978823205 STEW,0.862252418813399 SelfRegulationSCP1,0.9654738607771876 +SelfRegulationSCP2,0.5097530864197531 Skoda,0.995188222906422 SpokenArabicDigits,0.9998538592734334 StandWalkJump,0.76 diff --git a/results/multiverse/PatchMTSC/PatchMTSC_balacc.csv b/results/multiverse/PatchMTSC/PatchMTSC_balacc.csv index 77498ae..73dd626 100644 --- a/results/multiverse/PatchMTSC/PatchMTSC_balacc.csv +++ b/results/multiverse/PatchMTSC/PatchMTSC_balacc.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.3926386846646261 AutomotiveRoadTrials,0.5 BIDMC32HR_disc,0.8573504232795414 BIDMC32SpO2_disc,0.4621647264399827 +BasicMotions,1.0 BeijingPM10Quality_disc,0.777159156474126 BeijingPM25Quality_disc,0.8571257395007454 BenzeneConcentration_disc,0.9118606480736484 @@ -27,6 +28,7 @@ Epilepsy,0.9576709062003179 EthanolConcentration,0.2770979020979021 EyesOpenShut,0.5 FaceDetection,0.6753688989784337 +FingerMovements,0.4361744697879152 FordChallenge,0.8597076310065165 HandMovementDirection,0.47380952380952385 Handwriting,0.3441088424413383 @@ -54,6 +56,7 @@ PhotoStimulation,0.3111111111111111 RacketSports,0.8918604651162791 STEW,0.7808641975308642 SelfRegulationSCP1,0.8536017146584661 +SelfRegulationSCP2,0.4888888888888889 Skoda,0.9267168873791115 SpokenArabicDigits,0.9827189705271898 StandWalkJump,0.5333333333333333 diff --git a/results/multiverse/PatchMTSC/PatchMTSC_f1.csv b/results/multiverse/PatchMTSC/PatchMTSC_f1.csv index 6d4f204..aba51a5 100644 --- a/results/multiverse/PatchMTSC/PatchMTSC_f1.csv +++ b/results/multiverse/PatchMTSC/PatchMTSC_f1.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.7616963279966885 AutomotiveRoadTrials,0.0 BIDMC32HR_disc,0.8944724870437583 BIDMC32SpO2_disc,0.028070175438596492 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6903888481291269 BeijingPM25Quality_disc,0.8053691275167785 BenzeneConcentration_disc,0.9016672337529772 @@ -27,6 +28,7 @@ Epilepsy,0.9565217391304348 EthanolConcentration,0.26018604446846005 EyesOpenShut,0.6666666666666666 FaceDetection,0.7078651685393258 +FingerMovements,0.3 FordChallenge,0.8247497725204732 HandMovementDirection,0.44211692075685105 Handwriting,0.3236797998903157 @@ -54,6 +56,7 @@ PhotoStimulation,0.23333333333333334 RacketSports,0.8809058869134233 STEW,0.7772390188248717 SelfRegulationSCP1,0.8668730650154799 +SelfRegulationSCP2,0.4457831325301205 Skoda,0.935858492120604 SpokenArabicDigits,0.9827231705657531 StandWalkJump,0.49927849927849915 diff --git a/results/multiverse/PatchMTSC/PatchMTSC_logloss.csv b/results/multiverse/PatchMTSC/PatchMTSC_logloss.csv index aa0214f..38cc569 100644 --- a/results/multiverse/PatchMTSC/PatchMTSC_logloss.csv +++ b/results/multiverse/PatchMTSC/PatchMTSC_logloss.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.507990920058114 AutomotiveRoadTrials,0.5570083045135601 BIDMC32HR_disc,0.3730019182104101 BIDMC32SpO2_disc,2.681304813790032 +BasicMotions,0.002242248944981942 BeijingPM10Quality_disc,0.38299167067206213 BeijingPM25Quality_disc,0.2829980627230492 BenzeneConcentration_disc,0.16048908921160027 @@ -27,6 +28,7 @@ Epilepsy,0.13011442553672609 EthanolConcentration,1.4148892335730348 EyesOpenShut,0.7119754317202979 FaceDetection,0.6440598389976232 +FingerMovements,0.7478750800796817 FordChallenge,0.3654275418909056 HandMovementDirection,1.3806486229796795 Handwriting,2.7749284488280512 @@ -54,6 +56,7 @@ PhotoStimulation,1.121451318316658 RacketSports,0.3181905941771535 STEW,0.918362952464079 SelfRegulationSCP1,0.32180060445773145 +SelfRegulationSCP2,0.7016507823644452 Skoda,0.1991570612982679 SpokenArabicDigits,0.05668528512354104 StandWalkJump,1.0498368181068891 diff --git a/results/multiverse/PatchMTSC/PatchMTSC_sensitivity.csv b/results/multiverse/PatchMTSC/PatchMTSC_sensitivity.csv index 7bfa757..1c18d4b 100644 --- a/results/multiverse/PatchMTSC/PatchMTSC_sensitivity.csv +++ b/results/multiverse/PatchMTSC/PatchMTSC_sensitivity.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.7773340820698404 AutomotiveRoadTrials,0.0 BIDMC32HR_disc,0.8957899124635265 BIDMC32SpO2_disc,0.017569546120058566 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6454046639231824 BeijingPM25Quality_disc,0.7863695937090432 BenzeneConcentration_disc,0.8270911360799001 @@ -27,6 +28,7 @@ Epilepsy,0.9565217391304348 EthanolConcentration,0.27756653992395436 EyesOpenShut,1.0 FaceDetection,0.7866061293984109 +FingerMovements,0.24489795918367346 FordChallenge,0.8291255031101353 HandMovementDirection,0.44594594594594594 Handwriting,0.3458823529411765 @@ -54,6 +56,7 @@ PhotoStimulation,0.3888888888888889 RacketSports,0.881578947368421 STEW,0.7645903479236813 SelfRegulationSCP1,0.958904109589041 +SelfRegulationSCP2,0.4111111111111111 Skoda,0.9363282631765122 SpokenArabicDigits,0.9827194179172352 StandWalkJump,0.5333333333333333 diff --git a/results/multiverse/PatchMTSC/PatchMTSC_specificity.csv b/results/multiverse/PatchMTSC/PatchMTSC_specificity.csv index fc09126..2837cfc 100644 --- a/results/multiverse/PatchMTSC/PatchMTSC_specificity.csv +++ b/results/multiverse/PatchMTSC/PatchMTSC_specificity.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.7773340820698404 AutomotiveRoadTrials,1.0 BIDMC32HR_disc,0.8957899124635265 BIDMC32SpO2_disc,0.9067599067599068 +BasicMotions,1.0 BeijingPM10Quality_disc,0.9089136490250697 BeijingPM25Quality_disc,0.9278818852924475 BenzeneConcentration_disc,0.9966301600673968 @@ -27,6 +28,7 @@ Epilepsy,0.9565217391304348 EthanolConcentration,0.27756653992395436 EyesOpenShut,0.0 FaceDetection,0.5641316685584563 +FingerMovements,0.6274509803921569 FordChallenge,0.8902897589028976 HandMovementDirection,0.44594594594594594 Handwriting,0.3458823529411765 @@ -54,6 +56,7 @@ PhotoStimulation,0.3888888888888889 RacketSports,0.881578947368421 STEW,0.7971380471380471 SelfRegulationSCP1,0.7482993197278912 +SelfRegulationSCP2,0.5666666666666667 Skoda,0.9363282631765122 SpokenArabicDigits,0.9827194179172352 StandWalkJump,0.5333333333333333 diff --git a/results/multiverse/QUANT/QUANT_accuracy.csv b/results/multiverse/QUANT/QUANT_accuracy.csv index 448da13..277e781 100644 --- a/results/multiverse/QUANT/QUANT_accuracy.csv +++ b/results/multiverse/QUANT/QUANT_accuracy.csv @@ -3,18 +3,22 @@ Alzheimers,0.3488372093023256 AppliancesEnergy_disc,0.9285714285714286 ArticularyWordRecognition,0.9766666666666667 AsphaltObstaclesCoordinates,0.8158567774936062 +AsphaltPavementTypeCoordinates,0.9318181818181818 AsphaltRegularityCoordinates,0.9880159786950732 AtrialFibrillation,0.13333333333333333 AustraliaRainfall_disc,0.7760029949460285 AutomotiveRoadTrials,0.8051948051948052 BIDMC32HR_disc,0.6031679866611088 +BIDMC32RR_disc,0.6765318882867861 BIDMC32SpO2_disc,0.5777407253022092 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8391442155309033 BeijingPM25Quality_disc,0.884310618066561 BenzeneConcentration_disc,0.8599651365485182 Blink,0.9933333333333333 BoneIntensitiesAgeGroup,0.8157303370786517 BoneProbAgeGroup,0.6382022471910113 +ButtonPress,0.9916666666666667 CharacterTrajectories,0.9846796657381616 CounterMovementJump,0.888268156424581 Cricket,0.9722222222222222 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.7034220532319392 EyesOpenShut,0.5714285714285714 FaceDetection,0.6328036322360954 +FeedbackButton,0.5147826086956522 +FeetHands,0.6693121693121693 +FingerMovements,0.5 FordChallenge,0.9360352908740005 HandMovementDirection,0.527027027027027 Handwriting,0.33176470588235296 @@ -34,34 +41,86 @@ Heartbeat,0.775609756097561 HouseholdPowerConsumption1_disc,0.9723032069970845 HouseholdPowerConsumption2_disc,0.7813411078717201 IEEEPPG_disc,0.26957831325301207 +IRDS-EFL,0.7307692307692307 +IRDS-EFR,0.6666666666666666 +IRDS-SAL,0.3392857142857143 +IRDS-SAR,0.48484848484848486 +IRDS-SFE,0.6666666666666666 IRDS-SFL,0.8103448275862069 +IRDS-SFR,0.5333333333333333 +IRDS-STL,0.5 +IRDS-STR,0.9333333333333333 +ImaginedFeetHands,0.6801033591731266 +ImaginedOpenCloseFist,0.734920634920635 +InnerSpeech,0.24 JapaneseVowels,0.9594594594594594 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.8 +KERAAL-ELK-MC,0.7142857142857143 KERAAL-RTK,0.7142857142857143 +KERAAL-RTK-MC,0.46153846153846156 +KIMORE-LA-C,0.42857142857142855 +KIMORE-LT-C,0.5714285714285714 KIMORE-PR-C,0.5714285714285714 +KIMORE-Sq-C,0.2857142857142857 +KIMORE-TR-C,0.14285714285714285 +KINECAL-3WFV,0.9166666666666666 +KINECAL-GGFV,0.9230769230769231 +KINECAL-QSEC,0.9444444444444444 KINECAL-QSEO,0.9411764705882353 LSST,0.6451743714517437 Libras,0.8888888888888888 +LiveFuelMoistureContent_disc,0.8198675496688742 Locust2022,0.9102758411639891 +LongIntervalTask,0.6714285714285714 LowCost,0.6533333333333333 +MatchingPennies,0.55 MindReading,0.5911179173047473 MotionSenseHAR,0.9886792452830189 MotorImagery,0.51 NATOPS,0.8666666666666667 +NewsHeadlineSentiment_disc,0.5253096068293855 +NewsTitleSentiment_disc,0.6065087571640415 +OpenCloseFist,0.7365079365079366 +Opportunity,0.857362552864283 +PAMAP2,0.870843860535624 PEMS-SF,0.9826589595375722 +PPGDalia_disc,0.7305185736896006 PenDigits,0.9748427672955975 PhonemeSpectra,0.27945123769758423 PhotoStimulation,0.3333333333333333 +PronouncedSpeech,0.31 RacketSports,0.9013157894736842 +SPHERE-WUS,0.75 STEW,0.6961279461279462 SelfRegulationSCP1,0.8122866894197952 +SelfRegulationSCP2,0.5111111111111111 +ShortIntervalTask,0.7258928571428571 +SitStand,0.4240625 Skoda,0.9568447117085249 +SongFamiliarity,0.5413333333333333 SpokenArabicDigits,0.9740791268758526 StandWalkJump,0.2 TactileTextureRecognition,0.9985315712187959 Tiselac,0.8319009100101112 +UCDHE-MP,0.8397790055248618 +UCDHE-MP-MC,0.6850828729281768 +UCDHE-Rowing,0.8340909090909091 UCDHE-Rowing-MC,0.7886363636363637 UCIActivity,0.9695960016659725 UIPRMD-DS-C,0.8333333333333334 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.8888888888888888 +UIPRMD-SASLR-C,0.95 +UIPRMD-SL-C,0.8888888888888888 +UIPRMD-SSA-C,0.9444444444444444 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.8 +UIPRMD-SSS-C,0.9444444444444444 +UIPRMD-STS-C,0.9444444444444444 USCActivity,0.7328371810449574 UWaveGestureLibrary,0.896875 +VisualSpeech,0.265 WISDM,0.8781147382654046 +WISDM2,0.6536317235963879 diff --git a/results/multiverse/QUANT/QUANT_auroc.csv b/results/multiverse/QUANT/QUANT_auroc.csv index 68952fa..1992cd8 100644 --- a/results/multiverse/QUANT/QUANT_auroc.csv +++ b/results/multiverse/QUANT/QUANT_auroc.csv @@ -3,18 +3,22 @@ Alzheimers,0.5409377506014436 AppliancesEnergy_disc,0.9264705882352942 ArticularyWordRecognition,0.9995543981481482 AsphaltObstaclesCoordinates,0.9569403301274932 +AsphaltPavementTypeCoordinates,0.9886570245087054 AsphaltRegularityCoordinates,0.9992196921330779 AtrialFibrillation,0.47333333333333333 AustraliaRainfall_disc,0.8588123364702962 AutomotiveRoadTrials,0.882940108892922 BIDMC32HR_disc,0.6611694301890867 +BIDMC32RR_disc,0.44833654128897177 BIDMC32SpO2_disc,0.29443238557440604 +BasicMotions,1.0 BeijingPM10Quality_disc,0.9021120625422698 BeijingPM25Quality_disc,0.946099242879247 BenzeneConcentration_disc,0.9541714740876068 Blink,1.0 BoneIntensitiesAgeGroup,0.9362514664111843 BoneProbAgeGroup,0.7826774603403756 +ButtonPress,1.0 CharacterTrajectories,0.9998385332814856 CounterMovementJump,0.9866539912054209 Cricket,0.9991582491582491 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.8778555858326564 EyesOpenShut,0.6088435374149661 FaceDetection,0.6827159571274517 +FeedbackButton,0.5291856332703213 +FeetHands,0.7482471238945486 +FingerMovements,0.5222088835534213 FordChallenge,0.974524018620103 HandMovementDirection,0.7187207623648302 Handwriting,0.8325466369302803 @@ -34,34 +41,86 @@ Heartbeat,0.7700331910858227 HouseholdPowerConsumption1_disc,0.9971583963401897 HouseholdPowerConsumption2_disc,0.8451902565890075 IEEEPPG_disc,0.6056129926765597 +IRDS-EFL,1.0 +IRDS-EFR,0.79 +IRDS-SAL,0.38860544217687076 +IRDS-SAR,0.9439655172413793 +IRDS-SFE,1.0 IRDS-SFL,0.8944746376811594 +IRDS-SFR,0.5384615384615384 +IRDS-STL,0.41750841750841755 +IRDS-STR,0.9745454545454545 +ImaginedFeetHands,0.7469991111642894 +ImaginedOpenCloseFist,0.8257600019708317 +InnerSpeech,0.5371587454712211 JapaneseVowels,0.9990616254008018 +KERAAL-CTK,0.979591836734694 +KERAAL-CTK-MC,0.923861852433281 +KERAAL-ELK,0.125 +KERAAL-ELK-MC,0.7692307692307693 KERAAL-RTK,0.7916666666666667 +KERAAL-RTK-MC,0.689102564102564 +KIMORE-LA-C,0.6666666666666666 +KIMORE-LT-C,0.5833333333333334 KIMORE-PR-C,0.6666666666666667 +KIMORE-Sq-C,0.6 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.2727272727272727 +KINECAL-GGFV,1.0 +KINECAL-QSEC,0.7647058823529411 KINECAL-QSEO,0.6875 LSST,0.908897863338516 Libras,0.9952876984126985 +LiveFuelMoistureContent_disc,0.4942208005249344 Locust2022,0.8408813771773859 +LongIntervalTask,0.6454038742690058 LowCost,0.7386833333333334 +MatchingPennies,0.5945949255485894 MindReading,0.8933409115725498 MotionSenseHAR,1.0 MotorImagery,0.651 NATOPS,0.9792962962962963 +NewsHeadlineSentiment_disc,0.5045021804136592 +NewsTitleSentiment_disc,0.5017199429575555 +OpenCloseFist,0.8236402381123016 +Opportunity,0.9624914211292696 +PAMAP2,0.9908913804872362 PEMS-SF,0.9995249030010294 +PPGDalia_disc,0.8207809091673247 PenDigits,0.999252001231967 PhonemeSpectra,0.8852128722143645 PhotoStimulation,0.4833089133089133 +PronouncedSpeech,0.5681794919211026 RacketSports,0.9617507070428364 +SPHERE-WUS,1.0 STEW,0.7846634130304164 SelfRegulationSCP1,0.9710884353741496 +SelfRegulationSCP2,0.5311728395061728 +ShortIntervalTask,0.7858003472222221 +SitStand,0.721003125 Skoda,0.9957123472168714 +SongFamiliarity,0.5345975546361507 SpokenArabicDigits,0.9987626034520197 StandWalkJump,0.61 TactileTextureRecognition,0.9999977304037385 Tiselac,0.9726588008717724 +UCDHE-MP,0.8854198473282442 +UCDHE-MP-MC,0.8801007300478884 +UCDHE-Rowing,0.8597460317460318 UCDHE-Rowing-MC,0.9518587874543756 UCIActivity,0.9992833463258334 UIPRMD-DS-C,0.9907407407407408 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.9259259259259258 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.9876543209876543 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9876543209876544 USCActivity,0.9658042298566661 UWaveGestureLibrary,0.9890457589285713 +VisualSpeech,0.4945429485304452 WISDM,0.979301376945545 +WISDM2,0.9202828893144831 diff --git a/results/multiverse/QUANT/QUANT_balacc.csv b/results/multiverse/QUANT/QUANT_balacc.csv index 56d04f2..f51c267 100644 --- a/results/multiverse/QUANT/QUANT_balacc.csv +++ b/results/multiverse/QUANT/QUANT_balacc.csv @@ -3,18 +3,22 @@ Alzheimers,0.33189033189033185 AppliancesEnergy_disc,0.8602941176470589 ArticularyWordRecognition,0.9766666666666667 AsphaltObstaclesCoordinates,0.8149479002788417 +AsphaltPavementTypeCoordinates,0.921680035650624 AsphaltRegularityCoordinates,0.9881889763779528 AtrialFibrillation,0.13333333333333333 AustraliaRainfall_disc,0.37542225002342133 AutomotiveRoadTrials,0.7999092558983666 BIDMC32HR_disc,0.3611555334343606 +BIDMC32RR_disc,0.2928808677676353 BIDMC32SpO2_disc,0.4086937342793858 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7818196407487648 BeijingPM25Quality_disc,0.8498730689625146 BenzeneConcentration_disc,0.7824144629659429 Blink,0.994 BoneIntensitiesAgeGroup,0.8390551809537783 BoneProbAgeGroup,0.6699791690287699 +ButtonPress,0.9925373134328358 CharacterTrajectories,0.9837701231880528 CounterMovementJump,0.8880414312617703 Cricket,0.9722222222222223 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.704020979020979 EyesOpenShut,0.5714285714285714 FaceDetection,0.6328036322360954 +FeedbackButton,0.5147826086956522 +FeetHands,0.6700902950968743 +FingerMovements,0.5002000800320128 FordChallenge,0.9258200115523824 HandMovementDirection,0.5488095238095237 Handwriting,0.32758240506754466 @@ -34,34 +41,86 @@ Heartbeat,0.6881816026552868 HouseholdPowerConsumption1_disc,0.9375270173676303 HouseholdPowerConsumption2_disc,0.5857663391909967 IEEEPPG_disc,0.34115763361895374 +IRDS-EFL,0.7083333333333334 +IRDS-EFR,0.5 +IRDS-SAL,0.44047619047619047 +IRDS-SAR,0.7068965517241379 +IRDS-SFE,0.5 IRDS-SFL,0.818840579710145 +IRDS-SFR,0.7307692307692308 +IRDS-STL,0.43265993265993263 +IRDS-STR,0.7818181818181817 +ImaginedFeetHands,0.6800987334091122 +ImaginedOpenCloseFist,0.7349175386103846 +InnerSpeech,0.24882469354353853 JapaneseVowels,0.9595407515485379 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.6666666666666666 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.38461538461538464 KERAAL-RTK,0.7083333333333333 +KERAAL-RTK-MC,0.3428571428571428 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.5833333333333333 KIMORE-PR-C,0.75 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.5 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.5 LSST,0.4462175732998365 Libras,0.8888888888888888 +LiveFuelMoistureContent_disc,0.49753937007874016 Locust2022,0.6211728987985349 +LongIntervalTask,0.5678362573099416 LowCost,0.6533333333333333 +MatchingPennies,0.5502547021943573 MindReading,0.5834944033242436 MotionSenseHAR,0.9929577464788734 MotorImagery,0.51 NATOPS,0.8666666666666667 +NewsHeadlineSentiment_disc,0.33400445165215076 +NewsTitleSentiment_disc,0.33263284505176083 +OpenCloseFist,0.7364785268928943 +Opportunity,0.8673752464910909 +PAMAP2,0.872401305212959 PEMS-SF,0.982924482924483 +PPGDalia_disc,0.6171901927997413 PenDigits,0.9751831422760866 PhonemeSpectra,0.2795397944508752 PhotoStimulation,0.3 +PronouncedSpeech,0.31190979736376157 RacketSports,0.9079941860465116 +SPHERE-WUS,0.75 STEW,0.6961279461279462 SelfRegulationSCP1,0.8128552790979406 +SelfRegulationSCP2,0.5111111111111111 +ShortIntervalTask,0.6318055555555555 +SitStand,0.4240625 Skoda,0.9572028601038045 +SongFamiliarity,0.5381011044727229 SpokenArabicDigits,0.9740784557907846 StandWalkJump,0.20000000000000004 TactileTextureRecognition,0.9985119047619048 Tiselac,0.6289436546711366 +UCDHE-MP,0.7470992366412215 +UCDHE-MP-MC,0.6855223429951691 +UCDHE-Rowing,0.6398412698412699 UCDHE-Rowing-MC,0.798 UCIActivity,0.9697056706075416 UIPRMD-DS-C,0.8333333333333333 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.8888888888888888 +UIPRMD-SASLR-C,0.95 +UIPRMD-SL-C,0.8888888888888888 +UIPRMD-SSA-C,0.9444444444444444 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.8 +UIPRMD-SSS-C,0.9444444444444444 +UIPRMD-STS-C,0.9444444444444444 USCActivity,0.7167175640359815 UWaveGestureLibrary,0.8968750000000001 +VisualSpeech,0.26525754532582263 WISDM,0.6860793609214104 +WISDM2,0.5815942890852407 diff --git a/results/multiverse/QUANT/QUANT_f1.csv b/results/multiverse/QUANT/QUANT_f1.csv index 39bb2b2..35565fd 100644 --- a/results/multiverse/QUANT/QUANT_f1.csv +++ b/results/multiverse/QUANT/QUANT_f1.csv @@ -3,18 +3,22 @@ Alzheimers,0.3268321282001173 AppliancesEnergy_disc,0.8 ArticularyWordRecognition,0.976309881422925 AsphaltObstaclesCoordinates,0.8130904866968851 +AsphaltPavementTypeCoordinates,0.9316998886198998 AsphaltRegularityCoordinates,0.9879839786381842 AtrialFibrillation,0.1587301587301587 AustraliaRainfall_disc,0.7550669198787413 AutomotiveRoadTrials,0.6666666666666666 BIDMC32HR_disc,0.5621629906194213 +BIDMC32RR_disc,0.6448640082667935 BIDMC32SpO2_disc,0.021256038647342997 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6988130563798219 BeijingPM25Quality_disc,0.7994505494505495 BenzeneConcentration_disc,0.7192233009708738 Blink,0.9925558312655087 BoneIntensitiesAgeGroup,0.8145868753157427 BoneProbAgeGroup,0.6393914557807232 +ButtonPress,0.9906542056074766 CharacterTrajectories,0.9846813097619039 CounterMovementJump,0.8879701356892 Cricket,0.9720279720279721 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.6944309174622973 EyesOpenShut,0.625 FaceDetection,0.6393534002229655 +FeedbackButton,0.5139372822299652 +FeetHands,0.6955674622503654 +FingerMovements,0.5 FordChallenge,0.9124197810494526 HandMovementDirection,0.5218393265931466 Handwriting,0.28769226060916486 @@ -34,34 +41,86 @@ Heartbeat,0.5490196078431373 HouseholdPowerConsumption1_disc,0.9721169828275605 HouseholdPowerConsumption2_disc,0.7604164277882139 IEEEPPG_disc,0.12814649235540723 +IRDS-EFL,0.5882352941176471 +IRDS-EFR,0.0 +IRDS-SAL,0.32727272727272727 +IRDS-SAR,0.32 +IRDS-SFE,0.0 IRDS-SFL,0.6451612903225806 +IRDS-SFR,0.36363636363636365 +IRDS-STL,0.24 +IRDS-STR,0.6 +ImaginedFeetHands,0.6770996348461137 +ImaginedOpenCloseFist,0.733935209771641 +InnerSpeech,0.180091758895833 JapaneseVowels,0.9606745311211673 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.8956043956043956 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.7738095238095238 KERAAL-RTK,0.6666666666666666 +KERAAL-RTK-MC,0.471221086605702 +KIMORE-LA-C,0.6 +KIMORE-LT-C,0.5714285714285714 KIMORE-PR-C,0.4 +KIMORE-Sq-C,0.4444444444444444 +KIMORE-TR-C,0.25 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.5913072996881248 Libras,0.8882776836689881 +LiveFuelMoistureContent_disc,0.04225352112676056 Locust2022,0.34801762114537443 +LongIntervalTask,0.352112676056338 LowCost,0.6967930029154519 +MatchingPennies,0.5679012345679012 MindReading,0.5787353660090242 MotionSenseHAR,0.9886478870581268 MotorImagery,0.6573426573426573 NATOPS,0.8663448779709145 +NewsHeadlineSentiment_disc,0.4170295421224733 +NewsTitleSentiment_disc,0.4858320051749023 +OpenCloseFist,0.7287581699346405 +Opportunity,0.8568324063035968 +PAMAP2,0.8676207829629831 PEMS-SF,0.9826689992653034 +PPGDalia_disc,0.71689013752021 PenDigits,0.9748142789278724 PhonemeSpectra,0.2714706603440876 PhotoStimulation,0.2855392156862745 +PronouncedSpeech,0.3017625590469625 RacketSports,0.9002982766239506 +SPHERE-WUS,0.6666666666666666 STEW,0.6543249281838494 SelfRegulationSCP1,0.8387096774193549 +SelfRegulationSCP2,0.5728155339805825 +ShortIntervalTask,0.4408014571948998 +SitStand,0.4229507683968729 Skoda,0.9569143569016567 +SongFamiliarity,0.48656716417910445 SpokenArabicDigits,0.9740993763583665 StandWalkJump,0.16317016317016317 TactileTextureRecognition,0.9985305578103894 Tiselac,0.8190320252018833 +UCDHE-MP,0.6506024096385542 +UCDHE-MP-MC,0.6826196458935079 +UCDHE-Rowing,0.43410852713178294 UCDHE-Rowing-MC,0.7893329412572497 UCIActivity,0.9698126451008039 UIPRMD-DS-C,0.8571428571428571 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.8888888888888888 +UIPRMD-SASLR-C,0.9473684210526315 +UIPRMD-SL-C,0.9 +UIPRMD-SSA-C,0.9411764705882353 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.75 +UIPRMD-SSS-C,0.9411764705882353 +UIPRMD-STS-C,0.9473684210526315 USCActivity,0.7301499368568765 UWaveGestureLibrary,0.896277595661853 +VisualSpeech,0.2608537657400808 WISDM,0.8639385243000529 +WISDM2,0.6411698989007818 diff --git a/results/multiverse/QUANT/QUANT_logloss.csv b/results/multiverse/QUANT/QUANT_logloss.csv index 8990567..d6eadac 100644 --- a/results/multiverse/QUANT/QUANT_logloss.csv +++ b/results/multiverse/QUANT/QUANT_logloss.csv @@ -3,18 +3,22 @@ Alzheimers,1.3281742674205437 AppliancesEnergy_disc,0.2656305333768875 ArticularyWordRecognition,0.34608599892736647 AsphaltObstaclesCoordinates,0.4906694604248872 +AsphaltPavementTypeCoordinates,0.198561805133058 AsphaltRegularityCoordinates,0.04628685957711269 AtrialFibrillation,1.316971872685015 AustraliaRainfall_disc,0.527980940291519 AutomotiveRoadTrials,0.39658765182680855 BIDMC32HR_disc,3.524835776540508 +BIDMC32RR_disc,3.0164992855353194 BIDMC32SpO2_disc,4.345806912779263 +BasicMotions,0.06333197522990529 BeijingPM10Quality_disc,0.3557766230858167 BeijingPM25Quality_disc,0.2769875988634742 BenzeneConcentration_disc,0.3468399219264265 Blink,0.14976131392109487 BoneIntensitiesAgeGroup,0.5077588747962859 BoneProbAgeGroup,0.8436367717244749 +ButtonPress,0.00993766502825196 CharacterTrajectories,0.1522945376533851 CounterMovementJump,0.3440408417946666 Cricket,0.19747246128041918 @@ -27,6 +31,9 @@ Epilepsy,0.08279172900786116 EthanolConcentration,0.8816391936794009 EyesOpenShut,0.6792667867098384 FaceDetection,0.6542365442284841 +FeedbackButton,0.6964253122177333 +FeetHands,0.6068900756693193 +FingerMovements,0.7108164277214618 FordChallenge,0.19718973413967097 HandMovementDirection,1.277798132118388 Handwriting,3.1443271885240693 @@ -34,34 +41,86 @@ Heartbeat,0.49500994714598656 HouseholdPowerConsumption1_disc,0.09932769878769504 HouseholdPowerConsumption2_disc,0.4636007089005385 IEEEPPG_disc,1.581949790541438 +IRDS-EFL,0.41529424824156796 +IRDS-EFR,0.7938412279209405 +IRDS-SAL,1.5873715801426893 +IRDS-SAR,0.9286611124468108 +IRDS-SFE,0.44811882705730804 IRDS-SFL,0.5319665122118982 +IRDS-SFR,0.8352043827920468 +IRDS-STL,0.8014613578148586 +IRDS-STR,0.25807274589393414 +ImaginedFeetHands,0.603719404044137 +ImaginedOpenCloseFist,0.5263606636964406 +InnerSpeech,1.39494561562007 JapaneseVowels,0.3115468311084261 +KERAAL-CTK,0.39761042010904946 +KERAAL-CTK-MC,0.6808924840204329 +KERAAL-ELK,0.7298986985834768 +KERAAL-ELK-MC,0.37503644863479163 KERAAL-RTK,0.4866675249194107 +KERAAL-RTK-MC,0.8633130671575492 +KIMORE-LA-C,1.3087696135825355 +KIMORE-LT-C,0.8431356595464033 KIMORE-PR-C,1.147500177766419 +KIMORE-Sq-C,0.9361191423119497 +KIMORE-TR-C,1.8658286792102932 +KINECAL-3WFV,0.3268281910537523 +KINECAL-GGFV,0.22155484381628432 +KINECAL-QSEC,0.1944301136389429 KINECAL-QSEO,0.22051735733717734 LSST,1.207546889469361 Libras,0.3971291398881753 +LiveFuelMoistureContent_disc,0.5049149816677566 Locust2022,0.293848936363067 +LongIntervalTask,0.7256076084439562 LowCost,0.6145331286978449 +MatchingPennies,0.6849185670961994 MindReading,0.8456109812451477 MotionSenseHAR,0.05170898315276288 MotorImagery,0.6882096789219168 NATOPS,0.33338407920442825 +NewsHeadlineSentiment_disc,1.994517795304564 +NewsTitleSentiment_disc,1.8340951413529578 +OpenCloseFist,0.5369775099034968 +Opportunity,0.4151480492933275 +PAMAP2,0.6475351792173842 PEMS-SF,0.1119191028696404 +PPGDalia_disc,0.7077858655910739 PenDigits,0.14423321014180385 PhonemeSpectra,3.106679683023059 PhotoStimulation,1.500588418135136 +PronouncedSpeech,1.4246842053602011 RacketSports,0.5159592149911211 +SPHERE-WUS,0.40645747626566686 STEW,0.5688781916678138 SelfRegulationSCP1,0.34564441616105196 +SelfRegulationSCP2,0.6980943632316526 +ShortIntervalTask,0.5729324830188383 +SitStand,1.2121980779809158 Skoda,0.2620692816620543 +SongFamiliarity,0.7132233262877204 SpokenArabicDigits,0.2533269435900628 StandWalkJump,1.1035969433362947 TactileTextureRecognition,0.08151484228459158 Tiselac,0.5861921649092302 +UCDHE-MP,0.4066543280368262 +UCDHE-MP-MC,0.8519744549347563 +UCDHE-Rowing,0.3791139358773713 UCDHE-Rowing-MC,0.712774739071487 UCIActivity,0.17070273040025163 UIPRMD-DS-C,0.33577345598700203 +UIPRMD-HS-C,0.09456860865895417 +UIPRMD-IL-C,0.5235092404878918 +UIPRMD-SASLR-C,0.29963651509139794 +UIPRMD-SL-C,0.29833762140219044 +UIPRMD-SSA-C,0.14592137035702984 +UIPRMD-SSE-C,0.22070836218197057 +UIPRMD-SSIER-C,0.36238300860298617 +UIPRMD-SSS-C,0.183360974271512 +UIPRMD-STS-C,0.16182599974351605 USCActivity,0.9521250501946104 UWaveGestureLibrary,0.5825091184403577 +VisualSpeech,1.43170444635646 WISDM,0.6490157421025186 +WISDM2,1.1705358787363922 diff --git a/results/multiverse/QUANT/QUANT_sensitivity.csv b/results/multiverse/QUANT/QUANT_sensitivity.csv index 1d2aed1..f6ff9e6 100644 --- a/results/multiverse/QUANT/QUANT_sensitivity.csv +++ b/results/multiverse/QUANT/QUANT_sensitivity.csv @@ -3,18 +3,22 @@ Alzheimers,0.3488372093023256 AppliancesEnergy_disc,0.75 ArticularyWordRecognition,0.9766666666666667 AsphaltObstaclesCoordinates,0.8158567774936062 +AsphaltPavementTypeCoordinates,0.9318181818181818 AsphaltRegularityCoordinates,1.0 AtrialFibrillation,0.13333333333333333 AustraliaRainfall_disc,0.7760029949460285 AutomotiveRoadTrials,0.7894736842105263 BIDMC32HR_disc,0.6031679866611088 +BIDMC32RR_disc,0.6765318882867861 BIDMC32SpO2_disc,0.016105417276720352 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6460905349794238 BeijingPM25Quality_disc,0.762778505897772 BenzeneConcentration_disc,0.5780274656679151 Blink,1.0 BoneIntensitiesAgeGroup,0.8157303370786517 BoneProbAgeGroup,0.6382022471910113 +ButtonPress,1.0 CharacterTrajectories,0.9846796657381616 CounterMovementJump,0.888268156424581 Cricket,0.9722222222222222 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.7034220532319392 EyesOpenShut,0.7142857142857143 FaceDetection,0.6509648127128264 +FeedbackButton,0.5130434782608696 +FeetHands,0.7620064034151548 +FingerMovements,0.5102040816326531 FordChallenge,0.8843761434321259 HandMovementDirection,0.527027027027027 Handwriting,0.33176470588235296 @@ -34,34 +41,86 @@ Heartbeat,0.49122807017543857 HouseholdPowerConsumption1_disc,0.9723032069970845 HouseholdPowerConsumption2_disc,0.7813411078717201 IEEEPPG_disc,0.26957831325301207 +IRDS-EFL,0.4166666666666667 +IRDS-EFR,0.0 +IRDS-SAL,0.6428571428571429 +IRDS-SAR,1.0 +IRDS-SFE,0.0 IRDS-SFL,0.8333333333333334 +IRDS-SFR,1.0 +IRDS-STL,0.2727272727272727 +IRDS-STR,0.6 +ImaginedFeetHands,0.671147880041365 +ImaginedOpenCloseFist,0.7319915254237288 +InnerSpeech,0.24 JapaneseVowels,0.9594594594594594 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.7142857142857143 KERAAL-RTK,0.6666666666666666 +KERAAL-RTK-MC,0.46153846153846156 +KIMORE-LA-C,1.0 +KIMORE-LT-C,0.6666666666666666 KIMORE-PR-C,1.0 +KIMORE-Sq-C,1.0 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.6451743714517437 Libras,0.8888888888888888 +LiveFuelMoistureContent_disc,0.025 Locust2022,0.2696245733788396 +LongIntervalTask,0.2777777777777778 LowCost,0.7966666666666666 +MatchingPennies,0.5948275862068966 MindReading,0.5911179173047473 MotionSenseHAR,0.9886792452830189 MotorImagery,0.94 NATOPS,0.8666666666666667 +NewsHeadlineSentiment_disc,0.5253096068293855 +NewsTitleSentiment_disc,0.6065087571640415 +OpenCloseFist,0.7086864406779662 +Opportunity,0.857362552864283 +PAMAP2,0.870843860535624 PEMS-SF,0.9826589595375722 +PPGDalia_disc,0.7305185736896006 PenDigits,0.9748427672955975 PhonemeSpectra,0.27945123769758423 PhotoStimulation,0.3333333333333333 +PronouncedSpeech,0.31 RacketSports,0.9013157894736842 +SPHERE-WUS,0.5 STEW,0.5751964085297419 SelfRegulationSCP1,0.9794520547945206 +SelfRegulationSCP2,0.6555555555555556 +ShortIntervalTask,0.3025 +SitStand,0.4240625 Skoda,0.9568447117085249 +SongFamiliarity,0.4515235457063712 SpokenArabicDigits,0.9740791268758526 StandWalkJump,0.2 TactileTextureRecognition,0.9985315712187959 Tiselac,0.8319009100101112 +UCDHE-MP,0.54 +UCDHE-MP-MC,0.6850828729281768 +UCDHE-Rowing,0.3111111111111111 UCDHE-Rowing-MC,0.7886363636363637 UCIActivity,0.9695960016659725 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.8888888888888888 +UIPRMD-SASLR-C,0.9 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,0.8888888888888888 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.6 +UIPRMD-SSS-C,0.8888888888888888 +UIPRMD-STS-C,1.0 USCActivity,0.7328371810449574 UWaveGestureLibrary,0.896875 +VisualSpeech,0.265 WISDM,0.8781147382654046 +WISDM2,0.6536317235963879 diff --git a/results/multiverse/QUANT/QUANT_specificity.csv b/results/multiverse/QUANT/QUANT_specificity.csv index 58b4458..f3f7679 100644 --- a/results/multiverse/QUANT/QUANT_specificity.csv +++ b/results/multiverse/QUANT/QUANT_specificity.csv @@ -3,18 +3,22 @@ Alzheimers,0.3488372093023256 AppliancesEnergy_disc,0.9705882352941176 ArticularyWordRecognition,0.9766666666666667 AsphaltObstaclesCoordinates,0.8158567774936062 +AsphaltPavementTypeCoordinates,0.9318181818181818 AsphaltRegularityCoordinates,0.9763779527559056 AtrialFibrillation,0.13333333333333333 AustraliaRainfall_disc,0.7760029949460285 AutomotiveRoadTrials,0.8103448275862069 BIDMC32HR_disc,0.6031679866611088 +BIDMC32RR_disc,0.6765318882867861 BIDMC32SpO2_disc,0.8012820512820513 +BasicMotions,1.0 BeijingPM10Quality_disc,0.9175487465181058 BeijingPM25Quality_disc,0.9369676320272572 BenzeneConcentration_disc,0.9868014602639708 Blink,0.988 BoneIntensitiesAgeGroup,0.8157303370786517 BoneProbAgeGroup,0.6382022471910113 +ButtonPress,0.9850746268656716 CharacterTrajectories,0.9846796657381616 CounterMovementJump,0.888268156424581 Cricket,0.9722222222222222 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.7034220532319392 EyesOpenShut,0.42857142857142855 FaceDetection,0.6146424517593644 +FeedbackButton,0.5165217391304348 +FeetHands,0.5781741867785939 +FingerMovements,0.49019607843137253 FordChallenge,0.9672638796726388 HandMovementDirection,0.527027027027027 Handwriting,0.33176470588235296 @@ -34,34 +41,86 @@ Heartbeat,0.8851351351351351 HouseholdPowerConsumption1_disc,0.9723032069970845 HouseholdPowerConsumption2_disc,0.7813411078717201 IEEEPPG_disc,0.26957831325301207 +IRDS-EFL,1.0 +IRDS-EFR,1.0 +IRDS-SAL,0.23809523809523808 +IRDS-SAR,0.41379310344827586 +IRDS-SFE,1.0 IRDS-SFL,0.8043478260869565 +IRDS-SFR,0.46153846153846156 +IRDS-STL,0.5925925925925926 +IRDS-STR,0.9636363636363636 +ImaginedFeetHands,0.6890495867768595 +ImaginedOpenCloseFist,0.7378435517970402 +InnerSpeech,0.24 JapaneseVowels,0.9594594594594594 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,1.0 +KERAAL-ELK-MC,0.7142857142857143 KERAAL-RTK,0.75 +KERAAL-RTK-MC,0.46153846153846156 +KIMORE-LA-C,0.0 +KIMORE-LT-C,0.5 KIMORE-PR-C,0.5 +KIMORE-Sq-C,0.0 +KIMORE-TR-C,0.0 +KINECAL-3WFV,1.0 +KINECAL-GGFV,1.0 +KINECAL-QSEC,1.0 KINECAL-QSEO,1.0 LSST,0.6451743714517437 Libras,0.8888888888888888 +LiveFuelMoistureContent_disc,0.9700787401574803 Locust2022,0.9727212242182302 +LongIntervalTask,0.8578947368421053 LowCost,0.51 +MatchingPennies,0.5056818181818182 MindReading,0.5911179173047473 MotionSenseHAR,0.9886792452830189 MotorImagery,0.08 NATOPS,0.8666666666666667 +NewsHeadlineSentiment_disc,0.5253096068293855 +NewsTitleSentiment_disc,0.6065087571640415 +OpenCloseFist,0.7642706131078224 +Opportunity,0.857362552864283 +PAMAP2,0.870843860535624 PEMS-SF,0.9826589595375722 +PPGDalia_disc,0.7305185736896006 PenDigits,0.9748427672955975 PhonemeSpectra,0.27945123769758423 PhotoStimulation,0.3333333333333333 +PronouncedSpeech,0.31 RacketSports,0.9013157894736842 +SPHERE-WUS,1.0 STEW,0.8170594837261503 SelfRegulationSCP1,0.6462585034013606 +SelfRegulationSCP2,0.36666666666666664 +ShortIntervalTask,0.9611111111111111 +SitStand,0.4240625 Skoda,0.9568447117085249 +SongFamiliarity,0.6246786632390745 SpokenArabicDigits,0.9740791268758526 StandWalkJump,0.2 TactileTextureRecognition,0.9985315712187959 Tiselac,0.8319009100101112 +UCDHE-MP,0.9541984732824428 +UCDHE-MP-MC,0.6850828729281768 +UCDHE-Rowing,0.9685714285714285 UCDHE-Rowing-MC,0.7886363636363637 UCIActivity,0.9695960016659725 UIPRMD-DS-C,0.6666666666666666 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.8888888888888888 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.7777777777777778 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.8888888888888888 USCActivity,0.7328371810449574 UWaveGestureLibrary,0.896875 +VisualSpeech,0.265 WISDM,0.8781147382654046 +WISDM2,0.6536317235963879 diff --git a/results/multiverse/RDST/RDST_accuracy.csv b/results/multiverse/RDST/RDST_accuracy.csv index 121b0ae..59c071d 100644 --- a/results/multiverse/RDST/RDST_accuracy.csv +++ b/results/multiverse/RDST/RDST_accuracy.csv @@ -3,17 +3,21 @@ Alzheimers,0.37209302325581395 AppliancesEnergy_disc,0.8333333333333334 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8542199488491049 +AsphaltPavementTypeCoordinates,0.8996212121212122 AsphaltRegularityCoordinates,0.9800266311584553 AtrialFibrillation,0.2 AutomotiveRoadTrials,0.8051948051948052 BIDMC32HR_disc,0.9441433930804501 +BIDMC32RR_disc,0.7936640266777825 BIDMC32SpO2_disc,0.6611087953313881 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8108161648177497 BeijingPM25Quality_disc,0.8746038034865293 BenzeneConcentration_disc,0.7394925430950997 Blink,1.0 BoneIntensitiesAgeGroup,0.8067415730337079 BoneProbAgeGroup,0.6876404494382022 +ButtonPress,0.9083333333333333 CharacterTrajectories,0.9930362116991643 CounterMovementJump,0.8938547486033519 Cricket,1.0 @@ -26,6 +30,9 @@ Epilepsy,0.9927536231884058 EthanolConcentration,0.5855513307984791 EyesOpenShut,0.4523809523809524 FaceDetection,0.6220204313280363 +FeedbackButton,0.5382608695652173 +FeetHands,0.6285714285714286 +FingerMovements,0.53 FordChallenge,0.8005238489109456 HandMovementDirection,0.2972972972972973 Handwriting,0.5964705882352941 @@ -33,32 +40,80 @@ Heartbeat,0.7414634146341463 HouseholdPowerConsumption1_disc,0.880466472303207 HouseholdPowerConsumption2_disc,0.7813411078717201 IEEEPPG_disc,0.6694277108433735 +IRDS-EFL,0.8076923076923077 +IRDS-EFR,0.6666666666666666 +IRDS-SAL,0.75 +IRDS-SAR,0.45454545454545453 +IRDS-SFE,0.6666666666666666 IRDS-SFL,0.8620689655172413 +IRDS-SFR,0.8666666666666667 +IRDS-STL,0.8421052631578947 +IRDS-STR,0.9333333333333333 +ImaginedFeetHands,0.6403100775193798 +ImaginedOpenCloseFist,0.662962962962963 +InnerSpeech,0.29 JapaneseVowels,0.9891891891891892 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.7 +KERAAL-ELK-MC,1.0 KERAAL-RTK,0.5714285714285714 +KERAAL-RTK-MC,0.6153846153846154 +KIMORE-LA-C,0.42857142857142855 +KIMORE-LT-C,0.5714285714285714 KIMORE-PR-C,0.5714285714285714 +KIMORE-Sq-C,0.42857142857142855 +KIMORE-TR-C,0.14285714285714285 +KINECAL-3WFV,0.8333333333333334 +KINECAL-GGFV,0.9230769230769231 +KINECAL-QSEC,0.9444444444444444 KINECAL-QSEO,0.9411764705882353 LSST,0.6423357664233577 Libras,0.9222222222222223 +LiveFuelMoistureContent_disc,0.8112582781456954 Locust2022,0.9139133070627463 +LongIntervalTask,0.6053571428571428 LowCost,0.605 +MatchingPennies,0.5342857142857143 MindReading,0.5130168453292496 MotionSenseHAR,0.9811320754716981 MotorImagery,0.52 NATOPS,0.8888888888888888 +OpenCloseFist,0.6656084656084656 +Opportunity,0.844482891195694 +PAMAP2,0.8756947953511874 PEMS-SF,0.8959537572254336 PenDigits,0.9877072612921669 PhonemeSpectra,0.31583656427080226 PhotoStimulation,0.3055555555555556 +PronouncedSpeech,0.245 RacketSports,0.9078947368421053 +SPHERE-WUS,0.75 STEW,0.768658810325477 SelfRegulationSCP1,0.8805460750853242 +SelfRegulationSCP2,0.5222222222222223 +ShortIntervalTask,0.6705357142857142 +SitStand,0.3371875 Skoda,0.9487088786699681 +SongFamiliarity,0.5333333333333333 SpokenArabicDigits,0.9940882219190541 StandWalkJump,0.4666666666666667 TactileTextureRecognition,1.0 +UCDHE-MP,0.8674033149171271 +UCDHE-MP-MC,0.7983425414364641 +UCDHE-Rowing,0.8363636363636363 UCDHE-Rowing-MC,0.7477272727272727 UCIActivity,0.9900041649312786 UIPRMD-DS-C,0.6666666666666666 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.6111111111111112 +UIPRMD-SASLR-C,0.65 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,0.8888888888888888 +UIPRMD-SSE-C,0.7777777777777778 +UIPRMD-SSIER-C,0.95 +UIPRMD-SSS-C,0.9444444444444444 +UIPRMD-STS-C,0.9166666666666666 UWaveGestureLibrary,0.934375 +VisualSpeech,0.235 WISDM,0.8748309831949005 diff --git a/results/multiverse/RDST/RDST_auroc.csv b/results/multiverse/RDST/RDST_auroc.csv index 1f570ca..79e6eff 100644 --- a/results/multiverse/RDST/RDST_auroc.csv +++ b/results/multiverse/RDST/RDST_auroc.csv @@ -3,17 +3,21 @@ Alzheimers,0.5023275862068965 AppliancesEnergy_disc,0.7058823529411765 ArticularyWordRecognition,0.9965277777777779 AsphaltObstaclesCoordinates,0.9020911850007297 +AsphaltPavementTypeCoordinates,0.9266599527016193 AsphaltRegularityCoordinates,0.9801979144498829 AtrialFibrillation,0.4 AutomotiveRoadTrials,0.6937386569872959 BIDMC32HR_disc,0.9243724782787222 +BIDMC32RR_disc,0.499757281553398 BIDMC32SpO2_disc,0.5000204773264803 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7368530554695829 BeijingPM25Quality_disc,0.8403171452536127 BenzeneConcentration_disc,0.593261424483086 Blink,1.0 BoneIntensitiesAgeGroup,0.8479851488237317 BoneProbAgeGroup,0.7587837897122445 +ButtonPress,0.9119966206702338 CharacterTrajectories,0.9963441132828388 CounterMovementJump,0.9201680672268907 Cricket,1.0 @@ -26,6 +30,9 @@ Epilepsy,0.9953703703703703 EthanolConcentration,0.7234656206737426 EyesOpenShut,0.45238095238095244 FaceDetection,0.6220204313280363 +FeedbackButton,0.5382608695652175 +FeetHands,0.629073386183719 +FingerMovements,0.5316126450580232 FordChallenge,0.7687002064520954 HandMovementDirection,0.5205701078582434 Handwriting,0.7898650839558772 @@ -33,32 +40,80 @@ Heartbeat,0.63217164532954 HouseholdPowerConsumption1_disc,0.8120358587652599 HouseholdPowerConsumption2_disc,0.679409861094851 IEEEPPG_disc,0.755322650728289 +IRDS-EFL,0.7916666666666667 +IRDS-EFR,0.5 +IRDS-SAL,0.6190476190476191 +IRDS-SAR,0.6896551724137931 +IRDS-SFE,0.5 IRDS-SFL,0.8360507246376812 +IRDS-SFR,0.5 +IRDS-STL,0.7542087542087542 +IRDS-STR,0.6909090909090909 +ImaginedFeetHands,0.6402982300204261 +ImaginedOpenCloseFist,0.6629362704697747 +InnerSpeech,0.5267997838118602 JapaneseVowels,0.9941348973607038 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9642857142857143 +KERAAL-ELK,0.4375 +KERAAL-ELK-MC,1.0 KERAAL-RTK,0.5833333333333334 +KERAAL-RTK-MC,0.6458333333333334 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.625 KIMORE-PR-C,0.75 +KIMORE-Sq-C,0.6 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.45454545454545453 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.5 LSST,0.7633111558964139 Libras,0.9583333333333331 +LiveFuelMoistureContent_disc,0.49411089238845146 Locust2022,0.530759868204433 +LongIntervalTask,0.5008771929824561 LowCost,0.605 +MatchingPennies,0.5337480407523512 MindReading,0.6912300513936374 MotionSenseHAR,0.9861748405935284 MotorImagery,0.52 NATOPS,0.9333333333333333 +OpenCloseFist,0.6655756172286523 +Opportunity,0.8689015063773422 +PAMAP2,0.9314260689935975 PEMS-SF,0.939476925071526 PenDigits,0.9931793646609715 PhonemeSpectra,0.6489163734073046 PhotoStimulation,0.436043956043956 +PronouncedSpeech,0.4941475402884798 RacketSports,0.9367627785058978 +SPHERE-WUS,0.75 STEW,0.768658810325477 SelfRegulationSCP1,0.8807660050321499 +SelfRegulationSCP2,0.5222222222222223 +ShortIntervalTask,0.5576388888888888 +SitStand,0.558125 Skoda,0.9696592558443135 +SongFamiliarity,0.525105213310641 SpokenArabicDigits,0.9967156404877476 StandWalkJump,0.6 TactileTextureRecognition,1.0 +UCDHE-MP,0.8434732824427481 +UCDHE-MP-MC,0.8633238028486979 +UCDHE-Rowing,0.6742857142857144 UCDHE-Rowing-MC,0.8400143210437329 UCIActivity,0.9938559791672321 UIPRMD-DS-C,0.6666666666666667 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.611111111111111 +UIPRMD-SASLR-C,0.65 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,0.8888888888888888 +UIPRMD-SSE-C,0.7777777777777777 +UIPRMD-SSIER-C,0.9500000000000001 +UIPRMD-SSS-C,0.9444444444444444 +UIPRMD-STS-C,0.9166666666666667 UWaveGestureLibrary,0.9625 +VisualSpeech,0.4942006708121751 WISDM,0.9144338487394956 diff --git a/results/multiverse/RDST/RDST_balacc.csv b/results/multiverse/RDST/RDST_balacc.csv index 806a1e1..04cc211 100644 --- a/results/multiverse/RDST/RDST_balacc.csv +++ b/results/multiverse/RDST/RDST_balacc.csv @@ -3,17 +3,21 @@ Alzheimers,0.3292448292448293 AppliancesEnergy_disc,0.7058823529411764 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.855559891736377 +AsphaltPavementTypeCoordinates,0.8922682709447415 AsphaltRegularityCoordinates,0.9801979144498829 AtrialFibrillation,0.20000000000000004 AutomotiveRoadTrials,0.6937386569872959 BIDMC32HR_disc,0.9222549806426313 +BIDMC32RR_disc,0.3331583552055993 BIDMC32SpO2_disc,0.5000204773264803 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7368530554695829 BeijingPM25Quality_disc,0.8403171452536127 BenzeneConcentration_disc,0.5932614244830862 Blink,1.0 BoneIntensitiesAgeGroup,0.8257512599736333 BoneProbAgeGroup,0.7202169355573785 +ButtonPress,0.9119966206702337 CharacterTrajectories,0.9926243464197094 CounterMovementJump,0.8939736346516006 Cricket,1.0 @@ -26,6 +30,9 @@ Epilepsy,0.9926470588235294 EthanolConcentration,0.5864801864801865 EyesOpenShut,0.45238095238095233 FaceDetection,0.6220204313280363 +FeedbackButton,0.5382608695652175 +FeetHands,0.6290733861837191 +FingerMovements,0.5316126450580232 FordChallenge,0.7687002064520954 HandMovementDirection,0.25952380952380955 Handwriting,0.5911563396916857 @@ -33,32 +40,80 @@ Heartbeat,0.6321716453295401 HouseholdPowerConsumption1_disc,0.757770701761614 HouseholdPowerConsumption2_disc,0.6124071767907383 IEEEPPG_disc,0.6687356103091107 +IRDS-EFL,0.7916666666666667 +IRDS-EFR,0.5 +IRDS-SAL,0.6190476190476191 +IRDS-SAR,0.6896551724137931 +IRDS-SFE,0.5 IRDS-SFL,0.8360507246376812 +IRDS-SFR,0.5 +IRDS-STL,0.7542087542087541 +IRDS-STR,0.6909090909090909 +ImaginedFeetHands,0.6402982300204261 +ImaginedOpenCloseFist,0.6629362704697745 +InnerSpeech,0.28983307725708946 JapaneseVowels,0.9892007633943118 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.6666666666666666 +KERAAL-ELK,0.4375 +KERAAL-ELK-MC,1.0 KERAAL-RTK,0.5833333333333333 +KERAAL-RTK-MC,0.4380952380952381 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.625 KIMORE-PR-C,0.75 +KIMORE-Sq-C,0.6 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.45454545454545453 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.5 LSST,0.4089433731259633 Libras,0.922222222222222 +LiveFuelMoistureContent_disc,0.49411089238845146 Locust2022,0.530759868204433 +LongIntervalTask,0.5008771929824561 LowCost,0.605 +MatchingPennies,0.533748040752351 MindReading,0.5054719127386054 MotionSenseHAR,0.9893345580730761 MotorImagery,0.52 NATOPS,0.888888888888889 +OpenCloseFist,0.6655756172286523 +Opportunity,0.8547712643732203 +PAMAP2,0.8768501112327814 PEMS-SF,0.8943608726217421 PenDigits,0.9875996290005788 PhonemeSpectra,0.3158791960433548 PhotoStimulation,0.25555555555555554 +PronouncedSpeech,0.2422617876582071 RacketSports,0.9159883720930233 +SPHERE-WUS,0.75 STEW,0.768658810325477 SelfRegulationSCP1,0.8807660050321499 +SelfRegulationSCP2,0.5222222222222223 +ShortIntervalTask,0.5576388888888889 +SitStand,0.3371875 Skoda,0.9468073577936195 +SongFamiliarity,0.525105213310641 SpokenArabicDigits,0.9940909090909091 StandWalkJump,0.46666666666666673 TactileTextureRecognition,1.0 +UCDHE-MP,0.8434732824427481 +UCDHE-MP-MC,0.7985597826086956 +UCDHE-Rowing,0.6742857142857144 UCDHE-Rowing-MC,0.7581111111111112 UCIActivity,0.9903522403522403 UIPRMD-DS-C,0.6666666666666667 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.611111111111111 +UIPRMD-SASLR-C,0.65 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,0.8888888888888888 +UIPRMD-SSE-C,0.7777777777777778 +UIPRMD-SSIER-C,0.95 +UIPRMD-SSS-C,0.9444444444444444 +UIPRMD-STS-C,0.9166666666666667 UWaveGestureLibrary,0.934375 +VisualSpeech,0.24207808123249297 WISDM,0.5465191225960131 diff --git a/results/multiverse/RDST/RDST_f1.csv b/results/multiverse/RDST/RDST_f1.csv index 178ac53..d0ed46d 100644 --- a/results/multiverse/RDST/RDST_f1.csv +++ b/results/multiverse/RDST/RDST_f1.csv @@ -3,17 +3,21 @@ Alzheimers,0.3426151272960359 AppliancesEnergy_disc,0.5333333333333333 ArticularyWordRecognition,0.9933217391304349 AsphaltObstaclesCoordinates,0.8536590300958963 +AsphaltPavementTypeCoordinates,0.8998427246238153 AsphaltRegularityCoordinates,0.9799732977303071 AtrialFibrillation,0.22299922299922298 AutomotiveRoadTrials,0.5454545454545454 BIDMC32HR_disc,0.9419458282562919 +BIDMC32RR_disc,0.7027329634307115 BIDMC32SpO2_disc,0.1746192893401015 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6317007327419977 BeijingPM25Quality_disc,0.7841800204568701 BenzeneConcentration_disc,0.331178518150174 Blink,1.0 BoneIntensitiesAgeGroup,0.8045872981748985 BoneProbAgeGroup,0.6905229824757603 +ButtonPress,0.9009009009009009 CharacterTrajectories,0.9930367066706492 CounterMovementJump,0.8949368680406735 Cricket,1.0 @@ -26,6 +30,9 @@ Epilepsy,0.9927589422807559 EthanolConcentration,0.5744694944428124 EyesOpenShut,0.5490196078431373 FaceDetection,0.6152512998266898 +FeedbackButton,0.570735650767987 +FeetHands,0.6475903614457831 +FingerMovements,0.5607476635514018 FordChallenge,0.7072627958729516 HandMovementDirection,0.29880103903873 Handwriting,0.5644035136725344 @@ -33,32 +40,80 @@ Heartbeat,0.4536082474226804 HouseholdPowerConsumption1_disc,0.8782816274682171 HouseholdPowerConsumption2_disc,0.7652836668158669 IEEEPPG_disc,0.6763552444294286 +IRDS-EFL,0.7368421052631579 +IRDS-EFR,0.0 +IRDS-SAL,0.4166666666666667 +IRDS-SAR,0.3076923076923077 +IRDS-SFE,0.0 IRDS-SFL,0.7037037037037037 +IRDS-SFR,0.0 +IRDS-STL,0.6666666666666666 +IRDS-STR,0.5 +ImaginedFeetHands,0.6317460317460317 +ImaginedOpenCloseFist,0.6539923954372624 +InnerSpeech,0.2702087542087542 JapaneseVowels,0.9894713591977305 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,1.0 KERAAL-RTK,0.5714285714285714 +KERAAL-RTK-MC,0.5944055944055944 +KIMORE-LA-C,0.6 +KIMORE-LT-C,0.6666666666666666 KIMORE-PR-C,0.4 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,0.25 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.5879067141976849 Libras,0.9214337417815679 +LiveFuelMoistureContent_disc,0.046822742474916385 Locust2022,0.11801242236024845 +LongIntervalTask,0.2533783783783784 LowCost,0.511340206185567 +MatchingPennies,0.48417721518987344 MindReading,0.4985876234680534 MotionSenseHAR,0.9811161623285267 MotorImagery,0.42857142857142855 NATOPS,0.8850228616036578 +OpenCloseFist,0.6546448087431694 +Opportunity,0.8421739754376285 +PAMAP2,0.8783442132155268 PEMS-SF,0.8943157786806455 PenDigits,0.9876957856000388 PhonemeSpectra,0.31047646977417165 PhotoStimulation,0.22647818817449458 +PronouncedSpeech,0.22806071171907236 RacketSports,0.9079214805305947 +SPHERE-WUS,0.6666666666666666 STEW,0.7547955390334572 SelfRegulationSCP1,0.887459807073955 +SelfRegulationSCP2,0.5425531914893617 +ShortIntervalTask,0.2605210420841683 +SitStand,0.3369335619990041 Skoda,0.9488257240546188 +SongFamiliarity,0.38596491228070173 SpokenArabicDigits,0.9940859934997474 StandWalkJump,0.43386243386243384 TactileTextureRecognition,1.0 +UCDHE-MP,0.7669902912621359 +UCDHE-MP-MC,0.7998336495894083 +UCDHE-Rowing,0.5 UCDHE-Rowing-MC,0.7447620492590061 UCIActivity,0.9899330252462594 UIPRMD-DS-C,0.6 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.6956521739130435 +UIPRMD-SASLR-C,0.46153846153846156 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,0.875 +UIPRMD-SSE-C,0.7777777777777778 +UIPRMD-SSIER-C,0.9473684210526315 +UIPRMD-SSS-C,0.9473684210526315 +UIPRMD-STS-C,0.9090909090909091 UWaveGestureLibrary,0.9345601930633759 +VisualSpeech,0.17902430199602 WISDM,0.8541505708616366 diff --git a/results/multiverse/RDST/RDST_logloss.csv b/results/multiverse/RDST/RDST_logloss.csv index cfa889a..b4a7531 100644 --- a/results/multiverse/RDST/RDST_logloss.csv +++ b/results/multiverse/RDST/RDST_logloss.csv @@ -3,17 +3,21 @@ Alzheimers,22.632061430375884 AppliancesEnergy_disc,6.0072755648528595 ArticularyWordRecognition,0.24029102259411456 AsphaltObstaclesCoordinates,5.254445634730634 +AsphaltPavementTypeCoordinates,3.618018237922745 AsphaltRegularityCoordinates,0.7199131835376265 AtrialFibrillation,28.834922711293718 AutomotiveRoadTrials,7.021490919957888 BIDMC32HR_disc,2.013276179300416 +BIDMC32RR_disc,7.437102304132135 BIDMC32SpO2_disc,12.214877117695806 +BasicMotions,2.220446049250313e-16 BeijingPM10Quality_disc,6.8188765821329005 BeijingPM25Quality_disc,4.519737043445159 BenzeneConcentration_disc,9.389640481960598 Blink,2.220446049250313e-16 BoneIntensitiesAgeGroup,6.965739756099045 BoneProbAgeGroup,11.258579373229853 +ButtonPress,3.3040015606690725 CharacterTrajectories,0.25100037179050966 CounterMovementJump,3.8258626502414854 Cricket,2.220446049250313e-16 @@ -26,6 +30,9 @@ Epilepsy,0.2611858941240375 EthanolConcentration,14.938244180280492 EyesOpenShut,19.738191141659392 FaceDetection,13.623764561380263 +FeedbackButton,16.64276517358366 +FeetHands,13.38764268738637 +FingerMovements,16.94051709288506 FordChallenge,7.189849249249036 HandMovementDirection,25.327972651812054 Handwriting,14.54467424996139 @@ -33,32 +40,80 @@ Heartbeat,9.318603071332726 HouseholdPowerConsumption1_disc,4.308425040681642 HouseholdPowerConsumption2_disc,7.881265318320077 IEEEPPG_disc,11.915033010408456 +IRDS-EFL,6.931471805599452 +IRDS-EFR,12.014551129705717 +IRDS-SAL,9.010913347279288 +IRDS-SAR,19.66017457588208 +IRDS-SFE,12.014551129705717 IRDS-SFL,4.971538398498918 +IRDS-SFR,4.805820451882287 +IRDS-STL,5.691103166702708 +IRDS-STR,2.4029102259411435 +ImaginedFeetHands,12.96453889344989 +ImaginedOpenCloseFist,12.148046142258003 +InnerSpeech,25.590993906273173 JapaneseVowels,0.3896611177201857 +KERAAL-CTK,2.220446049250313e-16 +KERAAL-CTK-MC,2.5745466706512254 +KERAAL-ELK,10.813096016735146 +KERAAL-ELK-MC,2.220446049250313e-16 KERAAL-RTK,15.44728002390735 +KERAAL-RTK-MC,13.862943611198904 +KIMORE-LA-C,20.596373365209804 +KIMORE-LT-C,15.447280023907352 KIMORE-PR-C,15.447280023907352 +KIMORE-Sq-C,20.596373365209804 +KIMORE-TR-C,30.8945600478147 +KINECAL-3WFV,6.007275564852859 +KINECAL-GGFV,2.772588722239781 +KINECAL-QSEC,2.0024251882842865 KINECAL-QSEO,2.1202149052421855 LSST,12.891525664720731 Libras,2.803395263598001 +LiveFuelMoistureContent_disc,6.802941202581713 Locust2022,3.1028789216457326 +LongIntervalTask,14.224370355348018 LowCost,14.237243088701277 +MatchingPennies,16.786044292645986 MindReading,17.552652033291356 MotionSenseHAR,0.6800689318701352 MotorImagery,17.300953626776234 NATOPS,4.004850376568572 +OpenCloseFist,12.052692561863513 +Opportunity,5.605404765820026 +PAMAP2,4.480413710825072 PEMS-SF,3.750206711006409 PenDigits,0.44307521318811843 PhonemeSpectra,24.659749738930728 PhotoStimulation,25.030314853553577 +PronouncedSpeech,27.212958308783445 RacketSports,3.31981018057658 +SPHERE-WUS,9.010913347279288 STEW,8.338381655254514 SelfRegulationSCP1,4.3055558655942 +SelfRegulationSCP2,17.220856619244863 +ShortIntervalTask,11.875096518378776 +SitStand,23.890184011974206 Skoda,1.8487193991588209 +SongFamiliarity,16.820371581588002 SpokenArabicDigits,0.2130820800629938 StandWalkJump,19.223281807529144 TactileTextureRecognition,2.220446049250313e-16 +UCDHE-MP,4.779268957672993 +UCDHE-MP-MC,7.2684715397943425 +UCDHE-Rowing,5.898052372764625 UCDHE-Rowing-MC,9.092830741345464 UCIActivity,0.3602864145517751 UIPRMD-DS-C,12.014551129705717 +UIPRMD-HS-C,2.220446049250313e-16 +UIPRMD-IL-C,14.016976317990006 +UIPRMD-SASLR-C,12.615278686191004 +UIPRMD-SL-C,2.220446049250313e-16 +UIPRMD-SSA-C,4.004850376568573 +UIPRMD-SSE-C,8.009700753137146 +UIPRMD-SSIER-C,1.8021826694558576 +UIPRMD-SSS-C,2.0024251882842865 +UIPRMD-STS-C,3.0036377824264293 UWaveGestureLibrary,2.3653647536608133 +VisualSpeech,27.573394842674617 WISDM,4.511548656779585 diff --git a/results/multiverse/RDST/RDST_sensitivity.csv b/results/multiverse/RDST/RDST_sensitivity.csv index f2ba3a3..acd0700 100644 --- a/results/multiverse/RDST/RDST_sensitivity.csv +++ b/results/multiverse/RDST/RDST_sensitivity.csv @@ -3,17 +3,21 @@ Alzheimers,0.37209302325581395 AppliancesEnergy_disc,0.5 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8542199488491049 +AsphaltPavementTypeCoordinates,0.8996212121212122 AsphaltRegularityCoordinates,0.9918918918918919 AtrialFibrillation,0.2 AutomotiveRoadTrials,0.47368421052631576 BIDMC32HR_disc,0.9441433930804501 +BIDMC32RR_disc,0.7936640266777825 BIDMC32SpO2_disc,0.1259150805270864 +BasicMotions,1.0 BeijingPM10Quality_disc,0.5617283950617284 BeijingPM25Quality_disc,0.7536041939711664 BenzeneConcentration_disc,0.20786516853932585 Blink,1.0 BoneIntensitiesAgeGroup,0.8067415730337079 BoneProbAgeGroup,0.6876404494382022 +ButtonPress,0.9433962264150944 CharacterTrajectories,0.9930362116991643 CounterMovementJump,0.8938547486033519 Cricket,1.0 @@ -26,6 +30,9 @@ Epilepsy,0.9927536231884058 EthanolConcentration,0.5855513307984791 EyesOpenShut,0.6666666666666666 FaceDetection,0.6044267877412032 +FeedbackButton,0.6139130434782609 +FeetHands,0.688367129135539 +FingerMovements,0.6122448979591837 FordChallenge,0.6395901939260885 HandMovementDirection,0.2972972972972973 Handwriting,0.5964705882352941 @@ -33,32 +40,80 @@ Heartbeat,0.38596491228070173 HouseholdPowerConsumption1_disc,0.880466472303207 HouseholdPowerConsumption2_disc,0.7813411078717201 IEEEPPG_disc,0.6694277108433735 +IRDS-EFL,0.5833333333333334 +IRDS-EFR,0.0 +IRDS-SAL,0.35714285714285715 +IRDS-SAR,1.0 +IRDS-SFE,0.0 IRDS-SFL,0.7916666666666666 +IRDS-SFR,0.0 +IRDS-STL,0.5454545454545454 +IRDS-STR,0.4 +ImaginedFeetHands,0.6173733195449845 +ImaginedOpenCloseFist,0.6377118644067796 +InnerSpeech,0.29 JapaneseVowels,0.9891891891891892 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,1.0 KERAAL-RTK,0.6666666666666666 +KERAAL-RTK-MC,0.6153846153846154 +KIMORE-LA-C,1.0 +KIMORE-LT-C,1.0 KIMORE-PR-C,1.0 +KIMORE-Sq-C,1.0 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.6423357664233577 Libras,0.9222222222222223 +LiveFuelMoistureContent_disc,0.029166666666666667 Locust2022,0.06484641638225255 +LongIntervalTask,0.20833333333333334 LowCost,0.41333333333333333 +MatchingPennies,0.4396551724137931 MindReading,0.5130168453292496 MotionSenseHAR,0.9811320754716981 MotorImagery,0.36 NATOPS,0.8888888888888888 +OpenCloseFist,0.6345338983050848 +Opportunity,0.844482891195694 +PAMAP2,0.8756947953511874 PEMS-SF,0.8959537572254336 PenDigits,0.9877072612921669 PhonemeSpectra,0.31583656427080226 PhotoStimulation,0.3055555555555556 +PronouncedSpeech,0.245 RacketSports,0.9078947368421053 +SPHERE-WUS,0.5 STEW,0.7121212121212122 SelfRegulationSCP1,0.9452054794520548 +SelfRegulationSCP2,0.5666666666666667 +ShortIntervalTask,0.1625 +SitStand,0.3371875 Skoda,0.9487088786699681 +SongFamiliarity,0.3047091412742382 SpokenArabicDigits,0.9940882219190541 StandWalkJump,0.4666666666666667 TactileTextureRecognition,1.0 +UCDHE-MP,0.79 +UCDHE-MP-MC,0.7983425414364641 +UCDHE-Rowing,0.4 UCDHE-Rowing-MC,0.7477272727272727 UCIActivity,0.9900041649312786 UIPRMD-DS-C,0.5 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.8888888888888888 +UIPRMD-SASLR-C,0.3 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,0.7777777777777778 +UIPRMD-SSE-C,0.7777777777777778 +UIPRMD-SSIER-C,0.9 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.8333333333333334 UWaveGestureLibrary,0.934375 +VisualSpeech,0.235 WISDM,0.8748309831949005 diff --git a/results/multiverse/RDST/RDST_specificity.csv b/results/multiverse/RDST/RDST_specificity.csv index 0413b89..24d32c9 100644 --- a/results/multiverse/RDST/RDST_specificity.csv +++ b/results/multiverse/RDST/RDST_specificity.csv @@ -3,17 +3,21 @@ Alzheimers,0.37209302325581395 AppliancesEnergy_disc,0.9117647058823529 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8542199488491049 +AsphaltPavementTypeCoordinates,0.8996212121212122 AsphaltRegularityCoordinates,0.968503937007874 AtrialFibrillation,0.2 AutomotiveRoadTrials,0.9137931034482759 BIDMC32HR_disc,0.9441433930804501 +BIDMC32RR_disc,0.7936640266777825 BIDMC32SpO2_disc,0.8741258741258742 +BasicMotions,1.0 BeijingPM10Quality_disc,0.9119777158774374 BeijingPM25Quality_disc,0.9270300965360591 BenzeneConcentration_disc,0.9786576804268464 Blink,1.0 BoneIntensitiesAgeGroup,0.8067415730337079 BoneProbAgeGroup,0.6876404494382022 +ButtonPress,0.8805970149253731 CharacterTrajectories,0.9930362116991643 CounterMovementJump,0.8938547486033519 Cricket,1.0 @@ -26,6 +30,9 @@ Epilepsy,0.9927536231884058 EthanolConcentration,0.5855513307984791 EyesOpenShut,0.23809523809523808 FaceDetection,0.6396140749148694 +FeedbackButton,0.46260869565217394 +FeetHands,0.5697796432318992 +FingerMovements,0.45098039215686275 FordChallenge,0.8978102189781022 HandMovementDirection,0.2972972972972973 Handwriting,0.5964705882352941 @@ -33,32 +40,80 @@ Heartbeat,0.8783783783783784 HouseholdPowerConsumption1_disc,0.880466472303207 HouseholdPowerConsumption2_disc,0.7813411078717201 IEEEPPG_disc,0.6694277108433735 +IRDS-EFL,1.0 +IRDS-EFR,1.0 +IRDS-SAL,0.8809523809523809 +IRDS-SAR,0.3793103448275862 +IRDS-SFE,1.0 IRDS-SFL,0.8804347826086957 +IRDS-SFR,1.0 +IRDS-STL,0.9629629629629629 +IRDS-STR,0.9818181818181818 +ImaginedFeetHands,0.6632231404958677 +ImaginedOpenCloseFist,0.6881606765327696 +InnerSpeech,0.29 JapaneseVowels,0.9891891891891892 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.875 +KERAAL-ELK-MC,1.0 KERAAL-RTK,0.5 +KERAAL-RTK-MC,0.6153846153846154 +KIMORE-LA-C,0.0 +KIMORE-LT-C,0.25 KIMORE-PR-C,0.5 +KIMORE-Sq-C,0.2 +KIMORE-TR-C,0.0 +KINECAL-3WFV,0.9090909090909091 +KINECAL-GGFV,1.0 +KINECAL-QSEC,1.0 KINECAL-QSEO,1.0 LSST,0.6423357664233577 Libras,0.9222222222222223 +LiveFuelMoistureContent_disc,0.9590551181102362 Locust2022,0.9966733200266135 +LongIntervalTask,0.7934210526315789 LowCost,0.7966666666666666 +MatchingPennies,0.6278409090909091 MindReading,0.5130168453292496 MotionSenseHAR,0.9811320754716981 MotorImagery,0.68 NATOPS,0.8888888888888888 +OpenCloseFist,0.6966173361522199 +Opportunity,0.844482891195694 +PAMAP2,0.8756947953511874 PEMS-SF,0.8959537572254336 PenDigits,0.9877072612921669 PhonemeSpectra,0.31583656427080226 PhotoStimulation,0.3055555555555556 +PronouncedSpeech,0.245 RacketSports,0.9078947368421053 +SPHERE-WUS,1.0 STEW,0.8251964085297419 SelfRegulationSCP1,0.8163265306122449 +SelfRegulationSCP2,0.4777777777777778 +ShortIntervalTask,0.9527777777777777 +SitStand,0.3371875 Skoda,0.9487088786699681 +SongFamiliarity,0.7455012853470437 SpokenArabicDigits,0.9940882219190541 StandWalkJump,0.4666666666666667 TactileTextureRecognition,1.0 +UCDHE-MP,0.8969465648854962 +UCDHE-MP-MC,0.7983425414364641 +UCDHE-Rowing,0.9485714285714286 UCDHE-Rowing-MC,0.7477272727272727 UCIActivity,0.9900041649312786 UIPRMD-DS-C,0.8333333333333334 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.3333333333333333 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.7777777777777778 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,0.8888888888888888 +UIPRMD-STS-C,1.0 UWaveGestureLibrary,0.934375 +VisualSpeech,0.235 WISDM,0.8748309831949005 diff --git a/results/multiverse/RIST/RIST_accuracy.csv b/results/multiverse/RIST/RIST_accuracy.csv index 5fddd8b..6a4268f 100644 --- a/results/multiverse/RIST/RIST_accuracy.csv +++ b/results/multiverse/RIST/RIST_accuracy.csv @@ -3,18 +3,22 @@ Alzheimers,0.4883720930232558 AppliancesEnergy_disc,0.9047619047619048 ArticularyWordRecognition,0.9866666666666667 AsphaltObstaclesCoordinates,0.8209718670076727 +AsphaltPavementTypeCoordinates,0.9365530303030303 AsphaltRegularityCoordinates,0.9866844207723036 AtrialFibrillation,0.13333333333333333 AustraliaRainfall_disc,0.7711778041222105 AutomotiveRoadTrials,0.7922077922077922 BIDMC32HR_disc,0.9637348895373072 +BIDMC32RR_disc,0.7940808670279283 BIDMC32SpO2_disc,0.7152980408503543 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8341917591125199 BeijingPM25Quality_disc,0.8815372424722663 BenzeneConcentration_disc,0.8194847956614372 Blink,0.9933333333333333 BoneIntensitiesAgeGroup,0.8044943820224719 BoneProbAgeGroup,0.6269662921348315 +ButtonPress,1.0 CharacterTrajectories,0.9818941504178273 CounterMovementJump,0.9162011173184358 Cricket,0.9861111111111112 @@ -27,6 +31,9 @@ Epilepsy,0.9710144927536232 EthanolConcentration,0.6083650190114068 EyesOpenShut,0.47619047619047616 FaceDetection,0.6027241770715096 +FeedbackButton,0.5147826086956522 +FeetHands,0.6735449735449736 +FingerMovements,0.5 FordChallenge,0.9058450510063414 HandMovementDirection,0.44594594594594594 Handwriting,0.3776470588235294 @@ -34,34 +41,85 @@ Heartbeat,0.775609756097561 HouseholdPowerConsumption1_disc,0.9300291545189504 HouseholdPowerConsumption2_disc,0.7696793002915452 IEEEPPG_disc,0.3004518072289157 +IRDS-EFL,0.5769230769230769 +IRDS-EFR,0.6666666666666666 +IRDS-SAL,0.3392857142857143 +IRDS-SAR,0.15151515151515152 +IRDS-SFE,0.6666666666666666 IRDS-SFL,0.853448275862069 +IRDS-SFR,0.6 +IRDS-STL,0.6842105263157895 +IRDS-STR,0.9333333333333333 +ImaginedFeetHands,0.6795865633074936 +ImaginedOpenCloseFist,0.7253968253968254 +InnerSpeech,0.3 JapaneseVowels,0.9621621621621622 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.7142857142857143 +KERAAL-ELK,0.8 +KERAAL-ELK-MC,0.7857142857142857 KERAAL-RTK,0.7142857142857143 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,0.42857142857142855 KIMORE-PR-C,0.42857142857142855 +KIMORE-Sq-C,0.2857142857142857 +KIMORE-TR-C,0.14285714285714285 +KINECAL-3WFV,0.9166666666666666 +KINECAL-GGFV,0.9230769230769231 +KINECAL-QSEC,0.9444444444444444 KINECAL-QSEO,0.9411764705882353 LSST,0.6285482562854826 Libras,0.9722222222222222 +LiveFuelMoistureContent_disc,0.823841059602649 Locust2022,0.9120945741133677 +LongIntervalTask,0.66875 LowCost,0.6683333333333333 +MatchingPennies,0.59 MindReading,0.5313935681470138 MotionSenseHAR,1.0 MotorImagery,0.54 NATOPS,0.8333333333333334 +NewsHeadlineSentiment_disc,0.5346879884573764 +NewsTitleSentiment_disc,0.6095146487114745 +OpenCloseFist,0.7158730158730159 +Opportunity,0.8408304498269896 +PAMAP2,0.8766043456291056 PEMS-SF,1.0 +PPGDalia_disc,0.7848896750768085 PenDigits,0.9785591766723842 PhonemeSpectra,0.3095735162541008 PhotoStimulation,0.3888888888888889 +PronouncedSpeech,0.3 RacketSports,0.8947368421052632 +SPHERE-WUS,1.0 STEW,0.7093153759820426 SelfRegulationSCP1,0.8600682593856656 +SelfRegulationSCP2,0.5888888888888889 +ShortIntervalTask,0.7116071428571429 +SitStand,0.409375 Skoda,0.9430491687301026 +SongFamiliarity,0.5306666666666666 SpokenArabicDigits,0.977262391996362 StandWalkJump,0.4666666666666667 TactileTextureRecognition,1.0 Tiselac,0.8332659251769464 +UCDHE-MP,0.8370165745856354 +UCDHE-MP-MC,0.7430939226519337 +UCDHE-Rowing,0.8022727272727272 UCDHE-Rowing-MC,0.7136363636363636 UCIActivity,0.9820907955018742 UIPRMD-DS-C,0.8611111111111112 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.5 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.8888888888888888 +UIPRMD-SSA-C,0.9444444444444444 +UIPRMD-SSE-C,0.8333333333333334 +UIPRMD-SSIER-C,0.85 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9444444444444444 USCActivity,0.724179829890644 UWaveGestureLibrary,0.93125 +VisualSpeech,0.235 WISDM,0.884682248406413 +WISDM2,0.6715155084413035 diff --git a/results/multiverse/RIST/RIST_auroc.csv b/results/multiverse/RIST/RIST_auroc.csv index e9f7900..d0a5f4e 100644 --- a/results/multiverse/RIST/RIST_auroc.csv +++ b/results/multiverse/RIST/RIST_auroc.csv @@ -3,18 +3,22 @@ Alzheimers,0.679592522052927 AppliancesEnergy_disc,0.9117647058823529 ArticularyWordRecognition,0.9992476851851851 AsphaltObstaclesCoordinates,0.9637274432868004 +AsphaltPavementTypeCoordinates,0.9917037286039811 AsphaltRegularityCoordinates,0.9998865006739023 AtrialFibrillation,0.2733333333333333 AustraliaRainfall_disc,0.85321042954414 AutomotiveRoadTrials,0.8643375680580763 BIDMC32HR_disc,0.9796647192603877 +BIDMC32RR_disc,0.4923154650081621 BIDMC32SpO2_disc,0.35926957376444935 +BasicMotions,1.0 BeijingPM10Quality_disc,0.9001850323448384 BeijingPM25Quality_disc,0.9421535333418176 BenzeneConcentration_disc,0.9137770429479297 Blink,0.9999999999999999 BoneIntensitiesAgeGroup,0.9266918262452637 BoneProbAgeGroup,0.7994593061464543 +ButtonPress,1.0 CharacterTrajectories,0.9998037692900722 CounterMovementJump,0.9882440965212901 Cricket,0.9989478114478114 @@ -27,6 +31,9 @@ Epilepsy,0.9999282536949348 EthanolConcentration,0.8274723845741583 EyesOpenShut,0.4886621315192743 FaceDetection,0.6473671377459057 +FeedbackButton,0.5146389413988658 +FeetHands,0.7499577249174375 +FingerMovements,0.513405362144858 FordChallenge,0.9690316191634226 HandMovementDirection,0.6901176793125946 Handwriting,0.8604807067070522 @@ -34,34 +41,85 @@ Heartbeat,0.7430654338549075 HouseholdPowerConsumption1_disc,0.9823892646114087 HouseholdPowerConsumption2_disc,0.8175246395592667 IEEEPPG_disc,0.654846712385118 +IRDS-EFL,0.9166666666666666 +IRDS-EFR,0.8500000000000001 +IRDS-SAL,0.40986394557823125 +IRDS-SAR,0.9310344827586207 +IRDS-SFE,1.0 IRDS-SFL,0.9245923913043479 +IRDS-SFR,0.1538461538461538 +IRDS-STL,0.3888888888888889 +IRDS-STR,0.8109090909090909 +ImaginedFeetHands,0.7465381344705873 +ImaginedOpenCloseFist,0.8033765049987457 +InnerSpeech,0.5171718375465454 JapaneseVowels,0.9983650711831268 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9340659340659341 +KERAAL-ELK,0.3125 +KERAAL-ELK-MC,0.8461538461538461 KERAAL-RTK,0.8541666666666666 +KERAAL-RTK-MC,0.5064102564102565 +KIMORE-LA-C,0.5416666666666666 KIMORE-PR-C,0.6666666666666667 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,0.6666666666666667 +KINECAL-3WFV,0.8181818181818181 +KINECAL-GGFV,0.5416666666666666 +KINECAL-QSEC,0.7058823529411764 KINECAL-QSEO,0.71875 LSST,0.9016546492050616 Libras,0.9990906084656085 +LiveFuelMoistureContent_disc,0.4973884514435695 Locust2022,0.8377068388819631 +LongIntervalTask,0.6859703947368421 LowCost,0.7238277777777777 +MatchingPennies,0.641122975444096 MindReading,0.8986911156922168 MotionSenseHAR,1.0 MotorImagery,0.5696 NATOPS,0.9701481481481481 +NewsHeadlineSentiment_disc,0.5055659882296057 +NewsTitleSentiment_disc,0.5039200939565102 +OpenCloseFist,0.7963940498799584 +Opportunity,0.9592652833551694 +PAMAP2,0.9921806000547686 PEMS-SF,0.9999208171668382 +PPGDalia_disc,0.896617078838711 PenDigits,0.9997051572644785 PhonemeSpectra,0.9008021437910019 PhotoStimulation,0.4992633292633292 +PronouncedSpeech,0.5524417993126046 RacketSports,0.9698561016934538 +SPHERE-WUS,1.0 STEW,0.820367914082841 SelfRegulationSCP1,0.9769825738514585 +SelfRegulationSCP2,0.6111728395061728 +ShortIntervalTask,0.7970694444444445 +SitStand,0.7080873046875 Skoda,0.99360826788873 +SongFamiliarity,0.535922067379245 SpokenArabicDigits,0.9988886274402269 StandWalkJump,0.6466666666666666 TactileTextureRecognition,1.0 Tiselac,0.9751194960553742 +UCDHE-MP,0.9116221374045802 +UCDHE-MP-MC,0.8987332021795358 +UCDHE-Rowing,0.7938571428571428 UCDHE-Rowing-MC,0.9150657623819388 UCIActivity,0.9998564339489403 UIPRMD-DS-C,0.95679012345679 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.5308641975308642 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.9753086419753086 +UIPRMD-SSIER-C,0.99 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,1.0 USCActivity,0.9731656594053175 UWaveGestureLibrary,0.9957087053571427 +VisualSpeech,0.508716750320087 WISDM,0.9761357074847351 +WISDM2,0.9386900618850068 diff --git a/results/multiverse/RIST/RIST_balacc.csv b/results/multiverse/RIST/RIST_balacc.csv index 14def61..0b7db2c 100644 --- a/results/multiverse/RIST/RIST_balacc.csv +++ b/results/multiverse/RIST/RIST_balacc.csv @@ -3,18 +3,22 @@ Alzheimers,0.46007696007696014 AppliancesEnergy_disc,0.8455882352941176 ArticularyWordRecognition,0.9866666666666667 AsphaltObstaclesCoordinates,0.821286507553318 +AsphaltPavementTypeCoordinates,0.927942104872252 AsphaltRegularityCoordinates,0.9868376250266014 AtrialFibrillation,0.13333333333333333 AustraliaRainfall_disc,0.3674718503245003 AutomotiveRoadTrials,0.6674228675136116 BIDMC32HR_disc,0.9460966542750929 +BIDMC32RR_disc,0.3333333333333333 BIDMC32SpO2_disc,0.5 +BasicMotions,1.0 BeijingPM10Quality_disc,0.775690169690995 BeijingPM25Quality_disc,0.8495567647061013 BenzeneConcentration_disc,0.7278288933273173 Blink,0.994 BoneIntensitiesAgeGroup,0.8223381598048958 BoneProbAgeGroup,0.6480883082005553 +ButtonPress,1.0 CharacterTrajectories,0.9805886460610166 CounterMovementJump,0.916195856873823 Cricket,0.9861111111111112 @@ -27,6 +31,9 @@ Epilepsy,0.9705882352941176 EthanolConcentration,0.6089160839160839 EyesOpenShut,0.47619047619047616 FaceDetection,0.6027241770715097 +FeedbackButton,0.5147826086956522 +FeetHands,0.6740994287544473 +FingerMovements,0.5006002400960384 FordChallenge,0.8861159205570978 HandMovementDirection,0.40476190476190477 Handwriting,0.3739786358882968 @@ -34,34 +41,85 @@ Heartbeat,0.6720009483167377 HouseholdPowerConsumption1_disc,0.8138599014197156 HouseholdPowerConsumption2_disc,0.5465753424657535 IEEEPPG_disc,0.3681571238768982 +IRDS-EFL,0.5416666666666666 +IRDS-EFR,0.5 +IRDS-SAL,0.41666666666666663 +IRDS-SAR,0.5172413793103449 +IRDS-SFE,0.5 IRDS-SFL,0.8460144927536233 +IRDS-SFR,0.34615384615384615 +IRDS-STL,0.5622895622895623 +IRDS-STR,0.7818181818181817 +ImaginedFeetHands,0.6795811361713402 +ImaginedOpenCloseFist,0.7254105152829039 +InnerSpeech,0.3084855873609673 JapaneseVowels,0.9612493278566693 +KERAAL-CTK,0.8571428571428572 +KERAAL-CTK-MC,0.5 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.8846153846153846 KERAAL-RTK,0.7083333333333333 +KERAAL-RTK-MC,0.26666666666666666 +KIMORE-LA-C,0.5 KIMORE-PR-C,0.6666666666666666 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.5 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.5 LSST,0.4158344277954828 Libras,0.9722222222222221 +LiveFuelMoistureContent_disc,0.4948326771653543 Locust2022,0.6144701495757063 +LongIntervalTask,0.5220029239766082 LowCost,0.6683333333333333 +MatchingPennies,0.5903049895506792 MindReading,0.5052453447604208 MotionSenseHAR,1.0 MotorImagery,0.54 NATOPS,0.8333333333333334 +NewsHeadlineSentiment_disc,0.3345960272030492 +NewsTitleSentiment_disc,0.33245909554167147 +OpenCloseFist,0.7158531013724155 +Opportunity,0.8324997055831715 +PAMAP2,0.8725403908239532 PEMS-SF,1.0 +PPGDalia_disc,0.6836533722630755 PenDigits,0.9787764446092126 PhonemeSpectra,0.30961100003507663 PhotoStimulation,0.3444444444444444 +PronouncedSpeech,0.3048027739523903 RacketSports,0.9021802325581395 +SPHERE-WUS,1.0 STEW,0.7093153759820426 SelfRegulationSCP1,0.8604277327369303 +SelfRegulationSCP2,0.5888888888888889 +ShortIntervalTask,0.5995833333333334 +SitStand,0.409375 Skoda,0.9405172100436251 +SongFamiliarity,0.5241296313439532 SpokenArabicDigits,0.977266500622665 StandWalkJump,0.4666666666666666 TactileTextureRecognition,1.0 Tiselac,0.6174429868394522 +UCDHE-MP,0.7575572519083968 +UCDHE-MP-MC,0.7383001207729469 +UCDHE-Rowing,0.590952380952381 UCDHE-Rowing-MC,0.7252539682539683 UCIActivity,0.982792024759315 UIPRMD-DS-C,0.8611111111111112 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.5 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.8888888888888888 +UIPRMD-SSA-C,0.9444444444444444 +UIPRMD-SSE-C,0.8333333333333333 +UIPRMD-SSIER-C,0.85 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9444444444444444 USCActivity,0.7108336430633694 UWaveGestureLibrary,0.93125 +VisualSpeech,0.23125019238464617 WISDM,0.6848152171823233 +WISDM2,0.6215438507976442 diff --git a/results/multiverse/RIST/RIST_f1.csv b/results/multiverse/RIST/RIST_f1.csv index f32c21b..f6d709e 100644 --- a/results/multiverse/RIST/RIST_f1.csv +++ b/results/multiverse/RIST/RIST_f1.csv @@ -3,18 +3,22 @@ Alzheimers,0.4668564597429166 AppliancesEnergy_disc,0.75 ArticularyWordRecognition,0.9866434782608697 AsphaltObstaclesCoordinates,0.8181910121837559 +AsphaltPavementTypeCoordinates,0.936476315598932 AsphaltRegularityCoordinates,0.9866310160427807 AtrialFibrillation,0.16666666666666666 AustraliaRainfall_disc,0.7491594851171554 AutomotiveRoadTrials,0.5 BIDMC32HR_disc,0.9626314076033184 +BIDMC32RR_disc,0.702938685728719 BIDMC32SpO2_disc,0.0 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6894248608534322 BeijingPM25Quality_disc,0.796875 BenzeneConcentration_disc,0.62570281124498 Blink,0.9925558312655087 BoneIntensitiesAgeGroup,0.8030988569003734 BoneProbAgeGroup,0.6323764989495212 +ButtonPress,1.0 CharacterTrajectories,0.981833438758205 CounterMovementJump,0.9166138886562908 Cricket,0.9860139860139859 @@ -27,6 +31,9 @@ Epilepsy,0.9708519137866963 EthanolConcentration,0.6031108811713783 EyesOpenShut,0.5925925925925926 FaceDetection,0.5785671282360024 +FeedbackButton,0.535 +FeetHands,0.6919620569146281 +FingerMovements,0.5098039215686274 FordChallenge,0.8657889565730006 HandMovementDirection,0.44521029650339994 Handwriting,0.32519013979335676 @@ -34,34 +41,85 @@ Heartbeat,0.5208333333333334 HouseholdPowerConsumption1_disc,0.9266187636579133 HouseholdPowerConsumption2_disc,0.7308861427996225 IEEEPPG_disc,0.19266163281110243 +IRDS-EFL,0.15384615384615385 +IRDS-EFR,0.0 +IRDS-SAL,0.3018867924528302 +IRDS-SAR,0.2222222222222222 +IRDS-SFE,0.0 IRDS-SFL,0.7017543859649122 +IRDS-SFR,0.0 +IRDS-STL,0.3333333333333333 +IRDS-STR,0.6 +ImaginedFeetHands,0.6760710553814002 +ImaginedOpenCloseFist,0.7286983795086251 +InnerSpeech,0.24260677192291047 JapaneseVowels,0.9624875836916013 +KERAAL-CTK,0.875 +KERAAL-CTK-MC,0.6746031746031746 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.836024844720497 KERAAL-RTK,0.6666666666666666 +KERAAL-RTK-MC,0.18099547511312217 +KIMORE-LA-C,0.6 KIMORE-PR-C,0.3333333333333333 +KIMORE-Sq-C,0.4444444444444444 +KIMORE-TR-C,0.25 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.5540808151943856 Libras,0.9721348603087734 +LiveFuelMoistureContent_disc,0.022058823529411766 Locust2022,0.3378995433789954 +LongIntervalTask,0.17738359201773837 LowCost,0.6388384754990926 +MatchingPennies,0.6095238095238096 MindReading,0.47282589653176293 MotionSenseHAR,1.0 MotorImagery,0.640625 NATOPS,0.8329280024487759 +NewsHeadlineSentiment_disc,0.4118276433035411 +NewsTitleSentiment_disc,0.4849490448468602 +OpenCloseFist,0.7101996762007555 +Opportunity,0.8401870709868271 +PAMAP2,0.8709427047779013 PEMS-SF,1.0 +PPGDalia_disc,0.7763196904190313 PenDigits,0.9785630898325729 PhonemeSpectra,0.2994119160726424 PhotoStimulation,0.31121751025991795 +PronouncedSpeech,0.2954175599858712 RacketSports,0.8939019110643824 +SPHERE-WUS,1.0 STEW,0.6932188332839798 SelfRegulationSCP1,0.8730650154798761 +SelfRegulationSCP2,0.6262626262626263 +ShortIntervalTask,0.3394683026584867 +SitStand,0.4072953781439814 Skoda,0.94320776475923 +SongFamiliarity,0.41721854304635764 SpokenArabicDigits,0.9772830795810813 StandWalkJump,0.4666666666666667 TactileTextureRecognition,1.0 Tiselac,0.8202334678971116 +UCDHE-MP,0.6628571428571428 +UCDHE-MP-MC,0.7366770055243265 +UCDHE-Rowing,0.32558139534883723 UCDHE-Rowing-MC,0.7178167290540431 UCIActivity,0.9820278228141653 UIPRMD-DS-C,0.8780487804878049 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.3076923076923077 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.9 +UIPRMD-SSA-C,0.9411764705882353 +UIPRMD-SSE-C,0.8235294117647058 +UIPRMD-SSIER-C,0.8235294117647058 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.9473684210526315 USCActivity,0.7202415166492206 UWaveGestureLibrary,0.9309682056125146 +VisualSpeech,0.21852319336115297 WISDM,0.8733495251230263 +WISDM2,0.6580983949632869 diff --git a/results/multiverse/RIST/RIST_logloss.csv b/results/multiverse/RIST/RIST_logloss.csv index bce9097..1a7e2ea 100644 --- a/results/multiverse/RIST/RIST_logloss.csv +++ b/results/multiverse/RIST/RIST_logloss.csv @@ -3,18 +3,22 @@ Alzheimers,1.0073012212113914 AppliancesEnergy_disc,0.3402160819576623 ArticularyWordRecognition,0.49066441941644645 AsphaltObstaclesCoordinates,0.48093517274265934 +AsphaltPavementTypeCoordinates,0.21441331881696565 AsphaltRegularityCoordinates,0.03997432487561185 AtrialFibrillation,1.2059143087960693 AustraliaRainfall_disc,0.5262049970624265 AutomotiveRoadTrials,0.4245472379269558 BIDMC32HR_disc,0.31363997450103737 +BIDMC32RR_disc,0.9134178332901782 BIDMC32SpO2_disc,0.7376802665166211 +BasicMotions,0.07004097247261429 BeijingPM10Quality_disc,0.3595787681505922 BeijingPM25Quality_disc,0.2849675128893388 BenzeneConcentration_disc,0.4048497943548002 Blink,0.15856833534930034 BoneIntensitiesAgeGroup,0.5542032366787324 BoneProbAgeGroup,0.8445895309722172 +ButtonPress,0.028386004721493496 CharacterTrajectories,0.18219729671297558 CounterMovementJump,0.4547813184644954 Cricket,0.22553792550058116 @@ -27,6 +31,9 @@ Epilepsy,0.10840034239463085 EthanolConcentration,1.0113030186965217 EyesOpenShut,0.72517398767127 FaceDetection,0.6769573761910492 +FeedbackButton,0.6963604005295563 +FeetHands,0.6246759218301203 +FingerMovements,0.7001969763734767 FordChallenge,0.23889361922370056 HandMovementDirection,1.3214095543965698 Handwriting,2.8411471970251094 @@ -34,34 +41,85 @@ Heartbeat,0.5125504474208384 HouseholdPowerConsumption1_disc,0.23923038085808743 HouseholdPowerConsumption2_disc,0.5011598124213001 IEEEPPG_disc,1.2077443939678136 +IRDS-EFL,0.5520586087132408 +IRDS-EFR,0.7402271315953628 +IRDS-SAL,0.9968075510955694 +IRDS-SAR,1.2521093727006016 +IRDS-SFE,0.5348587123679821 IRDS-SFL,0.4401168318433343 +IRDS-SFR,0.664703539161313 +IRDS-STL,0.7556642844674663 +IRDS-STR,0.4658202573317392 +ImaginedFeetHands,0.6187672106763978 +ImaginedOpenCloseFist,0.5910186586062038 +InnerSpeech,1.3913922307543778 JapaneseVowels,0.436965006689844 +KERAAL-CTK,0.4715483616967065 +KERAAL-CTK-MC,0.7719120803074324 +KERAAL-ELK,0.6518842354577898 +KERAAL-ELK-MC,0.34496462347203777 KERAAL-RTK,0.5191509219294866 +KERAAL-RTK-MC,1.0093467126557802 +KIMORE-LA-C,1.478467535963192 KIMORE-PR-C,1.0822184726921276 +KIMORE-Sq-C,1.035732411538601 +KIMORE-TR-C,2.167465076670402 +KINECAL-3WFV,0.26272753746032435 +KINECAL-GGFV,0.2438779772362765 +KINECAL-QSEC,0.212095137850916 KINECAL-QSEO,0.20791592795356664 LSST,1.1758657595184407 Libras,0.39539546248790713 +LiveFuelMoistureContent_disc,0.4894168352684066 Locust2022,0.2367333922605388 +LongIntervalTask,0.5744274005758243 LowCost,0.6518347988961523 +MatchingPennies,0.6670765676773369 MindReading,0.9889746012938788 MotionSenseHAR,0.042943590255821486 MotorImagery,0.6906559259460862 NATOPS,0.4211036981177812 +NewsHeadlineSentiment_disc,1.974823007353261 +NewsTitleSentiment_disc,1.8220981285034388 +OpenCloseFist,0.606439439461296 +Opportunity,0.45240044784293537 +PAMAP2,0.6787414302586284 PEMS-SF,0.1875613278637383 +PPGDalia_disc,0.5351230820827011 PenDigits,0.12218188087883992 PhonemeSpectra,2.6424429805099616 PhotoStimulation,1.1963860953853431 +PronouncedSpeech,1.3748792986307907 RacketSports,0.5665380224503522 +SPHERE-WUS,0.3044351669733637 STEW,0.5212738178065317 SelfRegulationSCP1,0.3239813761937828 +SelfRegulationSCP2,0.6796973686169653 +ShortIntervalTask,0.5460016778385935 +SitStand,1.232105868759585 Skoda,0.3731436415231711 +SongFamiliarity,0.6973196681343536 SpokenArabicDigits,0.27741678178541274 StandWalkJump,1.0593277855943188 TactileTextureRecognition,0.09677215788752917 Tiselac,0.5346557786067553 +UCDHE-MP,0.3752018992369644 +UCDHE-MP-MC,0.820629832169233 +UCDHE-Rowing,0.43346380721316263 UCDHE-Rowing-MC,0.8747259577313439 UCIActivity,0.14492890833366628 UIPRMD-DS-C,0.38398672221098523 +UIPRMD-HS-C,0.14541782327140693 +UIPRMD-IL-C,0.6667507365983065 +UIPRMD-SASLR-C,0.28536265027553476 +UIPRMD-SL-C,0.28419046510811513 +UIPRMD-SSA-C,0.20943545868972827 +UIPRMD-SSE-C,0.37451195922106845 +UIPRMD-SSIER-C,0.37172438048380807 +UIPRMD-SSS-C,0.26943329514332826 +UIPRMD-STS-C,0.202472268903058 USCActivity,0.8077772241355301 UWaveGestureLibrary,0.6169804749796175 +VisualSpeech,1.3872708098280067 WISDM,0.6085654484465686 +WISDM2,0.9015255449460775 diff --git a/results/multiverse/RIST/RIST_sensitivity.csv b/results/multiverse/RIST/RIST_sensitivity.csv index 6316cbe..3990e48 100644 --- a/results/multiverse/RIST/RIST_sensitivity.csv +++ b/results/multiverse/RIST/RIST_sensitivity.csv @@ -3,18 +3,22 @@ Alzheimers,0.4883720930232558 AppliancesEnergy_disc,0.75 ArticularyWordRecognition,0.9866666666666667 AsphaltObstaclesCoordinates,0.8209718670076727 +AsphaltPavementTypeCoordinates,0.9365530303030303 AsphaltRegularityCoordinates,0.9972972972972973 AtrialFibrillation,0.13333333333333333 AustraliaRainfall_disc,0.7711778041222105 AutomotiveRoadTrials,0.42105263157894735 BIDMC32HR_disc,0.9637348895373072 +BIDMC32RR_disc,0.7940808670279283 BIDMC32SpO2_disc,0.0 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6371742112482853 BeijingPM25Quality_disc,0.7686762778505898 BenzeneConcentration_disc,0.48626716604244696 Blink,1.0 BoneIntensitiesAgeGroup,0.8044943820224719 BoneProbAgeGroup,0.6269662921348315 +ButtonPress,1.0 CharacterTrajectories,0.9818941504178273 CounterMovementJump,0.9162011173184358 Cricket,0.9861111111111112 @@ -27,6 +31,9 @@ Epilepsy,0.9710144927536232 EthanolConcentration,0.6083650190114068 EyesOpenShut,0.7619047619047619 FaceDetection,0.5454029511918275 +FeedbackButton,0.5582608695652174 +FeetHands,0.7395944503735326 +FingerMovements,0.5306122448979592 FordChallenge,0.8060739114526162 HandMovementDirection,0.44594594594594594 Handwriting,0.3776470588235294 @@ -34,34 +41,85 @@ Heartbeat,0.43859649122807015 HouseholdPowerConsumption1_disc,0.9300291545189504 HouseholdPowerConsumption2_disc,0.7696793002915452 IEEEPPG_disc,0.3004518072289157 +IRDS-EFL,0.08333333333333333 +IRDS-EFR,0.0 +IRDS-SAL,0.5714285714285714 +IRDS-SAR,1.0 +IRDS-SFE,0.0 IRDS-SFL,0.8333333333333334 +IRDS-SFR,0.0 +IRDS-STL,0.2727272727272727 +IRDS-STR,0.6 +ImaginedFeetHands,0.6690796277145812 +ImaginedOpenCloseFist,0.7383474576271186 +InnerSpeech,0.3 JapaneseVowels,0.9621621621621622 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.7142857142857143 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.7857142857142857 KERAAL-RTK,0.6666666666666666 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,1.0 KIMORE-PR-C,1.0 +KIMORE-Sq-C,1.0 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.6285482562854826 Libras,0.9722222222222222 +LiveFuelMoistureContent_disc,0.0125 Locust2022,0.2525597269624573 +LongIntervalTask,0.1111111111111111 LowCost,0.5866666666666667 +MatchingPennies,0.6436781609195402 MindReading,0.5313935681470138 MotionSenseHAR,1.0 MotorImagery,0.82 NATOPS,0.8333333333333334 +NewsHeadlineSentiment_disc,0.5346879884573764 +NewsTitleSentiment_disc,0.6095146487114745 +OpenCloseFist,0.6970338983050848 +Opportunity,0.8408304498269896 +PAMAP2,0.8766043456291056 PEMS-SF,1.0 +PPGDalia_disc,0.7848896750768085 PenDigits,0.9785591766723842 PhonemeSpectra,0.3095735162541008 PhotoStimulation,0.3888888888888889 +PronouncedSpeech,0.3 RacketSports,0.8947368421052632 +SPHERE-WUS,1.0 STEW,0.6568462401795735 SelfRegulationSCP1,0.9657534246575342 +SelfRegulationSCP2,0.6888888888888889 +ShortIntervalTask,0.2075 +SitStand,0.409375 Skoda,0.9430491687301026 +SongFamiliarity,0.3490304709141274 SpokenArabicDigits,0.977262391996362 StandWalkJump,0.4666666666666667 TactileTextureRecognition,1.0 Tiselac,0.8332659251769464 +UCDHE-MP,0.58 +UCDHE-MP-MC,0.7430939226519337 +UCDHE-Rowing,0.23333333333333334 UCDHE-Rowing-MC,0.7136363636363636 UCIActivity,0.9820907955018742 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.2222222222222222 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,0.8888888888888888 +UIPRMD-SSE-C,0.7777777777777778 +UIPRMD-SSIER-C,0.7 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,1.0 USCActivity,0.724179829890644 UWaveGestureLibrary,0.93125 +VisualSpeech,0.235 WISDM,0.884682248406413 +WISDM2,0.6715155084413035 diff --git a/results/multiverse/RIST/RIST_specificity.csv b/results/multiverse/RIST/RIST_specificity.csv index 49b3780..f751078 100644 --- a/results/multiverse/RIST/RIST_specificity.csv +++ b/results/multiverse/RIST/RIST_specificity.csv @@ -3,18 +3,22 @@ Alzheimers,0.4883720930232558 AppliancesEnergy_disc,0.9411764705882353 ArticularyWordRecognition,0.9866666666666667 AsphaltObstaclesCoordinates,0.8209718670076727 +AsphaltPavementTypeCoordinates,0.9365530303030303 AsphaltRegularityCoordinates,0.9763779527559056 AtrialFibrillation,0.13333333333333333 AustraliaRainfall_disc,0.7711778041222105 AutomotiveRoadTrials,0.9137931034482759 BIDMC32HR_disc,0.9637348895373072 +BIDMC32RR_disc,0.7940808670279283 BIDMC32SpO2_disc,1.0 +BasicMotions,1.0 BeijingPM10Quality_disc,0.9142061281337047 BeijingPM25Quality_disc,0.9304372515616127 BenzeneConcentration_disc,0.9693906206121876 Blink,0.988 BoneIntensitiesAgeGroup,0.8044943820224719 BoneProbAgeGroup,0.6269662921348315 +ButtonPress,1.0 CharacterTrajectories,0.9818941504178273 CounterMovementJump,0.9162011173184358 Cricket,0.9861111111111112 @@ -27,6 +31,9 @@ Epilepsy,0.9710144927536232 EthanolConcentration,0.6083650190114068 EyesOpenShut,0.19047619047619047 FaceDetection,0.6600454029511919 +FeedbackButton,0.47130434782608693 +FeetHands,0.608604407135362 +FingerMovements,0.47058823529411764 FordChallenge,0.9661579296615793 HandMovementDirection,0.44594594594594594 Handwriting,0.3776470588235294 @@ -34,34 +41,85 @@ Heartbeat,0.9054054054054054 HouseholdPowerConsumption1_disc,0.9300291545189504 HouseholdPowerConsumption2_disc,0.7696793002915452 IEEEPPG_disc,0.3004518072289157 +IRDS-EFL,1.0 +IRDS-EFR,1.0 +IRDS-SAL,0.2619047619047619 +IRDS-SAR,0.034482758620689655 +IRDS-SFE,1.0 IRDS-SFL,0.8586956521739131 +IRDS-SFR,0.6923076923076923 +IRDS-STL,0.8518518518518519 +IRDS-STR,0.9636363636363636 +ImaginedFeetHands,0.6900826446280992 +ImaginedOpenCloseFist,0.7124735729386892 +InnerSpeech,0.3 JapaneseVowels,0.9621621621621622 +KERAAL-CTK,0.7142857142857143 +KERAAL-CTK-MC,0.7142857142857143 +KERAAL-ELK,1.0 +KERAAL-ELK-MC,0.7857142857142857 KERAAL-RTK,0.75 +KERAAL-RTK-MC,0.3076923076923077 +KIMORE-LA-C,0.0 KIMORE-PR-C,0.3333333333333333 +KIMORE-Sq-C,0.0 +KIMORE-TR-C,0.0 +KINECAL-3WFV,1.0 +KINECAL-GGFV,1.0 +KINECAL-QSEC,1.0 KINECAL-QSEO,1.0 LSST,0.6285482562854826 Libras,0.9722222222222222 +LiveFuelMoistureContent_disc,0.9771653543307086 Locust2022,0.9763805721889555 +LongIntervalTask,0.9328947368421052 LowCost,0.75 +MatchingPennies,0.5369318181818182 MindReading,0.5313935681470138 MotionSenseHAR,1.0 MotorImagery,0.26 NATOPS,0.8333333333333334 +NewsHeadlineSentiment_disc,0.5346879884573764 +NewsTitleSentiment_disc,0.6095146487114745 +OpenCloseFist,0.7346723044397463 +Opportunity,0.8408304498269896 +PAMAP2,0.8766043456291056 PEMS-SF,1.0 +PPGDalia_disc,0.7848896750768085 PenDigits,0.9785591766723842 PhonemeSpectra,0.3095735162541008 PhotoStimulation,0.3888888888888889 +PronouncedSpeech,0.3 RacketSports,0.8947368421052632 +SPHERE-WUS,1.0 STEW,0.7617845117845118 SelfRegulationSCP1,0.7551020408163265 +SelfRegulationSCP2,0.4888888888888889 +ShortIntervalTask,0.9916666666666667 +SitStand,0.409375 Skoda,0.9430491687301026 +SongFamiliarity,0.699228791773779 SpokenArabicDigits,0.977262391996362 StandWalkJump,0.4666666666666667 TactileTextureRecognition,1.0 Tiselac,0.8332659251769464 +UCDHE-MP,0.9351145038167938 +UCDHE-MP-MC,0.7430939226519337 +UCDHE-Rowing,0.9485714285714286 UCDHE-Rowing-MC,0.7136363636363636 UCIActivity,0.9820907955018742 UIPRMD-DS-C,0.7222222222222222 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.7777777777777778 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,0.7777777777777778 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.8888888888888888 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.8888888888888888 USCActivity,0.724179829890644 UWaveGestureLibrary,0.93125 +VisualSpeech,0.235 WISDM,0.884682248406413 +WISDM2,0.6715155084413035 diff --git a/results/multiverse/ROCKET/ROCKET_accuracy.csv b/results/multiverse/ROCKET/ROCKET_accuracy.csv index 36d6f29..3052dc0 100644 --- a/results/multiverse/ROCKET/ROCKET_accuracy.csv +++ b/results/multiverse/ROCKET/ROCKET_accuracy.csv @@ -3,17 +3,21 @@ Alzheimers,0.4186046511627907 AppliancesEnergy_disc,0.7857142857142857 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8542199488491049 +AsphaltPavementTypeCoordinates,0.8636363636363636 AsphaltRegularityCoordinates,0.9387483355525965 AtrialFibrillation,0.06666666666666667 AutomotiveRoadTrials,0.7402597402597403 BIDMC32HR_disc,0.9208003334722801 +BIDMC32RR_disc,0.783659858274281 BIDMC32SpO2_disc,0.7203001250521051 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7466323296354992 BeijingPM25Quality_disc,0.7765451664025357 BenzeneConcentration_disc,0.7530505520046484 Blink,1.0 BoneIntensitiesAgeGroup,0.8134831460674158 BoneProbAgeGroup,0.6876404494382022 +ButtonPress,0.9833333333333333 CharacterTrajectories,0.9930362116991643 CounterMovementJump,0.9217877094972067 Cricket,1.0 @@ -26,6 +30,9 @@ Epilepsy,0.9855072463768116 EthanolConcentration,0.43346007604562736 EyesOpenShut,0.5238095238095238 FaceDetection,0.6058456299659478 +FeedbackButton,0.5382608695652173 +FeetHands,0.6677248677248677 +FingerMovements,0.55 FordChallenge,0.7977667493796526 HandMovementDirection,0.5135135135135135 Handwriting,0.5870588235294117 @@ -33,34 +40,86 @@ Heartbeat,0.7560975609756098 HouseholdPowerConsumption1_disc,0.89067055393586 HouseholdPowerConsumption2_disc,0.7478134110787172 IEEEPPG_disc,0.6310240963855421 +IRDS-EFL,0.5769230769230769 +IRDS-EFR,0.6666666666666666 +IRDS-SAL,0.6071428571428571 +IRDS-SAR,0.2727272727272727 +IRDS-SFE,0.6666666666666666 IRDS-SFL,0.7931034482758621 +IRDS-SFR,0.8 +IRDS-STL,0.7368421052631579 +IRDS-STR,0.9166666666666666 +ImaginedFeetHands,0.6625322997416021 +ImaginedOpenCloseFist,0.7391534391534391 +InnerSpeech,0.225 JapaneseVowels,0.8243243243243243 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.7142857142857143 +KERAAL-ELK,0.8 +KERAAL-ELK-MC,0.8571428571428571 KERAAL-RTK,0.9285714285714286 +KERAAL-RTK-MC,0.5384615384615384 +KIMORE-LA-C,0.42857142857142855 +KIMORE-LT-C,0.42857142857142855 KIMORE-PR-C,0.5714285714285714 +KIMORE-Sq-C,0.7142857142857143 +KIMORE-TR-C,0.2857142857142857 +KINECAL-3WFV,0.8333333333333334 +KINECAL-GGFV,0.9230769230769231 +KINECAL-QSEC,0.9444444444444444 KINECAL-QSEO,0.9411764705882353 LSST,0.6362530413625304 Libras,0.9055555555555556 +LiveFuelMoistureContent_disc,0.7880794701986755 Locust2022,0.9175507729615034 +LongIntervalTask,0.6901785714285714 LowCost,0.63 +MatchingPennies,0.6142857142857143 MindReading,0.4762633996937213 MotionSenseHAR,0.9773584905660377 MotorImagery,0.54 NATOPS,0.8722222222222222 +NewsHeadlineSentiment_disc,0.5128050979920644 +NewsTitleSentiment_disc,0.6024207446595327 +OpenCloseFist,0.744973544973545 +Opportunity,0.7935409457900807 +PAMAP2,0.8388074785245073 PEMS-SF,0.8439306358381503 +PPGDalia_disc,0.7800018620240201 PenDigits,0.9797026872498571 PhonemeSpectra,0.2782582761705935 PhotoStimulation,0.5833333333333334 +PronouncedSpeech,0.27 RacketSports,0.9078947368421053 +SPHERE-WUS,1.0 STEW,0.7843714927048261 SelfRegulationSCP1,0.8532423208191127 +SelfRegulationSCP2,0.5277777777777778 +ShortIntervalTask,0.6794642857142857 +SitStand,0.3984375 Skoda,0.9451715599575522 +SongFamiliarity,0.5066666666666667 SpokenArabicDigits,0.9899954524783993 StandWalkJump,0.4666666666666667 TactileTextureRecognition,0.9985315712187959 Tiselac,0.6459555106167846 +UCDHE-MP,0.8591160220994475 +UCDHE-MP-MC,0.7845303867403315 +UCDHE-Rowing,0.8159090909090909 UCDHE-Rowing-MC,0.7295454545454545 UCIActivity,0.9333610995418575 UIPRMD-DS-C,0.8611111111111112 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.7777777777777778 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.9444444444444444 +UIPRMD-SSIER-C,0.9 +UIPRMD-SSS-C,0.9444444444444444 +UIPRMD-STS-C,1.0 USCActivity,0.6634264884568651 UWaveGestureLibrary,0.940625 +VisualSpeech,0.235 WISDM,0.882364303650763 +WISDM2,0.5816843345111896 diff --git a/results/multiverse/ROCKET/ROCKET_auroc.csv b/results/multiverse/ROCKET/ROCKET_auroc.csv index ee58e75..1746435 100644 --- a/results/multiverse/ROCKET/ROCKET_auroc.csv +++ b/results/multiverse/ROCKET/ROCKET_auroc.csv @@ -3,17 +3,21 @@ Alzheimers,0.5614439655172414 AppliancesEnergy_disc,0.676470588235294 ArticularyWordRecognition,0.9965277777777779 AsphaltObstaclesCoordinates,0.9020663301209926 +AsphaltPavementTypeCoordinates,0.8977397987814655 AsphaltRegularityCoordinates,0.9389302688515286 AtrialFibrillation,0.3 AutomotiveRoadTrials,0.6506352087114338 BIDMC32HR_disc,0.9019872684352889 +BIDMC32RR_disc,0.5043724388068973 BIDMC32SpO2_disc,0.5585826447832305 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6615860624887757 BeijingPM25Quality_disc,0.7202798660060745 BenzeneConcentration_disc,0.6345111996693265 Blink,1.0 BoneIntensitiesAgeGroup,0.850992357252348 BoneProbAgeGroup,0.7507884523456314 +ButtonPress,0.9831033511686849 CharacterTrajectories,0.9963438804226369 CounterMovementJump,0.9411764705882353 Cricket,1.0 @@ -26,6 +30,9 @@ Epilepsy,0.9904198753208654 EthanolConcentration,0.6220709634415219 EyesOpenShut,0.5238095238095237 FaceDetection,0.6058456299659478 +FeedbackButton,0.5382608695652173 +FeetHands,0.6678264784240298 +FingerMovements,0.5528211284513804 FordChallenge,0.777196719006874 HandMovementDirection,0.6616589625064202 Handwriting,0.7851063423588238 @@ -33,34 +40,86 @@ Heartbeat,0.6315196775723092 HouseholdPowerConsumption1_disc,0.7829822407624082 HouseholdPowerConsumption2_disc,0.6299941282118998 IEEEPPG_disc,0.7354236619858642 +IRDS-EFL,0.5416666666666666 +IRDS-EFR,0.5 +IRDS-SAL,0.5476190476190477 +IRDS-SAR,0.5862068965517242 +IRDS-SFE,0.5 IRDS-SFL,0.8233695652173914 +IRDS-SFR,0.46153846153846156 +IRDS-STL,0.5454545454545454 +IRDS-STR,0.5 +ImaginedFeetHands,0.6625367499380379 +ImaginedOpenCloseFist,0.7391850610957824 +InnerSpeech,0.4815491377626165 JapaneseVowels,0.9007031114194568 +KERAAL-CTK,0.8571428571428572 +KERAAL-CTK-MC,0.7678571428571429 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.46153846153846156 KERAAL-RTK,0.9375 +KERAAL-RTK-MC,0.5833333333333334 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.4583333333333333 KIMORE-PR-C,0.75 +KIMORE-Sq-C,0.8 +KIMORE-TR-C,0.5833333333333333 +KINECAL-3WFV,0.45454545454545453 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.5 LSST,0.7670536144852363 Libras,0.9494047619047619 +LiveFuelMoistureContent_disc,0.49553805774278215 Locust2022,0.6390262705533188 +LongIntervalTask,0.5889619883040936 LowCost,0.6300000000000001 +MatchingPennies,0.6143221003134796 MindReading,0.6672405007606056 MotionSenseHAR,0.9839103748286753 MotorImagery,0.54 NATOPS,0.9233333333333332 +NewsHeadlineSentiment_disc,0.4982281745848188 +NewsTitleSentiment_disc,0.50121420089682 +OpenCloseFist,0.7449922958397535 +Opportunity,0.841435253455295 +PAMAP2,0.9100035534288228 PEMS-SF,0.9089045104790754 +PPGDalia_disc,0.7920193650479003 PenDigits,0.9887165682628827 PhonemeSpectra,0.6296325800192496 PhotoStimulation,0.6550549450549451 +PronouncedSpeech,0.5162602679381203 RacketSports,0.9365170380078638 +SPHERE-WUS,1.0 STEW,0.784371492704826 SelfRegulationSCP1,0.8531124778678594 +SelfRegulationSCP2,0.5277777777777777 +ShortIntervalTask,0.6106944444444444 +SitStand,0.5989583333333334 Skoda,0.9673595125261034 +SongFamiliarity,0.5052802483817445 SpokenArabicDigits,0.9944420199978562 StandWalkJump,0.6 TactileTextureRecognition,0.9992295839753467 Tiselac,0.7735356015416187 +UCDHE-MP,0.8439312977099237 +UCDHE-MP-MC,0.8541792194653836 +UCDHE-Rowing,0.649047619047619 UCDHE-Rowing-MC,0.8283233653821888 UCIActivity,0.9593887414602164 UIPRMD-DS-C,0.8611111111111112 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.7777777777777778 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.9444444444444444 +UIPRMD-SSIER-C,0.9 +UIPRMD-SSS-C,0.9444444444444444 +UIPRMD-STS-C,1.0 USCActivity,0.8157541664395627 UWaveGestureLibrary,0.9660714285714285 +VisualSpeech,0.4890086311406791 WISDM,0.9159305501766287 +WISDM2,0.7232052187050861 diff --git a/results/multiverse/ROCKET/ROCKET_balacc.csv b/results/multiverse/ROCKET/ROCKET_balacc.csv index 8ce64cd..1a0b598 100644 --- a/results/multiverse/ROCKET/ROCKET_balacc.csv +++ b/results/multiverse/ROCKET/ROCKET_balacc.csv @@ -3,17 +3,21 @@ Alzheimers,0.4004329004329004 AppliancesEnergy_disc,0.6764705882352942 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8548514856184968 +AsphaltPavementTypeCoordinates,0.8495989304812834 AsphaltRegularityCoordinates,0.9389302688515286 AtrialFibrillation,0.06666666666666667 AutomotiveRoadTrials,0.6506352087114338 BIDMC32HR_disc,0.8847803637878154 +BIDMC32RR_disc,0.33946685867806353 BIDMC32SpO2_disc,0.5585826447832304 +BasicMotions,1.0 BeijingPM10Quality_disc,0.6615860624887758 BeijingPM25Quality_disc,0.7202798660060745 BenzeneConcentration_disc,0.6345111996693266 Blink,1.0 BoneIntensitiesAgeGroup,0.8421220245836585 BoneProbAgeGroup,0.6913870492273421 +ButtonPress,0.9831033511686849 CharacterTrajectories,0.9927498468973225 CounterMovementJump,0.9212806026365348 Cricket,1.0 @@ -26,6 +30,9 @@ Epilepsy,0.9852941176470589 EthanolConcentration,0.4344405594405594 EyesOpenShut,0.5238095238095237 FaceDetection,0.6058456299659478 +FeedbackButton,0.5382608695652173 +FeetHands,0.6678264784240298 +FingerMovements,0.5528211284513805 FordChallenge,0.7771967190068738 HandMovementDirection,0.5059523809523809 Handwriting,0.5802812287864575 @@ -33,34 +40,86 @@ Heartbeat,0.6315196775723091 HouseholdPowerConsumption1_disc,0.7149192765198557 HouseholdPowerConsumption2_disc,0.5817074858170749 IEEEPPG_disc,0.6413142533906786 +IRDS-EFL,0.5416666666666666 +IRDS-EFR,0.5 +IRDS-SAL,0.5476190476190476 +IRDS-SAR,0.5862068965517242 +IRDS-SFE,0.5 IRDS-SFL,0.8233695652173914 +IRDS-SFR,0.46153846153846156 +IRDS-STL,0.5454545454545454 +IRDS-STR,0.5 +ImaginedFeetHands,0.6625367499380379 +ImaginedOpenCloseFist,0.7391850610957824 +InnerSpeech,0.22299509001636664 JapaneseVowels,0.8194664720193084 +KERAAL-CTK,0.8571428571428572 +KERAAL-CTK-MC,0.5079365079365079 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.46153846153846156 KERAAL-RTK,0.9375 +KERAAL-RTK-MC,0.3904761904761904 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.4583333333333333 KIMORE-PR-C,0.75 +KIMORE-Sq-C,0.8 +KIMORE-TR-C,0.5833333333333334 +KINECAL-3WFV,0.45454545454545453 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.5 LSST,0.3846945387306976 Libras,0.9055555555555553 +LiveFuelMoistureContent_disc,0.49553805774278215 Locust2022,0.6390262705533188 +LongIntervalTask,0.5889619883040935 LowCost,0.63 +MatchingPennies,0.6143221003134796 MindReading,0.4641474094273471 MotionSenseHAR,0.9880587875076546 MotorImagery,0.54 NATOPS,0.8722222222222222 +NewsHeadlineSentiment_disc,0.331751752026258 +NewsTitleSentiment_disc,0.3349783953839291 +OpenCloseFist,0.7449922958397535 +Opportunity,0.7971609994797547 +PAMAP2,0.8369833146015861 PEMS-SF,0.8386122733948821 +PPGDalia_disc,0.7215111677969395 PenDigits,0.9800014628067546 PhonemeSpectra,0.2783121119646427 PhotoStimulation,0.5494949494949495 +PronouncedSpeech,0.27448111351564036 RacketSports,0.9151162790697674 +SPHERE-WUS,1.0 STEW,0.784371492704826 SelfRegulationSCP1,0.8531124778678595 +SelfRegulationSCP2,0.5277777777777777 +ShortIntervalTask,0.6106944444444444 +SitStand,0.3984375 Skoda,0.9423330856727923 +SongFamiliarity,0.5052802483817446 SpokenArabicDigits,0.99 StandWalkJump,0.46666666666666673 TactileTextureRecognition,0.9985994397759103 Tiselac,0.4888776026594008 +UCDHE-MP,0.8439312977099237 +UCDHE-MP-MC,0.7832940821256038 +UCDHE-Rowing,0.649047619047619 UCDHE-Rowing-MC,0.734642857142857 UCIActivity,0.9390418570725476 UIPRMD-DS-C,0.8611111111111112 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.7777777777777778 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.9444444444444444 +UIPRMD-SSIER-C,0.9 +UIPRMD-SSS-C,0.9444444444444444 +UIPRMD-STS-C,1.0 USCActivity,0.6912521896700562 UWaveGestureLibrary,0.940625 +VisualSpeech,0.2327455020469726 WISDM,0.6334858492908861 +WISDM2,0.43408556661842573 diff --git a/results/multiverse/ROCKET/ROCKET_f1.csv b/results/multiverse/ROCKET/ROCKET_f1.csv index ba13a1c..ef74790 100644 --- a/results/multiverse/ROCKET/ROCKET_f1.csv +++ b/results/multiverse/ROCKET/ROCKET_f1.csv @@ -3,17 +3,21 @@ Alzheimers,0.42155135057056187 AppliancesEnergy_disc,0.47058823529411764 ArticularyWordRecognition,0.9933217391304349 AsphaltObstaclesCoordinates,0.8538999445930551 +AsphaltPavementTypeCoordinates,0.8639857266077653 AsphaltRegularityCoordinates,0.9386666666666666 AtrialFibrillation,0.05555555555555555 AutomotiveRoadTrials,0.47368421052631576 BIDMC32HR_disc,0.9156521411190368 +BIDMC32RR_disc,0.7071617614818628 BIDMC32SpO2_disc,0.2714440825190011 +BasicMotions,1.0 BeijingPM10Quality_disc,0.5120183136207554 BeijingPM25Quality_disc,0.6099585062240664 BenzeneConcentration_disc,0.44733420026007803 Blink,1.0 BoneIntensitiesAgeGroup,0.8116076657128474 BoneProbAgeGroup,0.6923814912756793 +ButtonPress,0.9811320754716981 CharacterTrajectories,0.9930366417008013 CounterMovementJump,0.921338131375976 Cricket,1.0 @@ -26,6 +30,9 @@ Epilepsy,0.9853953649106892 EthanolConcentration,0.429754459456405 EyesOpenShut,0.6153846153846154 FaceDetection,0.6018916595012898 +FeedbackButton,0.544206008583691 +FeetHands,0.6698212407991588 +FingerMovements,0.6017699115044248 FordChallenge,0.7210496292070736 HandMovementDirection,0.5131110734559011 Handwriting,0.5635624967815638 @@ -33,34 +40,86 @@ Heartbeat,0.4444444444444444 HouseholdPowerConsumption1_disc,0.8816065309333316 HouseholdPowerConsumption2_disc,0.7196350982645576 IEEEPPG_disc,0.6415145234719678 +IRDS-EFL,0.15384615384615385 +IRDS-EFR,0.0 +IRDS-SAL,0.35294117647058826 +IRDS-SAR,0.25 +IRDS-SFE,0.0 IRDS-SFL,0.6363636363636364 +IRDS-SFR,0.0 +IRDS-STL,0.16666666666666666 +IRDS-STR,0.0 +ImaginedFeetHands,0.6652998462327012 +ImaginedOpenCloseFist,0.7465295629820051 +InnerSpeech,0.18991727172717274 JapaneseVowels,0.819911123674383 +KERAAL-CTK,0.8333333333333334 +KERAAL-CTK-MC,0.7142857142857143 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.8571428571428571 KERAAL-RTK,0.9230769230769231 +KERAAL-RTK-MC,0.5236686390532544 +KIMORE-LA-C,0.6 +KIMORE-LT-C,0.5 KIMORE-PR-C,0.4 +KIMORE-Sq-C,0.6666666666666666 +KIMORE-TR-C,0.2857142857142857 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.5988227196041698 Libras,0.9050126942300856 +LiveFuelMoistureContent_disc,0.09090909090909091 Locust2022,0.39285714285714285 +LongIntervalTask,0.3880070546737213 LowCost,0.6105263157894737 +MatchingPennies,0.6153846153846154 MindReading,0.4368447571321604 MotionSenseHAR,0.9773913193724514 MotorImagery,0.5490196078431373 NATOPS,0.8684286934495327 +NewsHeadlineSentiment_disc,0.42004718499393373 +NewsTitleSentiment_disc,0.49012583387237624 +OpenCloseFist,0.7492195629552549 +Opportunity,0.7944847012708248 +PAMAP2,0.8395632487273932 PEMS-SF,0.8392635966900361 +PPGDalia_disc,0.7769907380716019 PenDigits,0.9796961721458342 PhonemeSpectra,0.2739996614303523 PhotoStimulation,0.5483932461873638 +PronouncedSpeech,0.24826448658027608 RacketSports,0.9077605508526561 +SPHERE-WUS,1.0 STEW,0.774468085106383 SelfRegulationSCP1,0.8469750889679716 +SelfRegulationSCP2,0.519774011299435 +ShortIntervalTask,0.45190839694656487 +SitStand,0.3978868231141254 Skoda,0.9451985386113539 +SongFamiliarity,0.4774011299435028 SpokenArabicDigits,0.9899752003161304 StandWalkJump,0.43386243386243384 TactileTextureRecognition,0.9985319084010649 Tiselac,0.6333265980916011 +UCDHE-MP,0.7605633802816901 +UCDHE-MP-MC,0.7840643231681068 +UCDHE-Rowing,0.4489795918367347 UCDHE-Rowing-MC,0.7255423488407013 UCIActivity,0.9330102764913962 UIPRMD-DS-C,0.8387096774193549 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.8181818181818182 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.9411764705882353 +UIPRMD-SSIER-C,0.8888888888888888 +UIPRMD-SSS-C,0.9473684210526315 +UIPRMD-STS-C,1.0 USCActivity,0.6451010723461442 UWaveGestureLibrary,0.9403994940982429 +VisualSpeech,0.2202495126705653 WISDM,0.8697293514824094 +WISDM2,0.5570372156045043 diff --git a/results/multiverse/ROCKET/ROCKET_logloss.csv b/results/multiverse/ROCKET/ROCKET_logloss.csv index c08b831..5b9b77f 100644 --- a/results/multiverse/ROCKET/ROCKET_logloss.csv +++ b/results/multiverse/ROCKET/ROCKET_logloss.csv @@ -3,17 +3,21 @@ Alzheimers,20.95561243553323 AppliancesEnergy_disc,7.723640011953675 ArticularyWordRecognition,0.24029102259411456 AsphaltObstaclesCoordinates,5.254445634730634 +AsphaltPavementTypeCoordinates,4.91504364397052 AsphaltRegularityCoordinates,2.2077337628487204 AtrialFibrillation,33.640743163176005 AutomotiveRoadTrials,9.361987893277181 BIDMC32HR_disc,2.8546453288587994 +BIDMC32RR_disc,7.797689082514298 BIDMC32SpO2_disc,10.081405345601336 +BasicMotions,2.220446049250313e-16 BeijingPM10Quality_disc,9.132296490626155 BeijingPM25Quality_disc,8.054128570309855 BenzeneConcentration_disc,8.900960308178263 Blink,2.220446049250313e-16 BoneIntensitiesAgeGroup,6.722748834374659 BoneProbAgeGroup,11.258579373229853 +ButtonPress,0.600727556485286 CharacterTrajectories,0.25100037179050966 CounterMovementJump,2.819056689651621 Cricket,2.220446049250313e-16 @@ -26,6 +30,9 @@ Epilepsy,0.5223717882480748 EthanolConcentration,20.420168650108195 EyesOpenShut,17.16364447100817 FaceDetection,14.2067634953132 +FeedbackButton,16.64276517358366 +FeetHands,11.976409697547922 +FingerMovements,16.219644025102717 FordChallenge,7.289225189114262 HandMovementDirection,17.534750297408344 Handwriting,14.883908634800143 @@ -33,34 +40,86 @@ Heartbeat,8.791134972955403 HouseholdPowerConsumption1_disc,3.9406326591600385 HouseholdPowerConsumption2_disc,9.08972600046249 IEEEPPG_disc,13.299239578815817 +IRDS-EFL,15.249237972318797 +IRDS-EFR,12.014551129705717 +IRDS-SAL,14.160006688581737 +IRDS-SAR,26.213566101176113 +IRDS-SFE,12.014551129705717 IRDS-SFL,7.457307597748376 +IRDS-SFR,7.20873067782343 +IRDS-STL,9.485171944504513 +IRDS-STR,3.0036377824264293 +ImaginedFeetHands,12.163568818136175 +ImaginedOpenCloseFist,9.401863026896697 +InnerSpeech,27.933831376565784 JapaneseVowels,6.3319931629530135 +KERAAL-CTK,5.149093341302451 +KERAAL-CTK-MC,10.298186682604902 +KERAAL-ELK,7.20873067782343 +KERAAL-ELK-MC,5.149093341302451 KERAAL-RTK,2.5745466706512254 +KERAAL-RTK-MC,16.635532333438682 +KIMORE-LA-C,20.596373365209804 +KIMORE-LT-C,20.596373365209804 KIMORE-PR-C,15.447280023907352 +KIMORE-Sq-C,10.298186682604902 +KIMORE-TR-C,25.74546670651225 +KINECAL-3WFV,6.007275564852859 +KINECAL-GGFV,2.772588722239781 +KINECAL-QSEC,2.0024251882842865 KINECAL-QSEO,2.1202149052421855 LSST,13.110769298474485 Libras,3.4041228200832867 +LiveFuelMoistureContent_disc,7.638390122197012 Locust2022,2.9717713615761943 +LongIntervalTask,11.167096183949687 LowCost,13.336151753973345 +MatchingPennies,13.902552021516614 MindReading,18.8773804886341 MotionSenseHAR,0.8160827182441621 MotorImagery,16.58008055899389 NATOPS,4.605577933053858 +NewsHeadlineSentiment_disc,17.56028418091892 +NewsTitleSentiment_disc,14.330208874195106 +OpenCloseFist,9.192085150028818 +Opportunity,7.441538588987278 +PAMAP2,5.80996737298048 PEMS-SF,5.625310066509613 +PPGDalia_disc,7.929536631457389 PenDigits,0.7315893054966606 PhonemeSpectra,26.01420853017104 PhotoStimulation,15.018188912132148 +PronouncedSpeech,26.31186697405552 RacketSports,3.31981018057658 +SPHERE-WUS,2.220446049250313e-16 STEW,7.772039177759969 SelfRegulationSCP1,5.2896829205871585 +SelfRegulationSCP2,17.020614100416434 +ShortIntervalTask,11.553278184547374 +SitStand,21.682510241890785 Skoda,1.9762172887559812 +SongFamiliarity,17.781535671964463 SpokenArabicDigits,0.36060044318352785 StandWalkJump,19.223281807529144 TactileTextureRecognition,0.05292753801632496 Tiselac,12.76105685965558 +UCDHE-MP,5.077973267527555 +UCDHE-MP-MC,7.766312056218613 +UCDHE-Rowing,6.635308919360203 UCDHE-Rowing-MC,9.748169893874866 UCIActivity,2.401909430345166 UIPRMD-DS-C,5.006062970710715 +UIPRMD-HS-C,2.220446049250313e-16 +UIPRMD-IL-C,8.009700753137146 +UIPRMD-SASLR-C,2.220446049250313e-16 +UIPRMD-SL-C,2.220446049250313e-16 +UIPRMD-SSA-C,2.220446049250313e-16 +UIPRMD-SSE-C,2.0024251882842865 +UIPRMD-SSIER-C,3.604365338911715 +UIPRMD-SSS-C,2.0024251882842865 +UIPRMD-STS-C,2.220446049250313e-16 USCActivity,12.131338990018774 UWaveGestureLibrary,2.1400919199788313 +VisualSpeech,27.573394842674617 WISDM,4.240020265399332 +WISDM2,15.077624854116554 diff --git a/results/multiverse/ROCKET/ROCKET_sensitivity.csv b/results/multiverse/ROCKET/ROCKET_sensitivity.csv index 161d978..554449c 100644 --- a/results/multiverse/ROCKET/ROCKET_sensitivity.csv +++ b/results/multiverse/ROCKET/ROCKET_sensitivity.csv @@ -3,17 +3,21 @@ Alzheimers,0.4186046511627907 AppliancesEnergy_disc,0.5 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8542199488491049 +AsphaltPavementTypeCoordinates,0.8636363636363636 AsphaltRegularityCoordinates,0.9513513513513514 AtrialFibrillation,0.06666666666666667 AutomotiveRoadTrials,0.47368421052631576 BIDMC32HR_disc,0.9208003334722801 +BIDMC32RR_disc,0.783659858274281 BIDMC32SpO2_disc,0.18301610541727673 +BasicMotions,1.0 BeijingPM10Quality_disc,0.46021947873799723 BeijingPM25Quality_disc,0.5779816513761468 BenzeneConcentration_disc,0.32209737827715357 Blink,1.0 BoneIntensitiesAgeGroup,0.8134831460674158 BoneProbAgeGroup,0.6876404494382022 +ButtonPress,0.9811320754716981 CharacterTrajectories,0.9930362116991643 CounterMovementJump,0.9217877094972067 Cricket,1.0 @@ -26,6 +30,9 @@ Epilepsy,0.9855072463768116 EthanolConcentration,0.43346007604562736 EyesOpenShut,0.7619047619047619 FaceDetection,0.5959137343927355 +FeedbackButton,0.551304347826087 +FeetHands,0.67982924226254 +FingerMovements,0.6938775510204082 FordChallenge,0.6937431394072447 HandMovementDirection,0.5135135135135135 Handwriting,0.5870588235294117 @@ -33,34 +40,86 @@ Heartbeat,0.3508771929824561 HouseholdPowerConsumption1_disc,0.89067055393586 HouseholdPowerConsumption2_disc,0.7478134110787172 IEEEPPG_disc,0.6310240963855421 +IRDS-EFL,0.08333333333333333 +IRDS-EFR,0.0 +IRDS-SAL,0.42857142857142855 +IRDS-SAR,1.0 +IRDS-SFE,0.0 IRDS-SFL,0.875 +IRDS-SFR,0.0 +IRDS-STL,0.09090909090909091 +IRDS-STR,0.0 +ImaginedFeetHands,0.671147880041365 +ImaginedOpenCloseFist,0.7690677966101694 +InnerSpeech,0.225 JapaneseVowels,0.8243243243243243 +KERAAL-CTK,0.7142857142857143 +KERAAL-CTK-MC,0.7142857142857143 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.8571428571428571 KERAAL-RTK,1.0 +KERAAL-RTK-MC,0.5384615384615384 +KIMORE-LA-C,1.0 +KIMORE-LT-C,0.6666666666666666 KIMORE-PR-C,1.0 +KIMORE-Sq-C,1.0 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.6362530413625304 Libras,0.9055555555555556 +LiveFuelMoistureContent_disc,0.06666666666666667 Locust2022,0.3003412969283277 +LongIntervalTask,0.3055555555555556 LowCost,0.58 +MatchingPennies,0.6206896551724138 MindReading,0.4762633996937213 MotionSenseHAR,0.9773584905660377 MotorImagery,0.56 NATOPS,0.8722222222222222 +NewsHeadlineSentiment_disc,0.5128050979920644 +NewsTitleSentiment_disc,0.6024207446595327 +OpenCloseFist,0.7627118644067796 +Opportunity,0.7935409457900807 +PAMAP2,0.8388074785245073 PEMS-SF,0.8439306358381503 +PPGDalia_disc,0.7800018620240201 PenDigits,0.9797026872498571 PhonemeSpectra,0.2782582761705935 PhotoStimulation,0.5833333333333334 +PronouncedSpeech,0.27 RacketSports,0.9078947368421053 +SPHERE-WUS,1.0 STEW,0.7404601571268238 SelfRegulationSCP1,0.815068493150685 +SelfRegulationSCP2,0.5111111111111111 +ShortIntervalTask,0.37 +SitStand,0.3984375 Skoda,0.9451715599575522 +SongFamiliarity,0.46814404432132967 SpokenArabicDigits,0.9899954524783993 StandWalkJump,0.4666666666666667 TactileTextureRecognition,0.9985315712187959 Tiselac,0.6459555106167846 +UCDHE-MP,0.81 +UCDHE-MP-MC,0.7845303867403315 +UCDHE-Rowing,0.36666666666666664 UCDHE-Rowing-MC,0.7295454545454545 UCIActivity,0.9333610995418575 UIPRMD-DS-C,0.7222222222222222 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,1.0 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.8888888888888888 +UIPRMD-SSIER-C,0.8 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,1.0 USCActivity,0.6634264884568651 UWaveGestureLibrary,0.940625 +VisualSpeech,0.235 WISDM,0.882364303650763 +WISDM2,0.5816843345111896 diff --git a/results/multiverse/ROCKET/ROCKET_specificity.csv b/results/multiverse/ROCKET/ROCKET_specificity.csv index 9609b7b..1fb3a40 100644 --- a/results/multiverse/ROCKET/ROCKET_specificity.csv +++ b/results/multiverse/ROCKET/ROCKET_specificity.csv @@ -3,17 +3,21 @@ Alzheimers,0.4186046511627907 AppliancesEnergy_disc,0.8529411764705882 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8542199488491049 +AsphaltPavementTypeCoordinates,0.8636363636363636 AsphaltRegularityCoordinates,0.926509186351706 AtrialFibrillation,0.06666666666666667 AutomotiveRoadTrials,0.8275862068965517 BIDMC32HR_disc,0.9208003334722801 +BIDMC32RR_disc,0.783659858274281 BIDMC32SpO2_disc,0.9341491841491841 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8629526462395544 BeijingPM25Quality_disc,0.8625780806360023 BenzeneConcentration_disc,0.9469250210614996 Blink,1.0 BoneIntensitiesAgeGroup,0.8134831460674158 BoneProbAgeGroup,0.6876404494382022 +ButtonPress,0.9850746268656716 CharacterTrajectories,0.9930362116991643 CounterMovementJump,0.9217877094972067 Cricket,1.0 @@ -26,6 +30,9 @@ Epilepsy,0.9855072463768116 EthanolConcentration,0.43346007604562736 EyesOpenShut,0.2857142857142857 FaceDetection,0.6157775255391601 +FeedbackButton,0.5252173913043479 +FeetHands,0.6558237145855194 +FingerMovements,0.4117647058823529 FordChallenge,0.860650298606503 HandMovementDirection,0.5135135135135135 Handwriting,0.5870588235294117 @@ -33,34 +40,86 @@ Heartbeat,0.9121621621621622 HouseholdPowerConsumption1_disc,0.89067055393586 HouseholdPowerConsumption2_disc,0.7478134110787172 IEEEPPG_disc,0.6310240963855421 +IRDS-EFL,1.0 +IRDS-EFR,1.0 +IRDS-SAL,0.6666666666666666 +IRDS-SAR,0.1724137931034483 +IRDS-SFE,1.0 IRDS-SFL,0.7717391304347826 +IRDS-SFR,0.9230769230769231 +IRDS-STL,1.0 +IRDS-STR,1.0 +ImaginedFeetHands,0.6539256198347108 +ImaginedOpenCloseFist,0.7093023255813954 +InnerSpeech,0.225 JapaneseVowels,0.8243243243243243 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.7142857142857143 +KERAAL-ELK,1.0 +KERAAL-ELK-MC,0.8571428571428571 KERAAL-RTK,0.875 +KERAAL-RTK-MC,0.5384615384615384 +KIMORE-LA-C,0.0 +KIMORE-LT-C,0.25 KIMORE-PR-C,0.5 +KIMORE-Sq-C,0.6 +KIMORE-TR-C,0.16666666666666666 +KINECAL-3WFV,0.9090909090909091 +KINECAL-GGFV,1.0 +KINECAL-QSEC,1.0 KINECAL-QSEO,1.0 LSST,0.6362530413625304 Libras,0.9055555555555556 +LiveFuelMoistureContent_disc,0.9244094488188976 Locust2022,0.97771124417831 +LongIntervalTask,0.8723684210526316 LowCost,0.68 +MatchingPennies,0.6079545454545454 MindReading,0.4762633996937213 MotionSenseHAR,0.9773584905660377 MotorImagery,0.52 NATOPS,0.8722222222222222 +NewsHeadlineSentiment_disc,0.5128050979920644 +NewsTitleSentiment_disc,0.6024207446595327 +OpenCloseFist,0.7272727272727273 +Opportunity,0.7935409457900807 +PAMAP2,0.8388074785245073 PEMS-SF,0.8439306358381503 +PPGDalia_disc,0.7800018620240201 PenDigits,0.9797026872498571 PhonemeSpectra,0.2782582761705935 PhotoStimulation,0.5833333333333334 +PronouncedSpeech,0.27 RacketSports,0.9078947368421053 +SPHERE-WUS,1.0 STEW,0.8282828282828283 SelfRegulationSCP1,0.891156462585034 +SelfRegulationSCP2,0.5444444444444444 +ShortIntervalTask,0.8513888888888889 +SitStand,0.3984375 Skoda,0.9451715599575522 +SongFamiliarity,0.5424164524421594 SpokenArabicDigits,0.9899954524783993 StandWalkJump,0.4666666666666667 TactileTextureRecognition,0.9985315712187959 Tiselac,0.6459555106167846 +UCDHE-MP,0.8778625954198473 +UCDHE-MP-MC,0.7845303867403315 +UCDHE-Rowing,0.9314285714285714 UCDHE-Rowing-MC,0.7295454545454545 UCIActivity,0.9333610995418575 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.5555555555555556 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,1.0 +UIPRMD-SSS-C,0.8888888888888888 +UIPRMD-STS-C,1.0 USCActivity,0.6634264884568651 UWaveGestureLibrary,0.940625 +VisualSpeech,0.235 WISDM,0.882364303650763 +WISDM2,0.5816843345111896 diff --git a/results/multiverse/STC/STC_accuracy.csv b/results/multiverse/STC/STC_accuracy.csv index 89d0cbb..792badf 100644 --- a/results/multiverse/STC/STC_accuracy.csv +++ b/results/multiverse/STC/STC_accuracy.csv @@ -3,18 +3,22 @@ Alzheimers,0.37209302325581395 AppliancesEnergy_disc,0.8571428571428571 ArticularyWordRecognition,0.97 AsphaltObstaclesCoordinates,0.8209718670076727 +AsphaltPavementTypeCoordinates,0.8551136363636364 AsphaltRegularityCoordinates,0.9494007989347537 AtrialFibrillation,0.26666666666666666 AustraliaRainfall_disc,0.7594891953162372 AutomotiveRoadTrials,0.8441558441558441 BIDMC32HR_disc,0.8978741142142559 +BIDMC32RR_disc,0.7940808670279283 BIDMC32SpO2_disc,0.7140475197999167 +BasicMotions,0.95 BeijingPM10Quality_disc,0.7612916006339144 BeijingPM25Quality_disc,0.7979397781299524 BenzeneConcentration_disc,0.8067015301181484 Blink,0.9977777777777778 BoneIntensitiesAgeGroup,0.8134831460674158 BoneProbAgeGroup,0.5797752808988764 +ButtonPress,0.95 CharacterTrajectories,0.9749303621169917 CounterMovementJump,0.7262569832402235 Cricket,0.9722222222222222 @@ -27,6 +31,9 @@ Epilepsy,0.9710144927536232 EthanolConcentration,0.7490494296577946 EyesOpenShut,0.47619047619047616 FaceDetection,0.6282633371169126 +FeedbackButton,0.5478260869565217 +FeetHands,0.671957671957672 +FingerMovements,0.6 FordChallenge,0.6232423490488007 HandMovementDirection,0.5405405405405406 Handwriting,0.4011764705882353 @@ -34,34 +41,86 @@ Heartbeat,0.7365853658536585 HouseholdPowerConsumption1_disc,0.880466472303207 HouseholdPowerConsumption2_disc,0.7696793002915452 IEEEPPG_disc,0.6596385542168675 +IRDS-EFL,0.8461538461538461 +IRDS-EFR,0.6666666666666666 +IRDS-SAL,0.6964285714285714 +IRDS-SAR,0.45454545454545453 +IRDS-SFE,0.6666666666666666 IRDS-SFL,0.8620689655172413 +IRDS-SFR,0.6 +IRDS-STL,0.7631578947368421 +IRDS-STR,0.9666666666666667 +ImaginedFeetHands,0.6935400516795865 +ImaginedOpenCloseFist,0.7619047619047619 +InnerSpeech,0.25 JapaneseVowels,0.8081081081081081 +KERAAL-CTK,0.8571428571428571 +KERAAL-CTK-MC,0.5714285714285714 +KERAAL-ELK,0.8 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.7857142857142857 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,0.42857142857142855 +KIMORE-LT-C,0.2857142857142857 KIMORE-PR-C,0.14285714285714285 +KIMORE-Sq-C,0.2857142857142857 +KIMORE-TR-C,0.14285714285714285 +KINECAL-3WFV,0.8333333333333334 +KINECAL-GGFV,0.9230769230769231 +KINECAL-QSEC,0.9444444444444444 KINECAL-QSEO,0.9411764705882353 LSST,0.6131386861313869 Libras,0.8888888888888888 +LiveFuelMoistureContent_disc,0.7973509933774835 Locust2022,0.9042133979993937 +LongIntervalTask,0.6669642857142857 LowCost,0.6633333333333333 +MatchingPennies,0.6242857142857143 MindReading,0.445635528330781 MotionSenseHAR,0.9773584905660377 MotorImagery,0.52 NATOPS,0.8611111111111112 +NewsHeadlineSentiment_disc,0.5425033064807022 +NewsTitleSentiment_disc,0.6246643421105367 +OpenCloseFist,0.7492063492063492 +Opportunity,0.7758554402153018 +PAMAP2,0.6956038403233956 PEMS-SF,0.9884393063583815 +PPGDalia_disc,0.8175216460292338 PenDigits,0.9702687249857062 PhonemeSpectra,0.29197733373098717 PhotoStimulation,0.4166666666666667 +PronouncedSpeech,0.33 RacketSports,0.8552631578947368 +SPHERE-WUS,0.75 STEW,0.7878787878787878 SelfRegulationSCP1,0.8327645051194539 +SelfRegulationSCP2,0.49444444444444446 +ShortIntervalTask,0.675 +SitStand,0.3546875 Skoda,0.844711708524938 +SongFamiliarity,0.52 SpokenArabicDigits,0.9549795361527967 StandWalkJump,0.3333333333333333 TactileTextureRecognition,0.9985315712187959 Tiselac,0.6328614762386249 +UCDHE-MP,0.856353591160221 +UCDHE-MP-MC,0.6961325966850829 +UCDHE-Rowing,0.8136363636363636 UCDHE-Rowing-MC,0.7431818181818182 UCIActivity,0.8234069137859226 UIPRMD-DS-C,0.9444444444444444 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.7222222222222222 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,0.9444444444444444 +UIPRMD-SSE-C,0.9444444444444444 +UIPRMD-SSIER-C,0.8 +UIPRMD-SSS-C,0.8333333333333334 +UIPRMD-STS-C,0.9444444444444444 USCActivity,0.5975091130012151 UWaveGestureLibrary,0.890625 +VisualSpeech,0.31 WISDM,0.8672976627390381 +WISDM2,0.5580094228504122 diff --git a/results/multiverse/STC/STC_auroc.csv b/results/multiverse/STC/STC_auroc.csv index 80409c4..2eba36b 100644 --- a/results/multiverse/STC/STC_auroc.csv +++ b/results/multiverse/STC/STC_auroc.csv @@ -3,18 +3,22 @@ Alzheimers,0.5400170408981556 AppliancesEnergy_disc,0.886029411764706 ArticularyWordRecognition,0.9988368055555554 AsphaltObstaclesCoordinates,0.9524263004133863 +AsphaltPavementTypeCoordinates,0.9681336540800319 AsphaltRegularityCoordinates,0.9918564233524864 AtrialFibrillation,0.53 AustraliaRainfall_disc,0.8316770016513555 AutomotiveRoadTrials,0.7604355716878403 BIDMC32HR_disc,0.9789372976704055 +BIDMC32RR_disc,0.4066477194266518 BIDMC32SpO2_disc,0.5353131495151994 +BasicMotions,0.9983333333333334 BeijingPM10Quality_disc,0.8161597143413919 BeijingPM25Quality_disc,0.8630997035670933 BenzeneConcentration_disc,0.8403303438800348 Blink,0.9999800000000001 BoneIntensitiesAgeGroup,0.9325449305695845 BoneProbAgeGroup,0.7556154103306482 +ButtonPress,0.9881723458180794 CharacterTrajectories,0.9996207487392623 CounterMovementJump,0.9048829867142387 Cricket,1.0 @@ -27,6 +31,9 @@ Epilepsy,0.9997130147797387 EthanolConcentration,0.9275225084802202 EyesOpenShut,0.4251700680272109 FaceDetection,0.6865225127260968 +FeedbackButton,0.5826283553875237 +FeetHands,0.7396011695919531 +FingerMovements,0.5886354541816727 FordChallenge,0.5008408133673543 HandMovementDirection,0.7557133982981439 Handwriting,0.8542866803676163 @@ -34,34 +41,86 @@ Heartbeat,0.6968349928876244 HouseholdPowerConsumption1_disc,0.9440682817204545 HouseholdPowerConsumption2_disc,0.7883749018884819 IEEEPPG_disc,0.8893899236862051 +IRDS-EFL,0.8303571428571429 +IRDS-EFR,0.76 +IRDS-SAL,0.7032312925170068 +IRDS-SAR,0.8879310344827586 +IRDS-SFE,0.4600000000000001 IRDS-SFL,0.9549365942028986 +IRDS-SFR,0.4230769230769231 +IRDS-STL,0.7710437710437711 +IRDS-STR,0.8672727272727272 +ImaginedFeetHands,0.7547507841411198 +ImaginedOpenCloseFist,0.8577065118070735 +InnerSpeech,0.49582189586353004 JapaneseVowels,0.96529933208842 +KERAAL-CTK,0.979591836734694 +KERAAL-CTK-MC,0.8058771585557299 +KERAAL-ELK,0.21875 +KERAAL-ELK-MC,0.8461538461538461 KERAAL-RTK,0.8125 +KERAAL-RTK-MC,0.5272435897435898 +KIMORE-LA-C,0.75 +KIMORE-LT-C,0.3333333333333333 KIMORE-PR-C,0.6666666666666667 +KIMORE-Sq-C,0.6 +KIMORE-TR-C,0.9166666666666667 +KINECAL-3WFV,0.2727272727272727 +KINECAL-GGFV,0.5833333333333333 +KINECAL-QSEC,0.4117647058823529 KINECAL-QSEO,1.0 LSST,0.8847362588707004 Libras,0.9937169312169314 +LiveFuelMoistureContent_disc,0.5042109580052494 Locust2022,0.8496919698714062 +LongIntervalTask,0.6673592836257309 LowCost,0.7199555555555556 +MatchingPennies,0.672805642633229 MindReading,0.8033866277570263 MotionSenseHAR,0.9992454404295963 MotorImagery,0.5683999999999999 NATOPS,0.9813518518518518 +NewsHeadlineSentiment_disc,0.5001819283846132 +NewsTitleSentiment_disc,0.5038033202744523 +OpenCloseFist,0.8440988148134877 +Opportunity,0.9178485535034145 +PAMAP2,0.9599723870871898 PEMS-SF,0.9997624515005147 +PPGDalia_disc,0.9275120132337829 PenDigits,0.9992609764229762 PhonemeSpectra,0.8876882309902762 PhotoStimulation,0.46499694749694753 +PronouncedSpeech,0.5888515854497399 RacketSports,0.9564438301668957 +SPHERE-WUS,1.0 STEW,0.8720364733505399 SelfRegulationSCP1,0.9058568632932624 +SelfRegulationSCP2,0.5060493827160494 +ShortIntervalTask,0.7420868055555556 +SitStand,0.6514690104166667 Skoda,0.9754671974499012 +SongFamiliarity,0.5172685129139992 SpokenArabicDigits,0.9978873317536718 StandWalkJump,0.6 TactileTextureRecognition,0.9999707141132322 Tiselac,0.8904195573961214 +UCDHE-MP,0.884236641221374 +UCDHE-MP-MC,0.8985043368908114 +UCDHE-Rowing,0.774015873015873 UCDHE-Rowing-MC,0.9295708594863007 UCIActivity,0.9692161982004053 UIPRMD-DS-C,0.9922839506172839 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.9259259259259259 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.9400000000000001 +UIPRMD-SSS-C,0.962962962962963 +UIPRMD-STS-C,0.9938271604938272 USCActivity,0.9412801677623446 UWaveGestureLibrary,0.9871595982142857 +VisualSpeech,0.5502816861008584 WISDM,0.9773466878176341 +WISDM2,0.8681993017101721 diff --git a/results/multiverse/STC/STC_balacc.csv b/results/multiverse/STC/STC_balacc.csv index b741c8f..595ee81 100644 --- a/results/multiverse/STC/STC_balacc.csv +++ b/results/multiverse/STC/STC_balacc.csv @@ -3,18 +3,22 @@ Alzheimers,0.3645983645983646 AppliancesEnergy_disc,0.8161764705882353 ArticularyWordRecognition,0.97 AsphaltObstaclesCoordinates,0.8202189142173084 +AsphaltPavementTypeCoordinates,0.8399667632204397 AsphaltRegularityCoordinates,0.9495069873022629 AtrialFibrillation,0.26666666666666666 AustraliaRainfall_disc,0.3631680780415875 AutomotiveRoadTrials,0.7372958257713249 BIDMC32HR_disc,0.8563240289364282 +BIDMC32RR_disc,0.3333333333333333 BIDMC32SpO2_disc,0.5008886306470495 +BasicMotions,0.95 BeijingPM10Quality_disc,0.6388995877131645 BeijingPM25Quality_disc,0.7161146971330926 BenzeneConcentration_disc,0.7290355253069299 Blink,0.998 BoneIntensitiesAgeGroup,0.8351446496417384 BoneProbAgeGroup,0.6248079749050156 +ButtonPress,0.9493100535060546 CharacterTrajectories,0.97366654753847 CounterMovementJump,0.7266478342749529 Cricket,0.9722222222222223 @@ -27,6 +31,9 @@ Epilepsy,0.972972972972973 EthanolConcentration,0.7495337995337995 EyesOpenShut,0.47619047619047616 FaceDetection,0.6282633371169126 +FeedbackButton,0.5478260869565217 +FeetHands,0.6722835599763035 +FingerMovements,0.6010404161664666 FordChallenge,0.5005788331122648 HandMovementDirection,0.5047619047619047 Handwriting,0.3980102478537523 @@ -34,34 +41,86 @@ Heartbeat,0.5532835467045993 HouseholdPowerConsumption1_disc,0.7260116839283531 HouseholdPowerConsumption2_disc,0.5366219270328859 IEEEPPG_disc,0.6425000095347263 +IRDS-EFL,0.8333333333333333 +IRDS-EFR,0.5 +IRDS-SAL,0.6071428571428571 +IRDS-SAR,0.6896551724137931 +IRDS-SFE,0.5 IRDS-SFL,0.8822463768115942 +IRDS-SFR,0.34615384615384615 +IRDS-STL,0.5909090909090909 +IRDS-STR,0.8 +ImaginedFeetHands,0.693540236908903 +ImaginedOpenCloseFist,0.761951526498728 +InnerSpeech,0.2502567721032767 JapaneseVowels,0.7998858252528999 +KERAAL-CTK,0.8571428571428572 +KERAAL-CTK-MC,0.3968253968253968 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.5 KERAAL-RTK,0.7708333333333333 +KERAAL-RTK-MC,0.3333333333333333 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.3333333333333333 KIMORE-PR-C,0.5 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.45454545454545453 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.5 LSST,0.30460337173890323 Libras,0.8888888888888887 +LiveFuelMoistureContent_disc,0.4942913385826772 Locust2022,0.637868177183744 +LongIntervalTask,0.55796783625731 LowCost,0.6633333333333333 +MatchingPennies,0.6247714211076281 MindReading,0.4424876769250747 MotionSenseHAR,0.9732037150438865 MotorImagery,0.52 NATOPS,0.8611111111111112 +NewsHeadlineSentiment_disc,0.3330923896707696 +NewsTitleSentiment_disc,0.3334079551536348 +OpenCloseFist,0.7491859121367399 +Opportunity,0.7102530601075072 +PAMAP2,0.6725240519984398 PEMS-SF,0.987012987012987 +PPGDalia_disc,0.7417946255770982 PenDigits,0.9706020844826815 PhonemeSpectra,0.291999017854011 PhotoStimulation,0.3666666666666667 +PronouncedSpeech,0.3263738605810217 RacketSports,0.8668397009966777 +SPHERE-WUS,0.75 STEW,0.7878787878787878 SelfRegulationSCP1,0.8326810176125244 +SelfRegulationSCP2,0.49444444444444446 +ShortIntervalTask,0.5911111111111111 +SitStand,0.35468750000000004 Skoda,0.8214639892423705 +SongFamiliarity,0.5159404396527782 SpokenArabicDigits,0.9549937733499376 StandWalkJump,0.3333333333333333 TactileTextureRecognition,0.9982363315696648 Tiselac,0.465811675828627 +UCDHE-MP,0.8018320610687023 +UCDHE-MP-MC,0.6940096618357487 +UCDHE-Rowing,0.5898412698412698 UCDHE-Rowing-MC,0.7488095238095237 UCIActivity,0.8340914101278888 UIPRMD-DS-C,0.9444444444444444 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.7222222222222222 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,0.9444444444444444 +UIPRMD-SSE-C,0.9444444444444444 +UIPRMD-SSIER-C,0.8 +UIPRMD-SSS-C,0.8333333333333333 +UIPRMD-STS-C,0.9444444444444444 USCActivity,0.6264023909673092 UWaveGestureLibrary,0.890625 +VisualSpeech,0.31190649336657744 WISDM,0.5621924113701345 +WISDM2,0.4737343880275376 diff --git a/results/multiverse/STC/STC_f1.csv b/results/multiverse/STC/STC_f1.csv index 01c09e1..1a3c354 100644 --- a/results/multiverse/STC/STC_f1.csv +++ b/results/multiverse/STC/STC_f1.csv @@ -3,18 +3,22 @@ Alzheimers,0.3733150036277542 AppliancesEnergy_disc,0.6666666666666666 ArticularyWordRecognition,0.9700940914158306 AsphaltObstaclesCoordinates,0.8180076699366774 +AsphaltPavementTypeCoordinates,0.8556464879738939 AsphaltRegularityCoordinates,0.9490616621983914 AtrialFibrillation,0.3066378066378066 AustraliaRainfall_disc,0.7372470267087378 AutomotiveRoadTrials,0.625 BIDMC32HR_disc,0.8924991376915257 +BIDMC32RR_disc,0.702938685728719 BIDMC32SpO2_disc,0.011527377521613832 +BasicMotions,0.9494949494949495 BeijingPM10Quality_disc,0.4579397210976158 BeijingPM25Quality_disc,0.6037296037296037 BenzeneConcentration_disc,0.6273338312173263 Blink,0.9975062344139651 BoneIntensitiesAgeGroup,0.8123111599305086 BoneProbAgeGroup,0.5802254584708355 +ButtonPress,0.9433962264150944 CharacterTrajectories,0.9750573302892237 CounterMovementJump,0.7163738116004748 Cricket,0.9720279720279721 @@ -27,6 +31,9 @@ Epilepsy,0.9707050093385211 EthanolConcentration,0.7483844457935266 EyesOpenShut,0.5769230769230769 FaceDetection,0.6187427240977881 +FeedbackButton,0.5615514333895447 +FeetHands,0.6823770491803278 +FingerMovements,0.6153846153846154 FordChallenge,0.005820298290287377 HandMovementDirection,0.5328338770961721 Handwriting,0.358839780790284 @@ -34,34 +41,86 @@ Heartbeat,0.22857142857142856 HouseholdPowerConsumption1_disc,0.8745869906543813 HouseholdPowerConsumption2_disc,0.7276900312180216 IEEEPPG_disc,0.6516064845938179 +IRDS-EFL,0.8 +IRDS-EFR,0.0 +IRDS-SAL,0.41379310344827586 +IRDS-SAR,0.3076923076923077 +IRDS-SFE,0.0 IRDS-SFL,0.7333333333333333 +IRDS-SFR,0.0 +IRDS-STL,0.3076923076923077 +IRDS-STR,0.75 +ImaginedFeetHands,0.6935400516795865 +ImaginedOpenCloseFist,0.7718052738336714 +InnerSpeech,0.2275318869987622 JapaneseVowels,0.8049601548327039 +KERAAL-CTK,0.8333333333333334 +KERAAL-CTK-MC,0.5904761904761905 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.8941798941798941 KERAAL-RTK,0.7272727272727273 +KERAAL-RTK-MC,0.21367521367521367 +KIMORE-LA-C,0.6 +KIMORE-LT-C,0.4444444444444444 KIMORE-PR-C,0.25 +KIMORE-Sq-C,0.4444444444444444 +KIMORE-TR-C,0.25 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.5342082872346795 Libras,0.8872441149832454 +LiveFuelMoistureContent_disc,0.07272727272727272 Locust2022,0.368 +LongIntervalTask,0.3279279279279279 LowCost,0.6456140350877193 +MatchingPennies,0.6525759577278731 MindReading,0.42307378498961107 MotionSenseHAR,0.9773196250859406 MotorImagery,0.6666666666666666 NATOPS,0.8592659623376276 +NewsHeadlineSentiment_disc,0.4003691494607913 +NewsTitleSentiment_disc,0.4808447618852108 +OpenCloseFist,0.744060475161987 +Opportunity,0.7729609662779691 +PAMAP2,0.6890204844153706 PEMS-SF,0.9883704927057528 +PPGDalia_disc,0.8129896118671964 PenDigits,0.9702761489669429 PhonemeSpectra,0.2859269402862679 PhotoStimulation,0.34366925064599485 +PronouncedSpeech,0.3127263609894905 RacketSports,0.8540278385911457 +SPHERE-WUS,0.6666666666666666 STEW,0.7868621370171976 SelfRegulationSCP1,0.8280701754385965 +SelfRegulationSCP2,0.5133689839572193 +ShortIntervalTask,0.3953488372093023 +SitStand,0.3502697282597566 Skoda,0.8442146314169992 +SongFamiliarity,0.44954128440366975 SpokenArabicDigits,0.9548833688791991 StandWalkJump,0.2792022792022792 TactileTextureRecognition,0.9985305990713076 Tiselac,0.6215929009403652 +UCDHE-MP,0.723404255319149 +UCDHE-MP-MC,0.695913071697869 +UCDHE-Rowing,0.31666666666666665 UCDHE-Rowing-MC,0.7382475308906853 UCIActivity,0.8191433723994636 UIPRMD-DS-C,0.9444444444444444 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.7619047619047619 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,0.9411764705882353 +UIPRMD-SSE-C,0.9411764705882353 +UIPRMD-SSIER-C,0.7777777777777778 +UIPRMD-SSS-C,0.8235294117647058 +UIPRMD-STS-C,0.9444444444444444 USCActivity,0.5912523588288081 UWaveGestureLibrary,0.8893361439006686 +VisualSpeech,0.3069340659340659 WISDM,0.8506555986465638 +WISDM2,0.49608062612301085 diff --git a/results/multiverse/STC/STC_logloss.csv b/results/multiverse/STC/STC_logloss.csv index 8e966d5..29fdd4d 100644 --- a/results/multiverse/STC/STC_logloss.csv +++ b/results/multiverse/STC/STC_logloss.csv @@ -3,18 +3,22 @@ Alzheimers,1.1402765902745708 AppliancesEnergy_disc,0.35192092418913723 ArticularyWordRecognition,0.28107538196442167 AsphaltObstaclesCoordinates,0.5284208245889829 +AsphaltPavementTypeCoordinates,0.35166073372008044 AsphaltRegularityCoordinates,0.12993121372251357 AtrialFibrillation,1.2188070858410105 AustraliaRainfall_disc,0.5695028488263548 AutomotiveRoadTrials,0.5033288857056711 BIDMC32HR_disc,0.38668285766033317 +BIDMC32RR_disc,1.7513962500761897 BIDMC32SpO2_disc,0.7306991563074636 +BasicMotions,0.2181752950516454 BeijingPM10Quality_disc,0.46926437935895005 BeijingPM25Quality_disc,0.41954719155778486 BenzeneConcentration_disc,0.4643251758672641 Blink,0.01934239055454226 BoneIntensitiesAgeGroup,0.44212367653180223 BoneProbAgeGroup,0.8164153939115167 +ButtonPress,0.23148715032760084 CharacterTrajectories,0.11095071486137158 CounterMovementJump,0.677483298160455 Cricket,0.23993532700652903 @@ -27,6 +31,9 @@ Epilepsy,0.11456373501191197 EthanolConcentration,0.6590524242989937 EyesOpenShut,0.7805894481852333 FaceDetection,0.6392867800695611 +FeedbackButton,0.6831863247351394 +FeetHands,0.6006379612572262 +FingerMovements,0.6923520853079169 FordChallenge,0.6635785329833942 HandMovementDirection,1.1973194778277527 Handwriting,2.67728105087311 @@ -34,34 +41,86 @@ Heartbeat,0.5347224820701176 HouseholdPowerConsumption1_disc,0.2915027104192259 HouseholdPowerConsumption2_disc,0.5766401209376693 IEEEPPG_disc,0.7383909562123083 +IRDS-EFL,0.6868554956356602 +IRDS-EFR,0.8725944210218259 +IRDS-SAL,0.5305076764773988 +IRDS-SAR,3.2311070985836983 +IRDS-SFE,1.0688566685584044 IRDS-SFL,0.3006610537698956 +IRDS-SFR,0.7348624093197679 +IRDS-STL,0.6246216999199852 +IRDS-STR,0.17922157235113426 +ImaginedFeetHands,0.5867697128610414 +ImaginedOpenCloseFist,0.47259733455571723 +InnerSpeech,1.4185694224008727 JapaneseVowels,0.8939416001659627 +KERAAL-CTK,0.4418115982966975 +KERAAL-CTK-MC,1.147441043110727 +KERAAL-ELK,0.6258985998518781 +KERAAL-ELK-MC,0.37312480932868636 KERAAL-RTK,0.5625757845139906 +KERAAL-RTK-MC,1.2126853739269337 +KIMORE-LA-C,1.4337768562779274 +KIMORE-LT-C,1.0511262280734923 KIMORE-PR-C,0.8948200936913396 +KIMORE-Sq-C,1.0735289756558413 +KIMORE-TR-C,7.3174754129732085 +KINECAL-3WFV,0.499439512732429 +KINECAL-GGFV,0.2618920310919776 +KINECAL-QSEC,0.2707210880287108 KINECAL-QSEO,0.1811907563632951 LSST,1.3050690465995882 Libras,0.4788753499867298 +LiveFuelMoistureContent_disc,0.5214270139498997 Locust2022,0.35210440573192886 +LongIntervalTask,0.6878258406718083 LowCost,0.6143143290828302 +MatchingPennies,0.6539874321544907 MindReading,1.2189268989773823 MotionSenseHAR,0.12786456693734105 MotorImagery,0.7226322914563775 NATOPS,0.41284281063284645 +NewsHeadlineSentiment_disc,1.3651083872657919 +NewsTitleSentiment_disc,0.9277313599789226 +OpenCloseFist,0.49798959817001587 +Opportunity,0.6569162283361524 +PAMAP2,1.0407374569182917 PEMS-SF,0.23717590144395712 +PPGDalia_disc,0.44218813952430597 PenDigits,0.11947202501329968 PhonemeSpectra,2.922990779332062 PhotoStimulation,1.2018847804285455 +PronouncedSpeech,1.3616715361364748 RacketSports,0.5003358577128987 +SPHERE-WUS,0.32802801534284753 STEW,0.47225420203317703 SelfRegulationSCP1,0.38345416514463676 +SelfRegulationSCP2,0.7106704782787403 +ShortIntervalTask,0.5639349859659374 +SitStand,1.3514060003111126 Skoda,0.9193312274644302 +SongFamiliarity,0.7318244930575468 SpokenArabicDigits,0.19517291062693307 StandWalkJump,1.1780861236733413 TactileTextureRecognition,0.29527227474145745 Tiselac,1.1157534994898137 +UCDHE-MP,0.3587900503638895 +UCDHE-MP-MC,0.7729901522588652 +UCDHE-Rowing,0.4192606077343979 UCDHE-Rowing-MC,0.8467512040208455 UCIActivity,0.48225117065896245 UIPRMD-DS-C,0.1957228251766103 +UIPRMD-HS-C,0.039803720785618175 +UIPRMD-IL-C,0.47960102412111794 +UIPRMD-SASLR-C,0.18962673859357218 +UIPRMD-SL-C,0.1911799214700788 +UIPRMD-SSA-C,0.16290814583992935 +UIPRMD-SSE-C,0.11351732219978149 +UIPRMD-SSIER-C,0.459913183369578 +UIPRMD-SSS-C,0.34290186397806977 +UIPRMD-STS-C,0.23384946171949694 USCActivity,1.018298690632085 UWaveGestureLibrary,0.4943682508897288 +VisualSpeech,1.3976586234399355 WISDM,0.6601802663920553 +WISDM2,1.1350478351013202 diff --git a/results/multiverse/STC/STC_sensitivity.csv b/results/multiverse/STC/STC_sensitivity.csv index f4240d3..50eac2e 100644 --- a/results/multiverse/STC/STC_sensitivity.csv +++ b/results/multiverse/STC/STC_sensitivity.csv @@ -3,18 +3,22 @@ Alzheimers,0.37209302325581395 AppliancesEnergy_disc,0.75 ArticularyWordRecognition,0.97 AsphaltObstaclesCoordinates,0.8209718670076727 +AsphaltPavementTypeCoordinates,0.8551136363636364 AsphaltRegularityCoordinates,0.9567567567567568 AtrialFibrillation,0.26666666666666666 AustraliaRainfall_disc,0.7594891953162372 AutomotiveRoadTrials,0.5263157894736842 BIDMC32HR_disc,0.8978741142142559 +BIDMC32RR_disc,0.7940808670279283 BIDMC32SpO2_disc,0.005856515373352855 +BasicMotions,0.95 BeijingPM10Quality_disc,0.34910836762688613 BeijingPM25Quality_disc,0.5091743119266054 BenzeneConcentration_disc,0.5243445692883895 Blink,1.0 BoneIntensitiesAgeGroup,0.8134831460674158 BoneProbAgeGroup,0.5797752808988764 +ButtonPress,0.9433962264150944 CharacterTrajectories,0.9749303621169917 CounterMovementJump,0.7262569832402235 Cricket,0.9722222222222222 @@ -27,6 +31,9 @@ Epilepsy,0.9710144927536232 EthanolConcentration,0.7490494296577946 EyesOpenShut,0.7142857142857143 FaceDetection,0.6032917139614075 +FeedbackButton,0.5791304347826087 +FeetHands,0.7107790821771611 +FingerMovements,0.6530612244897959 FordChallenge,0.0029271862422246614 HandMovementDirection,0.5405405405405406 Handwriting,0.4011764705882353 @@ -34,34 +41,86 @@ Heartbeat,0.14035087719298245 HouseholdPowerConsumption1_disc,0.880466472303207 HouseholdPowerConsumption2_disc,0.7696793002915452 IEEEPPG_disc,0.6596385542168675 +IRDS-EFL,0.6666666666666666 +IRDS-EFR,0.0 +IRDS-SAL,0.42857142857142855 +IRDS-SAR,1.0 +IRDS-SFE,0.0 IRDS-SFL,0.9166666666666666 +IRDS-SFR,0.0 +IRDS-STL,0.18181818181818182 +IRDS-STR,0.6 +ImaginedFeetHands,0.6938986556359876 +ImaginedOpenCloseFist,0.8061440677966102 +InnerSpeech,0.25 JapaneseVowels,0.8081081081081081 +KERAAL-CTK,0.7142857142857143 +KERAAL-CTK-MC,0.5714285714285714 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.6666666666666666 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,1.0 +KIMORE-LT-C,0.6666666666666666 KIMORE-PR-C,1.0 +KIMORE-Sq-C,1.0 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.6131386861313869 Libras,0.8888888888888888 +LiveFuelMoistureContent_disc,0.05 Locust2022,0.31399317406143346 +LongIntervalTask,0.25277777777777777 LowCost,0.6133333333333333 +MatchingPennies,0.7097701149425287 MindReading,0.445635528330781 MotionSenseHAR,0.9773584905660377 MotorImagery,0.96 NATOPS,0.8611111111111112 +NewsHeadlineSentiment_disc,0.5425033064807022 +NewsTitleSentiment_disc,0.6246643421105367 +OpenCloseFist,0.7298728813559322 +Opportunity,0.7758554402153018 +PAMAP2,0.6956038403233956 PEMS-SF,0.9884393063583815 +PPGDalia_disc,0.8175216460292338 PenDigits,0.9702687249857062 PhonemeSpectra,0.29197733373098717 PhotoStimulation,0.4166666666666667 +PronouncedSpeech,0.33 RacketSports,0.8552631578947368 +SPHERE-WUS,0.5 STEW,0.7831088664421998 SelfRegulationSCP1,0.8082191780821918 +SelfRegulationSCP2,0.5333333333333333 +ShortIntervalTask,0.2975 +SitStand,0.3546875 Skoda,0.844711708524938 +SongFamiliarity,0.407202216066482 SpokenArabicDigits,0.9549795361527967 StandWalkJump,0.3333333333333333 TactileTextureRecognition,0.9985315712187959 Tiselac,0.6328614762386249 +UCDHE-MP,0.68 +UCDHE-MP-MC,0.6961325966850829 +UCDHE-Rowing,0.2111111111111111 UCDHE-Rowing-MC,0.7431818181818182 UCIActivity,0.8234069137859226 UIPRMD-DS-C,0.9444444444444444 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.8888888888888888 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,0.8888888888888888 +UIPRMD-SSE-C,0.8888888888888888 +UIPRMD-SSIER-C,0.7 +UIPRMD-SSS-C,0.7777777777777778 +UIPRMD-STS-C,0.9444444444444444 USCActivity,0.5975091130012151 UWaveGestureLibrary,0.890625 +VisualSpeech,0.31 WISDM,0.8672976627390381 +WISDM2,0.5580094228504122 diff --git a/results/multiverse/STC/STC_specificity.csv b/results/multiverse/STC/STC_specificity.csv index f3419fa..2de1b47 100644 --- a/results/multiverse/STC/STC_specificity.csv +++ b/results/multiverse/STC/STC_specificity.csv @@ -3,18 +3,22 @@ Alzheimers,0.37209302325581395 AppliancesEnergy_disc,0.8823529411764706 ArticularyWordRecognition,0.97 AsphaltObstaclesCoordinates,0.8209718670076727 +AsphaltPavementTypeCoordinates,0.8551136363636364 AsphaltRegularityCoordinates,0.9422572178477691 AtrialFibrillation,0.26666666666666666 AustraliaRainfall_disc,0.7594891953162372 AutomotiveRoadTrials,0.9482758620689655 BIDMC32HR_disc,0.8978741142142559 +BIDMC32RR_disc,0.7940808670279283 BIDMC32SpO2_disc,0.995920745920746 +BasicMotions,0.95 BeijingPM10Quality_disc,0.9286908077994429 BeijingPM25Quality_disc,0.9230550823395798 BenzeneConcentration_disc,0.9337264813254704 Blink,0.996 BoneIntensitiesAgeGroup,0.8134831460674158 BoneProbAgeGroup,0.5797752808988764 +ButtonPress,0.9552238805970149 CharacterTrajectories,0.9749303621169917 CounterMovementJump,0.7262569832402235 Cricket,0.9722222222222222 @@ -27,6 +31,9 @@ Epilepsy,0.9710144927536232 EthanolConcentration,0.7490494296577946 EyesOpenShut,0.23809523809523808 FaceDetection,0.6532349602724177 +FeedbackButton,0.5165217391304348 +FeetHands,0.633788037775446 +FingerMovements,0.5490196078431373 FordChallenge,0.9982304799823049 HandMovementDirection,0.5405405405405406 Handwriting,0.4011764705882353 @@ -34,34 +41,86 @@ Heartbeat,0.9662162162162162 HouseholdPowerConsumption1_disc,0.880466472303207 HouseholdPowerConsumption2_disc,0.7696793002915452 IEEEPPG_disc,0.6596385542168675 +IRDS-EFL,1.0 +IRDS-EFR,1.0 +IRDS-SAL,0.7857142857142857 +IRDS-SAR,0.3793103448275862 +IRDS-SFE,1.0 IRDS-SFL,0.8478260869565217 +IRDS-SFR,0.6923076923076923 +IRDS-STL,1.0 +IRDS-STR,1.0 +ImaginedFeetHands,0.6931818181818182 +ImaginedOpenCloseFist,0.7177589852008457 +InnerSpeech,0.25 JapaneseVowels,0.8081081081081081 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.5714285714285714 +KERAAL-ELK,1.0 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.875 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,0.0 +KIMORE-LT-C,0.0 KIMORE-PR-C,0.0 +KIMORE-Sq-C,0.0 +KIMORE-TR-C,0.0 +KINECAL-3WFV,0.9090909090909091 +KINECAL-GGFV,1.0 +KINECAL-QSEC,1.0 KINECAL-QSEO,1.0 LSST,0.6131386861313869 Libras,0.8888888888888888 +LiveFuelMoistureContent_disc,0.9385826771653544 Locust2022,0.9617431803060545 +LongIntervalTask,0.8631578947368421 LowCost,0.7133333333333334 +MatchingPennies,0.5397727272727273 MindReading,0.445635528330781 MotionSenseHAR,0.9773584905660377 MotorImagery,0.08 NATOPS,0.8611111111111112 +NewsHeadlineSentiment_disc,0.5425033064807022 +NewsTitleSentiment_disc,0.6246643421105367 +OpenCloseFist,0.7684989429175476 +Opportunity,0.7758554402153018 +PAMAP2,0.6956038403233956 PEMS-SF,0.9884393063583815 +PPGDalia_disc,0.8175216460292338 PenDigits,0.9702687249857062 PhonemeSpectra,0.29197733373098717 PhotoStimulation,0.4166666666666667 +PronouncedSpeech,0.33 RacketSports,0.8552631578947368 +SPHERE-WUS,1.0 STEW,0.792648709315376 SelfRegulationSCP1,0.8571428571428571 +SelfRegulationSCP2,0.45555555555555555 +ShortIntervalTask,0.8847222222222222 +SitStand,0.3546875 Skoda,0.844711708524938 +SongFamiliarity,0.6246786632390745 SpokenArabicDigits,0.9549795361527967 StandWalkJump,0.3333333333333333 TactileTextureRecognition,0.9985315712187959 Tiselac,0.6328614762386249 +UCDHE-MP,0.9236641221374046 +UCDHE-MP-MC,0.6961325966850829 +UCDHE-Rowing,0.9685714285714285 UCDHE-Rowing-MC,0.7431818181818182 UCIActivity,0.8234069137859226 UIPRMD-DS-C,0.9444444444444444 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.5555555555555556 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.9 +UIPRMD-SSS-C,0.8888888888888888 +UIPRMD-STS-C,0.9444444444444444 USCActivity,0.5975091130012151 UWaveGestureLibrary,0.890625 +VisualSpeech,0.31 WISDM,0.8672976627390381 +WISDM2,0.5580094228504122 diff --git a/results/multiverse/TDE/TDE_accuracy.csv b/results/multiverse/TDE/TDE_accuracy.csv index de46f31..98bfc67 100644 --- a/results/multiverse/TDE/TDE_accuracy.csv +++ b/results/multiverse/TDE/TDE_accuracy.csv @@ -3,18 +3,22 @@ Alzheimers,0.3488372093023256 AppliancesEnergy_disc,0.8333333333333334 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8286445012787724 +AsphaltPavementTypeCoordinates,0.8418560606060606 AsphaltRegularityCoordinates,0.9507323568575233 AtrialFibrillation,0.26666666666666666 AustraliaRainfall_disc,0.7201389322185479 AutomotiveRoadTrials,0.7792207792207793 BIDMC32HR_disc,0.704460191746561 +BIDMC32RR_disc,0.7407253022092538 BIDMC32SpO2_disc,0.6369320550229263 +BasicMotions,1.0 BeijingPM10Quality_disc,0.7347464342313788 BeijingPM25Quality_disc,0.7591125198098256 BenzeneConcentration_disc,0.6904900251791594 Blink,1.0 BoneIntensitiesAgeGroup,0.8067415730337079 BoneProbAgeGroup,0.7033707865168539 +ButtonPress,0.9916666666666667 CharacterTrajectories,0.9784122562674095 CounterMovementJump,0.8100558659217877 Cricket,0.9722222222222222 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.5437262357414449 EyesOpenShut,0.40476190476190477 FaceDetection,0.5805902383654937 +FeedbackButton,0.5 +FeetHands,0.6153439153439153 +FingerMovements,0.56 FordChallenge,0.8895781637717122 HandMovementDirection,0.32432432432432434 Handwriting,0.5870588235294117 @@ -34,34 +41,83 @@ Heartbeat,0.6780487804878049 HouseholdPowerConsumption1_disc,0.8425655976676385 HouseholdPowerConsumption2_disc,0.7332361516034985 IEEEPPG_disc,0.37349397590361444 +IRDS-EFL,0.6153846153846154 +IRDS-EFR,0.6666666666666666 +IRDS-SAL,0.7142857142857143 +IRDS-SAR,0.12121212121212122 +IRDS-SFE,0.6666666666666666 IRDS-SFL,0.5086206896551724 +IRDS-SFR,0.8666666666666667 +IRDS-STL,0.7631578947368421 +IRDS-STR,0.8166666666666667 +ImaginedFeetHands,0.6537467700258398 +ImaginedOpenCloseFist,0.6851851851851852 +InnerSpeech,0.315 JapaneseVowels,0.7864864864864864 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.8 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.6428571428571429 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,0.42857142857142855 +KIMORE-LT-C,0.42857142857142855 KIMORE-PR-C,0.2857142857142857 +KIMORE-Sq-C,0.2857142857142857 +KIMORE-TR-C,0.14285714285714285 +KINECAL-3WFV,0.9166666666666666 +KINECAL-GGFV,0.9230769230769231 +KINECAL-QSEC,0.9444444444444444 KINECAL-QSEO,0.9411764705882353 LSST,0.559610705596107 Libras,0.8777777777777778 +LiveFuelMoistureContent_disc,0.7920529801324503 Locust2022,0.8926947559866626 +LongIntervalTask,0.6794642857142857 LowCost,0.6516666666666666 +MatchingPennies,0.5428571428571428 MindReading,0.5038284839203675 MotionSenseHAR,1.0 MotorImagery,0.52 NATOPS,0.8944444444444445 +NewsHeadlineSentiment_disc,0.5284357340387159 +NewsTitleSentiment_disc,0.6209771151456855 +OpenCloseFist,0.647089947089947 +Opportunity,0.7745098039215687 PEMS-SF,1.0 PenDigits,0.8847913093196113 PhonemeSpectra,0.2496271995228154 PhotoStimulation,0.3888888888888889 +PronouncedSpeech,0.295 RacketSports,0.8355263157894737 +SPHERE-WUS,0.75 STEW,0.7063692480359147 SelfRegulationSCP1,0.8191126279863481 +SelfRegulationSCP2,0.5388888888888889 +ShortIntervalTask,0.5776785714285714 +SitStand,0.3503125 Skoda,0.9204103289706402 +SongFamiliarity,0.5306666666666666 SpokenArabicDigits,0.9195088676671214 StandWalkJump,0.4 TactileTextureRecognition,0.9985315712187959 Tiselac,0.6379170879676441 +UCDHE-MP,0.8149171270718232 +UCDHE-MP-MC,0.6243093922651933 +UCDHE-Rowing,0.775 UCDHE-Rowing-MC,0.5704545454545454 UCIActivity,0.9546022490628905 UIPRMD-DS-C,0.8888888888888888 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.6666666666666666 +UIPRMD-SASLR-C,0.9 +UIPRMD-SL-C,0.8888888888888888 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.9444444444444444 +UIPRMD-SSIER-C,0.85 +UIPRMD-SSS-C,0.8333333333333334 +UIPRMD-STS-C,0.9444444444444444 USCActivity,0.5808778857837181 UWaveGestureLibrary,0.934375 +VisualSpeech,0.31 WISDM,0.79582769943983 diff --git a/results/multiverse/TDE/TDE_auroc.csv b/results/multiverse/TDE/TDE_auroc.csv index c419ea9..5eefc68 100644 --- a/results/multiverse/TDE/TDE_auroc.csv +++ b/results/multiverse/TDE/TDE_auroc.csv @@ -3,18 +3,22 @@ Alzheimers,0.5018068364073777 AppliancesEnergy_disc,0.7977941176470589 ArticularyWordRecognition,0.9980787037037037 AsphaltObstaclesCoordinates,0.9526441031567158 +AsphaltPavementTypeCoordinates,0.9613374274931251 AsphaltRegularityCoordinates,0.9883982407604455 AtrialFibrillation,0.46666666666666673 AustraliaRainfall_disc,0.8074947826097345 AutomotiveRoadTrials,0.8729582577132485 BIDMC32HR_disc,0.847983903015853 +BIDMC32RR_disc,0.4325255719662449 BIDMC32SpO2_disc,0.541132976345275 +BasicMotions,1.0 BeijingPM10Quality_disc,0.8016512488966836 BeijingPM25Quality_disc,0.8441554974051886 BenzeneConcentration_disc,0.637155675596462 Blink,1.0 BoneIntensitiesAgeGroup,0.9219611624684074 BoneProbAgeGroup,0.8248041256695395 +ButtonPress,1.0 CharacterTrajectories,0.9990847137927679 CounterMovementJump,0.9582394410278078 Cricket,1.0 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.773479180057899 EyesOpenShut,0.3424036281179138 FaceDetection,0.6152380111858236 +FeedbackButton,0.5135001890359169 +FeetHands,0.659924677561506 +FingerMovements,0.5598239295718287 FordChallenge,0.9440600124976801 HandMovementDirection,0.5965893474368051 Handwriting,0.9088027412013711 @@ -34,34 +41,83 @@ Heartbeat,0.5733760075865338 HouseholdPowerConsumption1_disc,0.8650795508144474 HouseholdPowerConsumption2_disc,0.7637620888440488 IEEEPPG_disc,0.7913161281688964 +IRDS-EFL,0.9047619047619047 +IRDS-EFR,0.35000000000000003 +IRDS-SAL,0.49744897959183676 +IRDS-SAR,0.7241379310344828 +IRDS-SFE,0.87 IRDS-SFL,0.865715579710145 +IRDS-SFR,0.24999999999999997 +IRDS-STL,0.33164983164983164 +IRDS-STR,0.3272727272727273 +ImaginedFeetHands,0.7101647764663653 +ImaginedOpenCloseFist,0.7565765309778909 +InnerSpeech,0.5636717517088572 JapaneseVowels,0.9779587945076654 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9237637362637363 +KERAAL-ELK,0.375 +KERAAL-ELK-MC,0.9230769230769231 KERAAL-RTK,0.875 +KERAAL-RTK-MC,0.2724358974358974 +KIMORE-LA-C,0.41666666666666663 +KIMORE-LT-C,0.8333333333333333 KIMORE-PR-C,0.6666666666666667 +KIMORE-Sq-C,0.7 +KIMORE-TR-C,0.4166666666666667 +KINECAL-3WFV,0.7727272727272727 +KINECAL-GGFV,0.8333333333333333 +KINECAL-QSEC,0.47058823529411764 KINECAL-QSEO,0.375 LSST,0.8433084741204105 Libras,0.9929232804232805 +LiveFuelMoistureContent_disc,0.5001771653543308 Locust2022,0.7924094927323962 +LongIntervalTask,0.6794170321637426 LowCost,0.7171 +MatchingPennies,0.5734962774294671 MindReading,0.840154100613787 MotionSenseHAR,1.0 MotorImagery,0.588 NATOPS,0.9777777777777777 +NewsHeadlineSentiment_disc,0.5048071459346801 +NewsTitleSentiment_disc,0.5093050073316941 +OpenCloseFist,0.7166873454688788 +Opportunity,0.9213182853141815 PEMS-SF,1.0 PenDigits,0.9875063182374243 PhonemeSpectra,0.8266142054522128 PhotoStimulation,0.5783821733821735 +PronouncedSpeech,0.5400253739096021 RacketSports,0.957631859177761 +SPHERE-WUS,1.0 STEW,0.7749237606139964 SelfRegulationSCP1,0.9258456807380486 +SelfRegulationSCP2,0.5459259259259259 +ShortIntervalTask,0.5386996527777778 +SitStand,0.6365046223958334 Skoda,0.9952000827469243 +SongFamiliarity,0.5187390069002842 SpokenArabicDigits,0.9933580427386813 StandWalkJump,0.5 TactileTextureRecognition,1.0 Tiselac,0.8807714398090422 +UCDHE-MP,0.8054198473282441 +UCDHE-MP-MC,0.872707188658203 +UCDHE-Rowing,0.7302539682539683 UCDHE-Rowing-MC,0.8429249759690937 UCIActivity,0.9969469318409124 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.7654320987654322 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.9753086419753086 +UIPRMD-SSIER-C,0.9800000000000001 +UIPRMD-SSS-C,0.9753086419753086 +UIPRMD-STS-C,0.9537037037037037 USCActivity,0.9364043932806045 UWaveGestureLibrary,0.9973158482142856 +VisualSpeech,0.49694584130244573 WISDM,0.9771380742801788 diff --git a/results/multiverse/TDE/TDE_balacc.csv b/results/multiverse/TDE/TDE_balacc.csv index b6e682d..5a2276d 100644 --- a/results/multiverse/TDE/TDE_balacc.csv +++ b/results/multiverse/TDE/TDE_balacc.csv @@ -3,18 +3,22 @@ Alzheimers,0.3066378066378066 AppliancesEnergy_disc,0.6102941176470589 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.832030184791375 +AsphaltPavementTypeCoordinates,0.8234737076648843 AsphaltRegularityCoordinates,0.9508583386536142 AtrialFibrillation,0.26666666666666666 AustraliaRainfall_disc,0.2991711989289402 AutomotiveRoadTrials,0.7118874773139746 BIDMC32HR_disc,0.6041218136945544 +BIDMC32RR_disc,0.31982749943867633 BIDMC32SpO2_disc,0.5060365452019918 +BasicMotions,1.0 BeijingPM10Quality_disc,0.5648411797746369 BeijingPM25Quality_disc,0.6156851187406178 BenzeneConcentration_disc,0.5012484394506866 Blink,1.0 BoneIntensitiesAgeGroup,0.8220324758620844 BoneProbAgeGroup,0.7037366805169283 +ButtonPress,0.9925373134328358 CharacterTrajectories,0.9767004025966969 CounterMovementJump,0.8099811676082863 Cricket,0.9722222222222223 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.5441142191142191 EyesOpenShut,0.40476190476190477 FaceDetection,0.5805902383654937 +FeedbackButton,0.5 +FeetHands,0.615598553576248 +FingerMovements,0.5622248899559824 FordChallenge,0.8666261920526505 HandMovementDirection,0.31190476190476185 Handwriting,0.5765194386690186 @@ -34,34 +41,83 @@ Heartbeat,0.4857752489331437 HouseholdPowerConsumption1_disc,0.553471989243409 HouseholdPowerConsumption2_disc,0.48874590655412575 IEEEPPG_disc,0.43238512659785727 +IRDS-EFL,0.5833333333333334 +IRDS-EFR,0.5 +IRDS-SAL,0.5 +IRDS-SAR,0.5 +IRDS-SFE,0.5 IRDS-SFL,0.6440217391304348 +IRDS-SFR,0.5 +IRDS-STL,0.6178451178451179 +IRDS-STR,0.5363636363636364 +ImaginedFeetHands,0.653748814173511 +ImaginedOpenCloseFist,0.6852313039739133 +InnerSpeech,0.32094007815892317 JapaneseVowels,0.7547049471354255 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.6666666666666666 +KERAAL-ELK,0.5 +KERAAL-ELK-MC,0.5 KERAAL-RTK,0.6875 +KERAAL-RTK-MC,0.3333333333333333 +KIMORE-LA-C,0.5 +KIMORE-LT-C,0.5 KIMORE-PR-C,0.5833333333333334 +KIMORE-Sq-C,0.5 +KIMORE-TR-C,0.5 +KINECAL-3WFV,0.5 +KINECAL-GGFV,0.5 +KINECAL-QSEC,0.5 KINECAL-QSEO,0.5 LSST,0.2939139442468128 Libras,0.8777777777777775 +LiveFuelMoistureContent_disc,0.5012795275590551 Locust2022,0.6269270333054029 +LongIntervalTask,0.568640350877193 LowCost,0.6516666666666666 +MatchingPennies,0.5439524555903866 MindReading,0.48981877678223606 MotionSenseHAR,1.0 MotorImagery,0.52 NATOPS,0.8944444444444445 +NewsHeadlineSentiment_disc,0.33515466996776905 +NewsTitleSentiment_disc,0.3337390393049679 +OpenCloseFist,0.6470957107535744 +Opportunity,0.7616705536054259 PEMS-SF,1.0 PenDigits,0.8848021308180737 PhonemeSpectra,0.24968606404994917 PhotoStimulation,0.3111111111111111 +PronouncedSpeech,0.29519968522526063 RacketSports,0.8502906976744187 +SPHERE-WUS,0.75 STEW,0.7063692480359147 SelfRegulationSCP1,0.8195415152362315 +SelfRegulationSCP2,0.5388888888888889 +ShortIntervalTask,0.4909722222222222 +SitStand,0.35031249999999997 Skoda,0.9120942331520815 +SongFamiliarity,0.5230329917609611 SpokenArabicDigits,0.9195205479452054 StandWalkJump,0.4000000000000001 TactileTextureRecognition,0.9982363315696648 Tiselac,0.4714800586271588 +UCDHE-MP,0.7701145038167939 +UCDHE-MP-MC,0.6234299516908213 +UCDHE-Rowing,0.6109523809523809 UCDHE-Rowing-MC,0.5843095238095237 UCIActivity,0.9559484189750713 UIPRMD-DS-C,0.8888888888888888 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.6666666666666666 +UIPRMD-SASLR-C,0.9 +UIPRMD-SL-C,0.8888888888888888 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.9444444444444444 +UIPRMD-SSIER-C,0.8500000000000001 +UIPRMD-SSS-C,0.8333333333333333 +UIPRMD-STS-C,0.9444444444444444 USCActivity,0.5765274177228356 UWaveGestureLibrary,0.934375 +VisualSpeech,0.30593439298796443 WISDM,0.43332017717915633 diff --git a/results/multiverse/TDE/TDE_f1.csv b/results/multiverse/TDE/TDE_f1.csv index 7b5f385..c64e168 100644 --- a/results/multiverse/TDE/TDE_f1.csv +++ b/results/multiverse/TDE/TDE_f1.csv @@ -3,18 +3,22 @@ Alzheimers,0.30948769801145937 AppliancesEnergy_disc,0.36363636363636365 ArticularyWordRecognition,0.9933217391304349 AsphaltObstaclesCoordinates,0.82649385626469 +AsphaltPavementTypeCoordinates,0.8416060112588668 AsphaltRegularityCoordinates,0.9504685408299867 AtrialFibrillation,0.2644688644688645 AustraliaRainfall_disc,0.6478285217426618 AutomotiveRoadTrials,0.5641025641025641 BIDMC32HR_disc,0.6399175900096182 +BIDMC32RR_disc,0.6815364682288824 BIDMC32SpO2_disc,0.24062772449869224 +BasicMotions,1.0 BeijingPM10Quality_disc,0.26144511858797576 BeijingPM25Quality_disc,0.38832997987927564 BenzeneConcentration_disc,0.0049813200498132005 Blink,1.0 BoneIntensitiesAgeGroup,0.8050227470590233 BoneProbAgeGroup,0.7051038181746355 +ButtonPress,0.9906542056074766 CharacterTrajectories,0.9783698682707233 CounterMovementJump,0.8135739167314743 Cricket,0.9720279720279721 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.5485443769428828 EyesOpenShut,0.5098039215686274 FaceDetection,0.6046013911182451 +FeedbackButton,0.5147679324894515 +FeetHands,0.624677336086732 +FingerMovements,0.6 FordChallenge,0.8407238019486976 HandMovementDirection,0.32263303441484015 Handwriting,0.5671465016722921 @@ -34,34 +41,83 @@ Heartbeat,0.08333333333333333 HouseholdPowerConsumption1_disc,0.8142840137575994 HouseholdPowerConsumption2_disc,0.7040899609763706 IEEEPPG_disc,0.3190208196438456 +IRDS-EFL,0.2857142857142857 +IRDS-EFR,0.0 +IRDS-SAL,0.1111111111111111 +IRDS-SAR,0.21621621621621623 +IRDS-SFE,0.0 IRDS-SFL,0.42424242424242425 +IRDS-SFR,0.0 +IRDS-STL,0.4 +IRDS-STR,0.15384615384615385 +ImaginedFeetHands,0.654994850669413 +ImaginedOpenCloseFist,0.6981227803145611 +InnerSpeech,0.26638697715328147 JapaneseVowels,0.7584473687994555 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.8956043956043956 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.8941798941798941 KERAAL-RTK,0.7058823529411765 +KERAAL-RTK-MC,0.21367521367521367 +KIMORE-LA-C,0.6 +KIMORE-LT-C,0.6 KIMORE-PR-C,0.2857142857142857 +KIMORE-Sq-C,0.4444444444444444 +KIMORE-TR-C,0.25 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.49288274157464523 Libras,0.8759781388766896 +LiveFuelMoistureContent_disc,0.10285714285714286 Locust2022,0.33458646616541354 +LongIntervalTask,0.3412844036697248 LowCost,0.6499162479061976 +MatchingPennies,0.6153846153846154 MindReading,0.46691394359919436 MotionSenseHAR,1.0 MotorImagery,0.5555555555555556 NATOPS,0.8943316661005514 +NewsHeadlineSentiment_disc,0.4167589606177531 +NewsTitleSentiment_disc,0.48268552221684635 +OpenCloseFist,0.6487625065824117 +Opportunity,0.773574150379103 PEMS-SF,1.0 PenDigits,0.884181517464376 PhonemeSpectra,0.23874020317394176 PhotoStimulation,0.24305555555555555 +PronouncedSpeech,0.2921509819125798 RacketSports,0.8335474101921471 +SPHERE-WUS,0.6666666666666666 STEW,0.7216385157600744 SelfRegulationSCP1,0.8389057750759878 +SelfRegulationSCP2,0.5257142857142857 +ShortIntervalTask,0.24077046548956663 +SitStand,0.3483353931991189 Skoda,0.921771233546782 +SongFamiliarity,0.3951890034364261 SpokenArabicDigits,0.9181939983167722 StandWalkJump,0.3945868945868946 TactileTextureRecognition,0.9985305990713076 Tiselac,0.6179141273203642 +UCDHE-MP,0.6666666666666666 +UCDHE-MP-MC,0.6214040866298776 +UCDHE-Rowing,0.37735849056603776 UCDHE-Rowing-MC,0.5632377464073778 UCIActivity,0.9537560314714917 UIPRMD-DS-C,0.9 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.75 +UIPRMD-SASLR-C,0.9090909090909091 +UIPRMD-SL-C,0.9 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.9473684210526315 +UIPRMD-SSIER-C,0.8421052631578947 +UIPRMD-SSS-C,0.8 +UIPRMD-STS-C,0.9473684210526315 USCActivity,0.5694408758179401 UWaveGestureLibrary,0.9339671545719854 +VisualSpeech,0.2956702081290182 WISDM,0.7459741780182929 diff --git a/results/multiverse/TDE/TDE_logloss.csv b/results/multiverse/TDE/TDE_logloss.csv index 7bb82d4..7e2abe6 100644 --- a/results/multiverse/TDE/TDE_logloss.csv +++ b/results/multiverse/TDE/TDE_logloss.csv @@ -3,18 +3,22 @@ Alzheimers,1.1131883015011201 AppliancesEnergy_disc,0.43704844018455064 ArticularyWordRecognition,0.2333438321835187 AsphaltObstaclesCoordinates,0.6077927802512004 +AsphaltPavementTypeCoordinates,0.3832621238348583 AsphaltRegularityCoordinates,0.21716136144703443 AtrialFibrillation,1.3312925953981747 AustraliaRainfall_disc,0.8103772152333866 AutomotiveRoadTrials,0.3562666561835708 BIDMC32HR_disc,0.5445802324380543 +BIDMC32RR_disc,2.8606151290865967 BIDMC32SpO2_disc,0.7849511334443995 +BasicMotions,0.015165499380536868 BeijingPM10Quality_disc,0.5619254372183746 BeijingPM25Quality_disc,0.504338432707193 BenzeneConcentration_disc,0.6203868374398013 Blink,0.06776110185980896 BoneIntensitiesAgeGroup,0.5298596594290861 BoneProbAgeGroup,0.8330541776320838 +ButtonPress,0.06703042208939358 CharacterTrajectories,0.1348716661369831 CounterMovementJump,0.4983784623292176 Cricket,0.1577838778892225 @@ -27,6 +31,9 @@ Epilepsy,0.02164992752832147 EthanolConcentration,2.1056064191698316 EyesOpenShut,0.7922451269645744 FaceDetection,0.6720730920356996 +FeedbackButton,0.7074623232004911 +FeetHands,0.6618663391351747 +FingerMovements,0.7382305054609196 FordChallenge,0.35991962004055034 HandMovementDirection,1.3702171870649544 Handwriting,4.062786071015923 @@ -34,34 +41,83 @@ Heartbeat,0.6102458410170916 HouseholdPowerConsumption1_disc,0.5327999818108758 HouseholdPowerConsumption2_disc,1.0545344205496938 IEEEPPG_disc,1.2254146558805012 +IRDS-EFL,1.9804275771169086 +IRDS-EFR,7.698533989888322 +IRDS-SAL,1.2179106402136577 +IRDS-SAR,18.84150367438236 +IRDS-SFE,1.0713932638222028 IRDS-SFL,1.2803752529121857 +IRDS-SFR,2.7850523444292246 +IRDS-STL,5.1986641948909655 +IRDS-STR,0.5412037684226971 +ImaginedFeetHands,0.6661913766788558 +ImaginedOpenCloseFist,0.5854966903034627 +InnerSpeech,1.398705353331617 JapaneseVowels,0.9158057411938708 +KERAAL-CTK,0.19299321382254367 +KERAAL-CTK-MC,2.784464493242822 +KERAAL-ELK,0.5706403633214222 +KERAAL-ELK-MC,0.357689952555705 KERAAL-RTK,0.6108322027016309 +KERAAL-RTK-MC,9.433461434834596 +KIMORE-LA-C,11.182153709520836 +KIMORE-LT-C,0.9422452371259523 KIMORE-PR-C,1.0843323143065653 +KIMORE-Sq-C,1.4918304460810723 +KIMORE-TR-C,16.619950147656024 +KINECAL-3WFV,0.28711706014821164 +KINECAL-GGFV,0.24564138320532403 +KINECAL-QSEC,2.0036399905527302 KINECAL-QSEO,2.124904171302287 LSST,2.4673901972031707 Libras,0.5923186589275115 +LiveFuelMoistureContent_disc,0.7259777350596862 Locust2022,0.9347328266712672 +LongIntervalTask,0.6551203432410125 LowCost,0.6166252623356945 +MatchingPennies,0.7054685558803172 MindReading,1.2681533513576895 MotionSenseHAR,0.028517351834474673 MotorImagery,0.7073615352444557 NATOPS,0.31325620112061425 +NewsHeadlineSentiment_disc,1.0472381209234547 +NewsTitleSentiment_disc,0.9495064794303931 +OpenCloseFist,0.616737949447184 +Opportunity,0.8514140090718617 PEMS-SF,0.007212459701890063 PenDigits,0.6939331589120361 PhonemeSpectra,6.517339029931114 PhotoStimulation,1.1283870794760338 +PronouncedSpeech,1.4194367600533044 RacketSports,0.41070629899733835 +SPHERE-WUS,0.42691996679814936 STEW,0.5864372029017902 SelfRegulationSCP1,0.5171146591886021 +SelfRegulationSCP2,0.7167445390922748 +ShortIntervalTask,0.9689007611953299 +SitStand,1.9739102229379102 Skoda,0.1875074463467951 +SongFamiliarity,0.7139535650340559 SpokenArabicDigits,0.4570068697595056 StandWalkJump,1.1342721809601788 TactileTextureRecognition,0.009182027684064802 Tiselac,2.3455434427386246 +UCDHE-MP,0.4774221628126901 +UCDHE-MP-MC,0.9983866722836611 +UCDHE-Rowing,0.4613156061998423 UCDHE-Rowing-MC,1.2487241911724993 UCIActivity,0.23102070354918536 UIPRMD-DS-C,0.1941595554944404 +UIPRMD-HS-C,0.032109004523742955 +UIPRMD-IL-C,0.5716875083172243 +UIPRMD-SASLR-C,0.1912544736080809 +UIPRMD-SL-C,0.36045458001174563 +UIPRMD-SSA-C,0.058552621434618576 +UIPRMD-SSE-C,0.28696155097249637 +UIPRMD-SSIER-C,0.231245743239056 +UIPRMD-SSS-C,0.36229746446256744 +UIPRMD-STS-C,0.2349077093293859 USCActivity,1.2473973626067083 UWaveGestureLibrary,0.34179386795310895 +VisualSpeech,1.4417260538329482 WISDM,0.6539832593371383 diff --git a/results/multiverse/TDE/TDE_sensitivity.csv b/results/multiverse/TDE/TDE_sensitivity.csv index 8121f01..9f4a03b 100644 --- a/results/multiverse/TDE/TDE_sensitivity.csv +++ b/results/multiverse/TDE/TDE_sensitivity.csv @@ -3,18 +3,22 @@ Alzheimers,0.3488372093023256 AppliancesEnergy_disc,0.25 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8286445012787724 +AsphaltPavementTypeCoordinates,0.8418560606060606 AsphaltRegularityCoordinates,0.9594594594594594 AtrialFibrillation,0.26666666666666666 AustraliaRainfall_disc,0.7201389322185479 AutomotiveRoadTrials,0.5789473684210527 BIDMC32HR_disc,0.704460191746561 +BIDMC32RR_disc,0.7407253022092538 BIDMC32SpO2_disc,0.2020497803806735 +BasicMotions,1.0 BeijingPM10Quality_disc,0.16255144032921812 BeijingPM25Quality_disc,0.2529488859764089 BenzeneConcentration_disc,0.0024968789013732834 Blink,1.0 BoneIntensitiesAgeGroup,0.8067415730337079 BoneProbAgeGroup,0.7033707865168539 +ButtonPress,1.0 CharacterTrajectories,0.9784122562674095 CounterMovementJump,0.8100558659217877 Cricket,0.9722222222222222 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.5437262357414449 EyesOpenShut,0.6190476190476191 FaceDetection,0.641316685584563 +FeedbackButton,0.5304347826086957 +FeetHands,0.6456776947705443 +FingerMovements,0.673469387755102 FordChallenge,0.7735089645078668 HandMovementDirection,0.32432432432432434 Handwriting,0.5870588235294117 @@ -34,34 +41,83 @@ Heartbeat,0.05263157894736842 HouseholdPowerConsumption1_disc,0.8425655976676385 HouseholdPowerConsumption2_disc,0.7332361516034985 IEEEPPG_disc,0.37349397590361444 +IRDS-EFL,0.16666666666666666 +IRDS-EFR,0.0 +IRDS-SAL,0.07142857142857142 +IRDS-SAR,1.0 +IRDS-SFE,0.0 IRDS-SFL,0.875 +IRDS-SFR,0.0 +IRDS-STL,0.2727272727272727 +IRDS-STR,0.2 +ImaginedFeetHands,0.6577042399172699 +ImaginedOpenCloseFist,0.7288135593220338 +InnerSpeech,0.315 JapaneseVowels,0.7864864864864864 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,0.0 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,1.0 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,1.0 +KIMORE-LT-C,1.0 KIMORE-PR-C,1.0 +KIMORE-Sq-C,1.0 +KIMORE-TR-C,1.0 +KINECAL-3WFV,0.0 +KINECAL-GGFV,0.0 +KINECAL-QSEC,0.0 KINECAL-QSEO,0.0 LSST,0.559610705596107 Libras,0.8777777777777778 +LiveFuelMoistureContent_disc,0.075 Locust2022,0.3037542662116041 +LongIntervalTask,0.25833333333333336 LowCost,0.6466666666666666 +MatchingPennies,0.735632183908046 MindReading,0.5038284839203675 MotionSenseHAR,1.0 MotorImagery,0.6 NATOPS,0.8944444444444445 +NewsHeadlineSentiment_disc,0.5284357340387159 +NewsTitleSentiment_disc,0.6209771151456855 +OpenCloseFist,0.652542372881356 +Opportunity,0.7745098039215687 PEMS-SF,1.0 PenDigits,0.8847913093196113 PhonemeSpectra,0.2496271995228154 PhotoStimulation,0.3888888888888889 +PronouncedSpeech,0.295 RacketSports,0.8355263157894737 +SPHERE-WUS,0.5 STEW,0.7612233445566778 SelfRegulationSCP1,0.9452054794520548 +SelfRegulationSCP2,0.5111111111111111 +ShortIntervalTask,0.1875 +SitStand,0.3503125 Skoda,0.9204103289706402 +SongFamiliarity,0.3185595567867036 SpokenArabicDigits,0.9195088676671214 StandWalkJump,0.4 TactileTextureRecognition,0.9985315712187959 Tiselac,0.6379170879676441 +UCDHE-MP,0.67 +UCDHE-MP-MC,0.6243093922651933 +UCDHE-Rowing,0.3333333333333333 UCDHE-Rowing-MC,0.5704545454545454 UCIActivity,0.9546022490628905 UIPRMD-DS-C,1.0 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,1.0 +UIPRMD-SASLR-C,1.0 +UIPRMD-SL-C,1.0 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,1.0 +UIPRMD-SSIER-C,0.8 +UIPRMD-SSS-C,0.6666666666666666 +UIPRMD-STS-C,1.0 USCActivity,0.5808778857837181 UWaveGestureLibrary,0.934375 +VisualSpeech,0.31 WISDM,0.79582769943983 diff --git a/results/multiverse/TDE/TDE_specificity.csv b/results/multiverse/TDE/TDE_specificity.csv index ceb0314..5139bef 100644 --- a/results/multiverse/TDE/TDE_specificity.csv +++ b/results/multiverse/TDE/TDE_specificity.csv @@ -3,18 +3,22 @@ Alzheimers,0.3488372093023256 AppliancesEnergy_disc,0.9705882352941176 ArticularyWordRecognition,0.9933333333333333 AsphaltObstaclesCoordinates,0.8286445012787724 +AsphaltPavementTypeCoordinates,0.8418560606060606 AsphaltRegularityCoordinates,0.9422572178477691 AtrialFibrillation,0.26666666666666666 AustraliaRainfall_disc,0.7201389322185479 AutomotiveRoadTrials,0.8448275862068966 BIDMC32HR_disc,0.704460191746561 +BIDMC32RR_disc,0.7407253022092538 BIDMC32SpO2_disc,0.8100233100233101 +BasicMotions,1.0 BeijingPM10Quality_disc,0.9671309192200557 BeijingPM25Quality_disc,0.9784213515048268 BenzeneConcentration_disc,1.0 Blink,1.0 BoneIntensitiesAgeGroup,0.8067415730337079 BoneProbAgeGroup,0.7033707865168539 +ButtonPress,0.9850746268656716 CharacterTrajectories,0.9784122562674095 CounterMovementJump,0.8100558659217877 Cricket,0.9722222222222222 @@ -27,6 +31,9 @@ Epilepsy,1.0 EthanolConcentration,0.5437262357414449 EyesOpenShut,0.19047619047619047 FaceDetection,0.5198637911464246 +FeedbackButton,0.46956521739130436 +FeetHands,0.5855194123819517 +FingerMovements,0.45098039215686275 FordChallenge,0.9597434195974341 HandMovementDirection,0.32432432432432434 Handwriting,0.5870588235294117 @@ -34,34 +41,83 @@ Heartbeat,0.918918918918919 HouseholdPowerConsumption1_disc,0.8425655976676385 HouseholdPowerConsumption2_disc,0.7332361516034985 IEEEPPG_disc,0.37349397590361444 +IRDS-EFL,1.0 +IRDS-EFR,1.0 +IRDS-SAL,0.9285714285714286 +IRDS-SAR,0.0 +IRDS-SFE,1.0 IRDS-SFL,0.41304347826086957 +IRDS-SFR,1.0 +IRDS-STL,0.9629629629629629 +IRDS-STR,0.8727272727272727 +ImaginedFeetHands,0.6497933884297521 +ImaginedOpenCloseFist,0.6416490486257929 +InnerSpeech,0.315 JapaneseVowels,0.7864864864864864 +KERAAL-CTK,1.0 +KERAAL-CTK-MC,0.9285714285714286 +KERAAL-ELK,1.0 +KERAAL-ELK-MC,0.9285714285714286 KERAAL-RTK,0.375 +KERAAL-RTK-MC,0.38461538461538464 +KIMORE-LA-C,0.0 +KIMORE-LT-C,0.0 KIMORE-PR-C,0.16666666666666666 +KIMORE-Sq-C,0.0 +KIMORE-TR-C,0.0 +KINECAL-3WFV,1.0 +KINECAL-GGFV,1.0 +KINECAL-QSEC,1.0 KINECAL-QSEO,1.0 LSST,0.559610705596107 Libras,0.8777777777777778 +LiveFuelMoistureContent_disc,0.9275590551181102 Locust2022,0.9500998003992016 +LongIntervalTask,0.8789473684210526 LowCost,0.6566666666666666 +MatchingPennies,0.3522727272727273 MindReading,0.5038284839203675 MotionSenseHAR,1.0 MotorImagery,0.44 NATOPS,0.8944444444444445 +NewsHeadlineSentiment_disc,0.5284357340387159 +NewsTitleSentiment_disc,0.6209771151456855 +OpenCloseFist,0.6416490486257929 +Opportunity,0.7745098039215687 PEMS-SF,1.0 PenDigits,0.8847913093196113 PhonemeSpectra,0.2496271995228154 PhotoStimulation,0.3888888888888889 +PronouncedSpeech,0.295 RacketSports,0.8355263157894737 +SPHERE-WUS,1.0 STEW,0.6515151515151515 SelfRegulationSCP1,0.6938775510204082 +SelfRegulationSCP2,0.5666666666666667 +ShortIntervalTask,0.7944444444444444 +SitStand,0.3503125 Skoda,0.9204103289706402 +SongFamiliarity,0.7275064267352185 SpokenArabicDigits,0.9195088676671214 StandWalkJump,0.4 TactileTextureRecognition,0.9985315712187959 Tiselac,0.6379170879676441 +UCDHE-MP,0.8702290076335878 +UCDHE-MP-MC,0.6243093922651933 +UCDHE-Rowing,0.8885714285714286 UCDHE-Rowing-MC,0.5704545454545454 UCIActivity,0.9546022490628905 UIPRMD-DS-C,0.7777777777777778 +UIPRMD-HS-C,1.0 +UIPRMD-IL-C,0.3333333333333333 +UIPRMD-SASLR-C,0.8 +UIPRMD-SL-C,0.7777777777777778 +UIPRMD-SSA-C,1.0 +UIPRMD-SSE-C,0.8888888888888888 +UIPRMD-SSIER-C,0.9 +UIPRMD-SSS-C,1.0 +UIPRMD-STS-C,0.8888888888888888 USCActivity,0.5808778857837181 UWaveGestureLibrary,0.934375 +VisualSpeech,0.31 WISDM,0.79582769943983 diff --git a/results/multiverse/TimesNet/TimesNet_accuracy.csv b/results/multiverse/TimesNet/TimesNet_accuracy.csv index 862ee6d..2381b62 100644 --- a/results/multiverse/TimesNet/TimesNet_accuracy.csv +++ b/results/multiverse/TimesNet/TimesNet_accuracy.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.7796634845365114 AutomotiveRoadTrials,0.7792207792207793 BIDMC32HR_disc,0.5839933305543976 BIDMC32SpO2_disc,0.7061275531471446 +BasicMotions,0.6 BeijingPM10Quality_disc,0.8181458003169572 BeijingPM25Quality_disc,0.8645007923930269 BenzeneConcentration_disc,0.9213635483246174 @@ -27,6 +28,7 @@ Epilepsy,0.8985507246376812 EthanolConcentration,0.2965779467680608 EyesOpenShut,0.5952380952380952 FaceDetection,0.6535187287173666 +FingerMovements,0.53 FordChallenge,0.8897160187482768 HandMovementDirection,0.5675675675675675 Handwriting,0.17411764705882352 @@ -54,6 +56,7 @@ PhotoStimulation,0.3888888888888889 RacketSports,0.8355263157894737 STEW,0.7365319865319865 SelfRegulationSCP1,0.8191126279863481 +SelfRegulationSCP2,0.5722222222222222 Skoda,0.9267775026529891 SpokenArabicDigits,0.9813551614370168 StandWalkJump,0.26666666666666666 diff --git a/results/multiverse/TimesNet/TimesNet_auroc.csv b/results/multiverse/TimesNet/TimesNet_auroc.csv index f18d76e..ac0491c 100644 --- a/results/multiverse/TimesNet/TimesNet_auroc.csv +++ b/results/multiverse/TimesNet/TimesNet_auroc.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.8625349241770757 AutomotiveRoadTrials,0.8312159709618875 BIDMC32HR_disc,0.6773794380553011 BIDMC32SpO2_disc,0.4833702778431914 +BasicMotions,0.8516666666666666 BeijingPM10Quality_disc,0.8749904474783253 BeijingPM25Quality_disc,0.9309040794318134 BenzeneConcentration_disc,0.9749213020371545 @@ -27,6 +28,7 @@ Epilepsy,0.9862550380827751 EthanolConcentration,0.5745624783473889 EyesOpenShut,0.7165532879818594 FaceDetection,0.6969903795733101 +FingerMovements,0.5378151260504201 FordChallenge,0.9407409080023597 HandMovementDirection,0.7984681908410722 Handwriting,0.6858361166766375 @@ -54,6 +56,7 @@ PhotoStimulation,0.4712067562067562 RacketSports,0.9445903678347245 STEW,0.8172149305122556 SelfRegulationSCP1,0.953499207902339 +SelfRegulationSCP2,0.5681481481481482 Skoda,0.9935043476694889 SpokenArabicDigits,0.9997081716255138 StandWalkJump,0.5199999999999999 diff --git a/results/multiverse/TimesNet/TimesNet_balacc.csv b/results/multiverse/TimesNet/TimesNet_balacc.csv index afc5185..6e6d20e 100644 --- a/results/multiverse/TimesNet/TimesNet_balacc.csv +++ b/results/multiverse/TimesNet/TimesNet_balacc.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.4140487445355887 AutomotiveRoadTrials,0.588021778584392 BIDMC32HR_disc,0.4709239620965495 BIDMC32SpO2_disc,0.538099345749419 +BasicMotions,0.6 BeijingPM10Quality_disc,0.7747954805109453 BeijingPM25Quality_disc,0.8457038067403321 BenzeneConcentration_disc,0.8871910848591745 @@ -27,6 +28,7 @@ Epilepsy,0.8982511923688394 EthanolConcentration,0.29545454545454547 EyesOpenShut,0.5952380952380952 FaceDetection,0.6535187287173667 +FingerMovements,0.530812324929972 FordChallenge,0.8783134492990511 HandMovementDirection,0.5892857142857143 Handwriting,0.16666662298642781 @@ -54,6 +56,7 @@ PhotoStimulation,0.3111111111111111 RacketSports,0.8468023255813953 STEW,0.7365319865319866 SelfRegulationSCP1,0.8195881092162892 +SelfRegulationSCP2,0.5722222222222222 Skoda,0.9179357910721214 SpokenArabicDigits,0.9813594852635947 StandWalkJump,0.26666666666666666 diff --git a/results/multiverse/TimesNet/TimesNet_f1.csv b/results/multiverse/TimesNet/TimesNet_f1.csv index f953282..fb10169 100644 --- a/results/multiverse/TimesNet/TimesNet_f1.csv +++ b/results/multiverse/TimesNet/TimesNet_f1.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.7637884682119469 AutomotiveRoadTrials,0.32 BIDMC32HR_disc,0.5585945105904826 BIDMC32SpO2_disc,0.2227122381477398 +BasicMotions,0.518270944741533 BeijingPM10Quality_disc,0.6810284920083391 BeijingPM25Quality_disc,0.7807692307692308 BenzeneConcentration_disc,0.8628378378378379 @@ -27,6 +28,7 @@ Epilepsy,0.8924464174838986 EthanolConcentration,0.19858702091342648 EyesOpenShut,0.711864406779661 FaceDetection,0.6722147651006711 +FingerMovements,0.5436893203883495 FordChallenge,0.8504113687359761 HandMovementDirection,0.5618750618750619 Handwriting,0.1330347969490157 @@ -54,6 +56,7 @@ PhotoStimulation,0.23333333333333334 RacketSports,0.8309665853150886 STEW,0.7163141993957703 SelfRegulationSCP1,0.8408408408408409 +SelfRegulationSCP2,0.37398373983739835 Skoda,0.9265318723123889 SpokenArabicDigits,0.9814030544189566 StandWalkJump,0.2545454545454546 diff --git a/results/multiverse/TimesNet/TimesNet_logloss.csv b/results/multiverse/TimesNet/TimesNet_logloss.csv index 72e7688..51f42ed 100644 --- a/results/multiverse/TimesNet/TimesNet_logloss.csv +++ b/results/multiverse/TimesNet/TimesNet_logloss.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.5103721333391383 AutomotiveRoadTrials,0.4623138921081696 BIDMC32HR_disc,6.590572726578991 BIDMC32SpO2_disc,3.972382463186422 +BasicMotions,1.1360837924853147 BeijingPM10Quality_disc,0.5895476296760733 BeijingPM25Quality_disc,0.45336789876064526 BenzeneConcentration_disc,0.3598162728366507 @@ -27,6 +28,7 @@ Epilepsy,0.28349653897231647 EthanolConcentration,1.8423970303040027 EyesOpenShut,0.665966461485736 FaceDetection,0.7907227657391813 +FingerMovements,0.7542523291634526 FordChallenge,0.4523257742272296 HandMovementDirection,1.1498558573304878 Handwriting,3.0647765836939316 @@ -54,6 +56,7 @@ PhotoStimulation,1.3357289698174262 RacketSports,0.4435775543274873 STEW,1.29413291863661 SelfRegulationSCP1,0.3899661776899016 +SelfRegulationSCP2,0.7870403802029219 Skoda,0.2711256899608417 SpokenArabicDigits,0.09320711216230121 StandWalkJump,1.121926403618857 diff --git a/results/multiverse/TimesNet/TimesNet_sensitivity.csv b/results/multiverse/TimesNet/TimesNet_sensitivity.csv index 5214a77..3c9413b 100644 --- a/results/multiverse/TimesNet/TimesNet_sensitivity.csv +++ b/results/multiverse/TimesNet/TimesNet_sensitivity.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.7796634845365114 AutomotiveRoadTrials,0.21052631578947367 BIDMC32HR_disc,0.5839933305543976 BIDMC32SpO2_disc,0.1478770131771596 +BasicMotions,0.6 BeijingPM10Quality_disc,0.6721536351165981 BeijingPM25Quality_disc,0.7981651376146789 BenzeneConcentration_disc,0.7971285892634207 @@ -27,6 +28,7 @@ Epilepsy,0.8985507246376812 EthanolConcentration,0.2965779467680608 EyesOpenShut,1.0 FaceDetection,0.7105561861520999 +FingerMovements,0.5714285714285714 FordChallenge,0.8320526893523601 HandMovementDirection,0.5675675675675675 Handwriting,0.17411764705882352 @@ -54,6 +56,7 @@ PhotoStimulation,0.3888888888888889 RacketSports,0.8355263157894737 STEW,0.6652637485970819 SelfRegulationSCP1,0.958904109589041 +SelfRegulationSCP2,0.25555555555555554 Skoda,0.9267775026529891 SpokenArabicDigits,0.9813551614370168 StandWalkJump,0.26666666666666666 diff --git a/results/multiverse/TimesNet/TimesNet_specificity.csv b/results/multiverse/TimesNet/TimesNet_specificity.csv index 9916e61..e6a3dc0 100644 --- a/results/multiverse/TimesNet/TimesNet_specificity.csv +++ b/results/multiverse/TimesNet/TimesNet_specificity.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.7796634845365114 AutomotiveRoadTrials,0.9655172413793104 BIDMC32HR_disc,0.5839933305543976 BIDMC32SpO2_disc,0.9283216783216783 +BasicMotions,0.6 BeijingPM10Quality_disc,0.8774373259052924 BeijingPM25Quality_disc,0.8932424758659853 BenzeneConcentration_disc,0.9772535804549284 @@ -27,6 +28,7 @@ Epilepsy,0.8985507246376812 EthanolConcentration,0.2965779467680608 EyesOpenShut,0.19047619047619047 FaceDetection,0.5964812712826334 +FingerMovements,0.49019607843137253 FordChallenge,0.9245742092457421 HandMovementDirection,0.5675675675675675 Handwriting,0.17411764705882352 @@ -54,6 +56,7 @@ PhotoStimulation,0.3888888888888889 RacketSports,0.8355263157894737 STEW,0.8078002244668911 SelfRegulationSCP1,0.6802721088435374 +SelfRegulationSCP2,0.8888888888888888 Skoda,0.9267775026529891 SpokenArabicDigits,0.9813551614370168 StandWalkJump,0.26666666666666666 diff --git a/results/multiverse/TimesURL/TimesURL_accuracy.csv b/results/multiverse/TimesURL/TimesURL_accuracy.csv index 17f210b..e0ade9e 100644 --- a/results/multiverse/TimesURL/TimesURL_accuracy.csv +++ b/results/multiverse/TimesURL/TimesURL_accuracy.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.7634408602150538 AutomotiveRoadTrials,0.8181818181818182 BIDMC32HR_disc,0.5856606919549813 BIDMC32SpO2_disc,0.712796998749479 +BasicMotions,0.975 BeijingPM10Quality_disc,0.8266640253565769 BeijingPM25Quality_disc,0.8609350237717908 BenzeneConcentration_disc,0.6897152818128994 @@ -27,6 +28,7 @@ Epilepsy,0.9420289855072463 EthanolConcentration,0.23954372623574144 EyesOpenShut,0.5 FaceDetection,0.5263904653802497 +FingerMovements,0.59 FordChallenge,0.8687620623104494 HandMovementDirection,0.28378378378378377 Handwriting,0.36 @@ -54,6 +56,7 @@ PhotoStimulation,0.3055555555555556 RacketSports,0.7828947368421053 STEW,0.6898148148148148 SelfRegulationSCP1,0.856655290102389 +SelfRegulationSCP2,0.5555555555555556 Skoda,0.9536611248673506 SpokenArabicDigits,0.9540700318326512 StandWalkJump,0.4 diff --git a/results/multiverse/TimesURL/TimesURL_auroc.csv b/results/multiverse/TimesURL/TimesURL_auroc.csv index d6ed61b..97f52b9 100644 --- a/results/multiverse/TimesURL/TimesURL_auroc.csv +++ b/results/multiverse/TimesURL/TimesURL_auroc.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.7923430737588386 AutomotiveRoadTrials,0.7558983666061707 BIDMC32HR_disc,0.6766831388242479 BIDMC32SpO2_disc,0.26627094233243576 +BasicMotions,0.9950000000000001 BeijingPM10Quality_disc,0.8939152347436676 BeijingPM25Quality_disc,0.9258711205282951 BenzeneConcentration_disc,0.7552685301755282 @@ -27,6 +28,7 @@ Epilepsy,0.9827082206548413 EthanolConcentration,0.5270873799468113 EyesOpenShut,0.4331065759637188 FaceDetection,0.5417629203219434 +FingerMovements,0.62625050020008 FordChallenge,0.9271435095787897 HandMovementDirection,0.546476908341315 Handwriting,0.8050997366009184 @@ -54,6 +56,7 @@ PhotoStimulation,0.43301994301994307 RacketSports,0.926886054668821 STEW,0.7129286772828672 SelfRegulationSCP1,0.9302022178734507 +SelfRegulationSCP2,0.5904938271604939 Skoda,0.9909375318143363 SpokenArabicDigits,0.9958774617602959 StandWalkJump,0.6000000000000001 diff --git a/results/multiverse/TimesURL/TimesURL_balacc.csv b/results/multiverse/TimesURL/TimesURL_balacc.csv index 2891a50..29608c8 100644 --- a/results/multiverse/TimesURL/TimesURL_balacc.csv +++ b/results/multiverse/TimesURL/TimesURL_balacc.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.3687086478343418 AutomotiveRoadTrials,0.6846642468239564 BIDMC32HR_disc,0.45113337784033103 BIDMC32SpO2_disc,0.4982517482517482 +BasicMotions,0.975 BeijingPM10Quality_disc,0.7932075839380079 BeijingPM25Quality_disc,0.8409201700153984 BenzeneConcentration_disc,0.5 @@ -27,6 +28,7 @@ Epilepsy,0.9441573926868044 EthanolConcentration,0.23933566433566433 EyesOpenShut,0.5 FaceDetection,0.5263904653802498 +FingerMovements,0.5908363345338136 FordChallenge,0.8567999900937957 HandMovementDirection,0.3333333333333333 Handwriting,0.3614000475962445 @@ -54,6 +56,7 @@ PhotoStimulation,0.25555555555555554 RacketSports,0.7956786202853234 STEW,0.6898148148148149 SelfRegulationSCP1,0.856770105302395 +SelfRegulationSCP2,0.5555555555555556 Skoda,0.9459696564612191 SpokenArabicDigits,0.9540805313408052 StandWalkJump,0.4000000000000001 diff --git a/results/multiverse/TimesURL/TimesURL_f1.csv b/results/multiverse/TimesURL/TimesURL_f1.csv index 519c325..cf6f780 100644 --- a/results/multiverse/TimesURL/TimesURL_f1.csv +++ b/results/multiverse/TimesURL/TimesURL_f1.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.7417642943564965 AutomotiveRoadTrials,0.5333333333333333 BIDMC32HR_disc,0.5902456474618527 BIDMC32SpO2_disc,0.0 +BasicMotions,0.974937343358396 BeijingPM10Quality_disc,0.7040919851200541 BeijingPM25Quality_disc,0.7745664739884393 BenzeneConcentration_disc,0.0 @@ -27,6 +28,7 @@ Epilepsy,0.9418486609229948 EthanolConcentration,0.2415233857922727 EyesOpenShut,0.6666666666666666 FaceDetection,0.49500756429652043 +FingerMovements,0.6019417475728155 FordChallenge,0.8227188081936685 HandMovementDirection,0.24617274617274618 Handwriting,0.33036564890115977 @@ -54,6 +56,7 @@ PhotoStimulation,0.25071225071225073 RacketSports,0.7777979666882976 STEW,0.6654561960962324 SelfRegulationSCP1,0.8609271523178808 +SelfRegulationSCP2,0.5121951219512195 Skoda,0.9537040910360911 SpokenArabicDigits,0.9544235086066181 StandWalkJump,0.3853276353276353 diff --git a/results/multiverse/TimesURL/TimesURL_logloss.csv b/results/multiverse/TimesURL/TimesURL_logloss.csv index 230cb78..94bd95b 100644 --- a/results/multiverse/TimesURL/TimesURL_logloss.csv +++ b/results/multiverse/TimesURL/TimesURL_logloss.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.6654922814860137 AutomotiveRoadTrials,0.4565840031221518 BIDMC32HR_disc,0.889176980938674 BIDMC32SpO2_disc,0.7714735636625506 +BasicMotions,0.3850454999728534 BeijingPM10Quality_disc,0.38222802385421756 BeijingPM25Quality_disc,0.3412114674226667 BenzeneConcentration_disc,0.7474851194130955 @@ -27,6 +28,7 @@ Epilepsy,0.4325868494205753 EthanolConcentration,1.9707683257768949 EyesOpenShut,1.1269007394531552 FaceDetection,0.8011298886180364 +FingerMovements,0.7493316568395305 FordChallenge,0.32986916667438576 HandMovementDirection,2.107396597630214 Handwriting,6.2025883846442 @@ -54,6 +56,7 @@ PhotoStimulation,1.588777764850843 RacketSports,0.6179285522468604 STEW,1.629677786651698 SelfRegulationSCP1,0.37393528067830706 +SelfRegulationSCP2,0.7735339342895385 Skoda,0.48831847572277554 SpokenArabicDigits,0.4825564295956747 StandWalkJump,1.3494774790872897 diff --git a/results/multiverse/TimesURL/TimesURL_sensitivity.csv b/results/multiverse/TimesURL/TimesURL_sensitivity.csv index 05bb815..537e95e 100644 --- a/results/multiverse/TimesURL/TimesURL_sensitivity.csv +++ b/results/multiverse/TimesURL/TimesURL_sensitivity.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.7634408602150538 AutomotiveRoadTrials,0.42105263157894735 BIDMC32HR_disc,0.5856606919549813 BIDMC32SpO2_disc,0.0 +BasicMotions,0.975 BeijingPM10Quality_disc,0.7139917695473251 BeijingPM25Quality_disc,0.7903014416775884 BenzeneConcentration_disc,0.0 @@ -27,6 +28,7 @@ Epilepsy,0.9420289855072463 EthanolConcentration,0.23954372623574144 EyesOpenShut,1.0 FaceDetection,0.4642451759364359 +FingerMovements,0.6326530612244898 FordChallenge,0.8082693011342846 HandMovementDirection,0.28378378378378377 Handwriting,0.36 @@ -54,6 +56,7 @@ PhotoStimulation,0.3055555555555556 RacketSports,0.7828947368421053 STEW,0.617003367003367 SelfRegulationSCP1,0.8904109589041096 +SelfRegulationSCP2,0.4666666666666667 Skoda,0.9536611248673506 SpokenArabicDigits,0.9540700318326512 StandWalkJump,0.4 diff --git a/results/multiverse/TimesURL/TimesURL_specificity.csv b/results/multiverse/TimesURL/TimesURL_specificity.csv index 2487839..e08c284 100644 --- a/results/multiverse/TimesURL/TimesURL_specificity.csv +++ b/results/multiverse/TimesURL/TimesURL_specificity.csv @@ -9,6 +9,7 @@ AustraliaRainfall_disc,0.7634408602150538 AutomotiveRoadTrials,0.9482758620689655 BIDMC32HR_disc,0.5856606919549813 BIDMC32SpO2_disc,0.9965034965034965 +BasicMotions,0.975 BeijingPM10Quality_disc,0.8724233983286908 BeijingPM25Quality_disc,0.8915388983532084 BenzeneConcentration_disc,1.0 @@ -27,6 +28,7 @@ Epilepsy,0.9420289855072463 EthanolConcentration,0.23954372623574144 EyesOpenShut,0.0 FaceDetection,0.5885357548240636 +FingerMovements,0.5490196078431373 FordChallenge,0.9053306790533068 HandMovementDirection,0.28378378378378377 Handwriting,0.36 @@ -54,6 +56,7 @@ PhotoStimulation,0.3055555555555556 RacketSports,0.7828947368421053 STEW,0.7626262626262627 SelfRegulationSCP1,0.8231292517006803 +SelfRegulationSCP2,0.6444444444444445 Skoda,0.9536611248673506 SpokenArabicDigits,0.9540700318326512 StandWalkJump,0.4 diff --git a/results/multiverse/datasets.html b/results/multiverse/datasets.html index ea26c9c..35734be 100644 --- a/results/multiverse/datasets.html +++ b/results/multiverse/datasets.html @@ -60,7 +60,7 @@ details { margin-top: .6rem; } summary { cursor: pointer; color: var(--accent); } code { font-family: ui-monospace, SFMono-Regular, Menlo, monospace; font-size: .9em; } -tr.nosignal td { background: rgba(214, 158, 46, .16); }tr.saturated td { background: rgba(56, 161, 105, .14); }

    Multiverse-core datasets: accuracy

    64 datasets · accuracy · best of up to 24 estimators against the Dummy baseline · built 2026-09-18

    DatasetDummyMedianBestBest estimatorGain over dummySpreadEstimators
    KINECAL-QSEO0.94120.94120.9412Arsenal0.00000.647124
    BIDMC32SpO2_disc0.71530.65740.7203ROCKET0.00500.190124
    Locust20220.91120.90820.9206MRHydra0.00940.052423
    Heartbeat0.72200.74880.7854CIF0.06340.126824
    HouseholdPowerConsumption2_disc0.72160.76530.7872DisjointCNN0.06560.097724
    MotorImagery0.50000.51000.5900HC20.09000.130024
    AutomotiveRoadTrials0.75320.78570.8442CIF0.09090.233824
    EyesOpenShut0.50000.50000.5952STSF0.09520.190524
    EmoPain0.78310.83380.8845Catch220.10140.256324
    AppliancesEnergy_disc0.80950.82140.9286DrCIF0.11900.428624
    BeijingPM10Quality_disc0.71120.82420.8417STSF0.13050.126024
    Alzheimers0.41860.37210.5581MRHydra0.13950.302323
    PhotoStimulation0.41670.38890.5833ROCKET0.16670.388923
    FaceDetection0.50000.62510.6850H-InceptionTime0.18500.170524
    BeijingPM25Quality_disc0.69770.87510.8879ConvTran0.19020.128824
    AtrialFibrillation0.33330.26670.5333TS2Vec0.20000.466724
    HouseholdPowerConsumption1_disc0.77840.91110.9825STSF0.20410.864424
    LowCost0.50000.63170.7300TSF0.23000.248324
    BoneProbAgeGroup0.47640.64380.7124H-InceptionTime0.23600.184324
    StandWalkJump0.33330.40000.6000MRHydra0.26670.400024
    CrowdSourced0.50020.71900.7734LITETime-MV0.27320.176824
    BenzeneConcentration_disc0.68970.81070.9768STSF0.28700.577024
    FordChallenge0.62320.88430.9360QUANT0.31280.312824
    BIDMC32HR_disc0.65070.80120.9637RIST0.31300.635324
    BoneIntensitiesAgeGroup0.47640.79890.8202HC20.34380.256224
    STEW0.50000.74020.8448HC20.34480.216324
    PhonemeSpectra0.02560.27100.3746H-InceptionTime0.34890.291124
    KERAAL-RTK0.57140.78570.9286HC20.35710.571424
    LSST0.31510.62900.6752HC20.36010.452124
    HandMovementDirection0.20270.41220.6081TSF0.40540.351424
    DuckDuckGeese0.20000.46000.6400H-InceptionTime0.44000.480024
    SelfRegulationSCP10.50170.85320.9454MRHydra0.44370.392524
    IEEEPPG_disc0.26050.45480.7078ConvTran0.44730.438324
    AsphaltRegularityCoordinates0.50730.97870.9947H-InceptionTime0.48740.061324
    MindReading0.23120.52830.7243LITETime-MV0.49310.385924
    EthanolConcentration0.25100.43350.7490STC0.49810.513324
    UIPRMD-DS-C0.50000.83331.0000Catch220.50000.388924
    WISDM0.36640.86580.8965MRHydra0.53000.131024
    Blink0.44440.98671.0000Arsenal0.55560.428924
    EigenWorms0.41980.86260.9771MRHydra0.55730.557323
    KIMORE-PR-C0.14290.42860.7143LITETime-MV0.57140.571424
    AsphaltObstaclesCoordinates0.28390.81970.8670MRHydra0.58310.199524
    CounterMovementJump0.33520.75700.9274Arsenal0.59220.458124
    Handwriting0.03760.37290.6529H-InceptionTime0.61530.478824
    RacketSports0.28290.87830.9079RDST0.62500.125024
    UCDHE-Rowing-MC0.20450.73410.8295PatchMTSC0.62500.259124
    USCActivity0.11380.69240.7473HC20.63340.166422
    IRDS-SFL0.20690.79310.8966XCM0.68970.482824
    Skoda0.23560.94550.9646H-InceptionTime0.72900.119924
    Epilepsy0.26810.98191.0000HC20.73190.101424
    Tiselac0.06280.80860.8373STSF0.77450.204421
    MotionSenseHAR0.20380.98871.0000DrCIF0.79620.101924
    NATOPS0.16670.89170.9667LITETime-MV0.80000.155624
    UCIActivity0.19160.97690.9983LITETime-MV0.80670.174924
    UWaveGestureLibrary0.12500.90940.9406Arsenal0.81560.553124
    ERing0.16670.94070.9963MRHydra0.82960.692624
    PEMS-SF0.11560.86991.0000CIF0.88440.317924
    SpokenArabicDigits0.10000.98160.9945DisjointCNN0.89450.129124
    Libras0.06670.88890.9722RIST0.90560.338924
    JapaneseVowels0.08380.97030.9946LITETime-MV0.91080.208124
    Cricket0.08330.97921.0000Arsenal0.91670.069424
    CharacterTrajectories0.06480.98960.9958H-InceptionTime0.93110.044624
    TactileTextureRecognition0.05140.99851.0000H-InceptionTime0.94860.234924
    ArticularyWordRecognition0.04000.98000.9933Arsenal0.95330.050024

    One row per dataset. Dummy is the no-skill floor. Median, best and spread are over the other estimators, so the baseline cannot flatter them. Gain over dummy is best minus dummy, how much skill was found at all; spread is best minus worst, how much the choice of estimator mattered. The two answer different questions, and a single range would conflate them.

    3 of 64 datasets gained 0.05 or less over the baseline (shaded amber) and 14 have a best of 0.99 or more (shaded green). Both separate estimators poorly, for opposite reasons. Best is a maximum over many estimators, so it is optimistic by construction: read it as what the archive can currently do on a problem, not as what any one method delivers.

    \ No newline at end of file diff --git a/results/multiverse/leaderboard_full.html b/results/multiverse/leaderboard_full.html new file mode 100644 index 0000000..138f429 --- /dev/null +++ b/results/multiverse/leaderboard_full.html @@ -0,0 +1,126 @@ +Multiverse leaderboard: the paper's 100 datasets

    Multiverse leaderboard: the paper's 100 datasets

    17 estimators on 100 datasets · 7 metrics · ordered by average accuracy rank · built 2026-09-19

    #EstimatorAccuracyBalanced accuracyAUROCF1Log loss ↓SensitivitySpecificity
    ScoreRankScoreRankScoreRankScoreRankScoreRankScoreRankScoreRank
    1HC20.76096.310.70386.960.84405.220.64217.070.58165.150.67857.250.77366.44
    2MRHydra0.75916.860.71456.570.760111.050.65686.468.683613.080.69257.030.76957.50
    3RDST0.75007.510.69747.910.747411.700.63147.779.010013.700.65608.420.77187.59
    4FreshPRINCE0.74737.660.71027.700.84356.140.65717.840.60864.990.69518.340.75708.37
    5CIF-5000.74657.880.70008.030.84136.590.63798.050.60846.090.67468.610.76127.86
    6Arsenal0.75248.000.69667.910.78869.090.63168.044.493811.010.66798.350.76848.00
    7ROCKET0.75308.070.69618.050.745611.940.62858.308.901113.840.66058.930.77148.30
    8DrCIF-5000.73148.200.69078.170.82796.860.62438.350.62996.530.66808.480.74718.30
    9RIST0.73518.310.69358.510.81836.830.62468.570.62716.200.66608.650.74438.67
    10QUANT0.73748.730.69778.670.83446.520.63848.610.62245.790.68318.770.74218.95
    11LITETime-MV0.71619.010.68628.320.81417.680.61098.351.65548.640.65018.380.75158.83
    12STC0.73349.610.67969.880.81758.480.62309.700.71787.100.654210.180.74799.71
    13Catch220.72019.670.68189.670.83137.810.61889.620.67817.370.67289.590.72619.71
    14H-InceptionTime0.697010.050.66729.490.79888.380.59259.331.76759.160.64948.980.716510.13
    15TDE0.716110.160.656110.200.78119.460.581010.281.47738.570.62869.700.73069.80
    161NN-DTW0.646712.640.619112.050.680213.880.561011.8712.734315.590.628710.760.643212.68
    17Dummy0.448914.320.372014.920.500015.370.221914.791.156210.200.383112.610.423112.15

    Average score and average rank over the 100 datasets with results for every estimator on every metric. Best in each column is highlighted. Metrics marked ↓ are better when lower.

    Not yet complete

    Estimators in the Multiverse-core table that do not yet have a result on every paper dataset, so are not ranked above.

    • PatchMTSC — 60 of 100; missing AsphaltPavementTypeCoordinates, ButtonPress, FeedbackButton, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech
    • TimesNet — 60 of 100; missing AsphaltPavementTypeCoordinates, ButtonPress, FeedbackButton, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech
    • TimesURL — 60 of 100; missing AsphaltPavementTypeCoordinates, ButtonPress, FeedbackButton, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech
    • CIF — 57 of 100; missing AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech
    • ConvTran — 57 of 100; missing Alzheimers, AsphaltPavementTypeCoordinates, ButtonPress, EigenWorms, FeedbackButton, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PhotoStimulation, PronouncedSpeech, SPHERE-WUS, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech
    • DisjointCNN — 57 of 100; missing AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech
    • DrCIF — 57 of 100; missing AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech
    • STSF — 57 of 100; missing AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech
    • Summary — 57 of 100; missing AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech
    • TSF — 57 of 100; missing AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech
    • XCM — 57 of 100; missing AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech
    • TS2Vec — 56 of 100; missing AsphaltPavementTypeCoordinates, BasicMotions, ButtonPress, FeedbackButton, FingerMovements, IRDS-EFL, IRDS-EFR, IRDS-SAL, IRDS-SAR, IRDS-SFE, IRDS-SFR, IRDS-STL, IRDS-STR, ImaginedFeetHands, InnerSpeech, KERAAL-CTK, KERAAL-CTK-MC, KERAAL-ELK, KERAAL-ELK-MC, KERAAL-RTK-MC, KIMORE-LA-C, KIMORE-Sq-C, KIMORE-TR-C, KINECAL-3WFV, KINECAL-GGFV, KINECAL-QSEC, LiveFuelMoistureContent_disc, Locust2022, PronouncedSpeech, SPHERE-WUS, SelfRegulationSCP2, UCDHE-MP, UCDHE-MP-MC, UCDHE-Rowing, UIPRMD-HS-C, UIPRMD-IL-C, UIPRMD-SASLR-C, UIPRMD-SL-C, UIPRMD-SSA-C, UIPRMD-SSE-C, UIPRMD-SSIER-C, UIPRMD-SSS-C, UIPRMD-STS-C, VisualSpeech

    Reproducing this page

    from multiverse.experiments.tables import leaderboard, paper_datasets
+
+leaderboard(
+    datasets=paper_datasets(),
+    estimators=["HC2", "MRHydra", "RDST", "FreshPRINCE", "CIF-500", "Arsenal", "ROCKET", "DrCIF-500", "RIST", "QUANT", "LITETime-MV", "STC", "Catch22", "H-InceptionTime", "TDE", "1NN-DTW", "Dummy"],
+    metrics=["accuracy", "balacc", "auroc", "f1", "logloss", "sensitivity", "specificity"],
+    sort_by="accuracy",
+)

    Or python -m multiverse.experiments.tables to rebuild it with the defaults.

    \ No newline at end of file diff --git a/results/multiverse/leaderboard_uea.html b/results/multiverse/leaderboard_uea.html index 7b5ce7f..cfe5e4e 100644 --- a/results/multiverse/leaderboard_uea.html +++ b/results/multiverse/leaderboard_uea.html @@ -60,7 +60,7 @@ details { margin-top: .6rem; } summary { cursor: pointer; color: var(--accent); } code { font-family: ui-monospace, SFMono-Regular, Menlo, monospace; font-size: .9em; } -

    UEA leaderboard

    25 estimators on 24 datasets · 7 metrics · ordered by average accuracy rank · built 2026-09-18

    #EstimatorAccuracyBalanced accuracyAUROCF1Log loss ↓SensitivitySpecificity
    ScoreRankScoreRankScoreRankScoreRankScoreRankScoreRankScoreRank
    1HC20.76176.650.74127.560.87526.770.73727.710.66815.880.74298.210.76556.52
    2RDST0.74078.270.72508.560.809818.330.71978.549.344820.830.72129.060.75128.29
    3MRHydra0.74628.770.73328.620.814518.400.73718.299.148020.880.75268.330.73158.85
    4Arsenal0.72829.380.71039.960.837514.600.70849.675.357517.420.708410.310.73808.73
    5H-InceptionTime0.72089.560.72149.080.86058.330.69629.791.503711.290.70469.710.732310.08
    6ROCKET0.72659.650.710110.040.800419.400.708410.319.859521.960.708410.960.73419.50
    7RIST0.737410.040.722610.250.86608.690.726110.440.79339.710.737010.790.729210.46
    8CIF0.747510.420.733410.580.87428.750.735610.350.841010.880.755010.670.730710.90
    9LITETime-MV0.704810.960.704010.170.85058.580.67699.771.481510.500.68949.670.718110.65
    10DrCIF0.732811.100.719911.080.86399.920.719311.980.838611.040.732411.790.725012.10
    11QUANT0.724512.540.713612.290.88038.190.716112.420.79788.750.738311.880.703513.52
    12DisjointCNN0.694312.620.696111.690.83879.710.662712.541.883911.920.683011.350.704411.79
    13STSF0.730912.710.719112.650.870311.190.691413.170.82559.380.698213.500.755612.29
    14PatchMTSC0.709613.710.697713.400.854910.600.690613.060.76197.500.722012.940.687414.58
    15TS2Vec0.699013.960.683914.270.833413.850.685313.710.882011.710.708813.770.678314.31
    16TDE0.702614.190.681814.270.838613.080.674513.941.127712.420.687714.100.701613.79
    17ConvTran0.691514.230.679113.810.849311.440.678413.350.80909.750.703213.790.672515.06
    18TSF0.718314.500.705214.210.860011.810.690114.040.901810.960.696214.480.732414.10
    19STC0.722414.620.700415.040.872211.330.700014.750.805210.250.713815.290.715713.85
    20Catch220.694514.980.680015.480.844312.730.683615.190.969013.460.702114.830.676215.44
    21XCM0.635615.980.620416.520.818413.790.589916.691.350713.750.617215.440.641015.75
    22TimesURL0.674517.040.660016.850.817018.290.647317.121.332617.460.661217.620.670316.27
    23TimesNet0.658217.920.650517.210.827516.150.640017.671.148513.540.664817.170.648118.77
    24Summary0.643118.060.631417.980.818117.380.617917.791.274516.000.626917.620.652117.75
    25Dummy0.228623.150.210623.420.500023.690.104422.711.861517.790.219321.710.219321.62

    Average score and average rank over the 24 datasets with results for every estimator on every metric. Best in each column is highlighted. Metrics marked ↓ are better when lower.

    Missing results

    • ConvTran — EigenWorms (CUDA out of memory)

    Scoring uses the 24 datasets every estimator completed, so a dataset any one of them is missing is left out for all. Reasons are from the job logs of these runs.

    4 requested dataset(s) have no results from any estimator: BasicMotions, FingerMovements, InsectWingbeat, SelfRegulationSCP2.

    Notes on listed estimators

    • XCM — run at fixed parameters, a single fit at window 0.8 with batch 32, not the per-dataset cross-validated search over window and batch size that the paper describes. The search was run and did not pay: across the 65 shared datasets it was 0.017 mean accuracy worse, 31 wins to 31 with 3 ties, Wilcoxon p = 0.63. On the 14 datasets where the search selected 0.8, the window used here, the two runs still differed by 0.11 mean absolute accuracy and by as much as 0.48, so at one resample XCM's run-to-run variance is larger than the effect the search is tuning for.

    Datasets not included

    • AustraliaRainfall_disc — 112186 cases, and three estimators fail on it for reasons compute cannot fix. RDST and ROCKET hit LAPACK integer overflow in RidgeClassifierCV's SVD, aeon issue 3738, after 14 and 12 attempts; MRHydra exhausted 128 GB over 13.
    • PenDigits — the series are length 8 and MRHydra requires at least 9, so the dataset cannot complete while MRHydra is a column.

    Held out of the collection rather than reported as missing, because no scheduling closes them. Results that do exist for them remain in the repository.

    Estimators not listed

    • LiteTIME — LITE is a univariate architecture. The multivariate variant of the same method is listed here as LITETime-MV.
    • FreshPRINCE — cannot complete the archive at the memory available: recorded OOM at 128 GB after eight attempts each on FaceDetection, FordChallenge and Skoda, and 38 on Tiselac.
    • 1NN-DTW — cannot complete the archive within the walltime available: exceeded the limit on BIDMC32HR_disc, with no result recorded for BIDMC32SpO2_disc.
    • DisjointCNN-Aeon — aeon's implementation applies a Permute after the final block, so its pooling reduces the wrong axes and the classifier head receives one feature instead of 64 (aeon issue #3775). Held as evidence for that issue; the port of the same method reports as DisjointCNN.

    Their results remain in the repository under results/multiverse/. Removing an estimator that cannot finish the archive returns the datasets it alone was missing to every other estimator, which is why the scored count above is larger than the number of datasets any single run completed.

    Reproducing this page

    from multiverse.experiments.tables import leaderboard
+
    UEA leaderboard
    25 estimators on 24 datasets · 7 metrics · ordered by average accuracy rank · built 2026-09-19
    #EstimatorAccuracyBalanced accuracyAUROCF1Log loss ↓SensitivitySpecificity
    ScoreRankScoreRankScoreRankScoreRankScoreRankScoreRankScoreRank
    1HC20.76176.650.74127.560.87526.770.73727.710.66815.880.74298.210.76556.52
    2RDST0.74078.270.72508.560.809818.330.71978.549.344820.830.72129.060.75128.29
    3MRHydra0.74628.770.73328.620.814518.400.73718.299.148020.880.75268.330.73158.85
    4Arsenal0.72829.380.71039.960.837514.600.70849.675.357517.420.708410.310.73808.73
    5H-InceptionTime0.72089.560.72149.080.86058.330.69629.791.503711.290.70469.710.732310.08
    6ROCKET0.72659.650.710110.040.800419.400.708410.319.859521.960.708410.960.73419.50
    7RIST0.737410.040.722610.250.86608.690.726110.440.79339.710.737010.790.729210.46
    8CIF0.747510.420.733410.580.87428.750.735610.350.841010.880.755010.670.730710.90
    9LITETime-MV0.704810.960.704010.170.85058.580.67699.771.481510.500.68949.670.718110.65
    10DrCIF0.732811.100.719911.080.86399.920.719311.980.838611.040.732411.790.725012.10
    11QUANT0.724512.540.713612.290.88038.190.716112.420.79788.750.738311.880.703513.52
    12DisjointCNN0.694312.620.696111.690.83879.710.662712.541.883911.920.683011.350.704411.79
    13STSF0.730912.710.719112.650.870311.190.691413.170.82559.380.698213.500.755612.29
    14PatchMTSC0.709613.710.697713.400.854910.600.690613.060.76197.500.722012.940.687414.58
    15TS2Vec0.699013.960.683914.270.833413.850.685313.710.882011.710.708813.770.678314.31
    16TDE0.702614.190.681814.270.838613.080.674513.941.127712.420.687714.100.701613.79
    17ConvTran0.691514.230.679113.810.849311.440.678413.350.80909.750.703213.790.672515.06
    18TSF0.718314.500.705214.210.860011.810.690114.040.901810.960.696214.480.732414.10
    19STC0.722414.620.700415.040.872211.330.700014.750.805210.250.713815.290.715713.85
    20Catch220.694514.980.680015.480.844312.730.683615.190.969013.460.702114.830.676215.44
    21XCM0.635615.980.620416.520.818413.790.589916.691.350713.750.617215.440.641015.75
    22TimesURL0.674517.040.660016.850.817018.290.647317.121.332617.460.661217.620.670316.27
    23TimesNet0.658217.920.650517.210.827516.150.640017.671.148513.540.664817.170.648118.77
    24Summary0.643118.060.631417.980.818117.380.617917.791.274516.000.626917.620.652117.75
    25Dummy0.228623.150.210623.420.500023.690.104422.711.861517.790.219321.710.219321.62
    Average score and average rank over the 24 datasets with results for every estimator on every metric. Best in each column is highlighted. Metrics marked ↓ are better when lower.
    Missing results
    • CIF — BasicMotions, FingerMovements, SelfRegulationSCP2 (not run outside Multiverse-core)
    • DrCIF — BasicMotions, FingerMovements, SelfRegulationSCP2 (not run outside Multiverse-core)
    • DisjointCNN — BasicMotions, FingerMovements, SelfRegulationSCP2 (not run outside Multiverse-core)
    • STSF — BasicMotions, FingerMovements, SelfRegulationSCP2 (not run outside Multiverse-core)
    • TS2Vec — BasicMotions, FingerMovements, SelfRegulationSCP2 (not run outside Multiverse-core)
    • ConvTran — EigenWorms (CUDA out of memory)
    • TSF — BasicMotions, FingerMovements, SelfRegulationSCP2 (not run outside Multiverse-core)
    • XCM — BasicMotions, FingerMovements, SelfRegulationSCP2 (not run outside Multiverse-core)
    • Summary — BasicMotions, FingerMovements, SelfRegulationSCP2 (not run outside Multiverse-core)
    Scoring uses the 24 datasets every estimator completed, so a dataset any one of them is missing is left out for all. Reasons are from the job logs of these runs.
    1 requested dataset(s) have no results from any estimator: InsectWingbeat.
    Notes on listed estimators
    • XCM — run at fixed parameters, a single fit at window 0.8 with batch 32, not the per-dataset cross-validated search over window and batch size that the paper describes. The search was run and did not pay: across the 65 shared datasets it was 0.017 mean accuracy worse, 31 wins to 31 with 3 ties, Wilcoxon p = 0.63. On the 14 datasets where the search selected 0.8, the window used here, the two runs still differed by 0.11 mean absolute accuracy and by as much as 0.48, so at one resample XCM's run-to-run variance is larger than the effect the search is tuning for.
    Datasets not included
    • AustraliaRainfall_disc — 112186 cases, and three estimators fail on it for reasons compute cannot fix. RDST and ROCKET hit LAPACK integer overflow in RidgeClassifierCV's SVD, aeon issue 3738, after 14 and 12 attempts; MRHydra exhausted 128 GB over 13.
    • PenDigits — the series are length 8 and MRHydra requires at least 9, so the dataset cannot complete while MRHydra is a column.
    Held out of the collection rather than reported as missing, because no scheduling closes them. Results that do exist for them remain in the repository.
    Estimators not listed
    • LiteTIME — LITE is a univariate architecture. The multivariate variant of the same method is listed here as LITETime-MV.
    • FreshPRINCE — cannot complete the archive at the memory available: recorded OOM at 128 GB after eight attempts each on FaceDetection, FordChallenge and Skoda, and 38 on Tiselac.
    • 1NN-DTW — cannot complete the archive within the walltime available: exceeded the limit on BIDMC32HR_disc, with no result recorded for BIDMC32SpO2_disc.
    • CIF-500 — the 500-tree configuration run for the Multiverse archive paper's full-archive benchmark, where it is reported as CIF. This table reports the default CIF; the full-archive leaderboard reports CIF-500.
    • DrCIF-500 — the 500-tree configuration HC2 uses internally, run for the Multiverse archive paper's full-archive benchmark, where it is reported as DrCIF. This table reports the default DrCIF; the full-archive leaderboard reports DrCIF-500.
    • DisjointCNN-Aeon — aeon's implementation applies a Permute after the final block, so its pooling reduces the wrong axes and the classifier head receives one feature instead of 64 (aeon issue #3775). Held as evidence for that issue; the port of the same method reports as DisjointCNN.
    Their results remain in the repository under results/multiverse/. Removing an estimator that cannot finish the archive returns the datasets it alone was missing to every other estimator, which is why the scored count above is larger than the number of datasets any single run completed.
    Reproducing this page
    from multiverse.experiments.tables import leaderboard
 
 leaderboard(
     datasets=[...]  # 24 datasets,
diff --git a/results/multiverse/paper_datasets.txt b/results/multiverse/paper_datasets.txt
new file mode 100644
index 0000000..37ae226
--- /dev/null
+++ b/results/multiverse/paper_datasets.txt
@@ -0,0 +1,103 @@
+# The 100 Multiverse datasets used for the full-archive comparison in the Multiverse
+# archive paper: those with a resample-0 result from all 17 of its classifiers.
+# Fixed, so the full-archive leaderboard keeps matching the paper as results arrive.
+Alzheimers
+AppliancesEnergy_disc
+ArticularyWordRecognition
+AsphaltObstaclesCoordinates
+AsphaltPavementTypeCoordinates
+AsphaltRegularityCoordinates
+AtrialFibrillation
+AutomotiveRoadTrials
+BasicMotions
+BeijingPM10Quality_disc
+BeijingPM25Quality_disc
+BenzeneConcentration_disc
+Blink
+BoneIntensitiesAgeGroup
+BoneProbAgeGroup
+ButtonPress
+CharacterTrajectories
+CounterMovementJump
+Cricket
+CrowdSourced
+DuckDuckGeese
+ERing
+EigenWorms
+EmoPain
+Epilepsy
+EthanolConcentration
+EyesOpenShut
+FeedbackButton
+FingerMovements
+HandMovementDirection
+Handwriting
+Heartbeat
+HouseholdPowerConsumption1_disc
+HouseholdPowerConsumption2_disc
+IEEEPPG_disc
+IRDS-EFL
+IRDS-EFR
+IRDS-SAL
+IRDS-SAR
+IRDS-SFE
+IRDS-SFL
+IRDS-SFR
+IRDS-STL
+IRDS-STR
+ImaginedFeetHands
+InnerSpeech
+JapaneseVowels
+KERAAL-CTK
+KERAAL-CTK-MC
+KERAAL-ELK
+KERAAL-ELK-MC
+KERAAL-RTK
+KERAAL-RTK-MC
+KIMORE-LA-C
+KIMORE-PR-C
+KIMORE-Sq-C
+KIMORE-TR-C
+KINECAL-3WFV
+KINECAL-GGFV
+KINECAL-QSEC
+KINECAL-QSEO
+LSST
+Libras
+LiveFuelMoistureContent_disc
+Locust2022
+LowCost
+MindReading
+MotionSenseHAR
+MotorImagery
+NATOPS
+PEMS-SF
+PhonemeSpectra
+PhotoStimulation
+PronouncedSpeech
+RacketSports
+SPHERE-WUS
+STEW
+SelfRegulationSCP1
+SelfRegulationSCP2
+SpokenArabicDigits
+StandWalkJump
+TactileTextureRecognition
+UCDHE-MP
+UCDHE-MP-MC
+UCDHE-Rowing
+UCDHE-Rowing-MC
+UCIActivity
+UIPRMD-DS-C
+UIPRMD-HS-C
+UIPRMD-IL-C
+UIPRMD-SASLR-C
+UIPRMD-SL-C
+UIPRMD-SSA-C
+UIPRMD-SSE-C
+UIPRMD-SSIER-C
+UIPRMD-SSS-C
+UIPRMD-STS-C
+UWaveGestureLibrary
+VisualSpeech
+WISDM
diff --git a/results/multiverse/pending_eeg.csv b/results/multiverse/pending_eeg.csv
new file mode 100644
index 0000000..e469126
--- /dev/null
+++ b/results/multiverse/pending_eeg.csv
@@ -0,0 +1,189 @@
+estimator,dataset
+H-InceptionTime,ShortIntervalTask
+H-InceptionTime,SitStand
+PatchMTSC,ButtonPress
+PatchMTSC,FeedbackButton
+PatchMTSC,FeetHands
+PatchMTSC,ImaginedFeetHands
+PatchMTSC,ImaginedOpenCloseFist
+PatchMTSC,InnerSpeech
+PatchMTSC,LongIntervalTask
+PatchMTSC,MatchingPennies
+PatchMTSC,OpenCloseFist
+PatchMTSC,PronouncedSpeech
+PatchMTSC,ShortIntervalTask
+PatchMTSC,SitStand
+PatchMTSC,SongFamiliarity
+PatchMTSC,VisualSpeech
+TimesNet,ButtonPress
+TimesNet,FeedbackButton
+TimesNet,FeetHands
+TimesNet,ImaginedFeetHands
+TimesNet,ImaginedOpenCloseFist
+TimesNet,InnerSpeech
+TimesNet,LongIntervalTask
+TimesNet,MatchingPennies
+TimesNet,OpenCloseFist
+TimesNet,PronouncedSpeech
+TimesNet,ShortIntervalTask
+TimesNet,SitStand
+TimesNet,SongFamiliarity
+TimesNet,VisualSpeech
+TimesURL,ButtonPress
+TimesURL,FeedbackButton
+TimesURL,FeetHands
+TimesURL,ImaginedFeetHands
+TimesURL,ImaginedOpenCloseFist
+TimesURL,InnerSpeech
+TimesURL,LongIntervalTask
+TimesURL,MatchingPennies
+TimesURL,OpenCloseFist
+TimesURL,PronouncedSpeech
+TimesURL,ShortIntervalTask
+TimesURL,SitStand
+TimesURL,SongFamiliarity
+TimesURL,VisualSpeech
+CIF,ButtonPress
+CIF,FeedbackButton
+CIF,FeetHands
+CIF,FingerMovements
+CIF,ImaginedFeetHands
+CIF,ImaginedOpenCloseFist
+CIF,InnerSpeech
+CIF,LongIntervalTask
+CIF,MatchingPennies
+CIF,OpenCloseFist
+CIF,PronouncedSpeech
+CIF,SelfRegulationSCP2
+CIF,ShortIntervalTask
+CIF,SitStand
+CIF,SongFamiliarity
+CIF,VisualSpeech
+ConvTran,Alzheimers
+ConvTran,ButtonPress
+ConvTran,FeedbackButton
+ConvTran,FeetHands
+ConvTran,ImaginedFeetHands
+ConvTran,ImaginedOpenCloseFist
+ConvTran,InnerSpeech
+ConvTran,LongIntervalTask
+ConvTran,MatchingPennies
+ConvTran,OpenCloseFist
+ConvTran,PhotoStimulation
+ConvTran,PronouncedSpeech
+ConvTran,ShortIntervalTask
+ConvTran,SitStand
+ConvTran,SongFamiliarity
+ConvTran,VisualSpeech
+DisjointCNN,ButtonPress
+DisjointCNN,FeedbackButton
+DisjointCNN,FeetHands
+DisjointCNN,FingerMovements
+DisjointCNN,ImaginedFeetHands
+DisjointCNN,ImaginedOpenCloseFist
+DisjointCNN,InnerSpeech
+DisjointCNN,LongIntervalTask
+DisjointCNN,MatchingPennies
+DisjointCNN,OpenCloseFist
+DisjointCNN,PronouncedSpeech
+DisjointCNN,SelfRegulationSCP2
+DisjointCNN,ShortIntervalTask
+DisjointCNN,SitStand
+DisjointCNN,SongFamiliarity
+DisjointCNN,VisualSpeech
+DrCIF,ButtonPress
+DrCIF,FeedbackButton
+DrCIF,FeetHands
+DrCIF,FingerMovements
+DrCIF,ImaginedFeetHands
+DrCIF,ImaginedOpenCloseFist
+DrCIF,InnerSpeech
+DrCIF,LongIntervalTask
+DrCIF,MatchingPennies
+DrCIF,OpenCloseFist
+DrCIF,PronouncedSpeech
+DrCIF,SelfRegulationSCP2
+DrCIF,ShortIntervalTask
+DrCIF,SitStand
+DrCIF,SongFamiliarity
+DrCIF,VisualSpeech
+STSF,ButtonPress
+STSF,FeedbackButton
+STSF,FeetHands
+STSF,FingerMovements
+STSF,ImaginedFeetHands
+STSF,ImaginedOpenCloseFist
+STSF,InnerSpeech
+STSF,LongIntervalTask
+STSF,MatchingPennies
+STSF,OpenCloseFist
+STSF,PronouncedSpeech
+STSF,SelfRegulationSCP2
+STSF,ShortIntervalTask
+STSF,SitStand
+STSF,SongFamiliarity
+STSF,VisualSpeech
+Summary,ButtonPress
+Summary,FeedbackButton
+Summary,FeetHands
+Summary,FingerMovements
+Summary,ImaginedFeetHands
+Summary,ImaginedOpenCloseFist
+Summary,InnerSpeech
+Summary,LongIntervalTask
+Summary,MatchingPennies
+Summary,OpenCloseFist
+Summary,PronouncedSpeech
+Summary,SelfRegulationSCP2
+Summary,ShortIntervalTask
+Summary,SitStand
+Summary,SongFamiliarity
+Summary,VisualSpeech
+TS2Vec,ButtonPress
+TS2Vec,FeedbackButton
+TS2Vec,FeetHands
+TS2Vec,FingerMovements
+TS2Vec,ImaginedFeetHands
+TS2Vec,ImaginedOpenCloseFist
+TS2Vec,InnerSpeech
+TS2Vec,LongIntervalTask
+TS2Vec,MatchingPennies
+TS2Vec,OpenCloseFist
+TS2Vec,PronouncedSpeech
+TS2Vec,SelfRegulationSCP2
+TS2Vec,ShortIntervalTask
+TS2Vec,SitStand
+TS2Vec,SongFamiliarity
+TS2Vec,VisualSpeech
+TSF,ButtonPress
+TSF,FeedbackButton
+TSF,FeetHands
+TSF,FingerMovements
+TSF,ImaginedFeetHands
+TSF,ImaginedOpenCloseFist
+TSF,InnerSpeech
+TSF,LongIntervalTask
+TSF,MatchingPennies
+TSF,OpenCloseFist
+TSF,PronouncedSpeech
+TSF,SelfRegulationSCP2
+TSF,ShortIntervalTask
+TSF,SitStand
+TSF,SongFamiliarity
+TSF,VisualSpeech
+XCM,ButtonPress
+XCM,FeedbackButton
+XCM,FeetHands
+XCM,FingerMovements
+XCM,ImaginedFeetHands
+XCM,ImaginedOpenCloseFist
+XCM,InnerSpeech
+XCM,LongIntervalTask
+XCM,MatchingPennies
+XCM,OpenCloseFist
+XCM,PronouncedSpeech
+XCM,SelfRegulationSCP2
+XCM,ShortIntervalTask
+XCM,SitStand
+XCM,SongFamiliarity
+XCM,VisualSpeech
diff --git a/results/multiverse/pending_full.csv b/results/multiverse/pending_full.csv
new file mode 100644
index 0000000..40b0e99
--- /dev/null
+++ b/results/multiverse/pending_full.csv
@@ -0,0 +1,509 @@
+estimator,dataset
+PatchMTSC,AsphaltPavementTypeCoordinates
+PatchMTSC,ButtonPress
+PatchMTSC,FeedbackButton
+PatchMTSC,IRDS-EFL
+PatchMTSC,IRDS-EFR
+PatchMTSC,IRDS-SAL
+PatchMTSC,IRDS-SAR
+PatchMTSC,IRDS-SFE
+PatchMTSC,IRDS-SFR
+PatchMTSC,IRDS-STL
+PatchMTSC,IRDS-STR
+PatchMTSC,ImaginedFeetHands
+PatchMTSC,InnerSpeech
+PatchMTSC,KERAAL-CTK
+PatchMTSC,KERAAL-CTK-MC
+PatchMTSC,KERAAL-ELK
+PatchMTSC,KERAAL-ELK-MC
+PatchMTSC,KERAAL-RTK-MC
+PatchMTSC,KIMORE-LA-C
+PatchMTSC,KIMORE-Sq-C
+PatchMTSC,KIMORE-TR-C
+PatchMTSC,KINECAL-3WFV
+PatchMTSC,KINECAL-GGFV
+PatchMTSC,KINECAL-QSEC
+PatchMTSC,LiveFuelMoistureContent_disc
+PatchMTSC,PronouncedSpeech
+PatchMTSC,SPHERE-WUS
+PatchMTSC,UCDHE-MP
+PatchMTSC,UCDHE-MP-MC
+PatchMTSC,UCDHE-Rowing
+PatchMTSC,UIPRMD-HS-C
+PatchMTSC,UIPRMD-IL-C
+PatchMTSC,UIPRMD-SASLR-C
+PatchMTSC,UIPRMD-SL-C
+PatchMTSC,UIPRMD-SSA-C
+PatchMTSC,UIPRMD-SSE-C
+PatchMTSC,UIPRMD-SSIER-C
+PatchMTSC,UIPRMD-SSS-C
+PatchMTSC,UIPRMD-STS-C
+PatchMTSC,VisualSpeech
+TimesNet,AsphaltPavementTypeCoordinates
+TimesNet,ButtonPress
+TimesNet,FeedbackButton
+TimesNet,IRDS-EFL
+TimesNet,IRDS-EFR
+TimesNet,IRDS-SAL
+TimesNet,IRDS-SAR
+TimesNet,IRDS-SFE
+TimesNet,IRDS-SFR
+TimesNet,IRDS-STL
+TimesNet,IRDS-STR
+TimesNet,ImaginedFeetHands
+TimesNet,InnerSpeech
+TimesNet,KERAAL-CTK
+TimesNet,KERAAL-CTK-MC
+TimesNet,KERAAL-ELK
+TimesNet,KERAAL-ELK-MC
+TimesNet,KERAAL-RTK-MC
+TimesNet,KIMORE-LA-C
+TimesNet,KIMORE-Sq-C
+TimesNet,KIMORE-TR-C
+TimesNet,KINECAL-3WFV
+TimesNet,KINECAL-GGFV
+TimesNet,KINECAL-QSEC
+TimesNet,LiveFuelMoistureContent_disc
+TimesNet,PronouncedSpeech
+TimesNet,SPHERE-WUS
+TimesNet,UCDHE-MP
+TimesNet,UCDHE-MP-MC
+TimesNet,UCDHE-Rowing
+TimesNet,UIPRMD-HS-C
+TimesNet,UIPRMD-IL-C
+TimesNet,UIPRMD-SASLR-C
+TimesNet,UIPRMD-SL-C
+TimesNet,UIPRMD-SSA-C
+TimesNet,UIPRMD-SSE-C
+TimesNet,UIPRMD-SSIER-C
+TimesNet,UIPRMD-SSS-C
+TimesNet,UIPRMD-STS-C
+TimesNet,VisualSpeech
+TimesURL,AsphaltPavementTypeCoordinates
+TimesURL,ButtonPress
+TimesURL,FeedbackButton
+TimesURL,IRDS-EFL
+TimesURL,IRDS-EFR
+TimesURL,IRDS-SAL
+TimesURL,IRDS-SAR
+TimesURL,IRDS-SFE
+TimesURL,IRDS-SFR
+TimesURL,IRDS-STL
+TimesURL,IRDS-STR
+TimesURL,ImaginedFeetHands
+TimesURL,InnerSpeech
+TimesURL,KERAAL-CTK
+TimesURL,KERAAL-CTK-MC
+TimesURL,KERAAL-ELK
+TimesURL,KERAAL-ELK-MC
+TimesURL,KERAAL-RTK-MC
+TimesURL,KIMORE-LA-C
+TimesURL,KIMORE-Sq-C
+TimesURL,KIMORE-TR-C
+TimesURL,KINECAL-3WFV
+TimesURL,KINECAL-GGFV
+TimesURL,KINECAL-QSEC
+TimesURL,LiveFuelMoistureContent_disc
+TimesURL,PronouncedSpeech
+TimesURL,SPHERE-WUS
+TimesURL,UCDHE-MP
+TimesURL,UCDHE-MP-MC
+TimesURL,UCDHE-Rowing
+TimesURL,UIPRMD-HS-C
+TimesURL,UIPRMD-IL-C
+TimesURL,UIPRMD-SASLR-C
+TimesURL,UIPRMD-SL-C
+TimesURL,UIPRMD-SSA-C
+TimesURL,UIPRMD-SSE-C
+TimesURL,UIPRMD-SSIER-C
+TimesURL,UIPRMD-SSS-C
+TimesURL,UIPRMD-STS-C
+TimesURL,VisualSpeech
+CIF,AsphaltPavementTypeCoordinates
+CIF,BasicMotions
+CIF,ButtonPress
+CIF,FeedbackButton
+CIF,FingerMovements
+CIF,IRDS-EFL
+CIF,IRDS-EFR
+CIF,IRDS-SAL
+CIF,IRDS-SAR
+CIF,IRDS-SFE
+CIF,IRDS-SFR
+CIF,IRDS-STL
+CIF,IRDS-STR
+CIF,ImaginedFeetHands
+CIF,InnerSpeech
+CIF,KERAAL-CTK
+CIF,KERAAL-CTK-MC
+CIF,KERAAL-ELK
+CIF,KERAAL-ELK-MC
+CIF,KERAAL-RTK-MC
+CIF,KIMORE-LA-C
+CIF,KIMORE-Sq-C
+CIF,KIMORE-TR-C
+CIF,KINECAL-3WFV
+CIF,KINECAL-GGFV
+CIF,KINECAL-QSEC
+CIF,LiveFuelMoistureContent_disc
+CIF,PronouncedSpeech
+CIF,SPHERE-WUS
+CIF,SelfRegulationSCP2
+CIF,UCDHE-MP
+CIF,UCDHE-MP-MC
+CIF,UCDHE-Rowing
+CIF,UIPRMD-HS-C
+CIF,UIPRMD-IL-C
+CIF,UIPRMD-SASLR-C
+CIF,UIPRMD-SL-C
+CIF,UIPRMD-SSA-C
+CIF,UIPRMD-SSE-C
+CIF,UIPRMD-SSIER-C
+CIF,UIPRMD-SSS-C
+CIF,UIPRMD-STS-C
+CIF,VisualSpeech
+ConvTran,Alzheimers
+ConvTran,AsphaltPavementTypeCoordinates
+ConvTran,ButtonPress
+ConvTran,EigenWorms
+ConvTran,FeedbackButton
+ConvTran,IRDS-EFL
+ConvTran,IRDS-EFR
+ConvTran,IRDS-SAL
+ConvTran,IRDS-SAR
+ConvTran,IRDS-SFE
+ConvTran,IRDS-SFR
+ConvTran,IRDS-STL
+ConvTran,IRDS-STR
+ConvTran,ImaginedFeetHands
+ConvTran,InnerSpeech
+ConvTran,KERAAL-CTK
+ConvTran,KERAAL-CTK-MC
+ConvTran,KERAAL-ELK
+ConvTran,KERAAL-ELK-MC
+ConvTran,KERAAL-RTK-MC
+ConvTran,KIMORE-LA-C
+ConvTran,KIMORE-Sq-C
+ConvTran,KIMORE-TR-C
+ConvTran,KINECAL-3WFV
+ConvTran,KINECAL-GGFV
+ConvTran,KINECAL-QSEC
+ConvTran,LiveFuelMoistureContent_disc
+ConvTran,PhotoStimulation
+ConvTran,PronouncedSpeech
+ConvTran,SPHERE-WUS
+ConvTran,UCDHE-MP
+ConvTran,UCDHE-MP-MC
+ConvTran,UCDHE-Rowing
+ConvTran,UIPRMD-HS-C
+ConvTran,UIPRMD-IL-C
+ConvTran,UIPRMD-SASLR-C
+ConvTran,UIPRMD-SL-C
+ConvTran,UIPRMD-SSA-C
+ConvTran,UIPRMD-SSE-C
+ConvTran,UIPRMD-SSIER-C
+ConvTran,UIPRMD-SSS-C
+ConvTran,UIPRMD-STS-C
+ConvTran,VisualSpeech
+DisjointCNN,AsphaltPavementTypeCoordinates
+DisjointCNN,BasicMotions
+DisjointCNN,ButtonPress
+DisjointCNN,FeedbackButton
+DisjointCNN,FingerMovements
+DisjointCNN,IRDS-EFL
+DisjointCNN,IRDS-EFR
+DisjointCNN,IRDS-SAL
+DisjointCNN,IRDS-SAR
+DisjointCNN,IRDS-SFE
+DisjointCNN,IRDS-SFR
+DisjointCNN,IRDS-STL
+DisjointCNN,IRDS-STR
+DisjointCNN,ImaginedFeetHands
+DisjointCNN,InnerSpeech
+DisjointCNN,KERAAL-CTK
+DisjointCNN,KERAAL-CTK-MC
+DisjointCNN,KERAAL-ELK
+DisjointCNN,KERAAL-ELK-MC
+DisjointCNN,KERAAL-RTK-MC
+DisjointCNN,KIMORE-LA-C
+DisjointCNN,KIMORE-Sq-C
+DisjointCNN,KIMORE-TR-C
+DisjointCNN,KINECAL-3WFV
+DisjointCNN,KINECAL-GGFV
+DisjointCNN,KINECAL-QSEC
+DisjointCNN,LiveFuelMoistureContent_disc
+DisjointCNN,PronouncedSpeech
+DisjointCNN,SPHERE-WUS
+DisjointCNN,SelfRegulationSCP2
+DisjointCNN,UCDHE-MP
+DisjointCNN,UCDHE-MP-MC
+DisjointCNN,UCDHE-Rowing
+DisjointCNN,UIPRMD-HS-C
+DisjointCNN,UIPRMD-IL-C
+DisjointCNN,UIPRMD-SASLR-C
+DisjointCNN,UIPRMD-SL-C
+DisjointCNN,UIPRMD-SSA-C
+DisjointCNN,UIPRMD-SSE-C
+DisjointCNN,UIPRMD-SSIER-C
+DisjointCNN,UIPRMD-SSS-C
+DisjointCNN,UIPRMD-STS-C
+DisjointCNN,VisualSpeech
+DrCIF,AsphaltPavementTypeCoordinates
+DrCIF,BasicMotions
+DrCIF,ButtonPress
+DrCIF,FeedbackButton
+DrCIF,FingerMovements
+DrCIF,IRDS-EFL
+DrCIF,IRDS-EFR
+DrCIF,IRDS-SAL
+DrCIF,IRDS-SAR
+DrCIF,IRDS-SFE
+DrCIF,IRDS-SFR
+DrCIF,IRDS-STL
+DrCIF,IRDS-STR
+DrCIF,ImaginedFeetHands
+DrCIF,InnerSpeech
+DrCIF,KERAAL-CTK
+DrCIF,KERAAL-CTK-MC
+DrCIF,KERAAL-ELK
+DrCIF,KERAAL-ELK-MC
+DrCIF,KERAAL-RTK-MC
+DrCIF,KIMORE-LA-C
+DrCIF,KIMORE-Sq-C
+DrCIF,KIMORE-TR-C
+DrCIF,KINECAL-3WFV
+DrCIF,KINECAL-GGFV
+DrCIF,KINECAL-QSEC
+DrCIF,LiveFuelMoistureContent_disc
+DrCIF,PronouncedSpeech
+DrCIF,SPHERE-WUS
+DrCIF,SelfRegulationSCP2
+DrCIF,UCDHE-MP
+DrCIF,UCDHE-MP-MC
+DrCIF,UCDHE-Rowing
+DrCIF,UIPRMD-HS-C
+DrCIF,UIPRMD-IL-C
+DrCIF,UIPRMD-SASLR-C
+DrCIF,UIPRMD-SL-C
+DrCIF,UIPRMD-SSA-C
+DrCIF,UIPRMD-SSE-C
+DrCIF,UIPRMD-SSIER-C
+DrCIF,UIPRMD-SSS-C
+DrCIF,UIPRMD-STS-C
+DrCIF,VisualSpeech
+STSF,AsphaltPavementTypeCoordinates
+STSF,BasicMotions
+STSF,ButtonPress
+STSF,FeedbackButton
+STSF,FingerMovements
+STSF,IRDS-EFL
+STSF,IRDS-EFR
+STSF,IRDS-SAL
+STSF,IRDS-SAR
+STSF,IRDS-SFE
+STSF,IRDS-SFR
+STSF,IRDS-STL
+STSF,IRDS-STR
+STSF,ImaginedFeetHands
+STSF,InnerSpeech
+STSF,KERAAL-CTK
+STSF,KERAAL-CTK-MC
+STSF,KERAAL-ELK
+STSF,KERAAL-ELK-MC
+STSF,KERAAL-RTK-MC
+STSF,KIMORE-LA-C
+STSF,KIMORE-Sq-C
+STSF,KIMORE-TR-C
+STSF,KINECAL-3WFV
+STSF,KINECAL-GGFV
+STSF,KINECAL-QSEC
+STSF,LiveFuelMoistureContent_disc
+STSF,PronouncedSpeech
+STSF,SPHERE-WUS
+STSF,SelfRegulationSCP2
+STSF,UCDHE-MP
+STSF,UCDHE-MP-MC
+STSF,UCDHE-Rowing
+STSF,UIPRMD-HS-C
+STSF,UIPRMD-IL-C
+STSF,UIPRMD-SASLR-C
+STSF,UIPRMD-SL-C
+STSF,UIPRMD-SSA-C
+STSF,UIPRMD-SSE-C
+STSF,UIPRMD-SSIER-C
+STSF,UIPRMD-SSS-C
+STSF,UIPRMD-STS-C
+STSF,VisualSpeech
+Summary,AsphaltPavementTypeCoordinates
+Summary,BasicMotions
+Summary,ButtonPress
+Summary,FeedbackButton
+Summary,FingerMovements
+Summary,IRDS-EFL
+Summary,IRDS-EFR
+Summary,IRDS-SAL
+Summary,IRDS-SAR
+Summary,IRDS-SFE
+Summary,IRDS-SFR
+Summary,IRDS-STL
+Summary,IRDS-STR
+Summary,ImaginedFeetHands
+Summary,InnerSpeech
+Summary,KERAAL-CTK
+Summary,KERAAL-CTK-MC
+Summary,KERAAL-ELK
+Summary,KERAAL-ELK-MC
+Summary,KERAAL-RTK-MC
+Summary,KIMORE-LA-C
+Summary,KIMORE-Sq-C
+Summary,KIMORE-TR-C
+Summary,KINECAL-3WFV
+Summary,KINECAL-GGFV
+Summary,KINECAL-QSEC
+Summary,LiveFuelMoistureContent_disc
+Summary,PronouncedSpeech
+Summary,SPHERE-WUS
+Summary,SelfRegulationSCP2
+Summary,UCDHE-MP
+Summary,UCDHE-MP-MC
+Summary,UCDHE-Rowing
+Summary,UIPRMD-HS-C
+Summary,UIPRMD-IL-C
+Summary,UIPRMD-SASLR-C
+Summary,UIPRMD-SL-C
+Summary,UIPRMD-SSA-C
+Summary,UIPRMD-SSE-C
+Summary,UIPRMD-SSIER-C
+Summary,UIPRMD-SSS-C
+Summary,UIPRMD-STS-C
+Summary,VisualSpeech
+TSF,AsphaltPavementTypeCoordinates
+TSF,BasicMotions
+TSF,ButtonPress
+TSF,FeedbackButton
+TSF,FingerMovements
+TSF,IRDS-EFL
+TSF,IRDS-EFR
+TSF,IRDS-SAL
+TSF,IRDS-SAR
+TSF,IRDS-SFE
+TSF,IRDS-SFR
+TSF,IRDS-STL
+TSF,IRDS-STR
+TSF,ImaginedFeetHands
+TSF,InnerSpeech
+TSF,KERAAL-CTK
+TSF,KERAAL-CTK-MC
+TSF,KERAAL-ELK
+TSF,KERAAL-ELK-MC
+TSF,KERAAL-RTK-MC
+TSF,KIMORE-LA-C
+TSF,KIMORE-Sq-C
+TSF,KIMORE-TR-C
+TSF,KINECAL-3WFV
+TSF,KINECAL-GGFV
+TSF,KINECAL-QSEC
+TSF,LiveFuelMoistureContent_disc
+TSF,PronouncedSpeech
+TSF,SPHERE-WUS
+TSF,SelfRegulationSCP2
+TSF,UCDHE-MP
+TSF,UCDHE-MP-MC
+TSF,UCDHE-Rowing
+TSF,UIPRMD-HS-C
+TSF,UIPRMD-IL-C
+TSF,UIPRMD-SASLR-C
+TSF,UIPRMD-SL-C
+TSF,UIPRMD-SSA-C
+TSF,UIPRMD-SSE-C
+TSF,UIPRMD-SSIER-C
+TSF,UIPRMD-SSS-C
+TSF,UIPRMD-STS-C
+TSF,VisualSpeech
+XCM,AsphaltPavementTypeCoordinates
+XCM,BasicMotions
+XCM,ButtonPress
+XCM,FeedbackButton
+XCM,FingerMovements
+XCM,IRDS-EFL
+XCM,IRDS-EFR
+XCM,IRDS-SAL
+XCM,IRDS-SAR
+XCM,IRDS-SFE
+XCM,IRDS-SFR
+XCM,IRDS-STL
+XCM,IRDS-STR
+XCM,ImaginedFeetHands
+XCM,InnerSpeech
+XCM,KERAAL-CTK
+XCM,KERAAL-CTK-MC
+XCM,KERAAL-ELK
+XCM,KERAAL-ELK-MC
+XCM,KERAAL-RTK-MC
+XCM,KIMORE-LA-C
+XCM,KIMORE-Sq-C
+XCM,KIMORE-TR-C
+XCM,KINECAL-3WFV
+XCM,KINECAL-GGFV
+XCM,KINECAL-QSEC
+XCM,LiveFuelMoistureContent_disc
+XCM,PronouncedSpeech
+XCM,SPHERE-WUS
+XCM,SelfRegulationSCP2
+XCM,UCDHE-MP
+XCM,UCDHE-MP-MC
+XCM,UCDHE-Rowing
+XCM,UIPRMD-HS-C
+XCM,UIPRMD-IL-C
+XCM,UIPRMD-SASLR-C
+XCM,UIPRMD-SL-C
+XCM,UIPRMD-SSA-C
+XCM,UIPRMD-SSE-C
+XCM,UIPRMD-SSIER-C
+XCM,UIPRMD-SSS-C
+XCM,UIPRMD-STS-C
+XCM,VisualSpeech
+TS2Vec,AsphaltPavementTypeCoordinates
+TS2Vec,BasicMotions
+TS2Vec,ButtonPress
+TS2Vec,FeedbackButton
+TS2Vec,FingerMovements
+TS2Vec,IRDS-EFL
+TS2Vec,IRDS-EFR
+TS2Vec,IRDS-SAL
+TS2Vec,IRDS-SAR
+TS2Vec,IRDS-SFE
+TS2Vec,IRDS-SFR
+TS2Vec,IRDS-STL
+TS2Vec,IRDS-STR
+TS2Vec,ImaginedFeetHands
+TS2Vec,InnerSpeech
+TS2Vec,KERAAL-CTK
+TS2Vec,KERAAL-CTK-MC
+TS2Vec,KERAAL-ELK
+TS2Vec,KERAAL-ELK-MC
+TS2Vec,KERAAL-RTK-MC
+TS2Vec,KIMORE-LA-C
+TS2Vec,KIMORE-Sq-C
+TS2Vec,KIMORE-TR-C
+TS2Vec,KINECAL-3WFV
+TS2Vec,KINECAL-GGFV
+TS2Vec,KINECAL-QSEC
+TS2Vec,LiveFuelMoistureContent_disc
+TS2Vec,Locust2022
+TS2Vec,PronouncedSpeech
+TS2Vec,SPHERE-WUS
+TS2Vec,SelfRegulationSCP2
+TS2Vec,UCDHE-MP
+TS2Vec,UCDHE-MP-MC
+TS2Vec,UCDHE-Rowing
+TS2Vec,UIPRMD-HS-C
+TS2Vec,UIPRMD-IL-C
+TS2Vec,UIPRMD-SASLR-C
+TS2Vec,UIPRMD-SL-C
+TS2Vec,UIPRMD-SSA-C
+TS2Vec,UIPRMD-SSE-C
+TS2Vec,UIPRMD-SSIER-C
+TS2Vec,UIPRMD-SSS-C
+TS2Vec,UIPRMD-STS-C
+TS2Vec,VisualSpeech