Spaces:
Running
Running
Commit ·
a9acde3
1
Parent(s): 43749d4
Consolidate academic results into a single results_academic/ dir
Browse files- Replace the old results_academic/ contents with the newer per-model
JSONs previously living under results_academic_new/ (richer schema:
per-fold metrics, ensemble columns for GBDTs, more datasets).
- Update _load_academic_results default directory accordingly.
- Drop complete_results_acad.json (unused since the app moved to the
per-model file loader; no code path still reads it).
The old TabPFN v2.5 / TabICL v1 pretty-name mappings stay: the current
tabpfn.json and tabicl.json files provide those results (the pretty
name is applied via _MODEL_DISPLAY_PRETTY on the filename-derived id).
- app.py +2 -2
- complete_results_acad.json +0 -0
- figures_cache.json +0 -0
- results_academic/catboost.json +0 -0
- results_academic/lightgbm.json +0 -0
- results_academic/limix.json +0 -0
- results_academic/mitra.json +0 -0
- {results_academic_new → results_academic}/modern_nca.json +0 -0
- results_academic/modernnca.json +0 -0
- results_academic/realmlp.json +0 -0
- results_academic/seldon.json +0 -0
- results_academic/tabdpt.json +0 -0
- results_academic/tabfm.json +0 -0
- results_academic/tabicl.json +0 -0
- results_academic/tabicl_v1.json +0 -0
- results_academic/tabicl_v2.json +0 -0
- results_academic/tabm.json +0 -0
- {results_academic_new → results_academic}/tabpfn.json +0 -0
- results_academic/tabpfn_2_5.json +0 -0
- results_academic/tabpfn_v3.json +0 -0
- results_academic/xgboost.json +0 -0
- results_academic_new/catboost.json +0 -0
- results_academic_new/lightgbm.json +0 -0
- results_academic_new/limix.json +0 -0
- results_academic_new/mitra.json +0 -0
- results_academic_new/realmlp.json +0 -0
- results_academic_new/seldon.json +0 -0
- results_academic_new/tabdpt.json +0 -0
- results_academic_new/tabicl.json +0 -0
- results_academic_new/tabicl_v2.json +0 -0
- results_academic_new/tabm.json +0 -0
- results_academic_new/tabpfn_v3.json +0 -0
- results_academic_new/xgboost.json +0 -0
app.py
CHANGED
|
@@ -231,14 +231,14 @@ def compute_elo_for_subset(df: pd.DataFrame, metric: str = "Accuracy") -> pd.Dat
|
|
| 231 |
return df
|
| 232 |
|
| 233 |
|
| 234 |
-
# --- Load
|
| 235 |
# Each file: {model, summary, datasets: {dataset_id: {folds: [...], mean_auc, mean_accuracy}}}
|
| 236 |
# We build BOTH a per-fold long dataframe (for proper CI computation) and a
|
| 237 |
# per-dataset mean dataframe (matching the legacy schema used downstream).
|
| 238 |
import glob, os
|
| 239 |
|
| 240 |
|
| 241 |
-
def _load_academic_results(directory="
|
| 242 |
"""Load per-model JSONs into long dataframes.
|
| 243 |
|
| 244 |
Supports both schemas:
|
|
|
|
| 231 |
return df
|
| 232 |
|
| 233 |
|
| 234 |
+
# --- Load academic results from results_academic/*.json ---
|
| 235 |
# Each file: {model, summary, datasets: {dataset_id: {folds: [...], mean_auc, mean_accuracy}}}
|
| 236 |
# We build BOTH a per-fold long dataframe (for proper CI computation) and a
|
| 237 |
# per-dataset mean dataframe (matching the legacy schema used downstream).
|
| 238 |
import glob, os
|
| 239 |
|
| 240 |
|
| 241 |
+
def _load_academic_results(directory="results_academic"):
|
| 242 |
"""Load per-model JSONs into long dataframes.
|
| 243 |
|
| 244 |
Supports both schemas:
|
complete_results_acad.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
figures_cache.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic/catboost.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic/lightgbm.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic/limix.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic/mitra.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|
{results_academic_new → results_academic}/modern_nca.json
RENAMED
|
File without changes
|
results_academic/modernnca.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic/realmlp.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic/seldon.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic/tabdpt.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic/tabfm.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic/tabicl.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic/tabicl_v1.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic/tabicl_v2.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic/tabm.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|
{results_academic_new → results_academic}/tabpfn.json
RENAMED
|
File without changes
|
results_academic/tabpfn_2_5.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic/tabpfn_v3.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic/xgboost.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic_new/catboost.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic_new/lightgbm.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic_new/limix.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic_new/mitra.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic_new/realmlp.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic_new/seldon.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic_new/tabdpt.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic_new/tabicl.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic_new/tabicl_v2.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic_new/tabm.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic_new/tabpfn_v3.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
results_academic_new/xgboost.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|