alexandreabraham commited on
Commit
a9acde3
·
1 Parent(s): 43749d4

Consolidate academic results into a single results_academic/ dir

Browse files

- Replace the old results_academic/ contents with the newer per-model
JSONs previously living under results_academic_new/ (richer schema:
per-fold metrics, ensemble columns for GBDTs, more datasets).
- Update _load_academic_results default directory accordingly.
- Drop complete_results_acad.json (unused since the app moved to the
per-model file loader; no code path still reads it).

The old TabPFN v2.5 / TabICL v1 pretty-name mappings stay: the current
tabpfn.json and tabicl.json files provide those results (the pretty
name is applied via _MODEL_DISPLAY_PRETTY on the filename-derived id).

app.py CHANGED
@@ -231,14 +231,14 @@ def compute_elo_for_subset(df: pd.DataFrame, metric: str = "Accuracy") -> pd.Dat
231
  return df
232
 
233
 
234
- # --- Load new academic results from results_academic/*.json ---
235
  # Each file: {model, summary, datasets: {dataset_id: {folds: [...], mean_auc, mean_accuracy}}}
236
  # We build BOTH a per-fold long dataframe (for proper CI computation) and a
237
  # per-dataset mean dataframe (matching the legacy schema used downstream).
238
  import glob, os
239
 
240
 
241
- def _load_academic_results(directory="results_academic_new"):
242
  """Load per-model JSONs into long dataframes.
243
 
244
  Supports both schemas:
 
231
  return df
232
 
233
 
234
+ # --- Load academic results from results_academic/*.json ---
235
  # Each file: {model, summary, datasets: {dataset_id: {folds: [...], mean_auc, mean_accuracy}}}
236
  # We build BOTH a per-fold long dataframe (for proper CI computation) and a
237
  # per-dataset mean dataframe (matching the legacy schema used downstream).
238
  import glob, os
239
 
240
 
241
+ def _load_academic_results(directory="results_academic"):
242
  """Load per-model JSONs into long dataframes.
243
 
244
  Supports both schemas:
complete_results_acad.json DELETED
The diff for this file is too large to render. See raw diff
 
figures_cache.json CHANGED
The diff for this file is too large to render. See raw diff
 
results_academic/catboost.json CHANGED
The diff for this file is too large to render. See raw diff
 
results_academic/lightgbm.json CHANGED
The diff for this file is too large to render. See raw diff
 
results_academic/limix.json CHANGED
The diff for this file is too large to render. See raw diff
 
results_academic/mitra.json CHANGED
The diff for this file is too large to render. See raw diff
 
{results_academic_new → results_academic}/modern_nca.json RENAMED
File without changes
results_academic/modernnca.json DELETED
The diff for this file is too large to render. See raw diff
 
results_academic/realmlp.json CHANGED
The diff for this file is too large to render. See raw diff
 
results_academic/seldon.json CHANGED
The diff for this file is too large to render. See raw diff
 
results_academic/tabdpt.json CHANGED
The diff for this file is too large to render. See raw diff
 
results_academic/tabfm.json ADDED
The diff for this file is too large to render. See raw diff
 
results_academic/tabicl.json CHANGED
The diff for this file is too large to render. See raw diff
 
results_academic/tabicl_v1.json DELETED
The diff for this file is too large to render. See raw diff
 
results_academic/tabicl_v2.json CHANGED
The diff for this file is too large to render. See raw diff
 
results_academic/tabm.json CHANGED
The diff for this file is too large to render. See raw diff
 
{results_academic_new → results_academic}/tabpfn.json RENAMED
File without changes
results_academic/tabpfn_2_5.json DELETED
The diff for this file is too large to render. See raw diff
 
results_academic/tabpfn_v3.json CHANGED
The diff for this file is too large to render. See raw diff
 
results_academic/xgboost.json CHANGED
The diff for this file is too large to render. See raw diff
 
results_academic_new/catboost.json DELETED
The diff for this file is too large to render. See raw diff
 
results_academic_new/lightgbm.json DELETED
The diff for this file is too large to render. See raw diff
 
results_academic_new/limix.json DELETED
The diff for this file is too large to render. See raw diff
 
results_academic_new/mitra.json DELETED
The diff for this file is too large to render. See raw diff
 
results_academic_new/realmlp.json DELETED
The diff for this file is too large to render. See raw diff
 
results_academic_new/seldon.json DELETED
The diff for this file is too large to render. See raw diff
 
results_academic_new/tabdpt.json DELETED
The diff for this file is too large to render. See raw diff
 
results_academic_new/tabicl.json DELETED
The diff for this file is too large to render. See raw diff
 
results_academic_new/tabicl_v2.json DELETED
The diff for this file is too large to render. See raw diff
 
results_academic_new/tabm.json DELETED
The diff for this file is too large to render. See raw diff
 
results_academic_new/tabpfn_v3.json DELETED
The diff for this file is too large to render. See raw diff
 
results_academic_new/xgboost.json DELETED
The diff for this file is too large to render. See raw diff