Step-5-Preview EXL3 (SAGE)
Continuity + release repo for the SAGE-assisted EXL3 quantization of
Step-5-Preview-BF16 β MoE, 92 layers,
352 experts top-8, GQA 64/4, head_dim 192, 262144-token window β targeting
2x DGX Spark (GB10 / sm_121, 128 GB unified each).
Status: work in progress β no weights published yet. This repo tracks the work files (census, plans, calibration manifests, recipes, reports) as they are produced, before encode, so the pipeline can resume from any point.
Access
Public repo with gated access (manual review). Request access and it will be reviewed. Nothing here is a quality claim; see the evidence policy below.
Layout
work/STATUS.jsonβ machine-readable progresswork/census/β source inventory (arch config, shard sizes, headers)work/plans/β stream plans, size targets, budgetswork/logs/β small logs and manifests onlyrecipes/β compiled SAGE recipesreports/β measurement and validation reports
Evidence policy
Implemented code, CPU tests, GPU qualification, predicted recipe quality and measured final-model quality are different evidence levels. Never present one as another.