Post
118
Excited to launch SKT-ST-X-0-3B by SKT AI Labs! đđźđł
âA powerful 3B Parameter Mixture of Experts (MoE) model optimized for high-performance reasoning with a small footprint.
â--> Quick Specs:
> Total Params: ~3B | Active Params: ~1.1B (2 experts/token)
> Pre-trained on 40B tokens (SKT-OMNI-CORPUS-2T)
1.Context: 8K tokens
2.Bilingual: English & Hindi đŹđ§đźđł
3. Base: Built on ST-X-0 with Mixtral stability
âGet 3B intelligence at 1B inference speeds. Fully open-source under Apache-2.0! đ
âđ Try it on Hugging Face: sKT-Ai-Labs/SKT-ST-X-0-3B
â#AI #OpenSource #LLM #MixtureOfExperts #SKTAILabs #MachineLearning
âA powerful 3B Parameter Mixture of Experts (MoE) model optimized for high-performance reasoning with a small footprint.
â--> Quick Specs:
> Total Params: ~3B | Active Params: ~1.1B (2 experts/token)
> Pre-trained on 40B tokens (SKT-OMNI-CORPUS-2T)
1.Context: 8K tokens
2.Bilingual: English & Hindi đŹđ§đźđł
3. Base: Built on ST-X-0 with Mixtral stability
âGet 3B intelligence at 1B inference speeds. Fully open-source under Apache-2.0! đ
âđ Try it on Hugging Face: sKT-Ai-Labs/SKT-ST-X-0-3B
â#AI #OpenSource #LLM #MixtureOfExperts #SKTAILabs #MachineLearning