CATALOGUE RECORD / HUB-DERIVED
ibm-research
PowerMoE-3b
Revision 13fcb5a98001438bed01cf1ac4b423751dc4c2ea
TENSOR ACCOUNTING
Where the bytes are.
Summed from the safetensors index, one row per dtype. A parameter count alone cannot produce this figure, because a checkpoint may mix widths.
| Dtype | Parameters | Bytes each | Bytes | Share |
|---|---|---|---|---|
F32 | 3,374,286,336 | 4 | 13.5 GB | 100.0% |
EVERY FIELD, WITH ITS ORIGIN
Sourced or undetermined. Never assumed.
Each value below names the exact API field it was computed from. Where the Hub does not establish a value, the reason is shown instead of a plausible default.
- Architecture
- granitemoe
config.model_type - Model classes
- GraniteMoeForCausalLM
config.architectures - Routed experts
- UndeterminedThe published config exposes no routed-expert count. The Hub's config summary omits fields some architectures place only in the full config.json.
- Experts per token
- 8
config.num_experts_per_tok - Shared experts
- UndeterminedThe published config declares no always-on shared experts.
- Routing sparsity
- UndeterminedRouting sparsity requires both a routed-expert and a per-token expert count.
- Total parameters
- 3,374,286,336
safetensors.total - Checkpoint bytes
- 13,497,145,344 (13.5 GB)
safetensors.parameters - Ships below 16-bit
- No
safetensors.parameters - Quantisation method
- UndeterminedThe repository declares no quantization method, which normally means unquantized weights.
- Trained context
- UndeterminedThe config summary omits max_position_embeddings. Trained context is a model-card claim, not a derivable fact.
- Declared licence
- apache-2.0
cardData.license - Base model
- UndeterminedThe repository declares no base model.
- Library
- transformers
library_name - Files in repository
- 11
siblings - Last modified
- 2024-09-24
lastModified
LICENCE POSTURE
Permissive
The repository declares a licence that is generally read as permitting commercial use. Read the licence file in the repository before relying on that.
This is a reading of a metadata field, not legal advice, and it does not account for the licences of upstream models or training data.
WEIGHT RESIDENCY FLOOR
The count below which it cannot fit.
Ceiling of checkpoint bytes over advertised accelerator memory. This is a lower bound on accelerator count for weights alone — KV cache, activations and runtime overhead all sit on top, so a real deployment needs more.