gemma-3-12b-wmt26-fp8

A compressed, modified derivative of google/gemma-3-12b-it for the WMT26 Model Compression shared task (constrained track). This file has been modified from the original Gemma 3 release: FP8 dynamic (compressed-tensors).

  • Base model: google/gemma-3-12b-it (Google)
  • Compression: FP8 dynamic (compressed-tensors)
  • Translation directions: ces-deu eng-zho_Hans eng-ara_EG
  • Serving: vLLM, validated stack vllm==0.23.0 / transformers==5.12.1 / compressed-tensors==0.17.0. Inference entrypoint, environment, and run instructions are in the submission package (run.sh / setup.sh / requirements.txt).

Built with Gemma โ€” license & use

Gemma is provided under and subject to the Gemma Terms of Use, found at https://ai.google.dev/gemma/terms . Use is additionally governed by the Gemma Prohibited Use Policy (https://ai.google.dev/gemma/prohibited_use_policy). This is a derivative of google/gemma-3-12b-it; Gemma and its trademarks are the property of Google. By using these weights you agree to the Gemma Terms of Use.

Downloads last month
8
Safetensors
Model size
13B params
Tensor type
BF16
ยท
F8_E4M3
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for soksof/gemma-3-12b-wmt26-fp8

Quantized
(167)
this model