RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
Text Generation • 8B • Updated • 415 • 2
Granite Quantized
Quantized Granite models from IBM Research.
-
-
RedHatAI/granite-3.1-2b-base-quantized.w8a8
Text Generation • 3B • Updated • 13 -
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16
Text Generation • 8B • Updated • 1.64k • 1 -
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
Text Generation • 3B • Updated • 25 -
RedHatAI/granite-3.1-8b-base-quantized.w8a8
Text Generation • 8B • Updated • 18 -
RedHatAI/granite-3.1-2b-instruct-quantized.w4a16
Text Generation • 3B • Updated • 90.7k • 1 -
RedHatAI/granite-3.1-8b-base-quantized.w4a16
Text Generation • 8B • Updated • 139 • 1 -
RedHatAI/granite-3.1-8b-instruct-FP8-dynamic
Text Generation • 8B • Updated • 390 • 1 -
RedHatAI/granite-3.1-2b-instruct-FP8-dynamic
Text Generation • 3B • Updated • 82 -
RedHatAI/granite-3.1-2b-base-FP8-dynamic
Text Generation • 3B • Updated • 28 -
RedHatAI/granite-3.1-2b-base-quantized.w4a16
Text Generation • 3B • Updated • 127 -
RedHatAI/granite-3.1-8b-base-FP8-dynamic
Text Generation • 8B • Updated • 29 -
ibm-granite/granite-3.3-8b-instruct
Text Generation • 8B • Updated • 56.2k • 161 -
RedHatAI/granite-4.0-h-small-FP8-dynamic
Text Generation • 32B • Updated • 80 • 2 -
RedHatAI/granite-4.0-h-tiny-FP8-dynamic
Text Generation • 7B • Updated • 338 • 3 -
RedHatAI/granite-4.0-h-small
Text Generation • 32B • Updated • 12 -
RedHatAI/granite-4.0-h-tiny
Text Generation • 7B • Updated • 11 -
RedHatAI/granite-3.3-8b-instruct
Text Generation • 8B • Updated • 14 • 1