mgoin/Qwen3.6-35B-A3B-2Bit-GSQ-ct
Image-Text-to-Text • 35B • Updated • 22
Michael Goin
mgoin
AI & ML interests
LLM inference optimization, compression, quantization, pruning, distillation
Recent Activity
updated a model 11 days ago
google/gemma-4-E4B-it-qat-mobile-ct updated a model 11 days ago
google/gemma-4-E2B-it-qat-mobile-ct published a model 13 days ago
google/gemma-4-E4B-it-qat-mobile-ctOrganizations
mgoin/Qwen3-0.6B-MXFP8
0.6B • Updated • 29
mgoin/GLM-4.6-FP8-BLOCK
Text Generation • 357B • Updated • 9
mgoin/Qwen3-0.6B-NVFP4
0.6B • Updated • 2
mgoin/mlperf-inference-llama3.1-8b-data
Updated
mgoin/Llama-3.1-8B-Instruct-FP8-BLOCK
8B • Updated • 3
mgoin/SEMIKONG-70B-W4A16-G128
71B • Updated • 4
mgoin/llama-4-tiny-random
Text Generation • 6.69M • Updated • 3
mgoin/Qwen1.5-14B-Chat-GPTQ
Text Generation • Updated • 3
mgoin/pixtral-12b
Image-Text-to-Text • 13B • Updated • 256 • 1
mgoin/Llama-3.2-1B-Instruct-FP8-ATTN
1B • Updated • 2
mgoin/Llama-3.2-1B-Instruct-FP8-dynamic-ATTN
1B • Updated • 1
mgoin/Pixtral-Large-Instruct-2411
Updated • 1
mgoin/Qwen2.5-Coder-32B-Instruct-fp8
Updated
mgoin/nemotron-3-8b-chat-4k-sft-hf
Text Generation • 9B • Updated • 355
mgoin/llava-onevision-qwen2-7b-ov-hf-bnb-full-4bit
Image-Text-to-Text • 8B • Updated • 5
mgoin/MiniCPM-Llama3-V-2_5-int4
Visual Question Answering • 9B • Updated • 1
mgoin/DeepSeek-Coder-V2-Lite-Instruct-FP8
16B • Updated • 3
mgoin/Mixtral-8x7B-Instruct-v0.1-FP8
47B • Updated • 4
mgoin/Nemotron-nemo-checkpoints
Updated
mgoin/Minitron-4B-Base-FP8
Text Generation • 4B • Updated • 4 • 3
mgoin/Nemotron-4-340B-Base-hf
Text Generation • 341B • Updated • 5 • 1
mgoin/Nemotron-4-340B-Instruct-hf-FP8
Text Generation • 341B • Updated • 43 • 3
mgoin/Nemotron-4-340B-Base-hf-FP8
Text Generation • 341B • Updated • 5 • 2
mgoin/Nemotron-4-340B-Instruct-hf
Text Generation • 341B • Updated • 2.65k • 4
mgoin/SparseLLama-2-7b-ultrachat_200k-pruned_50.2of4-compressed-tensors
4B • Updated • 5
mgoin/Minitron-8B-Base-FP8
Text Generation • 8B • Updated • 4 • 3
mgoin/Nemotron-4-340B-Instruct-FP8-Dynamic
Text Generation • 341B • Updated • 4
mgoin/Nemotron-4-340B-Instruct-vllm
Text Generation • 341B • Updated • 6
mgoin/Mistral-Nemo-Instruct-2407-FP8-KV
Text Generation • 12B • Updated • 77 • 1