autotrust/JEV-35B-NVFP4 — new model trending #21 on Hugging Face
AutoTrust released JEV-35B-NVFP4, a 4-bit quantization of its 35B decision model that cuts GPU memory by 65%.
AutoTrust released JEV-35B-NVFP4, an NVFP4 quantization of its JEV-35B System 1 decision model, built on Qwen3.5-35B-A3B (35B parameters, about 3B active). The 10,240 routed expert MLPs are quantized while attention, routers, the vision tower, and the decision head stay bf16. Download size falls from 71.9 GB to 25.6 GB and vLLM weight memory from 66.5 GiB to 23.3 GiB. Decision Index 0.3 is 59.18 versus 59.75 for bf16, with 96.6% of text answers unchanged and similar single-request latency on one B200.
48