{"id":219,"date":"2026-08-28T10:04:23","date_gmt":"2026-08-28T01:04:23","guid":{"rendered":"https:\/\/stratos-research.com\/?p=219"},"modified":"2026-08-28T10:04:23","modified_gmt":"2026-08-28T01:04:23","slug":"nvidia-nemotron-3-5-lightning-30b-%e3%81%ae%e3%83%8f%e3%83%bc%e3%83%89%e3%82%a6%e3%82%a7%e3%82%a2%e5%af%be%e5%bf%9c%e3%81%a8%e3%83%87%e3%83%97%e3%83%ad%e3%82%a4%e3%82%ac","status":"publish","type":"post","link":"https:\/\/stratos-research.com\/?p=219","title":{"rendered":"NVIDIA Nemotron\u202f3.5\u202fLightning\u202f30B \u306e\u30cf\u30fc\u30c9\u30a6\u30a7\u30a2\u5bfe\u5fdc\u3068\u30c7\u30d7\u30ed\u30a4\u30ac\u30a4\u30c9"},"content":{"rendered":"<h2>\u6982\u8981<\/h2>\n<p>NVIDIA \u304c\u958b\u767a\u3057\u305f\u5927\u898f\u6a21\u8a00\u8a9e\u30e2\u30c7\u30eb\u300cNVIDI\u200bA\u2011Nemotron\u20113.5\u2011Lightning\u201130B\u2011A3B\u2011NVFP4\u300d\u306f\u300130\u202fB \u30d1\u30e9\u30e1\u30fc\u30bf\uff08\u3046\u3061 3\u202fB \u304c\u30a2\u30af\u30c6\u30a3\u30d6\uff09\u3092\u6301\u3061\u3001\u6700\u5927 1\u202fM \u30c8\u30fc\u30af\u30f3\u306e\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u9577\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u307e\u3059\u3002\u82f1\u8a9e\u30fb\u30b9\u30da\u30a4\u30f3\u8a9e\u30fb\u30d5\u30e9\u30f3\u30b9\u8a9e\u30fb\u30c9\u30a4\u30c4\u8a9e\u30fb\u30a4\u30bf\u30ea\u30a2\u8a9e\u30fb\u65e5\u672c\u8a9e\u306a\u3069\u8907\u6570\u8a00\u8a9e\u306b\u5bfe\u5fdc\u3057\u3001\u5546\u7528\u5229\u7528\u304c\u53ef\u80fd\u3067\u3059\u3002<\/p>\n<h2>\u30e2\u30c7\u30eb\u69cb\u6210<\/h2>\n<p>&#8211; \u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\uff1aMixture\u2011of\u2011Experts \u30cf\u30a4\u30d6\u30ea\u30c3\u30c9\uff08Mamba\u202f2 \u3068 MoE \u5c64\u3001\u9078\u629e\u7684 Attention\uff09<br \/>\n&#8211; \u5b66\u7fd2\u30c7\u30fc\u30bf\uff1a20\u202fT \u30c8\u30fc\u30af\u30f3\u4ee5\u4e0a\u306e\u30b3\u30fc\u30c9\u30fb\u6570\u5b66\u30fb\u79d1\u5b66\u30fb\u4e00\u822c\u77e5\u8b58\u30c7\u30fc\u30bf<br \/>\n&#8211; \u8a13\u7df4\u6bb5\u968e\uff1a\u4e8b\u524d\u5b66\u7fd2 \u2192 MTP \u7d99\u7d9a\u5b66\u7fd2 \u2192 \u6559\u5e2b\u3042\u308a\u5fae\u8abf\u6574 \u2192 \u5f37\u5316\u5b66\u7fd2 \u2192 \u5f8c\u51e6\u7406\u91cf\u5b50\u5316\uff08W4A16\uff0fFP8\uff09<br \/>\n&#8211; \u30e9\u30a4\u30bb\u30f3\u30b9\uff1aOpenMDW\u20111.1 \u30e2\u30c7\u30eb\u30e9\u30a4\u30bb\u30f3\u30b9<\/p>\n<h2>\u30cf\u30fc\u30c9\u30a6\u30a7\u30a2\u5bfe\u5fdc<\/h2>\n<p>| \u30cf\u30fc\u30c9\u30a6\u30a7\u30a2 | \u5bfe\u5fdc\u65b9\u5f0f | \u30b3\u30e1\u30f3\u30c8 |<br \/>\n|&#8212;|&#8212;|&#8212;|<br \/>\n| NVIDIA Blackwell (GB200) | NVFP4 \u30c7\u30d5\u30a9\u30eb\u30c8 | 1\u202fM \u30c8\u30fc\u30af\u30f3\u691c\u8a3c\u6e08\u307f |<br \/>\n| NVIDIA DGX\u202fSpark (GB10) | NVFP4 W4A16 (Marlin) | \u63a8\u5968\u8a2d\u5b9a |<br \/>\n| NVIDIA GeForce RTX\u202f5090 | NVFP4 \u78ba\u8a8d\u672a\u5b9f\u65bd |<br \/>\n| NVIDIA Hopper (H100\/H200) | NVFP4 W4A16 (Humming) | FP4 \u30c6\u30f3\u30bd\u30eb\u30b3\u30a2\u306a\u3057 |<br \/>\n| NVIDIA Ampere (A100 \u7b49) | NVFP4 W4A16 (Humming) |<\/p>\n<h2>\u30c7\u30d7\u30ed\u30a4\u624b\u9806<\/h2>\n<p>\u4ee5\u4e0b\u306f\u4ee3\u8868\u7684\u306a vLLM \u30b3\u30de\u30f3\u30c9\u4f8b\u3067\u3059\u3002<\/p>\n<pre>\nexport MODEL_CKPT=nvidia\/NVIDI\u200bA-Nemotron-3.5-Lightning-30B-A3B-NVFP4\nexport DSPARK_CKPT=nvidia\/NVIDI\u200bA-Nemotron-3.5-Lightning-30B-A3B-NVFP4-DSpark\n\nvllm serve --model $MODEL_CKPT \\\n  --moe-backend marlin \\\n  --kv-cache-dtype fp8 \\\n  --enable-prefix-caching \\\n  --gpu-memory-utilization 0.85 \\\n  --speculative_config.num_speculative_tokens 3 \\\n  --mamba-backend flashinfer \\\n  --mamba-cache-mode align \\\n  --reasoning-parser nemotron_v3 \\\n  --speculative_config.model $DSPARK_CKPT \\\n  --tool-call-parser qwen3_coder \\\n  --enable-auto-tool-choice\n<\/pre>\n<p>\u4e0a\u8a18\u306f DGX\u202fSpark \u5411\u3051\u306e\u63a8\u5968\u8a2d\u5b9a\u3067\u3059\u3002H100 \u3067\u6700\u5927\u30b9\u30eb\u30fc\u30d7\u30c3\u30c8\u3092\u72d9\u3046\u5834\u5408\u306f\u30b9\u30da\u30ad\u30e5\u30ec\u30fc\u30c6\u30a3\u30d6\u30c7\u30b3\u30fc\u30c9\u3092\u7121\u52b9\u306b\u3057\u3001Mamba \u30ad\u30e3\u30c3\u30b7\u30e5\u3092 FP16 \u306b\u5909\u66f4\u3057\u307e\u3059\u3002<\/p>\n<h2>\u30d9\u30f3\u30c1\u30de\u30fc\u30af\u3068\u8a55\u4fa1<\/h2>\n<p>&#8211; \u8a55\u4fa1\u57fa\u76e4\uff1aNeMo Gym \/ NeMo Evaluator SDK\uff08NVIDIA \u5185\u90e8\u6e2c\u5b9a\uff09<br \/>\n&#8211; \u4e3b\u306a\u6307\u6a19\uff1a\u77e5\u8b58\u30fb\u63a8\u8ad6\u3001\u6307\u793a\u8ffd\u5f93\u3001\u30b3\u30fc\u30c7\u30a3\u30f3\u30b0\u3001\u30a8\u30fc\u30b8\u30a7\u30f3\u30c8\u3001\u30c4\u30fc\u30eb\u547c\u3073\u51fa\u3057\u3001\u9577\u6587\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8<br \/>\n&#8211; \u7d50\u679c\u306f\u516c\u5f0f NVFP4 \u30c1\u30a7\u30c3\u30af\u30dd\u30a4\u30f3\u30c8\u306b\u57fa\u3065\u304f\u3082\u306e\u3067\u3059\u3002<\/p>\n<h2>\u5229\u7528\u6761\u4ef6\u3068\u30e9\u30a4\u30bb\u30f3\u30b9<\/h2>\n<p>\u672c\u30e2\u30c7\u30eb\u306e\u4f7f\u7528\u6a29\u306f OpenMDW\u20111.1 \u30e9\u30a4\u30bb\u30f3\u30b9\u3067\u7ba1\u7406\u3055\u308c\u3001\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u6642\u306b\u540c\u610f\u304c\u5fc5\u8981\u3067\u3059\u3002<\/p>\n<h2>\u30ea\u30ea\u30fc\u30b9\u60c5\u5831<\/h2>\n<p>&#8211; \u767a\u58f2\u65e5\uff1a2026\u5e748\u670811\u65e5\uff08Hugging\u202fFace\uff09<br \/>\n&#8211; \u30d0\u30fc\u30b8\u30e7\u30f3\uff1aGA\uff082026\u201108\u201111\uff09<br \/>\n&#8211; \u958b\u767a\u671f\u9593\uff1a2025\u5e7412\u6708\u301c2026\u5e745\u6708<br \/>\n&#8211; \u30c7\u30fc\u30bf\u6700\u7d42\u66f4\u65b0\u65e5\uff1a2026\u5e745\u6708<\/p>\n<h2>\u30bd\u30d5\u30c8\u30a6\u30a7\u30a2\u7d71\u5408<\/h2>\n<p>&#8211; \u30e9\u30f3\u30bf\u30a4\u30e0\uff1aPyTorch<br \/>\n&#8211; \u5bfe\u5fdc OS\uff1aLinux<br \/>\n&#8211; \u63a8\u5968\u30cf\u30fc\u30c9\u30a6\u30a7\u30a2\uff1aNVIDIA Blackwell\u3001Hopper\u3001Ampere \u7cfb\u5217<br \/>\n&#8211; \u63a8\u5968\u30c4\u30fc\u30eb\u30c1\u30a7\u30fc\u30f3\uff1avLLM\uff08\u30d0\u30fc\u30b8\u30e7\u30f3 vllm\/vllm-openai:v0.27.1\uff09<\/p>\n<h2>\u307e\u3068\u3081<\/h2>\n<p>NVIDI\u200bA\u2011Nemotron\u20113.5\u2011Lightning\u201130B\u2011A3B\u2011NVFP4 \u306f\u3001\u6700\u65b0\u306e NVFP4 \u30cf\u30fc\u30c9\u30a6\u30a7\u30a2\u6700\u9069\u5316\u3068 MTP \u6280\u8853\u3092\u7d44\u307f\u5408\u308f\u305b\u305f\u9ad8\u6027\u80fd LLM \u3067\u3001\u69d8\u3005\u306a GPU \u74b0\u5883\u3067\u9ad8\u901f\u63a8\u8ad6\u304c\u53ef\u80fd\u3067\u3059\u3002\u516c\u5f0f\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u3068\u30d9\u30f3\u30c1\u30de\u30fc\u30af\u7d50\u679c\u3092\u53c2\u8003\u306b\u3001\u7528\u9014\u306b\u5fdc\u3058\u305f\u30c7\u30d7\u30ed\u30a4\u8a2d\u5b9a\u3092\u3054\u5229\u7528\u304f\u3060\u3055\u3044\u3002<\/p>\n<p class=\"source-link\">\u5143\u8a18\u4e8b: <a href=\"https:\/\/huggingface.co\/nvidia\/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4\" rel=\"noopener noreferrer\">https:\/\/huggingface.co\/nvidia\/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u6982\u8981 NVIDIA \u304c\u958b\u767a\u3057\u305f\u5927\u898f\u6a21\u8a00\u8a9e\u30e2\u30c7 [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":220,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_spp_pexels_query":"","_jetpack_hide_featured_image":false,"_jetpack_featured_image_duplicate_dismissed":0,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[2],"tags":[],"class_list":["post-219","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/stratos-research.com\/wp-content\/uploads\/2026\/08\/painted-218-6UcKcx.webp","_links":{"self":[{"href":"https:\/\/stratos-research.com\/index.php?rest_route=\/wp\/v2\/posts\/219","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/stratos-research.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/stratos-research.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/stratos-research.com\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/stratos-research.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=219"}],"version-history":[{"count":0,"href":"https:\/\/stratos-research.com\/index.php?rest_route=\/wp\/v2\/posts\/219\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/stratos-research.com\/index.php?rest_route=\/wp\/v2\/media\/220"}],"wp:attachment":[{"href":"https:\/\/stratos-research.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=219"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/stratos-research.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=219"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/stratos-research.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=219"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}