Orin NX 16G 可以运行 llama3 大模型 - V2EX

Home Sign Up Sign In

V2EX = way to explore

V2EX 是一个关于分享和探索的地方

Sign Up Now

For Existing Member Sign In

› 下载 GeForce Experience

› NVIDIA SHIELD

› GPU Ray Tracing

› NVIDIA Unix Driver

This topic created in 689 days ago, the information mentioned may be changed or developed.

参考 BV1rD421g7NT ，应该是 4bit 量化

No Comments Yet

orin llama3 quantization

About · Help · Advertise · Blog · API · FAQ · Solana · 2630 Online Highest 6679 ·

Select Language

创意工作者们的社区

World is powered by solitude

VERSION: 3.9.8.5 · 33ms · UTC 12:55 · PVG 20:55 · LAX 05:55 · JFK 08:55
♥ Do have faith in what you're doing.