LLaMA Int8 4bit ChatBot Guide v2
9-3-23 Added Torrent for HFv2 Model Weights, required for ooga’s webUI, Kobold, Tavern.11-3-23 There’s a new torrent version of the 4bit weights called “LLaMA-HFv2-4bit”. The old “LLaMA-4bit” torrent may be fine. But if you have any issues with it, it’s recommended to update...