TheBloke
/

Upstage-Llama-2-70B-instruct-v2-GGML

Text Generation

Model card Files Files and versions Community

TheBloke commited on Jul 31, 2023

Commit

0ee3733

·

1 Parent(s): 51c4ebe

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -38,7 +38,7 @@ tags:
 This repo contains GGML format model files for [Upstage's Llama 2 70B Instruct v2](https://huggingface.co/upstage/Llama-2-70b-instruct-v2).
-CUDA GPU acceleration is now available for Llama 2 70B GGML files. Metal acceleration (macOS) is not yet available. I haven't tested AMD acceleration - let me know if it owrks. The following clients/libraries are known to work with these files, including with CUDA GPU acceleration:
 * [llama.cpp](https://github.com/ggerganov/llama.cpp), commit `e76d630` and later.
 * [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI.
 * [KoboldCpp](https://github.com/LostRuins/koboldcpp), version 1.37 and later. A powerful GGML web UI, especially good for story telling.

 This repo contains GGML format model files for [Upstage's Llama 2 70B Instruct v2](https://huggingface.co/upstage/Llama-2-70b-instruct-v2).
+CUDA GPU acceleration is now available for Llama 2 70B GGML files. Metal acceleration (macOS) is not yet available. I haven't tested AMD acceleration - let me know if it works. The following clients/libraries are known to work with these files, including with CUDA GPU acceleration:
 * [llama.cpp](https://github.com/ggerganov/llama.cpp), commit `e76d630` and later.
 * [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI.
 * [KoboldCpp](https://github.com/LostRuins/koboldcpp), version 1.37 and later. A powerful GGML web UI, especially good for story telling.