unclemusclez commited on
Commit
03a4afc
·
verified ·
1 Parent(s): b6f4906

Update start.sh

Browse files
Files changed (1) hide show
  1. start.sh +4 -0
start.sh CHANGED
@@ -1,2 +1,6 @@
 
 
 
 
1
  ollama serve & sleep 5
2
  python app.py
 
1
+ cd llama.cpp
2
+ LLAMA_CUDA=1 make -j llama-quantize llama-gguf-split llama-imatrix
3
+
4
+ cd ..
5
  ollama serve & sleep 5
6
  python app.py