aquafire / llama_qwen3_vl_cmd.sh

Last active 6 months ago

Like 0

aquafire revised this gist 1 year ago · c51409e

1 file changed, 1 insertion

llama_qwen3_vl_cmd.sh (file created)
@@ -0,0 +1 @@
1 + ./build/bin/llama-server -m ~/ai/Qwen3-VL-30B-A3B-Q4_K_S.gguf --mmproj ~/ai/mmproj-Qwen3-VL-30B-A3B-F16.gguf -c 22000 --alias qwen3-vl-30b-a3b --host 192.168.0.11 --port 1234 --jinja --reasoning-format deepseek