Running on 8*48G 4090 successfully !
#3
by nwzjk - opened
what vllm version are you using?
what vllm version are you using?
the latest vllm main with self modification
what vllm version are you using?
what vllm version are you using?
the latest vllm main with self modification