runtime error
Exit code: 1. Reason: Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/llama_cpp/_ctypes_extensions.py", line 67, in load_shared_library return ctypes.CDLL(str(lib_path), **cdll_args) # type: ignore ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/ctypes/__init__.py", line 379, in __init__ self._handle = _dlopen(self._name, mode) ^^^^^^^^^^^^^^^^^^^^^^^^^ OSError: libcuda.so.1: cannot open shared object file: No such file or directory During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/app/app.py", line 48, in <module> from llama_cpp import Llama File "/usr/local/lib/python3.12/site-packages/llama_cpp/__init__.py", line 1, in <module> from .llama_cpp import * File "/usr/local/lib/python3.12/site-packages/llama_cpp/llama_cpp.py", line 43, in <module> _lib = load_shared_library(_lib_base_name, _base_path) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/llama_cpp/_ctypes_extensions.py", line 69, in load_shared_library raise RuntimeError(f"Failed to load shared library '{lib_path}': {e}") RuntimeError: Failed to load shared library '/usr/local/lib/python3.12/site-packages/llama_cpp/lib/libllama.so': libcuda.so.1: cannot open shared object file: No such file or directory
Container logs:
Fetching error logs...