xinference

Question

docker启动xinference报
File “/usr/local/1ib/python3.10/diat-packages/11ama_cpp/_ctypes_extensions.py", line 67, in load_shared_library
return ctypes.CDLL (str(lib path), *cd11 args) # type:ignore
Vile/usr/1ib/python3.10/ctypes/init.py”, line 374, in init
self.handle = _dlopen (self._name, mode)
OSError:1ibcuda.80.1：cannot open shared object file: No such file or directory During handling of the above exception, another exception occurred:
Traceback (most recent ca11 1a8t)：
File "/usr/1oca1/bin/xinference-1oca1",1ine 8,in
sys.exit (oca1(0)
le“/nsr/1oca1/1ib/python3.10/dist-packages/click/core.py”，line 1157, in _call
return se1f.matn(targe, *wargs)
File "/usr/1oca1/1ib/python3.10/dist-packages/click/core.py", line 1078, in main
ry = se1f,nvoke(ctx)
File "/usr/10ca1/11b/python3.10/diat-packages/click/core.py",line 1434, in invoke
return ctx, invoke (se1f.calback, *xetx,params)
F1e"/usr/1oca1/1ib/python3,10/diat-packages/click/core.py", line 783,in invoke
return callback(args, *kwexgs)
le"/u8r/10ca1/1iD/pytchon3, 10/dist-packages/xinference/deploy/cmdline.py", line 226, in local
Btart 1ocal_cluster(
Pile"/usr/10ca1/11b/python3.10/di8r-packeges/xinference/deploy/cmdline.py", line 101, in start_local_cluster
from,local iroort main
1"/usr/10ca1/1ib/python3,10/digt-peekeges/xinserence/deploy/local.py, line 29, in
fromo, core, superyisor import SuperyisorActor
ile"/usr/10ca1/1ib/python3,10/di8t-pBcxeges/xinference/core/supervisor.py", line 46, in
from,tpes import PeftModelConfig
1e"/a8r/10ce1/11b/python3，10/dist-peckages/xinserenee/types.py”, Iine 408,in
fzom 11ema_cpp import Llame
1e "/u8r/10c81/1ib/python3,10/diat-peckage8/L1ama_epp/init,py”, Iine I, in
from ,11ame_cpp import x
<eThpot ur 'ge sturt 'und'dds wett/dds et Tt/eaDxod-18Tp/OT'guoynNd/aTT/T的0t/380/。TE
1ib e 1oad shared library(lib base_name, base_path)
T1e"/u8x/10ca1/110/python3，10/dist-packages/11ama_cpp/_ctypes_extenaiona.py", line 69,in load_shared1ibrary
raige RuntimeError (f"Failed to load shared 1ibrery 'llib_path'：1e1")
BuntimeErroT; Tailed to 1oed shared Iibraxy '/u8/10ca1/11b/pych.on3,10/diar-packagea/11ama_epp/210/2101lama,sol；2ibeuda,ao.2: cannot open shared object ale: Mo such tile or därectory

Answer 1

阿里嘎多学长整理AIGC生成，因移动端显示问题导致当前答案未能完全显示，请使用PC端查看更加详细的解答过程

xinference

你遇到了 Docker 启动 xinnieference 报错的问题。

根据你的问题描述，错误信息是：

File “/usr/local/lib/python3.10/site-packages/11ama_cpp/_ctypes_extensions.py", line

这suggests that there is an issue with the Python extension module ctypes when running xinnieference inside a Docker container.

可能的解决方案：

1. 检查 Docker 容器中的 Python 版本是否与 xinnieference 的依赖项相匹配。
2. 尝试使用 pip reinstall ctypes 模块。
3. 检查 Dockerfile 中的依赖项是否正确。
4. 尝试使用 docker run 命令时添加 --rm 选项，以便在容器退出时自动删除容器。

如果你需要更多帮助，请提供更多的错误信息或 Dockerfile 内容。