描述问题
Windows 11操作系统在安装源代码时遇到了一个问题
硬件详情
GPU:NVIDIA 3060
软件版本
CUDA:12.2 torch:2.1.2+cu121
重现步骤
重现问题的步骤：
- 转到'...'
- 点击'....'
- 向下滚动到'....'
- 查看错误
预期行为
(qwen) C:\Users\PD\AutoGPTQ-main>pip install -vvv -e .
Using pip 24.0 from D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\pip (python 3.9)
Non-user install because site-packages writeable
Created temporary directory: C:\Users\PD\AppData\Local\Temp\pip-build-tracker-75s6_bth
Initialized build tracking at C:\Users\PD\AppData\Local\Temp\pip-build-tracker-75s6_bth
Created build tracker: C:\Users\PD\AppData\Local\Temp\pip-build-tracker-75s6_bth
Entered build tracker: C:\Users\PD\AppData\Local\Temp\pip-build-tracker-75s6_bth
Created temporary directory: C:\Users\PD\AppData\Local\Temp\pip-install-gtc0myvn
Created temporary directory: C:\Users\PD\AppData\Local\Temp\pip-ephem-wheel-cache-x64r9_dk
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Obtaining file:///C:/Users/PD/AutoGPTQ-main
Added file:///C:/Users/PD/AutoGPTQ-main to build tracker 'C:\\Users\\PD\\AppData\\Local\\Temp\\pip-build-tracker-75s6_bth'
Running setup.py (path:C:\Users\PD\AutoGPTQ-main\setup.py) egg_info for package from file:///C:/Users/PD/AutoGPTQ-main
Created temporary directory: C:\Users\PD\AppData\Local\Temp\pip-pip-egg-info-y59xsgqq
Running command python setup.py egg_info
conda_cuda_include_dir D:\Users\PD\anaconda3\envs\qwen\Lib\site-packages\nvidia/cuda_runtime/include
running egg_info
creating C:\Users\PD\AppData\Local\Temp\pip-pip-egg-info-y59xsgqq\auto_gptq.egg-info
writing C:\Users\PD\AppData\Local\Temp\pip-pip-egg-info-y59xsgqq\auto_gptq.egg-info\PKG-INFO
writing dependency_links to C:\Users\PD\AppData\Local\Temp\pip-pip-egg-info-y59xsgqq\auto_gptq.egg-info\dependency_links.txt
writing requirements to C:\Users\PD\AppData\Local\Temp\pip-pip-egg-info-y59xsgqq\auto_gptq.egg-info\requires.txt
writing top-level names to C:\Users\PD\AppData\Local\Temp\pip-pip-egg-info-y59xsgqq\auto_gptq.egg-info\top_level.txt
writing manifest file 'C:\Users\PD\AppData\Local\Temp\pip-pip-egg-info-y59xsgqq\auto_gptq.egg-info\SOURCES.txt'
reading manifest file 'C:\Users\PD\AppData\Local\Temp\pip-pip-egg-info-y59xsgqq\auto_gptq.egg-info\SOURCES.txt'
adding license file 'LICENSE'
writing manifest file 'C:\Users\PD\AppData\Local\Temp\pip-pip-egg-info-y59xsgqq\auto_gptq.egg-info\SOURCES.txt'
Preparing metadata (setup.py) ... done
Source in c:\users\pd\autogptq-main has version 0.8.0.dev0+cu121, which satisfies requirement auto_gptq==0.8.0.dev0+cu121 from file:///C:/Users/PD/AutoGPTQ-main
Removed auto_gptq==0.8.0.dev0+cu121 from file:///C:/Users/PD/AutoGPTQ-main from build tracker 'C:\\Users\\PD\\AppData\\Local\\Temp\\pip-build-tracker-75s6_bth'
Requirement already satisfied: accelerate>=0.26.0 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from auto_gptq==0.8.0.dev0+cu121) (0.27.2)
Requirement already satisfied: datasets in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from auto_gptq==0.8.0.dev0+cu121) (2.17.1)
Requirement already satisfied: sentencepiece in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from auto_gptq==0.8.0.dev0+cu121) (0.2.0)
Requirement already satisfied: numpy in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from auto_gptq==0.8.0.dev0+cu121) (1.24.1)
Requirement already satisfied: rouge in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from auto_gptq==0.8.0.dev0+cu121) (1.0.1)
Requirement already satisfied: gekko in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from auto_gptq==0.8.0.dev0+cu121) (1.0.6)
Requirement already satisfied: torch>=1.13.0 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from auto_gptq==0.8.0.dev0+cu121) (2.1.2+cu121)
Requirement already satisfied: safetensors in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from auto_gptq==0.8.0.dev0+cu121) (0.4.2)
Requirement already satisfied: transformers>=4.31.0 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from auto_gptq==0.8.0.dev0+cu121) (4.32.1)
Requirement already satisfied: peft>=0.5.0 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from auto_gptq==0.8.0.dev0+cu121) (0.8.2)
Requirement already satisfied: tqdm in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from auto_gptq==0.8.0.dev0+cu121) (4.66.2)
Requirement already satisfied: packaging>=20.0 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from accelerate>=0.26.0->auto_gptq==0.8.0.dev0+cu121) (23.2)
Requirement already satisfied: psutil in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from accelerate>=0.26.0->auto_gptq==0.8.0.dev0+cu121) (5.9.8)
Requirement already satisfied: pyyaml in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from accelerate>=0.26.0->auto_gptq==0.8.0.dev0+cu121) (6.0.1)
Requirement already satisfied: huggingface-hub in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from accelerate>=0.26.0->auto_gptq==0.8.0.dev0+cu121) (0.20.3)
Requirement already satisfied: filelock in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from torch>=1.13.0->auto_gptq==0.8.0.dev0+cu121) (3.9.0)
Requirement already satisfied: typing-extensions in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from torch>=1.13.0->auto_gptq==0.8.0.dev0+cu121) (4.8.0)
Requirement already satisfied: sympy in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from torch>=1.13.0->auto_gptq==0.8.0.dev0+cu121) (1.12)
Requirement already satisfied: networkx in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from torch>=1.13.0->auto_gptq==0.8.0.dev0+cu121) (3.2.1)
Requirement already satisfied: jinja2 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from torch>=1.13.0->auto_gptq==0.8.0.dev0+cu121) (3.1.2)
Requirement already satisfied: fsspec in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from torch>=1.13.0->auto_gptq==0.8.0.dev0+cu121) (2023.10.0)
Requirement already satisfied: regex!=2019.12.17 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from transformers>=4.31.0->auto_gptq==0.8.0.dev0+cu121) (2023.12.25)
Requirement already satisfied: requests in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from transformers>=4.31.0->auto_gptq==0.8.0.dev0+cu121) (2.28.1)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from transformers>=4.31.0->auto_gptq==0.8.0.dev0+cu121) (0.13.3)
Requirement already satisfied: colorama in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from tqdm->auto_gptq==0.8.0.dev0+cu121) (0.4.6)
Requirement already satisfied: pyarrow>=12.0.0 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from datasets->auto_gptq==0.8.0.dev0+cu121) (15.0.0)
Requirement already satisfied: pyarrow-hotfix in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from datasets->auto_gptq==0.8.0.dev0+cu121) (0.6)
Requirement already satisfied: dill<0.3.9,>=0.3.0 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from datasets->auto_gptq==0.8.0.dev0+cu121) (0.3.8)
Requirement already satisfied: pandas in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from datasets->auto_gptq==0.8.0.dev0+cu121) (2.2.0)
Requirement already satisfied: xxhash in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from datasets->auto_gptq==0.8.0.dev0+cu121) (3.4.1)
Requirement already satisfied: multiprocess in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from datasets->auto_gptq==0.8.0.dev0+cu121) (0.70.16)
Requirement already satisfied: aiohttp in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from datasets->auto_gptq==0.8.0.dev0+cu121) (3.9.3)
Requirement already satisfied: six in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from rouge->auto_gptq==0.8.0.dev0+cu121) (1.16.0)
Requirement already satisfied: aiosignal>=1.1.2 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from aiohttp->datasets->auto_gptq==0.8.0.dev0+cu121) (1.3.1)
Requirement already satisfied: attrs>=17.3.0 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from aiohttp->datasets->auto_gptq==0.8.0.dev0+cu121) (23.2.0)
Requirement already satisfied: frozenlist>=1.1.1 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from aiohttp->datasets->auto_gptq==0.8.0.dev0+cu121) (1.4.1)
Requirement already satisfied: multidict<7.0,>=4.5 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from aiohttp->datasets->auto_gptq==0.8.0.dev0+cu121) (6.0.5)
Requirement already satisfied: yarl<2.0,>=1.0 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from aiohttp->datasets->auto_gptq==0.8.0.dev0+cu121) (1.9.4)
Requirement already satisfied: async-timeout<5.0,>=4.0 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from aiohttp->datasets->auto_gptq==0.8.0.dev0+cu121) (4.0.3)
Requirement already satisfied: charset-normalizer<3,>=2 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from requests->transformers>=4.31.0->auto_gptq==0.8.0.dev0+cu121) (2.1.1)
Requirement already satisfied: idna<4,>=2.5 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from requests->transformers>=4.31.0->auto_gptq==0.8.0.dev0+cu121) (3.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from requests->transformers>=4.31.0->auto_gptq==0.8.0.dev0+cu121) (1.26.13)
Requirement already satisfied: certifi>=2017.4.17 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from requests->transformers>=4.31.0->auto_gptq==0.8.0.dev0+cu121) (2022.12.7)
Requirement already satisfied: MarkupSafe>=2.0 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from jinja2->torch>=1.13.0->auto_gptq==0.8.0.dev0+cu121) (2.1.3)
Requirement already satisfied: python-dateutil>=2.8.2 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from pandas->datasets->auto_gptq==0.8.0.dev0+cu121) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from pandas->datasets->auto_gptq==0.8.0.dev0+cu121) (2024.1)
Requirement already satisfied: tzdata>=2022.7 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from pandas->datasets->auto_gptq==0.8.0.dev0+cu121) (2024.1)
Requirement already satisfied: mpmath>=0.19 in d:\users\pd\anaconda3\envs\qwen\lib\site-packages (from sympy->torch>=1.13.0->auto_gptq==0.8.0.dev0+cu121) (1.3.0)
Created temporary directory: C:\Users\PD\AppData\Local\Temp\pip-unpack-cxae3mfa
Installing collected packages: auto_gptq
Running setup.py develop for auto_gptq
Running command python setup.py develop
conda_cuda_include_dir D:\Users\PD\anaconda3\envs\qwen\Lib\site-packages\nvidia/cuda_runtime/include
running develop
D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\setuptools\command\develop.py:40: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!
********************************************************************************
Please avoid running ``setup.py`` and ``easy_install``.
Instead, use pypa/build, pypa/installer or other
standards-based tools.
See https://github.com/pypa/setuptools/issues/917 for details.
********************************************************************************
!!
easy_install.initialize_options(self)
D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\setuptools\_distutils\cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!
********************************************************************************
Please avoid running ``setup.py`` directly.
Instead, use pypa/build, pypa/installer or other
standards-based tools.
See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
********************************************************************************
!!
self.initialize_options()
running egg_info
creating auto_gptq.egg-info
writing auto_gptq.egg-info\PKG-INFO
writing dependency_links to auto_gptq.egg-info\dependency_links.txt
writing requirements to auto_gptq.egg-info\requires.txt
writing top-level names to auto_gptq.egg-info\top_level.txt
writing manifest file 'auto_gptq.egg-info\SOURCES.txt'
reading manifest file 'auto_gptq.egg-info\SOURCES.txt'
adding license file 'LICENSE'
writing manifest file 'auto_gptq.egg-info\SOURCES.txt'
running build_ext
D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\torch\utils\cpp_extension.py:383: UserWarning: Error checking compiler version for g++: [WinError 2] 系统找不到指定的文件。
warnings.warn(f'Error checking compiler version for {compiler}: {error}')
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File "C:\Users\PD\AutoGPTQ-main\setup.py", line 205, in <module>
setup(
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\setuptools\__init__.py", line 103, in setup
return distutils.core.setup(**attrs)
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\setuptools\_distutils\core.py", line 185, in setup
return run_commands(dist)
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\setuptools\_distutils\core.py", line 201, in run_commands
dist.run_commands()
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\setuptools\_distutils\dist.py", line 969, in run_commands
self.run_command(cmd)
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\setuptools\dist.py", line 963, in run_command
super().run_command(command)
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\setuptools\command\develop.py", line 34, in run
self.install_for_development()
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\setuptools\command\develop.py", line 111, in install_for_development
self.run_command('build_ext')
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\setuptools\dist.py", line 963, in run_command
super().run_command(command)
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\setuptools\command\build_ext.py", line 89, in run
_build_ext.run(self)
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\setuptools\_distutils\command\build_ext.py", line 345, in run
self.build_extensions()
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\torch\utils\cpp_extension.py", line 525, in build_extensions
_check_cuda_version(compiler_name, compiler_version)
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\torch\utils\cpp_extension.py", line 413, in _check_cuda_version
raise RuntimeError(CUDA_MISMATCH_MESSAGE.format(cuda_str_version, torch.version.cuda))
RuntimeError:
The detected CUDA version (11.3) mismatches the version that was used to compile
PyTorch (12.1). Please make sure to use the same CUDA versions.
error: subprocess-exited-with-error
× python setup.py develop did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
full command: 'D:\Users\PD\anaconda3\envs\qwen\python.exe' -c '
exec(compile('"'"''"'"''"'"'
# This is <pip-setuptools-caller> -- a caller that pip uses to run setup.py
#
# - It imports setuptools before invoking setup.py, to enable projects that directly
# import from `distutils.core` to work with newer packaging standards.
# - It provides a clear error message when setuptools is not installed.
# - It sets `sys.argv[0]` to the underlying `setup.py`, when invoking `setup.py` so
# setuptools doesn'"'"'t think the script is `-c`. This avoids the following warning:
# manifest_maker: standard file '"'"'-c'"'"' not found".
# - It generates a shim setup.py, for handling setup.cfg-only projects.
import os, sys, tokenize
try:
import setuptools
except ImportError as error:
print(
"ERROR: Can not execute `setup.py` since setuptools is not available in "
"the build environment.",
file=sys.stderr,
)
sys.exit(1)
__file__ = %r
sys.argv[0] = __file__
if os.path.exists(__file__):
filename = __file__
with tokenize.open(__file__) as f:
setup_py_code = f.read()
else:
filename = "<auto-generated setuptools caller>"
setup_py_code = "from setuptools import setup; setup()"
exec(compile(setup_py_code, filename, "exec"))
'"'"''"'"''"'"' % ('"'"'C:\\Users\\PD\\AutoGPTQ-main\\setup.py'"'"',), "<pip-setuptools-caller>", "exec"))' develop --no-deps
cwd: C:\Users\PD\AutoGPTQ-main\
error: subprocess-exited-with-error
× python setup.py develop did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
Exception information:
Traceback (most recent call last):
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\pip\_internal\cli\base_command.py", line 180, in exc_logging_wrapper
status = run_func(*args)
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\pip\_internal\cli\req_command.py", line 245, in wrapper
return func(self, options, args)
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\pip\_internal\commands\install.py", line 452, in run
installed = install_given_reqs(
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\pip\_internal\req\__init__.py", line 72, in install_given_reqs
requirement.install(
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\pip\_internal\req\req_install.py", line 839, in install
install_editable_legacy(
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\pip\_internal\operations\install\editable_legacy.py", line 42, in install_editable
call_subprocess(
File "D:\Users\PD\anaconda3\envs\qwen\lib\site-packages\pip\_internal\utils\subprocess.py", line 224, in call_subprocess
raise error
pip._internal.exceptions.InstallationSubprocessError: python setup.py develop exited with 1
Remote version of pip: 24.0
Local version of pip: 24.0
Was pip installed by pip? False
Removed build tracker: 'C:\\Users\\PD\\AppData\\Local\\Temp\\pip-build-tracker-75s6_bth'截图
如果适用，请添加截图以帮助解释您的问题。
其他上下文
在此添加有关问题的任何其他上下文。
7条答案
按热度按时间6rqinv9w1#
你好，@anyiz ,你的问题是：
这看起来与AutoGPTQ无关。
klsxnrf12#
你好，@anyiz。你的问题是：
这个问题看起来与AutoGPTQ无关。我重新安装了Torch=1.12.1+cu113,这次CUDA版本与之对应。然而，当我再次运行
pip install - vvv - e.脚本卸载我的Torch时，重新安装Torch=2.2.1导致了一个错误，得到一个空的CUDA版本。我该如何解决这个问题？以下是我的操作步骤：zfciruhq3#
你可能应该使用CUDA 12和现代版本的PyTorch,但起初我认为CUDA 12不在你的路径中，所以它找到了一个旧版本。确保将你的CUDA 12添加到Windows路径中，如果你不知道如何做，请在网上搜索。这与AutoGPTQ无关。
nfs0ujit4#
您需要将CUDA版本升级到12,并使用相应版本的PyTorch来运行构建。
sg2wtvxw5#
是的，它们需要匹配，但是Python需要找到正确的版本，所以当你安装它时，它需要在你的路径中。
vnzz0bqm6#
是的，它们需要匹配，但是Python需要找到正确的版本，所以在安装时它需要在你的路径中。
请问在什么情况下量化过程会突然退出程序而不出现任何错误提示？
我遇到了这个问题，情况如下：
这是我的代码以及所需库的版本：
kcwpcxri7#
我可以询问在什么情况下量化过程会突然退出程序而不出现任何错误提示吗？
我不确定，但你可能正在耗尽内存。你可能不会收到cuda内存不足的错误，因为较新的驱动程序尝试使用交换空间代替，但有时这变得过多，Windows会杀死它。我不确定是否是因为你也用完了ram,然后使用了pagefile。但无论如何，你可能正在耗尽内存。