我正在使用tokenizers
和candle
,我的一个Windows用户在尝试构建screenpipe时遇到了两个问题:
CPU only
PS D:\AI\Screen\screen-pipe> cargo build --release
Compiling rustls-webpki v0.102.6
Compiling onig_sys v69.8.1
Compiling symphonia-utils-xiph v0.5.4
Compiling hyper-tls v0.5.0
Compiling http-body v1.0.1
Compiling spm_precompiled v0.1.4
Compiling idna v0.5.0
Compiling tokio v1.39.2
Compiling indexmap v1.9.3
Compiling macro_rules_attribute v0.2.0
Compiling ntapi v0.4.1
Compiling which v6.0.1
Compiling windows v0.54.0
Compiling digest v0.10.7
Compiling rayon-cond v0.3.0
Compiling parking_lot v0.12.3
Compiling fancy-regex v0.13.0
Compiling zune-jpeg v0.4.13
Compiling candle-nn v0.6.0
Compiling tiff v0.9.1
Compiling regex v1.10.5
Compiling crossbeam-utils v0.8.20
Compiling derive_builder v0.20.0
Compiling esaxx-rs v0.1.10
Compiling futures v0.3.30
Compiling tokio-stream v0.1.15
Compiling serde_plain v1.0.2
Compiling qoi v0.4.1
Compiling schannel v0.1.23
Compiling axum-core v0.3.4
Compiling cexpr v0.6.0
Compiling serde_json v1.0.121
Compiling tracing-core v0.1.32
Compiling native-tls v0.2.12
Compiling unicode-normalization-alignments v0.1.12
Compiling thiserror v1.0.63
Compiling reqwest v0.11.27
Compiling bitflags v2.6.0
Compiling heck v0.5.0
Compiling fastrand v2.1.0
Compiling itoa v1.0.11
Compiling unicode_categories v0.1.1
Compiling log v0.4.22
Compiling lazy_static v1.5.0
Compiling shlex v1.3.0
Compiling cpufeatures v0.2.12
Compiling strsim v0.11.1
Compiling clap_lex v0.7.2
Compiling rustc-hash v1.1.0
Compiling ryu v1.0.18
Compiling crc-catalog v2.4.0
Compiling lazycell v1.3.0
Compiling crossbeam-queue v0.3.11
Compiling url v2.5.2
Compiling clap_derive v4.5.11
Compiling sha2 v0.10.8
The following warnings were emitted during compilation:
warning: onig_sys@69.8.1: In file included from oniguruma\src/regenc.h:36,
warning: onig_sys@69.8.1: from oniguruma\src/regint.h:103,
warning: onig_sys@69.8.1: from oniguruma\src\regexec.c:36:
warning: onig_sys@69.8.1: D:\AI\Screen\screen-pipe\target\release\build\onig_sys-308529629068d6af\out/config.h:32:15: error: two or more data types in declaration specifiers
warning: onig_sys@69.8.1: 32 | #define uid_t int
warning: onig_sys@69.8.1: | ^~~
warning: onig_sys@69.8.1: D:\AI\Screen\screen-pipe\target\release\build\onig_sys-308529629068d6af\out/config.h:33:15: error: two or more data types in declaration specifiers
warning: onig_sys@69.8.1: 33 | #define gid_t int
warning: onig_sys@69.8.1: | ^~~
error: failed to run custom build command for `onig_sys v69.8.1`
Caused by:
process didn't exit successfully: `D:\AI\Screen\screen-pipe\target\release\build\onig_sys-d764c792d708edb0\build-script-build` (exit code: 1)
--- stdout
cargo:rerun-if-env-changed=RUSTONIG_DYNAMIC_LIBONIG
cargo:rerun-if-env-changed=RUSTONIG_STATIC_LIBONIG
cargo:rerun-if-env-changed=RUSTONIG_SYSTEM_LIBONIG
OUT_DIR = Some(D:\AI\Screen\screen-pipe\target\release\build\onig_sys-308529629068d6af\out)
TARGET = Some(x86_64-pc-windows-gnu)
OPT_LEVEL = Some(3)
HOST = Some(x86_64-pc-windows-gnu)
cargo:rerun-if-env-changed=CC_x86_64-pc-windows-gnu
CC_x86_64-pc-windows-gnu = None
cargo:rerun-if-env-changed=CC_x86_64_pc_windows_gnu
CC_x86_64_pc_windows_gnu = None
cargo:rerun-if-env-changed=HOST_CC
HOST_CC = None
cargo:rerun-if-env-changed=CC
CC = None
cargo:rerun-if-env-changed=CC_ENABLE_DEBUG_OUTPUT
RUSTC_WRAPPER = None
cargo:rerun-if-env-changed=CRATE_CC_NO_DEFAULTS
CRATE_CC_NO_DEFAULTS = None
DEBUG = Some(false)
CARGO_CFG_TARGET_FEATURE = Some(cmpxchg16b,fxsr,sse,sse2,sse3)
cargo:rerun-if-env-changed=CFLAGS_x86_64-pc-windows-gnu
CFLAGS_x86_64-pc-windows-gnu = None
cargo:rerun-if-env-changed=CFLAGS_x86_64_pc_windows_gnu
CFLAGS_x86_64_pc_windows_gnu = None
cargo:rerun-if-env-changed=HOST_CFLAGS
HOST_CFLAGS = None
cargo:rerun-if-env-changed=CFLAGS
CFLAGS = None
cargo:warning=In file included from oniguruma\src/regenc.h:36,
cargo:warning= from oniguruma\src/regint.h:103,
cargo:warning= from oniguruma\src\regexec.c:36:
cargo:warning=D:\AI\Screen\screen-pipe\target\release\build\onig_sys-308529629068d6af\out/config.h:32:15: error: two or more data types in declaration specifiers
cargo:warning= 32 | #define uid_t int
cargo:warning= | ^~~
cargo:warning=D:\AI\Screen\screen-pipe\target\release\build\onig_sys-308529629068d6af\out/config.h:33:15: error: two or more data types in declaration specifiers
cargo:warning= 33 | #define gid_t int
cargo:warning= | ^~~
--- stderr
error occurred: Command "gcc.exe" "-O3" "-ffunction-sections" "-fdata-sections" "-m64" "-I" "D:\\AI\\Screen\\screen-pipe\\target\\release\\build\\onig_sys-308529629068d6af\\out" "-I" "oniguruma\\src" "-o" "D:\\AI\\Screen\\screen-pipe\\target\\release\\build\\onig_sys-308529629068d6af\\out\\abd886268342579b-regexec.o" "-c" "oniguruma\\src\\regexec.c" with args gcc.exe did not execute successfully (status code exit code: 1).
warning: build failed, waiting for other jobs to finish...
Building [=================> ] 446/606: windows
cuda
huggingface/candle#353
他只是想让至少在CPU上正常工作,尝试在Windows上禁用onig
,因为似乎你的Cargo.toml
中有optional
,但然后构建器抱怨没有onig
。
如何在windows
上构建分词器?
2条答案
按热度按时间7dl7o3gd1#
你还可以使用
unstable_wasm
来使用高级正则表达式。atmip9wb2#
你是对的,它原本应该是可选的😓现在不是了。