Trouble with MaaDeps

[RieLCho]

Hi, I'm trying to catch up with maaMacGui development, but i'm having trouble with maaDeps.

First, I've tried to use maadeps-download.py, but this script didn't work out for me.

MaaAssistantArknights git:(dev) python3 maadeps-download.py 
about to download prebuilt dependency libraries for arm64-osx of 2023-04-24-3
to specify another triplet [and tag], run `maadeps-download.py <target triplet> [tag]`
e.g. `maadeps-download.py arm64-windows` or `maadeps-download.py arm64-windows 2023-04-24-3`
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 1348, in do_open
    h.request(req.get_method(), req.selector, req.data, headers,
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/http/client.py", line 1282, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/http/client.py", line 1328, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/http/client.py", line 1277, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/http/client.py", line 1037, in _send_output
    self.send(msg)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/http/client.py", line 975, in send
    self.connect()
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/http/client.py", line 1454, in connect
    self.sock = self._context.wrap_socket(self.sock,
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/ssl.py", line 513, in wrap_socket
    return self.sslsocket_class._create(
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/ssl.py", line 1071, in _create
    self.do_handshake()
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/ssl.py", line 1342, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:997)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/yangjin.cho/Desktop/MaaAssistantArknights/maadeps-download.py", line 157, in <module>
    main()
  File "/Users/yangjin.cho/Desktop/MaaAssistantArknights/maadeps-download.py", line 115, in main
    resp = retry_urlopen(req).read()
  File "/Users/yangjin.cho/Desktop/MaaAssistantArknights/maadeps-download.py", line 79, in retry_urlopen
    resp: http.client.HTTPResponse = urllib.request.urlopen(*args, **kwargs)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 216, in urlopen
    return opener.open(url, data, timeout)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 519, in open
    response = self._open(req, data)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 536, in _open
    result = self._call_chain(self.handle_open, protocol, protocol +
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 496, in _call_chain
    result = func(*args)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 1391, in https_open
    return self.do_open(http.client.HTTPSConnection, req,
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 1351, in do_open
    raise URLError(err)
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:997)>

So I've tried to build myself, using build.py inside maaDeps folder.

➜  MaaAssistantArknights git:(dev) sudo python3 MaaDeps/build.py         
Password:
host triplet for vcpkg: arm64-osx
target triplet for vcpkg: maa-arm64-osx
Detecting compiler hash for triplet arm64-osx...
Detecting compiler hash for triplet maa-arm64-osx...
The following packages will be built and installed:
  * abseil[core,cxx17]:maa-arm64-osx -> 20230125.0#1
    asio[core]:maa-arm64-osx -> 1.24.0#1
  * boost-config[core]:maa-arm64-osx -> 1.82.0#1
  * boost-mp11[core]:maa-arm64-osx -> 1.82.0#1
  * boost-uninstall[core]:maa-arm64-osx -> 1.82.0#1
  * boost-vcpkg-helpers[core]:maa-arm64-osx -> 1.82.0#1
    cpr[core,ssl]:maa-arm64-osx -> 1.10.2+3
  * cpuinfo[core]:maa-arm64-osx -> 2022-07-19#2
  * curl[core,non-http,sectransp,ssl]:maa-arm64-osx -> 8.0.1
  * date[core]:maa-arm64-osx -> 3.0.1#2
  * eigen3[core]:maa-arm64-osx -> 3.4.0#2
  * flatbuffers[core]:arm64-osx -> 23.3.3
  * flatbuffers[core]:maa-arm64-osx -> 23.3.3
  * libjpeg-turbo[core]:maa-arm64-osx -> 2.1.5.1
  * liblzma[core]:maa-arm64-osx -> 5.4.1#1
  * libpng[core]:maa-arm64-osx -> 1.6.39#1
    maa-fastdeploy[core]:maa-arm64-osx -> 2023-01-19#1 -- /Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/vcpkg-overlay/ports/maa-fastdeploy
  * maa-onnxruntime[core]:maa-arm64-osx -> 1.14.1 -- /Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/vcpkg-overlay/ports/maa-onnxruntime
    ms-gsl[core]:maa-arm64-osx -> 4.0.0
  * nlohmann-json[core]:maa-arm64-osx -> 3.11.2
  * nsync[core]:maa-arm64-osx -> 1.24.0#1
  * onnx[core]:maa-arm64-osx -> 1.13.1 -- /Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/vcpkg-overlay/ports/onnx
    opencv[core,eigen,jpeg,png,tiff,world]:maa-arm64-osx -> 4.7.0#1
    opencv4[core,eigen,jpeg,png,tiff,world]:maa-arm64-osx -> 4.7.0#5
  * protobuf[core]:arm64-osx -> 3.21.12
  * protobuf[core]:maa-arm64-osx -> 3.21.12
    range-v3[core]:maa-arm64-osx -> 0.12.0#1
  * re2[core]:maa-arm64-osx -> 2023-02-01
  * safeint[core]:maa-arm64-osx -> 3.0.26
  * tiff[core,jpeg,lzma,zip]:maa-arm64-osx -> 4.5.0#3
  * vcpkg-cmake[core]:arm64-osx -> 2022-12-22
  * vcpkg-cmake-config[core]:arm64-osx -> 2022-02-06#1
  * vcpkg-get-python-packages[core]:arm64-osx -> 2022-06-30
    zlib[core]:maa-arm64-osx -> 1.2.13
Additional packages (*) will be modified to complete this operation.
Restored 30 package(s) from /Users/yangjin.cho/.cache/vcpkg/archives in 2.1 s. Use --debug to see more details.
Installing 1/34 vcpkg-cmake-config:arm64-osx...
Elapsed time to handle vcpkg-cmake-config:arm64-osx: 4.02 ms
Installing 2/34 vcpkg-cmake:arm64-osx...
Elapsed time to handle vcpkg-cmake:arm64-osx: 3.02 ms
Installing 3/34 asio:maa-arm64-osx...
Elapsed time to handle asio:maa-arm64-osx: 217 ms
Installing 4/34 zlib:maa-arm64-osx...
Elapsed time to handle zlib:maa-arm64-osx: 3.62 ms
Installing 5/34 curl:maa-arm64-osx...
Elapsed time to handle curl:maa-arm64-osx: 12.7 ms
Installing 6/34 cpr:maa-arm64-osx...
Elapsed time to handle cpr:maa-arm64-osx: 20.6 ms
Installing 7/34 liblzma:maa-arm64-osx...
Elapsed time to handle liblzma:maa-arm64-osx: 9.28 ms
Installing 8/34 libjpeg-turbo:maa-arm64-osx...
Elapsed time to handle libjpeg-turbo:maa-arm64-osx: 8.05 ms
Installing 9/34 tiff:maa-arm64-osx...
Elapsed time to handle tiff:maa-arm64-osx: 5.64 ms
Installing 10/34 libpng:maa-arm64-osx...
Elapsed time to handle libpng:maa-arm64-osx: 8.29 ms
Installing 11/34 eigen3:maa-arm64-osx...
Elapsed time to handle eigen3:maa-arm64-osx: 550 ms
Installing 12/34 vcpkg-get-python-packages:arm64-osx...
Elapsed time to handle vcpkg-get-python-packages:arm64-osx: 4.47 ms
Installing 13/34 opencv4:maa-arm64-osx...
Elapsed time to handle opencv4:maa-arm64-osx: 106 ms
Installing 14/34 safeint:maa-arm64-osx...
Elapsed time to handle safeint:maa-arm64-osx: 3.88 ms
Installing 15/34 re2:maa-arm64-osx...
Elapsed time to handle re2:maa-arm64-osx: 8.92 ms
Installing 16/34 protobuf:arm64-osx...
Elapsed time to handle protobuf:arm64-osx: 155 ms
Installing 17/34 protobuf:maa-arm64-osx...
Elapsed time to handle protobuf:maa-arm64-osx: 97.1 ms
Installing 18/34 onnx:maa-arm64-osx...
Elapsed time to handle onnx:maa-arm64-osx: 49.4 ms
Installing 19/34 nsync:maa-arm64-osx...
Elapsed time to handle nsync:maa-arm64-osx: 11.2 ms
Installing 20/34 nlohmann-json:maa-arm64-osx...
Elapsed time to handle nlohmann-json:maa-arm64-osx: 29.1 ms
Installing 21/34 ms-gsl:maa-arm64-osx...
Elapsed time to handle ms-gsl:maa-arm64-osx: 11.8 ms
Installing 22/34 flatbuffers:arm64-osx...
Elapsed time to handle flatbuffers:arm64-osx: 36.5 ms
Installing 23/34 flatbuffers:maa-arm64-osx...
Elapsed time to handle flatbuffers:maa-arm64-osx: 26.9 ms
Installing 24/34 date:maa-arm64-osx...
Elapsed time to handle date:maa-arm64-osx: 11.1 ms
Installing 25/34 cpuinfo:maa-arm64-osx...
Elapsed time to handle cpuinfo:maa-arm64-osx: 9.58 ms
Installing 26/34 boost-uninstall:maa-arm64-osx...
Elapsed time to handle boost-uninstall:maa-arm64-osx: 5.16 ms
Installing 27/34 boost-vcpkg-helpers:maa-arm64-osx...
Elapsed time to handle boost-vcpkg-helpers:maa-arm64-osx: 9.93 ms
Installing 28/34 boost-mp11:maa-arm64-osx...
Elapsed time to handle boost-mp11:maa-arm64-osx: 21 ms
Installing 29/34 boost-config:maa-arm64-osx...
Elapsed time to handle boost-config:maa-arm64-osx: 79 ms
Installing 30/34 abseil:maa-arm64-osx...
Elapsed time to handle abseil:maa-arm64-osx: 206 ms
Installing 31/34 maa-onnxruntime:maa-arm64-osx...
Building maa-onnxruntime[core]:maa-arm64-osx...
-- [OVERLAY] Loading triplet configuration from: /Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/vcpkg-overlay/triplets/maa-arm64-osx.cmake
-- Installing port from location: /Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/vcpkg-overlay/ports/maa-onnxruntime
setting dynamic linkage for maa-onnxruntime
-- Using cached microsoft-onnxruntime-v1.14.1.tar.gz.
-- Cleaning sources at /Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/vcpkg/buildtrees/maa-onnxruntime/src/v1.14.1-f8cba2160b.clean. Use --editable to skip cleaning for the packages you specify.
-- Extracting source /Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/vcpkg/downloads/microsoft-onnxruntime-v1.14.1.tar.gz
-- Applying patch 0000-system-lib-fix.patch
-- Using source at /Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/vcpkg/buildtrees/maa-onnxruntime/src/v1.14.1-f8cba2160b.clean
-- Found external ninja('1.11.1').
-- Configuring maa-arm64-osx
-- Building maa-arm64-osx-rel
CMake Error at scripts/cmake/vcpkg_execute_build_process.cmake:134 (message):
    Command failed: /opt/homebrew/Cellar/cmake/3.29.0/bin/cmake --build . --config Release --target install -- -v -j9
    Working Directory: /Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/vcpkg/buildtrees/maa-onnxruntime/maa-arm64-osx-rel
    See logs for more information:
      /Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/vcpkg/buildtrees/maa-onnxruntime/install-maa-arm64-osx-rel-out.log

Call Stack (most recent call first):
  installed/arm64-osx/share/vcpkg-cmake/vcpkg_cmake_build.cmake:74 (vcpkg_execute_build_process)
  installed/arm64-osx/share/vcpkg-cmake/vcpkg_cmake_install.cmake:16 (vcpkg_cmake_build)
  /Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/vcpkg-overlay/ports/maa-onnxruntime/portfile.cmake:37 (vcpkg_cmake_install)
  scripts/ports.cmake:147 (include)


error: building maa-onnxruntime:maa-arm64-osx failed with: BUILD_FAILED
Please ensure you're using the latest port files with `git pull` and `vcpkg update`.
Then check for known issues at:
    https://github.com/microsoft/vcpkg/issues?q=is%3Aissue+is%3Aopen+in%3Atitle+maa-onnxruntime
You can submit a new issue at:
    https://github.com/microsoft/vcpkg/issues/new?title=[maa-onnxruntime]+Build+error&body=Copy+issue+body+from+%2FUsers%2Fyangjin.cho%2FDesktop%2FMaaAssistantArknights%2FMaaDeps%2Fvcpkg%2Finstalled%2Fvcpkg%2Fissue_body.md

Traceback (most recent call last):
  File "/Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/build.py", line 95, in <module>
    main()
  File "/Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/build.py", line 26, in main
    vcpkg_install()
  File "/Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/maadeps/runner.py", line 22, in __call__
    self.result = self.__func__(*args, **kwargs)
  File "/Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/build.py", line 19, in vcpkg_install
    vcpkg.install_manifest(basedir)
  File "/Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/maadeps/vcpkg.py", line 53, in install_manifest
    subprocess.check_call(cmd, cwd=manifest_root)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/vcpkg/vcpkg', 'install', '--x-install-root=/Users/yangjin.cho/Desktop/MaaAssistantArknights/MaaDeps/vcpkg/installed', '--triplet', 'maa-arm64-osx']' returned non-zero exit status 1.

It didn't work T T

MaaAssistantArknights git:(dev) git submodule status
1297324ea7be63d5488deeae29bd2ebda1e9bb7b MaaDeps (2023-04-24-3-1-g1297324)
0e9e36024909a570678bbde87f25ae811192bd24 src/MaaMacGui (v0.0.1-110-g0e9e360)
3adacf1d8ed4ffe4a4d4d93bdf9e1d6f8afb724e src/maa-cli (v0.4.2)
dfb2238c3882a396026d9963e0b5c6fcc6c858c4 test (heads/main)

python was 3.10, macOS 14.4

Any suggestions and ideas will be helpful!
Thanks for reading.

[RieLCho]

Self answering lol

I found out that maadeps-download.py just work when I bypass the ssl certification.
https://stackoverflow.com/questions/27835619/urllib-and-ssl-certificate-verify-failed-error

import ssl

ssl._create_default_https_context = ssl._create_unverified_context

Adding these two lines allowed me to download binaries so finally made it to /tools/build_macos_universal.zsh run correctly!