Environment solving for servicex from conda-forge

[alexander-held]

The environment solving currently fails for me with conda on OSX with ARM:

$ conda create -n servicex python=3.12
$ conda activate servicex
$ conda install servicex
Collecting package metadata (current_repodata.json): done
Solving environment: unsuccessful initial attempt using frozen solve. Retrying with flexible solve.
Solving environment: unsuccessful attempt using repodata from current_repodata.json, retrying with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: unsuccessful initial attempt using frozen solve. Retrying with flexible solve.
Solving environment: |
Found conflicts! Looking for incompatible packages.
This can take several minutes.  Press CTRL-C to abort.
failed

UnsatisfiableError: The following specifications were found
to be incompatible with the existing python installation in your environment:

Specifications:

  - servicex -> python[version='>=3.11,<3.12.0a0|>=3.11,<3.12.0a0|>=3.12,<3.13.0a0|>=3.12,<3.13.0a0|>=3.7,<3.12.4.0a0|>=3|>=3.10,<3.11.0a0|>=3.10,<3.11.0a0|>=3.5|>=3.7|>=3.9|>=3.6|>=3.8,<3.13|>=3.7,<3.13|>=3.9,<3.10.0a0|>=3.9,<3.10.0a0|>=3.8,<3.9.0a0|>=3.8,<3.9.0a0|>=3.13.0rc1,<3.14.0a0|>=3.13.0rc1,<3.14.0a0|>=3.12.0rc3,<3.13.0a0|>=3.12.0rc3,<3.13.0a0|>=3.8,<3.14|>=3.6,<3.13|>=3.7.0|>=3.6.2|>=3.13,<3.14.0a0|>=3.13,<3.14.0a0',build='*_cp313|*_cpython|*_cpython|*_cp313']

Your python: python=3.12

If python is on the left-most side of the chain, that's the version you've asked for.
When python appears to the right, that indicates that the thing on the left is somehow
not available for the python version you are constrained to. Note that conda will not
change your python version to a different minor version unless you explicitly specify
that.

The following specifications were found to be incompatible with your system:

  - feature:/osx-arm64::__osx==15.1.1=0
  - python=3.12 -> __osx[version='>=11.0']
  - python=3.12 -> ncurses[version='>=6.4,<7.0a0'] -> __osx[version='>=10.9']
  - servicex -> python[version='>=3.8'] -> __osx[version='>=11.0']

Your installed version is: 15.1.1

pixi similarly does not succeed either:

$ pixi add servicex
  3 api_endpoints:
  × failed to solve the conda requirements of 'default' 'osx-arm64'
  ╰─▶ Cannot solve the request because of: servicex * cannot be installed because there are no viable options:
      └─ servicex 3.0.0 | 3.0.0 | 3.0.1 | 3.0.1 would require
         └─ aiofile *, which cannot be installed because there are no viable options:
            └─ aiofile 3.7.4 | 3.8.0 | 3.8.1 | 3.8.4 | 3.8.5 | 3.8.7 | 3.8.8 | 3.9.0 | 3.9.0 would require
               └─ caio >=0.9.0,<0.10.0, for which no candidates were found.

The installation works fine from pypi as a workaround.

cc @matthewfeickert

[matthewfeickert]

This is currently because aiofile has a dependency of

caio >=0.9.0,<0.10.0

and

caio currently doesn't build for osx-* because

# OSX does not support fdatasync

I don't know what that means, so I'll open up an issue to ask the @conda-forge/caio maintainers: conda-forge/caio-feedstock#14

---

Note: This is why I have the somewhat bizarre split of dependencies and pypi-dependencies tables in the pixi manifest for https://github.com/iris-hep/analysis-grand-challenge.

[matthewfeickert]

@henryiii have you ever come across fdatasync issues before?

[matthewfeickert]

@alexander-held I've fixed this now by providing additional builds on the caio feedstock so

$ pixi add servicex --platform linux-64 --platform osx-arm64
✔ Added servicex >=3.0.1,<4
Added these only for platform(s): linux-64, osx-arm64

works now.