[Maintenance] pip takes too long in finding boto3 versions (100+ tries & still failed to install)

[AtmaHou]

Describe the feature
Provide a dependency resolver with stricter constraints for boto3 and botocore.

Expected behavior
Direct install the expected version.

Additional context
A sample of installing process:

.....


Collecting boto3
  Downloading boto3-1.20.38-py3-none-any.whl (131 kB)
     |████████████████████████████████| 131 kB 47 kB/s
Collecting botocore<1.24.0,>=1.23.38
  Downloading botocore-1.23.38-py3-none-any.whl (8.5 MB)
     |████████████████████████████████| 8.5 MB 128 kB/s
Collecting boto3
  Downloading boto3-1.20.37-py3-none-any.whl (131 kB)
     |████████████████████████████████| 131 kB 92 kB/s
Collecting botocore<1.24.0,>=1.23.37
  Downloading botocore-1.23.37-py3-none-any.whl (8.5 MB)
     |████████████████████████████████| 8.5 MB 285 kB/s
Collecting boto3
  Downloading boto3-1.20.36-py3-none-any.whl (131 kB)
     |████████████████████████████████| 131 kB 172 kB/s
Collecting botocore<1.24.0,>=1.23.36
  Downloading botocore-1.23.36-py3-none-any.whl (8.5 MB)
     |████████████████████████████████| 8.5 MB 156 kB/s
Collecting boto3
  Downloading boto3-1.20.35-py3-none-any.whl (131 kB)
     |████████████████████████████████| 131 kB 99 kB/s
Collecting botocore<1.24.0,>=1.23.35
  Downloading botocore-1.23.35-py3-none-any.whl (8.5 MB)
     |████████████████████████████████| 8.5 MB 409 kB/s
Collecting boto3
  Downloading boto3-1.20.34-py3-none-any.whl (131 kB)
     |████████████████████████████████| 131 kB 312 kB/s
Collecting botocore<1.24.0,>=1.23.34
  Downloading botocore-1.23.34-py3-none-any.whl (8.5 MB)
     |████████████████████████████████| 8.5 MB 121 kB/s
Collecting boto3
  Downloading boto3-1.20.33-py3-none-any.whl (131 kB)
     |████████████████████████████████| 131 kB 109 kB/s
Collecting botocore<1.24.0,>=1.23.33
  Downloading botocore-1.23.33-py3-none-any.whl (8.5 MB)
     |████████████████████████████████| 8.5 MB 312 kB/s
Collecting boto3
  Downloading boto3-1.20.32-py3-none-any.whl (131 kB)
     |████████████████████████████████| 131 kB 328 kB/s
Collecting botocore<1.24.0,>=1.23.32
  Downloading botocore-1.23.32-py3-none-any.whl (8.5 MB)
     |████████████████████████████████| 8.5 MB 939 kB/s
Collecting boto3
  Downloading boto3-1.20.31-py3-none-any.whl (131 kB)
     |████████████████████████████████| 131 kB 656 kB/s
Collecting botocore<1.24.0,>=1.23.31
  Downloading botocore-1.23.31-py3-none-any.whl (8.5 MB)
     |████████████████████████████████| 8.5 MB 437 kB/s
Collecting boto3
  Downloading boto3-1.20.30-py3-none-any.whl (131 kB)
     |████████████████████████████████| 131 kB 595 kB/s
Collecting botocore<1.24.0,>=1.23.30
  Downloading botocore-1.23.30-py3-none-any.whl (8.5 MB)
     |████████████████████████████████| 8.5 MB 2.2 MB/s
Collecting boto3
  Downloading boto3-1.20.29-py3-none-any.whl (131 kB)
     |████████████████████████████████| 131 kB 2.2 MB/s
Collecting botocore<1.24.0,>=1.23.29
  Downloading botocore-1.23.29-py3-none-any.whl (8.5 MB)
     |████████████████████████████████| 8.5 MB 3.2 MB/s
Collecting boto3
  Downloading boto3-1.20.28-py3-none-any.whl (131 kB)
     |████████████████████████████████| 131 kB 6.4 MB/s
Collecting botocore<1.24.0,>=1.23.28
  Downloading botocore-1.23.28-py3-none-any.whl (8.5 MB)
     |████████████████████████████████| 8.5 MB 3.3 MB/s

.....

[zqwerty]

Could you try to create a new conda environment and install ConvLab-2 again? We don't have a constraint on the version of boto3 & botocore. In the Colab, I can install boto3-1.21.16 botocore-1.24.16

[AtmaHou]

Could you try to create a new conda environment and install ConvLab-2 again? We don't have a constraint on the version of boto3 & botocore. In the Colab, I can install boto3-1.21.16 botocore-1.24.16

The version-checking still exists (in a new conda env with python3.6.1 on linux), even if I pre-install the boto3-1.21.16 botocore-1.24.16 :(

[AtmaHou]

Tried with python 3.7.11 and got new error:

Failed to build jsonnet quadprog
ERROR: Could not build wheels for quadprog which use PEP 517 and cannot be installed directly

[AtmaHou]

I succeed to fix all error, by
(1) Use a higher version of python.
(2) Fix the installation of jsonnet quadprog by directly installing them with conda.

[zqwerty]

maybe update the pip will solve the problem, too

[AtmaHou]

maybe update the pip will solve the problem, too

emmmm.. The problem seems coming from the deep dependency crash caused by python version, since I try many different version (3.5.0, 3.5.8, 3.6.0, 3.6.1, 3.7.0 etc) and confront to various problems. The problem is solved with 3.7.11 which is close to the version of Colab

[zqwerty]

@AtmaHou We release ConvLab-3, using python>=3.8, have a try!