Installation checker discussion

[set-soft]

This is open to collect opinions about the installation checker tool: kibot-check

Did it help? Did it said something confusing? Something was wrongly detected? etc.

[dbriscoe511]

Seems useful as a thing to paste in bug reports

[erikbozelie]

Hi,

I am running manjaro(5.18.10-1-MANJARO) and running into two problems with kibot-check

One is being it is saying some tools are not installed or too old
These ones are:

• InteractiveHtmlBom
• Ghostscript
• RAR

The other problem with kibot is that it cant use certain tools
ERROR:Failed to run /usr/bin/rsvg-convert, error 101 (kibot - out_navigate_results.py:136)
ERROR:Failed to run /usr/bin/convert, error 1 (kibot - out_navigate_results.py:136)

All of the above has been installed. I can run for example gs, gsc, rsvg-convert or convert from a commandline.
All versions of the installed tools are the latest.

[set-soft]

Hi @erikbozelie !

Thanks for the logs.

Ive installed kibot on a fresh installation of manjaro to avoid me having to have messed something up.

Do you have a list of commands to do it? I could try to reproduce your environment using docker.

The git error from the interactive html bom is below, but appears to be working.

Yes, this error is missleading, I asked about it to the author (openscopeproject/InteractiveHtmlBom#321)

Can pandoc be the problem? Latest version in the repository is 2.18. i have 2.5 installed via manual means.

Don't know, the problem seems to be related to the fonts, I don't know if pandoc is pulling some fonts dependencies on Manjaro.

The KiAuto you are trying is old, but I'm not sure about the reason, the logs says:

DEBUG:- Trying to download https://api.github.com/repos/INTI-CMNB/KiAuto/releases/latest (kibot - dep_downloader.py:123)
DEBUG:- Trying to download https://api.github.com/repos/INTI-CMNB/KiAuto/tarball/v1.6.15 (kibot - dep_downloader.py:123)

But currently latest is 2.0.0, so this log seems to have more than 5 days. This release should solve the recordmydesktop issue (INTI-CMNB/KiAuto@f98fa70).

In the first run KiAuto doesn't work because psutil isn't installed.

A lot of stuff fails to install in the first run when using pip, lamentably the code failed to log the error. I'm fixing the error capture.

The PcbDraw you have: 0.9.0.post2+21.g415ce87 isn't functional. I saw complains in the upstream site. So now I'm boosting the dependency to 0.9.0.3, which is my fork. As a consequence of using the broken PcbDraw a lot of things weren't generated.

I suggest upgrading KiAuto to 2.0.0 and installing PcbDraw from the last release: https://github.com/INTI-CMNB/PcbDraw/releases/tag/v0.9.0-3 in the fresh setup, to see if it fixes the problems.

Trying the last KiBot patches (originated from this discussion) could also help.

[erikbozelie]

Hi @set-soft

Here is a complete commands i used
This should do most of the installation how i have it:

Upgrading os, installing aur helper and kicad

sudo pacman -Syyu
sudo pacman -S yay
sudo pacman -S kicad kicad-library kicad-library-3d

installing kibot from git and its dependancy’s

yay -S kiauto-git kibom-git kibot-git

kibot-check will now be available

Lets fix the dependancy’s

yay -S kicost-git qrcodegen
sudo pacman -S pandoc

Some of the things needed to be installed are also available through the package manager. These do not seem to work. The ones from pip do.

pip install kicost
pip install KiKit
pip install qrcodegen
pip install kiauto
pip install svgpathtools

Interactive html bom

via its kicad’s gui plugin and content manager

reboot

The official repository pcbdraw version is 0.6.1
Can switch to 0.9.0.2 with

yay -S pcbdraw-git

We should also install that recordmydesktop app

sudo pacman -S recordmydesktop

Thanks for the help.
Ill try to upgrade kiauto to V2.0 and pcbdraw to version 0.9.0.3 to see if that fixes some issues,
Erik

[set-soft]

Hi @erikbozelie !
I was playing with a Manjaro image:

# Download the current image
docker pull manjarolinux/base
# Run bash inside the image, options:
# Automatically remove the container when it exits
# Interactive + TTY
docker run --rm -it manjarolinux/base /bin/bash
# Use a regular user, this one is always there
su builder
# Use the home as workplace
cd
# Download the script
curl https://raw.githubusercontent.com/INTI-CMNB/KiBot/master/tools/arch_install.sh > arch_install.sh
# Run it
. arch_install.sh

The script that I'm currently tring does:

#!/bin/sh
# Update the system
sudo pacman -Syyu --noconfirm
# Install the yay installer (needed for AUR) (Also installs git)
sudo pacman -S yay binutils --noconfirm
# Python installer
sudo pacman -S python-pip --noconfirm
###############################################################################
# Big dependencies
###############################################################################
# KiCad install, no 3D models (Down: 308.75 MiB, size: 1617.84 MiB)
# python-wxpython is installed here
sudo pacman -S kicad kicad-library --noconfirm
# KiBot graphic deps
# Note: librsvg is already installed for KiCad
sudo pacman -S ghostscript imagemagick librsvg --noconfirm
# Install rar (from AUR KiBot optional)
yay -S --noconfirm rar
# Install pandoc (KiBot optional)
sudo pacman -S pandoc texlive-core --noconfirm
# Not needed at all, already installed and very optional
# sudo pacman -S poppler --noconfirm
###############################################################################
# KiAuto
###############################################################################
# Dependencies
sudo pacman -S recordmydesktop xdotool xclip libxslt python-psutil python-xvfbwrapper --noconfirm
# KiAuto, clean install, no extra packages
sudo pip install KiAuto
###############################################################################
# KiBoM
###############################################################################
# KiBoM & KiBot dependency
sudo pacman -S python-xlsxwriter --noconfirm
# Install KiBoM, clean install, no extra packages (from repo)
git clone https://github.com/INTI-CMNB/KiBoM.git
cd KiBoM/
sudo pip install .
cd ..
sudo rm -r KiBoM/
###############################################################################
# iBoM
###############################################################################
# Install iBoM, clean install, no extra packages
git clone https://github.com/INTI-CMNB/InteractiveHtmlBom.git
cd InteractiveHtmlBom/
sudo pip install .
cd ..
sudo rm -r InteractiveHtmlBom/
###############################################################################
# KiDiff
###############################################################################
# Install KiDiff, clean install, no extra packages
sudo pip install KiDiff
###############################################################################
# PcbDraw 0.9.0
###############################################################################
# Dependencies
sudo pacman -S python-numpy python-lxml python-mistune1 python-pybars3 python-wand python-yaml python-pcbnewtransition python-scipy --noconfirm
yay -S python-svgpathtools-git --noconfirm
# Install PcbDraw, clean install, no extra packages
git clone https://github.com/INTI-CMNB/PcbDraw.git
cd PcbDraw/
git checkout v0.9.0_maintain
sudo pip install .
cd ..
sudo rm -r PcbDraw/
###############################################################################
# KiCost Digi-key plug-in
###############################################################################
# kicost_digikey_api_v3 dependencies
# Repeated: sudo pacman -S python-requests python-urllib3 python-six python-certifi python-setuptools --noconfirm
sudo pacman -S python-inflection python-pyopenssl python-tldextract python-dateutil --noconfirm
# Install Digi-Key KiCost plug-in, clean install, no extra packages
sudo pip install kicost_digikey_api_v3 dependencies
###############################################################################
# KiCost
###############################################################################
# KiCost dependencies
# Repeated: sudo pacman -S python-lxml python-xlsxwriter python-requests python-yaml --noconfirm
sudo pacman -S python-beautifulsoup4 python-tqdm python-validators python-colorama python-pillow --noconfirm
# Install KiCost plug-in, clean install, no extra packages
sudo pip install kicost
###############################################################################
# KiBot
###############################################################################
# KiBot install, pulls qrcodegen dependency
sudo pip install kibot

I know it looks long, but I tried to separate it stage and install things using the following priority:

• Arch repos using pacman
• AUR repos using yay
• PyPi using pip
• GitHub repos, just cloning and using pip

Almost all dependencies are from the main repo. Here you can see how I installed rar (from AUR).
I have to run the tests now, but the dependencies seems to be solved in a clean way.
I'm currently installing KiBoM, PcbDraw and iBoM from the repos manually, I'll see if I can install KiBoM and iBoM using AUR.
PcbDraw is a problem, in particular with the 1.0.0 released today.

[set-soft]

I did a couple of adjusts to the above script:

1. Arch/Manjaro seems to have strong problems with the minimum set of fonts needed to make the installed tools usable. For ImageMagick you must be sure you install gsfonts otherwise you can't handle text because the primitives uses Helvetica (an ancient sans serif font found even on Commodore 128 programs) and Manjaro doesn't install any replacement as ImageMagick dependency. Installing it ImageMagick can draw text, but I'm getting warnings like this:

Pango-WARNING **: 15:59:56.732: failed to create cairo scaled font, expect ugly output. the offending font is 'Nimbus Roman, 1333333'
Pango-WARNING **: 15:59:56.734: font_face status is: error occurred in libfreetype

2. Installing PcbDraw from the repo isn't trivial, you must tell git to also include the submodules, in addition to the right branch. I updated the script in the repo: https://github.com/INTI-CMNB/KiBot/blob/master/tools/arch_install.sh

Installing all the needed tools for testing:

sudo pacman -S flake8 python-pytest python-pytest-xdist python-wheel diffutils fluxbox x11vnc wmctrl unzip zbar python-coverage wget --noconfirm
# sudo pacman procps-ng python-setuptools python-pip curl --noconfirm
# For the makefile
sudo pacman -S --noconfirm  make python-pre-commit
yay -S --noconfirm  python-xlsx2csv

I was able to run all the regression tests. Some tests files because KiCad image generation is slightly inconsistent, changes in the KiCad version and/or underlying libs produces small differences, specially in the gradient found at edges. But overall KiBot seems to work as expected using the Manjaro image.

[taotieren]

yay -S kibot

[mdeweerd]

kibot-checker is/has been usefull, I would even add it as a kibot target to log the version in a file in the target directory to be able to check later which versions were used in producing the output.

[set-soft]

I added a new output called info, it just saves the kibot-check output.
More info could be added in the future.

[erikbozelie]

upgrading kiauto to V2.0 and pcbdraw to version 0.9.0.3 has caused some other issues.

Ill try to make a docker image for you.