RaspberryMatic 3.59.6.20210807

[jens-maus]

This is release 3.59.6.20210807 of RaspberryMatic which is a maintenance release with bugfixes and feature changes including the following changes:

_{Hier klicken für deutschsprachige 🇩🇪🇦🇹🇨🇭 Version des ChangeLogs/Diskussionsbeitrag}

🚧 Changes:

_{For all changes, see the full commit log.}

CCU/HomeMatic service changes:

• large overhaul of the general RaspberryMatic firmware update procedure. Now the vast majority of the firmware update work is performed within the recovery system rather than performing unarchiving, checksum checks, etc. in the general WebUI. This should solve all kind of firmware update issues which popped up during the last few released updates (Kein Update (mehr) möglich von 3.57.5.20210424 auf 3.59.20210703 #1336, cf. https://homematic-forum.de/forum/viewtopic.php?f=65&t=67419).
• fixed all obsolete (thus broken) references to our previously supplied copy (and now non-exsisting) of libNRJavaSerialv8.so for all aarch64-based platforms which resulted in a crashing HMIPServer process upon restoring a backup (Backup lässt sich nicht einspielen (3.59.6.20210703 auf RPi [3b]) #1333).
• implemented a fio-based disk performance check for the firmware update process which will output performance data of the used storage device (sd card, etc.) and also may give a hint if the performance might result in lengthy firmware update procedures. This fio-based performance check is largely based on the raspberry pi agnostics test, which also uses fio for deriving sd card related performance measure. (cf. https://github.com/raspberrypi-ui/agnostics)
• fixed an issue in createBackup.sh where it didn't consider the case that the tar command to archive the /usr/local part needs to be aware of situations where files may change during backup generation (Backup bricht bei Dateiänderungen ab #1345).
• updated integrated NEO server to latest 2.7.0 version.

WebUI changes:

• fixed a broken link in the help pages linking to the official RaspberryMatic documentation (WebUI: Infoseite im Loginscreen fehlt. #1358).
• added a new WebUI bugfix patch which fixes the issue that the help page was not accessible anymore from the logout page (WebUI: Infoseite im Loginscreen fehlt. #1358).
• integrated a new performance fix within the 0111-WebUI-Fix-Translation-Performance WebUI patch which should improve the performance of displaying the device list (#1354 Performance Fix within translate.js #1355, Potential Mistake in translate.js leads to performance issue #1354, @theimo1221).
• integrated a fix for the 0031-WebUI-Fix-FileUpload WebUI patch not working correctly when cancelling the EULA dialog.
• we use /dev/shm as the primary upload directory and only use the on-disk /usr/local/tmp in case /dev/shm is full. This should speed up any WebUI-based data upload and also reduce data write operations to the underlying storage (e.g. sd card).
• general graphical image file and logo overhaul including rework of the 0036-WebUI-AppleIcons WebUI patch to more generally improve the favicon use in the WebUI.
• added a new 0125-WebUI-ChannelHighlights WebUI patch which will bring up more device channel highlights in the device list using DEV_HIGHLIGHT statements in webui.js (DC Aktualisierung/Abstürze alle 7 Tage #1207, @Maik2208).
• implemented a change to the 0122-WebUI-ProgramExecutionWithConditionCheck WebUI patch which allows to toggle the active/inactive button in case the login is an Admin session. ("Anzeige - Button" des Programmstatus unter Status und Bedienung > Programme > Aktion, umfunktionieren um damit das Programm aktiv/inaktiv zu schalten #1292, @Maik2208).

Operating system changes:

• fixed loading the base device tree for the tinkerboard which did not use a valid test statements, thus didn't load the "tinker-s.dtb" file while it should have done in case of a eMMC boot.
• updated Java JRE to latest jdk8.0.302 LTS versions.
• updated upstream Linux kernel to 5.10.55 for ova, intelnuc, odroid and tinkerboard platform.
• added missing bluetooth firmware for RTL_87XX and RTL_88XX.
• updated the RaspberryPi related WiFi firmwares to the latest versions available.
• updated the RaspberryPi related EEPROM firmware versions to latest stable pieeprom-2021-07-06.bin version.
• updated the ODROID hardkernel kernel patches to latest versions fixing potential crash issues with an ODROID-N2. (board: hardkernel: Fix random crash on Linux kernel 5.10 and newer home-assistant/operating-system#1476)
• integrated improved XenServer support for the ova platform by modifying kernel configs and adding xe-guest-utilities as a dedicated buildroot package (cf. Improve Xen support home-assistant/operating-system#1459).
• added BR2_PACKAGE_WIRELESS_REGDB package which will generate a corresponding regulatory.db file the kernel can use for setup of wireless connections. In addition, we drop the legacy CRDA functionality in the kernel since regulatory.db is used since kernel 4.15+ (cf. Drop superseeded CRDA utility home-assistant/operating-system#1452).
• increased server.max-read-idle and server.max-write-idle to 1200 seconds (20 min) in lighttpd.conf so that large file uploads/downloads will not run into a webserver timeout on slow hardware platforms or slow SD card environments anymore (Kein Update (mehr) möglich von 3.57.5.20210424 auf 3.59.20210703 #1336, cf. https://homematic-forum.de/forum/viewtopic.php?f=65&t=67419).
• added a Content-Length header check to lighttpd.conf which will allow http post/put requests with transfer-encoding: chunked to be processed correctly. This seems to finally allow to use the new ingress_stream option in the HA add-on config file and thus make ingress-based large file upload > 16MB possible (cf. https://redmine.lighttpd.net/issues/2156, HA Add-on file upload: "Maximum request body size 16777216 exceeded" #1294, Large file uploads via ingress fail with "Maximum request body size 16777216 exceeded" home-assistant/supervisor#2950).
• increased the default timeout for ha-proxy.js so that large file downloads within the ingress routed WebUI will not run into gateway error messages because our ha-proxy timed out. This should fix large file backup downloads from within our HA add-on.

👪 Contributors (alphabetically):

• @Maik2208
• @jens-maus
• @theimo1221

📝 Support:

For support on installation and help please visit the following web pages:

RaspberryMatic - Documentation 🇺🇸
RaspberryMatic - Discussions 🇺🇸
RaspberryMatic - Dokumentation 🇩🇪
RaspberryMatic - Forum 🇩🇪

📦 Download:

The following installation archives can be downloaded for different hardware platforms. To verify their integrity a sha256 checksum is provided as well. You can either upload these files using the WebUI-based update mechanism or unarchive them to e.g. flash the included *.img files on a fresh installation media (e.g. microSD card):

• RaspberryPi4 Model B, RaspberryPi Compute Module 4, RaspberryPi 400 – (installation):
  _{📦 RaspberryMatic-3.59.6.20210807-rpi4.zip
  SHA256: 950b2f169ec08e59b0099e7dd2a7931f0d72d8234da009ad7bc15a3d5a586e04}

• CCU3, ELV-Charly, RaspberryPi3 Model B+, RaspberryPi3 Model B, RaspberryPi3 Model A+, RaspberryPi Compute Module 3, RaspberryPi Compute Module 3 lite – (installation):
  _{📦 RaspberryMatic-3.59.6.20210807-rpi3.zip
  SHA256: 737ef625dbb5fe3c160ad26095712736032b1a93cd9b182714017c4fef401b2a
  📦 RaspberryMatic-3.59.6.20210807-ccu3.tgz (only for initial CCU3 Firmware -> RaspberryMatic Upgrade)
  SHA256: f4a8ee13bbac629cd89fefb662f8389ac3f2f08d72171ead44078a8fab9963e1}

• RaspberryPi2 Model B – (installation):
  _{📦 RaspberryMatic-3.59.6.20210807-rpi2.zip
  SHA256: c4738277c9f8418135fa54f1d5672a29edfee07ac6c48dfa80b97223e1cfe895}

• RaspberryPi Zero W, RaspberryPi Zero, RaspberryPi Compute Module 1, RaspberryPi1 (A+/B+) – (installation):
  _{📦 RaspberryMatic-3.59.6.20210807-rpi0.zip
  SHA256: 8c4050c78828c56d29b978ec20d7c8106c20b55cc326c0661641b82ba58a1edd}

• TinkerBoard S, TinkerBoard – (installation):
  _{📦 RaspberryMatic-3.59.6.20210807-tinkerboard.zip
  SHA256: 2b3f5bc9c65854213059dfbb6bac66de8df1361adcfa276849d454e5539cba83}

• ODROID-N2/N2+/C4/C2 – (installation):
  _{📦 RaspberryMatic-3.59.6.20210807-odroid-n2.zip
  SHA256: cd86f2fc05e8f606e2b49183becac25767b346b47f975c9526a53e5aff64bb74
  📦 RaspberryMatic-3.59.6.20210807-odroid-c4.zip
  SHA256: fcfa24a434d241c5ed59062ba0736d34739dbd2b97ff99da90df53f964a091d9
  📦 RaspberryMatic-3.59.6.20210807-odroid-c2.zip
  SHA256: e210d64d7a7b57e9a029e0e9a4c83834e13ff20401998fefa4b3244b18c40b8a}

• Intel NUC – (installation):
  _{📦 RaspberryMatic-3.59.6.20210807-intelnuc.zip
  SHA256: a85a1d80f91826b0b039ff847e05968b21624d89808cff10730d4eced13c5101}

• Open Virtual Appliance (OVA) – (ESXi, Proxmox, VirtualBox, Synology, QNAP, Workstation Player, QEmu, UNRAID, HyperV):
  _{📦 RaspberryMatic-3.59.6.20210807-ova.zip
  SHA256: 4bab9b899bddabe9b52961e7fe1e99640e07b3bb30befb476980ed5619d0b80b
  📦 RaspberryMatic-3.59.6.20210807.ova (only for initial OVA installation)
  SHA256: d377c179b16816de545c1fcdda533a110ea5d8c2d5bfafa3c3f4d9d2c97e0b4b}

• Docker / Open Container Initiative (OCI) – virtual appliance (installation):
  _{📦 RaspberryMatic-3.59.6.20210807-oci_amd64.tgz (amd64/x86_64)
  SHA256: a1aaa655b842453a77b6e7a94ca3142512ad3696e0d4ed20340f0dca5c79e4c5
  📦 RaspberryMatic-3.59.6.20210807-oci_arm64.tgz (arm64/aarch64)
  SHA256: 23123535e817a7f29c47e6d3550c5eb8d6b7ea20838b608754c37f3ccfe9f20e
  📦 RaspberryMatic-3.59.6.20210807-oci_arm.tgz (arm/armhf)
  SHA256: 8b0e85f545e21a3b6088925b141a6967e208ee0ddd23bda8be1d7d18b28f7857}

• Kubernetes / K8s – virtual appliance:
  _{see install documentation}

• Home Assistant Add-on – virtual appliance:
  _{see install documentation}

---

This discussion was created from the release RaspberryMatic 3.59.6.20210807.