Loading integration fails with hahomematic 1.67.0 #1776

towo · 2024-10-16T08:09:16Z

I agree to the following

I have read the documentation right now
I have read the FAQs right now
I am aware of the latest release notes
I am aware that an integration that was installed via HACS also needs to be updated via HACS
The Backend (CCU/Homegear/...) is working as expected, devices are taught in and are controllable by its own UI.
I am running the latest version of the custom_component (and Home Assistant)

The problem

Integration cannot be loaded in current stable HA Container with extant configuration.

What version of HomematicIP (local) has the issue?

1.67.0

What was the last working version of HomematicIP (local)?

1.66.0

What type of installation are you running?

Home Assistant Container

What type of installation are you running for your homematic backend?

RaspberryMatic Standalone

Which version of your homematic backend are you running?

No response

What hardware are you running for your system?

No response

Which config details do you use

TLS
callback data (see)

Which interfaces do you use?

Homematic IP
Homematic (Bidcos-RF)
Groups (Heating-Group)
BidCos-Wired (HM-Wired)

Diagnostics information (no logs here)

No response

Log file extract. Anything in the logs that might be useful for us? The log (Setting/System/Logs -> load full log) is the best source to support trouble shooting!

Logger: homeassistant.setup
Source: setup.py:334
First occurred: 09:46:37 (1 occurrences)
Last logged: 09:46:37

Setup failed for custom integration 'homematicip_local': Unable to import component: cannot import name 'CustomEntity' from 'hahomematic.platforms.custom' (/config/deps/lib/python3.12/site-packages/hahomematic/platforms/custom/__init__.py)
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/loader.py", line 1007, in async_get_component
    comp = await self.hass.async_add_import_executor_job(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/loader.py", line 1067, in _get_component
    ComponentProtocol, importlib.import_module(self.pkg_path)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/util/loop.py", line 200, in protected_loop_func
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/importlib/__init__.py", line 90, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 935, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 995, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "/config/custom_components/homematicip_local/__init__.py", line 35, in <module>
    from .control_unit import ControlConfig, ControlUnit, get_storage_folder
  File "/config/custom_components/homematicip_local/control_unit.py", line 94, in <module>
    from .support import (
  File "/config/custom_components/homematicip_local/support.py", line 10, in <module>
    from hahomematic.platforms.custom import CustomEntity
ImportError: cannot import name 'CustomEntity' from 'hahomematic.platforms.custom' (/config/deps/lib/python3.12/site-packages/hahomematic/platforms/custom/__init__.py)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/setup.py", line 334, in _async_setup_component
    component = await integration.async_get_component()
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/loader.py", line 1027, in async_get_component
    self._component_future.result()
  File "/usr/src/homeassistant/homeassistant/loader.py", line 1019, in async_get_component
    comp = self._get_component()
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/loader.py", line 1067, in _get_component
    ComponentProtocol, importlib.import_module(self.pkg_path)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/util/loop.py", line 200, in protected_loop_func
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/importlib/__init__.py", line 90, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 935, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 995, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "/config/custom_components/homematicip_local/__init__.py", line 35, in <module>
    from .control_unit import ControlConfig, ControlUnit, get_storage_folder
  File "/config/custom_components/homematicip_local/control_unit.py", line 94, in <module>
    from .support import (
  File "/config/custom_components/homematicip_local/support.py", line 10, in <module>
    from hahomematic.platforms.custom import CustomEntity
ImportError: cannot import name 'CustomEntity' from 'hahomematic.platforms.custom' (/config/deps/lib/python3.12/site-packages/hahomematic/platforms/custom/__init__.py)

Additional information

I tried to reproduce this in a venv and could not:

$ python -m venv tmp
$ cd tmp; . bin/activate
$ pip install hahomematic
$ python
>>> from hahomematic.platforms.custom import CustomEntity
>>> import sys
>>> 'hahomematic' in sys.modules
True
>>> 'hahomematic.platforms.custom' in sys.modules
True
>>> 'hahomematic.platforms.custom.entity' in sys.modules
True
>>> CustomEntity
<class 'hahomematic.platforms.custom.entity.CustomEntity'>

The text was updated successfully, but these errors were encountered:

SukramJ · 2024-10-16T08:18:38Z

Kein Fehler der Integration.
Ich denke hier liegt mal wieder ein Problem im Dependency Management von HA vor.
Dependency Management ist eine Aufgabe von HA und nicht dieser Integration

Im /config/deps liegt bestimmt eine alte Version von hahomematic. Version löschen und HA neustarten.

towo · 2024-10-16T15:50:42Z

Okay, interessant. Es gibt:

./deps/hahomematic-2024.10.8.dist-info
./deps/hahomematic
./deps/hahomematic_support
./deps/lib/python3.10/site-packages/hahomematic
./deps/lib/python3.10/site-packages/hahomematic-2023.5.2.dist-info
./deps/lib/python3.11/site-packages/hahomematic
./deps/lib/python3.11/site-packages/hahomematic_support
./deps/lib/python3.11/site-packages/hahomematic-2024.1.7.dist-info
./deps/lib/python3.12/site-packages/hahomematic
./deps/lib/python3.12/site-packages/hahomematic_support
./deps/lib/python3.12/site-packages/hahomematic-2024.9.12.dist-info
./deps/lib/python3.9/site-packages/hahomematic
./deps/lib/python3.9/site-packages/hahomematic-1.9.1.dist-info

Die alte Variante in deps/lib/python3.12/site-packages gelöscht… Integration startet nimmer. die Versionen in deps/ha* gelöscht: Integration startet nimmer.

Haut freundlich ein

Oct 16 17:43:44 bifrost.waystone.wolter.house home-assistant[1171497]: 2024-10-16 17:43:44.858 INFO (SyncWorker_43) [homeassistant.util.package] Attempting install of hahomematic==2024.10.8
Oct 16 17:43:46 bifrost.waystone.wolter.house home-assistant[1171497]: 2024-10-16 17:43:46.847 ERROR (MainThread) [homeassistant.setup] Setup failed for custom integration 'homematicip_local': Unable to import component: No module named 'hahomematic'

raus nach einem disable/enable. Neustarts haben erstaunlich wenig Erfolg, die Dependencies neu zu installieren. Ist zwar jetzt wieder in deps, wird aber nicht zu den Python 3.12-Paketen gepackt.

towo · 2024-10-16T16:07:13Z

Wird scheinbar nur nach /config/deps installiert; Pakete werden aber in /config/deps/lib/python3.12/site-packages erwartet. Manuell hinkopiert geht's.
Ist das eher ein HACS oder ein HA-Thema für's followup?

SukramJ · 2024-10-16T16:07:29Z

Ich muss hier auch raten, weil das nicht mein Thema ist, und das Problem nur bei Containerinstallationen existiert.
Alles was nicht python 3.12 kann grundsätzlich komplett gelöscht werden.
Dependencies sollte HA alleine nachladen.
Was ist das:bifrost.waystone.wolter.house?

Bei meiner HAOS installation ist /config/deps leer.
Ich hab vor ein paar Wochen mal eine Container Installation gemacht, und da ist der Order auch leer.

Da ich ja davon ausgehe, das du ein Backup hast und dich an die Conatiner Vorgaben für die Installation gehalten hast, würde ich den /config/deps Order komplett leeren, und danach den Container neu starten. Wie durch ein Wunder funktioniert danach alles.
Ansonsten endet da mein Wissen.

towo · 2024-10-16T16:11:11Z

bifrost ist nur der Hostname, habe die Sachen direkt aus einem der Logs kopiert. Bin gerade mal bisschen durch den Code gegangen, homeassistant.util.package installiert fleissig, aber irgendwie stolpern die über die site-packages. Vielleicht mal wirklich mit Backup und tabula rasa probieren, aber dann sollte das ja eigentlich mal in irgendwelchen Release Notes stehen, dass man da die alten Sachen wegwerfen darf.

SukramJ · 2024-10-16T16:11:39Z

HA-Thema für's followup?

Das ist ein HA Thema.
Tickets in Github werden aber mit Verweis auf eine custom_component gerne zurückverwiesen, obwohl der komplette Code in HA liegt

SukramJ · 2024-10-16T16:15:25Z

Irgendwie häufen sich die Probleme aktuell bei den Container Installation, und die User landen dann hier.
Wenn Du was rausfindest wäre es schön, wenn Du noch mal Feedback geben kannst.
Issue werden irgendwann gelockt. Gerne dann auch als neue Diskussion.

chris42 · 2024-10-16T19:05:11Z

FYI: Hatte gerade den gleichen Fehler in Containern. Tip von towo funktioniert.
Ggf. vorhandene alte Versionen im site-packages vorher löschen.

Wird scheinbar nur nach /config/deps installiert; Pakete werden aber in /config/deps/lib/python3.12/site-packages erwartet. Manuell hinkopiert geht's. Ist das eher ein HACS oder ein HA-Thema für's followup?

u-lehner · 2024-10-18T14:57:52Z

Wird scheinbar nur nach /config/deps installiert; Pakete werden aber in /config/deps/lib/python3.12/site-packages erwartet. Manuell hinkopiert geht's. Ist das eher ein HACS oder ein HA-Thema für's followup?

Danke, hat geholfen.

Wenn's beruhigt: ist nicht die einzige Integration, die deswegen ausgestiegen ist. Die DWD-Integration hatte das selbe Problem.

eloo · 2024-10-23T18:47:14Z

for the record:
here is the upstream issue about the dependency issues:

home-assistant/core#127966

lackhove · 2024-10-26T18:59:27Z

@SukramJ Ich habe ein ähnliches Problem mit Version 1.68.1, ebenfalls im Container. deps/lib/python3.12/site-packages/hahomematic hat allerdings existiert. Darauf habe ich das komplette deps Verzeichnis umbenannt und den Container neu gestartet. Jetzt gibt es gar kein deps/lib mehr, nur noch die Pakete direkt unter deps (z.B. deps/hahomematic existiert). Im Log sehe ich folgendes:

Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/setup.py", line 334, in _async_setup_component
    component = await integration.async_get_component()
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/loader.py", line 1027, in async_get_component
    self._component_future.result()
  File "/usr/src/homeassistant/homeassistant/loader.py", line 1007, in async_get_component
    comp = await self.hass.async_add_import_executor_job(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/loader.py", line 1067, in _get_component
    ComponentProtocol, importlib.import_module(self.pkg_path)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/util/loop.py", line 200, in protected_loop_func
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/importlib/__init__.py", line 90, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 935, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 995, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "/config/custom_components/homematicip_local/__init__.py", line 11, in <module>
    from hahomematic import __version__ as HAHM_VERSION
ModuleNotFoundError: No module named 'hahomematic'

Ist das das gleiche Problem oder ein anderes?

SukramJ · 2024-10-26T19:01:28Z

Ist das das gleiche Problem oder ein anderes?

Das Gleiche

viennaa · 2024-10-30T20:29:14Z

Kurze Info für alle, die hier auch noch drüber stolpern, bis es gefixt ist. Credit to the upstream issue.

Im podman run Command einfach das mitgeben, um die Environment var zu setzen, dann braucht man nicht die Files kopieren.

-e 'PYTHONPATH=/config/deps'

towo closed this as completed Oct 16, 2024

SukramJ pinned this issue Oct 16, 2024

SukramJ closed this as not planned Won't fix, can't repro, duplicate, stale Oct 16, 2024

SukramJ mentioned this issue Nov 3, 2024

Error affter update from Homematic(IP) Local Version 1.65.0 to version 1.69.0 #1812

Closed

12 tasks

github-actions bot locked and limited conversation to collaborators Nov 7, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Loading integration fails with hahomematic 1.67.0 #1776

Loading integration fails with hahomematic 1.67.0 #1776

towo commented Oct 16, 2024

SukramJ commented Oct 16, 2024

towo commented Oct 16, 2024

towo commented Oct 16, 2024

SukramJ commented Oct 16, 2024

towo commented Oct 16, 2024

SukramJ commented Oct 16, 2024

SukramJ commented Oct 16, 2024

chris42 commented Oct 16, 2024

u-lehner commented Oct 18, 2024

eloo commented Oct 23, 2024

lackhove commented Oct 26, 2024

SukramJ commented Oct 26, 2024

viennaa commented Oct 30, 2024

Loading integration fails with hahomematic 1.67.0 #1776

Loading integration fails with hahomematic 1.67.0 #1776

Comments

towo commented Oct 16, 2024

I agree to the following

The problem

What version of HomematicIP (local) has the issue?

What was the last working version of HomematicIP (local)?

What type of installation are you running?

What type of installation are you running for your homematic backend?

Which version of your homematic backend are you running?

What hardware are you running for your system?

Which config details do you use

Which interfaces do you use?

Diagnostics information (no logs here)

Log file extract. Anything in the logs that might be useful for us? The log (Setting/System/Logs -> load full log) is the best source to support trouble shooting!

Additional information

SukramJ commented Oct 16, 2024

towo commented Oct 16, 2024

towo commented Oct 16, 2024

SukramJ commented Oct 16, 2024

towo commented Oct 16, 2024

SukramJ commented Oct 16, 2024

SukramJ commented Oct 16, 2024

chris42 commented Oct 16, 2024

u-lehner commented Oct 18, 2024

eloo commented Oct 23, 2024

lackhove commented Oct 26, 2024

SukramJ commented Oct 26, 2024

viennaa commented Oct 30, 2024