color parameter being sent for the non-RGB bulb and Zigbee groups #7220

stickpin · 2021-04-27T08:19:08Z

What happened

Hi,

With the latest DEV build color parameter being sent for non-RGB bulbs.
For example:

Ikea LED1836G9 WW bulb.
Philips 8718699673147 - Hue white A60 bulb E27 Bluetooth.

The same issue is present also for Zigbee groups.

zigbee2mqtt/Entrance Bedroom Light': '{"brightness":254,"color":{"x":0.4587,"y":0.4077},"last_seen":"2021-04-27T08:07:46.250Z","linkquality":60,"state":"OFF","update":{"state":"idle"},"update_available":false}

As the result it causing an issue on the Home Assistant side.

2021-04-27 10:07:45 ERROR (MainThread) [homeassistant.util.logging] Exception in state_received when handling msg on 'zigbee2mqtt/Entrance Bedroom Light': '{"brightness":254,"color":{"x":0.4587,"y":0.4077},"last_seen":"2021-04-27T08:07:40.943Z","linkquality":84,"state":"OFF","update":{"state":"idle"},"update_available":false}'
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/components/mqtt/debug_info.py", line 32, in wrapper
    msg_callback(msg)
  File "/usr/src/homeassistant/homeassistant/components/mqtt/light/schema_json.py", line 306, in state_received
    self._update_color(values)
  File "/usr/src/homeassistant/homeassistant/components/mqtt/light/schema_json.py", line 245, in _update_color
    color_mode = values["color_mode"]
KeyError: 'color_mode'

What did you expect to happen

color shouldn't be sent.

How to reproduce it (minimal and precise)

Turn bulb on or off through Home Assistant.
Zigbee2MQTT will send a device status message update to MQTT Broker.

Debug info

Zigbee2MQTT version: 1.18.2-dev commit: 71d77ac
Adapter hardware: Slaesh's CC2652RB stick
Adapter firmware version: 20210120

The text was updated successfully, but these errors were encountered:

Koenkk · 2021-04-27T12:57:02Z

I don't see what went wrong here since it is marked as brightness only here: https://github.com/Koenkk/zigbee-herdsman-converters/blob/2505d6f3bb900cffef5cbb26c9f5ad151af1980e/devices/ikea.js#L183

Try stopping z2m, remove color from data/state.json and start again.

stickpin · 2021-04-27T13:11:56Z

Hi @Koenkk,

Thanks for a quick reply.

Want to add few more comments.
I've tried the latest dev build and the issue still present.
The issue is not isolated to Ikea bulbs only, my Philips WW bulbs have the same issue.

I will clean up the state.json and will report back.

stickpin · 2021-04-27T14:19:18Z

@Koenkk after cleaning up the state.json the issue has been resolved.
Not sure what has caused this issue.
My Zigbee groups also had color parameters even for non-color bulbs, very strange.

It seems like a local issue, so feel free to close this issue if don't feel any need to investigate it.
I will reopen it, in case this issue will reappear again.

Thanks again for your help!

Koenkk · 2021-04-27T14:29:22Z

Can you try setting the color of the group, does the attribute reappear again?

stickpin · 2021-04-27T14:39:28Z

yes, you are right.

Let me try to explain what I've done:

I have a two Zigbee group:

"All Lights" with all the bulbs at home mixed ones with and without color.
"Kids Table" with 2 color bulbs.

If I change the color of the "Kids Table" group, color attributes appears also in the "All Lights" group.

DavyRoswinkel · 2021-04-28T06:05:39Z

I do have the same issue with the HG06106C bulbs.
Don't really understand how to solve this issue.

The content of state.json is only:
{}

Can someone explain?

stickpin · 2021-04-28T07:52:03Z

Found one more strange behavior:

Home Assistant complaining about color_mode but in this case, this strip is an RGB strip.
Lidl HG06104A - Livarno Lux smart LED light strip 2.5m

2021-04-27 23:20:09 ERROR (MainThread) [homeassistant.util.logging] Exception in state_received when handling msg on 'zigbee2mqtt/Living Room Sofa Strip': '{"brightness":255,"color":{"x":0.4587,"y":0.4077},"last_seen":"2021-04-27T20:27:33.089Z","linkquality":108,"state":"OFF"}'
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/components/mqtt/debug_info.py", line 32, in wrapper
    msg_callback(msg)
  File "/usr/src/homeassistant/homeassistant/components/mqtt/light/schema_json.py", line 306, in state_received
    self._update_color(values)
  File "/usr/src/homeassistant/homeassistant/components/mqtt/light/schema_json.py", line 245, in _update_color
    color_mode = values["color_mode"]
KeyError: 'color_mode'

DavyRoswinkel · 2021-04-28T08:11:10Z

yes, you are right.

Let me try to explain what I've done:

I have a two Zigbee group:
* "All Lights" with all the bulbs at home mixed ones with and without color.

* "Kids Table" with 2 color bulbs.
If I change the color of the "Kids Table" group, color attributes appears also in the "All Lights" group.

Not only NON-RGB bulbs, as my bulbs are RGB bulbs (HG06106C bulbs), and got the same problem

#7220

Koenkk · 2021-04-28T17:11:22Z

@stickpin found the issue, HA error should be gone now.
Changes will be available in the dev branch in a few hours from now. (https://www.zigbee2mqtt.io/how_tos/how-to-switch-to-dev-branch.html)

@DavyRoswinkel for RGB bulbs setting the brightness once should solve the issue.

stickpin · 2021-04-28T17:19:03Z

@Koenkk thanks a lot for the fix!
Will deploy it now and report back.

DavyRoswinkel · 2021-04-28T18:22:58Z

@stickpin found the issue, HA error should be gone now.
Changes will be available in the dev branch in a few hours from now. (https://www.zigbee2mqtt.io/how_tos/how-to-switch-to-dev-branch.html)

@DavyRoswinkel for RGB bulbs setting the brightness once should solve the issue.

I did set the brightness once...but it didn't solve the issue. Or do I have to update also to f27e5ef
Now using 1.18.2-dev commit: cedbd1f

stickpin · 2021-04-28T19:08:23Z

@DavyRoswinkel you have to update to f27e5ef.

DavyRoswinkel · 2021-04-28T19:15:47Z

@DavyRoswinkel you have to update to f27e5ef.

Maybe a dumb question...but I only know the way to update the edge version with the described steps.
How to update to this exact version???

stickpin · 2021-04-29T08:05:22Z

@Koenkk just to report back, so far so good. No more errors.

I want to propose one change regarding Zigbee Groups representation.
Let me give an example from my environment at home.
I have plenty of bulbs and relays that are controlling the light in different rooms.

My Zigbee group "All Lights" contains RGB Bulbs, WW Bulbs, Aqara Relays that I use to turn off all the lights when I leave home.
Z2M representing it in state.json with parameters that are not applicable for example for the Aqara Relays (LLKZMK11LM).

    "18": {
        "state": "ON",
        "brightness": 254,
        "color": {
            "x": 0.459,
            "y": 0.408
        },
        "color_mode": "xy",
        "color_temp": 265
    },

Wouldn't it be better to represent the parameters of the group based on the "less advanced" device in the group?
So for example, if my group contains devices with exposing the following parameters:

RGB Bulb - color, color_mode, color_temp, brightness, state
WW Bulbs - brightness, state
Aqara Relay - state

So in this case, only state should be exposed because this is the only parameter applicable for all devices in the group.
I hope I've managed to explain myself clearly. :)

Koenkk · 2021-04-29T16:17:50Z

@stickpin I agree with you. The state should only have actually supported features, e.g. a brightness only bulb shouldn't report color. I will look into this but this is a bit more complicated to fix.

stickpin · 2021-04-29T16:56:28Z

@Koenkk if you can point me out where to start to look at this, I can try to resolve it and after that can do a PR for your review.

DavyRoswinkel · 2021-04-29T17:06:16Z

I still don't understand how to update to version f27e5ef.
I only know the steps in the description, on how to update the edge version.
Or is it better to wait for a verified version that solves this issue?

Koenkk · 2021-04-29T17:33:43Z

@stickpin these state updates are send here:

zigbee2mqtt/lib/extension/groups.js

Line 107 in abd8a09

await this.publishEntityState(zigbeeGroup.groupID, payload, reason);

, look at e.g.

zigbee2mqtt/lib/extension/homeassistant.js

Line 85 in d61d6e2

const colorXY = expose.features.find((e) => e.name === 'color_xy');

on how to determine the features of a device.

@DavyRoswinkel these changes are included in the latest edge, if you are already on the edge uninstall and install it again should get you to the latest version.

DavyRoswinkel · 2021-04-29T17:45:56Z

@Koenkk Thanks for solving this issue! Thanks for your help. I needed to set the brightness and the color temperature, to make it work. And it works. Thanks again and have a nice evening.

svadel · 2021-05-04T17:45:24Z

Hi!
I have the same issue with KeyError: 'color_mode' with 2 devices GL-C-008-2ID.
The problem has appeared after I updated z2m from 1.18.2-1 to 1.18.3-1
I tried to reinstall z2m and reconnect GL-C-008-2ID, it was useless.
I have returned to version 1.18.2-1 and the problem disappears.
Please check what wrong with this controller configuration in the last version of master z2m. Thank you!

Koenkk · 2021-05-04T20:29:39Z

@svadel should be fixed now. After updating set color at least once.

Changes will be available in the dev branch in a few hours from now. (https://www.zigbee2mqtt.io/how_tos/how-to-switch-to-dev-branch.html)

svadel · 2021-05-05T18:57:45Z

@Koenkk Thanks for the help, works great on dev!

m4dm4xi · 2021-06-02T21:10:37Z

@Koenkk I have this error on 1.19.0-1 regarding this device now:
https://www.zigbee2mqtt.io/devices/4058075036147.html#osram-4058075036147

`Logger: homeassistant.util.logging
Source: util/logging.py:105
First occurred: 23:01:53 (1 occurrences)
Last logged: 23:01:53

Exception in state_received when handling msg on 'zigbee2mqtt/0x7cb03eaa00ae5688': '{"brightness":250,"color":{"x":0.667,"y":0.284},"color_temp":35,"linkquality":23,"state":"OFF","update":{"state":"idle"},"update_available":false}' Traceback (most recent call last): File "/usr/src/homeassistant/homeassistant/components/mqtt/debug_info.py", line 32, in wrapper msg_callback(msg) File "/usr/src/homeassistant/homeassistant/components/mqtt/light/schema_json.py", line 306, in state_received self._update_color(values) File "/usr/src/homeassistant/homeassistant/components/mqtt/light/schema_json.py", line 245, in _update_color color_mode = values["color_mode"] KeyError: 'color_mode'`

amuassabn · 2021-06-21T22:03:00Z

@Koenkk I have this error on 1.19.1-dev regarding this device now:
https://www.zigbee2mqtt.io/devices/LED1536G5.html#ikea-led1536g5

Logger: homeassistant.components.mqtt.light.schema_json
Source: components/mqtt/light/schema_json.py:247
Integration: MQTT (documentation, issues)
First occurred: 18:45:23 (2 occurrences)
Last logged: 18:45:23

Invalid color mode received

… group members. #7220 #7736

Koenkk · 2021-06-22T20:47:21Z

Invalid color mode received should be fixed now in the latest dev branch, note that after upgrading you need to set the color temperature of the individual bulb once (not the group).
Changes will be available in the dev branch in a few hours from now. (https://www.zigbee2mqtt.io/how_tos/how-to-switch-to-dev-branch.html)

nashant · 2021-07-21T09:10:29Z

Is this in 1.20.0? I'm still getting this error with ikea bulbs

nashant · 2021-07-21T18:15:30Z

So I found my issue. The bulbs that were causing the issue had defaulted to color_mode xy in the json reported via mqtt. As soon as I turned them on and set the color_temp in Z2M gui the json got updated correctly

johnjoemorgan · 2021-09-22T06:41:46Z

@nashant can I ask how you edited the state "color_mode": "xy" and changed it to "color_mode": "color_temp"

I have a number of GLEDOPTO GL-C-007 giving this error

boehser-enkel · 2022-07-26T20:00:20Z

The error occurred for my Z2M light group of 3 ikea bulbs. How to resolve?

stickpin added the problem Something isn't working label Apr 27, 2021

DavyRoswinkel mentioned this issue Apr 28, 2021

Exception in state_received zigbee2mqtt/hassio-zigbee2mqtt#97

Closed

stickpin changed the title ~~color parameter being sent for the not RGB bulb eg. Ikea LED1836G9 WW~~ color parameter being sent for the non-RGB bulb and Zigbee groups Apr 28, 2021

Koenkk added a commit that referenced this issue Apr 28, 2021

Fix Home Assistant "KeyError: 'color_mode'" for brightness only lights.

f27e5ef

#7220

vdkeybus mentioned this issue May 3, 2021

KeyError on HomeAssistant #7306

Closed

Koenkk added a commit that referenced this issue May 4, 2021

Fix color_mode missing for lights with multiple endpoints. #7220

a77e857

Koenkk closed this as completed May 6, 2021

Koenkk added a commit that referenced this issue Jun 22, 2021

Fix non supported color_mode and color properties being published for…

7b7f511

… group members. #7220 #7736

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

color parameter being sent for the non-RGB bulb and Zigbee groups #7220

color parameter being sent for the non-RGB bulb and Zigbee groups #7220

stickpin commented Apr 27, 2021 •

edited

Loading

Koenkk commented Apr 27, 2021

stickpin commented Apr 27, 2021

stickpin commented Apr 27, 2021

Koenkk commented Apr 27, 2021

stickpin commented Apr 27, 2021

DavyRoswinkel commented Apr 28, 2021 •

edited

Loading

stickpin commented Apr 28, 2021

DavyRoswinkel commented Apr 28, 2021 •

edited

Loading

Koenkk commented Apr 28, 2021

stickpin commented Apr 28, 2021

DavyRoswinkel commented Apr 28, 2021

stickpin commented Apr 28, 2021

DavyRoswinkel commented Apr 28, 2021

stickpin commented Apr 29, 2021

Koenkk commented Apr 29, 2021

stickpin commented Apr 29, 2021

DavyRoswinkel commented Apr 29, 2021

Koenkk commented Apr 29, 2021

DavyRoswinkel commented Apr 29, 2021

svadel commented May 4, 2021

Koenkk commented May 4, 2021

svadel commented May 5, 2021

m4dm4xi commented Jun 2, 2021 •

edited

Loading

amuassabn commented Jun 21, 2021

Koenkk commented Jun 22, 2021

nashant commented Jul 21, 2021

nashant commented Jul 21, 2021

johnjoemorgan commented Sep 22, 2021

boehser-enkel commented Jul 26, 2022

color parameter being sent for the non-RGB bulb and Zigbee groups #7220

color parameter being sent for the non-RGB bulb and Zigbee groups #7220

Comments

stickpin commented Apr 27, 2021 • edited Loading

What happened

What did you expect to happen

How to reproduce it (minimal and precise)

Debug info

Koenkk commented Apr 27, 2021

stickpin commented Apr 27, 2021

stickpin commented Apr 27, 2021

Koenkk commented Apr 27, 2021

stickpin commented Apr 27, 2021

DavyRoswinkel commented Apr 28, 2021 • edited Loading

stickpin commented Apr 28, 2021

DavyRoswinkel commented Apr 28, 2021 • edited Loading

Koenkk commented Apr 28, 2021

stickpin commented Apr 28, 2021

DavyRoswinkel commented Apr 28, 2021

stickpin commented Apr 28, 2021

DavyRoswinkel commented Apr 28, 2021

stickpin commented Apr 29, 2021

Koenkk commented Apr 29, 2021

stickpin commented Apr 29, 2021

DavyRoswinkel commented Apr 29, 2021

Koenkk commented Apr 29, 2021

DavyRoswinkel commented Apr 29, 2021

svadel commented May 4, 2021

Koenkk commented May 4, 2021

svadel commented May 5, 2021

m4dm4xi commented Jun 2, 2021 • edited Loading

amuassabn commented Jun 21, 2021

Koenkk commented Jun 22, 2021

nashant commented Jul 21, 2021

nashant commented Jul 21, 2021

johnjoemorgan commented Sep 22, 2021

boehser-enkel commented Jul 26, 2022

stickpin commented Apr 27, 2021 •

edited

Loading

DavyRoswinkel commented Apr 28, 2021 •

edited

Loading

DavyRoswinkel commented Apr 28, 2021 •

edited

Loading

m4dm4xi commented Jun 2, 2021 •

edited

Loading