Funnily enough, everything works as expected after upgrading the firmware to last week's firmware version 1.8.5. Although the changelog only mentions a fix regarding a short button press, I assume that it contains some LED dimming fixes as well.
Anyhow, I guess the essence is: if you encounter problems with Dimmer 2 and LED bulbs, try flashing firmware 1.8.5.