Kernel 6.10 released, then what? #89

elhossary · 2024-07-24T08:22:50Z

Kernel 6.10 was released yesterday, it has already integrated the IPU6 drivers.
However, camera's still do not work out of the box, most probably needs further configuration.
I believe this repo can be re-used to configure the cameras instead of installing the drivers for Kernel 6.10 users.
I have no idea how this can be done, but I am reaching out to check if anybody interested to help.

dffischer · 2024-07-25T13:25:20Z

I would be happy to finally ditch the LTS kernel and a DKMS module. But I also do not get any different results with the packages from this repository on the 6.10 kernel. There is also some experimentation going on over at the Arch Linux forums, perhaps at least providing some test reports.

Daniel-Ehrhardt · 2024-07-26T09:52:50Z

Could it be as easy as upgrading libcamera 0.3.0-1 to 0.3.1?

From their release notes:

     - libcamera: pipeline: simple: Enable intel-ipu6 with Soft ISP
     - libcamera: pipeline: simple: Enable Soft ISP for TI CSI-RX

elhossary · 2024-07-26T10:09:46Z

Hopefully

Daniel-Ehrhardt · 2024-07-26T10:20:51Z

Does anybody know how long it usually takes to get the libcamera package update?

For comparison, libcamera v0.3.0 was released on Sun May 19 16:54:11 2024 +0100.
The package timestamp says: May 25, 2024, 1:47 p.m. UTC

I tried building it myself from https://aur.archlinux.org/packages/libcamera-git which doesn't seem to work on-top of an existing installation.

dffischer · 2024-07-26T15:33:15Z

I managed to get a build of libcamera 0.3.1 from the official package by incrementing the pkgver, updating the checksums and changing the two qt5 dependencies to qt6.

Still no camera shows up on the cam utility. On the other hand, cam also does not show anything on the LTS kernel, all the while the camera still works there.

elhossary · 2024-07-30T16:03:06Z

I am getting this:

sudo dmesg | grep ipu6
[    2.391707] intel-ipu6 0000:00:05.0: enabling device (0000 -> 0002)
[    2.392573] intel-ipu6 0000:00:05.0: IPU6 in secure mode touch 0x0 mask 0xff
[    2.393082] intel-ipu6 0000:00:05.0: Unexpected CSR 0x0
[    2.393669] intel-ipu6 0000:00:05.0: Unexpected CSR 0x0
[    2.394352] intel-ipu6 0000:00:05.0: Unexpected CSR 0x0
[    2.394860] intel-ipu6 0000:00:05.0: Unexpected CSR 0x0
[    2.395368] intel-ipu6 0000:00:05.0: Unexpected CSR 0x0
[    2.396298] intel-ipu6 0000:00:05.0: Unexpected CSR 0x0
[    2.396806] intel-ipu6 0000:00:05.0: Unexpected CSR 0x0
[    2.397315] intel-ipu6 0000:00:05.0: Unexpected CSR 0x0
[    2.397821] intel-ipu6 0000:00:05.0: Unexpected CSR 0x0
[    2.398328] intel-ipu6 0000:00:05.0: Unexpected CSR 0x0
[    2.412329] intel-ipu6 0000:00:05.0: FW version: 20230925
[    2.412895] intel-ipu6 0000:00:05.0: Found supported sensor INT3474:01
[    2.412934] intel-ipu6 0000:00:05.0: Connected 1 cameras
[    2.413683] intel-ipu6 0000:00:05.0: Sending BOOT_LOAD to CSE
[    2.422635] intel-ipu6 0000:00:05.0: Sending AUTHENTICATE_RUN to CSE
[    2.508131] intel-ipu6 0000:00:05.0: CSE authenticate_run done
[    2.508146] intel-ipu6 0000:00:05.0: IPU6-v3[465d] hardware version 5

DutchEllie · 2024-07-31T09:11:54Z

I get exactly the same messages as @elhossary. Tons of camera sensors in the v4l2-ctl --list-devices output, but no usable camera in any application. cam doesn't work either.

I have manually installed the libcamera package that has been updated to 0.3.1, but no dice either. It's as if nothing changed.

I hoped that the camera would just "work" once updated to 6.10, but apparently that's asking for too much...

elhossary · 2024-08-01T11:01:59Z

I believe we should wait until next version libcamera comes out of testing:
https://archlinux.org/packages/extra-testing/x86_64/libcamera/
Looks like new pipewire dependencies were added, which likely will solve this issue

catwell · 2024-08-01T12:17:52Z

@elhossary It is unlikely that it will work. The most up-to-date discussion of this is this thread: linux-surface/linux-surface#1354 (comment)

alba4k · 2024-08-02T19:20:35Z

tldr we have to wait for the next libcamera release, as they forgot to include the new stuff in 0.3.1 on x86 too (it is only on arm atm)

elhossary · 2024-08-04T14:12:16Z

as @catwell said, libcamera 0.3.1 released from testing but still camera does not work

sigboe · 2024-09-30T18:16:30Z

@elhossary libcamera-0.3.2-1 was released Sep 24th, still not working

elhossary · 2024-09-30T18:30:19Z

yes, not working :(
Hopefully it will work with kernel 6.11

elhossary · 2024-10-01T14:41:11Z

No luck on 6.11.1 :(
That's really too much pain

apognu · 2024-10-01T15:43:26Z

Still doesn't work, but for the first time, I have no more errors in dmesg and my sensor is recognized.

> sudo dmesg | grep ipu6
[   17.402824] intel-ipu6 0000:00:05.0: enabling device (0000 -> 0002)
[   17.404159] intel-ipu6 0000:00:05.0: IPU6 in secure mode touch 0x80000000 mask 0x0
[   17.417957] intel-ipu6 0000:00:05.0: FW version: 20230925
[   17.420119] intel-ipu6 0000:00:05.0: Found supported sensor OVTI08F4:00
[   17.420161] intel-ipu6 0000:00:05.0: Connected 1 cameras
[   17.422069] intel-ipu6 0000:00:05.0: Sending BOOT_LOAD to CSE
[   17.482819] intel-ipu6 0000:00:05.0: Sending AUTHENTICATE_RUN to CSE
[   17.547240] intel-ipu6 0000:00:05.0: CSE authenticate_run done
[   17.547253] intel-ipu6 0000:00:05.0: IPU6-v4[7d19] hardware version 6

It was not under 6.10 and full of errors.

EDIT: all of the Intel IPU6 repositories have been updated two to four days ago, so I'll try building everything again, just in case.
EDIT 2: nope, still doesn't work. :(

elhossary · 2024-10-01T16:48:07Z

That's my output with Kernel 6.11.1 and libcamera 0.3.2.1

[    2.497067] intel-ipu6 0000:00:05.0: enabling device (0000 -> 0002)
[    2.497215] intel-ipu6 0000:00:05.0: IPU6 in secure mode touch 0x0 mask 0xff
[    2.523767] intel-ipu6 0000:00:05.0: FW version: 20230925
[    2.525080] intel-ipu6 0000:00:05.0: Found supported sensor INT3474:01
[    2.525296] intel-ipu6 0000:00:05.0: Connected 1 cameras
[    2.528136] intel-ipu6 0000:00:05.0: Sending BOOT_LOAD to CSE
[    2.544917] intel-ipu6 0000:00:05.0: Sending AUTHENTICATE_RUN to CSE
[    2.621272] intel-ipu6 0000:00:05.0: CSE authenticate_run done
[    2.621279] intel-ipu6 0000:00:05.0: IPU6-v3[465d] hardware version 5

stefanpartheym · 2024-10-11T17:14:23Z

Uff this so tedious… It's 2024 and a damn webcam still doesn't work.
Anyways, I updated the README to reflect the current state.

Just as an attempt to help you guys: I'm still on the LTS kernel (6.6.56-1-lts) and camera works for me using this repo for now.

alba4k · 2024-10-11T17:16:45Z

Has anybody checked what the latest working kernel is?

6.6.30 or so are known as working but newer lts kernels dont

stefanpartheym · 2024-10-11T17:18:25Z

@alba4k I just updated the README and added kernel version 6.6.56-1-lts to be working.

alba4k · 2024-10-11T18:22:00Z

@stefanpartheym are you sure it works? latest lts did notbfor me last time I tried

sigboe · 2024-10-12T18:21:45Z

@alba4k I can't comfirm 100%, but I switched to NixOS this month, and the official NixOS module to work on 6.6.54. And thats not the newest kernel driver.

bjesus · 2024-10-27T08:41:13Z

I've posted some instructions on how I got it working with the latest Arch kernel in the forum thread.

elhossary · 2024-10-27T08:43:52Z

@bjesus
Great to hear, would be even better to package that in a repo like this one

bjesus · 2024-10-27T08:48:48Z

@elhossary there's nothing new to package, the whole thing is now natively supported.

apognu · 2024-10-27T13:56:39Z

Unfortunately, this is exactly what I have, and no dice for me. Which sensor do you have?

Thanks for reporting, though.

bjesus · 2024-10-27T13:59:38Z

ov2740 on the Yoga X1 Gen 7. What part of the setup isn't working for you? I wrote the post the way I did so that it would be easier for people to troubleshoot what piece is broken.

marmistrz · 2024-10-27T14:14:56Z

Which sensor do you have?

How can I check it? Dell Latitude 7440 here

bjesus · 2024-10-27T14:19:08Z

Running cam -l should show it.

marmistrz · 2024-10-27T14:33:03Z

Running cam -l should show it.

It doesn't, the error message is No sensor found for /dev/media0. Detailed log:

[15:31:37] $ LIBCAMERA_LOG_LEVELS=0 cam -l
[3:36:09.124238998] [35968] DEBUG IPAModule ipa_module.cpp:334 ipa_ipu3.so: IPA module /usr/lib/libcamera/ipa_ipu3.so is signed
[3:36:09.124517931] [35968] DEBUG IPAManager ipa_manager.cpp:235 Loaded IPA module '/usr/lib/libcamera/ipa_ipu3.so'
[3:36:09.124717041] [35968] DEBUG IPAModule ipa_module.cpp:334 ipa_soft_simple.so: IPA module /usr/lib/libcamera/ipa_soft_simple.so is signed
[3:36:09.124766682] [35968] DEBUG IPAManager ipa_manager.cpp:235 Loaded IPA module '/usr/lib/libcamera/ipa_soft_simple.so'
[3:36:09.124917599] [35968]  INFO Camera camera_manager.cpp:325 libcamera v0.3.1+76-fc7250f0
[3:36:09.125213733] [35969] DEBUG Camera camera_manager.cpp:73 Starting camera manager
[3:36:09.138787821] [35969] DEBUG DeviceEnumerator device_enumerator.cpp:230 New media device "intel-ipu6" created from /dev/media0
[3:36:09.142164133] [35969] DEBUG DeviceEnumerator device_enumerator_udev.cpp:96 Defer media device /dev/media0 due to 1 missing dependencies
[3:36:09.142674841] [35969] DEBUG DeviceEnumerator device_enumerator_udev.cpp:322 All dependencies for media device /dev/media0 found
[3:36:09.142702919] [35969] DEBUG DeviceEnumerator device_enumerator.cpp:258 Added device /dev/media0: intel-ipu6
[3:36:09.143513184] [35969] DEBUG Camera camera_manager.cpp:138 Found registered pipeline handler 'ipu3'
[3:36:09.144075039] [35969] DEBUG Camera camera_manager.cpp:138 Found registered pipeline handler 'simple'
[3:36:09.144194044] [35969] DEBUG DeviceEnumerator device_enumerator.cpp:318 Successful match for media device "intel-ipu6"
[3:36:09.144301759] [35969]  INFO SimplePipeline simple.cpp:1550 No sensor found for /dev/media0
[3:36:09.144357876] [35969] DEBUG Camera camera_manager.cpp:138 Found registered pipeline handler 'uvcvideo'

Looks like libcamera has no support for my sensor - a patch similar to this one should do the trick, but first I'd need to figure out what the sensor model actually is.

apognu · 2024-10-27T14:41:58Z

Same here.

@bjesus: The kernel seems to detect everything properly:

$ dmesg | grep ipu6
[   10.816081] intel-ipu6 0000:00:05.0: enabling device (0000 -> 0002)
[   10.816952] intel-ipu6 0000:00:05.0: IPU6 in secure mode touch 0x80000000 mask 0x0
[   10.830907] intel-ipu6 0000:00:05.0: FW version: 20230925
[   10.831666] intel-ipu6 0000:00:05.0: Found supported sensor OVTI08F4:00
[   10.831703] intel-ipu6 0000:00:05.0: Connected 1 cameras
[   10.832984] intel-ipu6 0000:00:05.0: Sending BOOT_LOAD to CSE
[   10.901138] intel-ipu6 0000:00:05.0: Sending AUTHENTICATE_RUN to CSE
[   10.954237] intel-ipu6 0000:00:05.0: CSE authenticate_run done
[   10.954251] intel-ipu6 0000:00:05.0: IPU6-v4[7d19] hardware version 6
[ 2532.628176] intel-ipu6 0000:00:05.0: IPU6 in secure mode

But libcamera doesn't (similar output to @marmistrz's):

$ LIBCAMERA_LOG_LEVELS=0 cam -l
[0:13:43.509738745] [25429] DEBUG IPAModule ipa_module.cpp:333 ipa_ipu3.so: IPA module /usr/lib/libcamera/ipa_ipu3.so is signed
[0:13:43.509807995] [25429] DEBUG IPAManager ipa_manager.cpp:235 Loaded IPA module '/usr/lib/libcamera/ipa_ipu3.so'
[0:13:43.509844299] [25429] DEBUG IPAModule ipa_module.cpp:333 ipa_soft_simple.so: IPA module /usr/lib/libcamera/ipa_soft_simple.so is signed
[0:13:43.509861393] [25429] DEBUG IPAManager ipa_manager.cpp:235 Loaded IPA module '/usr/lib/libcamera/ipa_soft_simple.so'
[0:13:43.509894244] [25429] DEBUG IPAModule ipa_module.cpp:333 ipa_vimc.so: IPA module /usr/lib/libcamera/ipa_vimc.so is signed
[0:13:43.509909253] [25429] DEBUG IPAManager ipa_manager.cpp:235 Loaded IPA module '/usr/lib/libcamera/ipa_vimc.so'
[0:13:43.509958758] [25429] ERROR IPAModule ipa_module.cpp:171 Symbol ipaModuleInfo not found
[0:13:43.509969796] [25429] ERROR IPAModule ipa_module.cpp:291 v4l2-compat.so: IPA module has no valid info
[0:13:43.509987377] [25429]  INFO Camera camera_manager.cpp:325 libcamera v0.3.2
[0:13:43.510253516] [25430] DEBUG Camera camera_manager.cpp:73 Starting camera manager
[0:13:43.528595193] [25430] DEBUG DeviceEnumerator device_enumerator.cpp:230 New media device "intel-ipu6" created from /dev/media0
[0:13:43.532845412] [25430] DEBUG DeviceEnumerator device_enumerator.cpp:258 Added device /dev/media0: intel-ipu6
[0:13:43.533378564] [25430] DEBUG Camera camera_manager.cpp:138 Found registered pipeline handler 'vimc'
[0:13:43.533415263] [25430] DEBUG Camera camera_manager.cpp:138 Found registered pipeline handler 'uvcvideo'
[0:13:43.533427961] [25430] DEBUG Camera camera_manager.cpp:138 Found registered pipeline handler 'simple'
[0:13:43.533452001] [25430] DEBUG DeviceEnumerator device_enumerator.cpp:318 Successful match for media device "intel-ipu6"
[0:13:43.533476453] [25430]  INFO SimplePipeline simple.cpp:1548 No sensor found for /dev/media0
[0:13:43.533490931] [25430] DEBUG Camera camera_manager.cpp:138 Found registered pipeline handler 'ipu3'

And from there, of course gstreamer doesn't work either:

$ gst-launch-1.0 libcamerasrc ! queue ! glimagesink
Setting pipeline to PAUSED ...
[0:14:55.655571276] [26108] ERROR IPAModule ipa_module.cpp:171 Symbol ipaModuleInfo not found
[0:14:55.655602430] [26108] ERROR IPAModule ipa_module.cpp:291 v4l2-compat.so: IPA module has no valid info
[0:14:55.655617287] [26108]  INFO Camera camera_manager.cpp:325 libcamera v0.3.2
[0:14:55.670478523] [26117]  INFO SimplePipeline simple.cpp:1548 No sensor found for /dev/media0
ERROR: from element /GstPipeline:pipeline0/GstLibcameraSrc:libcamerasrc0: Could not find any supported camera on this system.
Additional debug info:
../libcamera/src/gstreamer/gstlibcamerasrc.cpp(395): gst_libcamera_src_open (): /GstPipeline:pipeline0/GstLibcameraSrc:libcamerasrc0:
libcamera::CameraMananger::cameras() is empty
ERROR: pipeline doesn't want to preroll.
Failed to set pipeline to PAUSED.
Setting pipeline to NULL ...
Freeing pipeline ...

marmistrz · 2024-10-27T14:43:49Z

Okay, so my sensor (according to dmesg) is OVTI02C1:00. I tried the following patch to libcamera-git, but no success either

diff --git a/src/ipa/libipa/camera_sensor_helper.cpp b/src/ipa/libipa/camera_sensor_helper.cpp
index c6169bdc..71d19cae 100644
--- a/src/ipa/libipa/camera_sensor_helper.cpp
+++ b/src/ipa/libipa/camera_sensor_helper.cpp
@@ -782,6 +782,17 @@ public:
 };
 REGISTER_CAMERA_SENSOR_HELPER("ov13858", CameraSensorHelperOv13858)
 
+class CameraSensorHelperOvti02c1 : public CameraSensorHelper
+{
+public:
+       CameraSensorHelperOvti02c1()
+       {
+               gainType_ = AnalogueGainLinear;
+               gainConstants_.linear = { 1, 0, 0, 128 };
+       }
+};
+REGISTER_CAMERA_SENSOR_HELPER("ovti02c1", CameraSensorHelperOvti02c1)
+
 #endif /* __DOXYGEN__ */
 
 } /* namespace ipa */
diff --git a/src/libcamera/sensor/camera_sensor_properties.cpp b/src/libcamera/sensor/camera_sensor_properties.cpp
index 6d4136d0..81c28730 100644
--- a/src/libcamera/sensor/camera_sensor_properties.cpp
+++ b/src/libcamera/sensor/camera_sensor_properties.cpp
@@ -213,6 +213,10 @@ const CameraSensorProperties *CameraSensorProperties::get(const std::string &sen
                        .unitCellSize = { 1400, 1400 },
                        .testPatternModes = {},
                } },
+               { "ovti02c1", {
+                       .unitCellSize = { 1400, 1400 },
+                       .testPatternModes = {},
+               } },
                { "ov5670", {
                        .unitCellSize = { 1120, 1120 },
                        .testPatternModes = {

bjesus · 2024-10-27T14:54:12Z

Yeah, I don't think either of your sensors is supported, which is why it doesn't work.

marmistrz · 2024-10-27T14:59:31Z

@bjesus how could I add support for my sensor? See my naive approach above. I have absolutely no idea what unitCellSize should be, I just put a random value - but if it were wrong I would expect the sensor to be detected but something fail later. Unfortunately, I can't find a data sheet for ovti02c1 anywhere.

bjesus · 2024-10-27T15:06:39Z

I have no idea really. I think you should seek help at the https://github.com/intel/ipu6-drivers and/or the libcamera project. This thread, as far as I understood, is about the sensors for which support was added in kernel 6.10, which doesn't seem to include your device.

bjesus · 2024-10-27T15:58:38Z

@marmistrz I believe this blogpost https://hansdegoede.dreamwidth.org/28841.html is quite relevant for those with unsupported sensors.

elhossary · 2024-10-27T19:55:30Z

@bjesus I confirm that your solution in the forum thread WORKS in my X1 Carbon 10th gen with gstreamer command
Thank you very much
I only installed the packages without ivsc
and added the line to camera.rules
Then it worked right away without rebooting
But it does not work on any other app, neither in web browser not zoom

bjesus · 2024-10-27T21:10:04Z

I don't think Zoom works with pipewire. I wrote the post in such a way that should help you understand where the problem is. Does GNOME Snapshot work? Did you change the about:config setting in Firefox?

struan-robertson · 2024-10-27T23:22:44Z

Annoyingly this only seems to work ~30% of the time for me, so I will have to stick to the previous solution. Hopefully soon it will be fixed an I can stop using LTS kernels on my laptop :). Just as a heads up to people trying this, setting media.webrtc.camera.allow-pipewirein Firefox stops it from reading non-pipewire cameras, so you will have to disable it to use the v4l2loopback based solution in this repo.

elhossary · 2024-11-24T18:21:34Z

Still no luck with kernel 6.12.1
only with firefox based on pipewire.

struan-robertson · 2024-11-25T14:41:12Z

@elhossary that isn't a kernel problem, but that Firefox and Gnome snapshot are the only two programs that source video from pipewire-camera (source). Other programs can also do this, but this functionality will need to be added to them. In the mean time, you should be able to use v4l2-relayd and v4l2loopback-dkms to create a virtual video device with the gstreamer source libcamerasrc that other application can consume.

elhossary · 2024-11-26T08:56:33Z

@struan-robertson The point is such thing should be working out of the box after the integration with the kernel 6.10. Anyways, do you have configuration guide or script to setup v4l2-relayd and v4l2loopback-dkms based on the new kernels?

struan-robertson · 2024-11-26T12:17:58Z

@elhossary the upstreamed drivers don't work very well with my webcam so I was limited in how much I could test this. If you have installed v4l2loopback-dkms (and have rebooted after installing) you can then run gst-launch-1.0 libcamerasrc ! queue ! videoconvert ! video/x-raw,format=NV12 ! v4l2sink device=/dev/video0 to pipe your camera to a virtual device that should be accessible by programs like Zoom etc. Annoyingly this keeps the camera on until you kill the process, so it is only a band aid. v4l2-relayd is used to only have the camera on only when the video source is being consumed, but I couldn't get it working with libcamerasrc for some reason.

struan-robertson mentioned this issue Oct 28, 2024

Webcam not working on LTS kernel #90

Closed

Kernel 6.10 released, then what? #89

Kernel 6.10 released, then what? #89

Comments

elhossary commented Jul 24, 2024

dffischer commented Jul 25, 2024

Daniel-Ehrhardt commented Jul 26, 2024

elhossary commented Jul 26, 2024

Daniel-Ehrhardt commented Jul 26, 2024

dffischer commented Jul 26, 2024

elhossary commented Jul 30, 2024

DutchEllie commented Jul 31, 2024

elhossary commented Aug 1, 2024

catwell commented Aug 1, 2024

alba4k commented Aug 2, 2024

elhossary commented Aug 4, 2024

sigboe commented Sep 30, 2024

elhossary commented Sep 30, 2024

elhossary commented Oct 1, 2024

apognu commented Oct 1, 2024 • edited Loading

elhossary commented Oct 1, 2024

stefanpartheym commented Oct 11, 2024

alba4k commented Oct 11, 2024

stefanpartheym commented Oct 11, 2024

alba4k commented Oct 11, 2024

sigboe commented Oct 12, 2024

bjesus commented Oct 27, 2024

elhossary commented Oct 27, 2024

bjesus commented Oct 27, 2024

apognu commented Oct 27, 2024 • edited Loading

bjesus commented Oct 27, 2024

marmistrz commented Oct 27, 2024 • edited Loading

bjesus commented Oct 27, 2024

marmistrz commented Oct 27, 2024 • edited Loading

apognu commented Oct 27, 2024

marmistrz commented Oct 27, 2024 • edited Loading

bjesus commented Oct 27, 2024

marmistrz commented Oct 27, 2024 • edited Loading

bjesus commented Oct 27, 2024

bjesus commented Oct 27, 2024

elhossary commented Oct 27, 2024

bjesus commented Oct 27, 2024

struan-robertson commented Oct 27, 2024

elhossary commented Nov 24, 2024 • edited Loading

struan-robertson commented Nov 25, 2024

elhossary commented Nov 26, 2024

struan-robertson commented Nov 26, 2024

apognu commented Oct 1, 2024 •

edited

Loading

apognu commented Oct 27, 2024 •

edited

Loading

marmistrz commented Oct 27, 2024 •

edited

Loading

marmistrz commented Oct 27, 2024 •

edited

Loading

marmistrz commented Oct 27, 2024 •

edited

Loading

marmistrz commented Oct 27, 2024 •

edited

Loading

elhossary commented Nov 24, 2024 •

edited

Loading