Getting Jan.AI to Work Fully with Q4OS Debian 12 Bookwork TDE on Alienware m16 r1 i7 with Nvidia 4070
My Alienware m18 blew up a couple of weeks ago, so I have had to fall back to a less performative m16 refurbish.
Here are some notes on getting Jan.AI fully functional on this system in case it helps others with trouble shooting.
This is specific to the Linux Distribution Q4OS Trinity Desktop Environment (TDE) Debian 12.
The device details are listed in the second half of this article for the Alienware M16 with Nvidia 4070 8 GB NVRAM.
Jan.ai worked out of the box at basic levels (without the GPU enabled) for some models, but had trouble with other models.
I will try to keep a running list of what is working and not working here, and provide updates on any fixes found for each model.
First of all, getting the GPU to work.
While for regular desktop use, the Nvidia drives that loaded with Q4OS "just worked", when it came to AI tools, including easier end-user accessible desktop tools like Jan.ai, this was not the case.
The following were "intentionally" installed (rather than just being dependency installs):
apt-mark showmanual | grep nvidia
nvidia-kernel-open-dkms
q4os-nvidia-drivers
Full relevant list:
apt list --installed *nvidia*
Listing... Done
firmware-nvidia-gsp/stable,now 525.147.05-4~deb12u1 amd64 [installed,auto-removable]
glx-alternative-nvidia/stable,now 1.2.2 amd64 [installed,automatic]
libegl-nvidia0/unknown,now 545.23.08-1 amd64 [installed,automatic]
libgl1-nvidia-glvnd-glx/unknown,now 545.23.08-1 amd64 [installed,automatic]
libgles-nvidia1/unknown,now 545.23.08-1 amd64 [installed,automatic]
libgles-nvidia2/unknown,now 545.23.08-1 amd64 [installed,automatic]
libglx-nvidia0/unknown,now 545.23.08-1 amd64 [installed,automatic]
libnvidia-allocator1/unknown,now 545.23.08-1 amd64 [installed,automatic]
libnvidia-cfg1/unknown,now 545.23.08-1 amd64 [installed,automatic]
libnvidia-egl-gbm1/stable,now 1.1.0-2 amd64 [installed,auto-removable]
libnvidia-egl-wayland1/stable,now 1:1.1.10-1 amd64 [installed,auto-removable]
libnvidia-eglcore/unknown,now 545.23.08-1 amd64 [installed,automatic]
libnvidia-encode1/unknown,now 545.23.08-1 amd64 [installed,automatic]
libnvidia-fbc1/unknown,now 545.23.08-1 amd64 [installed,automatic]
libnvidia-glcore/unknown,now 545.23.08-1 amd64 [installed,automatic]
libnvidia-glvkspirv/unknown,now 545.23.08-1 amd64 [installed,automatic]
libnvidia-gpucomp1/unknown,now 545.23.08-1 amd64 [installed,automatic]
libnvidia-ml1/unknown,now 545.23.08-1 amd64 [installed,automatic]
libnvidia-nvvm4/unknown,now 545.23.08-1 amd64 [installed,automatic]
libnvidia-opticalflow1/unknown,now 545.23.08-1 amd64 [installed,automatic]
libnvidia-pkcs11/unknown,now 545.23.08-1 amd64 [installed,automatic]
libnvidia-ptxjitcompiler1/unknown,now 545.23.08-1 amd64 [installed,automatic]
libnvidia-rtcore/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-alternative/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-cuda-mps/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-detect/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-driver-bin/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-driver-libs/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-driver/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-egl-common/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-egl-icd/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-installer-cleanup/stable,now 20220217+3~deb12u1 amd64 [installed,automatic]
nvidia-kernel-common/stable,now 20220217+3~deb12u1 amd64 [installed,automatic]
nvidia-kernel-open-dkms/unknown,now 545.23.08-1 amd64 [installed]
nvidia-kernel-support/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-legacy-check/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-libopencl1/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-modprobe/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-opencl-common/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-opencl-icd/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-persistenced/stable,now 525.85.05-1 amd64 [installed,upgradable to: 545.23.08-1]
nvidia-settings/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-smi/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-support/stable,now 20220217+3~deb12u1 amd64 [installed,automatic]
nvidia-vdpau-driver/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-vulkan-common/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-vulkan-icd/unknown,now 545.23.08-1 amd64 [installed,automatic]
nvidia-xconfig/unknown,now 545.23.08-1 amd64 [installed,automatic]
q4os-nvidia-drivers/now 4.4-a1 all [installed,local]
xserver-xorg-video-nvidia/unknown,now 545.23.08-1 amd64 [installed,automatic
And yet:
# nvidia-detect
Detected NVIDIA GPUs:
0000:01:00.0 VGA compatible controller [0300]: NVIDIA Corporation AD106M [GeForce RTX 4070 Max-Q / Mobile] [10de:2860] (rev a1)
Checking card: 00.0 VGA compatible controller
Uh oh. Your card is not supported by any driver version up to 545.23.08.
A newer driver may add support for your card.
Newer driver releases may be available in backports, unstable or experimental.
nvidia-driver is already the newest version (545.23.08-1).
Which is darn close to the latest available through the manual download New Feature Branch, and much newer than the 535 Production Branch straight from the NVidia website.