Intel ARC?

[56Knight]

It seems Intel Arc isn't supported—I have an Arc A60 Pro / Vulkan—but it runs entirely on the CPU.

[MichaelFomenko]

Vulkan: any GPU

Every MoE engine can use any GPU with a Vulkan 1.2 driver (AMD, Intel, NVIDIA, integrated or discrete) in two ways:

• the expert tier: a cache of routed experts in GPU memory, filled at startup from the experts your past conversations used and adapting while you chat. The GPU computes the experts it holds while the CPU computes the rest;
• the dense chain: a whole layer recorded as one GPU submission, with the model's running state kept on the GPU from one layer to the next.