I managed to fix the speed (Somewhat) with the help of How to access libinput properties in Wayland for an external touchpad? - #2 by jpetso . I set pointerAcceleration to 1, which I think made the tablet use the same acceleration as the mouse.
I didn’t find any setting in there to set custom speeds, but this works well enough for me so I’m sticking to it.