So, swapped in the spare starter I had and it shrieked, started it. But, it also suffered from heat soak.
Decided to pull apart the stock starter I had and other than making a mess, wow these things are simple. Cleaned brushes and commutator with some sandpiper.
This was the end result.
Seems to crank over much faster, gonna try and heat soak it tmmr for some tests.