Traxxas says there is "no limit"
View attachment 164006
https://traxxas.com/products/parts/escs/vxl3s
So it "should" work with the motor, but you may not get more speed from it.
Changing the motor and or ESC may not be the answer. The amount of energy to propel you car to what every speed is the same regardless of your KV and gears. That energy comes from the batteries and it's and it's about current. If you pull too much current the battery voltage will droop and drop your RPM. At that point the ESC and motor are along for the ride.
Theoretically more KV equates to more RPM and leads to speed. But gearing counts. The higher KV motors have less torque and if you keep the same gears it may never get there because your are still overtaxing the system. In that case you would be better running lower gears and higher RPM. Which which puts you back in the same place.
If you are using the factory battery with the Deans connector, I would bet it's an issue.
You might look at China Hobby or SMC. They seem to have good energy density. Or get two smaller batteries, stack them up and run them in parallel.
https://chinahobbyline.com/collections/cnhl-voltage-11-1v-3s-lipo-batteries
https://www.smc-racing.com/index.php?route=product/category&path=67_99
But before you do that, let's try some much cheaper alternatives.
1. Use a good connector. Deans is not designed for high current application. Traxxas claims the ESC "provides high-current output (320 amp peak)". There is no continous current quoted, but I would bet it's at least 80-100 AMP. I would suggest using at minimum an XT60/EC3. I run XT60 in my Slash on 3S and haven't had any melted connectors, but I'm not speed running it and I'm using the stock gearing.
2. See if you can fit two batteries in parallel. This doubles your current (Amps) capacity. Stack them up and fit your wires.
3. Keep an eye on your temps. More speed/current means more heat.
4. Modify your driving style. This might just fix your problem. Ease into the throttle and build up the speed slowly. Punching it leads to a massive current spike. If you ease into it, the system has time to build up the RPM. You will need a lot of room.
To give you an idea of what that looks like, look at the data log on the left. Notice the current spike (green) coincides with the quick throttle ramp (Black) and the massive voltage droop (red). The one on the right is what I would like.
View attachment 164022View attachment 164023