I had this problem too.
Rolex is right with the idle screw, but if you open it up to much, your idle is going to be way too high.
with the engine off, i test this out by going WOT, then release.... brake then release.
notice the difference if any in the "gap" with (under the air filter).
use that to test until you get it to be the same at idle and brake.
your center carb opening and full brake carb opening should be the same.
I had to make sure that when at center, the servo was pushing the throttle back all the way like it does when you brake. once i got that straight, I fixed the idle.
adrian