OK, sounds like you have an inappropriately adjusted throttle linkage. To check it, remove the air filter and make sure that there is no change in the idle opening between when you let off the gas, and when you hit the brakes.
A common mistake that people make is to adjust their linkage such that the idle opening is set to 1mm or so, not realizing that the idle stop screw is not screwed in enough to keep the carb from closing any further when the brakes are applied. This can happen when you change gearing, because the motor is shifted from the position you originally adjusted the linkage for, as well as when you use a different engine.
To fix it, you need to mess around with the tension on the spring on the throttle linkage as well as the linkage's overall length. You will know when you have it adjusted properly, by seeing two things:
1.) There is no difference in the carb slide position between idle, and brake.
2.) The slide still allows the carb to open fully when full throttle is applied.