No, it needs the heat in the coil the entire time your trying to start to ignite the fuel.
If your reaaaaaaaaally determined, you can use wire and a AA/C/D alkaline battery (C is better, D is best as glowplugs chew through alkaline cells fast). But getting something to stay on the pin on the glow plug will be hard. The negative wire can just be connected to the engine, like one of the mounting bolts. I just don't know how you can secure a piece of wire to the glow plug pin. Maybe with needle nose and one of those cheap banana connectors. Traxxas uses a spring type connector to the ezstart that you force over the glowplug pin and it just stays on there all the time.
I use AA type heaters with LSD NiMH 2000mah AA's and they hold up well. I can also charge the AA's in any general AA battery charger, and in a pinch, I can just buy some good alkalines.
https://www.amazon.com/Hobbypark-Ignitor-Igniter-Starter-Batteries/dp/B016LT187M
https://www.amazon.com/Energizer-Rechargeable-Auto-Safety-Over-charge-Protection/dp/B00IM3P8GS