If you want to really worry - think about all the Iraqui and Afgani insurgents that for the last 10 years have waged war against US and survived. They have worldclass IED making capabilities and it is not that hard to smuggle them in US to begin ground warfare.