Something equally threatening to full-size aircraft they have been unable to manage is laser pointers. There have been a lot more incidents with them than with RC aircraft, and the FAA hasn't been able to curb that problem. I can still go out and buy a laser pointer with no regulations at all.
While I don't trust any government agency to have my best interest in mind, this round of regulation (attempted) by the FAA doesn't concern me too much. Common sense keeps me out of trouble, unlike some of the idiots who go out and buy a 'toy' with no idea of how to use it safely. The only way I would see this impacting me is if I do something stupid. Flying in my yard or at the local flying field are both safe places away from other air traffic and people. If I choose to fly over a populated area, in the airport traffic pattern, or otherwise endanger others, I deserve whatever I get.