How many of the people you're in traffic with do you guess might know you're doing something other than stickin' your hand out the window? Legal, maybe, but it sure does raise the likelihood of getting hit.
Me, I'd rather put whatever effort it takes into making sure my lights and signals work than find myself standing on the roadside (assuming I'm still alive/conscious) looking at my damaged vehicle and going "But hand signals are totally legal!".