Three of the 12 Secret Service agents involved in the Colombia prostitution scandal refused to cooperate with authorities and submit to a polygraph test, according to House Homeland Security Committee Chairman Peter King.