Patience with Joseph V. Cuffari is growing thin in Congress and at the White House, with sources telling Latino Rebels that the embattled Department of Homeland Security Inspector General has embarrassed the agency, snubbed the White House, and fueled a lack of faith in Congress about his ability to continue in the role.