NEW: Man accused of using racial epithet against toddler "is not a racist," lawyer says
Joe Rickey Hundley is accused of slapping a crying 19-month-old on an airline flight
Passengers say Hundley also used a racial epithet to describe the boy
Attorney for parents say they have not yet decided if they'll sue
An Idaho man has been charged with assaulting a minor after he allegedly uttered a racial slur and slapped a 2-year-old boy who cried on a Delta plane as it began the final descent into Atlanta, court papers show.