GOP congressman: Something derogatory was said