Walker says he'll 'leave the nonsense to the media'