Source: Trump 'irritated' by Conway attacks on Romney