Pettigrew quitting politics: report

The prime minister has lobbied Pettigrew not to take the job, saying people might think the foreign affairs minister is leaving because he is unhappy with the federal Liberals, according to other reports.
Why would anybody think that?