The mood in the Conservative Party is bleak. Many of the political challenges with Brexit can be traced back to the 2017 election.