Tories concede local election results have been 'difficult'