Graham Potter has described managing Chelsea as "the hardest job in football" due to the high expectations and recent changes at the club.