Former Chelsea boss Graham Potter has suggested he would rather return to club management amid links to the England job.