Gareth Bale rejected an offer to come out of retirement to play for Wrexham because "he knew his body wasn't up to it anymore," his agent said.