The former leader has denied visiting Epstein's island