After sexist comment, Peters to leave Manly