Rottnest Island once the heart of ‘Fortress Fremantle’