This is a World War II gun emplacement built during the occupation of Jersey. It presides over the northwest corner of the Island and has views to Guernsey, Sark and Herm. This explains why it was built there.
On a lighter note - my kids have taken to calling it Squidward's House as it reminds them of their favourite cartoon. Now we all call it Squidward's House.