Just outside Copenhagen Harbour is a fortress called Flakfortet, one of three island-fortresses built to defend the harbour against naval attack in the 19th century. To get there you have to sail with this boat which leaves from the end of Nyhavn during the summer months. On the island there's a little harbour and a restaurant.
