There are no walls or fences on the island. In the 32 years that Bastøy has been open, there has only been one escape attempt, when an inmate tried to take a boat to shore with a friend. They ended up capsizing and were caught. There's a strong incentive to not attempt escape: if you're caught, you're sent back to a more strict prison, a much worse place to be than Bastøy.