The city that spent billions on tourism is now seeing the biggest decline in visitors