Leisure centres see membership drop by 20%