Can our neighbour force us to get rid of our brick compost heaps? He claims it will attract rats

Our new neighbour has demanded we remove our brick-built compost heaps from the bottom of our garden. We've not had any complaints in the 40 years we've been here.