Michael Howard took a look at a travellers' camp last month

The Tory leader was responding to news the chairman of the Gypsy Council intended to report him to police, alleging he was inciting racial hatred.

But Mr Howard said people who claimed it was racist to raise the issue of the "small minority of travellers abusing our planning system" were just wrong.

Gypsy Council leader Charles Smith branded Tory plans "despicable".

The plans, unveiled last month, would make trespass by travellers a criminal offence under a Tory administration.

TORIES' FIVE-POINT PLAN Review of the Human Rights Act to ensure it does not clash with laws against unauthorised land development New powers for councils to remove illegal caravans and the option of larger court fines Local authorities to be able to purchase land compulsorily where there is a continuing breach of a Stop Notice Revised guidance to police on traveller trespass and criminal or anti-social behaviour on traveller sites Empowering local people to decide on the location of traveller sites

Mr Howard also wants to review human rights legislation to ensure there is not clash with laws against unauthorised land development.

Mr Howard said: "People who claim it's racist to raise the issue of the small minority of travellers who are openly abusing our planning system are wrong.

"It is not. It has nothing to do with race. It's about common sense. And it's about making sure people abide by the law."

A meeting in Westminster organised by the Gypsy and Traveller Law Reform Coalition launched a seven-point charter and a Stamp Out Prejudice campaign.

The charter urges more traveller sites, a task force to advise the government on traveller issues and more support to help more gypsy children into training programmes.