Here is a section of the edl's mission statement taken from there on website.
The English Defence League (EDL) is a human rights organisation that was founded in the wake of the shocking actions of a small group of Muslim extremists who, at a homecoming parade in Luton, openly mocked the sacrifices of our service personnel without any fear of censure. Although these actions were certainly those of a minority, we believe that they reflect other forms of religiously-inspired intolerance and barbarity that are thriving amongst certain sections of the Muslim population in Britain: including, but not limited to, the denigration and oppression of women, the molestation of young children, the committing of so-called honour killings, homophobia, anti-Semitism, and continued support for those responsible for terrorist atrocities.
Everyone of the crimes listed are committed by some members of every race and religion on the planet. But yet the edl specifically aim there hatred towards only Muslims committing these acts.
So how can anyone who joins them not be classed as racist? Please don't try and say its a religious thing and therefore its not racist because that's a smokescreen.