I think almost all Jew-haters in America, hate Arabs as well. Other Muslims, too. If anti-Semitism applies only to Jews, then there must be a similar term for Arabs. But I don't know of any that can be used in polite company like anti-Semitism.
Arab and Muslim-Americans being the obvious exception, of course.