If you think antisemitism doesn’t matter because of how small the total world population of Jews is, consider that antisemitism is the reason that the modern Jewish population is so small in the first place.
I read a statistic once that suggested that if you got rid of the Roman and Babylonian diasporas, the pogroms, the ghettoization, the expulsions, the executions and the genocides, there would be 350 million Jews in the world today. Instead there are about 14 million. Think about that.
For context the current population of the US id 326 million.