How is it that a Jew is forbidden to charge another Jew interest, yet we are told that one has to charge a non-Jew interest?

How can there be such a seeming discrepancy?

This has been used in anti-Semitic literature throughout the ages, so what is the reason behind this law?