In the context, the slip doesn't really make much sense - I don't think he's on the side of the jews, nor do I think that he thinks that there are lots of jewish janitors.
However, I think it is likely that when he's talking about how "millionares" (which apparently means anyone who makes more than $250,000 a year?) need to pay more taxes, there was a part of his mind that was thinking about jews.
