Most stations charge an extra 10 cents per gallon or so, which turns out to be about 3-4 cents per dollar. Thus, only if you get 5 percent cash back is seems to be worth it.
So do you pay for gas with a CC?
I don't see it being worth it - ever - only if you're trying to meet a threshold or when doing 00.1 transactions.