Would You Shop Somewhere That Charged a Credit or Debit Card Fee?

I like to think we are all on a tight budget, maybe it is just me. Depending on what store I go to I actually add up all of the items I am putting in my cart or shopping bag before I check out. This is my way of controlling my over spending habit. If I have calculated my exact total and I get to the checkout only to find out that there is an extra fee for using my debit or credit card I am usually less than impressed. Especially if the fee is $5.00 or more. On the other side of things...why should the business have to pay for the method of payment I choose?