Traditional mashed potatoes often taste tangy if they are spoiled, have been out of the fridge for too long after being cooked, are green, have lots of sprouts, or have been prepared using too much sour cream. Although you may need to pay attention, you can prevent mashed potatoes from tasting tangy or bitter.