If I'm given the choice to eat something that's been coated/injected full of chemicals that, while protecting what I was eating while it was alive, would be otherwise unnecessary and possibly harmful over eating something that was grown without such and is just as good to eat, I'd take the latter. I won't say that non-organic is bad, but living in the vast, open countryside, I'm used to most of the local produce already being organic. Although I've heard it's become a larger trend and companies have jumped on this to overprice organic goods since people will buy it regardless.
In France we have the development of Amap which are generally organic vegetables. You buy directly a set of vegetable from the farmer, it tends to reduce the price but you cannot choose what you want.
I would say that the most important is to buy seasonal and if possible local products. When I see people buying tomatoes in Februar (it was snowing today for me) I feel a bit depressed for them.