Hmmm, thats odd.... I've tried, or got now, about every kind of plastic container in my shop, and have never had that happen. I love the little butter tubs to soak spray gun parts in the likes of lacquer thinner or acetone. I've even got Aspirin/vitamin/ antacid bottles with cutting oil and kerosene in them to keep around the lathe and mill. Have 8-10 of the dedicated drip or squeeze bottles like you describe and have anything from water to MEK in them. For washing/soaking parts in a smallish container I use a common plastic 5 gal bucket cut off at about 6-8 inches - the one I've got now has had mineral spirits in it for some 5-6 years.
If everything seems to be going well, you have obviously overlooked something........