I haven't had this problem. I do know the Magic Eraser is good for making my tub sparkle. Maybe you could try that with some Comet.
If your tub is old and the surface is etched that would happen. Is it cast iron or fiberglass? Mine is a cast iron tub from the 1930's and is etched. I use a Magic Eraser to get it clean.