I used to get them and never got damage, except over time my temple area got thinner, I think.
But, that is when I started getting braid touchups every few weeks to prevent that.
But, still, I think the very very small ones are harder to remove and the manipulation to take your hair down can be bad.