Welcome to the forum, Lela.
You stated that you wear your hair down all the time. That may be a big part of the problem - it was for me! All that rubbing against my shirts, car seats, blowing in the air was causing me to see bits of hair on the sink, my shirt, and the bathroom floor.
What really made a difference for me was maximizing the amount of moisture my hair received everyday. If you're just starting out, try using jherri curl activator (no, I'm not kidding). Concentrate especially on the hair from the ears to the ends (extra on the ends). Your ends are the oldest, driest part of your hair, and therefore the most fragile.
The second thing which got me past the nape-length/brushing tops of the shoulder length was putting my hair in a bun.
For example, after you have thoroughly moisturized your hair and placed oil (or vaseline) on your ends, put your hair in a ponytail and braid the ponytail. Place a sandwich bag, the kind without the zip or the teeth, over your braid, and secure it with a silky scrunchie. Place a dark nylon, clipped from the toe of your pantyhose, over the bag. At this point, many of us use what is called a "phonytail" or a "phony ponytail" as the final step. Others choose to keep the dark nylon exposed, secured with another silky scrunchie, which looks very pretty.
Are you tying your hair up at night with a silk or satin scarf? Do you have a silk or satin pillowcase? cotton is great at absorbing oil but bad for the hair b/c it sucks out moisture.
If your hair is relaxed, try going one week longer than usual between touchups, and remember to thoroughly coat your already-relaxed hair with conditioner (but leave the new growth alone) before each touch up.
All of these tricks have helped me to leave my hair alone...which allowed it to grow. HTH