Overloading your closets is never a good idea
If there is ever a ball or a vacuum you need to stuff away in a hurry, you will probably shove it into a nearby closet. Of course, this can lead to your closets storing more miscellaneous objects than clothes, but that is not entirely a bad thing. Overloading them with clothing items might end up causing more damage than you would ever expect.
Putting too many hangers on the central rod can strain it and eventually pull it away from the wall. It will cost you a pretty penny to re-do the entire closet. One trick you can try is to put away items such as winter jackets during the spring or summer. That way, you will free up space and take some weight off, too.