The video below specifically addresses the child labor issues, but other inequalities were also prevalent during the days before workers united to give a voice to the oppressed and help ensure that that voice was heard. It is an effort to protect the less fortunate from the strong arm of the owners and bosses in the working world.
While labor unions often also have their distasteful qualities, this aspect is the one we celebrate, ironically, by taking the day off.