According to the United States Department of Labor, the first Labor Day holiday was celebrated on Tuesday, September 5, 1882, in New York City, in accordance with the plans of the Central Labor Union. The Central Labor Union held its second Labor Day holiday just a year later, on September 5, 1883.

By 1894, 23 more states had adopted the holiday, and on June 28, 1894, President Grover Cleveland signed a law making the first Monday in September of each year a national holiday.

2019 is the 125th official Labor Day!

Longer quote:

[Labor Day is] a peculiarly American holiday. It is a most characteristic representation of our ideals. . . .

To my mind America has but one main problem, the character of the men and women it shall produce. It is not fundamentally a Government problem, although the Government can be of a great influence in its solution. It is the real problem of the people themselves. They control its property, they have determined its government, they manage its business. In all things, they are the masters of their own destiny. . . .

The door of opportunity swings wide open in our country. Through it, in constant flow, go those who toil. America recognizes no aristocracy save those who work. The badge of service is the sole requirement for admission to the ranks of our nobility.

Come unto me, all ye that labour and are heavy laden, and I will give you rest.

 Take my yoke upon you, and learn of me; for I am meek and lowly in heart: and ye shall find rest unto your souls.

 For my yoke is easy, and my burden is light.