Are you counting the days until you can say goodbye to your job forever and start enjoying your golden years? While only about half of all Americans say they're looking forward to retirement, around 18% of Americans retire before age 61 and half of all Americans quit working for good between ages 61 and 65.Some workers leave the workforce involuntarily because they lose their jobs and can't find new ones, or because poor health makes working impossible.