Image source: Flickr user John Morgan.You may have to pay taxes on some of your Social Security benefits, but this generally only happens if you have significant taxable income in addition to Social Security. Depending on your income, you could have to pay your federal income tax rate on up to 85% of your Social Security benefits.