Typically the only way to use money from a certificate of deposit at a bank or credit union before its term ends is to withdraw early and pay a penalty. But there’s an alternative: borrowing a lump sum from the bank holding your CD. You pay back that sum over time, with interest.