Assuming the debt is valid, your failure to pay can certainly lower your credit score. It can also result in a judgment being entered against you, which could allow garnishment of your wages and bank accounts, and a lien being filed which would attach to any real estate you own.