Read your court order(s).
You will probably find that (a) there is an order, maybe the most recent, maybe a previous order, that requires you to keep him informed of your phone number, and (2) that provision has never been changed or removed by any subsequent modifying order. In other words, you probably still have the obligation to give him your new phone number.