Since you state this is your child, the child does not fall into the category of being abandoned. If you are asking if you can terminate the father's rights, then you need to file a Petition with the court and ask that his parental rights be terminated.