This answer should not replace the legal advice you should seek in an office consultation with a skilled California Family Law attorney.
Child custody is a fact driven determination with the court always focused on the child's best interests. Mere economic superiority alone does not justify a change in a child's custody. A change of custody or time share with the child may be justified if the mother is living an unstable life and or engaging in criminal conduct.
It is always best to have an attorney help you with these challenging and complicated legal and parenting issues.