Using controlled substances is ALWAYS a concern when it comes to parenting children. You would be wise to stop using and perhaps seek a substance abuse evaluation if you want to have a relationship with your child. Your question does not provide any detail as to whether she believes you have parented under the influence ... but you should not. Clearly your ex is aware of your drug use. Even having controlled substances in the home poses a RISK to children. You should probably get information from a local attorney who can help you restart visitation.