You should contact the local office of Adult Protective Services. They get involved with abuse issues. They are qualified to assess the true facts in this case. This would possibly cover you should the elder, or another relative, want to charge YOU with any wrongdoing. Elder abuse is a major issue these days. There are many wrongful charges as well as cases where there is abuse with no charges ever made. This is serious, so you should get involved before someone knocks on your door.