The Issue The issue for consideration in this case is whether Petitioner should be awarded a passing grade on the clinical portion of the dental licensing examination given on December 12 through 14, 1996.
Findings Of Fact At all times pertinent to the issues herein, the Board of Dentistry was responsible for the licensing of dentists in this state and the regulation of the dental profession. Petitioner is a graduate of the University of Florida School of Dentistry and was eligible to sit for the examination for licensure as a dentist in Florida. Petitioner previously has taken and passed the written portion of the dental examination. He has taken the clinical portion of the examination twice and has received a failing grade each time. He is eligible to take the clinical portion alone for a third time, but must do so within a period of 13 months of taking it the second time or must take both the written and oral portions again. Dr. Scheutz first took the examination in June 1996. He received a passing grade in each of those examination portions which dealt with Florida laws and rules and with oral diagnosis. However, he received a grade of 2.31 on the clinical examination portion of the examination, and a passing grade was 3.0. Thereafter, in December 1996 he again took the clinical portion and this time received a grade of 2.71, still below the 3.0 passing grade. Dr. Theodor Simkin is a licensed dentist and consultant to the Board of Dentistry, who has been in the private practice of dentistry since 1950 and in Florida since 1975. He has been involved in the development, administration, and grading of the dental examination in Florida since 1979 and was a supervisor for the December 1996 examination. He is familiar with the standards applied in the clinical portion of the examination and how the examination is given and graded. Petitioner has challenged the grade he received on five separate procedures he performed during the December 1996 examination. The procedures chosen for accomplishment during the examination are not unusual procedures, but are common problems seen on a routine basis by a practicing dentist. Dr. Simkin reviewed the mannequin on which Petitioner did his work and which he presented to the examiners for grading. One of the grades challenged related to a "composite restoration" (Clinical D) for which Petitioner received a grade of 0. In this procedure the candidate is presented with a tooth on a mannequin. The candidate is instructed to cut off a corner of the tooth and then restore that corner with an amalgam restoration. The examiners are not present when the procedure is accomplished, but grade the procedure after completion. Instruction on the procedure is given to the candidate by a monitor who is present in the room but who does not grade the work done. The examination process is accomplished using the candidate number, not the candidate name, so that examiners do not know whose work at which they are looking. Once the procedure is done by the candidate, the mold is packed in the candidate's presence and is then held in the custody of the Board of Dentistry until examined independently by each of three examiners. Once graded, it is then shipped to Tallahassee and kept in a vault until needed, as here, for review by Dr. Simkin and others. Ordinarily, even if dropped, a model will not break. In the instant case, Petitioner performed the procedure on an upper right central incisor. The right corner of the tooth, approximately one-third of the tooth, was cut off and the candidate was instructed to rebuild it with a composite material. When the examiners evaluated Petitioner's work, they found that the filling was not bonded to the tooth and was loose. The loose restoration would be useless to the patient, whereas a properly done restoration should last for at least several years. On a human, the stresses applied to a tooth repair are significant, and the repair must be sufficient to withstand them. Notwithstanding Petitioner's claim that the tooth used was an artificial tooth to which the filling material does not easily bond, Dr. Simkin asserts that the bonding which occurs with a plastic tooth is different from that which occurs in a real tooth but the material can bond to the plastic tooth. He knows of no other complaints by other candidates at this examination of not being able to complete the restoration because the materials would not bond. Petitioner admits that when he did the procedure during the June 1996 examination, the tooth bonded correctly. In light of all the evidence regarding this point, it is found that Petitioner's claim is without merit. Petitioner also challenges his score of 2.0 received for his work on an "amalgam cavity preparation" (Clinical B). This composite score was based on a 2.0 awarded by each of the three examiners. An amalgam preparation is what is done to the tooth to get it ready for filling. In this case, an actual patient, supplied by the examines, had a cavity which was reviewed by the examiners. Once the patient was accepted by the examiners, the candidate then cleaned out the cavity and got it ready for filling. Dr. Simkin's review of the documentation prepared in regard to this candidate's performance of this procedure, in his opinion, supports the grades given by the examiners. Here, Petitioner sent the examiners a note as to what he proposed to do with his patient. Petitioner sought to deviate from a normal preparation due to the location of the caries, and the monitor agreed, as did the examiners. Thereafter, the candidate did the procedure. All three examiners graded his work against his proposal and gave him a failing grade. The examiners determined that his work on this patient merited only a grade of 2.0 because, according to two examiners, the margin of the filling was not separated from the next tooth as required. As to the "posterior endodonture procedure" (Clinical M), Petitioner received an overall score of 1.3. In this procedure, the candidate is required to bring in an extracted tooth which is mounted in an acrylic block. The candidate is to remove the nerve and diseased tissue, clean the cavity, file it, fill the canals, and seal the tooth. This is known as a root canal. In grading a candidate's work, the examiners look to see that the canal is properly cleaned out, is filled properly and sealed with a surface that is slightly shorter than the apex (highest point) of the tooth. On the x-ray taken of Petitioner's sample, it is obvious, according to Dr. Simkin, that one canal is at or short of the apex, but the other is long, and this is considered unacceptable treatment. Even Petitioner agrees. Petitioner received grades of 3.0, 2.0 and 1.0 for an overall failing grade of 2.0 on the "prep. cast restoration" (Clinical F). In this instance, the procedure called for the candidate to install a gold onlay. Normally the surface to which the onlay is to be placed is reduced slightly below the abutting face. Here, though one side was acceptable, Petitioner reduced too much on the other side without reason. Petitioner claims, however, that only one of the three examiners indicated excessive reduction. That determination calls for a very subjective opinion. He cannot understand how the propriety of reduction can be determined without looking into the mouth of a patient. However, Petitioner has presented no evidence in support of his opinion. The fifth challenge relates to the grade Petitioner received in the "pin amalgam pre. procedure" (Clinical G). This involves a situation where one cusp has been removed, and in order to hold a restoration, Repin must be placed in the solid portion of the tooth. The examiners determined that Petitioner's occlusal was too shallow at 1 mm, when it should have gone down 1~ to 2 mm. This, the examiners considered, would not give enough strength to hold the amalgam properly without risk of fracture. Dr. Simkins is of the opinion that Petitioner was subjected to a standardized test which was graded fairly. It would so appear and Petitioner introduced no evidence to the contrary. Ms. Carnes, a psychometrician and an expert in testing and test development who trains examiners to ensure they are consistent in their evaluations, agrees with Dr. Simkins' appraisal. The Department of Business and Professional Regulation tries to insure through its standardization efforts that the approach to grading of each examiner is consistent and that all examiners are grading with the same set of criteria. This was done in preparation for the December 1996 dental examination and a check done after the examination showed it was graded this way. Petitioner cites by way of explanation, if not excuse, that during his senior year in dental school, he was badly injured in an automobile accident and required stitches and several weeks of physical therapy for, among other injuries, a herniated disc. When he recovered sufficiently, he finished his course work and sat for the dental examination in June 1996, passing two of three sections, but not the clinical portion. Dr. Scheutz took the clinical portion of the examination again in December 1996 and again failed to earn a passing score. In his opinion, his knowledge has improved over time, but his procedural skills have diminished over the months due to his injuries. He contends he has work in dentistry he can do which will make accommodations for his physical condition, but does not believe he should have to wait another six months to take the examination again, especially since he would have to again take the entire examination, including those portions he has already passed since at that time more than 13 months from his last examination would have passed. Petitioner contends the clinical testing portion of the examination is too subjective to be valid. He wants to close this chapter in his life, but does not want to deal any more with the Board.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is recommended that the Board of Dentistry enter a Final Order denying Petitioner's challenge and sustaining the award of a failing grade on the clinical portion of the dental examination taken by the Petitioner on December 12 through 14, 1996. DONE AND ENTERED this 27th day of June, 1997, in Tallahassee, Leon County, Florida. ARNOLD H. POLLOCK Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (904) 488-9675 SUNCOM 278-9675 Fax Filing (904) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 27th day of June, 1997. COPIES FURNISHED: Dr. Eric J. Scheutz, pro se 332 Whispering Oaks Court Sarasota, Florida 34232 Karel Baarelag, Esquire Agency for Health Care Administration 2295 Victoria Avenue Fort Myers, Florida 33906-0127 Jerome W. Hoffman, General Counsel Agency for Health Care Administration 2727 Mahan Drive Tallahassee, Florida 32309 William Buckhalt, Executive Director Board of Dentistry 1940 North Monroe Street Tallahassee, Florida 32399-0792
The Issue The issue in this case is whether Petitioner should have received a passing score on the June 2001 Florida Dental Licensure Examination, notwithstanding Respondent’s determination that he failed the test.
Findings Of Fact The evidence presented at final hearing established the facts that follow. Siegel, who graduated from dental school in 1999, took the June 2001 Florida Dental Licensure Examination (the “Exam”), which was administered by the Department on June 2 through June 5, 2001. The Exam had two parts, a Clinical Part and a Laws and Rules Part. The Clinical Part was further divided into ten sections, each of which consisted of a separate clinical procedure. The minimum passing score on the Laws and Rules Part was 75.00; on the Clinical Part, a minimum score of 3.00 was required to pass. As calculated by The Department, Siegel scored 70.00 and 1.49, respectively, on the two parts. Thus, according to The Department, Siegel failed both parts of the Exam. Each candidate’s performance on the Clinical Part of the Exam was scored independently by three examiners chosen by the Department.1 These examiners were not informed of any candidate’s identity, nor were the candidates told the examiners’ names; they were not permitted to speak directly to one another while the Exam was being administered. The examiners who graded Siegel’s clinical performance had successfully completed standardization training.2 Additionally, the Department determined, as part of a routine post-Exam statistical review of examiner performance, that these particular examiners were reliable in terms of their consistency in applying the proper grading criteria.3 To determine a candidate’s overall score on the Clinical Part of the Exam, the Department first computed the average of the three examiners’ raw scores for each individual procedure. Each average score was then adjusted using the percentages prescribed in Rule 64B5-2.013, Florida Administrative Code, to arrive at a weighted mean score. A candidate’s overall score on the Clinical Part was equal to the sum of his or her weighted mean scores for each section. At hearing, Siegel challenged just one clinical procedure, the Patient Amalgam Restoration.4 An amalgam restoration is a dental procedure that involves filling a cavity so that the affected tooth is restored to proper form and function. After this procedure, the treated tooth should closely resemble its original size and shape. Siegel’s raw scores on this procedure were very low. One of the examiners who testified at the hearing, a dentist with some 40 years’ experience, had awarded Siegel no points for the Patient Amalgam Restoration procedure because, after completion of the work, the restoration was fractured and the patient’s gingival margin was open. Another examiner, a dentist with 35 years of experience, explained at hearing that Siegel's work on the amalgam restoration was a failure; in this examiner’s opinion, the patient's tooth was actually in worse condition after Siegel had finished the procedure. The testimony of these examiners was credible and is accepted as being truthful and accurate. Accordingly, it is found that Siegel failed to perform the amalgam restoration with the minimum degree of skill and competence required for licensure as a dentist in this state. For his part, Siegel contended that one of the examiners (presumably the one who did not testify at hearing) had caused the restoration to fracture. Siegel based this theory on the account of his patient, Scott Graham, who testified that one of the examiners had "picked" at his tooth with a sharp instrument.5 (Mr. Graham is not a dentist.) Mr. Graham, however, had not complained about any alleged examiner misconduct at the time of the examination. Likewise, no examiner ever reported any such irregularity. In the absence of contemporaneous corroborating evidence, created before it became known that Siegel had failed the Exam, Mr. Graham’s testimony is simply not persuasive evidence of examiner misconduct. To be sure, it is theoretically possible that an examiner might damage a candidate’s work and then attempt to cover up his error by blaming the candidate. The evidence in this case, however, is not nearly sufficient to support such a finding. To underscore the point: Siegel’s theory is speculative at best. As for the remaining clinical procedures, while Siegel complained that his scores were not a reliable or accurate measure of his performance, he failed to introduce any persuasive evidence in support of this allegation. At bottom, the trier is not persuaded that the scores Siegel received were arbitrary, capricious, unfair, inconsistent, or otherwise objectionable. To the contrary, the evidence in the record demonstrates convincingly that the scores Siegel received on this Exam were reliable, correct, impartially rendered, and consistent with the grading practices used in scoring other candidates’ work.
Recommendation Based on the foregoing Findings of Fact and Conclusion of Law, it is RECOMMENDED that the Department advise the Board Of Dentistry to enter a Final Order (a) holding that Siegel's administrative challenge to the scores he received on the June 2001 Florida Dental Licensure Examination is without factual and legal merit and (b) declaring that Siegel failed said examination. DONE AND ENTERED this 19th day of February, 2002, in Tallahassee, Leon County, Florida. JOHN G. VAN LANINGHAM Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 19th day of February, 2002.
The Issue The issue for determination is whether Petitioner successfully completed the December 1999 dental licensure examination.
Findings Of Fact Petitioner has been given a temporary permit to practice dentistry due to his being a resident in training. In December 1999, Petitioner took the dental licensure Examination. He successfully completed the Laws and Rules part of the Examination having received a score of 78.00, where a minimum score of 75.00 was required to pass that part. Petitioner failed to successfully complete the Clinical part of the Examination having received a score of 2.89, where a minimum score of 3.00 was required to pass the Clinical part. As a result, Petitioner failed to successfully complete the overall Examination. On the Periodontal section of the Clinical part, Petitioner received a score of 1.66. He challenges this score. Each candidate is graded by three examiners. Each examiner is a dentist who is licensed in the State of Florida, with a minimum of five active years' experience, and who, among other things, has no complaints or negative actions against his/her license. Before every examination, each examiner is trained in evaluating a procedure to make sure that the procedure is properly performed. The Department of Health (Department) conducts training in which each examiner is trained to grade using the same internal criteria. Such training results in a standardization of grading criteria. In this training process, the examiners are trained by assistant examiner supervisors on the different criteria that are used during the examination. The assistant examiner supervisors are dentists licensed in the State of Florida. To further their training, the examiners after receiving verbal training are shown slides of teeth which do not meet the clinical criteria of the examination. Following the standardization, to make sure that the examiners have been able to internalize the criteria, the examiners, themselves, are given an examination. Included in the examination is a hands-on clinical, where models are used and the examiners check for errors on the models. The examiners are evaluated on how they perform when they grade the models, to make sure that the examiners are grading the candidates the same, using the same criteria, and with reliability. Each examiner grades the examination independently. The examiners do not confer with each other while scoring the examination. The examiners do not have contact with the candidates. As to grading, the average of the three grades from the examiners produces the overall grade for the exercise performed by the candidate. Having three examiners grading provides a more reliable indication of the candidate's competency and true grade. Furthermore, the examination is double-blind graded, which is a grading process in which the candidates have no contact with the examiners. The candidates are located in one clinic and perform the dental procedures on their human patient. The clinic is monitored. When the candidate completes the procedures, a proctor accompanies the human patient to another clinic where the examiners are located, and the examiners grade the procedures performed by the candidates. Monitors are used by the Department at the examination. The role of a monitor is to preserve and secure the integrity of the examination. The monitor, among other things, gives instructions to the candidates, answers questions of the candidates, and acts as a messenger between the candidate and the examiner. Monitors also ensure that candidates do not have contact with the examiners. For the Periodontal section, a candidate, as Petitioner, performs a periodontal exercise on a human patient who is chosen by the candidate. The human patient must also be approved by the Department in accordance with criteria specified by rule.2 The criteria includes a requirement that the human patient must have a minimum of five teeth, each of which must have pockets of a minimum of four mm in depth with sub-gingival calculus. Petitioner chose his human patient. The Department approved Petitioner's human patient. Petitioner's human patient was a periodontally involved patient. Petitioner performed the periodontal exercise on his human patient. Petitioner's exercise was graded by three examiners, i.e., Examiners 131, 346, and 264. All three examiners participated in and successfully completed the standardization training, and it is inferred that they were considered qualified to act as examiners for the Examination. Petitioner's examination was double-blind graded. Each examiner independently graded Petitioner's examination. Examiner 131 found no errors and awarded Petitioner a grade of five (5). Examiner 346 found gross mutilation of the human patient's soft tissue of areas 26, 27, and 28, and awarded Petitioner a grade of zero (0). Examiner 264 also found gross mutilation of the human patient's soft tissue of areas 26, 27, and 28, and awarded Petitioner a grade of zero (0). The criteria for the Periodontal exercise mandates a grade of zero (0) where there is gross mutilation of gingival tissue.3 Consequently, Examiners 346 and 264 had no choice but to award Petitioner a grade of zero (0). After the grading, both graders who found gross mutilation of gingival tissue made written comments, regarding the tissue mutilation, on the Examiner-To-Monitor Instructions form. Examiner 264's comment was "Please have candidate place perio pak, area 26, 27, 28" and was not intended to be instructions to Petitioner but was directed to follow-up work or to attention that the human patient may need afterwards. The Examiner-To-Monitor Instructions form, with the written comments, was provided to the monitor who related the comments to Petitioner. The monitor did not allow Petitioner to view the written comments. The monitor informed Petitioner that further work needed to be done as to the human patient. The monitor indicated on the Examiner-To-Monitor Instructions form that Examiner 264's comment was related to Petitioner by the monitor writing "Candidate complied with" and writing and circling his assigned monitor number. The monitor writing "Candidate complied with" meant only that the monitor informed Petitioner that further work needed to be done, not that the Petitioner correctly performed the procedure. No evidence was presented that Petitioner sutured the human patient or that he placed a perio pak on the affected tissue of areas 26, 27, and 28. The evidence shows that the monitor only related to Petitioner that further work needed to be done without the monitor specifying what needed to be done. Moreover, the evidence shows that the monitor did not indicate that Petitioner had done what was requested of him. A candidate is not informed of his/her performance by the examiner because there is no contact between the examiner and the candidate. Additionally, such notification at the Examination site is not done because it is believed to have the effect of alarming the candidate and raising the candidate's anxiety level. The human patient was not informed that there was mutilation of soft tissue as a result of the periodontal exercise. Before an individual is accepted by the Department as a patient, the individual must complete and sign a "Patient Disclosure Statement and Express Assumption of Risk" form. This form, among other things, relieves the Department of any responsibility for poor work done by a candidate or for notifying the human patient of any poor work done by the candidate and places the responsibility on the human patient to have a licensed dentist check the work done by the candidate. The grading of Petitioner's Periodontal exercise is not arbitrary or capricious or an abuse of discretion. The grading process is not devoid of logic and reason.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that the Department of Health, Board of Dentistry, enter a final order dismissing Rami Ghurani's examination challenge to the periodontal section of the clinical part of the dental licensure examination administered in December 1999. DONE AND ENTERED this 15th day of December, 2000, in Tallahassee, Leon County, Florida. ERROL H. POWELL Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 15th day of December, 2000.
The Issue Whether the Petitioner should receive on the the clinical portion of the examination additional credit, which is sufficient to receive a passing grade on the December 1997 dental licensure examination.
Findings Of Fact Petitioner, Neda Raeisian, was a candidate for the dental licensure examination administered by the State of Florida in December 1997. The dental examination administered in December 1997 consisted of three parts: a "Florida Laws & Rules" part, an "Oral Diagnosis" part, and a "Clinical" part. The Petitioner received passing scores on the "Florida Laws & Rules" and "Oral Diagnosis" parts of the examination. Petitioner received a score of 2.95 on the Clinical part of the examination. A score of 3.00 was required on the Clinical part of the examination. The Petitioner failed the Clinical portion by .05 of a point, and, therefore, she failed the overall dental examination. Three examiners grade each candidate's clinical portion of the dental examination. Three examiners are used because by averaging the scores of the three examiners, the Respondent is more likely to capture the candidate's true score than by using one or two examiners. Before an examiner may be used for an examination, he or she must be recommended by an existing examiner or by a member of the Board of Dentistry. The proposed examiner may not have any complaints against his or her license and he or she must have been actively practicing and licensed for at least five years in the State of Florida. The examiner must complete an application that is sent to the Board of Dentistry examination committee, where it is then reviewed by the committee, and if approved, the examiner is entered into the pool of examiners. Before every examination, the Respondent conducts a standardization session, which is a process by which examiners are trained to grade using the same internal criteria. The Respondent uses assistant examiner supervisors who are appointed by the Board to train examiners on the different criteria that are used during the examination. The assistant examination supervisors go through and describe what a score of five would be, all the way down to a zero, the different criteria for each of those particular grades, and under what circumstances those grades should be given. After the examiners go through a verbal training, they are shown slides of teeth and told what the score on that procedure should be. After the standardization, there is a post- standardization exercise where the examiners are required to grade five mannequin models to make sure they have been able to internalize the criteria. After the post-standardization exercise, the Respondent evaluates the examiners to determine whether they are acceptable to use during the examination. There are also post-examination checks on the examiner, whereby the Respondent decides whether or not to use the examiners again. The Respondent runs the post-examination statistical checks to make sure that the examiners grade with consistency and reliability. There is generally a very high agreement rate between the examiners. Typically if there is an inconsistency in grading, it is usually the examiner who gives the higher grade that is incorrect because he or she missed an error; any error found by an examiner must be documented. The examiners grade the examination independently of each other; that is, they do not confer with each other while scoring the examination. The examination is also double-blind graded. Double- blind grading is the process through which examiners have no contact with the candidates. The examination is conducted in such a way that there is one clinic that is monitored by a licensed dentist in which the candidates actually perform the procedures. When the candidates are finished a proctor walks the patient over to another clinic where the examiners are located, and the examiners grade the examination. The candidates perform the patient portion of the examination on human beings that they are responsible for bringing in. If the patient has the necessary characteristics, the patient could serve for two different candidates or on two different examinations. The examination is a minimum competency examination. The grading system used during the clinical portion of the examination is as follows: A zero is a complete failure, a one is unacceptable dental procedure; a two is below minimally acceptable dental procedure; a three is minimally acceptable procedure, which is the minimum required to pass the clinical portion; a four is better than minimally acceptable dental procedure; and a five is outstanding dental procedure. An overall score is determine by averaging the three examiners' scores on the eight clinical procedures, putting different weights into a formula, and calculating the final grade. It is required in Board rule that the scores of the examiners be averaged. The Petitioner challenges the score given to her for her performance on Procedure 03, "Amalgam Final Restoration," of the Clinical portion of the examination. The Petitioner performed Procedure 03, the "Amalgam Final Restoration," on a live patient, Ms. Desiree Peacock. The Petitioner's performance on Procedure 03 was graded by three examiners: examiner number 290, identified as Dr. Richard Tomlin, of Pinellas Park, Florida; examiner number 299, identified as Dr. Haychell Saraydar, of Pinellas Park, Florida; and examiner number 176, identified as Dr. Leonard Britten, of Lutz, Florida. The Petitioner received a grade of 4 on a scale of 0-5 for her performance on Procedure 03 by examiner number 290; and a grade of 3 on a scale of 0-5 for her performance on Procedure 3 by examiner number 299. However, she received a grade of 0 on a scale of 0-5 for her performance on Procedure 03 by examiner number 176. The reason the Petitioner was given a score of 0 on procedure 03 by examiner number 176 was that the examiner felt that there was a lack of contact at the amalgam restoration site. The Respondent's dental expert, Jorge H. Miyares, D.D.S., testified that a score of 4 is given on Procedure 3 when, in the judgment of the examiner, there are only minor errors present which will not jeopardize the procedure; that a score of 3 is given on Procedure 03 when, in the judgment of the examiner, the procedure is completed at entry level; and that a score of 0 on Procedure 03 is mandatory if there is a total lack of contact. The examiners are taught and trained to check for contact when grading a candidate's performance on Procedure 03, as a lack of contact is a very significant error that jeopardizes the integrity of the amalgam restoration. There are two different types of contact involved in a Class II Restoration. The type of contact that was referenced by Examiner 176 in his grade documentation sheet is proximal contact. Proximal contact is when a tooth is restored, the proximal tooth next to it must be touching the tooth that has been prepared. Contact is something that either does or does not exist between two teeth. Contact is checked visually and by running a piece of dental floss between the teeth to see if there is resistance. Examiners 290 and 299 would have been required to give the Petitioner a grade of 0 on Procedure 03 if they had found a lack of contact. The findings of examiners 290 and 299 during their review of the Petitioner's performance on Procedure 03 were inconsistent with the findings of examiner 176 (lack of contact) during his review of the Petitioner's performance on Procedure 03. The inconsistency between the findings of examiners 290 and 299 and the findings of examiner 176 during their review of the Petitioner's performance on Procedure 03 were statistically unusual. Respondent performed Procedure 03 on the patient Desiree Peacock. Following the exam, Peacock used dental floss on the affected area and she believed she felt resistance. Although the grading on Procedure 03 of the clinical portion of the examination is inconsistent, the Respondent followed its standard testing procedures for the December 1997 dental examination. The evidence is insufficient to prove that the Respondent's examiner acted arbitrarily or capriciously or with an abuse of discretion in refusing to give the Petitioner a passing grade on procedure 03 of the clinical examination.
Recommendation Upon the foregoing findings of fact and conclusions of law, it is RECOMMENDED that the Board of Dentistry enter a Final Order dismissing the Petitioner's challenge to the grade assigned her for the clinical portion of the December 1997 dental licensure examination. DONE AND ENTERED this 22nd day of September, 1998, at Tallahassee, Leon County, Florida. DANIEL M. KILBRIDE Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 22nd day of September, 1998. COPIES FURNISHED: Anne Williamson, Esquire Department of Health Building 6, Room 102 1317 Winewood Boulevard Tallahassee, Florida 32399 Dr. Neda Raeisian 2161 Lake Debra Drive Apartment 1726 Orlando, Florida 32835 Pete Peterson, General Counsel Department of Health 2020 Capital Circle, Southeast Bin A 02 Tallahassee, Florida 32399-1703 Angela T. Hall, Agency Clerk Department of Health 2020 Capital Circle Southeast Bin A-02 Tallahassee, Florida 32399-1703
Findings Of Fact Dr. Farah is a candidate for licensure by the Board of Dentistry, having taken the dental clinical examination in June 1985. The examination covers ten domains of dental knowledge and practice; each is separately graded, and then weighted according to an algorithm. Rule 21G-2.13(3), Florida Administrative Code. A weighted grade of 3.0 is required to pass the clinical dental examination. Rule 21G-2.13(2)(c), Florida Administrative Code. Dr. Farah received a grade of 2.96. The June 1985 examination was Dr. Farah's second attempt to pass the clinical examination. The grading scale for each procedure is established in Rule 21G- 2.13(1), Florida Administrative Code, as follows: complete failure unacceptable dental procedure below minimal acceptable dental procedure 3- minimal acceptable dental procedure better than minimally acceptable dental procedure outstanding dental procedure An examiner is required to record a comment in support of any grade below 5. Examiners for the dental examination are experienced licensed Florida dentists. Rule 21G-2.20(4), Florida Administrative Code. They are trained by the completion of 8 to 10 hours of standardization exercises. During the standardization exercises the examiners receive examination grading criteria, grade identical procedures, discuss any grade variance and attempt to eliminate any discrepancies in interpretations of the grading criteria in order to bring the examiners to a consensus on grading. In the periodontal portion of the examination there are five criteria which are accorded equal importance in grading. These are: (a) presence of stain on the assigned teeth, (b) presence of supra-gingival calculus on assigned teeth, (c) presence of sub-gingival calculus on assigned teeth, (d) root roughness on the assigned teeth, (e) improper management of tissue such as gums which may have been lacerated during the procedure. Rule 21G-2.13(4)(b), Florida Administrative Code. The grading is holistic and each examiner assigns a grade based on the examiner's evaluation of the overall procedure. Three examiner's grades are averaged to obtain a final grade score for the individual procedure. Rule 21G- 2.17(1), Florida Administrative Code. The score for that procedure is then weighted and added with the other weighted scores to obtain the overall grade on the clinical examination. As a standardization technique in grading the periodontal exercise, an examiner marks off for root roughness when use of an explorer on treated teeth reveals a tactile roughness but the examiner is unable to visually confirm the presence of sub-gingival calculus. Use of an explorer reveals the presence of root roughness or calculus below the gum level (i.e., calculus which is sub- gingival). Dr. Farah was assigned teeth number 2, 3, 4, 12, 13, l4 and 15 on her periodontal patient. A prior candidate (Candidate 20057) had treated the same patient in her periodontal exercise, and had been assigned some of the same teeth as Dr. Farah, viz., teeth 2, 3, 4, 5, 6, 7 and 8. Candidate 20057 received individual holistic grades of 4, 4 and 5, which average to a grade of 4.33 for the periodontal procedure. Dr. Farah received grades of 1, 2 and 3, which average to a grade of 2.00 for the procedure. (Petitioner's Exhibit 8) Examiner #006 graded both Dr. Farah and Candidate 20057 on their periodontal treatment. That examiner gave Candidate 20057 a holistic grade of 4 (better than minimally acceptable), noting a deduction for "root roughness," but there is no indication on the grade sheet of the tooth or teeth on which roughness was found. Examiner #015 also gave Candidate 20057 a grade of 4, and noted "root roughness" on the mesial side of tooth number 7, which was not one of the teeth later treated by Dr. Farah. The third examiner gave Candidate 20057 a grade of 5 with no comments. (All comments are found on Respondent's Exhibit 3.) After Dr. Farah's treatment of the patient, which occurred two days after the treatment provided by Candidate 20057, Examiner #006 gave Dr. Farah a grade of 3, and recorded that he found sub-gingival calculus on the mesial side of tooth number 3. Calculus is a mineral deposit on teeth which does not form in 48 hours; Examiner #006 missed the calculus on tooth 3 when grading Candidate 20057 (perhaps because it was obscured by the inflammation and bleeding of the gums which the patient testified about at the hearing) or the calculus was on a tooth other than tooth 3, and the wrong tooth was noted by Examiner #006 on Dr. Farah's grade report. Examiner #005 gave Dr. Farah a grade of 2, finding root roughness and sub-gingival calculus on the distal side of tooth number 12, a tooth not treated by Candidate 20057. Examiner #048 gave Petitioner a grade of 1, commenting on "several" instances of sub-gingival calculus on teeth treated by Dr. Farah, as well as the presence of root roughness. (All comments are found on Petitioner's Exhibit 4.) Examiner #006 gave Dr. Farah the highest of her grades on the periodontal procedure, which was that it was minimally acceptable. The other examiners determined that Dr. Farah's treatment left sub-gingival calculus, and was below minimally acceptable standards (the grade of 2) or was unacceptable (the grade of 1). At the hearing Dr. Farah agreed that if calculus remained the appropriate grade would be 2 or lower. There is no reason to adjust the grades assigned on the periodontal exercise. Dr. Farah also prepared a cast class II restoration onlay wax up on a posterior tooth on a stone mannequin of a lower jaw. She received grades of 5, 3 and 2, which average to 3.33. Examiner #080 assigned a grade of 2, wrote on the grading form "undercuts," and also noted that the procedure had a marginal surface finish. Examiner #133 assigned a grade of 3, and noted "poor outline form" but added no comment concerning an undercut. The third examiner, #048, made no deductions and assigned a grade of 5. An "undercut" is an improper preparation of a tooth surface which is to support a crown. During the preparation of the assigned tooth, the center portion of the tooth was reduced to create a trapezoidal shape, similar to an equilateral triangle, the top of which has been cut by a plane parallel to its floor. A wax model of the crown is then prepared. If the side walls of the trapezoid, when the prepared surface is viewed from the top, do not slope downward and slightly outward, when the wax cast is removed, the wax deforms, and the crown made from it will not seat correctly on the tooth. This may cause the crown to fail, and is a serious error. When a curved dental explorer is placed against the base of the tooth and against the surface of the tooth vertically, one may observe whether there is an angular displacement outward from the vertical at the top, indicating an undercut. On Dr. Farah's preparation this test reveals an undercut. The testimony of Dr. Farah's expert, Dr. Robert Murrell, was that a "surveyor" is the proper instrument to use to evaluate a tooth preparation surface for an undercut. Dr. Murrell did so and determined there was no undercut on the Petitioner's work. There are two difficulties in determining whether there is an undercut using the surveyor. The surveyor's rod is fixed in a vertical position and cannot reflect whether it is actually up against the base of the tooth or not, and viewing the rod from the top down does not give visual confirmation whether the top edge is wider than the bottom; neither can one visually inspect the vertical alignment from the side because the remaining portion of the tooth would prevent one from viewing the alignment from the side position. Secondly, as the expert for the Department, Dr. Theodor Simkin, testified, the surveyor is not a proper instrument for determining undercuts on a mannequin, but is meant to be used on castings and other bridge or denture work done outside the patient's mouth. Logic supports Dr. Simkin's assessment, because a surveyor simply cannot be inserted into a patient's mouth. Dr. Simkin's testimony is also more persuasive because he has been, for several years, an experienced dental examiner and examination grading consultant. Dr. Murrell, while certainly a well-qualified dentist, has never been trained to grade the Florida clinical dental examination. Laying aside the question whether the surveyor or the explorer is the better instrument for assessing whether there is an undercut on a tooth, the other method for determining an undercut explained by Dr. Simkin is persuasive. If no undercut is present, when the stone mannequin of the mouth on which Dr. Farah worked is viewed from directly above, it should be possible to view all four bottom corners of the preparation surface at the same time; if there is an undercut, the undercut bottom corner will be hidden when all of the other corners are viewed. Visual examination confirms the presence of an undercut in the front right corner of Dr. Farah's preparation.
Recommendation It is recommended that the petition for regrading of the failing score assigned to Dr. Farah on the June 1985 clinical dental examination be DENIED. DONE AND ORDERED this 27th day of March 1986 in Tallahassee, Leon County, Florida. WILLIAM R. DORSEY, JR. Hearing Officer Division of Administrative Hearings The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32301 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 27th day of March 1986. APPENDIX TO RECOMMENDED ORDER CASE NO. 86-0235 The following constitute my specific rulings pursuant to Section 120.59(2), Florida Statutes (1985) on the proposed findings of fact submitted by the parties. Rulings on Proposed Findings of Fact Submitted by Petitioner Findings of Fact (onlay) Rejected for the reasons stated in Findings of Fact 14 and 16. Accepted in Finding of Fact 15. Rejected for the reasons stated in Finding of Fact 15. Findings of Fact (periodontal)1 Generally accepted in Findings of Fact 1 and 8, except for the final sentence, which is rejected as argument. Rejected for the reasons stated in Findings of Fact 10 and 11. In addition, the question of whether the performance of Candidate 20057 was properly graded does not arise in this proceeding. If Candidate 20057 received high grades although three of the seven teeth treated had to be retreated 48 ours later by Dr. Farah, this does not address the central question in this case: Did the treatment provided by Dr. Farah meet minimum standards? [page 7] Rejected because there is no competent substantial evidence that Dr. Simkin was Examiner #015, but if he was, the proposal is argument, not a finding of fact. Rulings on Findings of Fact Submitted by Respondent Accepted in Findings of Fact 4, 5 and 6. Accepted in Finding of Fact 5. Accepted in Finding of Fact 4. Accepted in Finding of Fact 3. Accepted in Findings of Fact 3 and 7. Accepted in Finding of Fact 8, 9 and 10. Accepted in Finding of Fact 11. Accepted in Finding of Fact 12. Accepted, but clarified in Findings of Fact 13 and 14. Accepted in Finding of Fact 15. COPIES FURNISHED: Mr. Fred Varn Executive Director Board of Dentistry 130 North Monroe Street Tallahassee, Florida 32301 Mr. Fred Roche Secretary Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32301 Salvatore A. Carpino, Esquire General Counsel Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32301 H. Reynolds Sampson, Esquire Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32301 Dr. Mina Farah 21-32 Crescent Street #D-7 Astoria, NY 11105
Recommendation Based on the foregoing findings of fact and conclusions of law, it is RECOMMENDED that Respondent regrade Petitioner's examination and give equal numerical point value to each criterion; it should also regrade procedure 3 giving consideration only to the grades of examiners 038, 02 and 048; all other requests for relief should be DENIED. DONE and ORDERED this 10th day of January, 1983, in Tallahassee, Florida. DONALD R. ALEXANDER Hearing Officer Division of Administrative Hearings The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32301 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 10th day of January, 1983.
The Issue At issue in this case are: (1) the Petitioner's standing; (2) the validity of the Respondent's proposed amendment to F.A.C. Rule 21G-8.004(2) (the so- called designation rule), which would designate the Alabama Dental Hygiene Program (ADHP) as a dental hygiene college or school under Section 466.007, Fla. Stat. (1989); and (3) the validity of the Respondent's proposed amendment to Rule 21G-8.004(3) (the so-called criteria rule), which would establish criteria for approval of a dental hygiene college or school under Section 466.007, Fla. Stat. (1989).
Findings Of Fact The Petitioner, the Florida Dental Hygienist Association, Inc., is a state association whose members are dental hygienists licensed to practice dental hygiene under Chapter 466, Fla. Stat. (1989). The Petitioner contends that the effect of the designation rule will be to allow inadequately educated dental hygienists to sit for examination for licensure in Florida with a resultant dilution of the quality of licensed dental hygienists available to practice dental hygiene in Florida. It is the purpose of the Florida Dental Hygienists Association to insure that the quality of dental hygiene practice is maintained and to insure that the persons licensed as dental hygienists in this state meet minimum education and training requirements. The Challenged Rules The proposed rule under challenge in Case No. 89 designation rule) would amend F.A.C. Rule 21G-8.004(2) by adding the language: The Alabama Dental Hygiene Program sponsored by the Alabama Board of Dental Examiners is determined to be a dental hygiene college or school within the meaning of Section 466.007, F.S., and is hereby approved by the Board. The proposed rule under challenge in Case No. 90 criteria rule) would renumber what is now (3) of F.A.C. Rule 21G-8.004 as (4) and would insert as (3) the new language: Colleges or schools whose program meets the following criteria shall be approved by the Board for the purposes of Section 466.007(2)(b), F.S., upon submission of evidence which establishes compliance with the following requirements: The educational program provides at least 50 hours of formal preclinical training and one year of clinical training which shall include performance of a minimum of 75 prophylaxes. The educational program provides instruction in the following subject areas as they relate to dental hygiene practice. The program shall consist of at least 260 total hours, at least 160 hours of which shall be provided through formal classroom instruction. Students shall be required to successfully complete examinations testing the subject matter presented through formal classroom instruction. Anatomy; Physiology; Biochemistry; General Chemistry; Microbiology; Pathology; Nutrition; Pharmacology; Pain Control; Tooth Morphology; Head, Neck and Oral Anatomy; Oral Embryoloty and Histology; Oral Pathology; Dental Materials; Periodontology; Radiography; Clinical Dental Hygiene (clinical and didactic instruction); Oral Health Education; Community Dental Health; Patient Management; and Medical and Dental Emergencies (including basic life support). Accredited Programs Dental hygiene in Florida is taught in the community college system. There are nine community colleges that have dental hygiene programs, all of which are accredited by the Commission on Dental Accreditation of the American Dental Association. Course work requirements for a dental hygiene degree range from 70 to 95 academic credit hours over a two year plus time period. Florida dental hygiene programs require in excess of 70 credit hours (60 credits being the minimum that a student can have in order to receive an associate of arts degree). Typical of the dental hygiene programs are the dental hygiene programs at the Valencia Community College and the Pensacola Junior College Dental Hygiene Program, each of which requires a minimum of 84 credit hours for a degree. The program includes general education and science courses as well as dental hygiene courses. The curriculum is comprehensive and includes general education, basic sciences, and didactic and clinical dental hygiene education. Education by Florida community colleges is offered at a minimum competency level reflected in standardized "curriculum frameworks" for each program. The frameworks establish a standardized guide for development of education programs and are required by state and federal law. The curriculum frameworks are adopted by the State Board of Education. The curriculum framework for dental hygiene education makes clear that it is to meet the standards for accreditation by the Commission on Dental Accreditation of the American Dental Association. The dental hygiene curriculum frameworks are built on national standards to achieve "leveling," reasonable standardization of education allowing educational credit to be transferred from one school to another. The Accreditation Standards for Dental Hygiene Educational Programs and the Procedures for Evaluation of Dental Hygiene Programs show that dental hygiene education at programs accredited by the Commission on Dental Accreditation is comprehensive. The Commission on Dental Accreditation requires both didactic and clinical dental hygiene education to: (1) be offered at the college level in post-secondary schools or colleges accredited by a regional accrediting agency recognized by the Counsel on Post-Secondary Accreditation; (2) award an associate or baccalaureate degree; and (3) prepare students to continue their education. Regional accrediting agencies require general and liberal arts education as part of the basic studies for each student. A basic science background in dental hygiene education helps students understand the transmission of diseases, such as AIDS. Liberal arts education helps prepare the dental hygienist for effective patient communication relating to dental hygiene. Neither the curriculum frameworks nor the Commission's accreditation standards for dental hygiene education programs establish the number of hours of formal education for each of the components of the curriculum. Some of these components include the maintenance of patient financial records, the collection of fees, the maintenance of dental office inventory controls, the demonstration of public relations responsibilities, the demonstration of skills on office equipment, and the demonstration of employability skills including job interviews and appropriate job changes. Florida's community college programs must also be accredited by the Southern Association of Colleges and Schools. This accrediting body requires all vocational programs at the associate level to offer a minimum of 25% of credit hours in general education and liberal arts which can include subjects such as sociology, government, humanities, art history, music appreciation, etc. In some of Florida's programs, liberal arts and general education may comprise as much as 50% of the dental hygiene curriculum. The dental hygiene curriculum requirements in Florida's community colleges go beyond the Commission on Dental Education minimum requirements in terms of the core dental hygiene instruction. In post-secondary academia, the term "college" means an established institution of higher learning; the term "school" means an organized body that leads to a post-secondary degree. A school is usually organized within a college. A "program" is a term of art in academia that means an identified, organized course of study leading to a degree. Programs are offered within academic schools or colleges. In practice, in dental hygiene academia, the terms "dental hygiene college," "dental hygiene school" and "dental hygiene program" are synonymous. The Commission on Dental Accreditation has accredited Florida's nine dental hygiene programs as opposed to the schools in which they reside. The Commission on Dental Accreditation of the American Dental Association accredits those organized courses of study that lead to a degree in dental hygiene, regardless of whether the course of study is labeled a "dental hygiene college," "dental hygiene school" or "dental hygiene program." The Alabama Dental Hygiene Program The Alabama Dental Hygiene Program (ADHP) is not accredited by, nor does it have status toward accreditation by, the Commission on Dental Accreditation of the American Dental Association. The Alabama Dental Hygiene Program began in 1959 as a system of non- academic preceptorship training. Under the ADHP, any licensed dentist is approved by the state licensing board to provide on-the-job training in dental hygiene to dental assistants with at least one year experience as a dental assistant. 1/ (Candidates also must be at least 18 years of age and must be a high school graduate.) The sponsoring dentist is responsible for the clinical adequacy and thoroughness of training. The program is administered by the Alabama Board of Dental Examiners, which has final authority over it, in concert with the Alabama Dental Association. A candidate cannot enter the program without sponsorship by a dentist. The Alabama Dental Hygiene Program now is a one year course of study that combines formal classroom education with hands-on clinical training. Participants receive approximately 165 hours of didactic lectures in 2 separate week-long sessions and 4 weekend sessions concurrent with the one year of preceptor training. Accredited programs generally include a minimum of approximately 1,000 classroom hours. Faculty and facilities for didactic lectures are provided by the University of Alabama College of Dentistry in Birmingham, Alabama, on a contractual basis. With the exception of one dental hygienist from North Carolina, all of the faculty members for the current ADHP class are on the UAB dental faculty. But it is not a program within or sponsored by the university, nor does the university give academic credit for it. It does not lead to a post-secondary degree. The Alabama Dental Hygiene Program includes significantly less formal classroom education in all of the areas of general education and basic sciences and significantly fewer lectures in the clinical practice of dental hygiene than do accredited programs. The Alabama Dental Hygiene Program does not include the following courses required in an accredited program: chemistry, head and neck anatomy, histology, periodontology, nutrition, public health, pharmacology, pathology, dental materials, law and ethics, sociology, psychology and English. A course in disease control, which is of particular importance since the onset of AIDS, and which requires a strong basic science and biology background, also is absent from the ADHP. Examples of some of the differences are: ADHP ACCREDITED MODEL LECTURE LAB TOTAL HRS. ANATOMY & PHYSIOLOGY 8 88 66 134 MICROBIOLOGY 8 40 40 80 ORAL PATHOLOGY 8 34 0 34 RADIOLOGY 12.5 27 30 57 PREVENTIVE DENTISTRY 12.5 36 6 42 A person trained in the Alabama Dental Hygiene Program would not receive academic credit at Pensacola Junior College or Valencia Community College for the training because it does not meet minimum standards. Clinical training in the office of the sponsoring dentist is done by means of a series of modules which serve, in effect, as building blocks in imparting dental hygiene skills. Each module identifies a number of specific skills that the student must master and requires the sponsoring dentist to evaluate performance for each such skill. The sponsoring dentist must verify in writing that a module has been completed, and the successful completion of all modules is a prerequisite to graduation from the Program. The use of the modules is an attempt to insure that all ADHP students are learning essentially the same skills over the same general period of time. However, the ADHP clinical training is less standardized than under accredited programs. An ADHP student is likely to see more actual patients over the course of the clinical training than a student in a community college program. ADHP clinical training is administered to a one-to-one basis as opposed to the higher student-to-dentist ratio found in community college programs. A great deal of quality control is inherent in the ADHP clinical training in that the student is learning on the sponsoring dentist's patients and he has a professional duty to make sure that a good job is done. However, the dental hygiene exam is the ultimate quality control device for ADHP in that a student must pass the exam in order to become licensed as a dental hygienist. The clinical portion of the Alabama Dental Hygiene Examination is equivalent to the Florida Dental Hygiene Exam in content and in administration. A person who passes the Alabama exam would be expected to pass the Florida exam and vice versa. A six-year comparison of scores on the Alabama clinical exam achieved by ADHP graduates with the scores of graduates of traditional two- or four-year programs reveal that ADHP graduates do just as well as their college- trained counterparts. This is a strong indication of equivalency in terms of clinical abilities. Data from the Alabama Dental Hygiene Licensing Exam also show that the Alabama Dental Hygiene Program graduates perform as well or better as candidates who take the National Board of Dental Hygiene examination. However, comparison of the two examinations is not valid because the National Board Examination is a "norm referenced test" whereas the Alabama Dental Hygiene Examination and the Florida license examination are "criterion referenced tests." There is no valid comparison of examination scores of graduates from the Alabama Dental Hygiene Program with graduates from accredited programs because the Alabama Dental Hygiene Program "graduates" are not eligible to sit for the National Board exam, the only standardized examination. The Proposed Criteria Proposed Rule 21G-8.004(3) provides that a college or school whose dental hygiene program meets the proposed rule criteria shall be approved by the Board of Dentistry. There are 21 subjects listed in the rule, but it is unclear whether those subjects are to be included in the 160 hours of formal classroom instruction or under another setting. There are no minimum number of hours that are attendant to any of the listed subjects. It is not clear whether the hours referenced are academic or actual clock hours. The rule is silent as to the method by which the clinical training is to be provided. The proposed rule is unclear as to its academic requirements and the hours of instruction required. The proposed rule seems to be approving a preceptor or apprenticeship type of dental hygiene training which is similar in structure to the Alabama Dental Hygiene Program. Comparison of ADHP and Criteria with Accreditation Standards The Board of Dentistry bases the proposed rules on a finding that dental hygienists who are trained by the ADHP, or who would be trained in a similar program meeting the requirements of the proposed criteria rule, would by adequately trained to safely and competently perform dental hygiene in dental practices in Florida. Based on the evidence presented, such a finding would be neither arbitrary nor capricious. But the evidence also shows that the training given in the ADHP, and training that would be given in a similar program meeting the requirements of the proposed criteria rule, is not the equivalent of the training given in accredited programs.
