The Issue The issue for determination is whether Petitioner successfully completed the clinical portion of the December 1997 dental hygiene examination.
Findings Of Fact In December 1997, Brandy Kern was a candidate for the dental hygiene examination (Examination). Ms. Kern had completed her dental hygiene studies at the University of Pittsburgh on or about April 29, 1995. She was an excellent student. Prior to making application for the Examination, Ms. Kern had obtained experience in dental hygiene by working as a dental hygienist in at least three dental offices over at least a two-year period in the State of Pennsylvania. Her employers, who were dentists, gave Ms. Kern very positive recommendations. Ms. Kern successfully completed all portions of the Examination, except for the scaling/calculus removal portion of the clinical part of the Examination. As a result, Ms. Kern did not successfully complete the overall Examination. The clinical examination consists of three parts: scaling and calculus removal, polishing, and root planing. The overall score for the clinical examination is determined from all three portions. Scaling and calculus removal counts as 70 per cent of the clinical examination; polishing as 10 percent; and root planing as 20 per cent. Each dental hygiene candidate is graded by three examiners. The clinical portion of Ms. Kern's examination was scored by three examiners. The examiners were 197, 243, and 320. Each examiner is a dental hygienist licensed in the State of Florida and is an experienced dental hygienist. An examiner must be recommended by an existing examiner or by a member of the Board of Dentistry (Board), have no complaints against their license, and be actively practicing. To become an examiner, an application must be completed and submitted to an examination committee of the Board. The committee reviews the application and, if approved, the applicant is placed in a pool of examiners. Before every examination, each examiner is trained in evaluating a procedure to make sure that it is properly performed. The Department of Health (Department) conducts a training in which each examiner is trained to grade using the same internal criteria. Such training results in a standardization of grading criteria. In this training process, the examiners are trained by assistant examiner supervisors on the different criteria that are used during the examination. The assistant examiner supervisors are dentists licensed in the State of Florida and are appointed by the Board of Dentistry (Board). To further their training, after the examiners receive their verbal training, the examiners are shown slides of teeth which do not meet the clinical criteria of the examination. To make sure that the examiners have been able to internalize the criteria, following the standardization, the examiners, themselves, are given an examination. Included in the examination is a hands-on clinical, where mannequins are used and the examiners check for errors on the mannequins. After the examiners complete their examination, the Bureau of Testing evaluates the examiners to determine whether the examiners are acceptable to use for the Examination. Subsequent to the Examination, the examiners are scored by the Bureau of Testing. The scoring is based on an examiner's performance wherein the Bureau of Testing examines how every examiner grades with every other examiner to make sure that the examiners are grading with reliability. This review is based on corroborated errors found by an examiner, not on the average errors found by an examiner. The average errors found by an examiner are irrelevant to the examiner's performance in that one examiner may have graded candidates who made numerous errors, while another examiner may have graded candidates who made very few errors. For the Examination, candidates are required to bring human patients on whom the candidates perform the dental procedures. Each examiner grades the Examination independently. The examiners do not confer with each other while scoring the Examination. Furthermore, the Examination is double-blind graded, which is a grading process in which the candidates have no contact with the examiners. The candidates are located in one clinic and perform the dental procedures on their human patient. The clinic is monitored by a licensed dental hygienist. When the candidate completes the procedures, a proctor accompanies the patient to another clinic where the examiners are located, and the examiners grade the procedures performed by the candidates. For the scaling/calculus removal portion of the Examination, the grading criteria is that complete removal of all supra and sub-marginal calculus from each tooth, without laceration to the surrounding tissue, is required. If the tooth is not clean and/or if there is damage to the surrounding tissue, the candidate is considered to have made one (1) error. Pursuant to Board rule, each tooth is judged as a whole. Even if a candidate makes three mistakes in performing the procedure on each tooth, e.g., calculus could be above the gum, calculus could be below the gum, and/or the gum could be lacerated, only one (1) error is counted against the candidate. The examiners do not document what error was committed by the candidate, i.e., whether the error is a calculus error or a laceration error. In grading the scaling/calculus removal portion of the Examination, a grade of five is the highest grade that a candidate can receive. A five is given if there are zero to three errors found. A grade of four is given if there are four errors found. A grade of three, which is considered to be minimally competent, is given if there are five errors found. A grade of two is given if there are six errors found. A grade of one is given if there are seven errors found, and a grade of zero is given if eight or more errors are found. For an error to be counted against a candidate, at least two of the three examiners must corroborate the error, i.e., at least two of the examiners must find the error. For Ms. Kern's clinical examination, she was scored by examiners 197, 243, and 320. All three examiners participated in the standardization training and were considered qualified to act as examiners for the Examination. Ms. Kern's examination was double-blind graded. Each examiner independently graded her examination. Examiner 197 found one error. Both examiners 243 and 320 found seven errors each. Examiners 243 and 320 agreed on six of seven teeth on which errors were found. Consequently, Ms. Kern was considered to have committed six errors. A post-examination review of the examiners was conducted. Examiners 243 and 320 were found to be reliable in their scoring. However, examiner 197 was found to be unreliable in his scoring. Examiner 197 was not used again for the Examination. The scoring of six errors made by Ms. Kern on the scaling/calculus removal portion of the Examination is not arbitrary or capricious or an abuse of discretion. The scoring process is not devoid of logic and reason. However, because examiners do not document the type of error committed by a candidate, a candidate has no way of knowing what detail of a procedure was improperly performed. The candidate only knows that a procedure, as a whole, was improperly performed. Consequently, a candidate who desires to re-take the Examination has no idea what procedure needs improvement by the candidate in order to prepare for a re-taking of the Examination.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that the Department of Health, Board of Dentistry enter a final order dismissing Brandy Kern's examination challenge to the clinical portion of the dental hygienist licensure examination administered in December 1997. DONE AND ENTERED this 6th day of August, 1998, in Tallahassee, Leon County, Florida. ERROL H. POWELL Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 6th day of August, 1998.
Findings Of Fact Joseph L. Ratchford is a graduate of the University of Georgetown School of Dentistry and took the Florida dental exam in June, 1984. The clinical, or practical, portion of the dental exam consists of ten procedures and the examinee must obtain a total combined weighted grade of 3.0 to pass the clinical portion of the exam. Petitioner received a total overall grade of 2.96 and has questioned the grades he received on two of the ten procedures. In grading the clinical portion of the exam, three examiners separately review and grade each procedure performed by the examinees. At each examination, approximately twelve to thirty examiners are used, and three hundred to four hundred candidates are examined. Each examiner must successfully complete an eight to twelve hour standardization exercise during which they are trained on the grading scale, procedures, and the criteria to be used in grading the clinical portion of the exam. The Board of Dentistry determines the criteria to be used in grading the exams and the grading scale. A perfect score is a "5" and a complete failure is a "O". Examiners are chosen by the Board of Dentistry based upon their successful completion of the standardization exercise and must also have been licensed in Florida for at least five years. Petitioner received grades of 2, 3, and 5 from the three examiners grading the Periodontal procedure on his exam. This resulted in a grade of 3.33 on the Periodontal procedure. Petitioner objects to the grading of this procedure due to the wide disparity in the three examiners' grades. The periodontal procedure is performed on a live patient and is an evaluation of the patient's teeth, root structure, and supporting structures. In grading this procedure, five criteria are used: Presence of stain on assigned teeth. Presence of supra-gingival calculus on assigned teeth. Presence of sub-gingival calculus on assigned teeth. Root roughness on assigned teeth. Tissue management. While several of these criteria are easily observable, criteria (c) and (d) are not, and in fact are sometimes hard to distinguish from each other. The grading system requires two points to be taken off when sub-gingival calculus is present on the assigned teeth (criteria c), and allows one to four points to be deducted for root roughness on the assigned teeth (criteria d). Examiner 10 gave Petitioner a grade of 2 since the examiner found Petitioner was deficient on criteria (a), (c), (d) and (e). A grade of 2 is appropriate with these deficiencies, although such a grade may even be a bit high. Examiner 10 had participated in seven exams prior to the one in question and a post-exam evaluation of all examiners shows that Examiner 10 ranked 6th out of 18 examiners in terms of grading accuracy. Examiner 35 gave Petitioner a grade of 3 since the examiner found Petitioner was deficient on criteria (c). A grade of 3 is mandatory is this situation since the presence of subgingival calculus requires two points to be deducted from the grade. Examiner 35 had participated in no previous exams but ranked 7th out of 18 examiners in terms of grading accuracy, according to a post-exam evaluation of all examiners. Examiner 82 gave Petitioner a perfect score of 5, noting no deficiencies. This was the second exam Examiner 82 had participated in and he ranked 17th out of 18 examiners in terms of grading accuracy. Therefore, the perfect score which Petitioner received from Examiner 82 is the least reliable of the three grades on the Periodontal procedure since Examiner 82 had the worst ranking for accuracy among these three examiners, and was next to last among all examiners. On the Cast Class II Onlay Prep procedure, Petitioner received grades of 1, 0, and 1. This resulted in a grade of .66 on this procedure. Petitioner objects to the grading of this procedure. He states he performed this procedure the way he was taught in dental school, he alleges that the comments of the examiners conflict, and he feels it is impossible to measure tooth reduction without an opposing model. The Cast Class II Only Prep procedure is performed on a model, or mannequin, and consists of a restoration onlay wax-up on a posterior tooth. In grading this procedure five criteria are used: Outline form Depth Retention Gingival level Mutilation of opposing or adjacent teeth Examiners 6 and 37 gave Petitioner a grade of 1. Examiner 6 commented on his score sheet that "Distal box too deep and undercut; excess facial cusp reduction." Examiner 37 commented that outline form was poor and "no lingual cusp protection." Examiner 15 gave Petitioner a score of 0 and commented that there was insufficient reduction of the functional cusp. Each of these examiners had participated in at least two previous exams, and each had a high grading accuracy ranking according to a post-exam evaluation of all examiners. Specifically, Examiner 15 ranked 1st, Examiner 37 ranked 4th and Examiner 6 ranked 8th out of 18 examiners. The comments of the examiners do not conflict and, in fact, do support the grades given. An examination of the mannequin used by Petitioner to perform this procedure (Petitioner's Exhibit 1) by a dental consultant who has been a licensed dentist in Florida since 1971, and who was accepted as a expert on the technical aspects of the clinical portion of the dental exam, confirms and supports the grades given by the examiners on this procedure. The major and significant deficiency on this procedure was Petitioner's failure to adequately reduce the functional or lingual cusp, and excessive reduction of the facial cusp resulting in the subject tooth being almost level. Although it is difficult to determine the amount of tooth reduction without an opposing model, and no opposing model was used in the exam, the teeth used for the exam mannequin are manufactured in large quantities from the sane mold or form. Therefore, variations in these model teeth before the procedures are performed are not visible to the naked eye. Improper reductions on these teeth are visible to the examiners who have seen this procedure performed many times on these same models, both in exams and in the standardization procedure. According to an examination development specialist employed by Respondent who was accepted as an expert in testing and measurement, specifically for the dental exam, the grading of exams which involve hands-on, practical demonstrations of an examinee's skill level is not entirely objective. There is some subjectivity in assigning grades after criteria for each procedure are evaluated. This is why three examiners separately review each procedure, and the average of their grades is used. In addition, Respondent performs the standardization exercise prior to the exam and then evaluates each examiner's grades for accuracy after the exam in order to minimize disparity and the effects of subjectivity. Examiners who do not receive a good evaluation in the post-exam review are not used in subsequent exams. Proposed findings of fact and conclusions of law have been submitted by the parties pursuant to Section 120.57(1)(b)4, F.S. A ruling on each proposed finding of fact has been made either directly or indirectly in this Recommended Order, except where such proposed findings of fact have been rejected as subordinate, cumulative, immaterial or unnecessary. Specifically, Petitioner's proposed findings numbered 7, 10, 11 and 12 are rejected for these reasons, and also because they are not based upon competent substantial evidence.
Recommendation Based upon the foregoing, it is recommended that Respondent enter a Final Order upholding the grades given to Petitioner and denying the relief sought by Petitioner. DONE and ENTERED this 19th day of April, 1985 at Tallahassee, Florida. DONALD D. CONN, Hearing Officer Division of Administrative Hearings The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32301 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 19th day of April, 1985. COPIES FURNISHED: Drucilla E. Bell, Esquire Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32301 Michael S. Rywant, Esquire 240 Hyde Park Avenue Tampa, Florida 33606 Fred Roche, Secretary Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32301 Salvatore A. Carpino, Esquire Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32301
The Issue Whether Petitioner should receive a passing grade on the clinical portion of the dentistry examination administered in December 1996.
Findings Of Fact In June 1996, Petitioner, Arthur A. Gage (Gage), took the dentistry examination for licensure as a dentist in Florida. He was unsuccessful on the clinical part. In December 1996, Gage retook the clinical portion of the examination. He was notified by an examination grade report, mailed on January 13, 1997, that he had again failed the clinical portion of the examination. He achieved a general average score of 2.75. A final grade of 3 or better as a general average on the clinical portion is a passing score. Gage complains that there was inconsistency among the examiners in grading the examination. In particular, he submits that if you average the grades by each examiner on the mannequin portion of the examination that the averages are 3.25, 3.08, and 1.08. Gage averaged all the grades for each examiner and did not average by procedure. Consequently, Gage's approach did not produce a statistically meaningful result. Marsha Carnes, a psychometrician with the Department of Business and Professional Regulation (DBPR), testified for the Respondent. A psychometrician is an expert in testing and measurement. Ms. Carnes' responsibility is to ensure the validity and reliability of the examinations, including the dentistry examination. Ms. Carnes outlined the procedure used for selecting the examiners and the grading of the dentistry examinations. The examiners are selected by the Florida Board of Dentistry (Board) and must have five years of experience as a licensed, active dentist in Florida. The examiner must be recommended by a current examiner or member of the Board. Examiners must submit an application and have no complaints against their dentistry license. After the examiners are selected, they are trained by DBPR. Approximately one month prior to the dentistry examination, the examiners are sent the details of the examination, the clinic monitor, and an examiner instruction package. The examiner package outlines the grading criteria, the procedures for the examination, and the necessary paper work. The day before the examination, the examiners go through a standardization process conducted by the psychometrician and three assistant examiner supervisors from DBPR. The process takes approximately eight hours. There are nine clinical procedures in the dentistry examination. Three of the procedures are performed on a patient, five on a mannequin, and one is written. As part of the standardization process, the assistant examiner supervisors outline the criteria for each procedure that is on the examination and explain what is and is not minimally acceptable. The examiners are shown slides, and the supervisors explain what grade should be awarded for each procedure shown on the slides. The examiners are given a post standardization examination to make sure that they have internalized the criteria explained during the standardization process. The examination consists of the examiners actually grading models created by applicants in past examinations. Twenty-five different procedures are graded, and DBPR staff evaluate the grading of the examiners to ensure that they are grading consistently. Scores of zero through five are possible on each examination procedure. Five is considered to be an outstanding dental procedure. Four is better than minimally acceptable. Three is minimally acceptable. Two is below minimally acceptable. One is unacceptable, and zero is a complete failure. Rule 64B5-2.013, Florida Administrative Code. Three examiners independently grade each procedure. The dentistry examination is double-blind graded. The applicant has no contact with the examiners, and the examiners do not consult one another. This procedure was followed for the dentistry examination taken by Gage. The overall percentage score is determined by averaging and weighting the grades of the three examiners for each procedure. Statistically, averaging three grades is more accurate than using one grade alone. Gage complains about the inconsistency of the grading of the procedures on the mannequin. The examiners were identified by number as 080, 320, and 321. These examiners successfully completed the standardization process. Gage complains that Examiner 321 gave disproportionately low grades for the procedures performed on the mannequin. It is, however, more common for an examiner to give an inappropriately high grade than an inappropriately low grade. The higher grade can be a result of an examiner missing something, but the low grade must be justified in documentation and then actually verified on the mannequin. The three examiners for the mannequin procedures, when examined in the examiner's performance report, all had statistically acceptable measures of consistency and reliability. Gage complained that the patient on whom he performed the patient procedures had to make several trips to the restroom during the examination and that he did not have time to properly perform all the procedures. During the examination, Gage did not submit monitor to examiner notes, indicating there were any problems encountered during the examination or anything that he wanted the examiners to take into consideration in the grading. Prior to the perio and amalgam sections of the examination, the applicants are read a script that gives instructions as to what is to be done and how much time is allotted. The script provides that the applicants need to plan their usage of time in order to finish the procedures within the allotted four hours. Near the end of the examination, the applicants are advised of the time remaining until the end of the examination. Time management is important in the practice of dentistry because patients do not like to be kept waiting and because certain dental procedures must be executed within certain time frames. Applicants are advised before the examination how much time is allotted. Applicants are responsible for obtaining a patient for the examination. Gage received grades of four, four, and one on the class four composite filling portion of the examination. Examiner 321 gave the grade of one and documented that there was a margin open on the incisal. Dr. Thomas Shields III, who was qualified as an expert witness for the Respondent, reviewed the procedure and found that there was a definite click or catch on the incisal margin of the tooth, which was consistent with the grade of one. On the endo portion of the examination, Gage received grades of two, three, and zero. Dr. Shields reviewed the X-rays of the procedure, which showed that the final fill on the root canal had voids and was unacceptable and one of the tooth canals was not completely filled. On the prosthetic written portion of the examination, Gage scored 70 percent. In order to pass that portion of the examination, the applicant must achieve at least 75 percent, which equates to a 3.75 on a scale of zero to five. Rule 64B5- 2.013(2)(c), Florida Administrative Code. Gage complained that some of the pictures in the booklet were not very good and it was difficult to see which teeth were touching. He went to Tallahassee and reviewed the written portion of the test and made some comments concerning the test. Gage did not present his comments at the final hearing.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a final order be entered finding that Arthur A. Gage failed to achieve a passing score for the clinical portion of the dentistry examination administered December 1996. DONE AND ENTERED this 7th day of January, 1998, in Tallahassee, Leon County, Florida. SUSAN B. KIRKLAND Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 7th day of January, 1998. COPIES FURNISHED: William Buckhalt, Executive Director Board of Dentistry Department of Business and Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792 Angela T. Hall, Agency Clerk Department of Health 1317 Winewood Boulevard Building 6 Tallahassee, Florida 32399-0700 Janine B. Myrick, Esquire Department of Health 1317 Winewood Boulevard Building 6, Room 102 Tallahassee, Florida 32399-0700 Arthur A. Gage, pro se 12688 Tucano Circle Boca Raton, Florida 33428
The Issue This is a license discipline case in which the Petitioner seeks to take disciplinary action against the Respondent on the grounds that the Respondent has violated several statutory provisions by repairing dentures in a licensed dental lab without having obtained the required work order from a licensed dentist.
Findings Of Fact Based on the stipulations of the parties, on the exhibits received in evidence, and on the testimony of the witnesses at hearing, the following facts are found: At all times relevant and material to this case, the Respondent, Magnolia Iole, held license number DL 0002153 issued by the Department of Professional Regulation, which licensed her to operate as a dental laboratory in the State of Florida. At all times relevant and material to this case, the Respondent's dental laboratory was operated at 201 East Oakland Park Boulevard, Fort Lauderdale, Florida, under the business name of All Emergency Denture Service. On April 11, 1990, an investigator with the Department of Professional Regulation took a broken denture to the Respondent's dental laboratory and asked to have it repaired. The broken denture was a woman's denture that had been obtained by one of the other Department investigators from a local dentist's office. The investigator who presented the broken denture for repair had not seen any dentist regarding the broken denture, nor did the investigator have any work order from a dentist for the repair. On April 11, 1990, an employee of the Respondent's dental laboratory agreed to repair the broken denture that was brought in by the Department investigator. The employee said that the repair would cost $50.00, and that the denture would be ready later than same day. Later that same day two Department investigators returned to the Respondent's dental laboratory, where they met the same employee who had agreed to repair the broken denture. The employee told the investigator who had brought the denture that it would be ready in a few minutes. A few minutes later the employee of Respondent's dental laboratory handed the repaired denture to the investigator who had brought it in earlier the same day. At that time the previously broken denture was completely repaired. Although the Respondent, Magnolia Iole, was not observed on the dental laboratory premises during the events of April 11, 1990, described above, she was aware that such events were taking place, because during a telephone conversation on April 12, 1990, Magnolia Iole admitted to a Department investigator that she had been taking repair work without work orders because she needed the money. A work order for denture repair is an order from a licensed dentist to a dental laboratory directing that certain repair services be performed. The work order is, essentially, a prescription for the performance of specific services. A dental laboratory is not permitted to perform a repair of an intra- oral dental appliance without a work order signed by a licensed dentist. A dental laboratory that repairs a denture without a work order issued by a licensed dentist is engaged in the unauthorized practice of dentistry. Denture repair under such circumstances also constitutes the acceptance and performance of professional responsibilities which the dental laboratory licensee is not competent to perform. Denture repair without a work order issued by a licensed dentist, even when the repairs are excellently accomplished, can prevent the discovery of emerging dental problems and cause them to go untreated to the harm of the patient.
Recommendation For all of the foregoing reasons, it is recommended that the Board of Dentistry enter a final order in this case concluding that the Respondent has violated Sections 466.028(1)(z) and 466.028(1)(bb), Florida Statutes, and imposing an administrative penalty consisting of a six month suspension of the Respondent's license, to be followed by a one year period of probation during which the Respondent shall be required to advise the Board quarterly of all work performed by the Respondent's dental laboratory and shall comply with all statutory and rule provisions governing the activities of dental laboratories. DONE AND ENTERED at Tallahassee, Leon Coun~y, Florida, this 21st day of May, 1991. MICHAEL M. PARRISH Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 904/488-9675 Filed with the Clerk of the Division of Administrative Hearings this 21st day of May, 1991. COPIES FURNISHED: Albert Peacock, Esquire Department of Professional Regulation Northwood Centre 1940 North Monroe Street Tallahassee, FL 32399-0792 Ms. Magnolia T. Iole 531 Northwest 39th Street Oakland Park, Florida 33309 Mr. William Buckhalt, Executive Director Florida Board of Dentistry Department of Professional Regulation 1940 North Monroe Street Suite 60 Tallahassee, FL 32399-0792 Jack McRay, Esquire General Counsel Department of Professional Regulation 1940 North Monroe Street Suite 60 Tallahassee, FL 32399-0792
Findings Of Fact Petitioner, Shaikh Enayetul Karim, sat for the dental licensure examination administered by the Department of Professional Regulation in December 1985. The Petitioner received a failing score of "2.85" for the clinical portion of the examination and a score of "78" on the written and oral diagnosis portion. A passing score on all portions is necessary for licensure. The Petitioner complained of contradictory grading or disparate grades between each of the three examiners for a given procedure. Accordingly, pursuant to Department rules, the Petitioner's objections were reviewed by the Respondent's dental examination consultant as to the following procedures: Procedure 2 - amalgam restoration Procedure 5 - endodontic evaluation (posterior) Procedure 6 - endodontic evaluation (anterior) Procedure 7 - cavity preparation Procedure 8 - onlay wax-up Procedure 9 - pin amalgam preparation Procedure 10 - pin amalgam restoration The Respondent's consultant, Dr. Sue Ellen Hamilton, testified as an expert witness and was one of the three graders on Petitioner's original examination. Upon reviewing the Petitioner's examination and his scores for each procedure, she ultimately agreed with the grade assigned by the three examiners for procedures numbered 2, 5, 7, 8 and 10 above. She questioned the grades for procedures 6 and 9, however, and recommended that those two procedures be regraded by three additional independent graders. Upon these procedures being regraded, the Petitioner's scores still were insufficient to merit a passing score on the clinical portion of the examination. Passing that portion is required to pass the entire examination and to become licensed. Lucinda Ann Richards was accepted as an expert witness in the areas of examination development, evaluation and the administration of examinations. She is an examination development specialist with the Department of Professional Regulation and is a PhD candidate in "testing and measurement," a discipline involving training in the development and implementation of fair examinations which accurately test competency in a field such as dentistry. She established that the examination at issue was developed and administered in accordance with the Department's rules. She particularly described the method of training of examiners to ensure that they grade each procedure tested independently of each other and accord a candidate a fair evaluation, giving a candidate the benefit of the doubt in the case of an answer or procedure in which they feel the scoring thereof is a "borderline" passing or failing situation. She established that the examination is based upon "holistic material," that is, the material for the dental examination is not drawn from one or two schools or methods of dentistry, but rather the material for the examination and the questions and procedures upon which candidates are tested is drawn from all generally accepted schools or methods of dentistry and is graded on the same holistic basis, that is, candidates' answers are accorded passing scores if they are correct under theories or practices of any of the generally accepted schools or methods of dentistry related to the procedure or question posed to the candidate. She established that this holistic grading system is more fair and reasonable for examination candidates who typically are educated at many dental schools in many different states. Fairness of the examination and its grading is additionally ensured by the use of three different independent examiners who each independently grade each question or procedure without consultation with each other. Their grades are then submitted for each procedure and averaged so that the score the candidate obtains is an average score so that the candidate will get the benefit of those examiners who graded a given guest ion or procedure with the maximum grade, a "5" to counter balance an examiner who might have graded the procedure with a "1" or "2." Thus, as established by witness Hamilton, the grades assigned by the three examiners for procedures 2, 5, 7, 8 and 10 were determined upon review to be correct but, as to those grades for procedures 6 and 9 which Ms. Hamilton determined required regrading, it developed that upon regrading of those procedures he was accorded the same grade on procedure 6, but indeed received a lower grade on procedure 9. Thus, ultimately, the Petitioner's grade on the clinical portion of the examination at issue, upon regrading, was still insufficient to accord him a passing score. Contrary to Petitioner's remonstrances before and at hearing, his score was not sufficient so that one additional point would have passed him, even upon regrading his examination. Witness Sue Ellen Hamilton was accepted as an expert witness in the field of practice of dentistry and the evaluation of dental examination candidates. She was examiner number "083" who helped grade the Petitioner's original examination and who participated in the review of that examination, when he protested his score to the Department. She found that all the procedures mentioned above put at issue by the Petitioner except procedures 6 and 9, were graded correctly. For instance, she did agree with the Petitioner in her testimony that he identified the "canals" correctly, but the other mistakes on that procedure amply justified the original grade she and the other examiners accorded him. Procedure 8 was not accorded a passing score upon original grading or upon review by Ms. Hamilton. That procedure involved a wax "onlay" which was "waxed up" higher or modeled with a higher dimension than surrounding teeth. Ms. Hamilton established that this was a serious defect which would result in that tooth being the only tooth touching the opposing teeth in both jaws. Witness Hamilton otherwise in her testimony, amply established that the grades on procedures 2, 5, 7, 8 and 10 were correct as originally scored and that, upon the regrading she felt required on procedures 6 and 9, that the scores upon regrading were correct. She established that as to procedure 2, there was a serious defect involving an "open contact," that is, too much space between the teeth of the model. The Petitioner had been dissatisfied with the variation of the three examiners' comments about this procedure. Two of the examiners had criticized the open contact, and the third examiner noted "proximal contour." Ms. Hamilton established that these examiners' comments do not actually oppose each other in their import. It would not be possible to verify the fact of contact or lack of it by an X-ray "because of variances due to angulation" (see Petitioner's Exhibit 1). Ms. Hamilton established, however, that given that there was an open contact situation in the Petitioner's performance of this procedure, the procedure should have a failing grade without having the candidate redo that restoration because of the fundamental and serious nature of this defect. Concerning procedure 5, the grades given were "3", "5" and "1". Ms. Hamilton agreed with the Petitioner that the canal identification was correct. Even so, the "messial" wall was overextended and slight "pulp horns" were found, on the "lingual" wall. She felt that the grade of "5" accorded by one examiner was overly generous but it should be allowed to balance the grade of "1" given by another examiner so that a fair, holistic evaluation of that procedure was that score originally given, that is, an average of the grades "3", "5" and "1". Accordingly, she recommended no regrading. As another example, upon her review of the Petitioner's response to procedure 6 (grades given were "2", "4" and "3") she found that indeed the preparation was overextended incicsally, as the examiners had found, but she could find no evidence of the under-extension concerning which the Petitioner had been criticized and concedes that maybe examiner number "10" had made an error in making the wrong comment about this procedure. Even so, examiner "10" had given the Petitioner a passing grade on it and in an abundance of caution, Ms. Hamilton recommended that it be regraded since she felt the preparation did not deserve a failing grade. The regrading of procedure 6, however, did not result in increasing the overall score on the clinical portion of the exam to a passing grade. As to procedures 7 and 8, she found the grades were fair for those procedures and should stand. For instance, as to procedure 7, she found that the "axial walls will not draw," which is a defect determined originally by the examiners. As to procedure 8, she found that the "margins were generously bulky and the over-waxed buccal cusp and distal marginal ridge would cause hyperocclusion." She felt the overly generous grades of "3" and "4" accorded by two of the examiners adequately compensated for the low grade of "1" accorded by the third examiner and felt that the grade was fair as to that procedure also. Procedure 9 has already been discussed and Ms. Hamilton recommended a regrade of that procedure, which was done. She felt the grade of "5" accorded by one examiner was overly lenient, did not sufficiently balance the lower grade of "2" given by another examiner, hence the recommended regrading for reasons more particularly described in Petitioner's Exhibit 1. Finally, as to procedure 10, the pin amalgam restoration, all three examiners accorded the Petitioner a grade of "3." Ms. Hamilton, upon a review of these grades and of the procedure performed by the Petitioner found that the margins were bulky on the "proximal and buccal surfaces." The distal buccal cusp was too narrow. In short, she felt that the grades accorded this procedure were justified to begin with. In summary, as established by Ms. Hamilton, although the Petitioner felt many of the grades were inconsistent and contradictory, it was established that the comments of the examiners were guidelines to show candidates where their procedures differed from the ideal situation. Comments are designed to overlap each other for each procedure so each situation is evaluated as completely as possible. It is difficult, given different aspects and interpretations possible for each procedure to have agreement of all three examiners as to scoring on the same procedure. This is why three examiners were used so as to aim for a holistic evaluation of each procedure and to average the number scores accorded by each examiner so as to accord maximum fairness to the candidate. She and witness Richards established that this was done as to each of the contested procedure grades for the Petitioner. With this type of grading in mind, it was shown that the object of the examination review accorded the Petitioner when he first objected to his grades, is to try to discern if a grade by one examiner is unjustifiably low and is not compensated for by a lenient grade from the other examiner, or examiners, for the same procedure. If one examiner, for instance, accords a grade of "1" for a procedure and other examiner on the same procedure accords a grade of "5", it may be that the grade of "1" is too low but that the grade of "5" is too beneficial to the candidate. Thus, the grades are averaged and the lenient grade is allowed to be averaged with the "too-low" grade, which results in a fair result for the candidate and helps to render the examination as a whole, and each procedure, a fair test of the candidate's overall competence in the field of dentistry. It has thus been established by Respondent's expert witnesses that the examination development and its administration and method of grading was professionally accurate, fairly took into account, and gave candidates the benefit of, their education in various schools or methods of dentistry, was statistically valid and was free of arbitrariness or caprice.
Recommendation Having considered the foregoing Findings of Fact, Conclusions of Law, the evidence of record, and the candor and demeanor of the witnesses, it is, therefore RECOMMENDED that the Petitioner, Shaikh Enayetul Karim, be denied licensure as a dentist in the State of Florida. DONE and ORDERED this 24th day of June, 1987, in Tallahassee, Florida. P. MICHAEL RUFF Hearing Officer Division of Administrative Hearings The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 24th day of June, 1987. APPENDIX TO RECOMMENDED ORDER, CASE NO. 86-2635 The Petitioner Karim did not file Proposed Findings of Fact and Conclusions of Law in this case. The Respondent Department of Professional Regulation did file Proposed Findings of Fact and Conclusions of Law, all of which were accepted. COPIES FURNISHED: Shaikh Enayetul Karim Apartment 30 524 Morris Avenue Elizabeth, New Jersey 07208 Jeffrey H. Barker, Esquire Deputy General Counsel Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32399-0750 Van Poole, Secretary Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32399-0750 Joseph A. Sole, Esquire General Counsel Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32399-0750 Pat Guilford, Executive Director Board of Dentistry Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32399-0750
The Issue The issue in this case is whether Petitioner should receive a passing score on the December 2001 dental license examination.
Findings Of Fact In December 2001, Petitioner took the dental licensure examination and failed to pass the clinical portion of the exam. The examination is a three-day process involving two days of clinical examination. Those two days of clinical examination consist of nine procedures. Four of the nine procedures were challenged by Petitioner. The clinical portion is where the candidate is required to perform certain patient procedures. The work product of the student, or candidate, is evaluated following the performance of those procedures by three examiners. Each examiner grades the candidate independently of whatever score the other examiners may award on a particular procedure. Then the average grade for each procedure is weighted in accordance with requirements of Rule 64B5-2.013, Florida Administrative Code. This produces the overall score for the entire clinical exam. The Department uses three examiners' scores because this provides a more reliable indication of the candidate's competency and true score. Further, each examiner must be a licensed dentist for a minimum of five years and have no complaints or disciplinary actions against their license. Examiners have no contact with the candidate taking the examination and, accordingly, have no idea of who they are grading. To further ensure fairness, each examiner must attend and successfully complete a standardization session. The purpose of these sessions is to ensure that each examiner is trained to use the same internal grading criteria. In standardization, each examiner is thoroughly taught specific grading criteria with the result that examiners are instructed on how to evaluate the work of the candidates. The examiners who graded Petitioner’s examination had successfully completed the foregoing standardization session. Also, the Department’s post-exam check found these examiners’ grading to be reliable. Petitioner contested the score he received on Procedure 4, the Endodontic procedure, a root canal. The Endodontic procedure required removal of infected nerve tissue and blood vessels pulp from the tooth. Petitioner was required to access the canal and pulp tissue from the outside. Then, Petitioner was required to remove the bad nerve and cleanse the canal. Finally, Petitioner was required to seal the canal to prevent recurring bacteria. Petitioner failed to observe a fracture in the tooth. He claimed that a fracture to the root of the tooth was caused by the Department after he reviewed his examination and that no one advised him the root was fractured. Petitioner requested a score of 3.00 for this procedure. However, the Department's witness, Dr. William F. Robinson, a licensed dentist for 32 years who examined the tooth and X-ray prepared by Petitioner, testified that the fracture to the root was noticed in both the X-ray and on the tooth when he examined the same. Additionally, two of the three re-graders also noted the fracture of the root. With regard to Petitioner's preparation of the X-ray at the conclusion of the examination, Dr. Robinson opined that Petitioner caused the fracture to the root during the examination and not the Department, as alleged by Petitioner. Dr. Robinson further opined that even without a fracture to the root of the tooth, Petitioner failed the procedure and the failing grade he received was fair. Dr. Robinson would not recommend that Petitioner receive a passing score of 3.00 on the procedure. The examiners' comments and grades and the testimony of Dr. William F. Robinson establish that Petitioner failed to properly perform this procedure. The grade Petitioner received was fair. Petitioner challenged the grade he received on Procedure 5, the Class IV Composite Restoration of the front tooth, but did not offer any testimony at the hearing as to why the score was not correct for the procedure. Petitioner requested that the score of 1.00 given by one of the examiners be thrown out, thus giving him a passing grade on this procedure. Procedure 5 of the dental licensure examination is a procedure that involves the candidate’s ability to replace the edge of the front tooth with a composite resin material, which is a tooth-colored filling. As established by the examiners’ comments and grades and the testimony of Dr. William F. Robinson, Petitioner failed to properly perform this procedure and the grade Petitioner received was fair. Specifically, the examiners found that the tooth was abraded and the re-grader noted, as did the examiners, the excessive “flash” on the tooth. Dr. Robinson also noted both deficiencies in the procedure. Petitioner contested the score he received on Procedure 6, the Class II Composite Restoration procedure in his original petition, but offered no testimony at the hearing concerning this procedure. Dr. Robinson reviewed the examiners' grades and the tooth prepared by Petitioner and opined that Petitioner’s grade of 2.66 for this procedure is fair. Based on the examiners’ comments and grades and the testimony of Dr. Robinson, Petitioner failed to properly perform this procedure and the grade Petitioner received was fair. Petitioner contested the score he received on Procedure 7, the preparation for a 3-unit Fixed Partial Denture, claiming that on the re-grade one of the examiners reviewed the wrong procedure. The Preparation for a 3-unit Fixed Partial Denture procedure of the dental licensure examination is a procedure that involves the candidate’s ability to provide preparations of two (2) teeth in order to replace a missing tooth with a fixed bridge. Dr. Robinson established that Petitioner’s work on this procedure resulted in one tooth, No. 29, being grossly over reduced and tooth No. 31 was insufficiently reduced. The result of such work is that it is impossible to place a bridge on such an improper preparation. As established by testimony of Dr. Robinson, Petitioner's problem with this procedure resulted from Petitioner’s undercut. This undercut indicated that Petitioner’s preparations were not properly aligned to accept a bridge. Based on the examiners’ comments and grades, and the testimony of Dr. Robinson, Petitioner failed to properly perform this procedure and the grade Petitioner received was fair. The Department's “re-grade” process was utilized in this case. Used to give all candidates who timely request a hearing another chance at passing, the re-grade process allows the Department to go back and determine whether any grades rendered were inconsistent. The Department selects the top three examiners who had the highest reliability from that examination to participate in the re-grade process. The Department maintains post-standardization statistics of the examiners’ performance. In this case, those statistics indicated that Petitioner’s examiners graded reliably. In addition, the Department calculates post- examination statistics for the examiners, which are as follows for the examiners who graded Petitioner’s challenged procedures: Examiner Accuracy Index & Rating #206 95.8-Excellent #375 98.8-Excellent #380 92.1-Good #334 97.8-Excellent #298 95.9-Excellent #375 98.8-Excellent-was an original and a re-grader. All of Petitioner's examiners exhibited a reliability significantly above the minimum acceptable accuracy index of 85.0.
Recommendation Based upon the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a Final Order be entered dismissing Petitioner's challenge to the grade assigned him for the December 2001 dental licensure examination. DONE AND ENTERED this 9th day of October, 2002, in Tallahassee, Leon County, Florida. DON W. DAVIS Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 9th day of October, 2002. COPIES FURNISHED: E. Renee Alsobrook, Esquire Department of Health 4052 Bald Cypress Way Bin A02 Tallahassee, Florida 32399-1703 Jason S. Baker, D.M.D. Westchester Medical Center 95 Grasslands Road, Box 572 Valhalla, New York 10595 R.S. Power, Agency Clerk Department of Health 4052 Bald Cypress Way Bin A02 Tallahassee, Florida 32399-1701 William W. Large, General Counsel Department of Health 4052 Bald Cypress Way Bin A02 Tallahassee, Florida 32399-1701
The Issue At issue is whether Respondent committed the offenses set forth in the Amended Administrative Complaint and, if so, what penalty should be imposed.
Findings Of Fact Petitioner is the state agency charged with regulating the practice of dentistry pursuant to Section 20.43, Florida Statutes, and Chapters 455 and 466, Florida Statutes. Pursuant to the authority of Section 20.43(3)(g), Florida Statutes, Petitioner has contracted with the Agency for Health Care Administration to provide consumer complaint, investigative and prosecutorial services by the Division of Medical Quality Assurance, councils, or boards. Respondent is and has been at all times material hereto, a licensed dentist in the State of Florida, having been issued license number DN0006759. Respondent's dental license has been delinquent since March 1, 2000. Respondent's last known address is 8081 Park Villa Circle, Cupertino, California 95014. On or about December 16, 1993, Respondent was convicted in a jury trial of one count of soliciting prostitution, five counts of sexual battery and two counts of false imprisonment in the County of Santa Clara, California. Respondent was sentenced to three years in prison. The sentence was suspended and Respondent was placed on felony probation for five years subject to the following conditions: that he serve one year in the county jail; that he pay fines and penalties; that he undergo psychiatric counseling; that he report his conviction to future employers; that he report to the California Dental Board; that he treat male patients only; and that he have no contact with the victims. The circumstances underlying Respondent's criminal convictions involved sexual battery of female employees in the dental office and of female patients during dental treatments in his office while he was engaged in the practice of dentistry. In or around January 1996, the California Board of Dentistry accepted Respondent's surrender of his California license to practice dentistry in case number AGN 1994-18, and allowing Respondent to apply for reinstatement after one year, subject to the terms and conditions of Respondent's criminal probation.
Recommendation Based upon the foregoing Findings of Fact and Conclusions of Law set forth herein, it is RECOMMENDED: That the Board of Dentistry enter a final order adopting the foregoing findings of fact and conclusions of law and which revokes Respondent's license. DONE AND ENTERED this 9th day of February, 2001, in Tallahassee, Leon County, Florida. BARBARA J. STAROS Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 9th day of February, 2001. COPIES FURNISHED: Rosanna M. Catalano, Esquire Agency for Health Care Administration Post Office Box 14229 Mail Stop 39 Tallahassee, Florida 32317-4229 Houshang J. Dayan, D.D.S. 8081 Park Villa Circle Cupertino, California 95014 William H. Buckhalt, Executive Director Board of Dentistry Department of Health 4052 Bald Cypress Way Tallahassee, Florida 32399-1701 Theodore M. Henderson, Agency Clerk Department of Health 4052 Bald Cypress Way Bin A02 Tallahassee, Florida 32399-1701
The Issue The issue is whether Ms. Gioia is eligible for re-examination of her clinical dental skills after having failed the clinical dental examination three times. She seeks to be re-examined without completing either a one year general practice residency or a minimum of one academic year of undergraduate clinical course work in dentistry at a dental school approved by the American Dental Association, Commission on Dental Accreditation.
Findings Of Fact Ms. Gioia first attempted the clinical dental licensure examination in June, 1987. On June 11, 1987, during the periodontal portion of the examination, Ms. Gioia was found to be in possession of a periodontal chart, which a monitor regarded as unauthorized written material for an examination candidate to have. The monitor made a report of an irregularity during the examination. On September 3, 1987, Ms. Gioia received from the Board of Dentistry a notice that she had failed to obtain a passing score on the June, 1987, clinical dental licensure examination, and that the Board had been presented with evidence that during the examination she had unauthorized written material in her possession, viz., a periodontal chart, which constituted a violation of Section 466.028(1)(bb), Florida Statutes, and Rule 21-11.007(1)(e), Florida Administrative Code, and that she would not be permitted to be re- examined until she completed a two credit hour college level course in ethics. The letter also notified her that: You may seek review of the above, by filing a petition with the Executive Director of the Board within twenty-one (21) days of your receipt of this notice. You may request a formal proceeding pursuant to Section 120.57(1), Florida Statutes, or informal proceedings pursuant to Section 120.57(2), Florida Statutes. If you request formal proceedings, the petition must contain the information required by Rule 28-5.201, Florida Administrative Code. Ms. Gioia then retained counsel, Kenneth Muszynski, and requested an informal hearing on September 28, 1987. The matter came before the Board of Dentistry on July 23, 1988, at its meeting in Tallahassee. According to the Final Order entered by the Board on October 14, 1988, (Board Exhibit 3) the Board found: . . . based upon [Ms. Gioia's] testimony relating to her possession of the periodontal chart, the Board determines that [her] possession of the periodontal chart did not constitute any intentional violation of examination rules or an attempt to obtain a license by fraud and ordered that she: . . . be certified for licensure without restriction upon her successful completion of the licensure examination. That Final Order effectively rescinded the requirement that she take an ethics course before she could be examined a second time. No appeal from that Final Order was ever taken. There is no indication in the evidence that Ms. Gioia ever challenged the finding made in the Board's September 3, 1987, letter that she had failed to obtain a passing score on the clinical dental examination given in June, 1987. Rather, she had challenged the allegation of misconduct which had resulted in a restriction on her ability to take the examination again. Ms. Gioia took the clinical dental examination for a second time in December of 1987, and did not obtain a passing score. She took the clinical dental examination for a third time in June of 1988, and again failed to receive a passing score. As a result, she received a letter on August 5, 1988, from the Board of Dentistry which states, in pertinent part: Pursuant to Florida Statutes 466.006(4)(b)5., . . . "If [an] applicant fails to pass the clinical examination in three attempts, he shall not be eligible for re-examination unless he completes additional education requirements established by the Board." Therefore, you are not eligible to sit for the Florida Dental Examination until you complete a one year general practice residency or a minimum of one academic year of undergraduate clinical coursework in dentistry at a dental school approved by the American Dental Association, Commission on Dental Accreditation. This letter prompted Ms. Gioia to request a review of her score on the June, 1988, clinical dental examination. After the review, Ms. Gioia was informed that the review did not result in an alteration of her grade, and if she wished to initiate a formal administrative hearing to challenge her grade she must do so within 30 days from the date of that October 4, 1988, letter. A petition for formal administrative hearing was filed, again by Kenneth Muszynski, on her behalf on November 14, 1988, which instituted this proceeding.
Recommendation Based upon the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a Final Order be entered denying the petition for formal hearing filed by Ms. Gioia which contended that her score on the clinical dental examination in June, 1987, should not be counted due to monitoring misconduct which unsettled her, and ordering that she not be certified to re-take the clinical dental examination until she completes the education requirements imposed in Rule 21G-2.021(2), Florida Administrative Code. DONE and ENTERED this 23rd day of August, 1990, at Tallahassee, Florida. WILLIAM R. DORSEY, JR. Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 23rd day of August, 1990. Copies furnished: Vytas Urba, Esquire Department of Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792 D. Carlton Enfinger, Esquire Barrett, Bajoczky, Hoffman and Harper 131 North Gadsden Street Post Office Box 1501 Tallahassee, Florida 32301-1501 Kenneth E. Easley, General Counsel Department of Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792 William Buckhalt, Executive Director Department of Professional Regulation Board of Dentistry 1940 North Monroe Street Tallahassee, Florida 32399-0792
Findings Of Fact Petitioner was an applicant for licensure by examination to practice dentistry in the State of Florida. The practical examination, which is the portion here contested, consisted of 11 procedures, each of which is graded separately by three examiners. Petitioner took the dental examination in December, 1983, and obtained a total overall grade of 2.93 (Exhibit 3). A grade of 3.0 is required to pass the examination. He is here contesting only procedures No. 01 in which he received grades from the three examiners of 3, 3, and 0 (Exhibit 1); and procedure No. 05 in which he received grades of 2, 3, and 0 from three different examiners. Examiners for the dental examination are all currently licensed dentists in the State of Florida who have been extensively trained and standardized by the Department of Professional Regulation. A standardization exercise takes place immediately prior to each examination during which the examiners grade identical procedures and discuss any grade variances to eliminate, as far as possible, any discrepancies in interpretation of the grading criteria. Examiners are selected based on their experience as examiners and their ability to grade without extremes of harshness or leniency. Candidates are informed of the grading criteria prior to the examination through the notice to appear (Exhibit 4) and the applicable laws and rules which are sent by the Office of Examiner Services to all candidates prior to the administration of the examination. In procedure No. 01 (Exhibit 1) one of the examiners found caries not removed in the preparation process, noted on the grade sheet where the caries was located, and gave a mandatory zero for this procedure. Although the other examiners did not see this caries, and gave grades of 3, it was in a difficult place to see and feel with the explorer. The examiner who found the caries submitted a note to the monitor (Exhibit 7) to have all decay removed before the tooth was filled and the monitor's notation on Exhibit 7 indicates this was done. In procedure No. 05 (Exhibit 2) which involved cleaning a specified number of teeth, one examiner found stain and root roughness and gave a grade of 2; a second examiner found root roughness and gave a grade of 3; while the third examiner found supra-gingival calculus, root roughness and subgingival calculus, and gave a grade of 0. One of the expert witnesses who testified was the examiner who graded Petitioner a failing grade of 2 on this procedure. Since he did not actually see subgingival calculus but saw stain and felt the rough tooth, he did not give a zero mark which he would have given had he also seen the subgingival calculus. The Notice to Appear (Exhibit 4) and the rules sent to the candidates are clear that all subgingival and supra-gingival foreign particles must be removed and a grade of zero is mandatory if the procedure is not completed, which would include removal of all calculus. The comments on the grade sheets support the grades awarded. Here, two of the three examiners gave Petitioner a failing grade on procedure No. 05 and the fact that only one of the examiners saw the subgingival calculus does not indicate this grade is erroneous. These grades were not very different but merely reflect different degrees of similar conditions as they were observed by the examiners.
The Issue The issue is whether the score that Respondent assigned to the Patient Amalgam Preparation section of the clinical part of Petitioner's June 2003 Florida Dental License Examination was arbitrary or capricious.
Findings Of Fact Petitioner took the June 2003 Florida Dental License Examination. A passing score for the clinical part of the examination is 3.0. Petitioner received a score of 2.9, so he failed the clinical part of the examination. Petitioner has challenged the grade of 2.0 that he received on the Patient Amalgam Preparation of the clinical part of the examination. The score of 2.0 is derived from averaging the 3s that Petitioner received from two evaluators and the 0 that he received from one evaluator. Petitioner challenges only the score of 0, and he needs two additional points to pass the clinical part of the examination. The administration of the clinical part of the dental examination requires Respondent to recruit and train numerous examiners and monitors, all of whom are experienced, licensed dentists. The training process includes standardization exercises designed to ensure that all examiners are applying the same scoring criteria. The evaluation of specific procedures are double-blind, with scoring sheets that identify candidates by test numbers, so examiners do not know the identity of the candidate whose procedures they are scoring. The section that is the subject of this case requires the candidate to demonstrate certain skills on a live patient. While working with the patient, the candidate is supervised by a monitor. When the candidate has completed the required dental work to his satisfaction, he so advises the monitor, who sends the patient to the dental examiners. For the section that is the subject of this case, three dental examiners examine the patient and score the procedure. These examiners do not communicate with each other, and each performs his or her examinations and scores the procedure in isolation from the other examiners. Communications between examiners and candidates are exclusively through monitor notes. For the section that is the subject of this case, the maximum possible score that a candidate may receive is a 5. Passing grades are 3, 4, or 5. Nonpassing grades are 0, 1, or A score of 3 indicates minimal competence. The Patient Amalgam Preparation section of the clinical part of the examination required Petitioner to remove caries from one tooth and prepare the tooth for restoration. These procedures are of obvious importance to dental health. Poor preparation of the tooth surface will probably result in the premature failure of the restoration. A restoration following incomplete removal of caries will probably result in ongoing disease, possibly resulting in the loss of the tooth. Written materials, as well as Respondent's rules, which are discussed below, require a 0 if caries remain, after the candidate has presented the patient as ready for restoration. Other criteria apply to the Patient Amalgam Preparation procedure, but this criterion is the only one of importance in this case. Examiners 207 and 394 each assigned Petitioner a 3 for this procedure, but Examiner 417 assigned him a 0. Examiners 207 and 394 noted some problems with the preparation of the tooth, but neither detected any caries. Examiner 417 detected caries and documented her finding, as required to do when scoring a 0. Examiner 207 has served as an examiner for 10 years and has conducted 15-20 evaluation examinations during this time. Examiner 417 graduated from dental school in 1979. Examiner 394 has been licensed in Florida since 1995 and has served as an examiner only three years. The instructions to examiners emphasize that they are to detect caries "exclusively" tactilely, not visually. Tactile detection of the stickiness characteristic of caries is more reliable than visual detection. For example, caries assumes the color of dentin as the decay approaches the dentin. Despite the requirement to detect caries by touch, not sight, Examiner 417 initially testified that she detected the caries by sight. Later in her testimony, she backtracked and stated that she was not sure if she felt it or saw it. Her earlier, more definitive testimony is credited; Examiner 417 never found caries by touch, only by sight. In DOAH Case No. 03-3998, Examiner 417 readily conceded that she must have missed the caries that another examiner had detected, inspiring little confidence in her caries-detection ability. In that case, her value as one of two dentists in the majority was insignificant, even though the majority finding prevailed. In this case, Examiner 417's role as the lone dentist who found caries is too great an evidentiary burden for her to bear. The vagueness of her testimony and her reliance upon visual caries-detection preclude a finding of caries in this patient. Three other additional factors undermine Examiner 417's finding of caries. First, Examiners 207 and 394 found no caries. Examiner 207 has considerable experience. Examiner 394 has less experience, but he was the lone evaluator in DOAH Case No. 03-3998 to detect calculus deep below the gums, proving that he is both meticulous and a demanding grader. Together, then, the findings of Examiners 207 and 394 of no caries carry much greater weight than the contrary finding of Examiner 417. Nor was it likely that Examiner 417 accidentally dislodged the caries. No evidence suggest that she was the first examiner to examine the patient, and her means of detecting caries was visual, not tactile. Second, the location of the caries in this case was directly in the center of the tooth. So located, it was difficult for Petitioner and Examiners 207 and 394 to miss. Third, by two monitors' notes, Petitioner twice obtained the evaluators' permission to expand the drilled area, due to the extensiveness of the caries, suggesting that Petitioner was devoting careful attention to the removal of all caries, even if it meant an atypical site preparation.
Recommendation It is RECOMMENDED that the Department of Health enter a final order granting Petitioner an additional two points on the clinical part of the June 2003 Florida Dental License Examination and determining that he has passed this part of the dental examination. DONE AND ENTERED this 27th day of February, 2004, in Tallahassee, Leon County, Florida. S ROBERT E. MEALE Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 27th day of February, 2004. COPIES FURNISHED: R. S. Power, Agency Clerk Department of Health 4052 Bald Cypress Way, Bin A02 Tallahassee, Florida 32399-1701 William W. Large, General Counsel Department of Health 4052 Bald Cypress Way, BIN A02 Tallahassee, Florida 32399-1701 William H. Buckhalt, Executive Director Board of Dentistry Department of Health 4052 Bald Cypress Way, Bin C06 Tallahassee, Florida 32399-1701 James Randolph Quick Driftwood Plaza 2151 South U.S. Highway One Jupiter, Florida 33477 Cassandra Pasley Senior Attorney Department of Health Office of the General Counsel 4052 Bald Cypress Way, Bin A02 Tallahassee, Florida 32399-1703
