Findings Of Fact Upon consideration of the oral and documentary evidence adduced at the hearing, the following relevant facts are found: Petitioner Carl L. Altchiler holds licenses to practice dentistry in the States of New York (1957) and New Jersey (1973). From 1974 through 1977, petitioner was employed in Florida as an institutional dentist at the Sunland Center in Orlando and the Sumter Correctional Institution in Bushnell. He has not practiced dentistry since 1978. In June of 1980, petitioner was a candidate for Florida licensure and took the clinical or practical portion of the dentistry examination. A prerequisite for licensure is that a candidate receive a final total clinical grade of 3.0. Petitioner received a grade below 3.0 on six of the eleven procedures tested, giving him an overall grade of 2.70 on the clinical portion of the exam. A candidate for licensure with the Board of Dentistry must take both a written examination and a pracatical or clinical examination. The clinical exam consists of six parts and requires that eleven procedures be completed. These include the following: Amalgam preparation on a patient Amalgam restoration on a patient Periodontal exercise on a patient Occlusal registration and transfer Final impression Pin amalgam preparation Pin amalgam final restoration Endodontic anterior Endodontic posterior Cast gold preparation Cast gold restoration Prior to the June, 1980, clinical examination, all candidates were sent an instruction booklet which included information concerning the subject areas to be tested, the weight to be accorded each area, the procedures the candidates were to follow in taking each procedure and the grading system. The candidates also participated in a three to four hour orientation program prior to the exam, where protocol was discussed and questions regarding procedure were answered. Florida dentists who have practiced for at least five years are preselected to be examiners for the clinical portion of the dentistry exam. Approximately 23 examiners were utilized during the June, 1980, exam. Prior to arriving at the examination site, each examiner is sent the grade sheets to be utilized and the instructions to candidates. They also receive examiner and monitor instructions and forms. On the day prior to the exam, the examiners are given an 8-hour "standardization" course where the grading guidelines and procedures are discussed. This is to promote consistency and objectivity in grading. Examiners are instructed to independently grade each procedure assigned to them by awarding a grade of from 0 to 5 and indicating the appropriate number on the comment portion of the grading sheet to justify the grade assigned. They may also provide additional comments if they so desire. The grades of 0 to 5 represent the following: 0 = complete failure 1 = unacceptable dental procedure 2 = below minimal acceptable dental procedure 3 = minimal acceptable dental procedure 4 = better than minimally acceptable dental procedure 5 = outstanding dental procedure Each clinical procedure performed by a candidate is independently graded by three different examiners, and the three grades are then averaged to determine the total grade for that procedure. Among the forms which the examination monitors are instructed to utilize is a "Report of Equipment Failure." If utilized during the exam, this form is to be placed in the candidate's file containing the examiner's grade sheets. Four witnesses who were qualified and accepted as experts in the field of dentistry testified in this proceeding. Thomas Gerald Ford, Jr., D.D.S. and Allen M. Guy, D.D.S. were called on behalf of the petitioner. Dr. Ford has practiced general dentistry since 1972, is a member of various dental associations, is a dental consultant for various agencies and private organizations and has given testimony in all phases of forensic dentistry. Dr. Guy has practiced general dentistry since 1971 and is a member of various dental associations. Neither Dr. Ford nor Dr. Guy has served as a monitor or examiner for the Florida dentistry examination. Testifying on behalf of the respondent were Rupert Q. Bliss, D.D.S. and Louis Vodila, D.D.S. Dr. Bliss has practiced general dentistry since 1956, specializing in restorative dentistry, is a member of various dental associations, has taught dentistry, is currently a member of the,Florida Board of Dentistry and has served as an examiner for the Florida dental examination. Dr. Vodila has practiced general dentistry since 1956, is a former member of the Board of Dentistry and has served as Chairman of the Dental Examination for two or three exams. He presently serves, as he did in June of 1980, as the consultant and Chief Dental Examiner for the Department of Professional Regulation, Office of Examination Services. PROCEDURE NUMBER 5 Procedure Number 5, entitled "Complete Denture Evaluation" was a test of the candidate's ability to transfer the centric relation of a live patient's jaw to an articulator. The accurate transfer from the human jaw to the articulator is crucial since the denture will be constructed on the articulator and not in the patient's mouth. If the transfer is not accurate, the denture will not fit or function properly. Wax bite registrations were utilized for this procedure and the test was whether the candidate could accurately duplicate the patient's jaw relationship on an articulator. Hand articulation is not an acceptable means of determining the accuracy of the transfer and cannot simulate the articulation observed by the three examiners who graded this procedure. Petitioner received the grades of 3, 2 and 2, for an overall score of 2.33 on Procedure Number 5. The two examiners who assigned a grade of 2 noted that the centric relation was unacceptable. Other comments listed by the three examiners were that the appearance of the wax was overcontoured and that the interocclusal distance (space) was too little. Petitioner's live patient for this procedure, Beatrice King, testified that the wax bite registrations fit and felt comfortable during the June, 1980, examination. She felt that two of the three examiners were very rough with her. She noted that the one gentle examiner had no trouble placing the rims in her mouth, and that she had to blow to enable their removal. During the administrative hearing, Mrs. King inserted the wax registrations in her mouth and felt that they were still comfortable and that her bite was normal. The expert witnesses testifying for both petitioner and respondent observed the registrations inside Mrs. King's mouth during the hearing. Petitioner's two expert witnesses agreed that the wax bite registrations lacked in appearance and were overcontoured. However, they both felt from observing the registrations in Mrs. King's mouth, that the centric relation was acceptable and repeatable and that, if inserted properly, a full seating could be obtained on Mrs. King. They would have assigned a grade of 3 and 4, respectively. Respondent's expert witness observed that the rims of the wax did not match and that the back sides of the rims were touching, thus providing an obstruction to proper closing. It was also his observation that the inserted bite rims in Mrs.King's mouth had lateral movement. He felt that a grade of 2 was "very generous." PROCEDURE NUMBER 6 Procedure Number 6, entitled "(Final) Complete Denture Evaluation," consisted of the preparation of an impression of the mouth. of a completely endentulous patient. On this procedure, petitioner received grades of 1, 2 and 4, for an overall grade of 2.33. All of the examiners noted voids in the impression tray. Other comments made by the examiners included pressure areas, inablility to observe a post-dam area, the tray not being built u high enough into the vestibule and lack of retention and stability. The actual impression tray used by petitioner during the examination has been distorted by improper storage while in the custody of respondent. It therefore could not be inserted into the mouth of Mrs. King for observation by the expert witnesses who testified at the hearing. Nevertheless, upon observation of the impression tray, petitioner's two witnesses, while noting the voids and pressure areas, would assign grades of 3.5 and 4, respectively. Respondent's expert witness did not feel that the impression submitted by petitioner constituted good dentistry. Voids and pressure areas in the impression tray can cause distortions and inaccuracies in the final denture. Respondent's witness felt that the grades of 1 or 2 were "very generous." PROCEDURE NUMBER 8 Procedure Number 8, entitled "Cast Gold Cavity Preparation," was conducted on a mannequin and required candidates to complete a cavity preparation to receive a cast gold onlay. The instructions called for the preparation of an MOD onlay replacing the buccal and lingual cusps. Petitioner received grades of 2, 2 and 1 on this procedure, for an overall grade of 1.67. The comments noted on the grading sheets included a rough marginal finish, no gingival bevel, debris, the scarring of adjacent teeth, unsupported enamel and unacceptable outline form and depth preparation. Petitioner agrees that the marginal finish was rough and that the adjacent teeth were scarred. According to petitioner, this latter defect occurred when the head of the mannequin suddenly moved as a result of a loose neck screw causing the drill to slip and go through the metal bands on the adjacent teeth. Petitioner's expert witnesses observed the rough marginal finish, but found the remaining criteria satisfactory. They would assign grades of 3 and 4, respectively. Respondent's witness felt that the outline form did not match what was called for on the examination. Rather than the MOD onlay required, the outline form more resembled one for a three-quarter crown. He noted the other deficiencies marked by the examiners on the comment section of the grading sheet. He felt that the grades of 1 and 2 were consistent with what he observed. PROCEDURE NUMBER 9 Procedure Number 9, entitled "Final Gold Restoration," consisted of the candidate fabricating an onlay casting for an ivorine tooth from a dentoform in a mannequin. The procedure was graded with the gold onlay placed on the tooth within the mannequin jaw and with regard to the relationship of the onlay to the other teeth in the jaw. Petitioner received grades of 0, 1 and 2 for this procedure, for an overall grade of 1.00. The examiner who assigned a grade of 0 noted that the casting was not seated and rocked. The other two examiners did not check this comment, but did make comments pertaining to functional anatomy, proximal contour, contact and surface finish. Petitioner's expert witnesses did not observe the ivorine tooth with the gold on lay in the dentoform in the mannequin jaw. They did observe the ivorine tooth with the gold onlay and found that the onlay did not rock on the tooth. Dr. Ford, while noting a few rough edges on the casting and a little problem in the margin, found the gold to be an exact match of the tooth. He would assign a grade of 4 to this procedure. Dr. Guy, noting a rough surface finish, would assign a grade of 3.6. The ivorine tooth and the gold onlay were in the possession of the respondent until several weeks prior to the administrative hearing. Respondent's two witnesses observed the tooth and onlay prior to the last part of April, 1981, and found that the gold onlay had a slight rock to it at that time. They both admitted that the on lay now seated better on the tooth than when they first observed it, though Dr. Bliss still detected a slight rock. Dr. Vodila felt that the procedure still deserved a failing grade because of the deficiencies in the margins. Dr. Bliss, noting that the procedure could not be accurately graded outside the dentoform in the mannequin's mouth, as well as the lack of seating when he first observed it, felt that the grade of 0 was accurate and that the product failed to meet minimal standards for the practice of dentistry. PROCEDURE NUMBER 10 Procedure Number 10, entitled "Pin Amalgam Preparation," was conducted on a dentoform in a mannequin and consisted of the preparation of a tooth for amalgam restoration. Petitioner did not complete this procedure and received a grade of 0 from each of the three examiners. According to petitioner, during this procedure the head on his mannequin often made sudden movements due to a loose screw on the back of the mannequin's neck. He attempted to tighten the screw to fixate the head on several occasions, but the screw would not hold. He testified that he called the monitor over on several occasions and was told, at first, to do the best he could, and eventually, to go on to another procedure. This testimony was corroborated by the testimony of Suzette Rogers, who assisted petitioner during this procedure. A steady, stable working station is important in this type of procedure for an accurate preparation. A competent dentist is trained to and should be able to steady his work area and complete the procedure even with a loose mannequin head. As noted above, the monitors are instructed to complete a form when equipment failure is demonstrated and to insert that form into the candidate's file. No such form was found in petitioner's file. The lead examiner for the dental exam, Dr. Vodila, was never notified of any mannequin failure during the June, 1980, exam. The same mannequin head used by petitioner was also used by four other candidates before and after petitioner used it. PROCEDURE NUMBER 11 Procedure Number 11, entitled "Pin Amalgam Final Restoration," required the candidate to complete an amalgam restoration in an ivorine tooth with a pin. This procedure was to be accomplished on a prepared tooth placed in a mannequin by the monitor after the candidate turned on a light to indicate his readiness for this procedure. Petitioner apparently did not understand the directions for this procedure, no prepared tooth was placed in the mannequin, and no work product was turned in by the petitioner. A grade of 0 was assigned by all three examiners for Procedure Number 11.
Recommendation Based upon the findings of fact and conclusions of law recited above, it is RECOMMENDED that the grades awarded to petitioner on Procedures Number 5, 6, 8, 9, 10 and 11 of the clinical portion of the dentistry examination held in June of 1980 be upheld. Respectfully submitted and entered this 29th day of October, 1981, in Tallahassee, Florida. DIANE D. TREMOR, Hearing Officer Division of Administrative Hearings The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32301 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 29th day of October, 1981. COPIES FURNISHED: Robert Dyer, Esquire Duckworth, Allen, Dyer and Pettis, P.A. 400 West Colonial Post Office Box 3791 Orlando, Florida 32802 Carol L. Gregg, Esquire Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32301 Samuel Shorstein Secretary, Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32301
Findings Of Fact On November 16, 1990, Petitioner sat for the Dental Manual Skills Examination administered by Respondent as part of its regulatory duties pertaining to the practice of dentistry in the State of Florida. This examination consisted of nine separate procedures. Each procedure was graded by three dentists, each of whom had been trained by Respondent to grade this type of an examination. Procedures 1-5 have a weighted value of 12 while Procedures 6-9 have a weighted value of 10. Following the initial scoring of Petitioner's performance, Petitioner received a final grade of 2.78. A final grade of 3 was the minimum passing grade. Petitioner challenged the scoring of her performance on Procedure 5 "Completed Endondontic Therapy" and on Procedure 6 "Class II Amalgam Restoration". Following receipt of Petitioner's challenge, Respondent caused the scoring of her performance to be reviewed by Theodore Simpkin, D.D.S., a consultant employed by Respondent. At the recommendation of Dr. Simpkin, Petitioner's performance on Procedure 5 and Procedure 6 was re-scored by three new scorers. As a result of the re-scoring, Petitioner received slightly lower total scores on each of these two procedures and, consequently, a slightly lower final grade. The final grade was still below that required for passage of the examination. At the formal hearing, Petitioner established that she was entitled to have Procedure 5 re-scored. On Procedure 5 the first examiner scored Petitioner's performance as a 2, the second examiner a 0, and the third a 3. Petitioner was entitled to have her performance re-scored because the second examiner neglected to completely fill out the score sheet. Petitioner's performance on Procedure 5 was re-scored by three other dentists used by Respondent as scorers for the manual skills examination. Petitioner failed to establish that the re-scoring of her performance on Procedure 5 was in error or that she was entitled to more credit than she received. Petitioner received the relief to which she was entitled when Respondent caused her performance to be re-scored. At the formal hearing, Petitioner also established that she was entitled to have Procedure 6 re-scored. On Procedure 6 the first examiner scored Petitioner's performance as a 0, the second examiner a 4, and the third a Dr. Simpkin recommended that Petitioner's performance on Procedure 6 be re- scored because he was of the opinion that her performance should not have received a grade of zero from the first examiner and he was also of the opinion that her performance should not have received a four from the other two examiners. Petitioner's performance on Procedure 6 was re-scored by three other dentists used by Respondent as scorers for the manual skills examination. Petitioner failed to establish that the re-scoring of her performance on Procedure 6 was in error or that she was entitled to more credit than she received. Petitioner received the relief to which she was entitled when Respondent caused her performance to be re-scored.
Recommendation Based upon the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a Final Order be entered which denies Petitioner's challenge to the scoring of her performance on Procedures 5 and 6 of the November 1990 Dental Manual Skills Examination. DONE AND ENTERED this 30th day of January, 1992, in Tallahassee, Leon County, Florida. CLAUDE B. ARRINGTON Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 30th day of January, 1992. Copies furnished: Tracey S. Hartman, Esquire Senior Attorney Department of Professional Regulation Northwood Centre, Suite 60 1940 North Monroe Street Tallahassee, Florida 32399-0792 William Buckhalt Executive Director Department of Professional Regulation/Board of Dentistry Northwood Centre, Suite 60 1940 North Monroe Street Tallahassee, Florida 32399-0792 Jack McRay, General Counsel Department of Professional Regulation Northwood Centre, Suite 60 1940 North Monroe Street Tallahassee, Florida 32399-0792 Salvatore Carpino, Esquire 1 Urban Center Suite 750 4830 West Kennedy Boulevard Tampa, Florida 33609 Victoria Grimes, D.D.S. 223 Summa Street West Palm Beach, Florida 33405
Findings Of Fact Dr. Roberts and His Background Dr. Steven Roberts is a dentist licensed to practice in the State of New York. He attended the United States Military Academy and received his undergraduate degree in 1970. He graduated from the New York University College of Dentistry in 1978, and practiced dentistry in New York, New York from 1978- 1987. To be licensed in New York, Dr. Roberts passed the national boards and the northeast regional board examination. During the course of his practice in New York, Dr. Roberts never received a complaint or had a claim for malpractice made or filed against him. Clinical Examinations Dr. Roberts took the Florida clinical dental examinations in June of 1986, January of 1987, and June of 1987. His grade on the June of 1987, examination is the subject of this proceeding. Dr. Roberts has successfully passed the written examination and the diagnostic examination required for licensure by Section 466.066(4)(a) and (c), Florida Statutes. Dr. Roberts' score for the June of 1987, clinical dental examination was 1.95; the minimum passing score is 3.00. The procedures tested during the June 1987, Clinical Dental Examination and Dr. Roberts' scores were as follows: The Procedure The Score The Revised Score Periodontal 1.67 Amalgam Cavity Preparation 1.67 Amalgam Cavity Restoration 3.00 Composite Preparation .67 Composite Restoration .33 Posterior Endodontics 2.00 3.66 Cast Preparation 2.67 3.00 Pin Amalgam Preparation 1.00 Pin Amalgam Restoration 1.67 Denture 3.63 Total Score 1.95 2.15 Dr. Roberts made a timely request to review his grade, and filed objections to his grades; a regrading procedure resulted in the regrading of his scores for posterior endodontics and cast restoration as set forth above. Each of the procedures tested in the clinical dental examination is scored by three different examiners. For each procedure examiners record their scores on separate 8 1/2" X 11" sheets. Each sheet has a matrix of circles which are blackened with a pencil so that they can be machine scored. On each sheet the candidate's identification number and the examiner's identification number are recorded along with the number for the procedure involved and the candidate's grade. On the sheet for each procedure the criteria for successful performance of the procedure are printed, along with preprinted comments which the examiners may use to explain the reason for the grade assigned. These comments relate to the criteria being examined. The following grades may be assigned by examiners: Complete failure Unacceptable dental procedure Below minimum acceptable dental procedure 3- Minimum acceptable dental procedure 4- Better than minimal acceptable dental procedure 5- Outstanding dental procedure An examiner is not required to mark a comment if the grade assigned is 5, a comment is marked for any grade below 5. Each procedure is graded in a holistic manner. Grades assigned by each of the three examiners for a procedure are averaged; the averaged scores for each procedure are then weighted and the weighted scores are summed to provide the overall clinical grade. By averaging the scores of three examiners for each procedure, variation from examiner to examiner is minimized. The examiners are experienced Florida dentists selected by the Board of Dentistry. An examiner must have at least five years of experience as a dentist and be an active practitioner. Potential examiners attend a standardization training exercise. This training is required by Section 466.006(4)(d), Florida Statutes. Its purpose is to instruct examiners in examination procedures and the criteria to be applied in grading. Through the training the examiner group as a whole arrives at a consensus opinion about the level of grading, so that candidates' scores on the examination will be valid and reliable. The training attempts to focus on each examiner's subjective, internalized evaluation criteria, so that they can be modified, as necessary, to reflect the consensus of all graders. A standardizer explains grading criteria to the potential examiners, and discusses various divisions among schools of thought and training on the procedures which will be the subject of the examination. The standardizer uses dental exhibits from prior dental exams as examples, and identifies grades and errors on the exhibits so that the graders learn and can adhere to uniform grading standards. The training focuses on three problems which professional literature has identified in evaluation: errors of central tendency, proximity errors, and bias a priori. Errors of central tendency result when graders are uncertain of criteria, hesitate to give extreme judgments, even in appropriate cases, and thus tend to improperly grade near the average. Proximity error is a type of halo effect which is applicable in grading of mannequin exhibits. The examiner grades all of the mannequin exhibits for each candidate at one time. If the first example of the candidate's work is especially good, and deserves a grade of 5, the grader may tend to transfer a generally positive attitude towards the next example of the candidate's work and assign a grade which may not be based solely upon the merits of that second piece of work. The same process can improperly depress the grades on subsequent mannequins if the first example of a candidate's work is poor. Bias a priori is the tendency to grade harshly or leniently based upon the examiner's knowledge of the use that will be made of the grade, rather than only on the quality of the work graded. After an 8 to 12 hour standardization training session, the Department administers an examination to those who have been trained. Those with the highest scores become the examiners, i.e., dentists who will grade candidates' work, while those with the lower scores in the training session become monitors, who supervise the candidates in their work on mannequins or on patients, but who do not actually grade student work. There is, however, no minimum score which a dentist who attends the standardization session must obtain in order to be an examiner rather than a monitor. This results, in part, from the limited pool of dentists who participate in the examination processes as monitors or examiners. For the 1987 clinical dental examination 31 dentists accepted selection by the Board and attended the standardization session, 20 were then selected as examiners and 11 became monitors for the examination. None of the dentists who attended the standardization session were dismissed by Department of Professional Regulation from further service at the examination session. The process by which the Department selected the examiners for the 1987 clinical dental exam was neither arbitrary nor capricious, but comports with Rule 21G- 2.020(4), Florida Administrative Code. The standardization training and examination of dentists to determine who will serve as examiners and monitors does not provide any bright line for distinguishing among potential examiners those who will make the most assiduous effort to apply the grading criteria explained in the training session versus those who retain an innate sense of a passing work based on what the examiner considers acceptable work in his own practice. The effort to convey to examiners the standard of "minimum competency" has imperfect success, but the Department's training is appropriate. Out-of-State Candidates' Scores 11. There is a substantial difference in the failure rates for out-of- state candidates and for in-state candidates on the clinical dental examinations. In the June of 1987, exam 82.5% of the candidates who graduated from the only in-state dental school, the University of Florida, passed the entire examination, while 54.2% of the out-of-state graduates passed, and only 37.8% of candidates from foreign schools were successful. Overall, 86.5% of the candidates passed the written portion of the examination, 93.5% the portion on oral diagnosis, but only 63.3% the clinical portion of the examination. Dr. Roberts has failed to prove that the lower pass rate for out-of- state candidates is the result of any sort of conscious effort on the part of examiners to be more stringent in grading out-of- state candidates. Dr. Kennedy's testimony indicated only that the data bear more analysis, not that they prove improper grading. Procedures Performed on Mannequins The Board of Dentistry tests between 600 and 700 dental candidates per year. It is extremely difficult for the candidates to find patients who have exactly the problem which is to be tested and bring them to the examination to work on. Some portions of the clinical dental examination, therefore, are not performed on patients, but on cast models of human teeth which resemble dentures, and which are known as mannequins. This is expressly authorized by Section 466.006(4)(a), Florida Statutes. The notice to appear which candidates receive approximately 30 days before the examination informs them of the types of mannequins which will be used in the examination. Before that time, however, dental supply companies obtain lists of those eligible to take the examination, and contact the candidates in an attempt to sell them the mannequins. Candidates must bring mannequins with them to the examination and can purchase additional mannequins for practice. Testing with mannequins is also more efficient because with live patients, the student must be graded at the time of the examination, while a model can be retained and graded a day or two later. The decision of the Board to have certain procedures performed on mannequins, so that each candidate would be graded on exactly the same procedure, is reasonable. The Board had also considered having students perform all test procedures on extracted human teeth, but there are not a sufficient number of all natural teeth available, given the number of students who are tested, both for the examination itself and for practice. The Board determined that it would be better to use mannequins for some of the procedures tested in the examination because they are readily available and students can purchase extra copies for practice. For certain procedures, such as endodontics, specific natural teeth (such as first bicuspids) are often extracted and so are generally available; for procedures performed on those teeth, it is possible to have candidates work on human teeth. By contrast, testing procedures performed on teeth such as incisors is not practicable. It is impossible to obtain enough incisors in good condition, without restorations and chips, for use during an examination. The statute governing the dental examination does require that one restoration performed by candidates must be done on a live patient, and for the June 1987, clinical dental examination that procedure was a class 2 amalgam restoration. The Board directed by rule that mannequins be utilized for five test procedures: the pin amalgam preparation and restoration, Rule 21G-2.013(3)(d), Florida Administrative Code; the endodontic procedure, Rule 21G-2.013(3)(e) Florida Administrative Code; the posterior tooth preparation for a cast restoration, Rule 21G-013(3)(f), Florida Administrative Code, the class III acid etch composite preparation and class IV acid etch composite restoration, Rule 21G-2.013(3)(g), Florida Administrative Code. Performing these procedures on mannequins is not exactly the same as performing procedures on human teeth in a patient. In view of the difficulty involved in finding patients whose teeth present virgin lesions, so that each candidate would be tested on exactly the same problem, the difficulty in grading a large number of procedures performed on live patients, and the difficulty in obtaining a large number of human teeth necessary for testing and for practice, the Board's decision to use the mannequins for these procedures is reasonable. The Legislature recognized this in Section 466.006(4)(b), Florida Statutes, which prescribes that the clinical dental examination shall include restorations "performed on mannequins, live patients, or both. At least one restoration shall be on a live patient." The Board was within its authority when it determined the procedures to be performed on mannequins. Violation of Blind Grading The dental examiners who grade the work of candidates grade blindly, i.e., they do not know which candidate's work they are grading. The Clinical Monitor and Examiner Instruction Manual for the June of 1987, examination makes this clear. At page 24 paragraph 3 the Manual states Examiners are requested to disqualify themselves at anytime they are presented with models or patients treated by a dentist who they know personally or with whom they have had professional contact. All examiners are requested to give department staff the name of any examination candidate who is personally known to them to be taking the exam. The department staff will assist the examiners in avoiding any work performed by the candidates they know. Rationale: Allegations have been made about examiners who knew candidates taking the exam even though the examiners only see candidate numbers. Monitors and Examiners are strongly urged to avoid discussion with candidates about the examination. Even conversation about non-examination related matters can be misinterpreted by other candidates as an unfair privileged communication. Despite this admonition, one of the examiners, Dr. Cohen, who knew Dr. Roberts, graded the work of Dr. Roberts. Dr. Cohen met Dr. Roberts the first time Dr. Roberts took the Florida Clinical Dental Examination in June of 1986. Dr. Roberts had with him a bag which would have identified him as a student from New York University, where Dr. Cohen had taught. Dr. Cohen came over to Dr. Roberts, introduced himself, gave Dr. Roberts his card, (exhibit 44) and invited Dr. Cohen to his hotel room where they discussed practicing dentistry in Florida. In 1986 Dr. Cohen was associated with another dentist, Gerald P. Gultz, who had recently moved to Florida from New York. Dr. Gultz had also been a part-time clinical assistant professor of dentistry at New York University College of Dentistry. After Dr. Cohen returned from the June 1986, administration of the clinical dental examination, he had a conversation with Dr. Gultz in which Dr. Cohen asked Gultz if he knew Dr. Roberts, and commented on Dr. Roberts performance on the clinical examination. Dr. Cohen said Dr. Roberts had done terribly, and Dr. Cohen believed that Dr. Roberts would never get his license to practice in Florida. (Tr. 5/26/88 at 73). Dr. Roberts saw Dr. Cohen at the January of 1987, clinical dental examination, but they did not speak. In June of 1987, Dr. Cohen also spoke briefly to the wife of Dr. Gerald Gultz, Lauren Gultz, saying that he would be seeing Dr. Roberts at the June of 1987, clinical dental examination, which was coming up. He told Mrs. Gultz that Dr. Roberts was a poor practitioner, and that he did not think he would pass the examination. At the June 1987, exam, Dr. Roberts' periodontal patient was his uncle, Mr. Finkelstein. Dr. Cohen was one of the examiners who reviewed Mr. Finkelstein to determine whether his condition was appropriate to serve as a patient for Dr. Roberts on the periodontal portion of the examination. Dr. Cohen had a conversation with Mr. Finkelstein in which he told him "tell your dentist to do a good job". Because Mr. Finkelstein had stated that his dentist was a graduate from N. Y. U. Dental School, Mr. Finkelstein was convinced that Dr. Cohen knew exactly who the dental candidate who would work on Dr. Finkelstein was -- Dr. Roberts. After accepting Mr. Finkelstein as an appropriate periodontal patient, Dr. Cohen also served as a grader on the periodontal procedure performed on Mr. Finkelstein. After grading the work which Dr. Roberts had done, Dr. Cohen told Mr. Finkelstein to tell his dentist that Dr. Cohen would see him later in the hotel where they were staying. At the hotel, Dr. Cohen talked to Dr. Roberts about the dental examination, that he himself had to take the examination three times, although he considered himself to be a superior dentist, and that Dr. Cohen could help Dr. Roberts with his grades but that he could never grade Dr. Roberts more that one grade higher than any of the other examiners. Dr. Cohen served as an examiner (i.e. grader) for Dr. Roberts on six of the nine procedures tested. There were: procedure number 1, the periodontal evaluation where he assigned a failing grade of 2; procedure number 4, the class III composite preparation, where he assigned a failing grade of 1; procedure number 5, the class IV composite restoration, where he assigned a failing grade of 1; procedure number 6, the endodontic evaluation, where he assigned a passing grade of 3; procedure number 7, the preparation for a cast restoration, where he assigned a passing grade of 3; and procedure number 8, the pin amalgam preparation, where he assigned a failing grade of 1. This failure of blind grading is a serious irregularity in the evaluation of Dr. Roberts' performance on the 1987 clinical dental examination, given his prior negative comments about Dr. Roberts before the examination. By ignoring those scores, Dr. Roberts would be evaluated only by two examiners, on all the procedures for which Dr. Cohen gave a grade. This would mean that his scores would not be comparable with those of any other candidate, for his grade on each procedure would not be the result of blind grading by three independent examiners. Dr. Roberts' Challenges to Grades Assigned by Other Examiners The full nine procedures evaluated in the 1987 dental clinical examination and Dr. Roberts' grades were: A periodontal exercise performed on a live patient, Mr. Finkelstein, which involved the scaling of five teeth both above and below the gum and stain removal. Dr. Roberts was assigned scores of 1, 2, and 2 by the examiners (one grade of 2 was assigned by Dr. Cohen) An amalgam cavity preparation, performed on a live patient, Elizabeth Cox, which is the preparation of a tooth for filling. When the preparation is completed a proctor escorts the patient to the three examiners who independently grade this part. After grading, the patient returns to the candidate who completes the filling of the tooth (the restoration) which is subsequently graded independently by three examiners. Dr. Roberts was assigned grades of 1, 1, and 3 for the preparation (none of these grades were assigned by Dr. Cohen). A final amalgam restoration, which is the filling of the tooth prepared in the prior procedure. Dr. Roberts received grades of 3, 3, and 3 on this procedure (none of the grades were assigned by Dr. Cohen). A class III composite preparation, which is preformed on a model, not a live patient. This involves removing decay and shaping a tooth to hold a class III filling, i.e., one located on the side surface of an incisor. Dr. Roberts received scores of 1, 0, and 1 (Dr. Cohen assigned one of the grades of 1) A class IV composite restoration, which is performed on a model, not a live patient. This involves restoring a fractured tooth with a composite restoration material. On this procedure Dr. Roberts received scores of 0, 0, and 1 (Dr. Cohen assigned the grade of 1). An endodontic evaluation performed on a posterior tooth, which is performed on a mannequin, and involves the opening of a molar, and identification of the canals in the tooth in preparation for a root canal procedure. Originally Dr. Roberts received grades of 3, 3, and 0 (one of the grades of 3 was assigned by Dr. Cohen). Dr. Roberts work was regraded by three new examiners and the grades of the original examiners were discarded. Dr. Roberts ultimately received a grade of 3.67 on the endodontic portion of the examination A preparation of a posterior tooth for a cast restoration, which is performed on a mannequin. It involves preparing a tooth to receive a crown. Dr. Roberts' original grades were 2, 3, and 3 (Dr. Cohen had assigned a grade of 3 on this procedure). On review, Dr. Roberts' was regraded by three new examiners, and the original grades were discarded. Dr. Roberts received a final grade of 3 on this portion of the examination. A pin amalgam preparation, which is performed on a model, not on a live patient. This involves the preparation of a tooth to hold an amalgam filling by inserting a pin into a portion of the tooth, which serves to anchor the filling. Dr. Roberts was assigned grades of 2, 0, and 1 on this procedure (Dr. Cohen assigned the grade of 1). Pin amalgam final restoration, which is performed on a model. It involves filling a tooth with amalgam filling material. Dr. Roberts was assigned grades of 2, 1, and 2 on this procedure (Dr. Cohen assigned one of the grades of 2). Due to the involvement of Dr. Cohen in so many of the procedures involved here, Dr. Roberts performance on the June of 1987, clinical dental examination was not fairly evaluated. A fair evaluation cannot be provided after the fact by merely dropping Dr. Cohen's grades, because Dr. Roberts' performance would not be subject to the independent evaluation of three examiners. Dr. Roberts relies, to a large extent, on the testimony of Dr. Gultz as the basis for regrading his procedures to a passing grade of 3, or better. The testimony of Dr. Gultz does not, however, show that he has ever participated in the standardization exercises for examiners at Florida clinical dental examinations. Dr. Gultz experience as a clinical professor of dentistry at New York University provides a substantial basis for his evaluation of dental procedures. The difficulty, however, is that as with any qualified examiner, his evaluations will be based on internalized standards which are personal to him. There is no way to know whether Dr. Gultz standards for adequate performance are equivalent to those which the standardization training produces among examiners at the standardization exercise before a clinical dental examination. The standardization process "attempts to bring all examiners to the same level of grading, so that each [examiner] is grading in a valid and reliable manner." Clinical Monitor and Examiner Instruction Manual, June of 1987, at page 42. The Florida dental clinical examination uses a holistic grading method. Each score sheet which an examiner fills out has on it the criteria to be applied in evaluating the candidates performance on that procedure. They all contain a statement which reads: It is the intent of the Board that each of the criteria are to be accorded equal importance in grading. Equal importance does not mean that each criteria has a numerical or point value, but means that any one of the criteria, if missed to a severe enough degree so as to render the completed procedure potentially useless or harmful to the patient in the judgment of the examiner, could result in a failing grade on the procedure. The criteria do not have any assigned numerical or point value, but are to be utilized in making a holistic evaluation of the procedure. Each grading sheet also points out to the examiner certain critical factors which, if present, require a grade of 0 for the procedure. The standardization in grading which the Board diligently attempts to achieve through the standardization training and the standardization testing of examiners done at the close of the training is elusive at best. Nonetheless, in the absence of showing that Dr. Gultz standards of evaluation are equivalent to those of an examiner trained at a standardization session, it is impossible to know whether his standards of evaluation are more rigorous or less rigorous than those reflected by the grades assigned to other candidates by the corps of examiners which evaluated the work of candidates at the June of 1987, clinical dental examination. The same is true with respect to the testimony of Dr. Simkins, the expert for the Board in this proceeding. No useful purpose would be served in attempting to choose between the testimony of Dr. Gultz, on the one hand, and the testimony of Dr. Simkins and of the other examiners who testified by deposition in this proceeding. If this were to be done, all the hearing officer would have determined is whose testimony about the appropriate grade to be assigned for each procedure is more believable. On this record it would be impossible to make a further finding about whether that more believable testimony reflects a scoring standard more stringent, less stringent or the same as that generally applied to all candidates by the corps of examiners in the June of 1987, clinical dental examination.
Recommendation It is recommended that the results of the clinical dental examination which Dr. Roberts took in June of 1987, be found invalid, and that he be permitted to take the next clinical dental examination offered by the Department of Professional Regulation at no cost to him. DONE AND ENTERED in Tallahassee, Leon County, Florida, this 8th day of December, 1989. WILLIAM R. DORSEY, JR. Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 8th day of December, 1989.
The Issue Whether Petitioner's licensure examination challenge should be sustained.
Findings Of Fact Petitioner is a dentist who seeks licensure to practice dentistry in the State of Florida and who was a candidate for the dental examination administered by Respondent in December 1990. Each candidate for licensure is given three opportunities to present a patient who presents certain minimal periodontal problems upon whom the candidate can demonstrate his or her proficiency in periodontics. Rule 21G- 2.013, Florida Administrative Code, provides, in pertinent part, as follows: (2)(b) ... It is the applicant's responsibil- ity to provide a patient who is at least 18 years of age and whose medical history permits dental treatment. In order that the examination may be conducted in an efficient and orderly manner, an applicant will be allowed no more than three attempts to qualify a patient during the specified check-in period for each procedure requiring a patient. The candidate is required to select five teeth that meet certain criteria from the candidate's first patient. Rule 21G-2.013, Florida Administrative Code, provides those criteria, in pertinent part, as follows: (4) The grading of the clinical portion of the dental examination shall be based on the following criteria: * * * (b) Periodontal exercise on a patient with a minimum of 5 teeth, none of which shall have a full crown restoration, all of which shall have pockets at least 4 mm. in depth with obvious sub-gingival calculus detectable by visual or tactile means and radiographic evidence of osseous destruction; at least one tooth shall be a multi-rooted molar which shall be in proximal contact with at least one other tooth; none of the 5 teeth shall be primary teeth. All calculus appearing on radiographs must be detectable by visual or tactile means. The patient is thereafter examined by two examiners who are dentists to determine whether each selected tooth meets the criteria. If the examiners determine that one or more of the teeth selected do not meet the criteria, the candidate has a second opportunity and may select additional teeth from patient one, or the candidate may present patient two and select five teeth from the new patient. If the examiners determine that one or more of the teeth selected on his second opportunity do not meet the criteria, the candidate has a third opportunity and may select additional teeth from patient two, or the candidate may present patient three and select five teeth from that third patient. If the examiners determine that one or more of the teeth selected on his third opportunity do not meet the criteria, the candidate receives, pursuant to Rule 21G-2.013(4)(b), Florida Administrative Code, a score of zero on the periodontics portion of the examination. For her first opportunity, Petitioner presented Patient #1 and selected teeth 13, 14, 19, 20, and 21. Examiners 187 and 054 examined the five teeth selected by Petitioner and rejected teeth 13, 20, and 21. Neither of these examiners testified and the reasons for the rejection of these three teeth were not given. Patient #1 had been used by Petitioner during the June 1990 administration of the examination. The five teeth selected from Patient #1 in the June 1990 examination had been accepted, but the teeth that had been accepted did not include teeth 13, 20, or 21. For her second opportunity, Petitioner presented Patient #2 and selected teeth 19, 20, 21, 22, and 23. Examiners 176 and 080 examined these five teeth and rejected teeth 19, 20, and 23. Neither of these examiners testified and the reasons for the rejection of these three teeth were not given. For her third opportunity, Petitioner again used Patient #2, but substituted teeth 3, 29, and 30 for the teeth that had been rejected in opportunity two, so that the selected teeth were 3, 21, 22, 29, and 30. Examiners 162 and 195 rejected teeth 3, 29, and 30. Neither of these examiners testified and the reasons for the rejection of these three teeth were not given. Petitioner thereafter received a zero on the periodontal portion of the examination, which greatly contributed to her failing the examination. Petitioner received a final grade of 2.51 on the examination. She needed a score of 3.00 to pass the examination. Each of the examiners who are used by Respondent in the administration of the dental examinations is a dentist who has been licensed in the State of Florida for a minimum of five years. Prior to the examination, the examiners undergo a day long standardization session during which the criteria to be applied and the proper method of application are taught. These dentists who serve as examiners examine the patient and the selected teeth from that patient independently of one another. Neither examiner knows the results of the examination performed by the other examiner and neither examiner knows the candidate who brought that patient to the examination. The purpose of the preliminary examination is to determine whether the teeth selected by the candidate meet the criteria established by Rule 21G- 2.013(4)(b), Florida Administrative Code. The form used by the examiners does not require that the reason for the rejection of a tooth to be stated. If both examiners reject a particular tooth, that tooth cannot be used by the candidate. Petitioner failed to present evidence upon which it can be concluded that the teeth she presented from the two patients she brought to the examination met the criteria for examination found in Rule 21G-2.013(4)(b), Florida Administrative Code.
Recommendation Based upon the foregoing Findings of Fact and Conclusions of Law, it is recommended that a Final Order be entered which denies Petitioner's challenge to the dental examination. RECOMMENDED in Tallahassee, Leon County, Florida, this 26th day of August, 1991. CLAUDE B. ARRINGTON Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 26th day of August, 1991. APPENDIX TO RECOMMENDED ORDER, CASE NO. 91-3086 The following rulings are made on the proposed findings of fact submitted on behalf of the Petitioner. The proposed findings of fact in the first numbered paragraph of Mr. Irigonegaray's letter dated August 8, 1991, are adopted in material part by the Recommended Order. The proposed findings of fact in the second numbered paragraph of Mr. Irigonegaray's letter dated August 8, 1991, are rejected as being unnecessary to the conclusions reached. The greater weight of the evidence was that the statistics cited by this paragraph were not designed to measure the professional qualifications of an examiner or how he or she grades a particular criteria. Therefore, these statistics do not support Petitioner's contention that the teeth she selected were arbitrarily or capriciously rejected. The following rulings are made on the proposed findings of fact submitted on behalf of the Respondent. 1. The proposed findings of fact in paragraphs 1-5 are adopted in material part by the Recommended. COPIES FURNISHED: Jack McRay General Counsel Department of Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792 William Buckhalt Executive Director Department of Professional Regulation Northwood Centre 1940 North Monroe Street Tallahassee, Florida 32399-0792 Vytas J. Urba, Esquire Department of Professional Regulation Northwood Centre 1940 North Monroe Street Suite 60 Tallahassee, Florida 32399-0792 Beatriz Jacobo 175 Fort Wilkinson Road Milledgeville, Georgia 31061
The Issue The issue for consideration in this matter is whether Petitioner, Cecelia Diaz, is qualified for licensure as a dentist in Florida.
Findings Of Fact At all times pertinent to the issues herein, the Board of Dentistry was the state agency in Florida responsible for the licensing of dentists in this state and the regulation of the dental profession. Petitioner is not licensed as a dentist in Florida. Petitioner was awarded a degree in General Dentistry at the University of Santiago de Cuba in October 1973. Thereafter, for almost fifteen years, she practiced dentistry in Cuba. In 1981 her husband was forced to leave Cuba for political reasons but, because of her advanced schooling, she was denied permission by the Cuban government to leave with him. In 1987, Petitioner was permitted to leave Cuba for the United States with her two daughters. In February 1991, for reasons not relevant to the issues here, Petitioner and her husband were divorced. She was forced to provide for her two daughters with no financial help from their father. At the time she was both working and studying to prepare for her dental licensing examinations. In May 1991, Petitioner sat for and passed Parts I and II of the National Examination. The following November, she presented her documents for the mannequin examination, the third part of the examination and the last one to be offered in Florida. Initially, Petitioner was denied permission to take the mannequin examination because, it was alleged, she did not have the requisite educational credentials. However, one week before the mannequin examination was to be given, she appeared before the Board of Dentistry and convinced the members to allow her to take the mannequin examination with the understanding her results would be withheld pending receipt of appropriate documentation from Cuba. Petitioner did not pass the mannequin examination, and, she contends, between 1991 and 1995, there was no way for a foreign dentist to be licensed as a dentist in Florida, upon testing by a mannequin examination. Only New York and California administered a mannequin examination, and Petitioner went to California to take a course to prepare herself for taking the mannequin examination in California. After taking the course, she returned to Florida to prepare to take the examination, and in March 1994, in furtherance of that aim, searched for patients who met the criteria needed for the examination to practice on. She admits this was a mistake. As a result of her actions, on April 1, 1994, she was charged in Circuit Court in Hillsborough County with practicing dentistry without a license. Her attorney recommended she accept a plea bargain with pre-trial intervention. Based on her successful completion of the pre- trial intervention program, the matter was closed without Petitioner having a conviction on her record. In 1995, Florida initiated a program for the licensing of foreign dentists and Petitioner was selected to participate in January 1996. She was in the program for two years at the University of Florida, assisting full time. In June 1998, Petitioner took the State of Florida Dentistry examination. She passed the written part of the examination and was given high passing grades on the clinical portion by two of the three examiners. The third clinical examiner, however, gave her a grade low enough to cause her to fail the clinical portion. Petitioner went to appear before a review panel in Tallahassee where, she claims, the examiner who did the review agreed with her on the discrepancy. The review examiner recommended, however, that though she could request a hearing, the hearing would be held after the next examination, and he felt, from looking at her work, that she could pass the examination. Therefore, she did not request a rehearing. Petitioner took the clinical portion of the dental examination in December 1998. She did not pass, though she feels she did well on all questions except that relating to what she referred to as the RCT, not otherwise defined. This one question caused her to fail the examination by .007 of a point. Petitioner considers it unusual that in the past, everyone who took the review course for foreign dentists at the University of Florida, the one she took, passed the exam. She did not. Ms. Diaz requested a review of the procedure for which she did not obtain a passing grade and found that the reviewer assigned to her was the same individual who had conducted the review of her prior effort. The reviewer began examining her work in a way which she did not consider fair, and when she tried to explain her procedure, he accused her of screaming at him. She requested the review be terminated and she left the office in tears. After that review, Petitioner filed an application for formal hearing, but before the hearing could be held, in May 1999 she received notification from the Board that she had passed and the hearing was not necessary. However, before a license was issued, in August 1999, Petitioner was again arrested in Hillsborough County and charged with practicing dentistry without a license. Petitioner admits that at the time alleged in 1999 she practiced dentistry without a license, and that in 1994 she also practiced dentistry without a license. Petitioner contends that she only began seeing patients in both instances when people from Cuba, who knew she was a dentist and who had no money for dental care, asked her for help. She claims to have taken little money for the work she did - only a small amount to pay for the supplies it was necessary for her to buy. A search of Petitioner’s home was conducted on July 28, 1999, pursuant to a search warrant. The investigator conducting the search found an appointment book, dental records, books and papers, in addition to a dental chair with a basin, as well as an x-ray machine and cabinets of dental equipment and supplies. Taped to some cabinets were before and after pictures of patients. Petitioner contends that at the time of the search she had all that equipment, which she had been given without pay by the custodian of a mall in which a dentist’s office had closed. The custodian was told by the landlord to get rid of the equipment, and he remembered Petitioner who had come into the mall earlier in search of a site for a dental office when she opened. At the time, the space had been rented to another tenant. However, the custodian remembered Petitioner and called her to ask if she wanted the equipment. She did, and he helped her transport it to her home. At no time did he take any money from Petitioner, nor did she do any dental work for him. Nonetheless, Petitioner was again convicted of practicing dentistry without a license. At its meeting in Tampa on January 8, 2000, the Board of Dentistry considered Petitioner’s application for licensure and voted to deny it based on her implication in two incidents of practicing dentistry without a license. Even though no adjudication of guilt was entered in either case, it was the official action which constituted being found guilty of those offenses regardless of adjudication which supported the Board action. Petitioner is currently working as a receptionist in an office making $300 per week working nine-hour days. Her current financial obligations for school loans and other debt exceeds $42,000. No evidence of any malpractice or inappropriate treatment was forthcoming.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is recommended that the Board of Dentistry issue a license to practice dentistry in Florida to the Petitioner, Cecelia C. Diaz, such license being placed on probation for a period of five years under such conditions as the Board may specify. DONE AND ENTERED this 23rd day of June, 2000. In Tallahassee, Leon County, Florida. ARNOLD H. POLLOCK Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6947 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 23rd day of June, 2000. COPIES FURNISHED: Edwin A. Bayo, Esquire Office of the Attorney General Department of Legal Affairs, The Capital, Plaza Level 01 Tallahassee, Florida 32399-1050 Dominic J. Baccarella, Esquire Baccarella & Baccarella, P.A. 4144 North Armenia Avenue Suite 300 Tampa, Florida 33607 William H. Buckhalt, Executive Director Board of Dentistry Department of Health 4052 Bald Cypress Way, Bin A02 Tallahassee, Florida 32399-1701 William W. Large, General Counsel Department of Health 4052 Bald Cypress Way, Bin A00 Tallahassee, Florida 32399-1701 Angela T. Hall, Agency Clerk Department of Health 4052 Bald Cypress Way, Bin A00 Tallahassee, Florida 32399-1701
The Issue Whether the Petitioner earned a passing grade on the clinical portion of the June, 1986 dental examination?
Findings Of Fact The Petitioner is a licensed dentist in the State of Louisiana. Her business address is 1006 Surrey Street, Lafayette, LA. The Petitioner attended Boston University and received a Bachelor of Arts degree in 1973. The Petitioner attended MaHerry Medical College and received a dental degree in 1978. The Petitioner received post-graduate training in dentistry during a residency at Sidham Hospital and received a Post-Graduate Certificate from Sidham Hospital in 1979. The Petitioner has taken approximately 200 hours of post-graduate courses in endodontics. From 1979 until 1982, the Petitioner practiced dentistry in the Bronx, New York. In 1982 the Petitioner relocated her practice to Louisiana. The Petitioner has passed the Northeast Regional Boards and the Louisiana State Board Exam. She is licensed to practice in approximately 20 states in the northeast United States and in Louisiana. The Petitioner has been an applicant for licensure in dentistry in the State of Florida. The Petitioner took the June, 1986 Dental Examination. The Petitioner was notified that she had been awarded an overall score for the clinical portion of the examination of 2.88. A score of 3.00 is the minimum passing score for the clinical portion of the examination. The Petitioner timely requested a review of her grade, filed objections and timely requested a formal administrative hearing. The procedures tested during the examination and the Petitioner's scores for the procedures are as follows: Amalgam Cavity Prep 2.33 Amalgam Final Restoration 2.66 Denture 2.87 Periodontal 3.66 Posterior Endodontics 2.66 Anterior Endodontics 2.00 Cast Class II Only Prep 3.00 Cast Class II Wax-Up 3.33 Pin Amalgam Prep 3.00 Pin Amalgam Final 2.00 Each procedure was graded by 3 different examiners. Each examiner graded a procedure independently. One of the following grades was assigned to each procedure by each examiner: - Complete failure; - Unacceptable Dental Procedure; - Below Minimal Acceptable Dental Procedure; - Minimally Acceptable Dental Procedure; - Better than Minimally Acceptable Dental Procedure; - Outstanding Dental Procedure. The procedures were graded in a holistic manner. A failing grade must include a "comment" justifying the grade of the examiner's grade sheets. The three examiners' grades for a procedure were averaged to determine the score for the procedure. The procedure scores were then individually weighted and the weighted scores were added to provide an overall clinical grade. This overall clinical grade must be at least 3.00 to constitute a passing grade. Examiners are experienced Florida dentists selected by the Board of Dentistry. They must have at least 5 years of experience as a dentist. Potential examiners attended a standardization course. The standardization course consisted of 8 to 12 hours of training, including a review of the criteria by which each procedure is required by rule to be judged. Some of the dentists who took part in the standardization exercise were designated as examiners and some were designated as monitors. Monitors were present during the examination with the candidates. They were instructed not to assist candidates during the examination. Subsequent to receiving notice that she had not received a passing grade on the June, 1986 examination, the Petitioner challenged the correctness of the scores she received on procedures 1, 2, 5, 6, 9 and 10. After receiving notice that her license application was being denied because the Petitioner did not receive a passing grade on the clinical portion of the June, 1986 dental examination, the Petitioner attended a review session with Dr. Simkin on September 10, 1986. The session was scheduled to last for 30 minutes. The session actually lasted longer than that. The session was recorded with a tape recorder. At the conclusion of the session the tape recorder was turned off. The discussion continued after the tape recorder was turned off, however. In total, the session and the continued discussion lasted for approximately 45 to 50 minutes. Procedure 1 Procedure 1 is an "Amalgam Cavity Preparation." It involves preparation of a tooth for a filling. This procedure is performed on an actual patient as opposed to a model tooth. The three examiners who graded the Petitioner's performance on procedure 1 awarded the Petitioner the following scores and made the following comments: Examiner 136 3 Outline form & unsupported enamel Examiner 129 2 Unsupported enamel Examiner 83 2 Outline form & depth prep. The primary problem with the tooth the Petitioner performed procedure 1 on and the reason for the failing grades of two of the graders was the failure of the Petitioner to insure that the amalgam base or floor was in dentin and not enamel. Whether the base or floor of the preparation is dentin can be determined by the color, dullness or feel of the dentin. It cannot be determined by x-rays. If an amalgam filling rests on enamel instead of dentin, the filling may be more sensitive to the patient, the enamel can crack and/or the filling may also crack. When the cracking of the enamel or filling may occur cannot be predicted. The Petitioner testified that the depth of the preparation was sufficient and has argued that such a finding is supported by notes which were exchanged between a monitor and the examiners. Petitioner's reliance on the notes which were passed between the monitor and examiners is misplaced. The first note was a note from the Petitioner to the examiners noting conditions she wanted the examiners to be aware of which were unrelated to whether the preparation was into the dentin. The monitor did not "approve" what the Petitioner wrote in her note; the monitor merely noted that the Petitioner had written the note. The other note was a note from one of the examiners to the Petitioner. That note indicated that the Petitioner needed to "lower pulpal floor into dentin." This note is consistent with the examiners' findings. If the note had been followed by the Petitioner and the pulpal floor had been lowered, the patient would have been protected from a potential hazard consistent with the Board's duty to protect patients being used in examinations. When the monitor instructed the Petitioner to "proceed" the monitor was not actually telling the Petitioner what steps she should take or showing any agreement or disagreement with the examiner's note. No regrade of procedure 1 is possible because the procedure was performed on a patient. If the grades the Petitioner received for this procedure had been improper, the Petitioner would have to take this portion of the test over. There is not justification for allowing the Petitioner to take procedure 1 over. The grades the Petitioner received were justified by the comments of the examiners and the difference in the grades of the 3 examiners is insignificant. Procedure 2 Procedure 2 is an "Amalgam Final Restoration." This procedure involves the filling of the tooth prepared in procedure 1 and the shaping of the surface of the filling to the natural surface of the tooth. The three examiners who graded the Petitioner's performance on procedure 2 awarded the following scores and made the following comments: Examiner 138 2 Functional anatomy, proximal contour & gingival overhang Examiner 150 3 Functional anatomy Examiner 48 3 Functional anatomy & margin Although gingival overhang can often be detected with x-rays, it is not always possible to detect with x-rays. In light of the score of 2 given by the examiner which noted "gingival overhang" as one of the examiner's comments, the overhang was probably very slight. It is therefore not unusual that the other two examiners did not note the existence of an overhang. Additionally, a slight gingival overhang could also be noted as "margin." Therefore, it is possible that examiner 48 noted the same problem with the tooth when the comment "margin" was marked that examiner 138 noted when examiner 138 marked the comment "gingival overhang." This procedure was performed on a patient and therefore could not be reviewed. The comments given by the examiners, however, are sufficient to justify the grades given, especially the failing grade. The grades the Petitioner received on procedure 2 were justified by the comments of the examiners and there was no discrepancy in the grades awarded sufficient to order a re-examination of this procedure. No regrade is possible or warranted. Procedure 5 Procedure 5 is a "Posterior Endodontics." This procedure involved the preparation of a molar tooth for a root canal. The procedure is performed on a model tooth and not on the tooth of a patient. The three examiners who graded the Petitioner's performance on procedure 5 awarded the following scores and made the following comments: Examiner 133 3 Overextension Examiner 129 3 Outline form & overextension Examiner 153 2 Outline form, underextension & pulp horns removed Over extension and outline form can indicate the same problem. According to Dr. Simkin, "As soon as you have pulp horns, you have underextension and the outline form is improper ..." It is not inconsistent for examiners to determine that a tooth has an overextension and an underextension. Both conditions can occur on the same tooth as a result of the same procedure. The tooth procedure 5 was performed on by the Petitioner did in fact have an overextension, as even Dr. Webber and Dr. Morrison, witnesses of the Petitioner, agreed. The tooth procedure 5 was performed on by the Petitioner also had pulp horns an underextension. The Petitioner's performance on procedure 5 was not graded according to an outdated technique. The Petitioner's testimony that she was looking for a possible fourth canal is rejected the area of over extension was too large and it was in the wrong area to be justified by a search for a fourth canal. The evidence also failed to prove that any of the examiners graded the Petitioner's performance on procedure 5 according to an outdated technique or that they did not take into account the need to search for a fourth canal. The grades the Petitioner received on procedure 5 were justified by the comments of the examiners and there was no significant discrepancy in the grades they awarded. Their comments and grades were supported by review of the model tooth. No regrade or change in score is justified. Procedure 6 Procedure 6 is an "Anterior Endodontics. " This procedure involves the preparation of an anterior, or front, tooth for a root canal. It is performed on a model tooth and not on the tooth of the patient. The three examiners who graded the Petitioner's performance on procedure 6 awarded the following scores and made the following comments: Examiner 153 2 Outlining form, underextension, & pulp horns removed Examiner 129 2 Outline form - too far incisally did not remove entire roof of chamber Examiner 133 2 Outline form & gouges The tooth that the Petitioner performed procedure 6 on has pulp horns (underextension), is overextended (bevelling of the entrance too severely) and has gouges. The grades the Petitioner received on procedure 6 were justified by the comments of the examiners and there was no discrepancy in the grades they awarded. The comments and the grades were supported by review of the model tooth. No regrade or change in score is justified. Procedure 9 Procedure 9 is a "Pin Amalgam Prep." This procedure involves preparation of an ivory model tooth for restoration. The tooth includes an area of damage or decay which is so extensive that a large portion of the tooth must be removed and the amalgam filling must be supported with a pin. The examiners who graded the Petitioner's performance on procedure 9 awarded the following scores and made the following comments: Examiner 153 3 Outlining form & pin placement Examiner 109 3 Retention form & unsupported enamel Examiner 133 3 Outline form & pin placement Although the Petitioner received a passing grade from all 3 examiners, she contended that she was entitled to a higher score of 4. The grades the Petitioner received on Procedure 9 were justified by the comments of the examiners and there was no discrepancy in the grades they awarded. The comments and grades were Supported by review of the model tooth. No regrade or change in score is justified. Procedure 10 Procedure 10 is a "Pin Amalgam Final." This procedure is the final step of the procedure begun in procedure 9. A different model tooth, one already prepared, is used for this procedure. The three examiners who graded the Petitioner's performance on procedure 10 awarded the following scores and made the following comments: Examiner 153 2 Proximal contour & margin Examiner 129 2 Functional anatomy & proximal contour Examiner 133 2 Functional anatomy & proximal contour Proximal contour involves the shape of the amalgam - it should follow the natural contour of the tooth. In this case, the tooth used by the Petitioner had a ledge area, where food can be trapped, and a slight overhang. Margin is where the filling meets the tooth. It should be smooth and it was not on the Petitioner's tooth. Functional anatomy primarily involves the occlusal portion of the tooth. The Petitioner failed to build up the lingual cusp, which was the cusp that had been removed. The grades the Petitioner received on Procedure 9 were justified by the comments of the graders and there was no discrepancy in the grades they awarded or their comments. The comments and grades were supported by review of the model tooth. No regrade or change in score is justified.
Recommendation Based upon the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that the Board of Dentistry issue a final order concluding that the Petitioner's grade on the clinical portion of the June, 1986, dental examination was a failing grade. DONE and ENTERED this 2nd day of September, 1987, in Tallahassee, Florida. LARRY J. SARTIN Hearing Officer Division of Administrative Hearings The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 2nd day of September, 1987. APPENDIX TO RECOMMENDED ORDER, CASE NO. 86-4838 The parties have timely filed proposed recommended orders containing proposed findings of fact. It has been noted below which proposed finding of fact have been generally accepted and the paragraph number(s) in the Recommended Order where they have been accepted, if any. Those proposed findings of fact which have been rejected and the reason for their rejection have also been noted. Petitioners Proposed Findings of Fact Proposed Finding Paragraph Number in Recommended Order of Fact Number of Acceptance or Reason for Rejection 1 1-7. 4 and 7. This proposed finding of fact is generally irrelevant. The issue in this proceeding is whether the Petitioner successfully passed an examination. It is accepted, however, to the extent that it is relevant as to the weight which should be given to the Petitioner's testimony. The first two sentences are accepted in 9, 11 and 12 except to the extent that the proposed findings of fact pertain to the December, 1985 examination. The last sentence is rejected as irrelevant. The time for challenging the results of the December, 1985 examination had passed at the time of this proceeding and the Petitioner did not attempt to amend its Petition until the formal hearing had commenced. 5 12 and 14. 6 13-15. 7 10. 8-9 These proposed "findings of fact" are statements of issues or argument and not findings of fact. To the extent that any finding of fact is suggested, it is not Supported by the weight of the evidence. 10 12 and 19. This proposed finding of fact is irrelevant. See the discussion of proposed finding of fact 3, supra. 20. The Petitioner's score of 2.88 was not an "alleged" score and more than 30 minutes of the review session was recorded. 13-15 Irrelevant, unnecessary or not supported by the weight of the evidence. Not supported by the weight of the evidence. Irrelevant or not supported by the weight of the evidence. 18-20 Not supported by the weight of the evidence. Irrelevant. The first 3 sentences are accepted in 21 and 22. The rest of the proposed fact is not supported by the weight of the evidence. Irrelevant. 25. The monitor did not indicate agreement with the Petitioner's note. The monitor did take the note and the patient to where an examiner looked at the patient and an examiner did give a note to the monitor. See 25. The rest of the proposed fact is not supported by the weight of the evidence. 26 22. Not supported by the weight of the evidence. The first sentence is accepted in 25. The rest of the proposed fact is not supported by the weight of the evidence. Not supported by the weight of the evidence. 30 27. Not supported by the weight of the evidence. The first 3 sentences are hereby accepted. The rest of the proposed fact is not supported by the weight of the evidence. 29 and 30. The last sentence is irrelevant. 34-35 Not supported by the weight of the evidence. The first sentence is accepted in 33. The rest of the proposed fact is not supported by the weight of the evidence. Irrelevant and too broad. The first sentence is accepted in 34. The fourth and fifth sentences are accepted in 35. The rest of the proposed facts are not supported by the weight of the evidence. Not supported by the weight of the evidence. Irrelevant and not supported by the weight of the evidence. The first two sentences are accepted in 40 and 41. The rest of the proposed fact is not supported by the weight of the evidence. 42 44. 43 The first sentence is accepted in 45. The rest of the proposed fact is not supported by the weight of the evidence. 44 48. 45 The first sentence is accepted in 49. The rest of the proposed fact is not supported by the weight of the evidence. 46-47 Not supported by the weight of the evidence or irrelevant. Respondent's Proposed Findings of Fact 1 8-11. 2 12. 3 13 and 16-17. 4 18. 5-8 Hereby accepted. 9 13-14. 10 15. 11 19. 12-14 Unnecessary. Irrelevant. Argument. 15 21. 16 22. 17-19 Summary Of testimony. See 23-28. 20 29. 21 30. 22-25 Summary of testimony. See 31-33. 26 34. 27 35-36. 28-29 35. 30 Summary of testimony. See 36-39. 31 40. 32 41. 33-34 Summary of testimony. See 42-43. 35 44. 36 45. 37 Summary Of testimony. See 46-47. 38 48. 39 49. 40 Summary of testimony. See 50-53. 41-43 Unnecessary. Argument as to the weight of the evidence. COPIES FURNISHED: Pat Guilford, Executive Director Board of Dentistry Department of Professional Regulation Old Courthouse Square Building 130 North Monroe Street Tallahassee, Florida 32399-0750 Van Poole, Secretary Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32399-0750 Joseph Sole, Esquire General Counsel Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32399-0750 Chester G. Senf, Esquire Deputy General Counsel Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida. 0750 Rex D. Ware, Esquire Fuller & Johnson, P.A. Ill North Calhoun Street Tallahassee, Florida 32302 =================================================================
The Issue The issue in this case is whether Petitioner, Jennifer Lee Brown, D.M.D., should receive a passing grade on the December 1997 Florida dental licensure examination.
Findings Of Fact Petitioner, Jennifer Lee Brown, D.M.D., is a graduate from the University of Florida College of Dentistry. Respondent, the Department of Health (hereinafter referred to as the "Department"), is responsible for the licensure of dentists in the State of Florida. In December 1997 the Florida Department of Business and Professional Regulation, on behalf of the Department, administered the Florida dental licensure examination which persons wishing to practice dentistry in the State were required to pass. Dr. Brown took the December 1997 dental examination (hereinafter referred to as the "Examination"). The Examination consisted of clinical, Florida laws and rules, and oral diagnosis parts. The clinical portion of the Examination consisted of 8 procedures: procedures 1-3 and 5-9. Each procedure was graded by three separate examiners. The scores awarded by the three examiners on each procedure were averaged, resulting in a truer score. Each procedure had standardized "comments" concerning a candidate's performance on the procedure which examiners could note. Examiners were selected from individuals recommended by existing examiners or members of the Board of Dentistry (hereinafter referred to as the "Board"). Prospective examiners could not have any complaints against their license and they were required to have actively practiced dentistry and to be licensed as a dentist in Florida for a minimum of five years. Prospective examiners were required to file an application with the Board's examination committee. Prior to the Examination, a "standardization" session was conducted for the examiners selected. During the session, examiners were trained how to grade the Examination using the same internal criteria. The standardization session was conducted by assistant examiner supervisors appointed by the Board. After completion of the standardization session, and before the Examination, examiners were required to grade five mannequin models in order to evaluate the examiners' understanding of the grading criteria. Each examiner's performance was evaluated to determine whether the examiner should be used during the Examination. The examiners who graded Dr. Brown's clinical part of the Examination were designated as Examiners 168, 176, 195, 207, 264, 290, 298, and 299. All of these examiners completed the standardization session and the post-standardization evaluation. During the clinical part of the Examination, the examiners were required to grade each procedure independently, without conferring with each other. The clinical part of the Examination was "double blind" graded. Examiners did not see the candidates they were grading or watch their work. The test procedures were performed in a clinic in the presence of a licensed dentist. After the procedure was completed, the patient or tooth was taken to another clinic where the examiners reviewed the work performed on the patient and graded the procedure. The examiners had no direct contact with any candidate. Candidates were permitted to use "monitor-to-examiner" notes to convey information to the examiners that a candidate wanted the examiners to take into consideration when grading a procedure. Any such notes were read by the examiners and initialed "SMN" (saw monitor note) before they actually looked at the patient or tooth. For the clinical part of the Examination the following grading system was used: Zero: complete failure; One: unacceptable; Two: below minimally acceptable. Three: minimally acceptable. Four: better than minimally acceptable. Five: outstanding. After the Examination was graded, all examiners underwent a post-examination evaluation. Grades awarded by each examiner were compared to other examiners for consistency. All of the examiners who graded Dr. Brown's clinical part of the Examination were found to have performed acceptably. Dr. Brown was subsequently informed that she had failed to obtain the minimum passing grade of 3.00 for the clinical part of the Examination. Dr. Brown was informed that she had been awarded a score of 2.67. Dr. Brown was also informed that she passed the other two parts of the Examination. Dr. Brown challenged the scores she had been awarded on the clinical part of the Examination for procedures 2, 5, 6, 7, 8, and 9. The procedures challenged were graded by examiners 176 (graded all the challenged procedures), 195 (graded procedures 5- 9), 207 (graded procedure 2), 298 (graded procedure 2), and 299 (graded procedures 5-9). The Department conceded that the scores awarded Dr. Brown on procedures 7 and 8 were incorrect. As a result, the Department agreed that Dr. Brown's overall score for the clinical part of the Examination should be raised to 2.82. The evidence failed to prove that Dr. Brown should have received a higher score on procedures 7 and 8. Procedure 2 consisted of an amalgam (filling)n preparation on a human patient. Dr. Brown was required to select a tooth and, after the selected tooth was checked by an examiner, complete preparation for the amalgam. Dr. Brown wrote three monitor-to-examiner notes during procedure 2. All three examiners wrote "SMN" on all three notes. Dr. Brown received an average score on procedure 2 of 3.66. Dr. Brown was awarded the following individual scores for her performance on procedure 2: Examiner Score 176 4 207 4 298 3 Examiners 176 and 298 noted the following comment concerning Dr. Brown's performance on procedure 2: "Depth Prep." Examiner 298 also noted the following comment: "Marginal Finish." Examiner 207 noted the following comment: "Retention Form." Dr. Brown admitted that her performance on procedure 2 was not ideal, but expressed concern that she was graded down for matters dealt with in the monitor-to-examiner notes. Dr. Shields opined that it was possible for the examiners to have reduced the score awarded to Dr. Brown on procedure for depth preparation, marginal finish, and retention form and not have graded her down for the monitor-to-examiner notes. The evidence failed to prove that Dr. Shields' opinion was not reasonable or accurate. The evidence failed to prove that Dr. Brown should have received a higher score for procedure 2 of the clinical part of the Examination. Dr. Brown received a fairly consistent score from all three graders. Procedure 5 was a "class IV composite restoration." This procedure involved the selection of a tooth by Dr. Brown which she was then required to make a slice cut on to replicate a fracture. Dr. Brown was then required to restore the simulated fractured tooth to its normal contour and function. The procedure was performed on a mannequin. Dr. Brown received an average score of 1.66 on procedure 5. Dr. Brown was awarded the following individual scores for her performance on procedure 5: Examiner Score 176 3 195 0 299 2 Examiners 176 and 195 noted the following comment concerning Dr. Brown's performance on procedure 5: "Proximal Contour." Examiners 176 and 299 noted the following comment concerning Dr. Brown's performance on procedure 5: "Margin." Finally, the following additional comments were noted by the examiners: Examiner Comment: 195 Functional Anatomy Mutilation of Adjacent Teeth 289 Gingival Overhang Dr. Brown's challenge to her score for procedure 5 was essentially that Examiner 199 had given her such a low score on this procedure and procedures 7 through 9 when compared to the scores awarded by Examiners 176 and 298. Dr. Shields opined that Dr. Brown should not have received a higher score for her performance on procedure 5. Dr. Shields' opinion was based generally upon his 21 years of experience as a dentist. More specifically, Dr. Shields based his opinion upon his examination of the actual tooth that Dr. Brown performed procedure 5 on. Dr. Shields found excess material left at the gingival or gum portion of the tooth. Dr. Shields also found that Dr. Brown attempted to polish the material off and had flattened some of the surface of the tooth. Apparently, based upon Examiner 195's comment notes, Examiner 195 was the only examiner to catch these deficiencies in Dr. Brown's performance on procedure 5. Dr. Shields also found slight damage on the mesial, the approximating surface of the lateral incisor, the tooth next to the tooth that was restored. The evidence failed to prove that Dr. Shields' opinions concerning Dr. Brown's performance on procedure 5 were not reasonable and accurate. The evidence failed to prove that Dr. Brown should have received a higher score for procedure 5 of the clinical part of the Examination. Procedure 6 required that Dr. Brown perform an Endodontic Evaluation of the Maxillary First Premolar. Dr. Brown was required to select an extracted tooth, a maxillary tricuspid, examine x-rays of the tooth, and then perform a root canal on the tooth. The tooth had two roots. The root canal involved creating an opening in the tooth and removing the pulpal tissue from the two nerve canals of the tooth (a debridement). The canals were to be shaped for an obturation or the filling of the canal. A final x-ray of the tooth was taken after the procedure was completed. Dr. Brown received an average score on procedure 6 of 1.00. Dr. Brown was awarded the following individual scores for her performance on procedure 6: Examiner Score 176 3 195 0 299 0 All three examiners noted the following comment for Dr. Brown's performance on procedure 6: "Proper Filling of Canal Spaces with Gutta Percha." Gutta Percha is the material that was used by Dr. Brown to fill the canal of the roots after she completed the debridement. Examiner 195 noted the following additional comment for Dr. Brown's performance on procedure 6: "Access Preparation." Examiner 299 noted the following additional comment: "Shaping of Canals." Dr. Brown's challenge to her score for procedure 6 was based in part on her concern that Examiners 199 and 299 had given her a score of 0 on this procedure while Examiner 176 had given her a score of 3. Dr. Brown admitted that she had caused the gutta percha to extrude through the apex of the canals. She argued, however, that gutta percha is reabsorbed by the patient. Therefore, Dr. Brown suggested that her performance was "clinically acceptable." Dr. Brown questioned how one examiner, Examiner 176, could conclude that her performance was in fact clinically acceptable, while the other two examiners concluded it was not. The difficulty with Dr. Brown's position with regard to procedure 6 is that she assumes that the only deficiency with her performance was the extrusion of gutta percha and that it was not a significant deficiency. The evidence failed to support this position. Dr. Shields opined that Dr. Brown should not have received a higher score for her performance on procedure 6. His opinion was based upon the fact that the extrusion of gutta percha was very significant on one of the canals: it extended a millimeter and a half. On the other canal it was a half of a millimeter. Filling the canal one half millimeter to a millimeter is considered ideal. The evidence failed to prove that Dr. Shields' opinion was not reasonable or accurate. During the standardization session, examiners were told that extrusion of gutta percha more than a half millimeter through the apex was to be considered an error of major consequence. Candidates who extruded guttal percha more than a half millimeter were not to receive a grade higher than one. In light of the instructions during the standardization session, it was more likely that Examiner 176 gave Dr. Brown too high of a score on procedure 6. The evidence failed to prove that Dr. Brown should have received a higher score for procedure 6 of the clinical part of the Examination. Procedure 9 was a pin amalgam final restoration. Although this procedure involved, in a lay person's terms, a filling, what exactly was involved in this procedure was not explained during the formal hearing. Dr. Brown received an average score on procedure 9 of 1.66. Dr. Brown was awarded the following individual scores for her performance on procedure 9: Examiner Score 176 4 195 0 299 1 All three examiners noted the following comment concerning Dr. Brown's performance on procedure 9: "Functional Anatomy." Examiners 195 and 299, who both graded Dr. Brown below minimal acceptability, also noted the following comments: "Proximal Contour," "Contract," and "Margin." Dr. Brown failed to present any evidence to support her claim that she should have received a higher score for procedure Dr. Brown simply questioned the fact that Examiner 195 had graded her low on all the clinical procedures. Dr. Shields opined that Dr. Brown should not receive a higher score on procedure 9. The evidence failed to prove that Dr. Shields' opinion was not reasonable or accurate. The evidence failed to prove that Dr. Brown should have received a higher score for procedure 9 of the clinical part of the Examination. Dr. Brown's challenge in this case was based largely on the fact that Examiner 195 had graded her performance on procedures 5, 6, and 9 as a zero, procedure 7 as a one, and procedure 8 as a two. Other than the fact that Examiner 195's scores were consistently low, the evidence failed to prove that Examiner 195 improperly graded Dr. Brown except as conceded by the Department on procedures 7 and 8. Comparing the scores awarded by Examiner 195 to Examiner 176 does raise some question as to why there was such a discrepancy in the two examiners' scores. When the scores on procedures 5, 6, and 9 of all three examiners are compared, however, Examiners 195 and 298 generally were consistently below acceptable, while Examiner 176's scores were generally higher on these three procedures: Examiner Procedure 5 Score Procedure 6 Score Procedure 9 Score 176 3 3 4 195 0 0 0 299 2 0 1 This simple mathematical comparison, however, is not sufficient to conclude that Examiner 195 scored too low or that Examiner 176 scored too high. Other than a simple comparison of the scores of the three examiners, the only evidence concerning whether Examiner 195 graded too low based upon the scores alone was presented by Ms. Carnes, an expert in psychometrics. Ms. Carnes opined that Examiner 195's performance was acceptable, except with regard to procedures 7 and 8. The evidence failed to refute Ms. Canres' opinion. Based upon the weight of the evidence, Dr. Brown's score for the clinical portion of the Examination, as adjusted by the Department during the final hearing of this case, was reasonable and accurate.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a Final Order be entered by the Department of Health, Board of Dentistry, dismissing Dr. Brown's challenge to the amended grade awarded for the clinical part of the December 1997 Dental Examination. DONE AND ENTERED this 14th day of September, 1998, in Tallahassee, Leon County, Florida. LARRY J. SARTIN Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 14th day of September, 1998. COPIES FURNISHED: Jennifer Brown Post Office Box 39 Starke, Florida 32091-0039 Anna Marie Williamson, Esquire Office of the General Counsel Department of Health Building 6, Room 102 1317 Winewood Boulevard Tallahassee, Florida 32399-0700 Angela T. Hall, Agency Clerk Department of Health 1317 Winewood Boulevard, Building 6 Tallahassee, Florida 32399-0700 William Buckhalt, Executive Director Department of Health 1940 North Monroe Street Tallahassee, Florida 32399-0792
The Issue The issue is whether Michael Germaine should be granted additional credit for Procedure 03-Amalgam preparation on the December 1988, dentistry examination or should be permitted to retake that portion of the examination at no additional cost.
Findings Of Fact Dr. Michael Germaine is a licensed dentist in the State of New York and has sought to be licensed as a dentist in the State of Florida. He has taken the Florida examination three times and has not passed the clinical examination. The last time Dr. Germaine took the Florida dental examination was in December 1988. The clinical portion involves the actual performance of various dental procedures on mannequin teeth and on live patients. On the December 1988, clinical examination, Germaine received an overall score of 2.97. The minimum passing score is 3.00. On Procedure 03- Amalgam preparation, Germaine received a score of 2.66. This score is the result of averaging the grades of 3, 2, and 3 given by three different examiners. During the clinical portion of the examination, a procedure is available to candidates for writing a "monitor's note." This procedure is the sole means by which a candidate may communicate with the examiners who will grade the procedures. The candidate could use this vehicle to advise the examiners about any problems or special circumstances encountered in the procedure in order to give the examiners all the information necessary to fairly and accurately grade the procedure. The process calls for the candidate to have a proctor summon a monitor who will oversee the preparation of the note and will deliver the note to the examiners. Procedure 03-Amalgam restoration involved filling a tooth with an amalgam filling after removal of a cavity. The procedure was timed. Within the allotted time, the candidate was to take an x-ray of the completed restoration. The x-ray was reviewed by the examiners. When Germaine looked at the x-ray for Procedure 03, he noticed what appeared to be excess loose amalgam lodged next to the tooth. He wanted to write a monitor's note to let the examiners know that he was aware of the excess amalgam that would be removed in the ordinary office setting. He was also concerned that the amalgam looked attached to the tooth, which would be a defect known as a gingival overhang. Dr. Germaine asked the proctor to send a monitor and then waited for the few minutes that remained of the time allotted for the procedure. When the monitor finally arrived, the time for the procedure had elapsed and for that reason the monitor did not allow Germaine to write a note. Procedure 03 was graded by three examiners. Examiner 195 gave a grade of 3, but noted on the grade sheet that there "may be loose [amalgam] at gingival margin (obvious on x-ray)." There is a place on the grader's sheet for certain "comments" to be marked if applicable to the procedure. Examiner 195 marked comments for Functional Anatomy and for Gingival Overhang. Examiner 131 awarded 2 points for the procedure and marked comments for Contact and for Gingival Overhang. Examiner 133 awarded 3 points and marked comments for Functional Anatomy and Margin. Dr. Theodore Simkin, accepted as an expert in dentistry, is an experienced examiner and has served DPR as a consultant doing grade reviews. Dr. Simkin acknowledges that Germaine should have been able to write a monitor's note, but such a note should not have changed the grading. Procedure 03 is a patient procedure and as such, examiners are only permitted to grade on what they see in the patient's mouth. The x-rays would only have served to alert the examiners to check the interproximal to see if the amalgam shown on the x-ray was gingival overhang or excess, loose amalgam. If the x-rays had been relied on for grading purposes, the grade would have been zero (0) because the x-rays show excess gingival overhang. Any gingival overhang which was as excessive as appeared on the x-ray would have mandated a grade of zero (0) as explained on the grading sheets of each examiner. Since a grade of zero was not given, it is apparent that the examiners thought the excessive amalgam shown on the x-ray was neither gross nor attached. That Examiner 195 was aware of the loose amalgam between the teeth is obvious from the grade sheet and from an Examiner to Monitor Instruction which went back to Germaine after grading. The instruction was to have the candidate remove the amalgam interproximal (between the teeth). Gross gingival overhang cannot be simply removed like loose amalgam can be removed. Even being aware of the loose amalgam, Examiner 195 still gave Germaine a passing grade of 3. Dr. Germaine maintains that the examiners were biased because they looked at the x-ray without having the benefit of the monitor's note which he was not allowed to write. The assertion is not supported by the competent, substantial evidence, but is instead based on speculation and assumption.
Recommendation Based upon the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that The Department of Professional Regulation enter a Final Order dismissing the petition filed by Michael Germaine and denying him licensure as a dentist in the State of Florida. DONE and ENTERED this 28th day of September, 1990, in Tallahassee, Florida. DIANE K. KIESLING Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, FL 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 28th day of September, 1990. APPENDIX TO THE RECOMMENDED ORDER IN CASE NO. 89-3899 The following constitutes my specific rulings pursuant to Section 120.59(2), Florida Statutes, on the proposed findings of fact submitted by the parties in this case. Specific Rulings on Proposed Findings of Fact Submitted by Petitioner, Michael Germaine Each of the following proposed findings of fact is adopted in substance as modified in the Recommended Order. The number in parentheses is the Finding of Fact which so adopts the proposed finding of fact: 1(1); 3(2); 4-6(4-6); 7 first sentence (7); and 9(8). Proposed findings of fact 2 and 11 are unnecessary. Proposed findings of fact 7 second sentence, 12, 16, 17, and 20 are unsupported by the competent, substantial evidence. Proposed findings of fact 8, 13, and 14 are subordinate to the facts actually found in this Recommended Order. Proposed findings of fact 10, 15, 18, and 19 are irrelevant. Specific Rulings on Proposed Findings of Fact Submitted by Respondent, Department of Professional Regulation Each of the following proposed findings of fact is adopted in substance as modified in the Recommended Order. The number in parentheses is the Finding of Fact which so adopts the proposed finding of fact: 1(3). Proposed finding of fact 2 is unnecessary. Proposed finding of fact 3 is a mere summary of testimony and is not a proposed finding of fact. Copies furnished: Michael J. Cherniga Attorney at Law Post Office Drawer 1838 Tallahassee, FL 32301 Vytas J. Urba Staff Attorney Department of Professional Regulation 1940 North Monroe Street Tallahassee, FL 32399-0792 Lawrence A. Gonzalez, Secretary Department of Professional Regulation 1940 North Monroe Street Tallahassee, FL 32399-0792 Kenneth E. Easley, General Counsel Department of Professional Regulation 1940 North Monroe Street Tallahassee, FL 32399-0792
