The Issue The issue for consideration in this case is whether Petitioner should be awarded a passing grade on the clinical portion of the dental licensing examination given on December 12 through 14, 1996.
Findings Of Fact At all times pertinent to the issues herein, the Board of Dentistry was responsible for the licensing of dentists in this state and the regulation of the dental profession. Petitioner is a graduate of the University of Florida School of Dentistry and was eligible to sit for the examination for licensure as a dentist in Florida. Petitioner previously has taken and passed the written portion of the dental examination. He has taken the clinical portion of the examination twice and has received a failing grade each time. He is eligible to take the clinical portion alone for a third time, but must do so within a period of 13 months of taking it the second time or must take both the written and oral portions again. Dr. Scheutz first took the examination in June 1996. He received a passing grade in each of those examination portions which dealt with Florida laws and rules and with oral diagnosis. However, he received a grade of 2.31 on the clinical examination portion of the examination, and a passing grade was 3.0. Thereafter, in December 1996 he again took the clinical portion and this time received a grade of 2.71, still below the 3.0 passing grade. Dr. Theodor Simkin is a licensed dentist and consultant to the Board of Dentistry, who has been in the private practice of dentistry since 1950 and in Florida since 1975. He has been involved in the development, administration, and grading of the dental examination in Florida since 1979 and was a supervisor for the December 1996 examination. He is familiar with the standards applied in the clinical portion of the examination and how the examination is given and graded. Petitioner has challenged the grade he received on five separate procedures he performed during the December 1996 examination. The procedures chosen for accomplishment during the examination are not unusual procedures, but are common problems seen on a routine basis by a practicing dentist. Dr. Simkin reviewed the mannequin on which Petitioner did his work and which he presented to the examiners for grading. One of the grades challenged related to a "composite restoration" (Clinical D) for which Petitioner received a grade of 0. In this procedure the candidate is presented with a tooth on a mannequin. The candidate is instructed to cut off a corner of the tooth and then restore that corner with an amalgam restoration. The examiners are not present when the procedure is accomplished, but grade the procedure after completion. Instruction on the procedure is given to the candidate by a monitor who is present in the room but who does not grade the work done. The examination process is accomplished using the candidate number, not the candidate name, so that examiners do not know whose work at which they are looking. Once the procedure is done by the candidate, the mold is packed in the candidate's presence and is then held in the custody of the Board of Dentistry until examined independently by each of three examiners. Once graded, it is then shipped to Tallahassee and kept in a vault until needed, as here, for review by Dr. Simkin and others. Ordinarily, even if dropped, a model will not break. In the instant case, Petitioner performed the procedure on an upper right central incisor. The right corner of the tooth, approximately one-third of the tooth, was cut off and the candidate was instructed to rebuild it with a composite material. When the examiners evaluated Petitioner's work, they found that the filling was not bonded to the tooth and was loose. The loose restoration would be useless to the patient, whereas a properly done restoration should last for at least several years. On a human, the stresses applied to a tooth repair are significant, and the repair must be sufficient to withstand them. Notwithstanding Petitioner's claim that the tooth used was an artificial tooth to which the filling material does not easily bond, Dr. Simkin asserts that the bonding which occurs with a plastic tooth is different from that which occurs in a real tooth but the material can bond to the plastic tooth. He knows of no other complaints by other candidates at this examination of not being able to complete the restoration because the materials would not bond. Petitioner admits that when he did the procedure during the June 1996 examination, the tooth bonded correctly. In light of all the evidence regarding this point, it is found that Petitioner's claim is without merit. Petitioner also challenges his score of 2.0 received for his work on an "amalgam cavity preparation" (Clinical B). This composite score was based on a 2.0 awarded by each of the three examiners. An amalgam preparation is what is done to the tooth to get it ready for filling. In this case, an actual patient, supplied by the examines, had a cavity which was reviewed by the examiners. Once the patient was accepted by the examiners, the candidate then cleaned out the cavity and got it ready for filling. Dr. Simkin's review of the documentation prepared in regard to this candidate's performance of this procedure, in his opinion, supports the grades given by the examiners. Here, Petitioner sent the examiners a note as to what he proposed to do with his patient. Petitioner sought to deviate from a normal preparation due to the location of the caries, and the monitor agreed, as did the examiners. Thereafter, the candidate did the procedure. All three examiners graded his work against his proposal and gave him a failing grade. The examiners determined that his work on this patient merited only a grade of 2.0 because, according to two examiners, the margin of the filling was not separated from the next tooth as required. As to the "posterior endodonture procedure" (Clinical M), Petitioner received an overall score of 1.3. In this procedure, the candidate is required to bring in an extracted tooth which is mounted in an acrylic block. The candidate is to remove the nerve and diseased tissue, clean the cavity, file it, fill the canals, and seal the tooth. This is known as a root canal. In grading a candidate's work, the examiners look to see that the canal is properly cleaned out, is filled properly and sealed with a surface that is slightly shorter than the apex (highest point) of the tooth. On the x-ray taken of Petitioner's sample, it is obvious, according to Dr. Simkin, that one canal is at or short of the apex, but the other is long, and this is considered unacceptable treatment. Even Petitioner agrees. Petitioner received grades of 3.0, 2.0 and 1.0 for an overall failing grade of 2.0 on the "prep. cast restoration" (Clinical F). In this instance, the procedure called for the candidate to install a gold onlay. Normally the surface to which the onlay is to be placed is reduced slightly below the abutting face. Here, though one side was acceptable, Petitioner reduced too much on the other side without reason. Petitioner claims, however, that only one of the three examiners indicated excessive reduction. That determination calls for a very subjective opinion. He cannot understand how the propriety of reduction can be determined without looking into the mouth of a patient. However, Petitioner has presented no evidence in support of his opinion. The fifth challenge relates to the grade Petitioner received in the "pin amalgam pre. procedure" (Clinical G). This involves a situation where one cusp has been removed, and in order to hold a restoration, Repin must be placed in the solid portion of the tooth. The examiners determined that Petitioner's occlusal was too shallow at 1 mm, when it should have gone down 1~ to 2 mm. This, the examiners considered, would not give enough strength to hold the amalgam properly without risk of fracture. Dr. Simkins is of the opinion that Petitioner was subjected to a standardized test which was graded fairly. It would so appear and Petitioner introduced no evidence to the contrary. Ms. Carnes, a psychometrician and an expert in testing and test development who trains examiners to ensure they are consistent in their evaluations, agrees with Dr. Simkins' appraisal. The Department of Business and Professional Regulation tries to insure through its standardization efforts that the approach to grading of each examiner is consistent and that all examiners are grading with the same set of criteria. This was done in preparation for the December 1996 dental examination and a check done after the examination showed it was graded this way. Petitioner cites by way of explanation, if not excuse, that during his senior year in dental school, he was badly injured in an automobile accident and required stitches and several weeks of physical therapy for, among other injuries, a herniated disc. When he recovered sufficiently, he finished his course work and sat for the dental examination in June 1996, passing two of three sections, but not the clinical portion. Dr. Scheutz took the clinical portion of the examination again in December 1996 and again failed to earn a passing score. In his opinion, his knowledge has improved over time, but his procedural skills have diminished over the months due to his injuries. He contends he has work in dentistry he can do which will make accommodations for his physical condition, but does not believe he should have to wait another six months to take the examination again, especially since he would have to again take the entire examination, including those portions he has already passed since at that time more than 13 months from his last examination would have passed. Petitioner contends the clinical testing portion of the examination is too subjective to be valid. He wants to close this chapter in his life, but does not want to deal any more with the Board.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is recommended that the Board of Dentistry enter a Final Order denying Petitioner's challenge and sustaining the award of a failing grade on the clinical portion of the dental examination taken by the Petitioner on December 12 through 14, 1996. DONE AND ENTERED this 27th day of June, 1997, in Tallahassee, Leon County, Florida. ARNOLD H. POLLOCK Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (904) 488-9675 SUNCOM 278-9675 Fax Filing (904) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 27th day of June, 1997. COPIES FURNISHED: Dr. Eric J. Scheutz, pro se 332 Whispering Oaks Court Sarasota, Florida 34232 Karel Baarelag, Esquire Agency for Health Care Administration 2295 Victoria Avenue Fort Myers, Florida 33906-0127 Jerome W. Hoffman, General Counsel Agency for Health Care Administration 2727 Mahan Drive Tallahassee, Florida 32309 William Buckhalt, Executive Director Board of Dentistry 1940 North Monroe Street Tallahassee, Florida 32399-0792
Findings Of Fact Petitioner was an applicant for licensure by examination to practice dentistry in the State of Florida. The practical examination, which is the portion here contested, consisted of 11 procedures, each of which is graded separately by three examiners. Petitioner took the dental examination in December, 1983, and obtained a total overall grade of 2.93 (Exhibit 3). A grade of 3.0 is required to pass the examination. He is here contesting only procedures No. 01 in which he received grades from the three examiners of 3, 3, and 0 (Exhibit 1); and procedure No. 05 in which he received grades of 2, 3, and 0 from three different examiners. Examiners for the dental examination are all currently licensed dentists in the State of Florida who have been extensively trained and standardized by the Department of Professional Regulation. A standardization exercise takes place immediately prior to each examination during which the examiners grade identical procedures and discuss any grade variances to eliminate, as far as possible, any discrepancies in interpretation of the grading criteria. Examiners are selected based on their experience as examiners and their ability to grade without extremes of harshness or leniency. Candidates are informed of the grading criteria prior to the examination through the notice to appear (Exhibit 4) and the applicable laws and rules which are sent by the Office of Examiner Services to all candidates prior to the administration of the examination. In procedure No. 01 (Exhibit 1) one of the examiners found caries not removed in the preparation process, noted on the grade sheet where the caries was located, and gave a mandatory zero for this procedure. Although the other examiners did not see this caries, and gave grades of 3, it was in a difficult place to see and feel with the explorer. The examiner who found the caries submitted a note to the monitor (Exhibit 7) to have all decay removed before the tooth was filled and the monitor's notation on Exhibit 7 indicates this was done. In procedure No. 05 (Exhibit 2) which involved cleaning a specified number of teeth, one examiner found stain and root roughness and gave a grade of 2; a second examiner found root roughness and gave a grade of 3; while the third examiner found supra-gingival calculus, root roughness and subgingival calculus, and gave a grade of 0. One of the expert witnesses who testified was the examiner who graded Petitioner a failing grade of 2 on this procedure. Since he did not actually see subgingival calculus but saw stain and felt the rough tooth, he did not give a zero mark which he would have given had he also seen the subgingival calculus. The Notice to Appear (Exhibit 4) and the rules sent to the candidates are clear that all subgingival and supra-gingival foreign particles must be removed and a grade of zero is mandatory if the procedure is not completed, which would include removal of all calculus. The comments on the grade sheets support the grades awarded. Here, two of the three examiners gave Petitioner a failing grade on procedure No. 05 and the fact that only one of the examiners saw the subgingival calculus does not indicate this grade is erroneous. These grades were not very different but merely reflect different degrees of similar conditions as they were observed by the examiners.
Findings Of Fact Dr. Roberts and His Background Dr. Steven Roberts is a dentist licensed to practice in the State of New York. He attended the United States Military Academy and received his undergraduate degree in 1970. He graduated from the New York University College of Dentistry in 1978, and practiced dentistry in New York, New York from 1978- 1987. To be licensed in New York, Dr. Roberts passed the national boards and the northeast regional board examination. During the course of his practice in New York, Dr. Roberts never received a complaint or had a claim for malpractice made or filed against him. Clinical Examinations Dr. Roberts took the Florida clinical dental examinations in June of 1986, January of 1987, and June of 1987. His grade on the June of 1987, examination is the subject of this proceeding. Dr. Roberts has successfully passed the written examination and the diagnostic examination required for licensure by Section 466.066(4)(a) and (c), Florida Statutes. Dr. Roberts' score for the June of 1987, clinical dental examination was 1.95; the minimum passing score is 3.00. The procedures tested during the June 1987, Clinical Dental Examination and Dr. Roberts' scores were as follows: The Procedure The Score The Revised Score Periodontal 1.67 Amalgam Cavity Preparation 1.67 Amalgam Cavity Restoration 3.00 Composite Preparation .67 Composite Restoration .33 Posterior Endodontics 2.00 3.66 Cast Preparation 2.67 3.00 Pin Amalgam Preparation 1.00 Pin Amalgam Restoration 1.67 Denture 3.63 Total Score 1.95 2.15 Dr. Roberts made a timely request to review his grade, and filed objections to his grades; a regrading procedure resulted in the regrading of his scores for posterior endodontics and cast restoration as set forth above. Each of the procedures tested in the clinical dental examination is scored by three different examiners. For each procedure examiners record their scores on separate 8 1/2" X 11" sheets. Each sheet has a matrix of circles which are blackened with a pencil so that they can be machine scored. On each sheet the candidate's identification number and the examiner's identification number are recorded along with the number for the procedure involved and the candidate's grade. On the sheet for each procedure the criteria for successful performance of the procedure are printed, along with preprinted comments which the examiners may use to explain the reason for the grade assigned. These comments relate to the criteria being examined. The following grades may be assigned by examiners: Complete failure Unacceptable dental procedure Below minimum acceptable dental procedure 3- Minimum acceptable dental procedure 4- Better than minimal acceptable dental procedure 5- Outstanding dental procedure An examiner is not required to mark a comment if the grade assigned is 5, a comment is marked for any grade below 5. Each procedure is graded in a holistic manner. Grades assigned by each of the three examiners for a procedure are averaged; the averaged scores for each procedure are then weighted and the weighted scores are summed to provide the overall clinical grade. By averaging the scores of three examiners for each procedure, variation from examiner to examiner is minimized. The examiners are experienced Florida dentists selected by the Board of Dentistry. An examiner must have at least five years of experience as a dentist and be an active practitioner. Potential examiners attend a standardization training exercise. This training is required by Section 466.006(4)(d), Florida Statutes. Its purpose is to instruct examiners in examination procedures and the criteria to be applied in grading. Through the training the examiner group as a whole arrives at a consensus opinion about the level of grading, so that candidates' scores on the examination will be valid and reliable. The training attempts to focus on each examiner's subjective, internalized evaluation criteria, so that they can be modified, as necessary, to reflect the consensus of all graders. A standardizer explains grading criteria to the potential examiners, and discusses various divisions among schools of thought and training on the procedures which will be the subject of the examination. The standardizer uses dental exhibits from prior dental exams as examples, and identifies grades and errors on the exhibits so that the graders learn and can adhere to uniform grading standards. The training focuses on three problems which professional literature has identified in evaluation: errors of central tendency, proximity errors, and bias a priori. Errors of central tendency result when graders are uncertain of criteria, hesitate to give extreme judgments, even in appropriate cases, and thus tend to improperly grade near the average. Proximity error is a type of halo effect which is applicable in grading of mannequin exhibits. The examiner grades all of the mannequin exhibits for each candidate at one time. If the first example of the candidate's work is especially good, and deserves a grade of 5, the grader may tend to transfer a generally positive attitude towards the next example of the candidate's work and assign a grade which may not be based solely upon the merits of that second piece of work. The same process can improperly depress the grades on subsequent mannequins if the first example of a candidate's work is poor. Bias a priori is the tendency to grade harshly or leniently based upon the examiner's knowledge of the use that will be made of the grade, rather than only on the quality of the work graded. After an 8 to 12 hour standardization training session, the Department administers an examination to those who have been trained. Those with the highest scores become the examiners, i.e., dentists who will grade candidates' work, while those with the lower scores in the training session become monitors, who supervise the candidates in their work on mannequins or on patients, but who do not actually grade student work. There is, however, no minimum score which a dentist who attends the standardization session must obtain in order to be an examiner rather than a monitor. This results, in part, from the limited pool of dentists who participate in the examination processes as monitors or examiners. For the 1987 clinical dental examination 31 dentists accepted selection by the Board and attended the standardization session, 20 were then selected as examiners and 11 became monitors for the examination. None of the dentists who attended the standardization session were dismissed by Department of Professional Regulation from further service at the examination session. The process by which the Department selected the examiners for the 1987 clinical dental exam was neither arbitrary nor capricious, but comports with Rule 21G- 2.020(4), Florida Administrative Code. The standardization training and examination of dentists to determine who will serve as examiners and monitors does not provide any bright line for distinguishing among potential examiners those who will make the most assiduous effort to apply the grading criteria explained in the training session versus those who retain an innate sense of a passing work based on what the examiner considers acceptable work in his own practice. The effort to convey to examiners the standard of "minimum competency" has imperfect success, but the Department's training is appropriate. Out-of-State Candidates' Scores 11. There is a substantial difference in the failure rates for out-of- state candidates and for in-state candidates on the clinical dental examinations. In the June of 1987, exam 82.5% of the candidates who graduated from the only in-state dental school, the University of Florida, passed the entire examination, while 54.2% of the out-of-state graduates passed, and only 37.8% of candidates from foreign schools were successful. Overall, 86.5% of the candidates passed the written portion of the examination, 93.5% the portion on oral diagnosis, but only 63.3% the clinical portion of the examination. Dr. Roberts has failed to prove that the lower pass rate for out-of- state candidates is the result of any sort of conscious effort on the part of examiners to be more stringent in grading out-of- state candidates. Dr. Kennedy's testimony indicated only that the data bear more analysis, not that they prove improper grading. Procedures Performed on Mannequins The Board of Dentistry tests between 600 and 700 dental candidates per year. It is extremely difficult for the candidates to find patients who have exactly the problem which is to be tested and bring them to the examination to work on. Some portions of the clinical dental examination, therefore, are not performed on patients, but on cast models of human teeth which resemble dentures, and which are known as mannequins. This is expressly authorized by Section 466.006(4)(a), Florida Statutes. The notice to appear which candidates receive approximately 30 days before the examination informs them of the types of mannequins which will be used in the examination. Before that time, however, dental supply companies obtain lists of those eligible to take the examination, and contact the candidates in an attempt to sell them the mannequins. Candidates must bring mannequins with them to the examination and can purchase additional mannequins for practice. Testing with mannequins is also more efficient because with live patients, the student must be graded at the time of the examination, while a model can be retained and graded a day or two later. The decision of the Board to have certain procedures performed on mannequins, so that each candidate would be graded on exactly the same procedure, is reasonable. The Board had also considered having students perform all test procedures on extracted human teeth, but there are not a sufficient number of all natural teeth available, given the number of students who are tested, both for the examination itself and for practice. The Board determined that it would be better to use mannequins for some of the procedures tested in the examination because they are readily available and students can purchase extra copies for practice. For certain procedures, such as endodontics, specific natural teeth (such as first bicuspids) are often extracted and so are generally available; for procedures performed on those teeth, it is possible to have candidates work on human teeth. By contrast, testing procedures performed on teeth such as incisors is not practicable. It is impossible to obtain enough incisors in good condition, without restorations and chips, for use during an examination. The statute governing the dental examination does require that one restoration performed by candidates must be done on a live patient, and for the June 1987, clinical dental examination that procedure was a class 2 amalgam restoration. The Board directed by rule that mannequins be utilized for five test procedures: the pin amalgam preparation and restoration, Rule 21G-2.013(3)(d), Florida Administrative Code; the endodontic procedure, Rule 21G-2.013(3)(e) Florida Administrative Code; the posterior tooth preparation for a cast restoration, Rule 21G-013(3)(f), Florida Administrative Code, the class III acid etch composite preparation and class IV acid etch composite restoration, Rule 21G-2.013(3)(g), Florida Administrative Code. Performing these procedures on mannequins is not exactly the same as performing procedures on human teeth in a patient. In view of the difficulty involved in finding patients whose teeth present virgin lesions, so that each candidate would be tested on exactly the same problem, the difficulty in grading a large number of procedures performed on live patients, and the difficulty in obtaining a large number of human teeth necessary for testing and for practice, the Board's decision to use the mannequins for these procedures is reasonable. The Legislature recognized this in Section 466.006(4)(b), Florida Statutes, which prescribes that the clinical dental examination shall include restorations "performed on mannequins, live patients, or both. At least one restoration shall be on a live patient." The Board was within its authority when it determined the procedures to be performed on mannequins. Violation of Blind Grading The dental examiners who grade the work of candidates grade blindly, i.e., they do not know which candidate's work they are grading. The Clinical Monitor and Examiner Instruction Manual for the June of 1987, examination makes this clear. At page 24 paragraph 3 the Manual states Examiners are requested to disqualify themselves at anytime they are presented with models or patients treated by a dentist who they know personally or with whom they have had professional contact. All examiners are requested to give department staff the name of any examination candidate who is personally known to them to be taking the exam. The department staff will assist the examiners in avoiding any work performed by the candidates they know. Rationale: Allegations have been made about examiners who knew candidates taking the exam even though the examiners only see candidate numbers. Monitors and Examiners are strongly urged to avoid discussion with candidates about the examination. Even conversation about non-examination related matters can be misinterpreted by other candidates as an unfair privileged communication. Despite this admonition, one of the examiners, Dr. Cohen, who knew Dr. Roberts, graded the work of Dr. Roberts. Dr. Cohen met Dr. Roberts the first time Dr. Roberts took the Florida Clinical Dental Examination in June of 1986. Dr. Roberts had with him a bag which would have identified him as a student from New York University, where Dr. Cohen had taught. Dr. Cohen came over to Dr. Roberts, introduced himself, gave Dr. Roberts his card, (exhibit 44) and invited Dr. Cohen to his hotel room where they discussed practicing dentistry in Florida. In 1986 Dr. Cohen was associated with another dentist, Gerald P. Gultz, who had recently moved to Florida from New York. Dr. Gultz had also been a part-time clinical assistant professor of dentistry at New York University College of Dentistry. After Dr. Cohen returned from the June 1986, administration of the clinical dental examination, he had a conversation with Dr. Gultz in which Dr. Cohen asked Gultz if he knew Dr. Roberts, and commented on Dr. Roberts performance on the clinical examination. Dr. Cohen said Dr. Roberts had done terribly, and Dr. Cohen believed that Dr. Roberts would never get his license to practice in Florida. (Tr. 5/26/88 at 73). Dr. Roberts saw Dr. Cohen at the January of 1987, clinical dental examination, but they did not speak. In June of 1987, Dr. Cohen also spoke briefly to the wife of Dr. Gerald Gultz, Lauren Gultz, saying that he would be seeing Dr. Roberts at the June of 1987, clinical dental examination, which was coming up. He told Mrs. Gultz that Dr. Roberts was a poor practitioner, and that he did not think he would pass the examination. At the June 1987, exam, Dr. Roberts' periodontal patient was his uncle, Mr. Finkelstein. Dr. Cohen was one of the examiners who reviewed Mr. Finkelstein to determine whether his condition was appropriate to serve as a patient for Dr. Roberts on the periodontal portion of the examination. Dr. Cohen had a conversation with Mr. Finkelstein in which he told him "tell your dentist to do a good job". Because Mr. Finkelstein had stated that his dentist was a graduate from N. Y. U. Dental School, Mr. Finkelstein was convinced that Dr. Cohen knew exactly who the dental candidate who would work on Dr. Finkelstein was -- Dr. Roberts. After accepting Mr. Finkelstein as an appropriate periodontal patient, Dr. Cohen also served as a grader on the periodontal procedure performed on Mr. Finkelstein. After grading the work which Dr. Roberts had done, Dr. Cohen told Mr. Finkelstein to tell his dentist that Dr. Cohen would see him later in the hotel where they were staying. At the hotel, Dr. Cohen talked to Dr. Roberts about the dental examination, that he himself had to take the examination three times, although he considered himself to be a superior dentist, and that Dr. Cohen could help Dr. Roberts with his grades but that he could never grade Dr. Roberts more that one grade higher than any of the other examiners. Dr. Cohen served as an examiner (i.e. grader) for Dr. Roberts on six of the nine procedures tested. There were: procedure number 1, the periodontal evaluation where he assigned a failing grade of 2; procedure number 4, the class III composite preparation, where he assigned a failing grade of 1; procedure number 5, the class IV composite restoration, where he assigned a failing grade of 1; procedure number 6, the endodontic evaluation, where he assigned a passing grade of 3; procedure number 7, the preparation for a cast restoration, where he assigned a passing grade of 3; and procedure number 8, the pin amalgam preparation, where he assigned a failing grade of 1. This failure of blind grading is a serious irregularity in the evaluation of Dr. Roberts' performance on the 1987 clinical dental examination, given his prior negative comments about Dr. Roberts before the examination. By ignoring those scores, Dr. Roberts would be evaluated only by two examiners, on all the procedures for which Dr. Cohen gave a grade. This would mean that his scores would not be comparable with those of any other candidate, for his grade on each procedure would not be the result of blind grading by three independent examiners. Dr. Roberts' Challenges to Grades Assigned by Other Examiners The full nine procedures evaluated in the 1987 dental clinical examination and Dr. Roberts' grades were: A periodontal exercise performed on a live patient, Mr. Finkelstein, which involved the scaling of five teeth both above and below the gum and stain removal. Dr. Roberts was assigned scores of 1, 2, and 2 by the examiners (one grade of 2 was assigned by Dr. Cohen) An amalgam cavity preparation, performed on a live patient, Elizabeth Cox, which is the preparation of a tooth for filling. When the preparation is completed a proctor escorts the patient to the three examiners who independently grade this part. After grading, the patient returns to the candidate who completes the filling of the tooth (the restoration) which is subsequently graded independently by three examiners. Dr. Roberts was assigned grades of 1, 1, and 3 for the preparation (none of these grades were assigned by Dr. Cohen). A final amalgam restoration, which is the filling of the tooth prepared in the prior procedure. Dr. Roberts received grades of 3, 3, and 3 on this procedure (none of the grades were assigned by Dr. Cohen). A class III composite preparation, which is preformed on a model, not a live patient. This involves removing decay and shaping a tooth to hold a class III filling, i.e., one located on the side surface of an incisor. Dr. Roberts received scores of 1, 0, and 1 (Dr. Cohen assigned one of the grades of 1) A class IV composite restoration, which is performed on a model, not a live patient. This involves restoring a fractured tooth with a composite restoration material. On this procedure Dr. Roberts received scores of 0, 0, and 1 (Dr. Cohen assigned the grade of 1). An endodontic evaluation performed on a posterior tooth, which is performed on a mannequin, and involves the opening of a molar, and identification of the canals in the tooth in preparation for a root canal procedure. Originally Dr. Roberts received grades of 3, 3, and 0 (one of the grades of 3 was assigned by Dr. Cohen). Dr. Roberts work was regraded by three new examiners and the grades of the original examiners were discarded. Dr. Roberts ultimately received a grade of 3.67 on the endodontic portion of the examination A preparation of a posterior tooth for a cast restoration, which is performed on a mannequin. It involves preparing a tooth to receive a crown. Dr. Roberts' original grades were 2, 3, and 3 (Dr. Cohen had assigned a grade of 3 on this procedure). On review, Dr. Roberts' was regraded by three new examiners, and the original grades were discarded. Dr. Roberts received a final grade of 3 on this portion of the examination. A pin amalgam preparation, which is performed on a model, not on a live patient. This involves the preparation of a tooth to hold an amalgam filling by inserting a pin into a portion of the tooth, which serves to anchor the filling. Dr. Roberts was assigned grades of 2, 0, and 1 on this procedure (Dr. Cohen assigned the grade of 1). Pin amalgam final restoration, which is performed on a model. It involves filling a tooth with amalgam filling material. Dr. Roberts was assigned grades of 2, 1, and 2 on this procedure (Dr. Cohen assigned one of the grades of 2). Due to the involvement of Dr. Cohen in so many of the procedures involved here, Dr. Roberts performance on the June of 1987, clinical dental examination was not fairly evaluated. A fair evaluation cannot be provided after the fact by merely dropping Dr. Cohen's grades, because Dr. Roberts' performance would not be subject to the independent evaluation of three examiners. Dr. Roberts relies, to a large extent, on the testimony of Dr. Gultz as the basis for regrading his procedures to a passing grade of 3, or better. The testimony of Dr. Gultz does not, however, show that he has ever participated in the standardization exercises for examiners at Florida clinical dental examinations. Dr. Gultz experience as a clinical professor of dentistry at New York University provides a substantial basis for his evaluation of dental procedures. The difficulty, however, is that as with any qualified examiner, his evaluations will be based on internalized standards which are personal to him. There is no way to know whether Dr. Gultz standards for adequate performance are equivalent to those which the standardization training produces among examiners at the standardization exercise before a clinical dental examination. The standardization process "attempts to bring all examiners to the same level of grading, so that each [examiner] is grading in a valid and reliable manner." Clinical Monitor and Examiner Instruction Manual, June of 1987, at page 42. The Florida dental clinical examination uses a holistic grading method. Each score sheet which an examiner fills out has on it the criteria to be applied in evaluating the candidates performance on that procedure. They all contain a statement which reads: It is the intent of the Board that each of the criteria are to be accorded equal importance in grading. Equal importance does not mean that each criteria has a numerical or point value, but means that any one of the criteria, if missed to a severe enough degree so as to render the completed procedure potentially useless or harmful to the patient in the judgment of the examiner, could result in a failing grade on the procedure. The criteria do not have any assigned numerical or point value, but are to be utilized in making a holistic evaluation of the procedure. Each grading sheet also points out to the examiner certain critical factors which, if present, require a grade of 0 for the procedure. The standardization in grading which the Board diligently attempts to achieve through the standardization training and the standardization testing of examiners done at the close of the training is elusive at best. Nonetheless, in the absence of showing that Dr. Gultz standards of evaluation are equivalent to those of an examiner trained at a standardization session, it is impossible to know whether his standards of evaluation are more rigorous or less rigorous than those reflected by the grades assigned to other candidates by the corps of examiners which evaluated the work of candidates at the June of 1987, clinical dental examination. The same is true with respect to the testimony of Dr. Simkins, the expert for the Board in this proceeding. No useful purpose would be served in attempting to choose between the testimony of Dr. Gultz, on the one hand, and the testimony of Dr. Simkins and of the other examiners who testified by deposition in this proceeding. If this were to be done, all the hearing officer would have determined is whose testimony about the appropriate grade to be assigned for each procedure is more believable. On this record it would be impossible to make a further finding about whether that more believable testimony reflects a scoring standard more stringent, less stringent or the same as that generally applied to all candidates by the corps of examiners in the June of 1987, clinical dental examination.
Recommendation It is recommended that the results of the clinical dental examination which Dr. Roberts took in June of 1987, be found invalid, and that he be permitted to take the next clinical dental examination offered by the Department of Professional Regulation at no cost to him. DONE AND ENTERED in Tallahassee, Leon County, Florida, this 8th day of December, 1989. WILLIAM R. DORSEY, JR. Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 8th day of December, 1989.
Findings Of Fact Joseph L. Ratchford is a graduate of the University of Georgetown School of Dentistry and took the Florida dental exam in June, 1984. The clinical, or practical, portion of the dental exam consists of ten procedures and the examinee must obtain a total combined weighted grade of 3.0 to pass the clinical portion of the exam. Petitioner received a total overall grade of 2.96 and has questioned the grades he received on two of the ten procedures. In grading the clinical portion of the exam, three examiners separately review and grade each procedure performed by the examinees. At each examination, approximately twelve to thirty examiners are used, and three hundred to four hundred candidates are examined. Each examiner must successfully complete an eight to twelve hour standardization exercise during which they are trained on the grading scale, procedures, and the criteria to be used in grading the clinical portion of the exam. The Board of Dentistry determines the criteria to be used in grading the exams and the grading scale. A perfect score is a "5" and a complete failure is a "O". Examiners are chosen by the Board of Dentistry based upon their successful completion of the standardization exercise and must also have been licensed in Florida for at least five years. Petitioner received grades of 2, 3, and 5 from the three examiners grading the Periodontal procedure on his exam. This resulted in a grade of 3.33 on the Periodontal procedure. Petitioner objects to the grading of this procedure due to the wide disparity in the three examiners' grades. The periodontal procedure is performed on a live patient and is an evaluation of the patient's teeth, root structure, and supporting structures. In grading this procedure, five criteria are used: Presence of stain on assigned teeth. Presence of supra-gingival calculus on assigned teeth. Presence of sub-gingival calculus on assigned teeth. Root roughness on assigned teeth. Tissue management. While several of these criteria are easily observable, criteria (c) and (d) are not, and in fact are sometimes hard to distinguish from each other. The grading system requires two points to be taken off when sub-gingival calculus is present on the assigned teeth (criteria c), and allows one to four points to be deducted for root roughness on the assigned teeth (criteria d). Examiner 10 gave Petitioner a grade of 2 since the examiner found Petitioner was deficient on criteria (a), (c), (d) and (e). A grade of 2 is appropriate with these deficiencies, although such a grade may even be a bit high. Examiner 10 had participated in seven exams prior to the one in question and a post-exam evaluation of all examiners shows that Examiner 10 ranked 6th out of 18 examiners in terms of grading accuracy. Examiner 35 gave Petitioner a grade of 3 since the examiner found Petitioner was deficient on criteria (c). A grade of 3 is mandatory is this situation since the presence of subgingival calculus requires two points to be deducted from the grade. Examiner 35 had participated in no previous exams but ranked 7th out of 18 examiners in terms of grading accuracy, according to a post-exam evaluation of all examiners. Examiner 82 gave Petitioner a perfect score of 5, noting no deficiencies. This was the second exam Examiner 82 had participated in and he ranked 17th out of 18 examiners in terms of grading accuracy. Therefore, the perfect score which Petitioner received from Examiner 82 is the least reliable of the three grades on the Periodontal procedure since Examiner 82 had the worst ranking for accuracy among these three examiners, and was next to last among all examiners. On the Cast Class II Onlay Prep procedure, Petitioner received grades of 1, 0, and 1. This resulted in a grade of .66 on this procedure. Petitioner objects to the grading of this procedure. He states he performed this procedure the way he was taught in dental school, he alleges that the comments of the examiners conflict, and he feels it is impossible to measure tooth reduction without an opposing model. The Cast Class II Only Prep procedure is performed on a model, or mannequin, and consists of a restoration onlay wax-up on a posterior tooth. In grading this procedure five criteria are used: Outline form Depth Retention Gingival level Mutilation of opposing or adjacent teeth Examiners 6 and 37 gave Petitioner a grade of 1. Examiner 6 commented on his score sheet that "Distal box too deep and undercut; excess facial cusp reduction." Examiner 37 commented that outline form was poor and "no lingual cusp protection." Examiner 15 gave Petitioner a score of 0 and commented that there was insufficient reduction of the functional cusp. Each of these examiners had participated in at least two previous exams, and each had a high grading accuracy ranking according to a post-exam evaluation of all examiners. Specifically, Examiner 15 ranked 1st, Examiner 37 ranked 4th and Examiner 6 ranked 8th out of 18 examiners. The comments of the examiners do not conflict and, in fact, do support the grades given. An examination of the mannequin used by Petitioner to perform this procedure (Petitioner's Exhibit 1) by a dental consultant who has been a licensed dentist in Florida since 1971, and who was accepted as a expert on the technical aspects of the clinical portion of the dental exam, confirms and supports the grades given by the examiners on this procedure. The major and significant deficiency on this procedure was Petitioner's failure to adequately reduce the functional or lingual cusp, and excessive reduction of the facial cusp resulting in the subject tooth being almost level. Although it is difficult to determine the amount of tooth reduction without an opposing model, and no opposing model was used in the exam, the teeth used for the exam mannequin are manufactured in large quantities from the sane mold or form. Therefore, variations in these model teeth before the procedures are performed are not visible to the naked eye. Improper reductions on these teeth are visible to the examiners who have seen this procedure performed many times on these same models, both in exams and in the standardization procedure. According to an examination development specialist employed by Respondent who was accepted as an expert in testing and measurement, specifically for the dental exam, the grading of exams which involve hands-on, practical demonstrations of an examinee's skill level is not entirely objective. There is some subjectivity in assigning grades after criteria for each procedure are evaluated. This is why three examiners separately review each procedure, and the average of their grades is used. In addition, Respondent performs the standardization exercise prior to the exam and then evaluates each examiner's grades for accuracy after the exam in order to minimize disparity and the effects of subjectivity. Examiners who do not receive a good evaluation in the post-exam review are not used in subsequent exams. Proposed findings of fact and conclusions of law have been submitted by the parties pursuant to Section 120.57(1)(b)4, F.S. A ruling on each proposed finding of fact has been made either directly or indirectly in this Recommended Order, except where such proposed findings of fact have been rejected as subordinate, cumulative, immaterial or unnecessary. Specifically, Petitioner's proposed findings numbered 7, 10, 11 and 12 are rejected for these reasons, and also because they are not based upon competent substantial evidence.
Recommendation Based upon the foregoing, it is recommended that Respondent enter a Final Order upholding the grades given to Petitioner and denying the relief sought by Petitioner. DONE and ENTERED this 19th day of April, 1985 at Tallahassee, Florida. DONALD D. CONN, Hearing Officer Division of Administrative Hearings The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32301 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 19th day of April, 1985. COPIES FURNISHED: Drucilla E. Bell, Esquire Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32301 Michael S. Rywant, Esquire 240 Hyde Park Avenue Tampa, Florida 33606 Fred Roche, Secretary Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32301 Salvatore A. Carpino, Esquire Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32301
The Issue Whether the Petitioner should receive on the the clinical portion of the examination additional credit, which is sufficient to receive a passing grade on the December 1997 dental licensure examination.
Findings Of Fact Petitioner, Neda Raeisian, was a candidate for the dental licensure examination administered by the State of Florida in December 1997. The dental examination administered in December 1997 consisted of three parts: a "Florida Laws & Rules" part, an "Oral Diagnosis" part, and a "Clinical" part. The Petitioner received passing scores on the "Florida Laws & Rules" and "Oral Diagnosis" parts of the examination. Petitioner received a score of 2.95 on the Clinical part of the examination. A score of 3.00 was required on the Clinical part of the examination. The Petitioner failed the Clinical portion by .05 of a point, and, therefore, she failed the overall dental examination. Three examiners grade each candidate's clinical portion of the dental examination. Three examiners are used because by averaging the scores of the three examiners, the Respondent is more likely to capture the candidate's true score than by using one or two examiners. Before an examiner may be used for an examination, he or she must be recommended by an existing examiner or by a member of the Board of Dentistry. The proposed examiner may not have any complaints against his or her license and he or she must have been actively practicing and licensed for at least five years in the State of Florida. The examiner must complete an application that is sent to the Board of Dentistry examination committee, where it is then reviewed by the committee, and if approved, the examiner is entered into the pool of examiners. Before every examination, the Respondent conducts a standardization session, which is a process by which examiners are trained to grade using the same internal criteria. The Respondent uses assistant examiner supervisors who are appointed by the Board to train examiners on the different criteria that are used during the examination. The assistant examination supervisors go through and describe what a score of five would be, all the way down to a zero, the different criteria for each of those particular grades, and under what circumstances those grades should be given. After the examiners go through a verbal training, they are shown slides of teeth and told what the score on that procedure should be. After the standardization, there is a post- standardization exercise where the examiners are required to grade five mannequin models to make sure they have been able to internalize the criteria. After the post-standardization exercise, the Respondent evaluates the examiners to determine whether they are acceptable to use during the examination. There are also post-examination checks on the examiner, whereby the Respondent decides whether or not to use the examiners again. The Respondent runs the post-examination statistical checks to make sure that the examiners grade with consistency and reliability. There is generally a very high agreement rate between the examiners. Typically if there is an inconsistency in grading, it is usually the examiner who gives the higher grade that is incorrect because he or she missed an error; any error found by an examiner must be documented. The examiners grade the examination independently of each other; that is, they do not confer with each other while scoring the examination. The examination is also double-blind graded. Double- blind grading is the process through which examiners have no contact with the candidates. The examination is conducted in such a way that there is one clinic that is monitored by a licensed dentist in which the candidates actually perform the procedures. When the candidates are finished a proctor walks the patient over to another clinic where the examiners are located, and the examiners grade the examination. The candidates perform the patient portion of the examination on human beings that they are responsible for bringing in. If the patient has the necessary characteristics, the patient could serve for two different candidates or on two different examinations. The examination is a minimum competency examination. The grading system used during the clinical portion of the examination is as follows: A zero is a complete failure, a one is unacceptable dental procedure; a two is below minimally acceptable dental procedure; a three is minimally acceptable procedure, which is the minimum required to pass the clinical portion; a four is better than minimally acceptable dental procedure; and a five is outstanding dental procedure. An overall score is determine by averaging the three examiners' scores on the eight clinical procedures, putting different weights into a formula, and calculating the final grade. It is required in Board rule that the scores of the examiners be averaged. The Petitioner challenges the score given to her for her performance on Procedure 03, "Amalgam Final Restoration," of the Clinical portion of the examination. The Petitioner performed Procedure 03, the "Amalgam Final Restoration," on a live patient, Ms. Desiree Peacock. The Petitioner's performance on Procedure 03 was graded by three examiners: examiner number 290, identified as Dr. Richard Tomlin, of Pinellas Park, Florida; examiner number 299, identified as Dr. Haychell Saraydar, of Pinellas Park, Florida; and examiner number 176, identified as Dr. Leonard Britten, of Lutz, Florida. The Petitioner received a grade of 4 on a scale of 0-5 for her performance on Procedure 03 by examiner number 290; and a grade of 3 on a scale of 0-5 for her performance on Procedure 3 by examiner number 299. However, she received a grade of 0 on a scale of 0-5 for her performance on Procedure 03 by examiner number 176. The reason the Petitioner was given a score of 0 on procedure 03 by examiner number 176 was that the examiner felt that there was a lack of contact at the amalgam restoration site. The Respondent's dental expert, Jorge H. Miyares, D.D.S., testified that a score of 4 is given on Procedure 3 when, in the judgment of the examiner, there are only minor errors present which will not jeopardize the procedure; that a score of 3 is given on Procedure 03 when, in the judgment of the examiner, the procedure is completed at entry level; and that a score of 0 on Procedure 03 is mandatory if there is a total lack of contact. The examiners are taught and trained to check for contact when grading a candidate's performance on Procedure 03, as a lack of contact is a very significant error that jeopardizes the integrity of the amalgam restoration. There are two different types of contact involved in a Class II Restoration. The type of contact that was referenced by Examiner 176 in his grade documentation sheet is proximal contact. Proximal contact is when a tooth is restored, the proximal tooth next to it must be touching the tooth that has been prepared. Contact is something that either does or does not exist between two teeth. Contact is checked visually and by running a piece of dental floss between the teeth to see if there is resistance. Examiners 290 and 299 would have been required to give the Petitioner a grade of 0 on Procedure 03 if they had found a lack of contact. The findings of examiners 290 and 299 during their review of the Petitioner's performance on Procedure 03 were inconsistent with the findings of examiner 176 (lack of contact) during his review of the Petitioner's performance on Procedure 03. The inconsistency between the findings of examiners 290 and 299 and the findings of examiner 176 during their review of the Petitioner's performance on Procedure 03 were statistically unusual. Respondent performed Procedure 03 on the patient Desiree Peacock. Following the exam, Peacock used dental floss on the affected area and she believed she felt resistance. Although the grading on Procedure 03 of the clinical portion of the examination is inconsistent, the Respondent followed its standard testing procedures for the December 1997 dental examination. The evidence is insufficient to prove that the Respondent's examiner acted arbitrarily or capriciously or with an abuse of discretion in refusing to give the Petitioner a passing grade on procedure 03 of the clinical examination.
Recommendation Upon the foregoing findings of fact and conclusions of law, it is RECOMMENDED that the Board of Dentistry enter a Final Order dismissing the Petitioner's challenge to the grade assigned her for the clinical portion of the December 1997 dental licensure examination. DONE AND ENTERED this 22nd day of September, 1998, at Tallahassee, Leon County, Florida. DANIEL M. KILBRIDE Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 22nd day of September, 1998. COPIES FURNISHED: Anne Williamson, Esquire Department of Health Building 6, Room 102 1317 Winewood Boulevard Tallahassee, Florida 32399 Dr. Neda Raeisian 2161 Lake Debra Drive Apartment 1726 Orlando, Florida 32835 Pete Peterson, General Counsel Department of Health 2020 Capital Circle, Southeast Bin A 02 Tallahassee, Florida 32399-1703 Angela T. Hall, Agency Clerk Department of Health 2020 Capital Circle Southeast Bin A-02 Tallahassee, Florida 32399-1703
The Issue The basic issue in this case is whether the Petitioner, Maria I. Galarza, is eligible to take the dental mannequin exam. The Board proposes to deny the Petitioner's application to take the exam on the grounds that the Petitioner's dental degree from the Universidad Central del Este in the Dominican Republic is not the equivalent of four academic years of dental education. The Petitioner contends her degree is equivalent and meets the criteria for taking the dental mannequin exam.
Findings Of Fact Facts stipulated to by all parties Petitioner sought approval of the Board to take the manual skills (mannequin) examination as an avenue toward being certified for licensure as a dentist in Florida with an application dated September 17, 1991. 1/ With her application, Petitioner submitted sufficient evidence to establish that she graduated from high school in Puerto Rico; received a bachelor of arts degree from a college in Puerto Rico; graduated with a "titulo" or degree in dentistry from the Universidad Central del Este (UCE) in the Dominican Republic; has attained an age of more than 18 years; and had completed the National Dental Board Examination with passing scores within the ten years preceding her application. UCE is not a dental school accredited by the Commission on Accreditation of the American Dental Association or its successor agency or any other nationally recognized accrediting agency. UCE is a foreign dental school located in the Dominican Republic. It is a member of the Asociacion Latinoamericana de Facultades y Escuelas de Odontologia (ALAFO). Pursuant to statute and rules of the Board, Petitioner submitted her educational credentials to ECE for a determination as to whether she had completed the equivalent of five academic years of post secondary education including four years of dental education. The Board of Dentistry requires that all graduates of foreign dental schools have their degrees evaluated for equivalency to U.S. degrees by Educational Credential Evaluators, Inc. (hereafter ECE). ECE is headed by Dr. James Frey. ECE has evaluated numerous dental degrees for graduates of Universidad Central del Este. In August 1990 ECE changed its opinion of the degree. ECE believes its previous evaluations finding the degree equivalent are erroneous. The Petitioner attended the UCE dental program from September 1979 to September 30 ,1982. UCE awarded Petitioner credit for previously completed course work and did not require Petitioner to take or complete the following courses in UCE's dental curriculum: Mathematics (4 credits) Literature (9 credits) Philosophy (undetermined credits) Sociology (undetermined credits) Physics (8 credits) Biology (4 credits) UCE has a dental program consisting of three academic semesters per calendar year. Dr. Frey testified that a four year dental degree requires a minimum of 120 semester hour credits. He determined that Ms. Galarza achieved the equivalent of 101.5 semester hours of credit at Universidad Central del Este. Dr. Frey also determined that UCE granted her the equivalent of fourteen additional semester hours of credit for course work already taken at the University of Puerto Rico. The University of Florida has the only accredited dental program in the State of Florida. At the University of Florida, dental students attend courses for three academic semesters per calendar year and the dental curriculum lasts for 3.66 calendar years and a total of eleven semesters. The Board, based upon its review of the Petitioner's credentials and the report from ECE determined the Petitioner has not completed four academic years of post secondary dental education. The Petitioner disagrees with the Board's determination. Facts based on evidence submitted at hearing The dental mannequin examination is an examination given to graduates of dental schools that are not accredited by the American Dental Association. Successful completion of the dental mannequin examination is a statutory prerequisite to taking the licensure examination. The dental education program at UCE is planned as an eleven semester program and consists of approximately 63 courses, for which the university awards a total of approximately 230 credits. 2/ Eleven of the courses are described as being part of the "Curso Comina" the so-called "common courses." The eleven courses that comprise the so-called "common courses" are high school level pre-dentistry courses.3/ These pre-dentistry courses are planned as part of the first two semesters, but in actual practice are taken at random times during the program, sometimes as late as the last semester. The eleven courses that make up the so-called common courses" represent a total of approximately 39 credits 4/ as follows: Mathematics 011 (or 101) 4 Literature 011 (or 101) 5 Phylosophy [sic] 2 Sociology 2 Physics 011 (or 101) 4 Biology 4 Literature 102 4 Dom. Soc. History 2 Mathematics 012 (or 102) 4 General Chemistry 4 Physics 012 (or 102) 4 Total "common course" credits 39 The Universidad Central del Este awarded the Petitioner a total of approximately 233 credits, including the credits that were awarded for either successful completion of, or for exemption from, the so-called "common courses." When the credits for the so-called "common courses" (which as noted above are pre-dentistry courses) are subtracted from the total credits awarded, the Petitioner's transcript reflects a total of approximately 194 credits of dental education. One credit at the dental education program at UCE represents the equivalent of approximately one-half of a semester hour credit at a dental education program in the United States. Accordingly, the Petitioner's 194 credits of dental education at UCE are the equivalent of approximately 97 semester hours at a dental education program in the United States. 5/ A full four-year dental program in the United States consists of a minimum of 120 semester hours of credit, and usually consists of 128 semester hours of credit. The standard length of a semester in a United States dental education program consists of 15 or 16 teaching weeks. The standard length of a semester at the University of Florida dental program is 16 teaching weeks. The length of the typical semester at the Universidad Central del Este consists of 13 or 13.5 teaching weeks. The Petitioner completed all of her course work at UCE during a period of eight consecutive semesters. During her eighth semester the Petitioner began work on her thesis. During that same semester her transcript reflects that she was also taking at least eleven courses totaling 44 hours of credit. 6/ During her ninth semester at UCE, the Petitioner did not take any classes, but spent all of her time working on her thesis. Educational Credential Evaluators, Incorporated, is the only agency approved by the Board of Dentistry to review foreign educational credentials. No other agency has ever been denied approval by the Board. Although the Board's rules permit other organizations to be approved, no other entity has ever requested to be approved by the Board. Educational Credential Evaluators, Incorporated, provides an evaluation of credentials to determine the quantity of education obtained at a foreign school in terms of the United States educational system. At one time Educational Credential Evaluators, Incorporated, was of the opinion that the dental education program at the Universidad Central del Este was equivalent to four years of dental education in the United States. The educational credentials of one of the Petitioner's classmates who also graduated from the UCE dental program in 1982 were earlier evaluated by Educational Credential Evaluators, Incorporated, and determined to be equivalent to four years of dental education. In 1990, following receipt and review of additional information about the dental program at UCE, Educational Credential Evaluators, Incorporated, concluded that its prior opinion was incorrect. The additional information that formed the primary basis for the change of opinion was that UCE was regularly waiving the so-called "common courses" on the basis of students' prior high school work and that UCE semesters were comprised of only thirteen or thirteen and a half teaching weeks. Educational Credential Evaluators, Incorporated, is now of the opinion that the dental program at UCE is the equivalent of only 3.66 years of dental education. 7/ Upon review of the Petitioner's educational credentials from UCE, Educational Credential Evaluators, Incorporated, concluded that she had actually completed the equivalent of only three and one-quarter years of dental education. 8/ This conclusion did not allow any credit for courses that were waived by UCE based on courses taken by the Petitioner at the University of Puerto Rico. The Board of Dentistry has a Credentials Committee that evaluates all applications to take the dental licensure examination, the dental hygiene licensure examination and the dental mannequin examination. The Credentials Committee reviews the educational credentials of applicants who have graduated from foreign dental schools. In its evaluation of foreign credentials, the Board of Dentistry does not accept as part of the statutorily required dental education any credit for course work completed at an undergraduate institution. Since 1987, the Board of Dentistry has relied upon reports from Educational Credential Evaluators, Incorporated, along with its own review of dental school transcripts, licensure applications, and national board examination scores, to determine the eligibility of applicants to take the dental mannequin examination. The Board has always accepted the recommendation of Educational Credential Evaluators, Incorporated, as to the equivalency of dental education. Prior to 1990, the Board of Dentistry generally accepted a dental education from the Universidad Central del Este as meeting the requirement for dental education set forth in the statutes. In 1990, based upon a report from Educational Credential Evaluators, Incorporated, which tended to confirm some of the Board's suspicions regarding the dental program offered at UCE, the Board changed its position regarding the equivalency of a UCE dental education.
Recommendation On the basis of all of the foregoing, it is RECOMMENDED that a Final Order be entered in this case concluding that the Petitioner has failed to prove by a preponderance of the evidence that she has received the equivalent of four academic years of dental education, concluding that the Petitioner is not eligible to take the dental mannequin examination, and dismissing the petition in this case. DONE AND ENTERED at Tallahassee, Leon County, Florida, this 31st of March, 1992. MICHAEL M. PARRISH, Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 31st day of March, 1992.
Findings Of Fact The Petitioner, a candidate for licensure as a dentist, was administered the state Dental Examination in June 1988. A part of the exam, the clinical portion, requires that each candidate perform specified procedures on a human patient. The exam procedures are performed in a clinical setting. A floor monitor is present during the examination. After each procedure is performed, the monitor escorts the patient to a grading room. In the grading room, three examiners separately and independently review each candidate's performance. The examiners generally do not discuss or otherwise communicate their opinions or the grades awarded other than to note such on the grading sheet completed by each examiner. The examiners are Florida-licensed practicing dentists. Prior to the examination, the examiners participate in a training session designed to provide a standardized, uniform reference for grading the results of a candidate's performance on the clinical exam. Each examiner awards a numerical grade between 0 and 5 for each procedure. The grade for each procedure reflects an evaluation of the whole of a candidate's performance. Comments are made by each examiner on the grading sheet, either through marking in a computer-scored portion on the sheet, or by written notes outside the computer-scored area. The criteria for each possible grade is as follows: 0--complete failure 1--unacceptable dental procedure 2--below minimal acceptable dental procedure 3--minimal acceptable dental procedure 4--better than minimal acceptable dental procedure 5--outstanding dental procedure The three scores awarded by the examiners are averaged to provide the grade for each procedure. Each candidate is identified on the grading sheet by number so as to prevent an examiner from knowing the identity of the individual candidate being reviewed. Each examiner is also identified by number. Examiners are assigned to grade a candidate through a random selection process. The test monitor is responsible for collecting the grading sheets after each examiner has completed the review. After the grading process is complete, the patient is returned to the clinic for performance of the next procedure. The grading process is repeated for each step. The Petitioner challenges the scores awarded to two of the ten procedures performed as part of the clinical exam. Procedure number two on the exam, the amalgam cavity prep, provides for the preparation of a decayed tooth for filling. Procedure number three, the final amalgam restoration, provides for the filling of the prepared cavity. The two procedures account for 20% of the total points on the clinical examination, divided between procedure two (two-thirds) and procedure three (one-third). On procedure number two, the Petitioner received a grade of 3 from examiner 133, a grade of 4 from examiner 194, and a grade of 0 from examiner 192. Examiner 192 noted that caries remained present in the prepared tooth cavity. Neither examiner 133 nor examiner 194 noted remaining caries, although both identified other areas of concern regarding the candidate's performance. According to the examination rules of the Department, a grade of 0 is mandatory if caries remain after completion of the procedure. There was no evidence to indicate that the review and scoring by examiner 192 was erroneous, beyond the fact that other examiners did not note remaining caries. It is possible, according to expert testimony, for one examiner to identify remaining caries which other examiners fail to discover. The remaining decay can be dislodged by one examiner in reviewing the procedure and therefore not visible to subsequent examiners, or the decay, loosened by the procedure, can be otherwise displaced within the patient's mouth between examinations. On procedure number three, the candidate received a grade of 3 from examiner 101, a grade of 4 from examiner 052, and a 0 from examiner 192. Examiner 192 noted that the functional anatomy, proximal contour, and margin of the amalgam restoration were deficient, further noting that a cervical shoulder existed and that the prepared area was not filled. The evidence did not indicate that the grade awarded by examiner 192 for procedure number three was erroneous or mistaken. According to the evidence, including expert testimony based upon a review of x-rays taken subsequent to completion of the procedure, the grade awarded by examiner 192 was appropriate.
Recommendation Based on the foregoing, it is hereby RECOMMENDED that the Department of Professional Regulation, Board of dentistry enter a Final Order dismissing the Petitioner's challenge to the grading of the two clinical procedures on the June 1988 dental examination. DONE and RECOMMENDED this 7th day of July, 1989, in Tallahassee, Florida. WILLIAM F. QUATTLEBAUM Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 7th day of July, APPENDIX CASE NO. 89-0588 The following constitute rulings on proposed findings of facts submitted by the parties. Petitioner The Petitioner's proposed findings of fact are accepted as modified in the Recommended Order except as follows: Rejected. The evidence did not establish that procedure number two is weighted more than all other procedures, but did indicate that procedures performed within the oral cavity are more heavily weighted that procedures performed outside the cavity. Procedures two and three are both performed within the oral cavity. Procedure two is, and, totaled, constitute 20% of the clinical examination. Procedure two provides two-thirds of the 20%, with procedure three providing one-third of the 20%. Rejected, restatement of testimony. The appropriate criteria for the 0-5 grade scale is as stated in Rule 21G-2.013 Florida Administrative Code. Rejected, not supported by weight of evidence. Both examiners noted comments on the grading sheet, either through marking within computer-scored area or by writing additional comments on the grading sheet. Rejected. The evidence did not indicate that it was "customary" for examiners to pass notes through monitors to the candidate. The witness testified that, on occasion, he had passed notes to monitors when he gave a score below three on the referenced procedures. However, there is apparently no requirement that examiners inform candidates, through monitors, of problems which are found during the grading of the candidate's work. Rejected, irrelevant. There is no requirement that the candidate should have been informed of the acceptability of his work or of his scores during the procedure. Rejected, not supported by weight of the evidence. The fact that one examiner identifies specific problem areas which are not identified by other examiners does not indicate that the scores are erroneous or that the standardization process undergone by the examiners was deficient. Rejected, conclusion of law. 14-15. Rejected, goes to weight accorded testimony of referenced witnesses. Respondent The Respondent's proposed findings of fact are accepted as modified in the Recommended Order except as follows: 4. Rejected, irrelevant. 9. Rejected, as to characterization of Petitioner's testimony. COPIES FURNISHED: James Sweeting, III, Esquire 2111 East Michigan Street, Suite 210 Orlando, Florida 32806 E. Harper Field, Deputy General Counsel Department of Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792 William Buckhalt, Executive Director Department of Professional Regulation Board of Dentistry 1940 North Monroe Street Tallahassee, Florida 32399-0792 Kenneth E. Easley, General Counsel Department of Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0729
The Issue Whether Respondent Tessler has violated Florida Statute Section 466.24(3)(a), (c) and (d) and is guilty of misconduct, malpractice, or willful negligence in the practice of dentistry. Whether Respondent is guilty of receiving compensation because of a false claim intentionally submitted. Whether Respondent has failed to treat a patient according to acceptable dental standards and procedures.
Findings Of Fact Dr. Stephen W. Tessler, the Respondent, is a dentist licensed to practice dentistry under the laws of the State of Florida, Chapter 466, Florida Statutes, engaged in the practice of dentistry in his office located at 1245 NW 190th Street, North Miami, Florida. The Petitioner, State Board of Dentistry, filed an administrative accusation against Respondent Tessler, which was sworn to and subscribed in July, 1978. The accusation contained two counts, and the Respondent requested an administrative hearing. The hearing was first scheduled for October 20, 1978, but was continued upon motion of the Petitioner to January 10, 1979, and rescheduled upon motion of the Respondent to March 8, 1979. During the months of January, 1977, through mid-June, 1977, Ms. Rachel Dixon was a dental patient of Respondent Tessler. Ms. Dixon is a 32-year-old woman with a history of severe tooth and gum problems. She had prosthetic appliances and six (6) anterior crowns placed in her mouth ten (10) to fifteen (15) years ago in Pennsylvania. She had engaged a dentist, a Dr. Snyder in Hollywood, Florida, but had not seen him for some two (2) years prior to making an appointment with the Respondent for relief from pain and gum irritation, and for cosmetic improvement. Ms. Dixon is an unhappy dental patient with an inordinate fear of dentists, and her home dental hygiene care is inadequate. At the time Ms. Dixon engaged Respondent Tessler, she was in need of dental treatment for full-mouth gross peridontal inflammation and infected root canals in tooth number 30. She employed the Respondent for the purpose of providing dental treatment for peridontal disease, endodonic care of tooth number 30, recapping to the anterior teeth, and restoration of an upper right bridge on teeth number 3, 4 and 5. Ms. Dixon was referred to Dr. Hirschfield, an orthodontist in Respondent's office, for x-rays. Costs were discussed, a payment made, and a schedule of appointments planned. Thereafter, Ms. Dixon kept numerous scheduled and unscheduled appointments with the Respondent. Respondent Tessler replaced existing crowns on six (6) anterior teeth (number 6, 7, 8, 9, 10 and 11) with six (6) anterior foil porcelain jackets. In the presence of peridontal disease, Respondent attempted to replace an upper right bridge on teeth number 3, 4 and 5. Respondent was dissatisfied with the "final restoration" but used it instead of making a temporary one. He placed it in Ms. Dixon's mouth because it was better than a temporary restoration. Respondent had told Ms. Dixon that he would satisfy her and would redo the temporary restoration on her front teeth. He did the restoration a second time. Initially, Ms. Dixon was pleased, but later she was not satisfied because she felt pain upon contact with food, drink, or air that was either hot or cold. At the time of hearing no further work had been done in this area of her mouth, and she still complained of pain. On the second or third visit, within two (2) weeks of Ms. Dixon's initial visit, Respondent treated tooth number 30 by performing three (3) root canal treatments. After a number of weeks, Ms. Dixon continued to experience pain in this tooth. Respondent treated tooth number 30 again, reopening two (2) root canals to permit drainage and prescribing an antibiotic. During the course of the endodonic treatment on tooth number 30 an existing lower right bridge on teeth number 28, 29, 30 and 31 was damaged. Ms. Dixon did not return to Respondent for treatment, although she was in pain and attempted for two (2) or three (3) days to reach Respondent by telephone calls to his office. Thereafter, a week or ten (10) days later, Ms. Dixon sought the services of Dr. Marvin Levinson. She indicated to Dr. Levinson that she was not going to return to Respondent Tessler, that she suffered from pain, and that she was concerned about her appearance. Dr. Levinson examined her and referred her to Dr. Satovsky, an endodontist, for immediate relief of pain for a dental abscess, and to Dr. Garfinkle, a peridontist, for a complete peridontal work-up. It was Dr. Garfinkle's opinion that the caps placed by Respondent Tessler in the mouth of Ms. Dixon were placed in the presence of peridontal disease or that the caps caused the disease. He could not determine which came first. Dr. Garfinkle stated that Ms. Dixon was prone to peridontal disease and that she was an unhappy dental patient. Dr. Garfinkle could not comment on the condition of Ms. Dixon's mouth at the time of the treatment given by Respondent, inasmuch as he had not seen her until some eight (8) months had passed. Dr. Satovsky stated that on tooth number 30, which he treated subsequent to the root canal treatment done by Respondent Tessler, the canals were inadequately cleaned and enlarged. He stated that there were three (3) canals on the tooth, two (2) of which had the rods removed, and that he removed the third. He retreated the three (3) canals and alleviated the pain of Ms. Dixon. Dr. Satovsky could not state whether he thought the work of Respondent was negligent, inasmuch as he could not state what the tooth looked like when Respondent first saw it. Dr. Marshall Brothers, the Secretary/Treasurer of the State Board of Dentistry, found that the permanent type of restoration was adequate but not good for a temporary restoration. Upon his examination of Ms. Dixon's mouth, he found her general peridontal condition to be poor. Dr. Brothers could not determine whether her condition was a result of the restoration or existed prior to the restoration. He assumed the condition to be the one or the other because of the recency of the restoration. Respondent Tessler is a licensed dentist and a general practitioner, and is licensed to perform the dental work involved in this case. His charges for this work were substantial, but there was no evidence submitted that said charges were excessive or that Ms. Dixon misunderstood them. Alternative methods of treatment were discussed. The testimony and the evidence in this case show that Respondent worked within his ability as an average dentist. There was no showing of willful negligence, although Respondent's judgment may have been poor, and probably he should have referred Ms. Dixon to specialists. Affixing a bridge and crown work in the presence of gum disease is not the acceptable standard of care within the dental profession, and Respondent admits to that fact; however, he felt that it would improve the overall condition, and he had not released Ms. Dixon as a patient. Ms. Dixon was not pleased with Respondent's work or his charges ad, after attempting to make an appointment, left Respondent Tessler for another dentist. Ms. Dixon was insured through her husband's employer by a policy issued by Aetna Casualty and Surety Company. On January 31, 1977, Respondent Tessler submitted a pre-treatment estimate for work to be done consisting of porcelain-to-gold restorations on anterior teeth number 7, 8, 9, 10 and 11, and for a fixed bridge on teeth number 28, 29, 30 and 31, plus additional treatment in the amount of $2,420.00. The insurance company refused to pay for all treatment except for the fixed bridge on teeth number 28 through 31. On April 27, 1977, Respondent submitted the customary insurance treatment form to Aetna certifying that the bridgework had been performed and completed on April 27, 1977. Based on Respondent's representation, Aetna paid Respondent $649.50. The bridgework had in fact not been done, nor were the anterior crowns porcelain-to-gold restorations. Approximately one year later, Respondent refunded the overage to Aetna upon the request of the insurance company. Both parties submitted proposed findings of fact and memoranda of law, and Respondent submitted a proposed order. These instruments were considered in the writing of this Order. To the extent the proposed findings of fact have not been adopted in, or are inconsistent with, factual findings in this Order, they have been specifically rejected as being irrelevant or not having boon supported by the evidence.
Recommendation Based upon the violation as established, it is recommended that the license of Stephen W. Tessler, D.D.S., be suspended for a period of time not exceeding one year from the date of the Final Order. DONE and ORDERED this 12th day of June, 1979, in Tallahassee, Leon County, Florida. DELPHENE C. STRICKLAND Hearing Officer Division of Administrative Hearings Room 101, Collins Building Tallahassee, Florida 32301 (904) 488-9675 COPIES FURNISHED: L. Haldane Taylor, Esquire 2516 Gulf Life Tower Jacksonville, Florida 32207 Stephen Mechanic, Esquire Suite 200 1125 NE 125th Street North Miami, Florida 33161
Findings Of Fact Upon consideration of the oral and documentary evidence adduced at the hearing, the following relevant facts are found: Petitioner Carl L. Altchiler holds licenses to practice dentistry in the States of New York (1957) and New Jersey (1973). From 1974 through 1977, petitioner was employed in Florida as an institutional dentist at the Sunland Center in Orlando and the Sumter Correctional Institution in Bushnell. He has not practiced dentistry since 1978. In June of 1980, petitioner was a candidate for Florida licensure and took the clinical or practical portion of the dentistry examination. A prerequisite for licensure is that a candidate receive a final total clinical grade of 3.0. Petitioner received a grade below 3.0 on six of the eleven procedures tested, giving him an overall grade of 2.70 on the clinical portion of the exam. A candidate for licensure with the Board of Dentistry must take both a written examination and a pracatical or clinical examination. The clinical exam consists of six parts and requires that eleven procedures be completed. These include the following: Amalgam preparation on a patient Amalgam restoration on a patient Periodontal exercise on a patient Occlusal registration and transfer Final impression Pin amalgam preparation Pin amalgam final restoration Endodontic anterior Endodontic posterior Cast gold preparation Cast gold restoration Prior to the June, 1980, clinical examination, all candidates were sent an instruction booklet which included information concerning the subject areas to be tested, the weight to be accorded each area, the procedures the candidates were to follow in taking each procedure and the grading system. The candidates also participated in a three to four hour orientation program prior to the exam, where protocol was discussed and questions regarding procedure were answered. Florida dentists who have practiced for at least five years are preselected to be examiners for the clinical portion of the dentistry exam. Approximately 23 examiners were utilized during the June, 1980, exam. Prior to arriving at the examination site, each examiner is sent the grade sheets to be utilized and the instructions to candidates. They also receive examiner and monitor instructions and forms. On the day prior to the exam, the examiners are given an 8-hour "standardization" course where the grading guidelines and procedures are discussed. This is to promote consistency and objectivity in grading. Examiners are instructed to independently grade each procedure assigned to them by awarding a grade of from 0 to 5 and indicating the appropriate number on the comment portion of the grading sheet to justify the grade assigned. They may also provide additional comments if they so desire. The grades of 0 to 5 represent the following: 0 = complete failure 1 = unacceptable dental procedure 2 = below minimal acceptable dental procedure 3 = minimal acceptable dental procedure 4 = better than minimally acceptable dental procedure 5 = outstanding dental procedure Each clinical procedure performed by a candidate is independently graded by three different examiners, and the three grades are then averaged to determine the total grade for that procedure. Among the forms which the examination monitors are instructed to utilize is a "Report of Equipment Failure." If utilized during the exam, this form is to be placed in the candidate's file containing the examiner's grade sheets. Four witnesses who were qualified and accepted as experts in the field of dentistry testified in this proceeding. Thomas Gerald Ford, Jr., D.D.S. and Allen M. Guy, D.D.S. were called on behalf of the petitioner. Dr. Ford has practiced general dentistry since 1972, is a member of various dental associations, is a dental consultant for various agencies and private organizations and has given testimony in all phases of forensic dentistry. Dr. Guy has practiced general dentistry since 1971 and is a member of various dental associations. Neither Dr. Ford nor Dr. Guy has served as a monitor or examiner for the Florida dentistry examination. Testifying on behalf of the respondent were Rupert Q. Bliss, D.D.S. and Louis Vodila, D.D.S. Dr. Bliss has practiced general dentistry since 1956, specializing in restorative dentistry, is a member of various dental associations, has taught dentistry, is currently a member of the,Florida Board of Dentistry and has served as an examiner for the Florida dental examination. Dr. Vodila has practiced general dentistry since 1956, is a former member of the Board of Dentistry and has served as Chairman of the Dental Examination for two or three exams. He presently serves, as he did in June of 1980, as the consultant and Chief Dental Examiner for the Department of Professional Regulation, Office of Examination Services. PROCEDURE NUMBER 5 Procedure Number 5, entitled "Complete Denture Evaluation" was a test of the candidate's ability to transfer the centric relation of a live patient's jaw to an articulator. The accurate transfer from the human jaw to the articulator is crucial since the denture will be constructed on the articulator and not in the patient's mouth. If the transfer is not accurate, the denture will not fit or function properly. Wax bite registrations were utilized for this procedure and the test was whether the candidate could accurately duplicate the patient's jaw relationship on an articulator. Hand articulation is not an acceptable means of determining the accuracy of the transfer and cannot simulate the articulation observed by the three examiners who graded this procedure. Petitioner received the grades of 3, 2 and 2, for an overall score of 2.33 on Procedure Number 5. The two examiners who assigned a grade of 2 noted that the centric relation was unacceptable. Other comments listed by the three examiners were that the appearance of the wax was overcontoured and that the interocclusal distance (space) was too little. Petitioner's live patient for this procedure, Beatrice King, testified that the wax bite registrations fit and felt comfortable during the June, 1980, examination. She felt that two of the three examiners were very rough with her. She noted that the one gentle examiner had no trouble placing the rims in her mouth, and that she had to blow to enable their removal. During the administrative hearing, Mrs. King inserted the wax registrations in her mouth and felt that they were still comfortable and that her bite was normal. The expert witnesses testifying for both petitioner and respondent observed the registrations inside Mrs. King's mouth during the hearing. Petitioner's two expert witnesses agreed that the wax bite registrations lacked in appearance and were overcontoured. However, they both felt from observing the registrations in Mrs. King's mouth, that the centric relation was acceptable and repeatable and that, if inserted properly, a full seating could be obtained on Mrs. King. They would have assigned a grade of 3 and 4, respectively. Respondent's expert witness observed that the rims of the wax did not match and that the back sides of the rims were touching, thus providing an obstruction to proper closing. It was also his observation that the inserted bite rims in Mrs.King's mouth had lateral movement. He felt that a grade of 2 was "very generous." PROCEDURE NUMBER 6 Procedure Number 6, entitled "(Final) Complete Denture Evaluation," consisted of the preparation of an impression of the mouth. of a completely endentulous patient. On this procedure, petitioner received grades of 1, 2 and 4, for an overall grade of 2.33. All of the examiners noted voids in the impression tray. Other comments made by the examiners included pressure areas, inablility to observe a post-dam area, the tray not being built u high enough into the vestibule and lack of retention and stability. The actual impression tray used by petitioner during the examination has been distorted by improper storage while in the custody of respondent. It therefore could not be inserted into the mouth of Mrs. King for observation by the expert witnesses who testified at the hearing. Nevertheless, upon observation of the impression tray, petitioner's two witnesses, while noting the voids and pressure areas, would assign grades of 3.5 and 4, respectively. Respondent's expert witness did not feel that the impression submitted by petitioner constituted good dentistry. Voids and pressure areas in the impression tray can cause distortions and inaccuracies in the final denture. Respondent's witness felt that the grades of 1 or 2 were "very generous." PROCEDURE NUMBER 8 Procedure Number 8, entitled "Cast Gold Cavity Preparation," was conducted on a mannequin and required candidates to complete a cavity preparation to receive a cast gold onlay. The instructions called for the preparation of an MOD onlay replacing the buccal and lingual cusps. Petitioner received grades of 2, 2 and 1 on this procedure, for an overall grade of 1.67. The comments noted on the grading sheets included a rough marginal finish, no gingival bevel, debris, the scarring of adjacent teeth, unsupported enamel and unacceptable outline form and depth preparation. Petitioner agrees that the marginal finish was rough and that the adjacent teeth were scarred. According to petitioner, this latter defect occurred when the head of the mannequin suddenly moved as a result of a loose neck screw causing the drill to slip and go through the metal bands on the adjacent teeth. Petitioner's expert witnesses observed the rough marginal finish, but found the remaining criteria satisfactory. They would assign grades of 3 and 4, respectively. Respondent's witness felt that the outline form did not match what was called for on the examination. Rather than the MOD onlay required, the outline form more resembled one for a three-quarter crown. He noted the other deficiencies marked by the examiners on the comment section of the grading sheet. He felt that the grades of 1 and 2 were consistent with what he observed. PROCEDURE NUMBER 9 Procedure Number 9, entitled "Final Gold Restoration," consisted of the candidate fabricating an onlay casting for an ivorine tooth from a dentoform in a mannequin. The procedure was graded with the gold onlay placed on the tooth within the mannequin jaw and with regard to the relationship of the onlay to the other teeth in the jaw. Petitioner received grades of 0, 1 and 2 for this procedure, for an overall grade of 1.00. The examiner who assigned a grade of 0 noted that the casting was not seated and rocked. The other two examiners did not check this comment, but did make comments pertaining to functional anatomy, proximal contour, contact and surface finish. Petitioner's expert witnesses did not observe the ivorine tooth with the gold on lay in the dentoform in the mannequin jaw. They did observe the ivorine tooth with the gold onlay and found that the onlay did not rock on the tooth. Dr. Ford, while noting a few rough edges on the casting and a little problem in the margin, found the gold to be an exact match of the tooth. He would assign a grade of 4 to this procedure. Dr. Guy, noting a rough surface finish, would assign a grade of 3.6. The ivorine tooth and the gold onlay were in the possession of the respondent until several weeks prior to the administrative hearing. Respondent's two witnesses observed the tooth and onlay prior to the last part of April, 1981, and found that the gold onlay had a slight rock to it at that time. They both admitted that the on lay now seated better on the tooth than when they first observed it, though Dr. Bliss still detected a slight rock. Dr. Vodila felt that the procedure still deserved a failing grade because of the deficiencies in the margins. Dr. Bliss, noting that the procedure could not be accurately graded outside the dentoform in the mannequin's mouth, as well as the lack of seating when he first observed it, felt that the grade of 0 was accurate and that the product failed to meet minimal standards for the practice of dentistry. PROCEDURE NUMBER 10 Procedure Number 10, entitled "Pin Amalgam Preparation," was conducted on a dentoform in a mannequin and consisted of the preparation of a tooth for amalgam restoration. Petitioner did not complete this procedure and received a grade of 0 from each of the three examiners. According to petitioner, during this procedure the head on his mannequin often made sudden movements due to a loose screw on the back of the mannequin's neck. He attempted to tighten the screw to fixate the head on several occasions, but the screw would not hold. He testified that he called the monitor over on several occasions and was told, at first, to do the best he could, and eventually, to go on to another procedure. This testimony was corroborated by the testimony of Suzette Rogers, who assisted petitioner during this procedure. A steady, stable working station is important in this type of procedure for an accurate preparation. A competent dentist is trained to and should be able to steady his work area and complete the procedure even with a loose mannequin head. As noted above, the monitors are instructed to complete a form when equipment failure is demonstrated and to insert that form into the candidate's file. No such form was found in petitioner's file. The lead examiner for the dental exam, Dr. Vodila, was never notified of any mannequin failure during the June, 1980, exam. The same mannequin head used by petitioner was also used by four other candidates before and after petitioner used it. PROCEDURE NUMBER 11 Procedure Number 11, entitled "Pin Amalgam Final Restoration," required the candidate to complete an amalgam restoration in an ivorine tooth with a pin. This procedure was to be accomplished on a prepared tooth placed in a mannequin by the monitor after the candidate turned on a light to indicate his readiness for this procedure. Petitioner apparently did not understand the directions for this procedure, no prepared tooth was placed in the mannequin, and no work product was turned in by the petitioner. A grade of 0 was assigned by all three examiners for Procedure Number 11.
Recommendation Based upon the findings of fact and conclusions of law recited above, it is RECOMMENDED that the grades awarded to petitioner on Procedures Number 5, 6, 8, 9, 10 and 11 of the clinical portion of the dentistry examination held in June of 1980 be upheld. Respectfully submitted and entered this 29th day of October, 1981, in Tallahassee, Florida. DIANE D. TREMOR, Hearing Officer Division of Administrative Hearings The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32301 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 29th day of October, 1981. COPIES FURNISHED: Robert Dyer, Esquire Duckworth, Allen, Dyer and Pettis, P.A. 400 West Colonial Post Office Box 3791 Orlando, Florida 32802 Carol L. Gregg, Esquire Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32301 Samuel Shorstein Secretary, Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32301
The Issue The primary issue in this case is whether the Petitioner should have been given a passing grade on the June 1983 Dental Mannequin examination. A secondary issue is whether the Petitioner should be permitted to take the regular State of Florida dental examination even if he is not entitled to a passing grade on the June 1983 Dental Mannequin examination.
Findings Of Fact On the basis of the testimony of the witnesses and the exhibits received into evidence at the hearing, I make the following findings of fact: The Petitioner, Dr. Angel N. Diaz-Norrman, is a graduate of a foreign dental school. Since his graduation from dental school he has engaged in three years of postgraduate training in the field of dentistry at the University of Miami and at the University of Florida. He has also completed all requirements for a teaching fellowship in the field of general dentistry. He is currently pursuing a program on postgraduate study in the specialty of periodontics at the University of Florida. His grade point average in his periodontic studies is 4.0 for both the didactic and the clinical portions of his studies. The Petitioner has twice taken the State of Florida Dental Mannequin Examination, once in December of 1982 and once in June of 1983. He was assigned a failing grade on both of those examinations. His December 1982 grade was slightly higher than his June 1983 grade. His June 1983 grade was 2.37. The minimum passing grade is 3.00. The State of Florida Dental Mannequin examination is a practical examination which tests several specified clinical skills. The examination consists of ten procedures, of which only nine are grades. Each of the nine graded procedures are graded separately. Each of the nine graded procedures on the examination is independently graded by three examiners. Each examiner assigns a grade of from 0 to 5 to the procedure and the final score for each procedure is determined by averaging the three grades given to that procedure. The final score on the entire examination is determined on the basis of a weighted average as provided in Rule 21G-2.19(1), Florida Administrative Code. 1/ The examiners who grade the State of Florida Dental Mannequin examination are all experienced Florida dentists who are selected by the Board of Dentistry. A person chosen as an examiner must have at least five years experience as a dentist. All persons who are selected to be examiners receive a full day of training in the examination process. They review the criteria by which each procedure is to be judged and they participate in a practice grading exercise. Proposed examiners who do not do a good job on the practice grading exercise are not selected as examiners, but are given other tasks at the examination such as serving as monitors. 2/ The application of the grading criteria is not a mathematically precise procedure. Although some shortcomings on the examination procedures require an automatic grade of 0, there is no mathematical formula for deducting any specific number of points or fractions of points for lesser shortcomings or deviations from an excellent procedure. Rather, the examiners use an holistic approach to the grading of each procedure. During the examination each examiner is required to record the grade assigned to each procedure on a written form. Whenever an examiner assigns a failing score to a procedure, the examiner is required to include on the grading form written comments sufficient to justify the failing grade. The written comments do not have to include everything the examiner thought was wrong with the procedure, but must include enough to justify the failing grade. An examiner is not required to justify a passing grade. When the Petitioner took the Dental Mannequin examination in June of 1983, the grades he received from each examiner on each graded procedure were as follows: Procedure Examiner Examiner Examiner Average No. No. 45 No. 48 No. 80 Grade 1. 1 0 0 0.33 2. 2 5 5 4.00 3. 1 3 3 2.33 4. 3 3 3 3.33 5. 2 1 3 2.00 6. 3 5 5 4.33 7. 1 2 3 2.00 8. 2 1 3 2.00 9. 1 1 1 1.00 8. The average grade given to the Petitioner for his performance on procedures number 1, 2, 5, 7, 8, and 9 was a fair and reasonable grade for his performance on each of those procedures. In other words, the average grades given to the Petitioner on those six procedures were fair and accurate measures of the skills demonstrated by the Petitioner on those procedures. The average grade given to Petitioner for procedure number 3 was higher than it should have been. The quality of the Petitioner's performance on procedure number 3 was such that he should have been given a grade of 1.00 instead of 2.33. The average grade given to Petitioner for procedure number 4 was lower than it should have been. The quality of the Petitioner's performance on procedure number 4 was such that he should have been given a grade of 4.00, instead of 3.33. The average grade given to Petitioner for procedure number 6 was lower than it should have been. The quality of the Petitioner's performance on procedure number 6 was such that he should have been given a grade of 5.00, instead of 4.33. With regard to procedure number 9, the Petitioner misunderstood the instructions and prepared a "wax-up" for a cast gold bridge of a type different than that required by the instructions. Between the time of the June 1983 examination and the time of the hearing the "wax-up" prepared by the Petitioner for procedure number 9 became partially damaged while in the custody of the Respondent.
Recommendation On the basis of all of the foregoing, I recommend that the Board of Dentistry issue a final order concluding that the Petitioner's grade on the June 1983 Dental Mannequin examination is 2.37, a failing grade, and that the Petitioner is not eligible to retake the Dental Mannequin examination or to take the regular dental license examination. DONE AND ENTERED this 4th day of April 1985 at Tallahassee, Florida. MICHAEL M. PARRISH Hearing Officer Division of Administrative Hearings The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 4th day of April, 1985.
