The Issue The issue in this case is whether Petitioner, Jennifer Lee Brown, D.M.D., should receive a passing grade on the December 1997 Florida dental licensure examination.
Findings Of Fact Petitioner, Jennifer Lee Brown, D.M.D., is a graduate from the University of Florida College of Dentistry. Respondent, the Department of Health (hereinafter referred to as the "Department"), is responsible for the licensure of dentists in the State of Florida. In December 1997 the Florida Department of Business and Professional Regulation, on behalf of the Department, administered the Florida dental licensure examination which persons wishing to practice dentistry in the State were required to pass. Dr. Brown took the December 1997 dental examination (hereinafter referred to as the "Examination"). The Examination consisted of clinical, Florida laws and rules, and oral diagnosis parts. The clinical portion of the Examination consisted of 8 procedures: procedures 1-3 and 5-9. Each procedure was graded by three separate examiners. The scores awarded by the three examiners on each procedure were averaged, resulting in a truer score. Each procedure had standardized "comments" concerning a candidate's performance on the procedure which examiners could note. Examiners were selected from individuals recommended by existing examiners or members of the Board of Dentistry (hereinafter referred to as the "Board"). Prospective examiners could not have any complaints against their license and they were required to have actively practiced dentistry and to be licensed as a dentist in Florida for a minimum of five years. Prospective examiners were required to file an application with the Board's examination committee. Prior to the Examination, a "standardization" session was conducted for the examiners selected. During the session, examiners were trained how to grade the Examination using the same internal criteria. The standardization session was conducted by assistant examiner supervisors appointed by the Board. After completion of the standardization session, and before the Examination, examiners were required to grade five mannequin models in order to evaluate the examiners' understanding of the grading criteria. Each examiner's performance was evaluated to determine whether the examiner should be used during the Examination. The examiners who graded Dr. Brown's clinical part of the Examination were designated as Examiners 168, 176, 195, 207, 264, 290, 298, and 299. All of these examiners completed the standardization session and the post-standardization evaluation. During the clinical part of the Examination, the examiners were required to grade each procedure independently, without conferring with each other. The clinical part of the Examination was "double blind" graded. Examiners did not see the candidates they were grading or watch their work. The test procedures were performed in a clinic in the presence of a licensed dentist. After the procedure was completed, the patient or tooth was taken to another clinic where the examiners reviewed the work performed on the patient and graded the procedure. The examiners had no direct contact with any candidate. Candidates were permitted to use "monitor-to-examiner" notes to convey information to the examiners that a candidate wanted the examiners to take into consideration when grading a procedure. Any such notes were read by the examiners and initialed "SMN" (saw monitor note) before they actually looked at the patient or tooth. For the clinical part of the Examination the following grading system was used: Zero: complete failure; One: unacceptable; Two: below minimally acceptable. Three: minimally acceptable. Four: better than minimally acceptable. Five: outstanding. After the Examination was graded, all examiners underwent a post-examination evaluation. Grades awarded by each examiner were compared to other examiners for consistency. All of the examiners who graded Dr. Brown's clinical part of the Examination were found to have performed acceptably. Dr. Brown was subsequently informed that she had failed to obtain the minimum passing grade of 3.00 for the clinical part of the Examination. Dr. Brown was informed that she had been awarded a score of 2.67. Dr. Brown was also informed that she passed the other two parts of the Examination. Dr. Brown challenged the scores she had been awarded on the clinical part of the Examination for procedures 2, 5, 6, 7, 8, and 9. The procedures challenged were graded by examiners 176 (graded all the challenged procedures), 195 (graded procedures 5- 9), 207 (graded procedure 2), 298 (graded procedure 2), and 299 (graded procedures 5-9). The Department conceded that the scores awarded Dr. Brown on procedures 7 and 8 were incorrect. As a result, the Department agreed that Dr. Brown's overall score for the clinical part of the Examination should be raised to 2.82. The evidence failed to prove that Dr. Brown should have received a higher score on procedures 7 and 8. Procedure 2 consisted of an amalgam (filling)n preparation on a human patient. Dr. Brown was required to select a tooth and, after the selected tooth was checked by an examiner, complete preparation for the amalgam. Dr. Brown wrote three monitor-to-examiner notes during procedure 2. All three examiners wrote "SMN" on all three notes. Dr. Brown received an average score on procedure 2 of 3.66. Dr. Brown was awarded the following individual scores for her performance on procedure 2: Examiner Score 176 4 207 4 298 3 Examiners 176 and 298 noted the following comment concerning Dr. Brown's performance on procedure 2: "Depth Prep." Examiner 298 also noted the following comment: "Marginal Finish." Examiner 207 noted the following comment: "Retention Form." Dr. Brown admitted that her performance on procedure 2 was not ideal, but expressed concern that she was graded down for matters dealt with in the monitor-to-examiner notes. Dr. Shields opined that it was possible for the examiners to have reduced the score awarded to Dr. Brown on procedure for depth preparation, marginal finish, and retention form and not have graded her down for the monitor-to-examiner notes. The evidence failed to prove that Dr. Shields' opinion was not reasonable or accurate. The evidence failed to prove that Dr. Brown should have received a higher score for procedure 2 of the clinical part of the Examination. Dr. Brown received a fairly consistent score from all three graders. Procedure 5 was a "class IV composite restoration." This procedure involved the selection of a tooth by Dr. Brown which she was then required to make a slice cut on to replicate a fracture. Dr. Brown was then required to restore the simulated fractured tooth to its normal contour and function. The procedure was performed on a mannequin. Dr. Brown received an average score of 1.66 on procedure 5. Dr. Brown was awarded the following individual scores for her performance on procedure 5: Examiner Score 176 3 195 0 299 2 Examiners 176 and 195 noted the following comment concerning Dr. Brown's performance on procedure 5: "Proximal Contour." Examiners 176 and 299 noted the following comment concerning Dr. Brown's performance on procedure 5: "Margin." Finally, the following additional comments were noted by the examiners: Examiner Comment: 195 Functional Anatomy Mutilation of Adjacent Teeth 289 Gingival Overhang Dr. Brown's challenge to her score for procedure 5 was essentially that Examiner 199 had given her such a low score on this procedure and procedures 7 through 9 when compared to the scores awarded by Examiners 176 and 298. Dr. Shields opined that Dr. Brown should not have received a higher score for her performance on procedure 5. Dr. Shields' opinion was based generally upon his 21 years of experience as a dentist. More specifically, Dr. Shields based his opinion upon his examination of the actual tooth that Dr. Brown performed procedure 5 on. Dr. Shields found excess material left at the gingival or gum portion of the tooth. Dr. Shields also found that Dr. Brown attempted to polish the material off and had flattened some of the surface of the tooth. Apparently, based upon Examiner 195's comment notes, Examiner 195 was the only examiner to catch these deficiencies in Dr. Brown's performance on procedure 5. Dr. Shields also found slight damage on the mesial, the approximating surface of the lateral incisor, the tooth next to the tooth that was restored. The evidence failed to prove that Dr. Shields' opinions concerning Dr. Brown's performance on procedure 5 were not reasonable and accurate. The evidence failed to prove that Dr. Brown should have received a higher score for procedure 5 of the clinical part of the Examination. Procedure 6 required that Dr. Brown perform an Endodontic Evaluation of the Maxillary First Premolar. Dr. Brown was required to select an extracted tooth, a maxillary tricuspid, examine x-rays of the tooth, and then perform a root canal on the tooth. The tooth had two roots. The root canal involved creating an opening in the tooth and removing the pulpal tissue from the two nerve canals of the tooth (a debridement). The canals were to be shaped for an obturation or the filling of the canal. A final x-ray of the tooth was taken after the procedure was completed. Dr. Brown received an average score on procedure 6 of 1.00. Dr. Brown was awarded the following individual scores for her performance on procedure 6: Examiner Score 176 3 195 0 299 0 All three examiners noted the following comment for Dr. Brown's performance on procedure 6: "Proper Filling of Canal Spaces with Gutta Percha." Gutta Percha is the material that was used by Dr. Brown to fill the canal of the roots after she completed the debridement. Examiner 195 noted the following additional comment for Dr. Brown's performance on procedure 6: "Access Preparation." Examiner 299 noted the following additional comment: "Shaping of Canals." Dr. Brown's challenge to her score for procedure 6 was based in part on her concern that Examiners 199 and 299 had given her a score of 0 on this procedure while Examiner 176 had given her a score of 3. Dr. Brown admitted that she had caused the gutta percha to extrude through the apex of the canals. She argued, however, that gutta percha is reabsorbed by the patient. Therefore, Dr. Brown suggested that her performance was "clinically acceptable." Dr. Brown questioned how one examiner, Examiner 176, could conclude that her performance was in fact clinically acceptable, while the other two examiners concluded it was not. The difficulty with Dr. Brown's position with regard to procedure 6 is that she assumes that the only deficiency with her performance was the extrusion of gutta percha and that it was not a significant deficiency. The evidence failed to support this position. Dr. Shields opined that Dr. Brown should not have received a higher score for her performance on procedure 6. His opinion was based upon the fact that the extrusion of gutta percha was very significant on one of the canals: it extended a millimeter and a half. On the other canal it was a half of a millimeter. Filling the canal one half millimeter to a millimeter is considered ideal. The evidence failed to prove that Dr. Shields' opinion was not reasonable or accurate. During the standardization session, examiners were told that extrusion of gutta percha more than a half millimeter through the apex was to be considered an error of major consequence. Candidates who extruded guttal percha more than a half millimeter were not to receive a grade higher than one. In light of the instructions during the standardization session, it was more likely that Examiner 176 gave Dr. Brown too high of a score on procedure 6. The evidence failed to prove that Dr. Brown should have received a higher score for procedure 6 of the clinical part of the Examination. Procedure 9 was a pin amalgam final restoration. Although this procedure involved, in a lay person's terms, a filling, what exactly was involved in this procedure was not explained during the formal hearing. Dr. Brown received an average score on procedure 9 of 1.66. Dr. Brown was awarded the following individual scores for her performance on procedure 9: Examiner Score 176 4 195 0 299 1 All three examiners noted the following comment concerning Dr. Brown's performance on procedure 9: "Functional Anatomy." Examiners 195 and 299, who both graded Dr. Brown below minimal acceptability, also noted the following comments: "Proximal Contour," "Contract," and "Margin." Dr. Brown failed to present any evidence to support her claim that she should have received a higher score for procedure Dr. Brown simply questioned the fact that Examiner 195 had graded her low on all the clinical procedures. Dr. Shields opined that Dr. Brown should not receive a higher score on procedure 9. The evidence failed to prove that Dr. Shields' opinion was not reasonable or accurate. The evidence failed to prove that Dr. Brown should have received a higher score for procedure 9 of the clinical part of the Examination. Dr. Brown's challenge in this case was based largely on the fact that Examiner 195 had graded her performance on procedures 5, 6, and 9 as a zero, procedure 7 as a one, and procedure 8 as a two. Other than the fact that Examiner 195's scores were consistently low, the evidence failed to prove that Examiner 195 improperly graded Dr. Brown except as conceded by the Department on procedures 7 and 8. Comparing the scores awarded by Examiner 195 to Examiner 176 does raise some question as to why there was such a discrepancy in the two examiners' scores. When the scores on procedures 5, 6, and 9 of all three examiners are compared, however, Examiners 195 and 298 generally were consistently below acceptable, while Examiner 176's scores were generally higher on these three procedures: Examiner Procedure 5 Score Procedure 6 Score Procedure 9 Score 176 3 3 4 195 0 0 0 299 2 0 1 This simple mathematical comparison, however, is not sufficient to conclude that Examiner 195 scored too low or that Examiner 176 scored too high. Other than a simple comparison of the scores of the three examiners, the only evidence concerning whether Examiner 195 graded too low based upon the scores alone was presented by Ms. Carnes, an expert in psychometrics. Ms. Carnes opined that Examiner 195's performance was acceptable, except with regard to procedures 7 and 8. The evidence failed to refute Ms. Canres' opinion. Based upon the weight of the evidence, Dr. Brown's score for the clinical portion of the Examination, as adjusted by the Department during the final hearing of this case, was reasonable and accurate.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a Final Order be entered by the Department of Health, Board of Dentistry, dismissing Dr. Brown's challenge to the amended grade awarded for the clinical part of the December 1997 Dental Examination. DONE AND ENTERED this 14th day of September, 1998, in Tallahassee, Leon County, Florida. LARRY J. SARTIN Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 14th day of September, 1998. COPIES FURNISHED: Jennifer Brown Post Office Box 39 Starke, Florida 32091-0039 Anna Marie Williamson, Esquire Office of the General Counsel Department of Health Building 6, Room 102 1317 Winewood Boulevard Tallahassee, Florida 32399-0700 Angela T. Hall, Agency Clerk Department of Health 1317 Winewood Boulevard, Building 6 Tallahassee, Florida 32399-0700 William Buckhalt, Executive Director Department of Health 1940 North Monroe Street Tallahassee, Florida 32399-0792
The Issue Whether Respondent Tessler has violated Florida Statute Section 466.24(3)(a), (c) and (d) and is guilty of misconduct, malpractice, or willful negligence in the practice of dentistry. Whether Respondent is guilty of receiving compensation because of a false claim intentionally submitted. Whether Respondent has failed to treat a patient according to acceptable dental standards and procedures.
Findings Of Fact Dr. Stephen W. Tessler, the Respondent, is a dentist licensed to practice dentistry under the laws of the State of Florida, Chapter 466, Florida Statutes, engaged in the practice of dentistry in his office located at 1245 NW 190th Street, North Miami, Florida. The Petitioner, State Board of Dentistry, filed an administrative accusation against Respondent Tessler, which was sworn to and subscribed in July, 1978. The accusation contained two counts, and the Respondent requested an administrative hearing. The hearing was first scheduled for October 20, 1978, but was continued upon motion of the Petitioner to January 10, 1979, and rescheduled upon motion of the Respondent to March 8, 1979. During the months of January, 1977, through mid-June, 1977, Ms. Rachel Dixon was a dental patient of Respondent Tessler. Ms. Dixon is a 32-year-old woman with a history of severe tooth and gum problems. She had prosthetic appliances and six (6) anterior crowns placed in her mouth ten (10) to fifteen (15) years ago in Pennsylvania. She had engaged a dentist, a Dr. Snyder in Hollywood, Florida, but had not seen him for some two (2) years prior to making an appointment with the Respondent for relief from pain and gum irritation, and for cosmetic improvement. Ms. Dixon is an unhappy dental patient with an inordinate fear of dentists, and her home dental hygiene care is inadequate. At the time Ms. Dixon engaged Respondent Tessler, she was in need of dental treatment for full-mouth gross peridontal inflammation and infected root canals in tooth number 30. She employed the Respondent for the purpose of providing dental treatment for peridontal disease, endodonic care of tooth number 30, recapping to the anterior teeth, and restoration of an upper right bridge on teeth number 3, 4 and 5. Ms. Dixon was referred to Dr. Hirschfield, an orthodontist in Respondent's office, for x-rays. Costs were discussed, a payment made, and a schedule of appointments planned. Thereafter, Ms. Dixon kept numerous scheduled and unscheduled appointments with the Respondent. Respondent Tessler replaced existing crowns on six (6) anterior teeth (number 6, 7, 8, 9, 10 and 11) with six (6) anterior foil porcelain jackets. In the presence of peridontal disease, Respondent attempted to replace an upper right bridge on teeth number 3, 4 and 5. Respondent was dissatisfied with the "final restoration" but used it instead of making a temporary one. He placed it in Ms. Dixon's mouth because it was better than a temporary restoration. Respondent had told Ms. Dixon that he would satisfy her and would redo the temporary restoration on her front teeth. He did the restoration a second time. Initially, Ms. Dixon was pleased, but later she was not satisfied because she felt pain upon contact with food, drink, or air that was either hot or cold. At the time of hearing no further work had been done in this area of her mouth, and she still complained of pain. On the second or third visit, within two (2) weeks of Ms. Dixon's initial visit, Respondent treated tooth number 30 by performing three (3) root canal treatments. After a number of weeks, Ms. Dixon continued to experience pain in this tooth. Respondent treated tooth number 30 again, reopening two (2) root canals to permit drainage and prescribing an antibiotic. During the course of the endodonic treatment on tooth number 30 an existing lower right bridge on teeth number 28, 29, 30 and 31 was damaged. Ms. Dixon did not return to Respondent for treatment, although she was in pain and attempted for two (2) or three (3) days to reach Respondent by telephone calls to his office. Thereafter, a week or ten (10) days later, Ms. Dixon sought the services of Dr. Marvin Levinson. She indicated to Dr. Levinson that she was not going to return to Respondent Tessler, that she suffered from pain, and that she was concerned about her appearance. Dr. Levinson examined her and referred her to Dr. Satovsky, an endodontist, for immediate relief of pain for a dental abscess, and to Dr. Garfinkle, a peridontist, for a complete peridontal work-up. It was Dr. Garfinkle's opinion that the caps placed by Respondent Tessler in the mouth of Ms. Dixon were placed in the presence of peridontal disease or that the caps caused the disease. He could not determine which came first. Dr. Garfinkle stated that Ms. Dixon was prone to peridontal disease and that she was an unhappy dental patient. Dr. Garfinkle could not comment on the condition of Ms. Dixon's mouth at the time of the treatment given by Respondent, inasmuch as he had not seen her until some eight (8) months had passed. Dr. Satovsky stated that on tooth number 30, which he treated subsequent to the root canal treatment done by Respondent Tessler, the canals were inadequately cleaned and enlarged. He stated that there were three (3) canals on the tooth, two (2) of which had the rods removed, and that he removed the third. He retreated the three (3) canals and alleviated the pain of Ms. Dixon. Dr. Satovsky could not state whether he thought the work of Respondent was negligent, inasmuch as he could not state what the tooth looked like when Respondent first saw it. Dr. Marshall Brothers, the Secretary/Treasurer of the State Board of Dentistry, found that the permanent type of restoration was adequate but not good for a temporary restoration. Upon his examination of Ms. Dixon's mouth, he found her general peridontal condition to be poor. Dr. Brothers could not determine whether her condition was a result of the restoration or existed prior to the restoration. He assumed the condition to be the one or the other because of the recency of the restoration. Respondent Tessler is a licensed dentist and a general practitioner, and is licensed to perform the dental work involved in this case. His charges for this work were substantial, but there was no evidence submitted that said charges were excessive or that Ms. Dixon misunderstood them. Alternative methods of treatment were discussed. The testimony and the evidence in this case show that Respondent worked within his ability as an average dentist. There was no showing of willful negligence, although Respondent's judgment may have been poor, and probably he should have referred Ms. Dixon to specialists. Affixing a bridge and crown work in the presence of gum disease is not the acceptable standard of care within the dental profession, and Respondent admits to that fact; however, he felt that it would improve the overall condition, and he had not released Ms. Dixon as a patient. Ms. Dixon was not pleased with Respondent's work or his charges ad, after attempting to make an appointment, left Respondent Tessler for another dentist. Ms. Dixon was insured through her husband's employer by a policy issued by Aetna Casualty and Surety Company. On January 31, 1977, Respondent Tessler submitted a pre-treatment estimate for work to be done consisting of porcelain-to-gold restorations on anterior teeth number 7, 8, 9, 10 and 11, and for a fixed bridge on teeth number 28, 29, 30 and 31, plus additional treatment in the amount of $2,420.00. The insurance company refused to pay for all treatment except for the fixed bridge on teeth number 28 through 31. On April 27, 1977, Respondent submitted the customary insurance treatment form to Aetna certifying that the bridgework had been performed and completed on April 27, 1977. Based on Respondent's representation, Aetna paid Respondent $649.50. The bridgework had in fact not been done, nor were the anterior crowns porcelain-to-gold restorations. Approximately one year later, Respondent refunded the overage to Aetna upon the request of the insurance company. Both parties submitted proposed findings of fact and memoranda of law, and Respondent submitted a proposed order. These instruments were considered in the writing of this Order. To the extent the proposed findings of fact have not been adopted in, or are inconsistent with, factual findings in this Order, they have been specifically rejected as being irrelevant or not having boon supported by the evidence.
Recommendation Based upon the violation as established, it is recommended that the license of Stephen W. Tessler, D.D.S., be suspended for a period of time not exceeding one year from the date of the Final Order. DONE and ORDERED this 12th day of June, 1979, in Tallahassee, Leon County, Florida. DELPHENE C. STRICKLAND Hearing Officer Division of Administrative Hearings Room 101, Collins Building Tallahassee, Florida 32301 (904) 488-9675 COPIES FURNISHED: L. Haldane Taylor, Esquire 2516 Gulf Life Tower Jacksonville, Florida 32207 Stephen Mechanic, Esquire Suite 200 1125 NE 125th Street North Miami, Florida 33161
The Issue Whether Respondent violated Sections 466.028(1)(j), (l), (m), (n), (u), and (y), Florida Statutes (1988 Supp.), and if so, what penalty should be imposed.
Findings Of Fact Petitioner, Agency for Health Care Administration (Agency), is the state agency charged with regulating the practice of dentistry pursuant to Section 20.165 and Chapters 455 and 466, Florida Statutes. Respondent, Michael Freedman (Dr. Freedman), is and has been at all times material to this proceeding a licensed dentist in the state of Florida, having been issued license number DN0010221. From June, 1988 through February, 1989, Dr. Freedman billed Medicare and received compensation for dental treatment of three elderly patients, L.S., E.K., and K.K., who resided in a nursing home, Meadowbrook Manor of Boca Cove (Meadowbrook). Patient L.S. At all material times to this proceeding, L.S. was a 93- year-old female who suffered from Alzheimer's disease. At the time of Dr. Freedman's treatment of L.S., Ms. Aurelia DaPra acted as L.S.'s legal guardian. She was also L.S.'s close personal friend and visited L.S. on a daily basis. During these visits Ms. DaPra would attend to L.S.'s personal needs. On or about July 7, 1988, patient L.S. was presented to Dr. Freedman for a consultation at the nursing home where L.S. resided. Dr. Freedman's examination revealed edentulism and/or prosthetic related problems. His recommendations included further diagnostic investigations, surgical procedures, and rehabilitative measures. Dr. Freedman billed $173.00 and was subsequently paid $107.84 by Medicare for services rendered. The "Next Patient Appointment/Service Record" contained in Dr. Freedman's records indicate that dental X-rays were taken of L.S. on July 25, 1988. On July 25, 1988, Dr. Freedman billed $70.00 and was subsequently paid $34.88 by Medicare for office services for L.S. On August 8, 1988, Dr. Freedman gave telephone orders to the staff at Meadowbrook to premedicate L.S. prior to Dr. Freedman's visit on the next day. On August 9, 1988, Dr. Freedman visited L.S. Other than rendering an X-ray report, the records do not indicate any other service performed by Dr. Freedman on that date. On August 9, 1988, Dr. Freedman billed $225.00 and was subsequently paid $108.80 by Medicare for X-rays and supplies for L.S. The Medicare category under which supplies are billed is entitled "supplies/prosthesis." Dr. Freedman's customary practice was to make the X-rays at the nursing home using a mobile X-ray machine and to develop the films in his office the next day. He rendered an X-ray report on the dental X-rays of L.S. on August 9, 1988. On August 17, 1988, Dr. Freedman visited L.S. and did a behavior adjustment evaluation. Premedication was given to L.S. on site. On August 17, 1988, Dr. Freedman billed $70.00 and was subsequently paid $34.88 by Medicare for office services for L.S. On August 26, 1988, Dr. Freedman billed $70.00 and was subsequently paid $34.88 by Medicare for office services for L.S. The dental records of L.S. do not indicate that any service was provided to L.S. on August 26, 1988. Based on the unrebutted evidence presented at the final hearing, no services were provided to L.S. by Dr. Freedman on August 26, 1988. Dr. Freedman billed $70.00 for office services on September 2, 1988, and was subsequently paid $34.88 by Medicare for such services. The records of Dr. Freedman include a draft letter to Dr. Janotta, L.S.'s physician, stating that L.S. needed to have intrabony lesions removed and would require premedication to facilitate the procedure. Notes in his records indicate that by September 18, 1988, Dr. Freedman had not heard from Dr. Janotta. Dr. Freedman billed $72.70 for supplies for L.S. on November 1, 1988, and was subsequently paid $43.88 by Medicare. On November 1, 1988, Dr. Freedman billed $374.00 and was subsequently paid $160.00 by Medicare for surgery on L.S. On November 1, 1988, Dr. Freedman performed a debridement procedure on L.S., which was surgical in nature and was not a routine cleaning of the teeth. Another behavior management evaluation was done on L.S. on November 1, 1988. On January 13, 1989, Dr. Freedman billed $133.00 and was subsequently paid $69.60 by Medicare for X-rays and supplies for L.S. Dr. Freedman's records did not indicate that any services were provided to L.S. on that date. Based on the unrebutted evidence presented at the final hearing, no services were provided to L.S. by Dr. Freedman on January 13, 1989. Dr. Janotta's progress notes concerning L.S. indicate that he was contacted by Dr. Freedman on February 5, 1989. On the same date, Dr. Janotta ordered that L.S.'s legal guardian be contacted to get L.S.'s private dentist to look at L.S.'s dental problems. After Ms. DaPra was informed that Dr. Janotta had left orders that L.S. should see a dentist, she told the nurse that she did not want Dr. Freedman to be used as the dentist. On January 26, 1989, Dr. Freedman's office called Dr. Janotta's office and stated that Dr. Freedman intended to do some minor dental work on L.S. and inquired whether the dental work should be done and whether L.S. should be premedicated. On February 10, 1989, Dr. Freedman billed $52.00 and was subsequently paid $22.72 by Medicare for office services for L.S. Dr. Freedman's records do not indicate that any services were performed for L.S. on that date. Based on the unrebutted evidence presented at the final hearing, no services were performed for L.S. by Dr. Freedman on February 10, 1989. On February 13, 1989, Dr. Hagquist, a dentist, did an oral exam of L.S. and concluded that several of her teeth needed to be extracted. On February 28, 1989, Dr. Hagquist extracted six of L.S.'s teeth. On December 13, 1990, L.S. was examined by Dr. Robert W. Williams, Petitioner's dental expert. Dr. Williams' examination revealed a completely mutilated dentition with serious carious breakdown and several teeth in poor repair. He further discovered gross calcus and debris present with chronic gingival irritation, inflammation, and periodontal breakdown. No evidence was presented as to what dental care L.S. received from February 14, 1989 to December 13, 1990. Patient E.K. At all times material to this proceeding, E.K. was an 84-year-old female who suffered from Alzheimer's disease. On June 6, 1988, patient E.K. was presented to Dr. Freedman for consultation at the nursing home where she resided. Dr. Freedman billed $173.00 and was subsequently paid $107.84 by Medicare for services rendered on June 6, 1988. On July 12, 1988, Dr. Freedman made dental X-rays of E.K. The dental records do not contain either the x-rays or a report on the findings of the x-rays. On July 12, 1988, Dr. Freedman billed $238.00 and was subsequently paid $134.08 by Medicare for X-rays and supplies for patient E.K. Dr. Freedman's records indicate that on August 9, 1988, Dr. Freedman gave some medication as part of a procedure performed on E.K. in the maxilla area. The records do not indicate exactly what the procedure was; however based on the testimony of Dr. Bayloff, Respondent's expert witness, the procedure was not a routine cleaning. On August 9, 1988, Dr. Freedman billed $33.75 and was subsequently paid $10.72 by Medicare for supplies for patient E.K. According to Dr. Freedman's "Tissue Repair/Debridement/ Treatment Report", on November 1, 1988, Dr. Freedman performed the following on E.K. in the mandible area: "brush", "dentifrice," and "dentition." No evidence was presented to establish whether this procedure would not qualify as surgery for purposes of payment from Medicare. On November 1, 1988, Dr. Freedman billed $33.75 and was subsequently paid $14.00 by Medicare for supplies for patient E.K. The procedure performed on November 1 did require the use of some supplies. On November 1, 1988, Dr. Freedman billed $200.00 and was subsequently paid $80.00 by Medicare for surgery on patient E.K. Patient K.K. K.K. is an 85-year-old male who has been described as mentally alert, physically impaired as to sight, and well aware of his surroundings. On June 13, 1988, patient K.K. was presented to Dr. Freedman for a consultation at the nursing home where K.K. resided. Dr. Freedman made a preliminary evaluation. Dr. Freedman billed $173.00 and was subsequently paid $107.84 by Medicare for consultation services rendered to K.K. on August 13, 1988. It appears that the date which appeared on the Medicare payment report was a scrivener's error and should have read June 13, 1988. On June 20, 1988, Dr. Freedman billed $70.00 and was subsequently paid $34.88 by Medicare for office services for K.K. This billing was for a trip by one of Dr. Freedman's staff to Meadowbrook to copy parts of K.K.'s records. On July 12, 1988, Dr. Freedman made dental X-rays of K.K. and rendered an X-ray report. On July 12, 1988, Dr. Freedman billed $283.00 and was subsequently paid $134.08 by Medicare for X-rays and supplies for patient K.K. On July 29, 1988, Dr. Freedman billed $70.00 and was subsequently paid $34.88 by Medicare for office services for patient K.K. Dr. Freedman's records indicate that his staff called Dr. McKay to inquire whether K.K. needed to have premedication prior to minor oral surgery and if so, what medication would be needed. MITIGATION Dr. Freedman had practiced dentistry at other nursing homes in the area and had not received any complaints concerning the services that he provided. Between 1985 and 1989, Dr. Freedman developed and maintained a practice exclusively limited to patients requiring special care. The majority of his patients resided in nursing homes or ACLF's and were frail and elderly. He was the Dental Director for 23 long-term care facilities and served 50 other facilities on a more limited basis. At any given time he was serving between 1000 to 2000 patients in a 150 mile area.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a Final Order be entered finding that Dr. Freedman did not violate Sections 466.028(1)(j)(l) and (u), Florida Statutes as alleged in Count I, finding that Dr. Freedman did violate Section 466.028(1)(m), Florida Statutes (1988 Supp.), in Count I as it related to the X-rays, dismissing Count II of the Administrative Complaint, dismissing the portions of Counts I and III alleging a violation of Section 466.028(1)(n), Florida Statutes (1988 Supp.), finding that Dr. Freedman did not violate Sections 466.028(1)(m) and (y), Florida Statutes (1988 Supp.), as alleged in Count III, finding that Dr. Freedman violated Section 466.028(1)(j) and (l), Florida Statutes (1988 Supp.), as alleged in Count III, imposing a $750 administrative fine and placing Dr. Freedman on probation for one year under the terms and conditions to be set forth by the Board of Dentistry. DONE AND ENTERED this 28th day of February, 1996, in Tallahassee, Leon County, Florida. SUSAN B. KIRKLAND Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 28th day of February, 1996. APPENDIX TO RECOMMENDED ORDER, CASE NO. 95-3391 To comply with the requirements of Section 120.59(2), Florida Statutes, the following rulings are made on the parties' proposed findings of fact: Petitioner's Proposed Findings of Fact. Paragraphs 1-10: Accepted. Paragraph 11: Accepted except as to a prosthesis. The evidence showed that the Medicare category was supplies/prosthesis. Dr. Freedman was billing for supplies not for a prosthesis. Paragraph 12: Accepted. Paragraph 13: Rejected as to the amount billed. The evidence showed that Dr. Freedman billed $70.00. The remainder is accepted. Paragraph 14: Rejected that he billed for supplies and prosthesis. The records indicate that he billed for office services. Paragraph 15: Rejected that Dr. Freedman billed for a prosthesis. The remainder is accepted. Paragraph 16: Accepted. Paragraphs 17-18: Rejected as subordinate to the facts found. Paragraph 19: Rejected as subordinate to the facts found. There was no evidence presented to link the blank X-ray with the X-rays that were taken on July 25, 1988. Paragraphs 20-21: Rejected as subordinate to the facts found. Paragraph 22: Rejected as to billing for a prosthesis. The remaining is accepted. Paragraph 23: Accepted in substance. Paragraph 24: Accepted. Paragraphs 25-26: Accepted in substance. Paragraph 27: Accepted. Paragraphs 28-30: Rejected as unnecessary. Paragraphs 31-32: Accepted in substance. Paragraph 33: Rejected as subordinate to the facts found. Paragraph 34: Accepted in substance. Paragraph 35: Rejected. The evidence does not support such an opinion. Paragraphs 36-38: Rejected as subordinate to the facts found. Paragraph 39: Rejected as not supported by the evidence. Paragraphs 40-41: Accepted. Paragraphs 42-43: Rejected as not established by clear and convincing evidence. Paragraph 44: Accepted. Paragraph 45: Rejected as unnecessary. Paragraphs 46-47: Accepted in substance. Paragraphs 48-50: Rejected as to the prosthesis. The remainder is accepted. Paragraph 51: Accepted. Paragraph 52: Rejected as subordinate to the facts found. Paragraph 53: Rejected. His conclusion is not supported by the evidence presented. Paragraph 54: Rejected as unnecessary and repetitious. Paragraph 55: Rejected as unnecessary. Paragraphs 56-57: Rejected as based on hearsay. Paragraph 58: Rejected as not supported by the evidence. Paragraphs 59-61: Rejected as not established by clear and convincing evidence. Paragraphs 62-66: Accepted. Paragraph 67: Rejected as to prosthesis. The remaining is accepted. Paragraph 68: Accepted. Paragraph 69: Rejected. The evidence established that K.K. was actually seen twice by Dr. Freedman. Paragraph 70: Rejected as not established by clear and convincing evidence. Respondent's Proposed Findings of Fact. Paragraph 1: The third sentence is rejected as unnecessary. The remaining sentences are rejected as constituting argument. Paragraph 2: The first sentence is accepted. The remaining sentences are rejected as subordinate to the facts found. Paragraphs 3-10: Rejected as subordinate to the facts found. Paragraph 11: The first sentence is rejected as constituting argument. The remaining is rejected as subordinate to the facts found. Paragraphs 12-13: Rejected as subordinate to the facts found. Paragraph 14: The first two sentences are rejected as constituting argument. The remaining is rejected as subordinate to the facts found. Paragraph 15: The third sentence is rejected as constituting argument. The remainder is rejected as subordinate to the facts found. There was no paragraph 16. Paragraph 17: Rejected as subordinate to the facts found. Paragraph 18: Rejected as constituting argument. Paragraph 19: The first sentence is rejected as constituting argument. The remainder is rejected as subordinate to the facts found. Paragraphs 20-22: Rejected as subordinate to the facts found. Paragraph 23: The first sentence is rejected as constituting argument. The last sentence is rejected as immaterial. Paragraph 24: The first two sentences and the last sentence are rejected as constituting argument. The remainder is rejected as subordinate to the facts found. Paragraph 25: The first and last sentences are rejected as constituting argument. Paragraph 26: Rejected as unnecessary. Paragraph 27: The first two sentences are rejected as unnecessary. The third sentence is accepted in substance. Sentences 4-13 and 42 are rejected as immaterial to the issues. Sentences 14, 29, 31, 38, and 40 are rejected as constituting argument. Sentence 15 is accepted in substance. Sentence 16 is rejected as not supported by the evidence presented. Sentences 17-28, 30, 32-37, 39, and 41 are rejected as subordinate to the facts found. Paragraph 28: Rejected as constituting argument. Paragraph 29(1): The first sentence is rejected as unnecessary. The second sentence is accepted. Sentences 3-8 are rejected as subordinate to the facts found that Dr. Williams was an expert. Sentence 9 is rejected as constituting argument. Sentences 10-13 and 15-18, are accepted in substance. Sentence 14 is rejected as subordinate to the facts found. The remaining sentences are rejected as constituting argument. Paragraph 29(2): Rejected as mere recitation of testimony. Paragraph 29(3): Sentences 1-11 are rejected as mere recitation of testimony. The remaining is rejected as constituting argument. Paragraph 30: Rejected as subordinate to the facts found and as constituting argument. Paragraph 31: Rejected as constituting argument. Paragraph 32: The last two sentences are rejected as constituting argument. The remainder is rejected as mere recitation of testimony and subordinate to the facts found. Paragraph 33: The first sentence is rejected as constituting argument. The remainder is rejected as subordinate to the facts found. Paragraph 34: Rejected as constituting argument. Paragraph 35: Sentences 1, 2 6, 7, 12, 13, 56 are rejected as unnecessary. Sentences 3-5, 10, 23, 24, 32, 35, 36, 37, 52, 55, 58 and 59 are rejected as subordinate to the facts found. Sentences 8, 9, 11, 28, 30, 51, 71, 72 are rejected as constituting argument. Sentences 14-22, 25-27, 29, 31, 33, 34, 39-50, 53, 54, 60-63 are accepted in substance. Sentence 38 is rejected as not supported by the evidence. Sentence 57 is not a complete sentence. Sentences 64-70 are rejected as irrelevant. Paragraph 29 (Keene pg. 15 of PRO): The first sentence is rejected as unnecessary. Sentence 2(1) is accepted in substance. Sentence 2(2) is rejected as based on hearsay. Sentence 2(3) is accepted in substance. Sentence 2(4) is rejected to the extent that the opinion was not supported by the evidence. Sentence 3 is rejected to the extent the opinion is not supported by the record. Paragraph 30 (pg. 15 PRO): Sentences 1-3, 5, and 6 are rejected as based on hearsay. Sentences 4 and 27 are rejected as constituting argument. Sentences 7-10, 15, 23, and 24,are accepted in substance. Sentences 11-13 and 16 are rejected as subordinate to the facts found. Sentences 14, 17, 41, 42, are rejected as unnecessary. Sentences 18-22, 28-40, and 43 are accepted in substance to the extent that X-rays were made. Sentences 25 and 26 are rejected as not credible given that Dr. Freedman was able to produce the records of the patients at issue. The testimony at the hearing dealt with his inablity to produce copies of the Medicare forms that he received from Medicare. Paragraph 31 (pg. 16 PRO): The first two sentences are rejected as subordinate to the facts found. The remaining is rejected as constituting argument. Paragraph 32 (pg. 17 PRO): Sentences 1-10 and 17-19 are rejected as irrelevant. The remaining is accepted in substance. Paragraph 33 (pg. 17 PRO): Rejected as subordinate to the facts found. Paragraph 34 (pg. 18 PRO): Sentences 1-10 are accepted in substance. The remainder is rejected as subordinate to the facts found. Paragraph 35 (pg. 18 PRO): The last three sentences are rejected as irrelevant. The remainder is accepted in substance to the extent that Dr. Bayloff was qualified as an expert witness. Paragraphs 36 (pg. 19 PRO): Rejected as irrelevant. Paragraph 37 (pg. 19 PRO): Sentences 1-2 are rejected as unnecessary. Sentences 3-7 are rejected as irrelevant. Sentences 8-10 are accepted in substance to the extent that L.S.'s file did contain adequate records. Sentences 11-14 are accepted to the extent that they apply to the records of L.S. and K.K. but not as to the records of E.K. as it relates to the X- rays. There were no X-rays or X-ray report in E.K.'s file. Paragraph 38 (pg. 19 PRO): Sentences 1-2 are accepted in substance as it pertains to L.S. Sentences 3-4 are rejected as irrelevant. Sentences 5-6 are accepted to the extent that the expert reviewed records which were present. There were no records for treatment of L.S. on August 26, 1988, January 13, 1989, and February 10, 1989. Dr. Bayloff did not render an opinion on whether services were provided on those dates. The remaining is rejected as constituting argument. COPIES FURNISHED: Natalie Duguid, Esquire Agency For Health Care Administration 1940 North Monroe Street Tallahassee, Florida 32399-0792 Michael Freedman 421 Lakeview Drive, Suite 201 Fort Lauderdale, Florida 33326 Dr. Marm Harris Executive Director Agency For Health Care Administration Board of Medicine 1940 North Monroe Street Tallahassee, Florida 32399-0770 Jerome W. Hoffman General Counsel Agency For Health Care Administration 2727 Mahan Drive Fort Knox Building 3, Suite 3431 Tallahassee, Florida 32308-5403
Findings Of Fact Dr. Roberts and His Background Dr. Steven Roberts is a dentist licensed to practice in the State of New York. He attended the United States Military Academy and received his undergraduate degree in 1970. He graduated from the New York University College of Dentistry in 1978, and practiced dentistry in New York, New York from 1978- 1987. To be licensed in New York, Dr. Roberts passed the national boards and the northeast regional board examination. During the course of his practice in New York, Dr. Roberts never received a complaint or had a claim for malpractice made or filed against him. Clinical Examinations Dr. Roberts took the Florida clinical dental examinations in June of 1986, January of 1987, and June of 1987. His grade on the June of 1987, examination is the subject of this proceeding. Dr. Roberts has successfully passed the written examination and the diagnostic examination required for licensure by Section 466.066(4)(a) and (c), Florida Statutes. Dr. Roberts' score for the June of 1987, clinical dental examination was 1.95; the minimum passing score is 3.00. The procedures tested during the June 1987, Clinical Dental Examination and Dr. Roberts' scores were as follows: The Procedure The Score The Revised Score Periodontal 1.67 Amalgam Cavity Preparation 1.67 Amalgam Cavity Restoration 3.00 Composite Preparation .67 Composite Restoration .33 Posterior Endodontics 2.00 3.66 Cast Preparation 2.67 3.00 Pin Amalgam Preparation 1.00 Pin Amalgam Restoration 1.67 Denture 3.63 Total Score 1.95 2.15 Dr. Roberts made a timely request to review his grade, and filed objections to his grades; a regrading procedure resulted in the regrading of his scores for posterior endodontics and cast restoration as set forth above. Each of the procedures tested in the clinical dental examination is scored by three different examiners. For each procedure examiners record their scores on separate 8 1/2" X 11" sheets. Each sheet has a matrix of circles which are blackened with a pencil so that they can be machine scored. On each sheet the candidate's identification number and the examiner's identification number are recorded along with the number for the procedure involved and the candidate's grade. On the sheet for each procedure the criteria for successful performance of the procedure are printed, along with preprinted comments which the examiners may use to explain the reason for the grade assigned. These comments relate to the criteria being examined. The following grades may be assigned by examiners: Complete failure Unacceptable dental procedure Below minimum acceptable dental procedure 3- Minimum acceptable dental procedure 4- Better than minimal acceptable dental procedure 5- Outstanding dental procedure An examiner is not required to mark a comment if the grade assigned is 5, a comment is marked for any grade below 5. Each procedure is graded in a holistic manner. Grades assigned by each of the three examiners for a procedure are averaged; the averaged scores for each procedure are then weighted and the weighted scores are summed to provide the overall clinical grade. By averaging the scores of three examiners for each procedure, variation from examiner to examiner is minimized. The examiners are experienced Florida dentists selected by the Board of Dentistry. An examiner must have at least five years of experience as a dentist and be an active practitioner. Potential examiners attend a standardization training exercise. This training is required by Section 466.006(4)(d), Florida Statutes. Its purpose is to instruct examiners in examination procedures and the criteria to be applied in grading. Through the training the examiner group as a whole arrives at a consensus opinion about the level of grading, so that candidates' scores on the examination will be valid and reliable. The training attempts to focus on each examiner's subjective, internalized evaluation criteria, so that they can be modified, as necessary, to reflect the consensus of all graders. A standardizer explains grading criteria to the potential examiners, and discusses various divisions among schools of thought and training on the procedures which will be the subject of the examination. The standardizer uses dental exhibits from prior dental exams as examples, and identifies grades and errors on the exhibits so that the graders learn and can adhere to uniform grading standards. The training focuses on three problems which professional literature has identified in evaluation: errors of central tendency, proximity errors, and bias a priori. Errors of central tendency result when graders are uncertain of criteria, hesitate to give extreme judgments, even in appropriate cases, and thus tend to improperly grade near the average. Proximity error is a type of halo effect which is applicable in grading of mannequin exhibits. The examiner grades all of the mannequin exhibits for each candidate at one time. If the first example of the candidate's work is especially good, and deserves a grade of 5, the grader may tend to transfer a generally positive attitude towards the next example of the candidate's work and assign a grade which may not be based solely upon the merits of that second piece of work. The same process can improperly depress the grades on subsequent mannequins if the first example of a candidate's work is poor. Bias a priori is the tendency to grade harshly or leniently based upon the examiner's knowledge of the use that will be made of the grade, rather than only on the quality of the work graded. After an 8 to 12 hour standardization training session, the Department administers an examination to those who have been trained. Those with the highest scores become the examiners, i.e., dentists who will grade candidates' work, while those with the lower scores in the training session become monitors, who supervise the candidates in their work on mannequins or on patients, but who do not actually grade student work. There is, however, no minimum score which a dentist who attends the standardization session must obtain in order to be an examiner rather than a monitor. This results, in part, from the limited pool of dentists who participate in the examination processes as monitors or examiners. For the 1987 clinical dental examination 31 dentists accepted selection by the Board and attended the standardization session, 20 were then selected as examiners and 11 became monitors for the examination. None of the dentists who attended the standardization session were dismissed by Department of Professional Regulation from further service at the examination session. The process by which the Department selected the examiners for the 1987 clinical dental exam was neither arbitrary nor capricious, but comports with Rule 21G- 2.020(4), Florida Administrative Code. The standardization training and examination of dentists to determine who will serve as examiners and monitors does not provide any bright line for distinguishing among potential examiners those who will make the most assiduous effort to apply the grading criteria explained in the training session versus those who retain an innate sense of a passing work based on what the examiner considers acceptable work in his own practice. The effort to convey to examiners the standard of "minimum competency" has imperfect success, but the Department's training is appropriate. Out-of-State Candidates' Scores 11. There is a substantial difference in the failure rates for out-of- state candidates and for in-state candidates on the clinical dental examinations. In the June of 1987, exam 82.5% of the candidates who graduated from the only in-state dental school, the University of Florida, passed the entire examination, while 54.2% of the out-of-state graduates passed, and only 37.8% of candidates from foreign schools were successful. Overall, 86.5% of the candidates passed the written portion of the examination, 93.5% the portion on oral diagnosis, but only 63.3% the clinical portion of the examination. Dr. Roberts has failed to prove that the lower pass rate for out-of- state candidates is the result of any sort of conscious effort on the part of examiners to be more stringent in grading out-of- state candidates. Dr. Kennedy's testimony indicated only that the data bear more analysis, not that they prove improper grading. Procedures Performed on Mannequins The Board of Dentistry tests between 600 and 700 dental candidates per year. It is extremely difficult for the candidates to find patients who have exactly the problem which is to be tested and bring them to the examination to work on. Some portions of the clinical dental examination, therefore, are not performed on patients, but on cast models of human teeth which resemble dentures, and which are known as mannequins. This is expressly authorized by Section 466.006(4)(a), Florida Statutes. The notice to appear which candidates receive approximately 30 days before the examination informs them of the types of mannequins which will be used in the examination. Before that time, however, dental supply companies obtain lists of those eligible to take the examination, and contact the candidates in an attempt to sell them the mannequins. Candidates must bring mannequins with them to the examination and can purchase additional mannequins for practice. Testing with mannequins is also more efficient because with live patients, the student must be graded at the time of the examination, while a model can be retained and graded a day or two later. The decision of the Board to have certain procedures performed on mannequins, so that each candidate would be graded on exactly the same procedure, is reasonable. The Board had also considered having students perform all test procedures on extracted human teeth, but there are not a sufficient number of all natural teeth available, given the number of students who are tested, both for the examination itself and for practice. The Board determined that it would be better to use mannequins for some of the procedures tested in the examination because they are readily available and students can purchase extra copies for practice. For certain procedures, such as endodontics, specific natural teeth (such as first bicuspids) are often extracted and so are generally available; for procedures performed on those teeth, it is possible to have candidates work on human teeth. By contrast, testing procedures performed on teeth such as incisors is not practicable. It is impossible to obtain enough incisors in good condition, without restorations and chips, for use during an examination. The statute governing the dental examination does require that one restoration performed by candidates must be done on a live patient, and for the June 1987, clinical dental examination that procedure was a class 2 amalgam restoration. The Board directed by rule that mannequins be utilized for five test procedures: the pin amalgam preparation and restoration, Rule 21G-2.013(3)(d), Florida Administrative Code; the endodontic procedure, Rule 21G-2.013(3)(e) Florida Administrative Code; the posterior tooth preparation for a cast restoration, Rule 21G-013(3)(f), Florida Administrative Code, the class III acid etch composite preparation and class IV acid etch composite restoration, Rule 21G-2.013(3)(g), Florida Administrative Code. Performing these procedures on mannequins is not exactly the same as performing procedures on human teeth in a patient. In view of the difficulty involved in finding patients whose teeth present virgin lesions, so that each candidate would be tested on exactly the same problem, the difficulty in grading a large number of procedures performed on live patients, and the difficulty in obtaining a large number of human teeth necessary for testing and for practice, the Board's decision to use the mannequins for these procedures is reasonable. The Legislature recognized this in Section 466.006(4)(b), Florida Statutes, which prescribes that the clinical dental examination shall include restorations "performed on mannequins, live patients, or both. At least one restoration shall be on a live patient." The Board was within its authority when it determined the procedures to be performed on mannequins. Violation of Blind Grading The dental examiners who grade the work of candidates grade blindly, i.e., they do not know which candidate's work they are grading. The Clinical Monitor and Examiner Instruction Manual for the June of 1987, examination makes this clear. At page 24 paragraph 3 the Manual states Examiners are requested to disqualify themselves at anytime they are presented with models or patients treated by a dentist who they know personally or with whom they have had professional contact. All examiners are requested to give department staff the name of any examination candidate who is personally known to them to be taking the exam. The department staff will assist the examiners in avoiding any work performed by the candidates they know. Rationale: Allegations have been made about examiners who knew candidates taking the exam even though the examiners only see candidate numbers. Monitors and Examiners are strongly urged to avoid discussion with candidates about the examination. Even conversation about non-examination related matters can be misinterpreted by other candidates as an unfair privileged communication. Despite this admonition, one of the examiners, Dr. Cohen, who knew Dr. Roberts, graded the work of Dr. Roberts. Dr. Cohen met Dr. Roberts the first time Dr. Roberts took the Florida Clinical Dental Examination in June of 1986. Dr. Roberts had with him a bag which would have identified him as a student from New York University, where Dr. Cohen had taught. Dr. Cohen came over to Dr. Roberts, introduced himself, gave Dr. Roberts his card, (exhibit 44) and invited Dr. Cohen to his hotel room where they discussed practicing dentistry in Florida. In 1986 Dr. Cohen was associated with another dentist, Gerald P. Gultz, who had recently moved to Florida from New York. Dr. Gultz had also been a part-time clinical assistant professor of dentistry at New York University College of Dentistry. After Dr. Cohen returned from the June 1986, administration of the clinical dental examination, he had a conversation with Dr. Gultz in which Dr. Cohen asked Gultz if he knew Dr. Roberts, and commented on Dr. Roberts performance on the clinical examination. Dr. Cohen said Dr. Roberts had done terribly, and Dr. Cohen believed that Dr. Roberts would never get his license to practice in Florida. (Tr. 5/26/88 at 73). Dr. Roberts saw Dr. Cohen at the January of 1987, clinical dental examination, but they did not speak. In June of 1987, Dr. Cohen also spoke briefly to the wife of Dr. Gerald Gultz, Lauren Gultz, saying that he would be seeing Dr. Roberts at the June of 1987, clinical dental examination, which was coming up. He told Mrs. Gultz that Dr. Roberts was a poor practitioner, and that he did not think he would pass the examination. At the June 1987, exam, Dr. Roberts' periodontal patient was his uncle, Mr. Finkelstein. Dr. Cohen was one of the examiners who reviewed Mr. Finkelstein to determine whether his condition was appropriate to serve as a patient for Dr. Roberts on the periodontal portion of the examination. Dr. Cohen had a conversation with Mr. Finkelstein in which he told him "tell your dentist to do a good job". Because Mr. Finkelstein had stated that his dentist was a graduate from N. Y. U. Dental School, Mr. Finkelstein was convinced that Dr. Cohen knew exactly who the dental candidate who would work on Dr. Finkelstein was -- Dr. Roberts. After accepting Mr. Finkelstein as an appropriate periodontal patient, Dr. Cohen also served as a grader on the periodontal procedure performed on Mr. Finkelstein. After grading the work which Dr. Roberts had done, Dr. Cohen told Mr. Finkelstein to tell his dentist that Dr. Cohen would see him later in the hotel where they were staying. At the hotel, Dr. Cohen talked to Dr. Roberts about the dental examination, that he himself had to take the examination three times, although he considered himself to be a superior dentist, and that Dr. Cohen could help Dr. Roberts with his grades but that he could never grade Dr. Roberts more that one grade higher than any of the other examiners. Dr. Cohen served as an examiner (i.e. grader) for Dr. Roberts on six of the nine procedures tested. There were: procedure number 1, the periodontal evaluation where he assigned a failing grade of 2; procedure number 4, the class III composite preparation, where he assigned a failing grade of 1; procedure number 5, the class IV composite restoration, where he assigned a failing grade of 1; procedure number 6, the endodontic evaluation, where he assigned a passing grade of 3; procedure number 7, the preparation for a cast restoration, where he assigned a passing grade of 3; and procedure number 8, the pin amalgam preparation, where he assigned a failing grade of 1. This failure of blind grading is a serious irregularity in the evaluation of Dr. Roberts' performance on the 1987 clinical dental examination, given his prior negative comments about Dr. Roberts before the examination. By ignoring those scores, Dr. Roberts would be evaluated only by two examiners, on all the procedures for which Dr. Cohen gave a grade. This would mean that his scores would not be comparable with those of any other candidate, for his grade on each procedure would not be the result of blind grading by three independent examiners. Dr. Roberts' Challenges to Grades Assigned by Other Examiners The full nine procedures evaluated in the 1987 dental clinical examination and Dr. Roberts' grades were: A periodontal exercise performed on a live patient, Mr. Finkelstein, which involved the scaling of five teeth both above and below the gum and stain removal. Dr. Roberts was assigned scores of 1, 2, and 2 by the examiners (one grade of 2 was assigned by Dr. Cohen) An amalgam cavity preparation, performed on a live patient, Elizabeth Cox, which is the preparation of a tooth for filling. When the preparation is completed a proctor escorts the patient to the three examiners who independently grade this part. After grading, the patient returns to the candidate who completes the filling of the tooth (the restoration) which is subsequently graded independently by three examiners. Dr. Roberts was assigned grades of 1, 1, and 3 for the preparation (none of these grades were assigned by Dr. Cohen). A final amalgam restoration, which is the filling of the tooth prepared in the prior procedure. Dr. Roberts received grades of 3, 3, and 3 on this procedure (none of the grades were assigned by Dr. Cohen). A class III composite preparation, which is preformed on a model, not a live patient. This involves removing decay and shaping a tooth to hold a class III filling, i.e., one located on the side surface of an incisor. Dr. Roberts received scores of 1, 0, and 1 (Dr. Cohen assigned one of the grades of 1) A class IV composite restoration, which is performed on a model, not a live patient. This involves restoring a fractured tooth with a composite restoration material. On this procedure Dr. Roberts received scores of 0, 0, and 1 (Dr. Cohen assigned the grade of 1). An endodontic evaluation performed on a posterior tooth, which is performed on a mannequin, and involves the opening of a molar, and identification of the canals in the tooth in preparation for a root canal procedure. Originally Dr. Roberts received grades of 3, 3, and 0 (one of the grades of 3 was assigned by Dr. Cohen). Dr. Roberts work was regraded by three new examiners and the grades of the original examiners were discarded. Dr. Roberts ultimately received a grade of 3.67 on the endodontic portion of the examination A preparation of a posterior tooth for a cast restoration, which is performed on a mannequin. It involves preparing a tooth to receive a crown. Dr. Roberts' original grades were 2, 3, and 3 (Dr. Cohen had assigned a grade of 3 on this procedure). On review, Dr. Roberts' was regraded by three new examiners, and the original grades were discarded. Dr. Roberts received a final grade of 3 on this portion of the examination. A pin amalgam preparation, which is performed on a model, not on a live patient. This involves the preparation of a tooth to hold an amalgam filling by inserting a pin into a portion of the tooth, which serves to anchor the filling. Dr. Roberts was assigned grades of 2, 0, and 1 on this procedure (Dr. Cohen assigned the grade of 1). Pin amalgam final restoration, which is performed on a model. It involves filling a tooth with amalgam filling material. Dr. Roberts was assigned grades of 2, 1, and 2 on this procedure (Dr. Cohen assigned one of the grades of 2). Due to the involvement of Dr. Cohen in so many of the procedures involved here, Dr. Roberts performance on the June of 1987, clinical dental examination was not fairly evaluated. A fair evaluation cannot be provided after the fact by merely dropping Dr. Cohen's grades, because Dr. Roberts' performance would not be subject to the independent evaluation of three examiners. Dr. Roberts relies, to a large extent, on the testimony of Dr. Gultz as the basis for regrading his procedures to a passing grade of 3, or better. The testimony of Dr. Gultz does not, however, show that he has ever participated in the standardization exercises for examiners at Florida clinical dental examinations. Dr. Gultz experience as a clinical professor of dentistry at New York University provides a substantial basis for his evaluation of dental procedures. The difficulty, however, is that as with any qualified examiner, his evaluations will be based on internalized standards which are personal to him. There is no way to know whether Dr. Gultz standards for adequate performance are equivalent to those which the standardization training produces among examiners at the standardization exercise before a clinical dental examination. The standardization process "attempts to bring all examiners to the same level of grading, so that each [examiner] is grading in a valid and reliable manner." Clinical Monitor and Examiner Instruction Manual, June of 1987, at page 42. The Florida dental clinical examination uses a holistic grading method. Each score sheet which an examiner fills out has on it the criteria to be applied in evaluating the candidates performance on that procedure. They all contain a statement which reads: It is the intent of the Board that each of the criteria are to be accorded equal importance in grading. Equal importance does not mean that each criteria has a numerical or point value, but means that any one of the criteria, if missed to a severe enough degree so as to render the completed procedure potentially useless or harmful to the patient in the judgment of the examiner, could result in a failing grade on the procedure. The criteria do not have any assigned numerical or point value, but are to be utilized in making a holistic evaluation of the procedure. Each grading sheet also points out to the examiner certain critical factors which, if present, require a grade of 0 for the procedure. The standardization in grading which the Board diligently attempts to achieve through the standardization training and the standardization testing of examiners done at the close of the training is elusive at best. Nonetheless, in the absence of showing that Dr. Gultz standards of evaluation are equivalent to those of an examiner trained at a standardization session, it is impossible to know whether his standards of evaluation are more rigorous or less rigorous than those reflected by the grades assigned to other candidates by the corps of examiners which evaluated the work of candidates at the June of 1987, clinical dental examination. The same is true with respect to the testimony of Dr. Simkins, the expert for the Board in this proceeding. No useful purpose would be served in attempting to choose between the testimony of Dr. Gultz, on the one hand, and the testimony of Dr. Simkins and of the other examiners who testified by deposition in this proceeding. If this were to be done, all the hearing officer would have determined is whose testimony about the appropriate grade to be assigned for each procedure is more believable. On this record it would be impossible to make a further finding about whether that more believable testimony reflects a scoring standard more stringent, less stringent or the same as that generally applied to all candidates by the corps of examiners in the June of 1987, clinical dental examination.
Recommendation It is recommended that the results of the clinical dental examination which Dr. Roberts took in June of 1987, be found invalid, and that he be permitted to take the next clinical dental examination offered by the Department of Professional Regulation at no cost to him. DONE AND ENTERED in Tallahassee, Leon County, Florida, this 8th day of December, 1989. WILLIAM R. DORSEY, JR. Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 8th day of December, 1989.
The Issue This is a license discipline case in which the Respondent has been charged in a Corrected Administrative Complaint with a violation of Section 466.028(1)(m), Florida Statutes.
Findings Of Fact At all times material to this proceeding, the Respondent, Dr. Merle N. Jacobs, has been licensed to practice dentistry in the State of Florida. He currently holds license number DN 0005940. During the period from January 22, 1993, through March 27, 1995, T. C. was a patient of the Respondent. During that period of time, the Respondent performed various dental services for T. C., including the making and fitting of a partial denture. The Respondent prepared and kept dental records and medical history records of his care of patient T. C. The Respondent's records of such care are sufficient to comply with all relevant statutory requirements. The Respondent's records of such care do not include any notations specifically identified or captioned as a treatment plan. The records do, however, include marginal notes of the course of treatment the Respondent intended to follow in his care of patient T. C. Those marginal notes describe the treatment the Respondent planned to provide to patient T. C.
Recommendation On the basis of all of the foregoing it is RECOMMENDED that a Final Order be issued in this case dismissing all charges against the Respondent. DONE AND ENTERED this day of May, 1998, in Tallahassee, Leon County, Florida. MICHAEL M. PARRISH Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this day of May, 1998.
The Issue The issue in this case is whether Petitioner should receive a passing score on the December 2001 dental license examination.
Findings Of Fact In December 2001, Petitioner took the dental licensure examination and failed to pass the clinical portion of the exam. The examination is a three-day process involving two days of clinical examination. Those two days of clinical examination consist of nine procedures. Four of the nine procedures were challenged by Petitioner. The clinical portion is where the candidate is required to perform certain patient procedures. The work product of the student, or candidate, is evaluated following the performance of those procedures by three examiners. Each examiner grades the candidate independently of whatever score the other examiners may award on a particular procedure. Then the average grade for each procedure is weighted in accordance with requirements of Rule 64B5-2.013, Florida Administrative Code. This produces the overall score for the entire clinical exam. The Department uses three examiners' scores because this provides a more reliable indication of the candidate's competency and true score. Further, each examiner must be a licensed dentist for a minimum of five years and have no complaints or disciplinary actions against their license. Examiners have no contact with the candidate taking the examination and, accordingly, have no idea of who they are grading. To further ensure fairness, each examiner must attend and successfully complete a standardization session. The purpose of these sessions is to ensure that each examiner is trained to use the same internal grading criteria. In standardization, each examiner is thoroughly taught specific grading criteria with the result that examiners are instructed on how to evaluate the work of the candidates. The examiners who graded Petitioner’s examination had successfully completed the foregoing standardization session. Also, the Department’s post-exam check found these examiners’ grading to be reliable. Petitioner contested the score he received on Procedure 4, the Endodontic procedure, a root canal. The Endodontic procedure required removal of infected nerve tissue and blood vessels pulp from the tooth. Petitioner was required to access the canal and pulp tissue from the outside. Then, Petitioner was required to remove the bad nerve and cleanse the canal. Finally, Petitioner was required to seal the canal to prevent recurring bacteria. Petitioner failed to observe a fracture in the tooth. He claimed that a fracture to the root of the tooth was caused by the Department after he reviewed his examination and that no one advised him the root was fractured. Petitioner requested a score of 3.00 for this procedure. However, the Department's witness, Dr. William F. Robinson, a licensed dentist for 32 years who examined the tooth and X-ray prepared by Petitioner, testified that the fracture to the root was noticed in both the X-ray and on the tooth when he examined the same. Additionally, two of the three re-graders also noted the fracture of the root. With regard to Petitioner's preparation of the X-ray at the conclusion of the examination, Dr. Robinson opined that Petitioner caused the fracture to the root during the examination and not the Department, as alleged by Petitioner. Dr. Robinson further opined that even without a fracture to the root of the tooth, Petitioner failed the procedure and the failing grade he received was fair. Dr. Robinson would not recommend that Petitioner receive a passing score of 3.00 on the procedure. The examiners' comments and grades and the testimony of Dr. William F. Robinson establish that Petitioner failed to properly perform this procedure. The grade Petitioner received was fair. Petitioner challenged the grade he received on Procedure 5, the Class IV Composite Restoration of the front tooth, but did not offer any testimony at the hearing as to why the score was not correct for the procedure. Petitioner requested that the score of 1.00 given by one of the examiners be thrown out, thus giving him a passing grade on this procedure. Procedure 5 of the dental licensure examination is a procedure that involves the candidate’s ability to replace the edge of the front tooth with a composite resin material, which is a tooth-colored filling. As established by the examiners’ comments and grades and the testimony of Dr. William F. Robinson, Petitioner failed to properly perform this procedure and the grade Petitioner received was fair. Specifically, the examiners found that the tooth was abraded and the re-grader noted, as did the examiners, the excessive “flash” on the tooth. Dr. Robinson also noted both deficiencies in the procedure. Petitioner contested the score he received on Procedure 6, the Class II Composite Restoration procedure in his original petition, but offered no testimony at the hearing concerning this procedure. Dr. Robinson reviewed the examiners' grades and the tooth prepared by Petitioner and opined that Petitioner’s grade of 2.66 for this procedure is fair. Based on the examiners’ comments and grades and the testimony of Dr. Robinson, Petitioner failed to properly perform this procedure and the grade Petitioner received was fair. Petitioner contested the score he received on Procedure 7, the preparation for a 3-unit Fixed Partial Denture, claiming that on the re-grade one of the examiners reviewed the wrong procedure. The Preparation for a 3-unit Fixed Partial Denture procedure of the dental licensure examination is a procedure that involves the candidate’s ability to provide preparations of two (2) teeth in order to replace a missing tooth with a fixed bridge. Dr. Robinson established that Petitioner’s work on this procedure resulted in one tooth, No. 29, being grossly over reduced and tooth No. 31 was insufficiently reduced. The result of such work is that it is impossible to place a bridge on such an improper preparation. As established by testimony of Dr. Robinson, Petitioner's problem with this procedure resulted from Petitioner’s undercut. This undercut indicated that Petitioner’s preparations were not properly aligned to accept a bridge. Based on the examiners’ comments and grades, and the testimony of Dr. Robinson, Petitioner failed to properly perform this procedure and the grade Petitioner received was fair. The Department's “re-grade” process was utilized in this case. Used to give all candidates who timely request a hearing another chance at passing, the re-grade process allows the Department to go back and determine whether any grades rendered were inconsistent. The Department selects the top three examiners who had the highest reliability from that examination to participate in the re-grade process. The Department maintains post-standardization statistics of the examiners’ performance. In this case, those statistics indicated that Petitioner’s examiners graded reliably. In addition, the Department calculates post- examination statistics for the examiners, which are as follows for the examiners who graded Petitioner’s challenged procedures: Examiner Accuracy Index & Rating #206 95.8-Excellent #375 98.8-Excellent #380 92.1-Good #334 97.8-Excellent #298 95.9-Excellent #375 98.8-Excellent-was an original and a re-grader. All of Petitioner's examiners exhibited a reliability significantly above the minimum acceptable accuracy index of 85.0.
Recommendation Based upon the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a Final Order be entered dismissing Petitioner's challenge to the grade assigned him for the December 2001 dental licensure examination. DONE AND ENTERED this 9th day of October, 2002, in Tallahassee, Leon County, Florida. DON W. DAVIS Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 9th day of October, 2002. COPIES FURNISHED: E. Renee Alsobrook, Esquire Department of Health 4052 Bald Cypress Way Bin A02 Tallahassee, Florida 32399-1703 Jason S. Baker, D.M.D. Westchester Medical Center 95 Grasslands Road, Box 572 Valhalla, New York 10595 R.S. Power, Agency Clerk Department of Health 4052 Bald Cypress Way Bin A02 Tallahassee, Florida 32399-1701 William W. Large, General Counsel Department of Health 4052 Bald Cypress Way Bin A02 Tallahassee, Florida 32399-1701
