Findings Of Fact Dr. Donald P. Austin freely, intelligently, and voluntarily admitted to violation of the provisions of Florida Statutes, 466.24(3)(e), and the Regulations of the Florida State Board of Dentistry, Chapter 21-G-9, Florida Administrative Code, by permitting Carmella Carney, an unlicensed person acting under his supervision and control, to perform work constituting the practice of dental hygiene, in that on Decumber 12, 1974 he permitted said Carmella Carney to remove calculus from the teeth of a patient, Barbara Dubrian. (TR 3-7) Similar Charges were filed against two licensed dentists who had practiced with Dr. Austin, and the proceedings were informally disposed of by the admissions of the dentists as to the accuracy of facts contained in the Accusation. Each dentist received a public reprimand in connection with those charges. The incident resulting in charges being filed against Dr. Austin was an isolated incident, and was the only occasion upon which Dr. Austin permitted any unlicensed person acting under his supervision to remove calculus from the teeth of a patient. (TR 9, 14, 15, 25). Dr. Austin's reputation among his colleagues for professional competence and integrity is excellent. (TR 23 - 25, 28, 29). The patient involved in this incident had very light calculus, only slightly heavier than heavy stains. Dr. Austin examined the work performed by Ms. Carney, and the teeth were clean. The patient did not complain about the work, and in fact, complemented Ms. Carney for it. Dr. Austin did not charge the patient for the work. (Th 9, 13-15).
Findings Of Fact Petitioner was an applicant for licensure by examination to practice dentistry in the State of Florida. The practical examination, which is the portion here contested, consisted of 11 procedures, each of which is graded separately by three examiners. Petitioner took the dental examination in December, 1983, and obtained a total overall grade of 2.93 (Exhibit 3). A grade of 3.0 is required to pass the examination. He is here contesting only procedures No. 01 in which he received grades from the three examiners of 3, 3, and 0 (Exhibit 1); and procedure No. 05 in which he received grades of 2, 3, and 0 from three different examiners. Examiners for the dental examination are all currently licensed dentists in the State of Florida who have been extensively trained and standardized by the Department of Professional Regulation. A standardization exercise takes place immediately prior to each examination during which the examiners grade identical procedures and discuss any grade variances to eliminate, as far as possible, any discrepancies in interpretation of the grading criteria. Examiners are selected based on their experience as examiners and their ability to grade without extremes of harshness or leniency. Candidates are informed of the grading criteria prior to the examination through the notice to appear (Exhibit 4) and the applicable laws and rules which are sent by the Office of Examiner Services to all candidates prior to the administration of the examination. In procedure No. 01 (Exhibit 1) one of the examiners found caries not removed in the preparation process, noted on the grade sheet where the caries was located, and gave a mandatory zero for this procedure. Although the other examiners did not see this caries, and gave grades of 3, it was in a difficult place to see and feel with the explorer. The examiner who found the caries submitted a note to the monitor (Exhibit 7) to have all decay removed before the tooth was filled and the monitor's notation on Exhibit 7 indicates this was done. In procedure No. 05 (Exhibit 2) which involved cleaning a specified number of teeth, one examiner found stain and root roughness and gave a grade of 2; a second examiner found root roughness and gave a grade of 3; while the third examiner found supra-gingival calculus, root roughness and subgingival calculus, and gave a grade of 0. One of the expert witnesses who testified was the examiner who graded Petitioner a failing grade of 2 on this procedure. Since he did not actually see subgingival calculus but saw stain and felt the rough tooth, he did not give a zero mark which he would have given had he also seen the subgingival calculus. The Notice to Appear (Exhibit 4) and the rules sent to the candidates are clear that all subgingival and supra-gingival foreign particles must be removed and a grade of zero is mandatory if the procedure is not completed, which would include removal of all calculus. The comments on the grade sheets support the grades awarded. Here, two of the three examiners gave Petitioner a failing grade on procedure No. 05 and the fact that only one of the examiners saw the subgingival calculus does not indicate this grade is erroneous. These grades were not very different but merely reflect different degrees of similar conditions as they were observed by the examiners.
The Issue Whether Petitioner should receive a passing grade on the clinical portion of the dentistry examination administered in December 1996.
Findings Of Fact In June 1996, Petitioner, Arthur A. Gage (Gage), took the dentistry examination for licensure as a dentist in Florida. He was unsuccessful on the clinical part. In December 1996, Gage retook the clinical portion of the examination. He was notified by an examination grade report, mailed on January 13, 1997, that he had again failed the clinical portion of the examination. He achieved a general average score of 2.75. A final grade of 3 or better as a general average on the clinical portion is a passing score. Gage complains that there was inconsistency among the examiners in grading the examination. In particular, he submits that if you average the grades by each examiner on the mannequin portion of the examination that the averages are 3.25, 3.08, and 1.08. Gage averaged all the grades for each examiner and did not average by procedure. Consequently, Gage's approach did not produce a statistically meaningful result. Marsha Carnes, a psychometrician with the Department of Business and Professional Regulation (DBPR), testified for the Respondent. A psychometrician is an expert in testing and measurement. Ms. Carnes' responsibility is to ensure the validity and reliability of the examinations, including the dentistry examination. Ms. Carnes outlined the procedure used for selecting the examiners and the grading of the dentistry examinations. The examiners are selected by the Florida Board of Dentistry (Board) and must have five years of experience as a licensed, active dentist in Florida. The examiner must be recommended by a current examiner or member of the Board. Examiners must submit an application and have no complaints against their dentistry license. After the examiners are selected, they are trained by DBPR. Approximately one month prior to the dentistry examination, the examiners are sent the details of the examination, the clinic monitor, and an examiner instruction package. The examiner package outlines the grading criteria, the procedures for the examination, and the necessary paper work. The day before the examination, the examiners go through a standardization process conducted by the psychometrician and three assistant examiner supervisors from DBPR. The process takes approximately eight hours. There are nine clinical procedures in the dentistry examination. Three of the procedures are performed on a patient, five on a mannequin, and one is written. As part of the standardization process, the assistant examiner supervisors outline the criteria for each procedure that is on the examination and explain what is and is not minimally acceptable. The examiners are shown slides, and the supervisors explain what grade should be awarded for each procedure shown on the slides. The examiners are given a post standardization examination to make sure that they have internalized the criteria explained during the standardization process. The examination consists of the examiners actually grading models created by applicants in past examinations. Twenty-five different procedures are graded, and DBPR staff evaluate the grading of the examiners to ensure that they are grading consistently. Scores of zero through five are possible on each examination procedure. Five is considered to be an outstanding dental procedure. Four is better than minimally acceptable. Three is minimally acceptable. Two is below minimally acceptable. One is unacceptable, and zero is a complete failure. Rule 64B5-2.013, Florida Administrative Code. Three examiners independently grade each procedure. The dentistry examination is double-blind graded. The applicant has no contact with the examiners, and the examiners do not consult one another. This procedure was followed for the dentistry examination taken by Gage. The overall percentage score is determined by averaging and weighting the grades of the three examiners for each procedure. Statistically, averaging three grades is more accurate than using one grade alone. Gage complains about the inconsistency of the grading of the procedures on the mannequin. The examiners were identified by number as 080, 320, and 321. These examiners successfully completed the standardization process. Gage complains that Examiner 321 gave disproportionately low grades for the procedures performed on the mannequin. It is, however, more common for an examiner to give an inappropriately high grade than an inappropriately low grade. The higher grade can be a result of an examiner missing something, but the low grade must be justified in documentation and then actually verified on the mannequin. The three examiners for the mannequin procedures, when examined in the examiner's performance report, all had statistically acceptable measures of consistency and reliability. Gage complained that the patient on whom he performed the patient procedures had to make several trips to the restroom during the examination and that he did not have time to properly perform all the procedures. During the examination, Gage did not submit monitor to examiner notes, indicating there were any problems encountered during the examination or anything that he wanted the examiners to take into consideration in the grading. Prior to the perio and amalgam sections of the examination, the applicants are read a script that gives instructions as to what is to be done and how much time is allotted. The script provides that the applicants need to plan their usage of time in order to finish the procedures within the allotted four hours. Near the end of the examination, the applicants are advised of the time remaining until the end of the examination. Time management is important in the practice of dentistry because patients do not like to be kept waiting and because certain dental procedures must be executed within certain time frames. Applicants are advised before the examination how much time is allotted. Applicants are responsible for obtaining a patient for the examination. Gage received grades of four, four, and one on the class four composite filling portion of the examination. Examiner 321 gave the grade of one and documented that there was a margin open on the incisal. Dr. Thomas Shields III, who was qualified as an expert witness for the Respondent, reviewed the procedure and found that there was a definite click or catch on the incisal margin of the tooth, which was consistent with the grade of one. On the endo portion of the examination, Gage received grades of two, three, and zero. Dr. Shields reviewed the X-rays of the procedure, which showed that the final fill on the root canal had voids and was unacceptable and one of the tooth canals was not completely filled. On the prosthetic written portion of the examination, Gage scored 70 percent. In order to pass that portion of the examination, the applicant must achieve at least 75 percent, which equates to a 3.75 on a scale of zero to five. Rule 64B5- 2.013(2)(c), Florida Administrative Code. Gage complained that some of the pictures in the booklet were not very good and it was difficult to see which teeth were touching. He went to Tallahassee and reviewed the written portion of the test and made some comments concerning the test. Gage did not present his comments at the final hearing.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a final order be entered finding that Arthur A. Gage failed to achieve a passing score for the clinical portion of the dentistry examination administered December 1996. DONE AND ENTERED this 7th day of January, 1998, in Tallahassee, Leon County, Florida. SUSAN B. KIRKLAND Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 7th day of January, 1998. COPIES FURNISHED: William Buckhalt, Executive Director Board of Dentistry Department of Business and Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792 Angela T. Hall, Agency Clerk Department of Health 1317 Winewood Boulevard Building 6 Tallahassee, Florida 32399-0700 Janine B. Myrick, Esquire Department of Health 1317 Winewood Boulevard Building 6, Room 102 Tallahassee, Florida 32399-0700 Arthur A. Gage, pro se 12688 Tucano Circle Boca Raton, Florida 33428
The Issue The issue for determination is whether Petitioner successfully completed the December 1999 dental licensure examination.
Findings Of Fact Petitioner has been given a temporary permit to practice dentistry due to his being a resident in training. In December 1999, Petitioner took the dental licensure Examination. He successfully completed the Laws and Rules part of the Examination having received a score of 78.00, where a minimum score of 75.00 was required to pass that part. Petitioner failed to successfully complete the Clinical part of the Examination having received a score of 2.89, where a minimum score of 3.00 was required to pass the Clinical part. As a result, Petitioner failed to successfully complete the overall Examination. On the Periodontal section of the Clinical part, Petitioner received a score of 1.66. He challenges this score. Each candidate is graded by three examiners. Each examiner is a dentist who is licensed in the State of Florida, with a minimum of five active years' experience, and who, among other things, has no complaints or negative actions against his/her license. Before every examination, each examiner is trained in evaluating a procedure to make sure that the procedure is properly performed. The Department of Health (Department) conducts training in which each examiner is trained to grade using the same internal criteria. Such training results in a standardization of grading criteria. In this training process, the examiners are trained by assistant examiner supervisors on the different criteria that are used during the examination. The assistant examiner supervisors are dentists licensed in the State of Florida. To further their training, the examiners after receiving verbal training are shown slides of teeth which do not meet the clinical criteria of the examination. Following the standardization, to make sure that the examiners have been able to internalize the criteria, the examiners, themselves, are given an examination. Included in the examination is a hands-on clinical, where models are used and the examiners check for errors on the models. The examiners are evaluated on how they perform when they grade the models, to make sure that the examiners are grading the candidates the same, using the same criteria, and with reliability. Each examiner grades the examination independently. The examiners do not confer with each other while scoring the examination. The examiners do not have contact with the candidates. As to grading, the average of the three grades from the examiners produces the overall grade for the exercise performed by the candidate. Having three examiners grading provides a more reliable indication of the candidate's competency and true grade. Furthermore, the examination is double-blind graded, which is a grading process in which the candidates have no contact with the examiners. The candidates are located in one clinic and perform the dental procedures on their human patient. The clinic is monitored. When the candidate completes the procedures, a proctor accompanies the human patient to another clinic where the examiners are located, and the examiners grade the procedures performed by the candidates. Monitors are used by the Department at the examination. The role of a monitor is to preserve and secure the integrity of the examination. The monitor, among other things, gives instructions to the candidates, answers questions of the candidates, and acts as a messenger between the candidate and the examiner. Monitors also ensure that candidates do not have contact with the examiners. For the Periodontal section, a candidate, as Petitioner, performs a periodontal exercise on a human patient who is chosen by the candidate. The human patient must also be approved by the Department in accordance with criteria specified by rule.2 The criteria includes a requirement that the human patient must have a minimum of five teeth, each of which must have pockets of a minimum of four mm in depth with sub-gingival calculus. Petitioner chose his human patient. The Department approved Petitioner's human patient. Petitioner's human patient was a periodontally involved patient. Petitioner performed the periodontal exercise on his human patient. Petitioner's exercise was graded by three examiners, i.e., Examiners 131, 346, and 264. All three examiners participated in and successfully completed the standardization training, and it is inferred that they were considered qualified to act as examiners for the Examination. Petitioner's examination was double-blind graded. Each examiner independently graded Petitioner's examination. Examiner 131 found no errors and awarded Petitioner a grade of five (5). Examiner 346 found gross mutilation of the human patient's soft tissue of areas 26, 27, and 28, and awarded Petitioner a grade of zero (0). Examiner 264 also found gross mutilation of the human patient's soft tissue of areas 26, 27, and 28, and awarded Petitioner a grade of zero (0). The criteria for the Periodontal exercise mandates a grade of zero (0) where there is gross mutilation of gingival tissue.3 Consequently, Examiners 346 and 264 had no choice but to award Petitioner a grade of zero (0). After the grading, both graders who found gross mutilation of gingival tissue made written comments, regarding the tissue mutilation, on the Examiner-To-Monitor Instructions form. Examiner 264's comment was "Please have candidate place perio pak, area 26, 27, 28" and was not intended to be instructions to Petitioner but was directed to follow-up work or to attention that the human patient may need afterwards. The Examiner-To-Monitor Instructions form, with the written comments, was provided to the monitor who related the comments to Petitioner. The monitor did not allow Petitioner to view the written comments. The monitor informed Petitioner that further work needed to be done as to the human patient. The monitor indicated on the Examiner-To-Monitor Instructions form that Examiner 264's comment was related to Petitioner by the monitor writing "Candidate complied with" and writing and circling his assigned monitor number. The monitor writing "Candidate complied with" meant only that the monitor informed Petitioner that further work needed to be done, not that the Petitioner correctly performed the procedure. No evidence was presented that Petitioner sutured the human patient or that he placed a perio pak on the affected tissue of areas 26, 27, and 28. The evidence shows that the monitor only related to Petitioner that further work needed to be done without the monitor specifying what needed to be done. Moreover, the evidence shows that the monitor did not indicate that Petitioner had done what was requested of him. A candidate is not informed of his/her performance by the examiner because there is no contact between the examiner and the candidate. Additionally, such notification at the Examination site is not done because it is believed to have the effect of alarming the candidate and raising the candidate's anxiety level. The human patient was not informed that there was mutilation of soft tissue as a result of the periodontal exercise. Before an individual is accepted by the Department as a patient, the individual must complete and sign a "Patient Disclosure Statement and Express Assumption of Risk" form. This form, among other things, relieves the Department of any responsibility for poor work done by a candidate or for notifying the human patient of any poor work done by the candidate and places the responsibility on the human patient to have a licensed dentist check the work done by the candidate. The grading of Petitioner's Periodontal exercise is not arbitrary or capricious or an abuse of discretion. The grading process is not devoid of logic and reason.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that the Department of Health, Board of Dentistry, enter a final order dismissing Rami Ghurani's examination challenge to the periodontal section of the clinical part of the dental licensure examination administered in December 1999. DONE AND ENTERED this 15th day of December, 2000, in Tallahassee, Leon County, Florida. ERROL H. POWELL Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 15th day of December, 2000.
The Issue Whether Respondent violated Subsections 456.057(4) and 466.028(1)(n), Florida Statutes, and, if so, what discipline should be imposed.
Findings Of Fact The Department is the state agency charged with regulating the practice of Dentistry pursuant to Chapters 456 and 466 and Section 20.43. Dr. Kashlak is and has been at all material times hereto a licensed dentist in the State of Florida, having been issued license number DN 0011469. Dr. Kashlak has been practicing dentistry since 1985. She and her husband, Dr. Anthony Oswick, have had a small general dentistry practice in Orlando since at least 1990. On August 8, 2001, Dr. Kashlak first saw patient D.B. X-rays were taken on that date, and D.B.'s teeth were cleaned. D.B. next presented on August 21, 2001, at which time the cleaning of her teeth was completed. D.B. was scheduled for a one-hour appointment at 1 p.m. on September 19, 2001. D.B. called Dr. Kashlak's office at 10 a.m. on the morning of her appointment and advised that she had a conflict with her 1 p.m. appointment. She was advised that she would be charged a $50 cancellation fee if she did not make her appointment. D.B. advised that she would be coming, but that she would be late. D.B. arrived at 1:25 p.m. for her appointment. She was advised by the receptionist that she was too late for her appointment and that she would be charged the $50 cancellation fee. D.B. was unhappy with the situation. The receptionist told D.B. that she would have the dentist call her. It is the policy of Dr. Kashlak's office that she will deal with Dr. Oswick's patients on fee matters and that he will deal with her patients on fee matters. On the evening of September 19, 2001, Dr. Oswick called D.B. to discuss her concerns about the cancellation fee. D.B. and Dr. Oswick argued about the cancellation fee. D.B. advised him that she was not happy with the way that she had been treated and that she would be going to another dentist. D.B. told Dr. Oswick that she wanted her dental records, and he advised her to put her request in writing and send a check for $35 to cover the costs of copying the records. In a letter dated September 25, 2001, D.B. sent a letter to Dr. Kashlak stating the following: As per your instructions, I have enclosed a check for $35 to cover the cost of duplicating my dental records--x-rays, treatment plan, and notes. Please call me at the number noted below as soon as they are available and I will come by to pick them up. On October 8, 2001, D.B. received a copy of her dental x-rays and a letter enclosing a check for $99, which represented a refund of an insurance claim payment for D.B. No mention was made in the letter why all D.B.'s dental records had not been sent, and no mention was made that Dr. Kashlak or Dr. Oswick would contact D.B. concerning the remaining dental records. D.B. called Dr. Kashlak's office on October 8, 2001, and spoke to Dr. Oswick. Dr. Kashlak was with Dr. Oswick during the telephone conversation with D.B. D.B. asked why she had not received all of her dental records. He told her that the diagrams of her teeth would not copy well and that there was nothing else that she needed in her records. D.B. did not indicate to Dr. Oswick that she was withdrawing her request for the records. D.B. went to another dentist on October 17, 2001. She gave the x-rays to the dentist and told the dentist that she was unable to get the remaining records from Dr. Kashlak. Upon being advised by the new dentist that Dr. Kashlak was required to provide her with a copy of the records, D.B. went by Dr. Kashlak's office after her dental appointment in an attempt to get her dental records. The receptionist at Dr. Kashlak's office would not give D.B. her records. After her October 17 visit to Dr. Kashlak's office, D.B. never attempted to contact Dr. Kashlak again concerning her dental records. On October 17, 2001, Dr. Kashlak and Dr. Oswick were on vacation and were not in the office. They were not advised that D.B. had stopped by the office requesting her records. In April 2002, D.B. filed a complaint with the Department concerning Dr. Kashlak's treatment and the failure to provide the requested dental records. The Department investigated the complaint and contacted Dr. Kashlak by letter dated June 24, 2002, advising her of the complaint. By a Verification of Completeness of Records form dated July 15, 2002, Dr. Kashlak sent D.B.'s records, consisting of 14 pages, to the Department. One page of D.B.'s dental records, which the Department received, contained the following in the upper right- hand corner: Personal Notes: 9-19-01 Pt. showed up @ 125 pm -- caused disruptive scene in reception area/slanderous stmts. demanding refund. mk 9-19-01 called pt per request, became argumentative Re: broken appt. fee !! Also requested copy of x-rays afo 10-8-01 spoke to pt Re. Tx notes argumentative Re: BA Fee of $50 Pt's next dentist to contact us mk After receiving notice from the Department of D.B.'s complaint, Dr. Kashlak also sent D.B. a copy of D.B.'s dental records, which D.B. received on July 20, 2002. D.B.'s copy did not contain the personal notes set forth above. Dr. Kashlak has never had her license to practice dentistry disciplined.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a final order be entered finding that Dr. Kashlak violated Subsections 456.057(4) and 466.028(1)(n), imposing an administrative fine of $750, issuing a reprimand, and requiring Dr. Kashlak to complete 30 hours of continuing dental education in record keeping or risk management. DONE AND ENTERED this 11th day of September, 2003, in Tallahassee, Leon County, Florida. S SUSAN B. KIRKLAND Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 11th day of September, 2003. COPIES FURNISHED: Wayne Mitchell, Esquire Ephraim D. Livingston, Esquire Department of Health 4052 Bald Cypress Way, Bin C-65 Tallahassee, Florida 32399-3265 Brian D. Stokes, Esquire Unger, Acree, Weinstein, Marcus, Merrill, Kast & Metz, P.L. 701 Peachtree Road Orlando, Florida 32804 William W. Large, General Counsel Department of Health 4052 Bald Cypress Way, Bin A02 Tallahassee, Florida 32399-1701 William H. Buckhalt, Executive Director Board of Dentistry Department of Health 4052 Bald Cypress Way, Bin C06 Tallahassee, Florida 32399-1701 R. S. Power, Agency Clerk Department of Health 4052 Bald Cypress Way, Bin A02 Tallahassee, Florida 32399-1701
Recommendation Based on the foregoing findings of fact and conclusions of law, it is RECOMMENDED that Respondent regrade Petitioner's examination and give equal numerical point value to each criterion; it should also regrade procedure 3 giving consideration only to the grades of examiners 038, 02 and 048; all other requests for relief should be DENIED. DONE and ORDERED this 10th day of January, 1983, in Tallahassee, Florida. DONALD R. ALEXANDER Hearing Officer Division of Administrative Hearings The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32301 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 10th day of January, 1983.
The Issue The issue in this case is whether Petitioner, Jennifer Lee Brown, D.M.D., should receive a passing grade on the December 1997 Florida dental licensure examination.
Findings Of Fact Petitioner, Jennifer Lee Brown, D.M.D., is a graduate from the University of Florida College of Dentistry. Respondent, the Department of Health (hereinafter referred to as the "Department"), is responsible for the licensure of dentists in the State of Florida. In December 1997 the Florida Department of Business and Professional Regulation, on behalf of the Department, administered the Florida dental licensure examination which persons wishing to practice dentistry in the State were required to pass. Dr. Brown took the December 1997 dental examination (hereinafter referred to as the "Examination"). The Examination consisted of clinical, Florida laws and rules, and oral diagnosis parts. The clinical portion of the Examination consisted of 8 procedures: procedures 1-3 and 5-9. Each procedure was graded by three separate examiners. The scores awarded by the three examiners on each procedure were averaged, resulting in a truer score. Each procedure had standardized "comments" concerning a candidate's performance on the procedure which examiners could note. Examiners were selected from individuals recommended by existing examiners or members of the Board of Dentistry (hereinafter referred to as the "Board"). Prospective examiners could not have any complaints against their license and they were required to have actively practiced dentistry and to be licensed as a dentist in Florida for a minimum of five years. Prospective examiners were required to file an application with the Board's examination committee. Prior to the Examination, a "standardization" session was conducted for the examiners selected. During the session, examiners were trained how to grade the Examination using the same internal criteria. The standardization session was conducted by assistant examiner supervisors appointed by the Board. After completion of the standardization session, and before the Examination, examiners were required to grade five mannequin models in order to evaluate the examiners' understanding of the grading criteria. Each examiner's performance was evaluated to determine whether the examiner should be used during the Examination. The examiners who graded Dr. Brown's clinical part of the Examination were designated as Examiners 168, 176, 195, 207, 264, 290, 298, and 299. All of these examiners completed the standardization session and the post-standardization evaluation. During the clinical part of the Examination, the examiners were required to grade each procedure independently, without conferring with each other. The clinical part of the Examination was "double blind" graded. Examiners did not see the candidates they were grading or watch their work. The test procedures were performed in a clinic in the presence of a licensed dentist. After the procedure was completed, the patient or tooth was taken to another clinic where the examiners reviewed the work performed on the patient and graded the procedure. The examiners had no direct contact with any candidate. Candidates were permitted to use "monitor-to-examiner" notes to convey information to the examiners that a candidate wanted the examiners to take into consideration when grading a procedure. Any such notes were read by the examiners and initialed "SMN" (saw monitor note) before they actually looked at the patient or tooth. For the clinical part of the Examination the following grading system was used: Zero: complete failure; One: unacceptable; Two: below minimally acceptable. Three: minimally acceptable. Four: better than minimally acceptable. Five: outstanding. After the Examination was graded, all examiners underwent a post-examination evaluation. Grades awarded by each examiner were compared to other examiners for consistency. All of the examiners who graded Dr. Brown's clinical part of the Examination were found to have performed acceptably. Dr. Brown was subsequently informed that she had failed to obtain the minimum passing grade of 3.00 for the clinical part of the Examination. Dr. Brown was informed that she had been awarded a score of 2.67. Dr. Brown was also informed that she passed the other two parts of the Examination. Dr. Brown challenged the scores she had been awarded on the clinical part of the Examination for procedures 2, 5, 6, 7, 8, and 9. The procedures challenged were graded by examiners 176 (graded all the challenged procedures), 195 (graded procedures 5- 9), 207 (graded procedure 2), 298 (graded procedure 2), and 299 (graded procedures 5-9). The Department conceded that the scores awarded Dr. Brown on procedures 7 and 8 were incorrect. As a result, the Department agreed that Dr. Brown's overall score for the clinical part of the Examination should be raised to 2.82. The evidence failed to prove that Dr. Brown should have received a higher score on procedures 7 and 8. Procedure 2 consisted of an amalgam (filling)n preparation on a human patient. Dr. Brown was required to select a tooth and, after the selected tooth was checked by an examiner, complete preparation for the amalgam. Dr. Brown wrote three monitor-to-examiner notes during procedure 2. All three examiners wrote "SMN" on all three notes. Dr. Brown received an average score on procedure 2 of 3.66. Dr. Brown was awarded the following individual scores for her performance on procedure 2: Examiner Score 176 4 207 4 298 3 Examiners 176 and 298 noted the following comment concerning Dr. Brown's performance on procedure 2: "Depth Prep." Examiner 298 also noted the following comment: "Marginal Finish." Examiner 207 noted the following comment: "Retention Form." Dr. Brown admitted that her performance on procedure 2 was not ideal, but expressed concern that she was graded down for matters dealt with in the monitor-to-examiner notes. Dr. Shields opined that it was possible for the examiners to have reduced the score awarded to Dr. Brown on procedure for depth preparation, marginal finish, and retention form and not have graded her down for the monitor-to-examiner notes. The evidence failed to prove that Dr. Shields' opinion was not reasonable or accurate. The evidence failed to prove that Dr. Brown should have received a higher score for procedure 2 of the clinical part of the Examination. Dr. Brown received a fairly consistent score from all three graders. Procedure 5 was a "class IV composite restoration." This procedure involved the selection of a tooth by Dr. Brown which she was then required to make a slice cut on to replicate a fracture. Dr. Brown was then required to restore the simulated fractured tooth to its normal contour and function. The procedure was performed on a mannequin. Dr. Brown received an average score of 1.66 on procedure 5. Dr. Brown was awarded the following individual scores for her performance on procedure 5: Examiner Score 176 3 195 0 299 2 Examiners 176 and 195 noted the following comment concerning Dr. Brown's performance on procedure 5: "Proximal Contour." Examiners 176 and 299 noted the following comment concerning Dr. Brown's performance on procedure 5: "Margin." Finally, the following additional comments were noted by the examiners: Examiner Comment: 195 Functional Anatomy Mutilation of Adjacent Teeth 289 Gingival Overhang Dr. Brown's challenge to her score for procedure 5 was essentially that Examiner 199 had given her such a low score on this procedure and procedures 7 through 9 when compared to the scores awarded by Examiners 176 and 298. Dr. Shields opined that Dr. Brown should not have received a higher score for her performance on procedure 5. Dr. Shields' opinion was based generally upon his 21 years of experience as a dentist. More specifically, Dr. Shields based his opinion upon his examination of the actual tooth that Dr. Brown performed procedure 5 on. Dr. Shields found excess material left at the gingival or gum portion of the tooth. Dr. Shields also found that Dr. Brown attempted to polish the material off and had flattened some of the surface of the tooth. Apparently, based upon Examiner 195's comment notes, Examiner 195 was the only examiner to catch these deficiencies in Dr. Brown's performance on procedure 5. Dr. Shields also found slight damage on the mesial, the approximating surface of the lateral incisor, the tooth next to the tooth that was restored. The evidence failed to prove that Dr. Shields' opinions concerning Dr. Brown's performance on procedure 5 were not reasonable and accurate. The evidence failed to prove that Dr. Brown should have received a higher score for procedure 5 of the clinical part of the Examination. Procedure 6 required that Dr. Brown perform an Endodontic Evaluation of the Maxillary First Premolar. Dr. Brown was required to select an extracted tooth, a maxillary tricuspid, examine x-rays of the tooth, and then perform a root canal on the tooth. The tooth had two roots. The root canal involved creating an opening in the tooth and removing the pulpal tissue from the two nerve canals of the tooth (a debridement). The canals were to be shaped for an obturation or the filling of the canal. A final x-ray of the tooth was taken after the procedure was completed. Dr. Brown received an average score on procedure 6 of 1.00. Dr. Brown was awarded the following individual scores for her performance on procedure 6: Examiner Score 176 3 195 0 299 0 All three examiners noted the following comment for Dr. Brown's performance on procedure 6: "Proper Filling of Canal Spaces with Gutta Percha." Gutta Percha is the material that was used by Dr. Brown to fill the canal of the roots after she completed the debridement. Examiner 195 noted the following additional comment for Dr. Brown's performance on procedure 6: "Access Preparation." Examiner 299 noted the following additional comment: "Shaping of Canals." Dr. Brown's challenge to her score for procedure 6 was based in part on her concern that Examiners 199 and 299 had given her a score of 0 on this procedure while Examiner 176 had given her a score of 3. Dr. Brown admitted that she had caused the gutta percha to extrude through the apex of the canals. She argued, however, that gutta percha is reabsorbed by the patient. Therefore, Dr. Brown suggested that her performance was "clinically acceptable." Dr. Brown questioned how one examiner, Examiner 176, could conclude that her performance was in fact clinically acceptable, while the other two examiners concluded it was not. The difficulty with Dr. Brown's position with regard to procedure 6 is that she assumes that the only deficiency with her performance was the extrusion of gutta percha and that it was not a significant deficiency. The evidence failed to support this position. Dr. Shields opined that Dr. Brown should not have received a higher score for her performance on procedure 6. His opinion was based upon the fact that the extrusion of gutta percha was very significant on one of the canals: it extended a millimeter and a half. On the other canal it was a half of a millimeter. Filling the canal one half millimeter to a millimeter is considered ideal. The evidence failed to prove that Dr. Shields' opinion was not reasonable or accurate. During the standardization session, examiners were told that extrusion of gutta percha more than a half millimeter through the apex was to be considered an error of major consequence. Candidates who extruded guttal percha more than a half millimeter were not to receive a grade higher than one. In light of the instructions during the standardization session, it was more likely that Examiner 176 gave Dr. Brown too high of a score on procedure 6. The evidence failed to prove that Dr. Brown should have received a higher score for procedure 6 of the clinical part of the Examination. Procedure 9 was a pin amalgam final restoration. Although this procedure involved, in a lay person's terms, a filling, what exactly was involved in this procedure was not explained during the formal hearing. Dr. Brown received an average score on procedure 9 of 1.66. Dr. Brown was awarded the following individual scores for her performance on procedure 9: Examiner Score 176 4 195 0 299 1 All three examiners noted the following comment concerning Dr. Brown's performance on procedure 9: "Functional Anatomy." Examiners 195 and 299, who both graded Dr. Brown below minimal acceptability, also noted the following comments: "Proximal Contour," "Contract," and "Margin." Dr. Brown failed to present any evidence to support her claim that she should have received a higher score for procedure Dr. Brown simply questioned the fact that Examiner 195 had graded her low on all the clinical procedures. Dr. Shields opined that Dr. Brown should not receive a higher score on procedure 9. The evidence failed to prove that Dr. Shields' opinion was not reasonable or accurate. The evidence failed to prove that Dr. Brown should have received a higher score for procedure 9 of the clinical part of the Examination. Dr. Brown's challenge in this case was based largely on the fact that Examiner 195 had graded her performance on procedures 5, 6, and 9 as a zero, procedure 7 as a one, and procedure 8 as a two. Other than the fact that Examiner 195's scores were consistently low, the evidence failed to prove that Examiner 195 improperly graded Dr. Brown except as conceded by the Department on procedures 7 and 8. Comparing the scores awarded by Examiner 195 to Examiner 176 does raise some question as to why there was such a discrepancy in the two examiners' scores. When the scores on procedures 5, 6, and 9 of all three examiners are compared, however, Examiners 195 and 298 generally were consistently below acceptable, while Examiner 176's scores were generally higher on these three procedures: Examiner Procedure 5 Score Procedure 6 Score Procedure 9 Score 176 3 3 4 195 0 0 0 299 2 0 1 This simple mathematical comparison, however, is not sufficient to conclude that Examiner 195 scored too low or that Examiner 176 scored too high. Other than a simple comparison of the scores of the three examiners, the only evidence concerning whether Examiner 195 graded too low based upon the scores alone was presented by Ms. Carnes, an expert in psychometrics. Ms. Carnes opined that Examiner 195's performance was acceptable, except with regard to procedures 7 and 8. The evidence failed to refute Ms. Canres' opinion. Based upon the weight of the evidence, Dr. Brown's score for the clinical portion of the Examination, as adjusted by the Department during the final hearing of this case, was reasonable and accurate.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a Final Order be entered by the Department of Health, Board of Dentistry, dismissing Dr. Brown's challenge to the amended grade awarded for the clinical part of the December 1997 Dental Examination. DONE AND ENTERED this 14th day of September, 1998, in Tallahassee, Leon County, Florida. LARRY J. SARTIN Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 14th day of September, 1998. COPIES FURNISHED: Jennifer Brown Post Office Box 39 Starke, Florida 32091-0039 Anna Marie Williamson, Esquire Office of the General Counsel Department of Health Building 6, Room 102 1317 Winewood Boulevard Tallahassee, Florida 32399-0700 Angela T. Hall, Agency Clerk Department of Health 1317 Winewood Boulevard, Building 6 Tallahassee, Florida 32399-0700 William Buckhalt, Executive Director Department of Health 1940 North Monroe Street Tallahassee, Florida 32399-0792
The Issue Whether Petitioner should receive a refund for an alleged overpayment of dental insurance premiums.
Findings Of Fact The Division of State Group Insurance (Division) is the executive agency within the Department of Management Services (Department) that is responsible for the administration of the State Group Insurance Program (Program). Isaacs was first employed with the State of Florida in 1993, and remained employed with the State until March 2011, when he retired. According to Isaacs, when he originally signed up for dental insurance, there were only two options available for employees; an employee could sign up either for “employee” coverage or for “employee plus family” coverage. Isaacs chose “employee plus family” dental coverage, so that he and his spouse would have coverage. During his tenure as a State employee, Isaacs was married and had no children. At all times material to the instant case, Isaacs resided, and received his mail, at 13021 S.W. 116th Street, Miami, Florida, 33186. On January 1, 2005, the State of Florida started using an online system called “People First” to manage State of Florida employee payroll and benefit packages. Every employee and retiree was given a username and password to access the online system. Each employee’s payroll information, leave balances, and benefits information could be seen online. Pursuant to section 110.123(3)(h), every year there is a finite period of time during which State employees can sign up for benefit plans, or change their existing benefit plans, for the upcoming calendar year. This period is called “open enrollment.” Prior to open enrollment every year, People First mails out, to every State employee, a package which contains a personalized benefits statement and a Benefits Guide, which contains information as to all the benefit plans that are being offered for the upcoming calendar year. The benefits statement informs employees of the benefits they currently have and will continue to have during the upcoming calendar year, unless they make changes to their insurance or coverage level. On September 7, 2007, the Division mailed each participant in the dental insurance program a letter explaining significant changes to the dental program. This letter was mailed by first class mail to the address of record for each employee who was then enrolled in the dental program. Isaacs' address of record in People First was his mailing address: 13021 S.W. 116th Street, Miami, Florida, 33186. Isaacs claims that he never received this letter. The undersigned finds this testimony to not be credible, given that Isaacs' address has not changed in 33 years, and he was unaware of any other problems with delivery to this address. The September 2007 letter advised employees that there would be new coverage levels offered in 2008. It stated, in pertinent part: There will be new coverage levels offered in 2008. You may currently be enrolled in a coverage level that will not be offered. The new coverage levels are: ° Employee Only ° Employee + Spouse ° Employee + Child(ren) ° Family You will have the opportunity during the upcoming Open Enrollment to cancel coverage, change your coverage level, or switch to another dental plan. Any change you make will be effective on January 1, 2008. If you take no action, your dental coverage may be changed automatically for 2008. If you are currently enrolled in a coverage level that will not be offered in 2008, you will be enrolled in Family coverage. People First sent Isaacs open enrollment packages in 2007, 2008, 2009, and 2010. The 2008 package, sent on September 17, 2007, included a Benefits Guide which contained all the information as to the change in the dental insurance program. Employees were placed on notice that except for employees who had previously been enrolled for “Employee” coverage, all coverage levels would be moved to “Family” coverage unless the employees made changes during open enrollment. The package included instructions on how to make the coverage changes, and how to verify that those changes had been properly made. Isaacs never changed his dental plan coverage; therefore, he was defaulted to the “Family” coverage as of January 1, 2008. Due to his failure to act, he remained in that coverage until he retired. The open enrollment packages sent to Isaacs for years 2009, 2010, and 2011 included information as to the dental coverage tiers, and a personalized Benefits Statement which indicated which benefit plans Isaacs was enrolled in, and his coverage level. Every year, he could have made changes to his dental insurance coverage, but failed to do so. As of People First going “live” in 2005, all State employees could review their benefits and coverage levels online. Thus, Isaacs, on his state-issued desktop computer, had access to People First, and could have reviewed his coverage levels and benefit plans. Isaacs admitted at hearing that he did not review the open enrollment packages he received every year because he was under the impression, based on advice he was given, that he need not review the information if he was not making any changes to his coverage levels or benefit plans. He added that he was not sure if he even opened all the open enrollment packages that were sent through the years. Isaacs had the responsibility to open, review, and carefully read the open enrollment packages and all correspondence sent to him by his employer. Isaacs was advised of the changes to the dental plan, but did not review the information sent to him. He had ample notice of the change to the dental plan coverage levels, but failed to review the information, and failed to avail himself of the many opportunities he had to adjust the coverage level. He paid for more coverage than he needed because he ignored all the information sent to him, which gave him specific instructions on how to avoid that exact circumstance.
Recommendation Based upon the foregoing Findings of Fact and Conclusions of Law, it is hereby RECOMMENDED that the Department of Management Services enter an order denying Isaacs' request for a refund for his overpayment of dental insurance premiums. DONE AND ENTERED this 15th day of November, 2011, in Tallahassee, Leon County, Florida. S JESSICA E. VARN Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 15th day of November, 2011.
