The Issue The issue is whether the score that Respondent assigned to the Patient Amalgam Preparation section of the clinical part of Petitioner's June 2003 Florida Dental License Examination was arbitrary or capricious.
Findings Of Fact Petitioner took the June 2003 Florida Dental License Examination. A passing score for the clinical part of the examination is 3.0. Petitioner received a score of 2.9, so he failed the clinical part of the examination. Petitioner has challenged the grade of 2.0 that he received on the Patient Amalgam Preparation of the clinical part of the examination. The score of 2.0 is derived from averaging the 3s that Petitioner received from two evaluators and the 0 that he received from one evaluator. Petitioner challenges only the score of 0, and he needs two additional points to pass the clinical part of the examination. The administration of the clinical part of the dental examination requires Respondent to recruit and train numerous examiners and monitors, all of whom are experienced, licensed dentists. The training process includes standardization exercises designed to ensure that all examiners are applying the same scoring criteria. The evaluation of specific procedures are double-blind, with scoring sheets that identify candidates by test numbers, so examiners do not know the identity of the candidate whose procedures they are scoring. The section that is the subject of this case requires the candidate to demonstrate certain skills on a live patient. While working with the patient, the candidate is supervised by a monitor. When the candidate has completed the required dental work to his satisfaction, he so advises the monitor, who sends the patient to the dental examiners. For the section that is the subject of this case, three dental examiners examine the patient and score the procedure. These examiners do not communicate with each other, and each performs his or her examinations and scores the procedure in isolation from the other examiners. Communications between examiners and candidates are exclusively through monitor notes. For the section that is the subject of this case, the maximum possible score that a candidate may receive is a 5. Passing grades are 3, 4, or 5. Nonpassing grades are 0, 1, or A score of 3 indicates minimal competence. The Patient Amalgam Preparation section of the clinical part of the examination required Petitioner to remove caries from one tooth and prepare the tooth for restoration. These procedures are of obvious importance to dental health. Poor preparation of the tooth surface will probably result in the premature failure of the restoration. A restoration following incomplete removal of caries will probably result in ongoing disease, possibly resulting in the loss of the tooth. Written materials, as well as Respondent's rules, which are discussed below, require a 0 if caries remain, after the candidate has presented the patient as ready for restoration. Other criteria apply to the Patient Amalgam Preparation procedure, but this criterion is the only one of importance in this case. Examiners 207 and 394 each assigned Petitioner a 3 for this procedure, but Examiner 417 assigned him a 0. Examiners 207 and 394 noted some problems with the preparation of the tooth, but neither detected any caries. Examiner 417 detected caries and documented her finding, as required to do when scoring a 0. Examiner 207 has served as an examiner for 10 years and has conducted 15-20 evaluation examinations during this time. Examiner 417 graduated from dental school in 1979. Examiner 394 has been licensed in Florida since 1995 and has served as an examiner only three years. The instructions to examiners emphasize that they are to detect caries "exclusively" tactilely, not visually. Tactile detection of the stickiness characteristic of caries is more reliable than visual detection. For example, caries assumes the color of dentin as the decay approaches the dentin. Despite the requirement to detect caries by touch, not sight, Examiner 417 initially testified that she detected the caries by sight. Later in her testimony, she backtracked and stated that she was not sure if she felt it or saw it. Her earlier, more definitive testimony is credited; Examiner 417 never found caries by touch, only by sight. In DOAH Case No. 03-3998, Examiner 417 readily conceded that she must have missed the caries that another examiner had detected, inspiring little confidence in her caries-detection ability. In that case, her value as one of two dentists in the majority was insignificant, even though the majority finding prevailed. In this case, Examiner 417's role as the lone dentist who found caries is too great an evidentiary burden for her to bear. The vagueness of her testimony and her reliance upon visual caries-detection preclude a finding of caries in this patient. Three other additional factors undermine Examiner 417's finding of caries. First, Examiners 207 and 394 found no caries. Examiner 207 has considerable experience. Examiner 394 has less experience, but he was the lone evaluator in DOAH Case No. 03-3998 to detect calculus deep below the gums, proving that he is both meticulous and a demanding grader. Together, then, the findings of Examiners 207 and 394 of no caries carry much greater weight than the contrary finding of Examiner 417. Nor was it likely that Examiner 417 accidentally dislodged the caries. No evidence suggest that she was the first examiner to examine the patient, and her means of detecting caries was visual, not tactile. Second, the location of the caries in this case was directly in the center of the tooth. So located, it was difficult for Petitioner and Examiners 207 and 394 to miss. Third, by two monitors' notes, Petitioner twice obtained the evaluators' permission to expand the drilled area, due to the extensiveness of the caries, suggesting that Petitioner was devoting careful attention to the removal of all caries, even if it meant an atypical site preparation.
Recommendation It is RECOMMENDED that the Department of Health enter a final order granting Petitioner an additional two points on the clinical part of the June 2003 Florida Dental License Examination and determining that he has passed this part of the dental examination. DONE AND ENTERED this 27th day of February, 2004, in Tallahassee, Leon County, Florida. S ROBERT E. MEALE Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 27th day of February, 2004. COPIES FURNISHED: R. S. Power, Agency Clerk Department of Health 4052 Bald Cypress Way, Bin A02 Tallahassee, Florida 32399-1701 William W. Large, General Counsel Department of Health 4052 Bald Cypress Way, BIN A02 Tallahassee, Florida 32399-1701 William H. Buckhalt, Executive Director Board of Dentistry Department of Health 4052 Bald Cypress Way, Bin C06 Tallahassee, Florida 32399-1701 James Randolph Quick Driftwood Plaza 2151 South U.S. Highway One Jupiter, Florida 33477 Cassandra Pasley Senior Attorney Department of Health Office of the General Counsel 4052 Bald Cypress Way, Bin A02 Tallahassee, Florida 32399-1703
Findings Of Fact The Respondent, Prince Edward Denton, D.D.S., is now, and has been at all times material to this proceeding, a licensed dentist in the State of Florida, having previously been issued license number DN 0006762. Carol Hepp has been a dental assistant for twenty-seven years. She received her initial training as a dental assistant after graduation from high school when she went to work for Dr. Seth Rhodes in North Miami Beach. Since that time she has attended many training courses in her career as a dental assistant, including expanded duties courses at Emory University and the University of Florida. Ms. Hepp was employed by the Respondent as a dental assistant for a total of approximately four and one-half years. Ms. Hepp was so employed on February 2, 1988. On February 2, 1988, patient C.H. went to the Respondent's office to obtain treatment for a cracked tooth. The cracked tooth was tooth number 18, which was the last tooth in the patient's left lower jaw. During that visit, the patient C.H. was examined by the Respondent and by his dental assistant, Carol Hepp. Ms. Hepp explained the tooth crowning procedure to the patient. Ms. Hepp took a preliminary impression of the lower jaw by placing a two-part putty-like substance called "citrocon" in a tray, placing a plastic sheet over the top, and placing the tray into the patient's mouth. She held the tray in place for approximately six minutes and then removed it. This procedure yielded an approximate image of the patient's lower teeth. The Respondent took the final impression by applying a viscous substance around tooth number 18, and then inserting the preliminary impression into the patient's mouth. The Respondent held the impression in place until it was set or non-moveable, at which time Ms. Hepp took over the task of holding the impression in place for the balance of the approximately four-minute period during which the final impression material completely set up. After the impression was finished, Ms. Hepp took it to the Respondent who examined it and approved the finished final impression. After the final impression had been taken, Ms. Hepp made a wax form for purposes of fabricating a temporary crown for C.H.`s tooth number 18. This was done prior to the "preparation" of the tooth. The "preparation" of a tooth for crowning is the actual grinding down of the tooth that is to be crowned. The Respondent, and not Ms. Hepp, ground down the patient C.H.`s tooth number 18 in preparation for crowning. Following the Respondent's "preparation" of the subject tooth, Ms. Hepp packed a cord around the tooth. 1/ The grinding down, or "preparation," of a tooth for crowning is an irremediable task, which under no circumstances should be delegated to a dental assistant. Following the Respondent's "preparation" of the tooth, Ms. Hepp then fabricated and installed a temporary crown on the patient's tooth number 18. This was done by utilizing the wax form she had previously made, filling the form with a self-curing jet material, adding tooth color, and then placing the temporary crown over the prepared tooth. At all times during the treatment of the patient C.H., the Respondent was aware of, and had authorized, each step performed by Ms. Hepp, and was available to assistt Ms. Hepp had she requested his assistance. Accordingly, Ms. Hepp was working under the direct supervision of the Respondent at all times material to this proceeding.
Recommendation For all of the foregoing reasons, it is recommended that a Final Order be issued in this case dismissing all charges in the Administrative Complaint. DONE AND ENTERED at Tallahassee, Leon County, Florida, this 31st day of July, 1991. MICHAEL M. PARRISH Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 904/488-9675 Filed with the Clerk of the Division of Administrative Hearings this 31st day of July, 1991.
The Issue The issue for consideration in this case is whether Petitioner should be awarded a passing grade on the clinical portion of the dental licensing examination given on December 12 through 14, 1996.
Findings Of Fact At all times pertinent to the issues herein, the Board of Dentistry was responsible for the licensing of dentists in this state and the regulation of the dental profession. Petitioner is a graduate of the University of Florida School of Dentistry and was eligible to sit for the examination for licensure as a dentist in Florida. Petitioner previously has taken and passed the written portion of the dental examination. He has taken the clinical portion of the examination twice and has received a failing grade each time. He is eligible to take the clinical portion alone for a third time, but must do so within a period of 13 months of taking it the second time or must take both the written and oral portions again. Dr. Scheutz first took the examination in June 1996. He received a passing grade in each of those examination portions which dealt with Florida laws and rules and with oral diagnosis. However, he received a grade of 2.31 on the clinical examination portion of the examination, and a passing grade was 3.0. Thereafter, in December 1996 he again took the clinical portion and this time received a grade of 2.71, still below the 3.0 passing grade. Dr. Theodor Simkin is a licensed dentist and consultant to the Board of Dentistry, who has been in the private practice of dentistry since 1950 and in Florida since 1975. He has been involved in the development, administration, and grading of the dental examination in Florida since 1979 and was a supervisor for the December 1996 examination. He is familiar with the standards applied in the clinical portion of the examination and how the examination is given and graded. Petitioner has challenged the grade he received on five separate procedures he performed during the December 1996 examination. The procedures chosen for accomplishment during the examination are not unusual procedures, but are common problems seen on a routine basis by a practicing dentist. Dr. Simkin reviewed the mannequin on which Petitioner did his work and which he presented to the examiners for grading. One of the grades challenged related to a "composite restoration" (Clinical D) for which Petitioner received a grade of 0. In this procedure the candidate is presented with a tooth on a mannequin. The candidate is instructed to cut off a corner of the tooth and then restore that corner with an amalgam restoration. The examiners are not present when the procedure is accomplished, but grade the procedure after completion. Instruction on the procedure is given to the candidate by a monitor who is present in the room but who does not grade the work done. The examination process is accomplished using the candidate number, not the candidate name, so that examiners do not know whose work at which they are looking. Once the procedure is done by the candidate, the mold is packed in the candidate's presence and is then held in the custody of the Board of Dentistry until examined independently by each of three examiners. Once graded, it is then shipped to Tallahassee and kept in a vault until needed, as here, for review by Dr. Simkin and others. Ordinarily, even if dropped, a model will not break. In the instant case, Petitioner performed the procedure on an upper right central incisor. The right corner of the tooth, approximately one-third of the tooth, was cut off and the candidate was instructed to rebuild it with a composite material. When the examiners evaluated Petitioner's work, they found that the filling was not bonded to the tooth and was loose. The loose restoration would be useless to the patient, whereas a properly done restoration should last for at least several years. On a human, the stresses applied to a tooth repair are significant, and the repair must be sufficient to withstand them. Notwithstanding Petitioner's claim that the tooth used was an artificial tooth to which the filling material does not easily bond, Dr. Simkin asserts that the bonding which occurs with a plastic tooth is different from that which occurs in a real tooth but the material can bond to the plastic tooth. He knows of no other complaints by other candidates at this examination of not being able to complete the restoration because the materials would not bond. Petitioner admits that when he did the procedure during the June 1996 examination, the tooth bonded correctly. In light of all the evidence regarding this point, it is found that Petitioner's claim is without merit. Petitioner also challenges his score of 2.0 received for his work on an "amalgam cavity preparation" (Clinical B). This composite score was based on a 2.0 awarded by each of the three examiners. An amalgam preparation is what is done to the tooth to get it ready for filling. In this case, an actual patient, supplied by the examines, had a cavity which was reviewed by the examiners. Once the patient was accepted by the examiners, the candidate then cleaned out the cavity and got it ready for filling. Dr. Simkin's review of the documentation prepared in regard to this candidate's performance of this procedure, in his opinion, supports the grades given by the examiners. Here, Petitioner sent the examiners a note as to what he proposed to do with his patient. Petitioner sought to deviate from a normal preparation due to the location of the caries, and the monitor agreed, as did the examiners. Thereafter, the candidate did the procedure. All three examiners graded his work against his proposal and gave him a failing grade. The examiners determined that his work on this patient merited only a grade of 2.0 because, according to two examiners, the margin of the filling was not separated from the next tooth as required. As to the "posterior endodonture procedure" (Clinical M), Petitioner received an overall score of 1.3. In this procedure, the candidate is required to bring in an extracted tooth which is mounted in an acrylic block. The candidate is to remove the nerve and diseased tissue, clean the cavity, file it, fill the canals, and seal the tooth. This is known as a root canal. In grading a candidate's work, the examiners look to see that the canal is properly cleaned out, is filled properly and sealed with a surface that is slightly shorter than the apex (highest point) of the tooth. On the x-ray taken of Petitioner's sample, it is obvious, according to Dr. Simkin, that one canal is at or short of the apex, but the other is long, and this is considered unacceptable treatment. Even Petitioner agrees. Petitioner received grades of 3.0, 2.0 and 1.0 for an overall failing grade of 2.0 on the "prep. cast restoration" (Clinical F). In this instance, the procedure called for the candidate to install a gold onlay. Normally the surface to which the onlay is to be placed is reduced slightly below the abutting face. Here, though one side was acceptable, Petitioner reduced too much on the other side without reason. Petitioner claims, however, that only one of the three examiners indicated excessive reduction. That determination calls for a very subjective opinion. He cannot understand how the propriety of reduction can be determined without looking into the mouth of a patient. However, Petitioner has presented no evidence in support of his opinion. The fifth challenge relates to the grade Petitioner received in the "pin amalgam pre. procedure" (Clinical G). This involves a situation where one cusp has been removed, and in order to hold a restoration, Repin must be placed in the solid portion of the tooth. The examiners determined that Petitioner's occlusal was too shallow at 1 mm, when it should have gone down 1~ to 2 mm. This, the examiners considered, would not give enough strength to hold the amalgam properly without risk of fracture. Dr. Simkins is of the opinion that Petitioner was subjected to a standardized test which was graded fairly. It would so appear and Petitioner introduced no evidence to the contrary. Ms. Carnes, a psychometrician and an expert in testing and test development who trains examiners to ensure they are consistent in their evaluations, agrees with Dr. Simkins' appraisal. The Department of Business and Professional Regulation tries to insure through its standardization efforts that the approach to grading of each examiner is consistent and that all examiners are grading with the same set of criteria. This was done in preparation for the December 1996 dental examination and a check done after the examination showed it was graded this way. Petitioner cites by way of explanation, if not excuse, that during his senior year in dental school, he was badly injured in an automobile accident and required stitches and several weeks of physical therapy for, among other injuries, a herniated disc. When he recovered sufficiently, he finished his course work and sat for the dental examination in June 1996, passing two of three sections, but not the clinical portion. Dr. Scheutz took the clinical portion of the examination again in December 1996 and again failed to earn a passing score. In his opinion, his knowledge has improved over time, but his procedural skills have diminished over the months due to his injuries. He contends he has work in dentistry he can do which will make accommodations for his physical condition, but does not believe he should have to wait another six months to take the examination again, especially since he would have to again take the entire examination, including those portions he has already passed since at that time more than 13 months from his last examination would have passed. Petitioner contends the clinical testing portion of the examination is too subjective to be valid. He wants to close this chapter in his life, but does not want to deal any more with the Board.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is recommended that the Board of Dentistry enter a Final Order denying Petitioner's challenge and sustaining the award of a failing grade on the clinical portion of the dental examination taken by the Petitioner on December 12 through 14, 1996. DONE AND ENTERED this 27th day of June, 1997, in Tallahassee, Leon County, Florida. ARNOLD H. POLLOCK Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (904) 488-9675 SUNCOM 278-9675 Fax Filing (904) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 27th day of June, 1997. COPIES FURNISHED: Dr. Eric J. Scheutz, pro se 332 Whispering Oaks Court Sarasota, Florida 34232 Karel Baarelag, Esquire Agency for Health Care Administration 2295 Victoria Avenue Fort Myers, Florida 33906-0127 Jerome W. Hoffman, General Counsel Agency for Health Care Administration 2727 Mahan Drive Tallahassee, Florida 32309 William Buckhalt, Executive Director Board of Dentistry 1940 North Monroe Street Tallahassee, Florida 32399-0792
The Issue The issue in this case is whether Colette Michele Gatward (Petitioner) should receive a passing score on the Florida Dental Hygiene Clinical Examination.
Findings Of Fact The Petitioner was a candidate for licensure as a dental hygienist by the State of Florida. All candidates for Florida licensure as dental hygienists are required to pass the Florida Dental Hygiene Clinical Examination. The Petitioner took the exam on November 5, 2010. Information and instructions related to the exam were provided to candidates through a "Candidate Information Booklet" (CIB) that was posted on the Respondent's Internet website approximately 60 days prior to the date of the exam. Candidates were expected to review the information contained in the CIB. The Petitioner was aware of the information in the CIB. Part of the exam required that each candidate perform certain clinical procedures to the teeth of a human patient. The CIB stated that each candidate was responsible for providing their own human patient upon whom the clinical procedures could be performed. A panel of three examiners reviewed and scored each candidate's performance of the clinical procedures. In relevant part, the CIB stated that each candidate must submit a patient with 12 surfaces of explorer-detectable moderate subgingival calculus. An explorer is a piece of equipment used in dental practice. The CIB stated that 6.5 points would be awarded for each of the 12 surfaces of subgingival calculus detected and removed by the candidate during the exam. The CIB also stated that failure to detect and remove a minimum of nine surfaces of moderate subgingival calculus would result in a candidate receiving less than a passing score on the exam. The CIB specifically stated that "[p]oor patient selection and management is a common reason for examination failure." The Petitioner brought her sister-in-law to the exam to serve as her patient. After the applicable portion of the exam was completed, the panel of three examiners evaluated the Petitioner's clinical performance. Two of the three examiners determined that the Petitioner had detected and removed subgingival calculus from only eight surfaces of her patient's teeth. There was no evidence presented to indicate that the Petitioner neglected to remove subgingival calculus from her patient's teeth. The Petitioner was aware at the time of the exam that her sister-in-law did not have sufficient subgingival calculus to meet the patient requirements for the clinical demonstration. The insufficient degree of subgingival calculus present in the Petitioner's patient prior to the clinical exam precluded the Petitioner from passing the exam. The Petitioner received a total deduction of 26 points (6.5 points deducted for each of the four surfaces upon which no subgingival calculus was detected) and failed the exam with a score of 74. The Petitioner offered no credible evidence that the panel of examiners improperly reviewed her performance on the exam or that the score she received on the November 5, 2010, administration of the exam was in any manner incorrect. At the hearing, the Petitioner testified that she is licensed as a dental hygienist in another state, that the examinations in both states were conducted by the same regional testing agency, and that the scores from the other state should be accepted by the Respondent for licensure of dental hygienists in Florida. Florida law does not provide for dental hygienist license reciprocity.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that the Department of Health enter a final order dismissing the Petitioner's challenge to the scoring of the exam referenced herein. DONE AND ENTERED this 31st day of May, 2011, in Tallahassee, Leon County, Florida. S WILLIAM F. QUATTLEBAUM Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 31st day of May, 2011. COPIES FURNISHED: Morris Shelkofsky, Esquire Department of Health 4052 Bald Cypress Way, Bin A02 Tallahassee, Florida 32399-1703 Colette Michele Gatward 2212 Margarita Court Kissimmee, Florida 34741 R. S. Power, Agency Clerk Department of Health 4052 Bald Cypress Way, Bin A02 Tallahassee, Florida 32399-1703 H. Frank Farmer, M.D., Ph.D., Secretary State Surgeon General Department of Health 4052 Bald Cypress Way, Bin A00 Tallahassee, Florida 32399-1701 E. Renee Alsobrook, Acting General Counsel Department of Health 4052 Bald Cypress Way, Bin A02 Tallahassee, Florida 32399-1701
Findings Of Fact Dr. Roberts and His Background Dr. Steven Roberts is a dentist licensed to practice in the State of New York. He attended the United States Military Academy and received his undergraduate degree in 1970. He graduated from the New York University College of Dentistry in 1978, and practiced dentistry in New York, New York from 1978- 1987. To be licensed in New York, Dr. Roberts passed the national boards and the northeast regional board examination. During the course of his practice in New York, Dr. Roberts never received a complaint or had a claim for malpractice made or filed against him. Clinical Examinations Dr. Roberts took the Florida clinical dental examinations in June of 1986, January of 1987, and June of 1987. His grade on the June of 1987, examination is the subject of this proceeding. Dr. Roberts has successfully passed the written examination and the diagnostic examination required for licensure by Section 466.066(4)(a) and (c), Florida Statutes. Dr. Roberts' score for the June of 1987, clinical dental examination was 1.95; the minimum passing score is 3.00. The procedures tested during the June 1987, Clinical Dental Examination and Dr. Roberts' scores were as follows: The Procedure The Score The Revised Score Periodontal 1.67 Amalgam Cavity Preparation 1.67 Amalgam Cavity Restoration 3.00 Composite Preparation .67 Composite Restoration .33 Posterior Endodontics 2.00 3.66 Cast Preparation 2.67 3.00 Pin Amalgam Preparation 1.00 Pin Amalgam Restoration 1.67 Denture 3.63 Total Score 1.95 2.15 Dr. Roberts made a timely request to review his grade, and filed objections to his grades; a regrading procedure resulted in the regrading of his scores for posterior endodontics and cast restoration as set forth above. Each of the procedures tested in the clinical dental examination is scored by three different examiners. For each procedure examiners record their scores on separate 8 1/2" X 11" sheets. Each sheet has a matrix of circles which are blackened with a pencil so that they can be machine scored. On each sheet the candidate's identification number and the examiner's identification number are recorded along with the number for the procedure involved and the candidate's grade. On the sheet for each procedure the criteria for successful performance of the procedure are printed, along with preprinted comments which the examiners may use to explain the reason for the grade assigned. These comments relate to the criteria being examined. The following grades may be assigned by examiners: Complete failure Unacceptable dental procedure Below minimum acceptable dental procedure 3- Minimum acceptable dental procedure 4- Better than minimal acceptable dental procedure 5- Outstanding dental procedure An examiner is not required to mark a comment if the grade assigned is 5, a comment is marked for any grade below 5. Each procedure is graded in a holistic manner. Grades assigned by each of the three examiners for a procedure are averaged; the averaged scores for each procedure are then weighted and the weighted scores are summed to provide the overall clinical grade. By averaging the scores of three examiners for each procedure, variation from examiner to examiner is minimized. The examiners are experienced Florida dentists selected by the Board of Dentistry. An examiner must have at least five years of experience as a dentist and be an active practitioner. Potential examiners attend a standardization training exercise. This training is required by Section 466.006(4)(d), Florida Statutes. Its purpose is to instruct examiners in examination procedures and the criteria to be applied in grading. Through the training the examiner group as a whole arrives at a consensus opinion about the level of grading, so that candidates' scores on the examination will be valid and reliable. The training attempts to focus on each examiner's subjective, internalized evaluation criteria, so that they can be modified, as necessary, to reflect the consensus of all graders. A standardizer explains grading criteria to the potential examiners, and discusses various divisions among schools of thought and training on the procedures which will be the subject of the examination. The standardizer uses dental exhibits from prior dental exams as examples, and identifies grades and errors on the exhibits so that the graders learn and can adhere to uniform grading standards. The training focuses on three problems which professional literature has identified in evaluation: errors of central tendency, proximity errors, and bias a priori. Errors of central tendency result when graders are uncertain of criteria, hesitate to give extreme judgments, even in appropriate cases, and thus tend to improperly grade near the average. Proximity error is a type of halo effect which is applicable in grading of mannequin exhibits. The examiner grades all of the mannequin exhibits for each candidate at one time. If the first example of the candidate's work is especially good, and deserves a grade of 5, the grader may tend to transfer a generally positive attitude towards the next example of the candidate's work and assign a grade which may not be based solely upon the merits of that second piece of work. The same process can improperly depress the grades on subsequent mannequins if the first example of a candidate's work is poor. Bias a priori is the tendency to grade harshly or leniently based upon the examiner's knowledge of the use that will be made of the grade, rather than only on the quality of the work graded. After an 8 to 12 hour standardization training session, the Department administers an examination to those who have been trained. Those with the highest scores become the examiners, i.e., dentists who will grade candidates' work, while those with the lower scores in the training session become monitors, who supervise the candidates in their work on mannequins or on patients, but who do not actually grade student work. There is, however, no minimum score which a dentist who attends the standardization session must obtain in order to be an examiner rather than a monitor. This results, in part, from the limited pool of dentists who participate in the examination processes as monitors or examiners. For the 1987 clinical dental examination 31 dentists accepted selection by the Board and attended the standardization session, 20 were then selected as examiners and 11 became monitors for the examination. None of the dentists who attended the standardization session were dismissed by Department of Professional Regulation from further service at the examination session. The process by which the Department selected the examiners for the 1987 clinical dental exam was neither arbitrary nor capricious, but comports with Rule 21G- 2.020(4), Florida Administrative Code. The standardization training and examination of dentists to determine who will serve as examiners and monitors does not provide any bright line for distinguishing among potential examiners those who will make the most assiduous effort to apply the grading criteria explained in the training session versus those who retain an innate sense of a passing work based on what the examiner considers acceptable work in his own practice. The effort to convey to examiners the standard of "minimum competency" has imperfect success, but the Department's training is appropriate. Out-of-State Candidates' Scores 11. There is a substantial difference in the failure rates for out-of- state candidates and for in-state candidates on the clinical dental examinations. In the June of 1987, exam 82.5% of the candidates who graduated from the only in-state dental school, the University of Florida, passed the entire examination, while 54.2% of the out-of-state graduates passed, and only 37.8% of candidates from foreign schools were successful. Overall, 86.5% of the candidates passed the written portion of the examination, 93.5% the portion on oral diagnosis, but only 63.3% the clinical portion of the examination. Dr. Roberts has failed to prove that the lower pass rate for out-of- state candidates is the result of any sort of conscious effort on the part of examiners to be more stringent in grading out-of- state candidates. Dr. Kennedy's testimony indicated only that the data bear more analysis, not that they prove improper grading. Procedures Performed on Mannequins The Board of Dentistry tests between 600 and 700 dental candidates per year. It is extremely difficult for the candidates to find patients who have exactly the problem which is to be tested and bring them to the examination to work on. Some portions of the clinical dental examination, therefore, are not performed on patients, but on cast models of human teeth which resemble dentures, and which are known as mannequins. This is expressly authorized by Section 466.006(4)(a), Florida Statutes. The notice to appear which candidates receive approximately 30 days before the examination informs them of the types of mannequins which will be used in the examination. Before that time, however, dental supply companies obtain lists of those eligible to take the examination, and contact the candidates in an attempt to sell them the mannequins. Candidates must bring mannequins with them to the examination and can purchase additional mannequins for practice. Testing with mannequins is also more efficient because with live patients, the student must be graded at the time of the examination, while a model can be retained and graded a day or two later. The decision of the Board to have certain procedures performed on mannequins, so that each candidate would be graded on exactly the same procedure, is reasonable. The Board had also considered having students perform all test procedures on extracted human teeth, but there are not a sufficient number of all natural teeth available, given the number of students who are tested, both for the examination itself and for practice. The Board determined that it would be better to use mannequins for some of the procedures tested in the examination because they are readily available and students can purchase extra copies for practice. For certain procedures, such as endodontics, specific natural teeth (such as first bicuspids) are often extracted and so are generally available; for procedures performed on those teeth, it is possible to have candidates work on human teeth. By contrast, testing procedures performed on teeth such as incisors is not practicable. It is impossible to obtain enough incisors in good condition, without restorations and chips, for use during an examination. The statute governing the dental examination does require that one restoration performed by candidates must be done on a live patient, and for the June 1987, clinical dental examination that procedure was a class 2 amalgam restoration. The Board directed by rule that mannequins be utilized for five test procedures: the pin amalgam preparation and restoration, Rule 21G-2.013(3)(d), Florida Administrative Code; the endodontic procedure, Rule 21G-2.013(3)(e) Florida Administrative Code; the posterior tooth preparation for a cast restoration, Rule 21G-013(3)(f), Florida Administrative Code, the class III acid etch composite preparation and class IV acid etch composite restoration, Rule 21G-2.013(3)(g), Florida Administrative Code. Performing these procedures on mannequins is not exactly the same as performing procedures on human teeth in a patient. In view of the difficulty involved in finding patients whose teeth present virgin lesions, so that each candidate would be tested on exactly the same problem, the difficulty in grading a large number of procedures performed on live patients, and the difficulty in obtaining a large number of human teeth necessary for testing and for practice, the Board's decision to use the mannequins for these procedures is reasonable. The Legislature recognized this in Section 466.006(4)(b), Florida Statutes, which prescribes that the clinical dental examination shall include restorations "performed on mannequins, live patients, or both. At least one restoration shall be on a live patient." The Board was within its authority when it determined the procedures to be performed on mannequins. Violation of Blind Grading The dental examiners who grade the work of candidates grade blindly, i.e., they do not know which candidate's work they are grading. The Clinical Monitor and Examiner Instruction Manual for the June of 1987, examination makes this clear. At page 24 paragraph 3 the Manual states Examiners are requested to disqualify themselves at anytime they are presented with models or patients treated by a dentist who they know personally or with whom they have had professional contact. All examiners are requested to give department staff the name of any examination candidate who is personally known to them to be taking the exam. The department staff will assist the examiners in avoiding any work performed by the candidates they know. Rationale: Allegations have been made about examiners who knew candidates taking the exam even though the examiners only see candidate numbers. Monitors and Examiners are strongly urged to avoid discussion with candidates about the examination. Even conversation about non-examination related matters can be misinterpreted by other candidates as an unfair privileged communication. Despite this admonition, one of the examiners, Dr. Cohen, who knew Dr. Roberts, graded the work of Dr. Roberts. Dr. Cohen met Dr. Roberts the first time Dr. Roberts took the Florida Clinical Dental Examination in June of 1986. Dr. Roberts had with him a bag which would have identified him as a student from New York University, where Dr. Cohen had taught. Dr. Cohen came over to Dr. Roberts, introduced himself, gave Dr. Roberts his card, (exhibit 44) and invited Dr. Cohen to his hotel room where they discussed practicing dentistry in Florida. In 1986 Dr. Cohen was associated with another dentist, Gerald P. Gultz, who had recently moved to Florida from New York. Dr. Gultz had also been a part-time clinical assistant professor of dentistry at New York University College of Dentistry. After Dr. Cohen returned from the June 1986, administration of the clinical dental examination, he had a conversation with Dr. Gultz in which Dr. Cohen asked Gultz if he knew Dr. Roberts, and commented on Dr. Roberts performance on the clinical examination. Dr. Cohen said Dr. Roberts had done terribly, and Dr. Cohen believed that Dr. Roberts would never get his license to practice in Florida. (Tr. 5/26/88 at 73). Dr. Roberts saw Dr. Cohen at the January of 1987, clinical dental examination, but they did not speak. In June of 1987, Dr. Cohen also spoke briefly to the wife of Dr. Gerald Gultz, Lauren Gultz, saying that he would be seeing Dr. Roberts at the June of 1987, clinical dental examination, which was coming up. He told Mrs. Gultz that Dr. Roberts was a poor practitioner, and that he did not think he would pass the examination. At the June 1987, exam, Dr. Roberts' periodontal patient was his uncle, Mr. Finkelstein. Dr. Cohen was one of the examiners who reviewed Mr. Finkelstein to determine whether his condition was appropriate to serve as a patient for Dr. Roberts on the periodontal portion of the examination. Dr. Cohen had a conversation with Mr. Finkelstein in which he told him "tell your dentist to do a good job". Because Mr. Finkelstein had stated that his dentist was a graduate from N. Y. U. Dental School, Mr. Finkelstein was convinced that Dr. Cohen knew exactly who the dental candidate who would work on Dr. Finkelstein was -- Dr. Roberts. After accepting Mr. Finkelstein as an appropriate periodontal patient, Dr. Cohen also served as a grader on the periodontal procedure performed on Mr. Finkelstein. After grading the work which Dr. Roberts had done, Dr. Cohen told Mr. Finkelstein to tell his dentist that Dr. Cohen would see him later in the hotel where they were staying. At the hotel, Dr. Cohen talked to Dr. Roberts about the dental examination, that he himself had to take the examination three times, although he considered himself to be a superior dentist, and that Dr. Cohen could help Dr. Roberts with his grades but that he could never grade Dr. Roberts more that one grade higher than any of the other examiners. Dr. Cohen served as an examiner (i.e. grader) for Dr. Roberts on six of the nine procedures tested. There were: procedure number 1, the periodontal evaluation where he assigned a failing grade of 2; procedure number 4, the class III composite preparation, where he assigned a failing grade of 1; procedure number 5, the class IV composite restoration, where he assigned a failing grade of 1; procedure number 6, the endodontic evaluation, where he assigned a passing grade of 3; procedure number 7, the preparation for a cast restoration, where he assigned a passing grade of 3; and procedure number 8, the pin amalgam preparation, where he assigned a failing grade of 1. This failure of blind grading is a serious irregularity in the evaluation of Dr. Roberts' performance on the 1987 clinical dental examination, given his prior negative comments about Dr. Roberts before the examination. By ignoring those scores, Dr. Roberts would be evaluated only by two examiners, on all the procedures for which Dr. Cohen gave a grade. This would mean that his scores would not be comparable with those of any other candidate, for his grade on each procedure would not be the result of blind grading by three independent examiners. Dr. Roberts' Challenges to Grades Assigned by Other Examiners The full nine procedures evaluated in the 1987 dental clinical examination and Dr. Roberts' grades were: A periodontal exercise performed on a live patient, Mr. Finkelstein, which involved the scaling of five teeth both above and below the gum and stain removal. Dr. Roberts was assigned scores of 1, 2, and 2 by the examiners (one grade of 2 was assigned by Dr. Cohen) An amalgam cavity preparation, performed on a live patient, Elizabeth Cox, which is the preparation of a tooth for filling. When the preparation is completed a proctor escorts the patient to the three examiners who independently grade this part. After grading, the patient returns to the candidate who completes the filling of the tooth (the restoration) which is subsequently graded independently by three examiners. Dr. Roberts was assigned grades of 1, 1, and 3 for the preparation (none of these grades were assigned by Dr. Cohen). A final amalgam restoration, which is the filling of the tooth prepared in the prior procedure. Dr. Roberts received grades of 3, 3, and 3 on this procedure (none of the grades were assigned by Dr. Cohen). A class III composite preparation, which is preformed on a model, not a live patient. This involves removing decay and shaping a tooth to hold a class III filling, i.e., one located on the side surface of an incisor. Dr. Roberts received scores of 1, 0, and 1 (Dr. Cohen assigned one of the grades of 1) A class IV composite restoration, which is performed on a model, not a live patient. This involves restoring a fractured tooth with a composite restoration material. On this procedure Dr. Roberts received scores of 0, 0, and 1 (Dr. Cohen assigned the grade of 1). An endodontic evaluation performed on a posterior tooth, which is performed on a mannequin, and involves the opening of a molar, and identification of the canals in the tooth in preparation for a root canal procedure. Originally Dr. Roberts received grades of 3, 3, and 0 (one of the grades of 3 was assigned by Dr. Cohen). Dr. Roberts work was regraded by three new examiners and the grades of the original examiners were discarded. Dr. Roberts ultimately received a grade of 3.67 on the endodontic portion of the examination A preparation of a posterior tooth for a cast restoration, which is performed on a mannequin. It involves preparing a tooth to receive a crown. Dr. Roberts' original grades were 2, 3, and 3 (Dr. Cohen had assigned a grade of 3 on this procedure). On review, Dr. Roberts' was regraded by three new examiners, and the original grades were discarded. Dr. Roberts received a final grade of 3 on this portion of the examination. A pin amalgam preparation, which is performed on a model, not on a live patient. This involves the preparation of a tooth to hold an amalgam filling by inserting a pin into a portion of the tooth, which serves to anchor the filling. Dr. Roberts was assigned grades of 2, 0, and 1 on this procedure (Dr. Cohen assigned the grade of 1). Pin amalgam final restoration, which is performed on a model. It involves filling a tooth with amalgam filling material. Dr. Roberts was assigned grades of 2, 1, and 2 on this procedure (Dr. Cohen assigned one of the grades of 2). Due to the involvement of Dr. Cohen in so many of the procedures involved here, Dr. Roberts performance on the June of 1987, clinical dental examination was not fairly evaluated. A fair evaluation cannot be provided after the fact by merely dropping Dr. Cohen's grades, because Dr. Roberts' performance would not be subject to the independent evaluation of three examiners. Dr. Roberts relies, to a large extent, on the testimony of Dr. Gultz as the basis for regrading his procedures to a passing grade of 3, or better. The testimony of Dr. Gultz does not, however, show that he has ever participated in the standardization exercises for examiners at Florida clinical dental examinations. Dr. Gultz experience as a clinical professor of dentistry at New York University provides a substantial basis for his evaluation of dental procedures. The difficulty, however, is that as with any qualified examiner, his evaluations will be based on internalized standards which are personal to him. There is no way to know whether Dr. Gultz standards for adequate performance are equivalent to those which the standardization training produces among examiners at the standardization exercise before a clinical dental examination. The standardization process "attempts to bring all examiners to the same level of grading, so that each [examiner] is grading in a valid and reliable manner." Clinical Monitor and Examiner Instruction Manual, June of 1987, at page 42. The Florida dental clinical examination uses a holistic grading method. Each score sheet which an examiner fills out has on it the criteria to be applied in evaluating the candidates performance on that procedure. They all contain a statement which reads: It is the intent of the Board that each of the criteria are to be accorded equal importance in grading. Equal importance does not mean that each criteria has a numerical or point value, but means that any one of the criteria, if missed to a severe enough degree so as to render the completed procedure potentially useless or harmful to the patient in the judgment of the examiner, could result in a failing grade on the procedure. The criteria do not have any assigned numerical or point value, but are to be utilized in making a holistic evaluation of the procedure. Each grading sheet also points out to the examiner certain critical factors which, if present, require a grade of 0 for the procedure. The standardization in grading which the Board diligently attempts to achieve through the standardization training and the standardization testing of examiners done at the close of the training is elusive at best. Nonetheless, in the absence of showing that Dr. Gultz standards of evaluation are equivalent to those of an examiner trained at a standardization session, it is impossible to know whether his standards of evaluation are more rigorous or less rigorous than those reflected by the grades assigned to other candidates by the corps of examiners which evaluated the work of candidates at the June of 1987, clinical dental examination. The same is true with respect to the testimony of Dr. Simkins, the expert for the Board in this proceeding. No useful purpose would be served in attempting to choose between the testimony of Dr. Gultz, on the one hand, and the testimony of Dr. Simkins and of the other examiners who testified by deposition in this proceeding. If this were to be done, all the hearing officer would have determined is whose testimony about the appropriate grade to be assigned for each procedure is more believable. On this record it would be impossible to make a further finding about whether that more believable testimony reflects a scoring standard more stringent, less stringent or the same as that generally applied to all candidates by the corps of examiners in the June of 1987, clinical dental examination.
Recommendation It is recommended that the results of the clinical dental examination which Dr. Roberts took in June of 1987, be found invalid, and that he be permitted to take the next clinical dental examination offered by the Department of Professional Regulation at no cost to him. DONE AND ENTERED in Tallahassee, Leon County, Florida, this 8th day of December, 1989. WILLIAM R. DORSEY, JR. Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 8th day of December, 1989.
The Issue The issue presented is whether Petitioner achieved a passing score on the June 1999 Florida dental licensure examination.
Findings Of Fact Petitioner is licensed to practice dentistry in California and was also licensed in Georgia until he permitted his Georgia license to become inactive. He has been engaged in the active practice of dentistry for thirteen years. He has never been sued. Petitioner took the June 1999 clinical portion of the Florida dental licensure examination. He was subsequently advised that he had not achieved a passing score. Petitioner challenges the score he received on two portions of the clinical examination: his amalgam cavity preparation on the patient and his endodontic procedure on an extracted tooth. Petitioner's patient had a cavity between two teeth, although it was much lower than the contact point. The patient also had a large non-contiguous cavity in the front of the same tooth. Petitioner determined that he wished to save as much of the tooth as possible knowing that the large cavity in the front of the tooth would need to be filled. Because of the manner in which it was necessary to prepare the tooth to preserve the maximum amount of structure, he generated a monitor note explaining his approach. When he located the monitor to whom he would turn in his note, that monitor was busy viewing another patient and motioned for Petitioner to place the note at the monitor's station. Petitioner placed the note in the monitor's chair and returned to his patient. Petitioner completed the preparation procedure. While doing so, he noticed that his patient's tooth had a dead tract, a rare dental defect that would not interfere with the process. This was only the second time that Petitioner had seen a dead tract in a tooth despite his many years of practice. The first time had been while Petitioner was in dental school When his patient was graded, two of the three graders gave Petitioner a score of "0," noting that caries remained. The third grader saw no caries but noted debris remained. What the two examiners mistook for further decay was the dead tract. No debris remained. The other comments of the graders suggested that they had not seen the monitor note generated by Petitioner explaining the manner in which he was preparing the tooth and why. Despite the alleged presence of decay, Petitioner was instructed to proceed to fill the cavity. The extracted tooth on which Petitioner performed his endodontic procedure was an "easy" tooth with large canals. One grader gave Petitioner a "5," which is a perfect score. One grader gave him a "3," and the other gave him a "0." Only the grader who gave Petitioner the "0" noted that the tooth was perforated. The tooth Petitioner worked on had no perforation on the inside, and the x-rays taken during the process revealed no file or gutta percha filling off to the side of the canals. Petitioner did not perforate the tooth during his endodontic procedure. Petitioner properly performed both the amalgam cavity preparation on his patient and the endodontic procedure on the extracted tooth. He should be awarded full points on both procedures. The additional points are sufficient to give Petitioner a passing score.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a final order be entered finding that Petitioner achieved a passing score on the June 1999 dental licensure examination. DONE AND ENTERED this 26th day of January, 2000, in Tallahassee, Leon County, Florida. LINDA M. RIGOT Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 26th day of January, 2000. COPIES FURNISHED: Bill Buckhalt, Executive Director Department of Health Northwood Centre 1940 North Monroe Street Tallahassee, Florida 32399-0750 Angela T. Hall, Agency Clerk Department of Health 2020 Capital Circle, Southeast Bin A02 Tallahassee, Florida 32399-1703 Gregory K. Barfield 2555 Collins Road, Penthouse 114 Miami Beach, Florida 33140 Gregory K. Barfield Post Office Box 102 Rancho Sante Fe, California 92067 Adam Keith Ehrlich, Esquire Department of Health 2020 Capital Circle, Southeast Bin A02 Tallahassee, Florida 32399-1703
The Issue The issue for determination is whether Petitioner successfully completed the clinical portion of the December 1997 dental hygiene examination.
Findings Of Fact In December 1997, Brandy Kern was a candidate for the dental hygiene examination (Examination). Ms. Kern had completed her dental hygiene studies at the University of Pittsburgh on or about April 29, 1995. She was an excellent student. Prior to making application for the Examination, Ms. Kern had obtained experience in dental hygiene by working as a dental hygienist in at least three dental offices over at least a two-year period in the State of Pennsylvania. Her employers, who were dentists, gave Ms. Kern very positive recommendations. Ms. Kern successfully completed all portions of the Examination, except for the scaling/calculus removal portion of the clinical part of the Examination. As a result, Ms. Kern did not successfully complete the overall Examination. The clinical examination consists of three parts: scaling and calculus removal, polishing, and root planing. The overall score for the clinical examination is determined from all three portions. Scaling and calculus removal counts as 70 per cent of the clinical examination; polishing as 10 percent; and root planing as 20 per cent. Each dental hygiene candidate is graded by three examiners. The clinical portion of Ms. Kern's examination was scored by three examiners. The examiners were 197, 243, and 320. Each examiner is a dental hygienist licensed in the State of Florida and is an experienced dental hygienist. An examiner must be recommended by an existing examiner or by a member of the Board of Dentistry (Board), have no complaints against their license, and be actively practicing. To become an examiner, an application must be completed and submitted to an examination committee of the Board. The committee reviews the application and, if approved, the applicant is placed in a pool of examiners. Before every examination, each examiner is trained in evaluating a procedure to make sure that it is properly performed. The Department of Health (Department) conducts a training in which each examiner is trained to grade using the same internal criteria. Such training results in a standardization of grading criteria. In this training process, the examiners are trained by assistant examiner supervisors on the different criteria that are used during the examination. The assistant examiner supervisors are dentists licensed in the State of Florida and are appointed by the Board of Dentistry (Board). To further their training, after the examiners receive their verbal training, the examiners are shown slides of teeth which do not meet the clinical criteria of the examination. To make sure that the examiners have been able to internalize the criteria, following the standardization, the examiners, themselves, are given an examination. Included in the examination is a hands-on clinical, where mannequins are used and the examiners check for errors on the mannequins. After the examiners complete their examination, the Bureau of Testing evaluates the examiners to determine whether the examiners are acceptable to use for the Examination. Subsequent to the Examination, the examiners are scored by the Bureau of Testing. The scoring is based on an examiner's performance wherein the Bureau of Testing examines how every examiner grades with every other examiner to make sure that the examiners are grading with reliability. This review is based on corroborated errors found by an examiner, not on the average errors found by an examiner. The average errors found by an examiner are irrelevant to the examiner's performance in that one examiner may have graded candidates who made numerous errors, while another examiner may have graded candidates who made very few errors. For the Examination, candidates are required to bring human patients on whom the candidates perform the dental procedures. Each examiner grades the Examination independently. The examiners do not confer with each other while scoring the Examination. Furthermore, the Examination is double-blind graded, which is a grading process in which the candidates have no contact with the examiners. The candidates are located in one clinic and perform the dental procedures on their human patient. The clinic is monitored by a licensed dental hygienist. When the candidate completes the procedures, a proctor accompanies the patient to another clinic where the examiners are located, and the examiners grade the procedures performed by the candidates. For the scaling/calculus removal portion of the Examination, the grading criteria is that complete removal of all supra and sub-marginal calculus from each tooth, without laceration to the surrounding tissue, is required. If the tooth is not clean and/or if there is damage to the surrounding tissue, the candidate is considered to have made one (1) error. Pursuant to Board rule, each tooth is judged as a whole. Even if a candidate makes three mistakes in performing the procedure on each tooth, e.g., calculus could be above the gum, calculus could be below the gum, and/or the gum could be lacerated, only one (1) error is counted against the candidate. The examiners do not document what error was committed by the candidate, i.e., whether the error is a calculus error or a laceration error. In grading the scaling/calculus removal portion of the Examination, a grade of five is the highest grade that a candidate can receive. A five is given if there are zero to three errors found. A grade of four is given if there are four errors found. A grade of three, which is considered to be minimally competent, is given if there are five errors found. A grade of two is given if there are six errors found. A grade of one is given if there are seven errors found, and a grade of zero is given if eight or more errors are found. For an error to be counted against a candidate, at least two of the three examiners must corroborate the error, i.e., at least two of the examiners must find the error. For Ms. Kern's clinical examination, she was scored by examiners 197, 243, and 320. All three examiners participated in the standardization training and were considered qualified to act as examiners for the Examination. Ms. Kern's examination was double-blind graded. Each examiner independently graded her examination. Examiner 197 found one error. Both examiners 243 and 320 found seven errors each. Examiners 243 and 320 agreed on six of seven teeth on which errors were found. Consequently, Ms. Kern was considered to have committed six errors. A post-examination review of the examiners was conducted. Examiners 243 and 320 were found to be reliable in their scoring. However, examiner 197 was found to be unreliable in his scoring. Examiner 197 was not used again for the Examination. The scoring of six errors made by Ms. Kern on the scaling/calculus removal portion of the Examination is not arbitrary or capricious or an abuse of discretion. The scoring process is not devoid of logic and reason. However, because examiners do not document the type of error committed by a candidate, a candidate has no way of knowing what detail of a procedure was improperly performed. The candidate only knows that a procedure, as a whole, was improperly performed. Consequently, a candidate who desires to re-take the Examination has no idea what procedure needs improvement by the candidate in order to prepare for a re-taking of the Examination.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that the Department of Health, Board of Dentistry enter a final order dismissing Brandy Kern's examination challenge to the clinical portion of the dental hygienist licensure examination administered in December 1997. DONE AND ENTERED this 6th day of August, 1998, in Tallahassee, Leon County, Florida. ERROL H. POWELL Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 6th day of August, 1998.
The Issue The issue in this case is whether the Department should give the Petitioner a passing grade on the June, 1993, Board of Dentistry Clinical Examination.
Findings Of Fact The Petitioner, Jose P. Cruz, took the June, 1993, Board of Dentistry Clinical Examination. Initially, he received a grade of 2.91, whereas a grade of 3.0 is passing. He requested a review of his grades and received some additional credit, raising his grade for the examination to 2.98--still failing, but quite close to a passing grade. The examination grade is a weighted aggregate made up of scores given on each tested procedure, using a formula for weighting the scores on each procedure. The possible scores for each procedure range from zero to five, with a score of three considered "passing" for a particular procedure. Likewise, weighted aggregates can range from zero to five, with a grade of 3.00 passing. Each procedure performed by the Petitioner (and the other examinees) was graded by three graders from pool of qualified graders. The Petitioner's graders not only were qualified, but they also were "standardized." "Standardization" is a process undertaken on the day before the examination to explain to the prospective qualified graders for an examination the criteria for grading the different procedures and how the criteria should be evaluated. The purpose of "standardization" is to insure that the graders are looking at the criteria in the same way, so that ideally each grader would grade the same performance the same way. Averaging the scores given by three "standardized graders" increased the reliability of the examination results. Procedure 8 on the examination was a pin amalgam preparation on an ivorine (plastic) tooth. Criteria for the procedure include: (a) outline; (b) depth; (c) retention; (d) pin placement; and (e) mutilation of opposing adjacent teeth. Two of the three graders gave the Petitioner a score of 3 on Procedure 8; the other gave him a 2. Procedure 9 on the examination was a pin amalgam final restoration on an ivorine (plastic) tooth. Criteria for the procedure include: (a) functional anatomy - appropriate occlusal and interproximal anatomy; (b) proximal contour and contact - contact is considered present when resistance is met with specified floss given at the time of the exam; (c) margins; (d) gingival overhang - overhang is considered to be excess amalgam in either a proximal or gingival direction at the gingival cavosurface margin; and (e) ma[n]agement of soft tissue. Two of the three graders gave the Petitioner a score of 2 on Procedure 9; the other gave him a 3. An ivorine (plastic) tooth is not the same as a real tooth. It is easier to carve, but it does not have the major external and internal landmarks created by the enamel, dentin and nerve root of a real tooth. Without additional instructions, the latter differences make it difficult or impossible for the examinee or a grader to apply certain criteria. The evidence was that the examinees received an examination booklet that instructed them to "treat simulated teeth as normal human teeth, that is, assume the simulated teeth have the same enamel, dentin, and pupil morphology as human teeth." The instruction in the examination booklet, by itself, leaves some important questions unanswered. "Normal human teeth" differ in the thickness of the enamel, not only from one person to another but also from tooth to tooth within any one person's mouth and even from place to place on any one tooth. Also, the direction in which the enamel rods run in "normal human teeth" differ, depending essentially on the shape of the tooth. The direction of the enamel rods is important in determining whether enough dentin is left under the enamel rods to support the enamel. "Normal human teeth" also have fissures, i.e., little cracks and grooves, and the margins of a preparation and restoration should be extended to include fissures that cannot be eliminated by enamelplasty. But ivorine teeth do not have all the fissures normal teeth have. As a result of these difference between "normal human teeth" and the test mannequin's ivorine teeth, it still would be difficult or impossible--even with the information in the examination booklet--for an examinee or a grader to apply, with any degree of precision, the following criteria for Procedure 8: outline form; depth of preparation; and retention. In addition, as to Procedure 9, functional anatomy depends upon a tooth's interaction with its opposing and adjacent teeth, but the mannequins did not have opposing teeth. As a result, it still would be difficult or impossible--even with the information in the examination booklet--for an examinee or a grader to apply, with any degree of precision, the criterion functional anatomy for Procedure 9. Similarly, the ivorine teeth in the mannequins were cemented in place, and points were to be deducted for moving them. This made it difficult, if not impossible--even with the information in the examination booklet--for the candidates to control proximal contour and contact, which are criteria for Procedure 9. Despite the deficiencies in the information in the examination booklet, taken by itself, there also was evidence that the graders were instructed orally during standardization, and the candidates were instructed during an orientation prior to the administration of the examination, that they were to assume an "ideal, minimal preparation" and that the purpose of the examination was simply to demonstrate basic knowledge of acceptable techniques. They also were told to assume "normal" or "ideal" enamel thickness of approximately 0.5 millimeter. Given those qualifications, they were told that the preparations were to have a "normal outline form" and "normal depth." As for functional anatomy, they were told that restorations were to "set up ideal (or normal) occlusion" by making the marginal ridges even and by replacing the restoration to the "normal shape of a cusp of a tooth." As for proximal contour, a restoration's marginal ridges were to meet (i.e., match) those of the adjacent tooth. Candidates also were allowed to ask questions as part of the orientation to clarify the oral instructions, as necessary. Given the additional oral instructions, the candidates and graders were given a clear enough understanding of the examination criteria. Evaluation of the candidates' and the graders' performance by the Department's psychometrician indicated that the examination was valid and reliable. The Petitioner's performance of Procedure 8 was primarily deficient in that the outline form was 0.25 millimeter short of the lingual occlusal groove, which was clearly visible on the ivorine tooth and which should have been included within the outline form. The Petitioner did not prove that his performance of the procedure, when looked at as a whole, should have been given a passing grade. The Petitioner's performance of Procedure 9 was primarily deficient in that the restoration did not replace the "normal shape of a cusp of a tooth" and that the marginal ridges did not meet those of the adjacent tooth. The Petitioner did not prove that his performance of the procedure, when looked at as a whole, should have been given a passing grade. There was evidence that, since the examination on ivorine teeth only simulates real teeth, which are easier to carve than real teeth, and is necessarily limited to a demonstration of basic knowledge of acceptable techniques, the examination does not directly test the candidate's ability to actually practice dentistry. But, due to heightened concern for the transmission of infectious disease, including HIV, ivorine teeth have been used in dental schools and in dental clinical examinations exclusively for over ten years, and the Petitioner did not prove that the use of ivorine teeth, instead of extracted real teeth, for his examination was unreasonable.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is recommended that the Department of Business and Professional Regulation, Board of Dentistry, enter a final order denying the Petitioner's examination challenge. RECOMMENDED this 28th day of July, 1994, in Tallahassee, Florida. J. LAWRENCE JOHNSTON Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 28th day of July, 1994. APPENDIX TO RECOMMENDED ORDER, CASE NO. 93-6923 To comply with the requirements of Section 120.59(2), Fla. Stat. (1993), the following rulings are made on the parties' proposed findings of fact: Petitioner's Proposed Findings of Fact. 1. Accepted and incorporated. 2.-4. Accepted but subordinate and not necessary. Rejected as not proven. (The exam should not necessarily measure a person with more dental experience as receiving a higher grade.) Accepted but subordinate and not necessary. Accepted and incorporated. 8.-10. Rejected as not proven. (It would be more accurate to say that the Department's examination reviewer could neither say that the the score of 2 was erroneous or unreasonable or that a score of 3 would have been erroneous or unreasonable.) 11. Accepted and incorporated. 12.-16. Accepted but subordinate and not necessary. (As to 16, however, he reiterated his opinion that the appropriate score was a 2.) 17. Accepted and incorporated to the extent not subordinate or unnecessary. 18.-19. Accepted and incorporated. Rejected as not proven that the dentin is the "stronger material." Otherwise, accepted and incorporated. Accepted and incorporated. 22.-26. Accepted and incorporated to the extent not subordinate or unnecessary. However, as found, notwithstanding the limitations inherent in not being able to see on the ivorine tooth exactly where the enamel would end and the dentin would begin, or where the enamel rods would be, certain basic knowledge of acceptable techniques can be demonstrated on the ivorine teeth, given certain additional instructions. 27.-29. Rejected as not proven. The Petitioner's expert was not "standardized" and was not privy to what the graders were told during standardization or what the candidates were told during orientation. 30. See 22.-26. 31.-32. See 27.-29. 33. See 22.-26. Respondent's Proposed Findings of Fact. 1.-8. Accepted and incorporated to the extent not subordinate or unnecessary. 9.-10. Accepted and subordinate to facts found. 11. Rejected as contrary to the evidence that the Petitioner introduced no competent and substantial evidence in support of his challenge. COPIES FURNISHED: Salvatore A. Carpino, Esquire Colonial Square Office Park 8001 North Dale Mabry Highway Suite 301-A Tampa, Florida 33614 William M. Woodyard, Esquire Assistant General Counsel Department of Business and Professional Regulation Northwood Centre 1940 North Monroe Street Tallahassee, Florida 32399-0750 Jack McRay, Esquire Acting General Counsel Department of Business and Professional Regulation Northwood Centre 1940 North Monroe Street Tallahassee, Florida 32399-0792 William Buckhalt, Executive Director Board of Dentistry Northwood Centre 1940 North Monroe Street Tallahassee, Florida 32399-0792
The Issue The issue in this case is whether Petitioner should receive a passing score on the December 2001 dental license examination.
Findings Of Fact In December 2001, Petitioner took the dental licensure examination and failed to pass the clinical portion of the exam. The examination is a three-day process involving two days of clinical examination. Those two days of clinical examination consist of nine procedures. Four of the nine procedures were challenged by Petitioner. The clinical portion is where the candidate is required to perform certain patient procedures. The work product of the student, or candidate, is evaluated following the performance of those procedures by three examiners. Each examiner grades the candidate independently of whatever score the other examiners may award on a particular procedure. Then the average grade for each procedure is weighted in accordance with requirements of Rule 64B5-2.013, Florida Administrative Code. This produces the overall score for the entire clinical exam. The Department uses three examiners' scores because this provides a more reliable indication of the candidate's competency and true score. Further, each examiner must be a licensed dentist for a minimum of five years and have no complaints or disciplinary actions against their license. Examiners have no contact with the candidate taking the examination and, accordingly, have no idea of who they are grading. To further ensure fairness, each examiner must attend and successfully complete a standardization session. The purpose of these sessions is to ensure that each examiner is trained to use the same internal grading criteria. In standardization, each examiner is thoroughly taught specific grading criteria with the result that examiners are instructed on how to evaluate the work of the candidates. The examiners who graded Petitioner’s examination had successfully completed the foregoing standardization session. Also, the Department’s post-exam check found these examiners’ grading to be reliable. Petitioner contested the score he received on Procedure 4, the Endodontic procedure, a root canal. The Endodontic procedure required removal of infected nerve tissue and blood vessels pulp from the tooth. Petitioner was required to access the canal and pulp tissue from the outside. Then, Petitioner was required to remove the bad nerve and cleanse the canal. Finally, Petitioner was required to seal the canal to prevent recurring bacteria. Petitioner failed to observe a fracture in the tooth. He claimed that a fracture to the root of the tooth was caused by the Department after he reviewed his examination and that no one advised him the root was fractured. Petitioner requested a score of 3.00 for this procedure. However, the Department's witness, Dr. William F. Robinson, a licensed dentist for 32 years who examined the tooth and X-ray prepared by Petitioner, testified that the fracture to the root was noticed in both the X-ray and on the tooth when he examined the same. Additionally, two of the three re-graders also noted the fracture of the root. With regard to Petitioner's preparation of the X-ray at the conclusion of the examination, Dr. Robinson opined that Petitioner caused the fracture to the root during the examination and not the Department, as alleged by Petitioner. Dr. Robinson further opined that even without a fracture to the root of the tooth, Petitioner failed the procedure and the failing grade he received was fair. Dr. Robinson would not recommend that Petitioner receive a passing score of 3.00 on the procedure. The examiners' comments and grades and the testimony of Dr. William F. Robinson establish that Petitioner failed to properly perform this procedure. The grade Petitioner received was fair. Petitioner challenged the grade he received on Procedure 5, the Class IV Composite Restoration of the front tooth, but did not offer any testimony at the hearing as to why the score was not correct for the procedure. Petitioner requested that the score of 1.00 given by one of the examiners be thrown out, thus giving him a passing grade on this procedure. Procedure 5 of the dental licensure examination is a procedure that involves the candidate’s ability to replace the edge of the front tooth with a composite resin material, which is a tooth-colored filling. As established by the examiners’ comments and grades and the testimony of Dr. William F. Robinson, Petitioner failed to properly perform this procedure and the grade Petitioner received was fair. Specifically, the examiners found that the tooth was abraded and the re-grader noted, as did the examiners, the excessive “flash” on the tooth. Dr. Robinson also noted both deficiencies in the procedure. Petitioner contested the score he received on Procedure 6, the Class II Composite Restoration procedure in his original petition, but offered no testimony at the hearing concerning this procedure. Dr. Robinson reviewed the examiners' grades and the tooth prepared by Petitioner and opined that Petitioner’s grade of 2.66 for this procedure is fair. Based on the examiners’ comments and grades and the testimony of Dr. Robinson, Petitioner failed to properly perform this procedure and the grade Petitioner received was fair. Petitioner contested the score he received on Procedure 7, the preparation for a 3-unit Fixed Partial Denture, claiming that on the re-grade one of the examiners reviewed the wrong procedure. The Preparation for a 3-unit Fixed Partial Denture procedure of the dental licensure examination is a procedure that involves the candidate’s ability to provide preparations of two (2) teeth in order to replace a missing tooth with a fixed bridge. Dr. Robinson established that Petitioner’s work on this procedure resulted in one tooth, No. 29, being grossly over reduced and tooth No. 31 was insufficiently reduced. The result of such work is that it is impossible to place a bridge on such an improper preparation. As established by testimony of Dr. Robinson, Petitioner's problem with this procedure resulted from Petitioner’s undercut. This undercut indicated that Petitioner’s preparations were not properly aligned to accept a bridge. Based on the examiners’ comments and grades, and the testimony of Dr. Robinson, Petitioner failed to properly perform this procedure and the grade Petitioner received was fair. The Department's “re-grade” process was utilized in this case. Used to give all candidates who timely request a hearing another chance at passing, the re-grade process allows the Department to go back and determine whether any grades rendered were inconsistent. The Department selects the top three examiners who had the highest reliability from that examination to participate in the re-grade process. The Department maintains post-standardization statistics of the examiners’ performance. In this case, those statistics indicated that Petitioner’s examiners graded reliably. In addition, the Department calculates post- examination statistics for the examiners, which are as follows for the examiners who graded Petitioner’s challenged procedures: Examiner Accuracy Index & Rating #206 95.8-Excellent #375 98.8-Excellent #380 92.1-Good #334 97.8-Excellent #298 95.9-Excellent #375 98.8-Excellent-was an original and a re-grader. All of Petitioner's examiners exhibited a reliability significantly above the minimum acceptable accuracy index of 85.0.
Recommendation Based upon the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a Final Order be entered dismissing Petitioner's challenge to the grade assigned him for the December 2001 dental licensure examination. DONE AND ENTERED this 9th day of October, 2002, in Tallahassee, Leon County, Florida. DON W. DAVIS Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 9th day of October, 2002. COPIES FURNISHED: E. Renee Alsobrook, Esquire Department of Health 4052 Bald Cypress Way Bin A02 Tallahassee, Florida 32399-1703 Jason S. Baker, D.M.D. Westchester Medical Center 95 Grasslands Road, Box 572 Valhalla, New York 10595 R.S. Power, Agency Clerk Department of Health 4052 Bald Cypress Way Bin A02 Tallahassee, Florida 32399-1701 William W. Large, General Counsel Department of Health 4052 Bald Cypress Way Bin A02 Tallahassee, Florida 32399-1701
The Issue Whether the Agency for Health Care Administration (Petitioner or AHCA) is entitled to recover: certain Medicaid payments made to Respondent, Ason Maxillofacial Surgery, P.A., pursuant to section 409.913(11), Florida Statutes (2016); an amount of sanctions imposed pursuant to section 409.913(15); and the amount of any investigative, legal, and expert witness costs that AHCA incurred pursuant to section 409.913(23).
Findings Of Fact Based upon the testimony and documentary evidence presented at hearing, the demeanor and credibility of the witnesses, and the entire record of this proceeding, the following factual findings are made: Petitioner is the state agency authorized to administer and make payments for medical and related services under Title XIX of the Social Security Act, the Medicaid Program, relevant to this proceeding. At all times pertinent to this case, Respondent, an oral and maxillofacial surgery practice operated by Dr. Ason, was enrolled in the Florida Medicaid Program as a Medicaid dental provider. Respondent’s Medicaid provider number was 007294600. Petitioner engaged the services of Dr. Hardeman as its expert and peer reviewer. Dr. Hardeman is a Florida-licensed medical doctor and dentist, who is board-certified in oral and maxillofacial surgery. He practices in the same specialty or subspecialty as Respondent’s provider, Dr. Ason. Respondent stipulated and agreed that Dr. Hardeman meets the requirements and qualifications of a “peer” as defined in section 409.9131, Florida Statutes. Dr. Hardeman’s testimony is credible. Petitioner offered the testimony of AHCA Administrator Olmstead to describe the process by which the audit was conducted. Administrator Olmstead has years of experience in this process, and her testimony is credible. Nurse Kinser holds a Bachelor of Science degree in nursing and is a Florida-licensed registered nurse. She is employed as a registered nurse-consultant for Petitioner. Nurse Kinser is a certified professional coder, having received her credentials from the American Academy of Professional Coders. Her testimony is credible. Respondent offered the testimony of Dr. Fonseca, of North Carolina, as an expert in the field of oral and maxillofacial surgery to opine on the medical necessity of the services provided by Respondent. Respondent offered the testimony of Mr. Dicksen as a coding expert. Mr. Dicksen holds a degree in health information management and is licensed as a registered health information administrator. Mr. Dicksen is not licensed as a medical doctor, oral surgeon or dentist in Florida, and is not trained to read a panorex, X-ray or CT scan in his scope of work. Mr. Dicksen’s lack of medical or dental training in reading medical/dental records seriously detracted from his testimony regarding the proper coding of services. Respondent’s representative, Dr. Ason is a well-educated, board-certified oral and maxillofacial surgeon. His lack of understanding in the various aspects of his coding for services rendered is a disservice to his practice, as it is apparent from his testimony that he cares for his patients. Dr. Ason does not watch the clock during a procedure, but instead he “takes care of [his] patients.” Title XIX of the Social Security Act establishes Medicaid as a collaborative federal-state program in which the state receives federal funding for services provided to Medicaid- eligible recipients in accordance with federal law. The Florida Statutes and rules relevant to this proceeding essentially incorporate federal Medicaid standards. In order to receive payment, a provider must enter a Medicaid provider agreement, which is a voluntary contract between AHCA and the provider. Respondent, as an enrolled Medicaid provider must comply fully with all state and federal laws pertaining to the Medicaid Program, including Medicaid Provider Handbooks incorporated by reference into rules which were in effect during the audit period. AHCA’s Bureau of Medicaid Program Integrity (MPI) is required to identify and recover overpayments to ensure that Medicaid funds are appropriately utilized and to reduce fraud and abuse to the Medicaid Program. Pursuant to section 409.913, MPI conducted an audit of Respondent’s paid Medicaid claims for services rendered to Medicaid recipients between January 1, 2013, and June 30, 2014. The Florida Medicaid Dental Program (Dental Program) covers all medically necessary and dental services to eligible children. The Dental Program is limited in the services and treatments available to persons over 21 years of age. These limited services include relief of pain, suffering, and trauma, and preparation for dentures. The Dental Program does not cover preventive dental care for adults. Administrator Olmstead provided the framework by which this audit was opened, investigated, reviewed and reported. The investigation followed all the required procedures and the audit was properly conducted. On July 6, 2016, AHCA issued a FAR2/ alleging that Medicaid overpaid Respondent $654,485.81 for services that were not covered, in whole or in part, by Medicaid. Additionally, pursuant to section 409.913(23), AHCA sought to assess a sanction of $118,000.00 for the alleged violations. In the FAR, the following “Findings” were set forth (and will be discussed in this Order below): The 2008 and 2012 Florida Medicaid Provider General Handbooks, page 5-4, state that when presenting a claim for payment under the Medicaid program, a provider has an affirmative duty to present a claim for goods and services that are medically necessary. A review of your medical records by a peer consultant in accordance with Sections 409.913 and 409.9131, F.S. revealed that the medical necessity for some claims submitted was not supported by the documentation. Payments made to you for these services are considered an overpayment. (NMN) The 2008 and 2012 Florida Medicaid Provider General Handbooks, page 5-4, require that when presenting a claim for payment under the Medicaid program, a provider has an affirmative duty to present a claim that is true and accurate and is for goods and services that have actually been furnished to the recipient. A review of your medical records revealed that some services rendered were erroneously coded on the submitted claim. The appropriate dental code was applied. These dental services are not reimbursable by Medicaid. Payments made to you for these services are considered an overpayment. (ERROR IN CODING) The 2008 Florida Medicaid Provider General Handbook, pages 2-57 and 5-8 and the 2012 Florida Medicaid Provider General Handbook, pages 2-60 and 5-9, define incomplete records as records that lack documentation that all requirements or conditions for service provision have been met. A review of your medical records revealed that the documentation for some services for which you billed and received payment was incomplete or was not provided. Payments made to you for these services are considered an overpayment. (INSUFFICIENT/NO DOC) The 2011 Dental Services Coverage and Limitations Handbook, page 2-40, states use of Evaluation and Management Services must follow guidelines set by the Physicians’ Current Procedural Terminology (CPT) for E&M code levels. A review of your medical records by a peer consultant in accordance with Sections 409.913 and 409.9131, F.S. revealed that the level of service for some claims submitted was not supported by the documentation. The appropriate code was applied and the payment adjusted. Payments made to you for these services, in excess of the adjusted amount, are considered an overpayment. (LOS) The 2011 Dental Services Coverage and Limitations Handbook, pages 2-38 and 2-39, defines a consultation as a type of service provided by an accredited dental specialist whose opinion or advice regarding the evaluation or management of the specific problem is request by another dentist. The following components must be recorded in the recipient’s dental records: a request and need for consultation from the attending or requesting provider; the consultant’s opinion and any services ordered or performed; and a written report of the findings and recommendations provided to the attending or requesting provider. If the referring provider will not participate in the on-going care of the recipient for this problem, this is not a consultation, but is instead a referral, and should be billed as an examination or appropriate evaluation and management code. The documentation you provided did not meet the criteria for a consultation service. The appropriate code was applied and the payment adjusted. Payments made to you for these services, in excess of the adjusted amount, are considered an overpayment. (NOT A CONSULT) The 2008 and 2012 Florida Medicaid Provider General Handbooks, page 1-3, define global reimbursement as a method of payment where the provider is paid one fee for a service that consists of multiple procedure codes that are rendered on the same date of service or over a span of time rather than paid individually for each procedure code. A review of your medical records revealed that some services, for which you billed and received payment, were covered under a global procedure code. Payments made to you for these services are considered an overpayment. (GLOBAL) The 2011 Dental Services Coverage and Limitations Handbook, page 2-1, states that only those services designated in the applicable provider handbook and fee schedule are reimbursed by Medicaid. You billed and received payment for services that are not covered by Medicaid after the correct code was assigned. Payments made to you for these services are considered overpayments. (NOT A COVERED SERVICE) (emphasis added). AHCA used a statistical analysis to review claims. AHCA obtained a list of claims for 35 randomly selected recipients from the cluster sample program. Petitioner then requested the medical records for those 35 recipients from Respondent. Respondent provided the medical records, and throughout the process has provided additional records when requested. Further, Respondent has not contested the process of the statistical sampling or the statistical methods utilized to establish the validity of the overpayment calculation. Following the issuance of the FAR, and after receiving and reviewing additional documentation, AHCA amended Respondent’s overpayment downward to $640,493.77 and the sanction amount to $106,000.00. Teeth are numbered 1 through 16 from right to left on the upper jaw, and 17 through 32 from left to right on the lower jaw. The wisdom teeth are numbered 1, 16, 17, and 32, and are also called the 3rd molars. Additionally, the mouth is divided into four quadrants: upper jaw left and right, and lower jaw left and right. Not Medically Necessary (NMN) Recipient 7 had seven claims labeled as NMN. Of claims 3, 4, 5, 6, 9, and 12,3/ Dr. Hardeman agreed that the bone grafts were necessary and medically appropriate; however, other causes for disallowance of the claims shall be addressed below. Recipient 23 had two claims labeled as NMN regarding lower jaw bone grafts on teeth 17 and 32. Recipient 23 was a 22-year-old male with impacted wisdom teeth. Dr. Ason extracted the wisdom teeth and then completed bone grafts on the areas. Dr. Hardeman opined that bone grafts were not indicated in this young patient as he would heal without the grafts.4/ Recipient 24 had one claim labeled as NMN regarding a lower jaw bone graft on tooth 17. Tooth 17 is the lower left wisdom tooth. Dr. Ason extracted the wisdom tooth and then completed a bone graft on the area. Dr. Hardeman opined that the graft was not medically necessary because following the extraction, the site should have granulated and healed naturally. Error in Coding CPT code “21210 Graft, bone; nasal, maxillary or malar areas (includes obtaining graft)” is explained with a coding tip as follows: The physician reconstructs the nasal, maxillary, or malar area bones with a bone graft to correct defects due to injury, infection, or tumor resection. The procedure may also be performed to augment atrophic or thin bone, or to aid in healing fractures. The physician harvests bone from the patient’s hip, rib, or skull. Incisions are made overlying the harvest site. Tissues are dissected away to the desired bone. The physician removes the bone as needed for grafting to the defect area. After the bone is harvested, the donor site is repaired in layers. Access incisions are made to the recipient site and the area of bony defect is exposed. The graft is placed to repair the defect and may be held in place with wires, plates, or screws. The access sites are irrigated and sutured closed. Harvesting of the bone graft is not reported separately. If bone graft is not harvested from the patient, modifier 52 Reduced services, should be appended. For harvest of graft by another physician, append modifier 62 Two surgeons, to the applicable bone graft code. CPT code “21215 Graft, bone; mandible (includes obtaining graft)” is explained with a coding tip as follows: The physician reconstructs the mandible with a bone graft to correct defects due to injury, infection, or tumor resection. The procedure may also be performed to augment atrophic or thin mandibles, or to aid in healing fractures. The physician harvests bone from another site on the patient’s body, most commonly the rib, hip, or skull, and repairs the surgically created wound. The physician makes facial skin incisions to expose the mandible and place the graft from the donor site. Occasionally, intraoral incisions are used. The graft is held firmly positioned with wires, plates or screws. The incisions are sutured with a layered closure. Harvesting of the bone graft is not reported separately. If bone graft is not harvested from the patient, modifier 52 Reduced services, should be appended. For harvest of graft by another physician, append modifier 62 Two surgeons, to the applicable bone graft code. For interdental wiring, see code 21497. For application, including removal of an interdental fixation device for conditions other than fracture or dislocation, see code 21110. Because this procedure may be performed for cosmetic purposes, verify coverage with insurance carrier. Supplies used when providing this procedure may be reported with appropriate HCPCS Level II code. Check with specific payer to determine coverage. CPT code 41823 is for the “Excision of osseous tuberosities, dentoalveolar structures.” CDT code D7140 is explained as follows: [E]xtraction, erupted tooth or exposed root (elevation and/or forceps removal) Includes routine removal of tooth structure, minor smoothing of socket bone, and closure, as necessary. Surgical Extractions (Includes Local Anesthesia, Suturing, If Needed, and Routine Postoperative Care) CDT code D7210 is explained as follows: [S]urgical removal of erupted tooth requiring removal of bone and/or sectioning of tooth, and including elevation of mucoperiosteal flap if indicated Includes related cutting of gingiva and bone, removal of tooth structure, minor smoothing of socket bone and closure. CDT code D7220 is explained as follows: [R]emoval of impacted tooth – soft tissue Occlusal surface of tooth covered by soft tissue; requires mucoperiosteal flap elevation. CDT code D7230 is explained as follows: [R]emoval of impacted tooth – partially bony Part of crown covered by bone; requires mucoperiosteal flap elevation and bone removal. CDT code D7240 is explained as follows: [R]emoval of impacted tooth –completely bony Most or all of crown covered by bone; requires mucoperiosteal flap elevation and bone removal. CDT code D7250 is explained as follows: Surgical removal of residual roots (cutting procedure), includes cutting of soft tissue and bone, removal of tooth structure and closure. CDT code D7310 is explained as follows: lveoloplasty in conjunction with extractions – four or more teeth or tooth spaces, per quadrant The alveoloplasty is distinct (separate procedure) from extractions and/or surgical extractions. Usually in preparation for a prosthesis or other treatments such as radiation therapy and transplant surgery. CDT code D7953 is explained as follows: one replacement graft for ridge preservation – per site Graft is placed in an extraction or implant removal site at the time of the extraction or removal to preserve ridge integrity (e.g., clinically indicated in preparation for implant reconstruction or where alveolar contour is critical to planned prosthetic reconstruction). Does not include obtaining graft material. Membrane, if used should be reported separately. Recipient 2’s claim 3, coded as 21210, related to a face bone graft for tooth 15. Following the extraction of tooth 15, Dr. Ason used a bone graft to close the opening in the sinus. Dr. Hardeman opined there was “a hole in the alveolus, the socket.” Dr. Hardeman further opined that “This fee (using code 21210) would be applicable for augmentation of an atrophic ridge, but not for a small graft used in conjunction with the treatment of a sinus exposure.” Dr. Ason testified that when he extracted the tooth “a part of the floor of the sinus . . . came with the root, leaving a defect.” He then saw the Schneiderian Membrane,5/ placed the bone graft, and closed the site. There was no break in the membrane, and a small graft closure was more appropriate. For Recipient 2’s claim at issue, the appropriate code should be D7953. Recipient 4’s claims 3 and 4, both coded as 21215, related to the lower jaw bone grafts for teeth 17 and 18. Dr. Hardeman reviewed the operative note that provided “a large periodontal defect in the area adjacent to Tooth No. 19. It was therefore grafted.” Dr. Hardeman did not find tooth 19 on the panorex, and the reasoning for a graft was “invalid.” Dr. Hardeman opined the grafting was a socket preservation. For Recipient 4’s claims at issue, the appropriate code is D7953. Dr. Ason qualified his operative note, which discussed the “area of teeth #’s 17, 18 where a sulcular incision was made. . . . There was a large defect of bone distal to tooth #19,” with a comment that when he referred to “Area 19” that does not mean that tooth 19 was there, just that he was referring to the area. Dr. Ason’s attempt to re-write the operative note to reflect his current testimony is not persuasive. Recipient 6’s claims 3, 4, 6, and 7, coded as 21215, related to lower jaw bone grafts for teeth 21, 22, 27, and 28; and claim 5, coded as 21210, related to a face bone graft for tooth 12. Recipient 6 had multiple teeth extracted from the lower jaw, and one removed from the upper jaw. Dr. Ason grafted both the bottom and the top where the extractions were completed. Dr. Hardeman opined that these “were merely socket preservation grafts,” and the appropriate code for all the claims should be D7953. Recipient 7’s claims 3, 4, 5, and 6, coded as 21210, related to face bone grafts for teeth 1, 2, 15 and 16. Recipient 7 had teeth 1, 2, 15, and 16 surgically extracted,6/ and Dr. Ason used allograft bone to preserve the alveolar ridge in all four locations. Dr. Hardeman reviewed the panorex, and teeth 1 and 16 were not present on it. Dr. Hardeman could not find a “clear-cut” clinical indication for the grafting done on Recipient 7. For Recipient 7’s claims at issue, the appropriate code should be D7953. Recipient 8’s claims 3 and 4, both coded as 21215, related to the lower jaw bone grafts for teeth 17 and 32. Recipient 8 had multiple wisdom teeth and a supernumerary wisdom tooth removed. Dr. Ason testified that there were “wide-rooted molars with chronic infection” and because of the infection, “it spreads throughout the bone and you can’t predictably take out a root and leave a socket.” Dr. Hardeman found nothing remarkable about these extractions, and opined that these were socket preservation grafts. Dr. Hardeman agreed that it was reasonable to put a graft distal to teeth 18 and 31, but did not alter his opinion that these were socket preservations. For Recipient 8’s claims at issue, the appropriate code should be D7953. Recipient 13’s claim 3, coded as 21215, related to the lower jaw bone graft for tooth 32. Recipient 13 had multiple decayed teeth which were extracted; however, only claim 3 is at issue here. Dr. Hardeman opined the bone graft was not warranted because the distal bone was at the appropriate height. For this claim, the appropriate code should be D7953. Recipient 14’s claim 2, coded as 21210, related to the face bone graft for tooth 1. Recipient 14 had one wisdom tooth extracted. Dr. Hardeman agreed there was a “good defect on the back side of” the tooth and agreed that a graft “could be medically appropriate.” Dr. Hardeman further stated that he would have “tried to do something for that,” however this involved socket preservation grafting, not the higher medical grafting code. The appropriate code should be D7953. Recipient 17’s claims 5 through 8, coded as D41823, related to excision of gum lesions for teeth 2, 3, 4, and 5. These four teeth are in the upper right quadrant; however, Dr. Ason billed for alveoloplasties in four quadrants. AHCA allowed claims 1 through 4, but denied claims 5 through 8 because that would have been double-billing for the same procedure, which is not allowed. Recipient 21’s claim 6 was coded as 21210 for a face bone graft for tooth 16, and claim 8 was coded as 21215 for a lower jaw bone graft for tooth 32. Recipient 21 had four wisdom teeth extracted, and a repair of a sinus exposure on tooth 16. Initially, there was no documentation for a peer review of the procedures billed. After receiving the documentation, Dr. Hardeman opined that these “were socket preservation grafts.” The appropriate code should be D7953. Recipient 23’s claims 3 and 4 were coded as 21215 for lower jaw bone grafts to teeth 17 and 32, and claims 7 and 8 were coded as D7230 for impacted teeth removed for teeth 1 and 16. Recipient 23 had four wisdom teeth removed. Dr. Hardeman opined that bone grafts were not indicated to preserve the integrity of the bone adjacent to the second molars in this young patient. The appropriate codes for claims 3 and 4 are D7953, and the appropriate codes for claims 7 and 8 are D7220 and D7210, respectively. Recipient 25’s claims 4 and 5 were coded as 21215 for a lower jaw bone graft for teeth 19 and 30, and claims 6 and 7 were coded as 21210 for a face bone graft for teeth 1 and 16. Recipient 25 had five teeth surgically removed (1, 16, 17, 19 and 30), and bone grafts placed at sites 1, 16, 19 and 30. Dr. Hardeman opined that some bone grafting may have been medically necessary, but that he would have coded these claims as D7953. The appropriate code for all these claims is D7953. Recipient 26’s claims 3 and 4 were coded as 21215 for a lower jaw bone graft for teeth 22 and 27, and claims 5, 6, 7, and 8 were coded as 21210 for a face bone graft for teeth 2, 3, 14, and 15. Recipient 26, a 30-year-old male had all the teeth in the maxilla removed and all the teeth present in the mandible removed. Bone grafts were placed at sites 2, 3, 14, 15, 22, and 27. Dr. Ason testified that there were a few sinus exposures (of the upper jaw) in “common locations” and he used bone graft to those areas. Dr. Ason also testified that for teeth 22 and 27, these teeth were infected, and when he extracted them, he placed bone graft at those sites. Dr. Ason did not testify that he saw infection in the vacated sites. Dr. Hardeman opined that the procedures may have been medically necessary, but were not properly coded. The appropriate code for all of these claims is D7953. Recipient 28’s claim 7 was coded as D7240 for removal of an impacted tooth 16. Dr. Hardeman reviewed the panoramic X-ray and determined that this tooth was just a partially impacted tooth, as opposed to a completely bone-impacted tooth. The appropriate code for this claim is D7230. Recipient 29’s claim 8 was coded 20680 for the removal of support for tooth 3. Dr. Hardeman candidly admitted that he made an error in determining that Dr. Ason had simply put a screwdriver on hardware in Recipient 29’s mouth to remove screws and plates. Upon an additional review of the operative report, Dr. Hardeman opined that Dr. Ason did make an incision to remove the screws and plates.7/ Recipient 31’s claims 3 and 4 were coded as 21215 for a lower jaw bone graft for teeth 22 and 27, and claims 5, 6, 7, and 8 were coded as 21210 for a face bone graft for teeth 5, 6, 11, and 12. There was no direct testimony on the bone grafts performed on this Recipient. The documentation (Exhibit 18-31: Bates-stamped pages 1031 through 1062) reflected Dr. Hardeman wrote “socket graft” at each claim. However, this is insufficient to support a finding of fact. Insufficient or No Documentation Recipient 3’s claims 2, 3 and 4 included a panoramic image, a primary closure of a sinus perforation at tooth 1, and a primary closure of a sinus perforation at tooth 16, respectively. Initially claim 2 was denied because of a lack of documentation, however, additional documentation was received and claim 2 was allowed. As to claims 3 and 4, Dr. Hardeman opined there was insufficient documentation to support the claims as he could find “no sinus exposure was noted” in the “op [operation] note.” Dr. Ason’s testified that he had “to get a primary closure for this patient on both sides,” and his operative note provides: The roots were in the radiograph close to or into the sinus. As a precaution, a primary sinus closure was performed on both sites #1 and #16 by using chromic gut 3-0 to get a watertight seal. Dr. Ason’s operative note did not document that there was sinus exposure during the operation. There is insufficient documentation to support these two claims. The claims should not be allowed. Recipient 5’s claim 3 involved insufficient documentation to support a “Repair Tooth Socket” for an unknown tooth. Dr. Hardeman agreed that an alveoloplasty was appropriate in this case; however, there was no documentation for the site at which it was performed. Dr. Ason recited four sentences from his operative note; however, he did not provide a tooth number for the procedure. There is insufficient documentation to support this claim, and the claim should not be allowed. Recipient 7’s claim 2 involved a missing panoramic image, claims 7 and 8 involved no documentation for the “Repair Tooth Socket” for unknown teeth, and claims 9 and 12 involved the removal of impacted teeth 1 and 16. During the hearing, Petitioner’s counsel affirmed that “claim 7, page 2” was paid,8/ and claims 2, 9, and 129/ were paid. No testimony was received regarding claims 7 and 8. The claims (7 and 8) are allowed. Recipient 10’s claim 4 involved the lack of documentation for the “Excision Of Gum Flap” for tooth 32. Dr. Hardeman opined there was no documentation of this procedure. The claim should be disallowed. Recipient 13’s claim 9 involved insufficient documentation to support a “Repair Tooth Socket” for an unknown tooth. The documentation (Exhibit 18-13: Bates-stamped page 600) reflected Dr. Hardeman wrote “What socket was repaired? I would allow if site was #30, that is what is in the op note. But the cover sheet does not indicate tooth#.” Dr. Hardeman adopted his written notations as his testimony. This claim should not be allowed. Recipient 22’s claim 1 involved the lack of documentation to support an office consultation claim. Dr. Hardeman did not find any documentation to support an office consultation visit. The claim should be disallowed. Recipient 29’s claim 2 involved the lack of documentation to support an inpatient consultation claim, and claim 6 involved the lack documentation of a “CT” scan of the maxillofacial region without dye. Dr. Hardeman did not find any documentation to support an in-patient consultation on the date specified, nor could he find a CT scan for this recipient in any of the records. These claims should be disallowed. Recipient 34’s claim 1 lacks documentation of a “CT” scan of the maxillofacial region without dye. Dr. Hardeman did not see a CT scan for this recipient in any of the records. This claim should be disallowed. Level of Service and Not a Consult As provided in paragraph 15.5. above, the description for an office consultation is clear. The Dental Handbook details the components of a consultation. The Dental Handbook provides guidance between a “Consultation Versus Referral” as: If a provider sends a recipient to another provider for specialized care that is not in the referring provider’s domain, and the referring provider will not participate in the on-going care of the recipient for this problem, this is not a consultation. This is a referral and should be billed as an examination or appropriate evaluation and management code. The distinguishing feature between a consultation and an established or new patient visit will depend on whether the referring provider is going to continue to care for the patient for that particular problem. If this condition can be met, then the referral should be billed as a consultation. If this condition cannot be met, then the referral should be billed as a new or established patient. Respondent billed an office consultation for the vast majority of the 35 recipients.10/ Respondent consistently billed CPT codes 99424, 99243 or 99244. AHCA adjusted the codes downward, uses CPT codes 99202, 99203, or 99204 as warranted, and AHCA seeks to recover the difference as overpayment. Respondent did not provide a written report of the findings and recommendations to the attending or requesting provider, but instead provided treatment to each of the 35 recipients in this sample. For Recipient 22, there was no documentation to support an office visit. For Recipient 29, the consultation was covered within a global surgery code, and will be discussed below. Respondent’s surgeon, Dr. Ason, mistakenly thought that he was providing a consult because the “patients were receiving care for their oral health by a general dentist. . . . So they [general dentists] sent the patient to me to consult on the area and confirm that the extraction or whatever procedure was needed, and after I was done with the procedure, I would then hand the patient right back to the dentist.” Dr. Ason’s explanation does not justify coding as a consult. Global Codes 21462, 21453, and 13132 involve the surgical procedures in the treatment of a fractured jaw with the insertion of hardware or an oral splint. Code 20680 involves the removal of support, i.e., the hardware that was used in the surgical procedure to treat a fractured jaw. The Florida Medicaid Provider General Handbook provides the following regarding global reimbursements: Global reimbursement is a method of payment where the provider is paid one fee for a service that consists of multiple procedure codes that are rendered on the same date of service or over a span of time rather than paid individually for each procedure code. If a provider bills for several individual procedure codes that are covered under a global procedure code, which is referred to as “unbundling,” Medicaid Program Integrity will audit the provider’s billing. The Florida Medicaid Dental Services Coverage and Limitations Handbook provides the following description regarding surgery services: Surgical services are manual and operative procedures for correction of deformities and defects repair of injuries, and diagnosis and cure of certain diseases. The following services are included in the payment amount for a global surgery: The preoperative visit on day one (the day of surgery); Intraoperative Services – Intraoperative services area usual and necessary part of a surgical procedure; examples are local anesthesia and topical anesthesia; Complications Following Surgery – All additional medical or surgical services required of the surgeon during the postoperative period of the surgery, because of complications that do not require additional trips to the operating room; Post Surgical Pain Management – By the surgeon; Miscellaneous Services and Supplies – Items such as dressing changes; local incisional care; removal of operative pack; removal of cutaneous sutures and staples, lines, wires, tubes, drains, splints; routing peripheral intravenous lines, nasogastric tubes; and changes and removal of tracheostomy tubes; and Postoperative Visits – Follow-up visits within the postoperative period of the surgery that are related to recovery from the surgery. Note: See the Florida Medicaid Provider Reimbursement Schedule for the number of follow-up days that are included in the surgical fee. The reimbursement schedule is available on the Medicaid fiscal agent’s Web site at: www.mymedicaid-florida.com. Select Public Information for Providers, then Provider support, then Fee Schedules. The following services are not included in the payment amount for a global surgery: Diagnostic tests and procedures, including diagnostic radiological procedures; or Treatment for postoperative complications, which requires a return trip to the operating room (OR). An OR for this purpose is defined as a place of service specifically equipped and staffed for the sole purpose of performing surgical procedures. It does not include a patient’s room, a minor treatment room, a post-anesthesia care unit, or an intensive care unit (unless the patient’s condition was so critical there would be insufficient time for transportation to an OR. The Physician Surgical Fee Schedule in the Florida Medicaid Provider Reimbursement Schedule provides the global treatment period (also known as follow-up days, FUD) for codes 21453, 21454, 21461, and 21462, as 90 days. Recipient 29 had a fractured jaw. On March 18, 2014, Dr. Ason performed a “closed reduction of bilateral condylar fracture of the mandible,” and an “open reduction and internal fixation of symphysis fracture of the mandible” on Recipient 29. On March 26, 2014, this recipient presented to Respondent’s practice for an office follow-up visit. On May 15, 2014, another surgical procedure was performed on Recipient 29 to remove the hardware that had been inserted into Recipient 29’s mouth during the March surgery. The March 26 office follow-up visit was eight days after the surgery, and within the 90 FUD. Claim 7 was coded as an office consultation on March 26, 2014. Claim 7 should not be allowed as the office visit occurred eight days after the surgery and was included with the global billing code. Recipient 29’s claims 8 through 13 involved the removal of support implants from teeth 3, 8, 14, 19, 24, and 30, dated May 15, 2014. Claims 9 through 13 were appropriately denied as occurring within the 90 FUD period, and were excluded because they were covered under the global billing code. Nurse Kinser adjusted claim 8 downward, but admitted that claim 8 should have been denied as it occurred within the 90 FUD period. Nurse Kinser testified that when an error is made to the provider’s benefit, the benefit stays. However, if an error was made that was not to the provider’s benefit, it would be appropriately adjusted. Not a Covered Service The Florida Medicaid Dental services coverage and limitations handbook provides the following overview introduction of dental services: This chapter defines the services covered by the dental services programs, the services that are limited and excluded, services that must be prior authorized, and the services that are specialty specific. Those claims that were not initially coded appropriately fall under “Not a Covered Service” finding. Now that the correct codes have been assigned, the claims are not allowed per Medicaid guidelines. Other Findings Administrative sanctions shall be imposed for failure to comply with the provision of Medicaid law. For the first offense, Florida Administrative Code Rule 59G-9.070(7)(e) authorizes AHCA to impose a penalty in the amount of $1,000.00 per violation. AHCA is seeking to impose a fine of $106,000.00 for 106 separate offenses. The sanction should be imposed for the claims that have been sustained; however, the actual sanction amount is unknown at this time due to the adjustments that must be made based on the findings of fact above. Section 409.913(23) provides that AHCA is entitled to recover all investigative, legal, and expert witness costs if the agency ultimately prevails. At this time, the total costs are unknown. Dr. Fonesca is not licensed to practice either medicine or dentistry in Florida. Dr. Fonesca testified he has an “expert witness certificate as it relates to” Florida. However, this matter is not a medical negligence litigation action, or a criminal child abuse or neglect case. This case revolves around whether Respondent coded certain services appropriately for Medicaid reimbursement. Dr. Fonseca is not a qualified Florida peer, and his testimony, while informative, is not competent in this case.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that the Agency for Health Care Administration enter a final order finding that Respondent was overpaid, and is liable for reimbursement to AHCA for the claims detailed above (AHCA shall rework the claims detailed above to determine the overpayment); finding that an administrative fine should be imposed based on each violation; and finding that Petitioner is entitled to recover all investigative, legal, and expert witness costs. Jurisdiction is retained to determine the amount of appropriate costs if the parties are unable to agree. Within 30 days after entry of the final order, either party may file a request for a hearing on the amount. Failure to request a hearing within 30 days after entry of the final order shall be deemed to indicate that the issue of costs has been resolved. DONE AND ENTERED this 23rd day of March, 2017, in Tallahassee, Leon County, Florida. S LYNNE A. QUIMBY-PENNOCK Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 23rd day of March, 2017.
