Findings Of Fact Pursuant to Section 310.011, Florida Statutes, the Board of Pilot Commissioners (Board) was established within the Department of Professional Regulation (Department). The Board, in conformance with Section 310.061, has the authority to determine the number of pilots needed for a given port. To fill those numbers, the Department examines all applicants for the position of pilot or deputy pilot and, if found qualified, appoints and licenses as a pilot or appoints and certifies as a deputy pilot the number prescribed by the Board. See: Section 310.081, Florida Statutes. On December 8, 1986, the Department held an examination to fill two deputy pilot positions at Port Canaveral. Petitioner and Intervenors, Captain John M. Boltz and Captain Earl R. McMillin were among the candidates examined. A total of twenty-two candidates took the examination. The facets of the examination were as required by Rule 21SS-5.13(1), Florida Administrative Code. That rule requires that the examination include the following subject areas: International Rules of the Road. Inland Rules of the Road and the Pilot Rules. Seamanship, Shiphandling and other Subjects Relating to Piloting. Aids to Navigation. Local or specific knowledge of the port area for which being examined. Chartwork of the port area for which being examined, with detailed information of the port area required to be charted. A general examination concerning matters pertaining to a candidates knowledge of federal and state pilotage, fitness and ability to undertake the duties of a certified deputy pilot in the port for which being examined, and such other related information as may be deemed pertinent to the examination process, to determine whether the applicant is qualified to pilot all classes of vessels liable to enter the port and is familiar with the waters, the channels, the harbor and the port. Rule 21SS-5.13(2), Florida Administrative Code, mandates that: In order to achieve a passing grade on the examination a candidate must score 90 percent on the subject areas in subsections (1)(a) and (b), and a score of 75 percent on the subject areas in subsection (1)(c), (d), (e), (f) and (g). A failure to attain the required percentage in any of the seven subject areas renders the candidate unsuccessful. Of the twenty-two candidates who took the examination, only four candidates attained a passing score on each of the seven subject areas. Of these four, Captain McMillin was first with an overall score of 94.74 percent, Captain Boltz was second with an overall score of 92.76 percent, and Petitioner was third with an overall score of 92.62 percent. The Department, in accordance with standard practice, ranked the candidates by overall score, and appointed the top two candidates, Captain McMillin and Captain Boltz, to the two available positions. Following disclosure of his score, Petitioner reviewed his examination and offered a timely objection to question 117. That question reads: The reaction of a ship known as "squat" results in a change in trim. generally varies in direct proportion to the speed. Only I is a correct statement. Only II is a correct statement. Both I and II are correct statements. Neither I nor II is a correct statement. As originally keyed, the only correct response to question 117 was answer A. However, after reviewing the test results, the Department decided to rekey the acceptable responses to the question and accord credit for answer A and C. Petitioner objects to the Department's decision to accord credit for answer C, which he asserts is a technically incorrect response. Significantly, had the Department not rekeyed the responses to the question, Petitioner, who elected response A, would have achieved a better overall score than Captain Boltz, who elected response C. Question 117 was developed by Captain John C. Hanson, the Department's consultant, from Shiphandling For The Mariner, by MacElrevey; a source recommended to all candidates prior to the examination. Pertinent to this case, MacElrevey teaches: As a ship begins to make way through the water she undergoes a change in mean draft known as sinkage. This change may occur equally forward and aft or may be greater at the bow or the stern, the resulting change in trim being known as "squat." When passing through the water the ship displaces an amount of water equal to her own weight. This water must move outward from and around the hull in all directions. The water so displaced moves primarily along and under the hull and returns astern of the ship to "fill" the space left by the ship as she moves on. Naturally, the faster the ship is moving the greater the velocity of this flow under and along her hull, and the greater the corresponding pressure drop as a result of that increased velocity. Depending upon where the greatest drop in pressure occurs along the length of the hull, this reduced pressure will result in greater sinkage (increase in draft) at the bow or stern, although the draft increases to some degree all along the length of the ship. As the ship enters shallow water the flow of water becomes increasingly restricted due to the reduced clearance both under and on one or both sides of the hull. The degree of restriction or "blockage factor" is dependent upon several variables . . . Consider first the effect of ship's speed since this is the factor over which the mariner has the greatest control. It has been found, based upon observations of both actual ships and models, that squat varies in proportion to the square of the speed. If ship's speed is doubled, squat increased by a factor of four. With today's large ships and minimal underkeel clearances it becomes immediately obvious why speed and resulting squat must be very much on the shiphandler's mind. (Emphasis added) The question developed by Captain Hanson was designed to test the candidate's knowledge of squat and the effect of speed on squat, which is important information for a pilot who must navigate through shallow waters or confined channels. The correct technical response to question 117 as posed, and as intended by Captain Hanson, was answer A. Answer C was an incorrect response because squat does not technically vary in direct proportion to speed but, rather, in proportion to the square of the speed. 1/ Notwithstanding the fact that answer A was the intended and only technically correct response to question 117, the Department's Office of Examination Services decided to also afford credit for answer C. This decision was predicated on its conclusion, after a review of the responses to the question, that the phrase "direct proportion" could logically have been interpreted by the candidates in a non-technical sense to mean: that squat is directly related to speed (i.e., if speed increases/decreases, squat increases/decreases). If so interpreted, answer C would also have been a correct response to question 117. Accordingly, the Department concluded that it would afford credit for answer C, as well as answer A. The proof accords logic and reason to the Department's decision. The twenty-two candidates who took the examination were experts in seamanship and shiphandling. A review of the responses to question 117 by these twenty-two candidates revealed that: three chose answer A, one chose answer B, and 18 chose answer C. Of the four who attained a passing score, two chose answer A and two chose answer C. Notably, 82 percent of the candidates in both the upper and lower half of the class chose answer C. Because of its poor statistical performance, Ms. Lila Quero-Munoz of the Office of Examination Services, an expert in psychometrics, was of the opinion that the question needed close review. In Ms. Quero-Munoz' opinion, which is credited, when 18 of 22 qualified people select a response other than the one that was keyed, there is good reason to suspect that there is something in the phrasing of the question that is subject to misinterpretation. Upon review of question 117, Ms. Quero-Munoz and Martin Persampieri, also of the Office of Examination Services, were of the opinion, which opinion is credited, that the phrase "direct proportion" could have logically been interpreted as meaning that squat is directly related to speed, instead of its technical or mathematical definition. Therefore, the Department's decision to afford credit for answer C had a logical and reasonable basis. /2 The testimony of Captain Hanson, Petitioner, Captain McMillin and Captain Boltz lends support to the conclusion that the Department acted logically and reasonably when it decided to rekey the answers to question 117. Captain Hanson, when he prepared the question, did not intend it to be a trick question. Yet, Petitioner and Captain McMillin, both of whom responded with answer A, thought the question to be tricky and applied the technical or mathematical definition of "direct proportion." Captain Boltz was not familiar with the technical definition of "direct proportion" and ascribed to it the general proposition that squat is directly related to speed. Notably, the term "direct proportion" was not defined anywhere in the sources recommended by the Department to the candidates. The Department, in carrying out the examination process, is charged with the responsibility of ensuring that the examination for deputy pilot adequately and reliably measures a candidate's ability to practice the profession of deputy pilot. Further, it must ensure that the examination questions are a reliable measurement of the general areas of competence specified in Rule 21SS-5.13(1), Florida Administrative Code. These responsibilities were adequately addressed by the Department in this case.
Recommendation Based on the foregoing findings of fact and conclusions of law, it is RECOMMENDED that the examination challenge filed by Petitioner be DISMISSED. DONE AND ENTERED this 21st day of October, 1987, in Tallahassee, Leon County, Florida. WILLIAM J. KENDRICK Hearing Officer Division of Administrative Hearings The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32399-1550 (904)488-9675 Filed with the Clerk of the Division of Administrative Hearings this 21st day of October, 1987.
The Issue Whether Petitioner's response to the questions on the October 1990 Florida Professional Engineers Examination were sufficient to allow him to receive a passing grade. Whether problems in Petitioner's examination occurred which were due to the Department's change in the list of reference materials allowed into the examination room.
Findings Of Fact In order to obtain licensure as a Professional Engineer in Florida, Petitioner is required to successfully complete the licensure examination. Petitioner sat for the October 1990 National Engineering Licensure Exam. He received an overall score of 69.1%. A passing score for the examination was 70.0%. The Professional Engineer Candidate Information Booklet advised candidates that the reference materials taken into the examination room had to be formally bound, copyrighted and published. The only exception to this rule was the Standard Building Code, which is contained in a three-ring binder. On the first day of the examination, Petitioner learned that the Board of Engineers had approved the use of additional codes, standards and manuals that are bound in three ring binders during the examination. One of these newly approved references was the Highway Capacity Manual, Transportation Research Board. Petitioner did not have his copy of the Highway Capacity Manual with him at the examination site because of the prior prohibition against its use during the exam. Petitioner did not object to the last minute expansion of the reference materials list until after he received his test results. The examination questions and answers challenged by Petitioner are Questions #124 and #425. Question #124 involved a five-sided figure that contained curves in two of its sides. According to the situation given as part of the test question, this figure was a parcel of land. The engineer was required to compute the area of the parcel. The first requirement for part (a) of the question was the computation of the area of traverse ABCDEA in acres. The figure provided some of the sector measurements in feet as well as a stated radius for each curved area. A review of Petitioner's calculations for part (a) reveals that he did not close the figure. Closure is required in a problem involving land boundaries. Thus, he was not able to compute the area and convert the measurement to acres, as required. Each side had to be included to obtain the proper area measurement. Petitioner did not demonstrate entitlement to credit for his incorrect answer to part (a) because he did not follow the instructions or demonstrate competency in the engineering principles tested by this question. The scoring plan for the examination did not provide partial credit for the incomplete calculations made by Petitioner on this portion of the exam. Petitioner received full credit for part (b) of Question #124 during the original grading of the exam so that portion of the question is not in dispute. Part (c) of Question #124 required the exam candidates to compute the length of curve DE in feet. The measurement for sector DE was provided in feet along with the measurement for the radius. Petitioner's answer to Question #124, part (c) was 514.39 feet. The correct answer was 514.79 feet. Although Petitioner's solution is similar to the correct answer, he did not compute the length of the curve for the side DE as required by the exam instructions. Instead, he computed the central angle for the circular arc DE. Even in his computation of the central angle, Petitioner used a central angle of 58.94 instead of the correct angle of 58.99. The examination sought to test Petitioner's ability to compute the length of a curve. Petitioner ignored the instruction and used a different calculation method that was not requested. As a result, no credit was given for the wrong answer. Petitioner did not demonstrate competency in the engineering principles being tested. Question #425 was a multiple-choice problem with ten parts. The responses were to be made from five alternatives for each part. Petitioner received eight of the ten possible points for the question. Only subparts (3) and (4) were answered incorrectly. Petitioner did not demonstrate entitlement to credit for his incorrect answer to subpart (3) of Question #425. He did not provide evidence to support his theory that his answer "D" (1,390 gallons) was within a reasonable margin of error and should be given credit. The correct answer is "E" (1,410 gallons). The necessary calculations reveal that the actual answer is 1,408 gallons. The question asks for the multiple choice selection which is "most nearly" accurate based on the information given in subpart (2). Based upon the problem itself, Petitioner's additional input regarding temperature and expansion possibilities are without merit. The problem was not solved as presented. Petitioner did not demonstrate his ability to properly calculate the amount of substance occupying a particular volume. Subpart (4) of Question #425 deals with the symbols for roadway materials. The candidates were expected to select one of the listed materials as the one most likely used at a particular stage of roadway construction. Petitioner was unable to reference the Highway Capacity Manual when answering this question because the original instructions in the Professional Engineer Candidate Information Booklet instructed candidates that the only three-ring binder book allowed into the exam was the Standard Building Code. Although the decision prohibiting the entry of the Highway Capacity Manual into the examination room was changed prior to the exam, Petitioner was not alerted in time to have it available for his use. Prior to final hearing, Petitioner contended that if he had been given sufficient notice, he could have used the Highway Capacity Manual to define the symbols in subpart (4) of Question #425. At final hearing, Petitioner stated the answer could be in that manual or one of the other handbooks in the same series. The Highway Capacity Manual does not contain definitions for the symbols set forth in subpart (4). The Asphalt Handbook may contain such symbols. This reference would have been allowed into the examination even prior to the changed ruling on references contained in three-ring binders. The Hearing Officer was unable to find all of the symbols in subpart (4) in the pages provided by Petitioner. Petitioner failed to demonstrate that the change in the Department's policy regarding references in three-ring binders affected his ability to correctly answer subpart (4) of Question #425. He should not be given credit for his incorrect response on the answer sheet.
Recommendation Based upon the foregoing, it is RECOMMENDED: The Department should enter a Final Order which denies Petitioner's challenges to Questions #124 and #425. The exhibits marked "confidential" should remain sealed and not open to public inspection. DONE and ENTERED this 12th day of November, 1992, at Tallahassee, Florida. VERONICA E. DONNELLY Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 12th day of November, 1992. APPENDIX Petitioner's proposed findings of fact are addressed as follows: Accepted. See HO #2. Accepted. See Conclusions of Law. Accepted. Accepted. Accepted. Accepted. Accepted. Accepted. Rejected. Contrary to fact. Rejected. Contrary to fact. Accepted. See HO #6. Accepted. Rejected. Contrary to fact. See HO #14. Accepted. Accepted. Rejected. Argumentative. Rejected. Contrary to fact. See HO #9. Rejected. Contrary to fact. See HO #15. Rejected. Contrary to fact. See HO #14. There was no number 20 in Petitioner's findings. Rejected. It was Petitioner's responsibility to meet this burden. Rejected. Improper argument. Rejected. Argument as opposed to factual finding. Rejected. Contrary to fact. See HO #23. Rejected. Speculative and contrary to evidence. Accepted. Accepted, except for the disadvantage issue. Speculative. Rejected. Contrary to fact. Rejected. Improper summary. Argumentative. Respondent's proposed findings of fact are addressed as follows: Accepted. See HO #2. Accepted. See Preliminary Statement. Accepted. Accepted. See HO #7. Accepted. See HO #9. Accepted. See HO #12. Accepted. Accepted. See HO #11 and #14. Accepted. See HO #15. Accepted. See HO #18-#19. Accepted. See HO #23. COPIES FURNISHED: Jack McRay, General Counsel Department of Professional Regulation 1940 North Monroe Street Tallahassee, FL 32399-0792 Angel Gonzalez, Executive Director Board of Professional Engineers 1940 North Monroe Street Tallahassee, FL 32399-0792 Russell A. Ferlita 1220 LaBrad Lane Tampa, FL 33613 Vytas J. Urba, Esquire Department of Professional Regulation 1940 North Monroe Street Tallahassee, FL 32399-07950
Findings Of Fact Petitioner is an experienced and successful alarm system contractor licensed in Rhode Island and Massachusetts. Petitioner sought licensure as an alarm system contractor in Florida and sat for the Alarm System II Contractor's Examination administered by Respondent in January 1992. Applicants for licensure as alarm system contractors must pass the examination to be qualified for licensure. Petitioner's final grade on the examination was 70, but the minimum passing grade was 75. Petitioner did not pass the examination and, consequently, he was denied licensure. All challenged questions were multiple choice questions and the candidates were to select the best answer from the four possible answers provided. Candidates were allowed to use approved source materials during this open book examination. Petitioner challenged Questions #1, 17, 18, 19, and 76 because the content of each question pertained to accounting. For the reasons to be discussed in the Conclusions of Law portion of this Recommended Order, Petitioner's contention that accounting questions should not be included on the examination is rejected. The answer Petitioner selected for Question #1 was not the best answer to the question. Consequently, Petitioner was properly denied credit for his response to Question #1. The answer Petitioner selected for Question #17 was not the best answer to the question. Consequently, Petitioner was properly denied credit for his response to Question #17. The answer Petitioner selected for Question 18 was the best answer for the question, and he was awarded appropriate credit for that correct answer. The answer Petitioner selected for Question #19 was not the best answer to the question. Consequently, Petitioner was properly denied credit for his response to Question #19. The answer Petitioner selected for Question 76 was the best answer for the question, and he was awarded appropriate credit for that correct answer. Petitioner challenged Question #6 contending that the question was badly worded and that there were three possible answers to the question. Petitioner selected answer "B" as his answer to the question, but argued at hearing that answers "A", "B", or "C" are also correct answers. Respondent asserts that answer "C" is the best answer to the question. Petitioner failed to establish that Question #6 was impermissibly vague or that Respondent's determination that answer "C" was the best answer to the question was devoid of logic or reason. The answer Petitioner selected for Question #6 was not the best answer to the question. Consequently, Petitioner was properly denied credit for his response to Question #6. Petitioner challenged Question #23. The answer Petitioner selected for Question #23 was not the best answer to the question. Consequently, Petitioner was properly denied credit for his response to Question #23. Petitioner challenged Question #25 on the basis that the question was a trick question and that there were three possible answers to the question. Petitioner selected answer "B" as his answer to the question, but argued at hearing that answers "A", "B", or "C" are also correct answers. Respondent asserts that answer "A" is the best answer to the question. Petitioner established that his answer to the question was as correct as the answer selected by Respondent as the best answer to the question. Consequently, Petitioner was improperly denied credit for his response to Question #25. Petitioner challenged Question #78 and argued that the source material upon which Respondent based its answer is obsolete. Petitioner chose answer "A" while Respondent asserts that answer "D" is the best answer to the question. Respondent's answer appears in "Design Applications of Security Fire Alarm Systems", a reference book to which the candidates were permitted to refer while taking the examination. While Petitioner was very critical of this reference book, he failed to establish that Respondent could not rely on the book or that the determination by Respondent that answer "D" was the best answer to the question was devoid of logic or reason. Petitioner failed to establish that Question #78 was an improper question or that he was entitled to credit for his answer to the question. At the formal hearing, Petitioner raised for the first time a challenge to Question #83, a question pertaining to the use of coaxial cable. Petitioner contends that because alarm system contractors do not routinely use coaxial cable, the question is improper and should be thrown out. Petitioner concedes that the information necessary to correctly answer the question was in the resource material to which the candidates were permitted to refer while taking the examination and that he gave the wrong answer to the question. Petitioner failed to establish that Question #83 pertained to an improper subject or that he was entitled to credit for his response to the question. Petitioner challenged Question #98. After the examination was administered, the Electrical Contractors Licensing Board rejected this question from every candidate's examination as being outside the scope of practice. Consequently, that question was not a factor in the scoring of Petitioner's examination.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a Final Order be entered which awards Petitioner credit for his answer to Question #25, but which denies him additional credit for his answers to the other challenged questions. It is further recommended that the examination questions and Petitioner's Exhibit 6 pertaining to certain of the examination questions be sealed as confidential exhibits. DONE AND ENTERED this 19th day of January, 1993, in Tallahassee, Leon County, Florida. CLAUDE B. ARRINGTON Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 19th day of January, 1993. APPENDIX TO RECOMMENDED ORDER, CASE NO. 92-4924 The post-hearing submittal filed by Petitioner consists of argument and suggestions as to measures the Respondent should take to improve the examination, but does not contain proposed findings of fact that require a ruling from the undersigned. The proposed findings of fact submitted by Respondent are adopted in material part by the Recommended Order. COPIES FURNISHED: Joseph A. Trillo 800 Jeffrey Street Boca Raton, Florida 33487 Vytas J. Urba, Esquire Assistant General Counsel Department of Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0750 Daniel O'Brien, Executive Director Department Of Professional Regulation Electrical Contractors Licensing Board 1940 North Monroe Street Tallahassee, Florida 32399-0792 Jack McRay, General Counsel Department of Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792
The Issue The issues in this case are whether Petitioner, Gary P. Santoro (“Petitioner” or “Mr. Santoro”), undeservedly received a failed grade on the Construction Business and Finance Examination (“Examination”) for licensure as an air-conditioning contractor; whether any questions on the examination had more than one correct answer; whether the examination is unfair; whether there is transparency in the examination review process; and whether the examination grading process is arbitrary and capricious.
Findings Of Fact Mr. Santoro took the Examination on November 16, 2018. Petitioner failed the Examination because he scored less than 70 percent correct. The Examination contains 125 questions, 120 of which are scored. The other five are not scored and are considered “pilot” questions for potential use on future examinations. In order to pass the Examination, a candidate must obtain a score of at least 70 percent. All scored questions on the Examination are weighted equally. As a result of failing to pass the Examination, Petitioner was notified of his results. All questions on the Examination had a single correct answer. Cynthia Woodley, Ph.D., employed by Professional Testing, Inc. (“PTI”), as the chief operating officer, is an expert in psychometrics and exam development. She holds a master’s degree in vocational education and a doctorate in curriculum and instruction with a specialization in measurement. Her current position calls for her to manage a number of licensure and certification exam programs. She explained at length how specific questions become part of a professional licensure exam. To develop questions, her company brings in any number of subject matter experts, people actually employed in the professions being tested, and they help develop subject matter questions for a particular exam. That was the process used for development of the Examination in this matter. Once the subject matter experts are trained in exam question writing techniques, they write questions, which are reviewed by other subject matter experts to determine whether the questions are fair and understandable enough to be answered by prospective test takers. Generally, five subject matter experts review each question before it makes its way onto an exam. PTI measures the “P value” of the questions by determining what percent of individuals taking a given exam answer a particular question correctly. For example, a P value of .90 means that 90 percent of the people taking the exam answered a particular question correctly. PTI looks for a wide range of P values in its exam questions. If a P value is too low, say .40, the company might reexamine that question to determine whether it should be removed from future exams since fewer than half the people taking the exam answered it correctly. The business and finance portion of the exam is given to all contractors, regardless of their specialty, with the exception of pool service contractors. Here, Petitioner, a HVAC contractor was administered the same Examination as plumbing contractors, electrical contractors, general contractors, etc. Each of the 120 questions on the exam in this case was equally weighted. There were also five pilot questions inserted into the exam, which did not count towards the total score, but were included as test questions for future exams. Petitioner provided hearsay documents regarding computer hacking and computer glitches associated with some exams administered around the United States. However, he did not connect the articles submitted into evidence to the exam administered in this case or any exam administered by the Department in Florida. Dr. Woodley was familiar with the allegations of computer glitches in testing, but testified that the problems were with K-12 testing in schools, not with professional licensure exams, such as administered by the Department. Therefore, since the hearsay evidence was not linked to the exam at issue or similar professional licensure exams given in Florida, it is entitled to no weight in arriving at the decision in this case. Question BF 1290 has a single correct answer, which is answer “C.” Petitioner selected answer “B.” Petitioner was unable to demonstrate that the answer he selected was correct. Question BF 0473 has a single correct answer, which is answer “A.” Petitioner selected answer “C.” This question asks for an answer of general applicability. Petitioner’s claim that his answer is equally correct is based on a narrow exception in law. Accordingly, Petitioner was not able to demonstrate that the answer he selected was correct. Question BF 0162 has a single correct answer, which is answer “B.” Petitioner selected answer “C.” Petitioner was unable to demonstrate that the answer he selected was correct. Question BF 1691 has a single correct answer, which is answer “C.” Petitioner selected answer “D.” Petitioner was unable to demonstrate that the answer he selected was correct. Petitioner was unable to submit sufficient evidence to show that the Examination is unfair, that there is insufficient transparency in the examination review process, or that the examination grading process is arbitrary and capricious. Accordingly, he cannot prevail in his challenge to the Examination. Petitioner testified that he took and passed the HVAC contractors special license examination on his first attempt. He has taken the Examination on numerous occasions and is yet to be successful. He testified he studied hard for every administration of the exam, but just cannot reach the finish line successfully. While that is unfortunate, the evidence does not support that his failure to succeed on the Examination is the fault of the exam itself or of the Department either in its contracting to have the exam created or in the administration of the exam. From the way he conducted himself at hearing, Petitioner appears to be an intelligent, diligent, and successful individual in his HVAC business. For some unknown reason he has been unable to successfully complete the Examination. His persistence in retaking the Examination multiple times is admirable and should ultimately pay off with his successful passage of the Examination.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that the Construction Industry Licensing Board enter a final order upholding the Department’s Amended Grade Report finding that Petitioner failed to achieve a passing score on the Construction Business and Finance Examination, which he took on November 16, 2018. DONE AND ENTERED this 23rd day of August, 2019, in Tallahassee, Leon County, Florida. S ROBERT S. COHEN Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 23rd day of August, 2019. COPIES FURNISHED: Thomas G. Thomas, Esquire Department of Business and Professional Regulation 2601 Blair Stone Road Tallahassee, Florida 32399-2202 (eServed) Gary Peter Santoro Hometown Air & Services 8229 Blaikie Court Sarasota, Florida 34240-8323 (eServed) Ray Treadwell, General Counsel Office of the General Counsel Department of Business and Professional Regulation 2601 Blair Stone Road Tallahassee, Florida 32399-2202 (eServed) Daniel Biggins, Executive Director Construction Industry Licensing Board Department of Business and Professional Regulation 2601 Blair Stone Road Tallahassee, Florida 32399 (eServed) Halsey Beshears, Secretary Department of Business and Professional Regulation 2601 Blair Stone Road Tallahassee, Florida 32399-2202 (eServed)
Findings Of Fact Petitioner herein, Kristina V. Tignor, took the Professional Engineers Examination for the State of Florida in Orlando on April 9 and 10, 1987. On July 22, 1987 she was advised by the Department of Professional Regulation's Office of Examination Services that she had failed the examination and was given a cummulative score of principles and practice of 69.1 percent. In her initial request for review and reconsideration, Petitioner objected to the points assigned to her solutions for three problems on the test, Numbers 425, 421, and 124. She contended that as a working engineer, certain criteria and assumptions must be made in approaching any engineering problem and, because the portion of the examination in issue is graded subjectively, her answered should be reconsidered and evaluated in that light. At the hearing, Petitioner contested only the grading of questions number 124 and 421, thereby accepting the grade given for question 425. With regard to Question 124, Ms. Tignor was awarded a score of 5 on her solution to this problem. The National Council of Engineering Examiners, in its Standard Scoring Plan Outline awards a "qualified" evaluation to scores from 10 down to 6 on this question. Scores from 5 to 0 are rated, "unqualified." A score of 5 indicates the applicant has failed to demonstrate adequate knowledge in one aspect of one category. Specifically, a rating of 5 in this question indicates that the examinee displayed an inadequate knowledge of weight/volume and concrete mix design. Her computations were displayed and an incomplete or erroneous solution was arrived at which gave a generally unrealistic result. Dr. Bruce A. Suprenant a civil engineer registered in four states and who teaches engineering at the University of South Florida, reviewed the question, the Petitioner's solution, the solution proposed by the examiners, and the grading scheme for this problem and found a number of illogical items in Petitioner's solution which, to him, were difficult to understand. He found several items which had no basis and which were possibly assumed. As to Part a of Petitioner's answer, a mixture of answers, (correction for moisture), which should have been in Part b, was located in Part a. As to density, the value used by Petitioner does not appear to be reasonable based on information provided in the problem. In Dr. Suprenant's opinion, there are at least three approaches to this problem. One is the water/cement ration method. Another is the weight method. The third is the absolute volume method. The water/cement ratio method would be difficult to apply here and neither Petitioner nor the examiners used it. As to the weight method, much the same problem exists. There is insufficient information provided to satisfactorily apply this method and while the examiners did not use it, Petitioner did. Petitioner's answer has a correction for moisture in the absolute volume method on the first page of the solution form at the top. The calculations by Petitioner are assumed information not known, (volume). In addition the correction for moisture in the second part of page one is included on the top of page two. It is not a part of the solution for subpart a and should not be there. Petitioner used 150 pounds per cubic foot for concrete density in her solution and this choice is not explained. Most publications utilized by engineers suggest using tables which were not provided to the examinees and it is, therefore, illogical to assume concrete density with no history for that assumption. Petitioner's answer of 5.41 cubic yards is only slightly off the suggested answer of 5.44 cubic yards but the fact that the answers are close does not justify her assumption. It might well not come so close in other cases. As to Part b of the question calling for the water/cement ratio, the corrections for moisture of fine and coarse aggregate on page one are acceptable. On the second page, a problem arises in when the correction for moisture should decrease. Petitioner got the right factor but applied it in the wrong manner. As a result, her answer to Part b of the examination question is wrong. Her answer was 4.40 as opposed to the correct answer of 4.34. This small degree of error can be attributed to the smallness of the amount in question. Were the amounts greater, the error would be greater. As to part c of the question, which deals with the cement factor in a yard of concrete, Petitioner's approach of dividing sacks of cubic yards is correct, but the cubic yard content was determined from Part a of the question, and Dr. Suprenant does not agree with how she got her solution. He therefore questions her carryover. The standard weight of a sack of concrete is 94 pounds. The individual grading Petitioner's response to Question 124 indicates she displayed inadequate knowledge and reached a solution which gives "unrealistic results." Dr. Suprenant agrees, contending that Petitioner's performance in regard to this question indicates inadequate knowledge of weight/volume relationship. She made inadequate assumptions in formulating her answer to the question. The fact that in this problem she arrived at a solution close to the correct one does not indicate that in other problems, she would achieve the same closeness using the same procedure. In his opinion, Petitioner showed some confusion regarding the basis for solving this problem and Dr. Suprenant believes that a grade of 5 as awarded by the examiner is correct. Petitioner questioned the fact that the various technical weights and volumes, such as 94 pounds in a sack of concrete, 8.33 pounds for a gallon of water, and 27 cubic feet in a cubic yard do not appear in the problem statement. This, in the opinion of Dr. Suprenant, compounds the gravity of Petitioner's deficiency. They are routine "givens" generally accepted in the practice by engineers and it would be difficult to assume that anyone familiar with the practice of engineering would use different "givens" for these specifics. Petitioner's employer, Mr. Bishop, himself a registered civil engineer in Florida since 1958, also reviewed Petitioner's solution to Question 124. He admits that on the first page of the answer sheet, Petitioner began solving the problem in an inappropriate way. Her calculations for moisture content were correct, however. On the second paged the correction factor was put in with the wrong sign and the aggregate was given the wrong factor. As a result, the answer was off. In his practice, however, the error committed by Petitioner in these regards is both minimal and acceptable. Her choice of 150 pounds per square foot is reasonable and produced a close result, and while it is true that if the project were of a greater scale, the error might be significant for a test question, as here, the error, in his opinion, is insignificant. He feels much the same way regarding the error in Part c of the examination question. While the factors used by petitioner were wrong, the process used was correct and the answer was not unreasonably incorrect for a test solution. In an examination situation, the calculations are not being done on a continuous basis, and he feels the grade of 5 awarded is unduly harsh since the error was numerical rather than operational. In his opinion, a more reasonable grade would have been a 6 or 7. Petitioner began her solution to this problem by using one similar to that used by the examiners in their publications. Shortly, however, she realized she would not get the answer she needed by doing so and abandoned her solution. She forgot to cross it out, however, and now recognizes she should have done so. She thereafter began to accomplish a series of new calculations on the first page of the answer sheet but did not necessarily utilize that data for her solution to Part a. She admits she made an error in calculation for moisture on the second page. In that calculation, she used the study manual and admits now that she should have cited the figure she used. As to Parts b and c, her use of some figures from Part a may have thrown her answer off somewhat. However, the 5 awarded her, indicating her solution was unrealistic, is, in her opinion unfair as she considers her answer to be quite realistic. The problem did not state what solution method to use and she feels her use of givens from recognized manuals such as the 150 pounds, should not be held against her. 94 pounds for a sack of cement used by the grader was also not given and her use of other accepted numbers should not, she contends, be held against her. Petitioner believes a grade of 7 would more accurately describe the quality of her answer. A 7 means that the examinee obtained an appropriate solution but chose a less than optimum approach. The solution is, therefore, awkward but nonetheless resonable. Ms. Tignor believes that while her approach may have been awkward, she achieved reasonable solution demonstrated by the fact that it was only slightly off the correct figure. Therefore, she believes a grade of 6 would be appropriate. This examination was an open book examination and Petitioner had her manuals with her. She could have easily determined the appropriate weights an "givens" from these manuals without choosing those she used. Ms. Tignor's conclusions that her results are realistic are contradicted by the Board's expert. Realistic results are, in engineering practice, not only the figure reached but also the method used in arriving at that figure. Here, though Petitioner's results are close, the approach utilized in arriving at her solution is unrealistic. Her approach showed an inadequate knowledge of weight/volume and calculations. Consequently it is found the grade is valid and was not arbitrarily assigned. According to the Standard Scoring Plan Outline, each score from 10 through 6 has an indispensable criteria that all categories must be satisfied. Since Ms. Tignor's examination response did not satisfy all categories, the best she can be given is a 5 and that award appears to be justified by the evidence presented. Question 421 was a four part drainage problem. Petitioner used as a part of her solution calculations based on a 100 year storm and this was determined by the examiners to be inappropriate. Ms. Tignor was awarded a grade of 8 and contends she was not given appropriate credit. She relates that even Mr. Smith, the Executive Director of the Board of Professional Engineers, advised her she may not have been given full credit for her answer. She was given full credit for Part a but lost two points for part c which included a calculation error to which Petitioner admits. She contends however, it was so minor, only one point should have been deducted. Were Petitioner to receive an additional one point on this question, she would pass the examination which she failed by only one point. However, this issue must be resolved on the basis of lawfully admitted evidence and Mr. Smith's comment, being unsupported hearsay evidence, cannot itself sustain the rasing of the grade. The Standard Scoring Plan Outline for this question reflects that to receive an 8, the examinee must demonstrate that all categories are satisfied, that errors are attributable to misread tables or calculating devices, and that errors would be corrected by routine checking. The results must be reasonable if not correct. For a 9, the examinee must demonstrate that all categories are satisfied; that a correct solution is arrived at but the examinee has been excessively conservative in the choice of working values; and that examinee's presentation is lacking in completeness or equations diagrams or orderly steps in solution, etc. Subqualifications for a 9 indicates that the answer is correct but that the organization of the solution is not logical. One error in calculation in any of the Parts from a to d, which does not affect the other parts of the solution, is acceptable. Mr. Kenneth Weldon, the Assistant State Drainage Engineer for the Department of Transportation, an expert in the area of drainage to which this problem relates, reviewed the question and the Petitioner's answer thereto and would award a grade of 8 to her answer. He found various numerical mathematical errors which led to the wrong solution. In addition, Petitioner made various assumptions that, though supposedly supported, were, he felt, in error through her misinterpretation. In general, none of the actual solutions she arrived at were correct. Specifically, that portion of the problem to determine the cross sectional area of the waterway for establishing normal depth flow was done incorrectly. Because the Petitioner used incorrect equations throughout the problem, the depth flow computed is high. Petitioner did no analysis to determine whether or not any of the several situations relating to flow control were pertinent. Mr. Weldon initially felt Petitioner's answer to the question merited a grade of 6. This means that the examinee knew all the proper steps but failed to interpret some of the criteria properly. He could not award her a grade of 9 which would indicate all categories were satisfied and the solution was correct, if conservative. Petitioner's solutions were incorrect. He subsequently changed his award to an 8, however, on the basis that the Petitioner's errors were attributable to a misread table or calculating device and would be corrected by routine checking. The result was reasonable, though not correct. Mr. Weldon did not like this question even though he believed it appropriate for a one-hour exam. As written, it involves establishing and making judgements beyond what someone minimally competent would be expected to do. It requires materials that are beyond what are normally available to someone taking the exam. However, Petitioner failed to make proper provision to protect herself in a case where the question is inappropriate or incomplete. If she felt something was wrong with the question, she should have clearly stated the assumption she was making to solve the problem. This was her responsibility and she failed to do so. In Mr. Weldon's opinion, Petitioner's answer might merit a grade slightly higher but not significantly higher. His reasoning is that Petitioner misinterpreted the criteria she stated for writing the problem. Her comment that the Department of Transportation uses 100 year storm criteria was incorrect even though that statement is made in outdated Department of Transportation publications. The basis for her answer is not well established or correct, or based on engineering calculations or judgement, and at best he could award no more than an 8.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is, therefore: RECOMMENDED that a Final Order be entered affirming the score awarded to Petitioner on questions 124 and 421, respectively, of the Civil Engineering Examination administered to her in April, 1987. RECOMMENDED this 10th day of June, 1988, at Tallahassee, Florida. ARNOLD H. POLLOCK, Hearing Officer Division of Administrative Hearings The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 10th day of June, 1988. APPENDIX TO RECOMMENDED ORDER, CASE NO. 87-5110 The following constitutes my specific rulings pursuant to Section 120.59(2), Florida Statutes, on all of the Proposed Findings of Fact submitted by the parties to this case. For the Petitioner None For the Respondent Accepted and incorporated herein. Accepted and incorporated herein. Accepted and incorporated except for the characterization of several assumptions as guesses. No evidence exists to support such a characterization even though they are incorrect. Accepted and incorporated herein. Accepted and incorporated herein. Accepted and incorporated herein. Accepted and incorporated herein. Accepted and incorporated herein. COPIES FURNISHED: Kristina V. Tignor, pro se 2160 North Oval Drive Sarasota, Florida 34239 H. Reynolds Sampson, Esquire Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32399-0750 Allen R. Smith, Jr. Executive Director DPR, Board of Professional Engineers 130 North Monroe Street Tallahassee, Florida 32399-0750
The Issue Is Petitioner entitled to enough credit so as to have passed the professional engineering examination?
Findings Of Fact Petitioner took the April 18-19, 1997, Professional Engineer Licensing Examination. A passing grade would have been "70." Petitioner achieved a scaled score of "68." In order to achieve a passing grade, he would have to prove entitlement to two more points per scale. Question * involved engineering ethics. In a multiple choice of four possibilities, examinees were asked to determine under what conditions a professional engineer may ethically accept gift items from potential suppliers. Petitioner selected the most restrictive possible answer, multiple choice answer "d," to the effect that it is never appropriate to accept any item from a supplier. Petitioner took the position that if a professional engineer never accepts anything from anybody, then s/he never owes anyone anything and therefore s/he can never have his/her professional judgment clouded by favoritism nor can s/he be "corrupted." In support of his answer, Petitioner quoted from, and introduced, Board-approved manual sections related to the duty that registered professional engineers owe to one another. Petitioner's answer was graded "incorrect" because the type of gifts specifically named in the question are not deemed prohibited in the practice of engineering. According to the grading system, multiple choice answer "c" would have been completely correct. Even applying Petitioner's belief system, the Agency's expert was unable to relate the question about suppliers and the items listed in the question to the duty owed among engineers because the ethical consideration concerning the duty of one engineer to another is confined to "valuable" exchanges and the examination question referred to named items, the monetary value of which "is not significant." In the expert's opinion, Petitioner should have relied on the portions of the manual related to an engineer's duty not to solicit or accept "valuable" considerations in connection with work for clients. Nonetheless, although Petitioner's answer "d" was considered technically "wrong" by the national testing service, the Agency expert testified that it still could have been "double-keyed" as a "subordinate correct alternative answer." The only reason it was not "double keyed" as a subordinate correct alternative answer is because similarly stringent responses from licensure candidates were minimal. (TR-39). Neither witness could testify as to how much the sole question at issue herein was worth in scoring points (TR-28, 48- 50). Nobody testified how many points Question * was worth or whether the Question * that is at issue herein was the Question * from the morning or afternoon testing session. By reference to Petitioner's scored answer sheet (Petitioner's Exhibit 4), the undersigned has determined that the question at issue was Question * of the morning session and the correct answer was worth only one additional raw point for the following reasons. As set out supra, the oral testimony and all the exhibits show that Question No. * at issue ideally should have been answered "c," and that Petitioner answered "d." The score shown on Petitioner's Exhibit 4 for the afternoon session is "26 x 2 = 52" correct answers out of 60 questions. The score sheet page shows 34 wrong answers. Arithmetic would suggest that each afternoon question was worth two raw points. However, on Question * of the afternoon testing session, Petitioner answered "c" and the grader's marks indicate that the correct answer was "d." Therefore, upon all the evidence, I deduce that the afternoon session Question * is not the question at issue here. However, on the morning session page, Petitioner's answer to Question * was "d," and it was marked wrong because the grader thought it should have been "c." The morning session answer sheet equates with all other evidence concerning the question and answer at issue in this cause. There were 120 questions on the morning session, for which Petitioner received 62 points on his answer sheet. For the morning session, it appears that 58 of Petitioner's answers were marked wrong. Therefore, 62 correct answers and 58 wrong answers out of a possible 120 questions, would logically indicate that each question on the morning session was worth one raw point. This is borne out by the total score for the entire examination recorded on the morning session page as "62 + 52 = 114 = 68.0 scale." There is no scale provided by which to translate the raw score of 114 into 68.0.
Recommendation Upon the foregoing findings of fact and conclusions of law, it is RECOMMENDED that the Department of Business and Professional Regulation enter a Final Order awarding Petitioner one additional point on his examination and denying him a passing grade thereon. DONE AND ENTERED this 26th day of June, 1998, in Tallahassee, Leon County, Florida. ELLA JANE P. DAVIS Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 26th day of June, 1998. COPIES FURNISHED: Gabriel Enriquez 3461 Southwest Second Avenue Apartment 218 Gainesville, Florida 32607 R. Beth Atchison, Esquire Department of Business and Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399 Angel Gonzalez, Director Department of Business and Professional Regulation Board of Professional Engineers Northwood Centre 1940 North Monroe Street Tallahassee, Florida 32399 Lynda Goodgame, Esquire Department of Business and Professional Regulation Northwood Centre 1940 North Monroe Street Tallahassee, Florida 32399
Findings Of Fact Lee Ricciardi is a 62 year old male who, before retirement, spent most of his working life as an automobile salesman. He worked as a carpenter in construction while in high school and, since leaving the automobile business has worked for U.S. Home Corporation in home construction, has built homes in Connecticut and Massachusetts and built his own home in Tarpon Springs. Petitioner took the recommended course to prepare for the examination and he has taken the examination four times, failing on each occasion. His overall grade on the examination here challenged which was taken in October 1986 was 63.05. A grade of 70.0 is required to pass the examination. Exhibit 1 shows that on the four examinations given to applicants for licensure as residential contractors between October 1985 and October 1986 the percentage passing range from 34 percent in June 1986 to 58 percent in October 1985. Those questions excepted to by Petitioner, as shown on Exhibit 3, are the same questions shown in Exhibit 1. Most of the questions which Petitioner objected to involve calculations of the amount of materials, such as concrete, reinforcing bars, fill, etc. needed for the project comprising the examination problem. Petitioner merely contends that the concrete supplier can compute the amount of concrete needed for foundations, driveways, etc., the landscape contractor can advise the contractor the amount of fill, mulch and fertilizer that will be required, and that many of the questions asked on the exam are properly answered by the contractor's accountant. Unless the residential contractor can determine the amount of material he will need to complete the project he cannot accurately estimate the cost of materials and labor he will have to expend to complete the construction. Lacking accurate information in costs, he cannot competently bid on constructing a residence for a prospective customer. Of the four questions given the first morning of the examination which are challenged by Petitioner, 66 percent, 56 percent, 55 percent and 62 percent of the applicants taking that exam provided the correct answer. Of the five examination questions from the afternoon of the first day of the examination which are challenged by Petitioner, 51 percent, 30 percent, 42 percent, 48 percent and 38 percent of the examinees gave correct answers. Of those questions on the second day of the examination which are challenged by Petitioner, correct answers were provided by 65 percent, 76 percent, 71 percent, 70 percent, 79 percent, 67 percent, 46 percent, 54 percent, 51 percent and 58 percent of the examinees. Following an examination the answers are screened to determine the number of applicants providing correct and incorrect answers. The higher the percentage of examinees providing the correct answer the more valid the question is presumed to be. On the October 1986 examination challenged by Petitioner, the answer to only one question was deemed invalid and two answers were accepted as correct for this question.
The Issue Did Petitioner pass the Mechanical Engineers Examination he took on April 24, 1998?
Findings Of Fact On April 24, 1998, Petitioner took the Mechanical Engineers Examination. He received a score of 69 for his effort. A passing score was 70. The Mechanical Engineers Examination was administered under Respondent's auspices. As alluded to in the preliminary statement, Petitioner challenged the score received on problem 146. The maximum score available for that problem was ten points. Petitioner received eight points. In accordance with the National Council of Examiners for Engineering and Surveying Principles in Practice of Engineering Examinations for spring 1998, score conversion table - discipline specific, Petitioner had a raw score of 47 which equated to a conversion of 69, to include the eight raw points received for problem 146. In addition, the examination provided a scoring plan for problem 146, which assigns scores in increments of two points from zero to ten. To pass, it would be necessary for Petitioner to receive an incremental increase of two points, raising his score from eight points to ten points. This would give him a raw score of 49 points. According to the score conversion table - discipline specific, that would give Petitioner 71 points. According to the scoring plan for problem 146 to receive the ten points, Petitioner would have to demonstrate: Exceptional competence (it is not necessary that the solution to the problem be perfect) generally complete, one math error. Shows in-depth understanding of cooling load calculation psychrometrics. Problem 146 required Petitioner to: Determine the required cooling coil supply air quantity (cfm) and the conditions (°F db and °F wb) of the air entering and leaving the coil." Petitioner was provided a psychrometric chart to assist in solving problem 146. The examination candidates were also allowed to bring reference sources to the examination to assist in solving the examination problems. Petitioner brought to the examination, the Air-Conditioning Systems Design Manual prepared by the ASHRAE 581-RP Project Team, Harold G. Lorsch, Principal Investigator. Petitioner used that manual to determine the wet-bulb temperature of the air entering the coil. In particular, he used an equation from the manual involving air mixtures. For that part of the solution he arrived at a temperature of 65.6°F wb. According to the problem solution by Respondent's affiliate testing agency, reference ASHRAE Fundamentals Chapter 26, the coil entering wet-bulb temperature taken from the psychrometric chart was 66.12°F wb. The scorer in grading Petitioner's solution for problem 146 placed an "x" by the answer provided 65.6°F wb and wrote the words "psychrometric chart." No other entry or comment was made by that scorer in initially reviewing the solution Petitioner provided for that problem. This led to the score of eight. The scoring plan for problem 146 for the April 1998 examination taken by Respondent equates the score of eight as: MORE THAN MINIMUM BUT LESS THAN EXCEPTIONAL COMPETENCE Either a) Provides correct solution to problem with two math errors or incorrect dry-bulb or wet-bulb for coil entering or leaving conditions or minor total cooling load error, or b) Provides correct solution to items c and d correctly and minor math errors in items a and b of Score 6 below. Petitioner was entitled to review the results of his examination. He exercised that opportunity on September 21, 1998, through a post-examination review session. Petitioner requested and was provided re-scoring of his solution to problem 146. According to correspondence from the National Council of Examiners for Engineering and Surveying to the Florida Member Board from Patricia M. Simpson, Assistant Supervisor of scoring services, the score did not change through re-scoring. In this instance, the October 14, 1998 correspondence on re-scoring states, in relation to problem 146: Incorrect methodology used in calculating coil entering wet-bulb temperature. Incorrect coil entering wet-bulb temperature provided. No calculation provided for coil leaving temperature conditions. The coil leaving wet-bulb temperature in Respondent's proposed solution was 53.22°F wb taken from the psychrometric chart. Petitioner's solution for the coil leaving wet-bulb temperature taken from the psychrometric chart was 53.3°F wb. At hearing Respondent did not provide an expert to establish the basis for point deduction in the original score and the re-scoring of Petitioner's solution for problem 146. Moreover, Respondent did not present expert witnesses to defend the commentary, the preferred written solution in its examination materials. Consequently, Respondent's preferred solution constitutes hearsay about which no facts may be found accepting the validity of Respondent's proposed solution, as opposed to merely reporting that information.1 By contrast, Petitioner provided direct evidence concerning the solution provided for problem 146 in response to the criticisms of his solution that were unsupported by competent evidence at hearing. More importantly the criticisms were responded to at hearing by Geoffrey Spencer, P.E., a mechanical engineer licensed to practice in Florida, who was accepted as an expert in that field for purposes of the hearing. As Petitioner explained at hearing, he used the Air- Conditioning Systems Design Manual equation to arrive at the coil entering wet-bulb temperature, which he believed would provide the answer as readily as the use of the psychrometric chart. (Although the psychrometric chart had been provided to Petitioner for solving problem 146, the instructions for that problem did not prohibit the use of the equation or formula.) Petitioner in his testimony pointed out the equivalency of the process of the use of the psychrometric chart and the equation. Petitioner deemed the equation to be more accurate than the psychrometric chart. Petitioner had a concern that if the answer on the coil entering wet-bulb temperature was inaccurate, this would present difficulty in solving the rest of problem 146 because the error would be carried forward. Petitioner pointed out in his testimony that the solution for determining the coil entering wet-bulb temperature was set out in his answer. The answer that was derived by use of the formula was more time consuming but less prone to error, according the Petitioner's testimony. Petitioner points out in his testimony that the answer he derived, 65.6°F wb, is not significantly different than Respondent's proposed solution of 66.12°F wb. (The instructions concerning problem 146 did not explain what decimal point of a degree the candidate had to respond to in order to get full credit for that portion of the solution to the problem.) Petitioner in his testimony concerning his solution for the coil leaving wet-bulb temperature indicated that the calculation for arriving at that temperature was taken from the psychrometric chart and is sufficiently detailed to be understood. Further, Petitioner testified that the degree of accuracy in which the answer was given as 53.3°F wb, as opposed to Respondent's proposed solution of 53.22°F wb, is in recognition of the use of the psychrometric chart. Petitioner questions whether the proposed solution by Respondent, two decimal points, could be arrived at by the use of the psychrometric chart. In relation to the calculation of the coil entering wet-bulb temperature, Mr. Spencer testified that the formula from the Air-Conditioning Systems Design Manual or the psychrometric chart could have been used. Moreover, Mr. Spencer stated his opinion that the solution for coil entering wet-bulb temperature of 65.6°F wb by Petitioner is sufficiently close to Respondent's proposed solution of 66.12°F wb to be acceptable. Mr. Spencer expressed the opinion that Petitioner had correctly used the formula from the manual in solving the coil entering wet-bulb temperature. Mr. Spencer expressed the opinion that the psychrometric chart is an easier source for obtaining the solution than the use of the formula from the manual. In Mr. Spencer's opinion, the formula shows a more basic knowledge of the physics involved than the use of the psychrometric chart would demonstrate. In relation to the coil leaving wet-bulb temperature, Mr. Spencer expressed the opinion that Petitioner had adequately explained the manner of deriving the answer. Further, Mr. Spencer expressed the opinion that the answer derived was sufficiently accurate. The testimony of Petitioner and opinion of Mr. Spencer is unrefuted and accepted.
Recommendation Upon consideration of the facts found and conclusions of law reached, it is RECOMMENDED: That a final order be entered which finds that Petitioner passed the Florida Board of Professional Engineers April 24, 1998, Mechanical Engineers Examination with a score of 71. DONE AND ENTERED this 22nd day of February, 1999, in Tallahassee, Leon County, Florida. CHARLES C. ADAMS Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 22nd day of February, 1999.
Findings Of Fact Respondent is the state agency charged with the duty of regulating general contractors in the State of Florida. An applicant for certification as a plumbing contractor must pass the examination administered by Respondent as a prerequisite to certification. Section 489.113(1), Florida Statutes. Petitioner sat for Part I of the plumbing contractor's examination on February 19, 1990. Petitioner did not pass Part I of the examination. Following notification that he had not passed Part I of the examination, Petitioner filed a timely challenge to Question 7. Petitioner scored the highest score one can score on Part I without passing that part of the examination. Had Petitioner been awarded any credit for his answer to Question 7 or if question 7 were thrown out, he would have passed Part I of the examination. Question 7 is an objective, multiple choice question. The candidate is required to choose the correct response from among four possible answers. Prior to taking the examination, Petitioner was told by Respondent that certain approved reference materials were used in formulating the examination questions and that certain reference materials could be used during the examination. Among those reference materials was Circular E prepared by the Internal Revenue Service. Question 7 provided certain information in the stem of the question and offered four different dates as possible answers to the question. Based on the factual information stated in the stem of the question, the candidate was to determine the latest date a certain tax form must be filed. The information contained in the stem of the question and the information available to all candidates in IRS Circular E were sufficient to enable the candidate to correctly answer the problem. The evidence does not support Petitioner's contention that this question is unfairly deceptive or otherwise defective. Respondent gave Petitioner no credit for his answer to Question 7 because Petitioner gave the wrong answer to the question.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is: RECOMMENDED that Respondent, State of Florida, Department of Professional Regulation, enter a final order which denies Petitioner's challenge to Question It is further recommended that Respondent's Exhibit 1 be sealed. DONE AND ENTERED in Tallahassee, Leon County, Florida, this 20th day of February, 1991. CLAUDE B. ARRINGTON Hearing Officer The DeSoto Building 1230 Apalachee Parkway Tallahassee, FL 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 20th day of February, 1991. APPENDIX TO RECOMMENDED ORDER, IN CASE NO. 90-4407 The following rulings are made on the proposed findings of fact submitted on behalf of Respondent. The proposed findings of fact in paragraph 1 are rejected as being unnecessary to the findings made and to the conclusions reached. The proposed findings of fact in paragraphs 2-10 are rejected as being subordinate to the findings made and because Section 455.230, Florida Statutes, discourage such detailed findings about a confidential examination question. Copies furnished: Thomas Tighe 8581 N.W. 3rd Street Pembroke Pines, Florida 33024 Roberta L. Fenner, Esquire Department of Professional Regulation 1940 North Monroe Street, Suite 60 Tallahassee, Florida 32399-0792 Jack McRay, General Counsel Department of Professional Regulation 1940 North Monroe Street, Suite 60 Tallahassee, Florida 32399-0792 Fred Seely, Executive Director Department of Professional Regulation Construction Industry Licensing Board Post Office Box 2 Jacksonville, Florida 32202
