The Issue Whether Petitioner is entitled to additional credit for his responses to question numbers 21 and 24 of the Principles and Practice of Engineering Examination administered in April 1998.
Findings Of Fact Petitioner took the April 24, 1998 professional engineering licensing examination with an emphasis in civil engineering. A score of 70 is required to pass the test. Petitioner obtained a score of 69. In order to achieve a score of 70, Petitioner needs a raw score of 48. Therefore, Petitioner is in need of at least one additional raw score point. Petitioner is challenging question numbers 21 and 24. They are both multiple-choice questions and worth one point each. Exhibit 10 contains a diagram for the candidate's use in answering question numbers 21 and 24. Question 21 requires the examinee to calculate the percentage of wooded land on the diagram. The diagram contains a rectangle labeled "woodlot," and within the rectangle are three non-contiguous areas marked with schematics of trees. The Petitioner reduced the percentage of wooded area to conform to the portion of the area labeled "woodlot" marked with schematics of trees. In regard to question number 21, the Petitioner asserts that as a matter of convention, by failing to put the trees everywhere in the wooded lot, one may assume that there are trees only where there is a schematic of the trees. The Petitioner's challenge was rejected on the basis that the scorer opined that it is standard practice that drawings are only partially filled with details, and the most reasonable interpretation of the site plan drawings is that the woodlot fills the entire area enclosed by the rectangle. John Howath, a professional engineer, testified regarding accepted conventions in engineering drawings. In Howath's opinion the drawing on the examination used inconsistent methodologies and was confusing regarding whether all of the area designated by the label or "call out" of woodlot was in fact wooded. Both the Petitioner and Mr. Howath referred to drawings in the Civil Engineering Reference Manual which showed areas on drawings totally covered with visual indications of a particular material or condition. Peter Sushinsky, a professional engineer, testified as an expert for the Respondent. Mr. Sushinsky acknowledged the Petitioner's exhibits; however, Mr. Sushinsky noted that these were only a few examples of drawings that are available. Mr. Sushinsky referenced construction drawings he had seen in his practice with partial "cross-hatching" just like the diagram on the examination. In sum, Mr. Sushinsky's experience was that diagram might be totally or partially "cross-hatched." In Mr. Sushinsky's opinion it was not a bad diagram, only subject to a different interpretation by a minor group. Question number 24 asked the candidate to calculate the weir peak discharge from the catchment area using the rational formula. The Petitioner asserts the question is misleading and should read, "What is the peak discharge from the watershed?" The Petitioner bases his assertion on the ground that the "rational formula" is used to compute discharge from a watershed not a weir, as mandated by the question. The scorer did not address the Petitioner's concerns. The scorer stated, "It is clear from the item statement that the weir equation is not to be used." However, the questions ask the candidate to compute the weir discharge. Jennifer Jacobs, a professor of engineering, testified regarding the rationale formula that it was used to calculate watershed discharge and not weir discharge. All experts agreed that the rational formula is not used to compute weir discharge. The experts all agree that the question was confusing because the rational formula is not used to calculate the discharge from a weir. The Respondent's expert justifies the answer deemed correct on the basis that if one uses the rational formula and computes the watershed discharge, one of the answers provided is close to the result. The Respondent's expert calculated the watershed discharge as 230.6 cubic feet per second (cfs). The answer deemed correct was 232 cfs. The expert stated the weir attenuates flow. If the weir attenuates flow one would expect an answer less than 230.6 cfs., not an answer equal to or greater than 230.6 cfs. The amount of attenuation is based upon the physical features of the impoundment area and the mouth of the weir. Weir Attenuation varies. The only answers smaller than 230.6 are 200 or 32. Is the 232 cfs. answer wrong because it does not allow for attenuation by the weir? How much did the weir attenuate the flow? Under these facts, the question is capricious. The Respondent argues that the Petitioner didn't follow instructions while acknowledging that the "correct" answer is not the answer to the question that was asked.
Recommendation Based upon the foregoing Findings of Fact and Conclusions of Law set forth herein, it is RECOMMENDED: That the Respondent enter a final order awarding Petitioner two raw points and a passing score on the Principles and Practice of Engineering Examination. DONE AND ENTERED this 20th day of May, 1999, in Tallahassee, Leon County, Florida. STEPHEN F. DEAN Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 20th day of May, 1999. COPIES FURNISHED: Mark W. Nelson 720 Northwest 31st Avenue Gainesville, Florida 32609 Natalie A. Lowe, Esquire Board of Professional Engineers 1208 Hays Street Tallahassee, Florida 32301 Dennis Barton, Executive Director Board of Professional Engineers 1208 Hays Street Tallahassee, Florida 32301 William Woodyard, General Counsel Department of Business and Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792
Findings Of Fact Petitioner, Immaculate Espejo Asuncion, of St. Paul, Minnesota, filed an application with Respondent, Board of Medical Examiners, on September 21, 1982, for licensure by endorsement to practice medicine. (Testimony of Petitioner, Joint Exhibit No. 1) On March 7, 1983, Respondent issued a Notice of Intent to Deny Endorsement Licensure on the grounds that Petitioner had not obtained a 75 percent FLEX weighted average on the licensure examination of the Federation of State Medical Boards of the United States, Inc., as required by Rule 21M- 29.01(2), Florida Administrative Code, and was not certified by the National Board of Medical Examiners as having completed its examination within the ten years immediately preceding the filing of the application for licensure by endorsement, as required by Section 458.313(1)(d), Florida Statutes. Petitioner thereafter requested a hearing on the proposed denial of her application. (Testimony of Faircloth, Joint Exhibit No. 1) Petitioner was licensed to practice medicine in the state of Minnesota in 1978. She obtained such licensure by satisfactorily passing the clinical science and clinical competence portions of the FLEX examination, and by successfully completing a basic sciences examination administered by the Minnesota State Board of Examiners. (Testimony of Petitioner, Joint Exhibit No. 1) Petitioner is a graduate of a foreign medical school and is therefore not eligible to take the examination of the National Board of Medical Examiners. The alternate method of obtaining licensure by endorsement is by certification through licensure examination of the Federation of State Medical Boards of the United States, Inc. (FLEX). This examination has three parts and is taken over a period of three days. The three parts of the examination are basic science, clinical science, and clinical competence. The scores on the three parts are averaged under a formula to produce a weighted average score. Respondent's Rule 21M-29.01(2), Florida Administrative Code, requires that an applicant have a FLEX weighted average of 75 percent from one complete sitting on the examination. Petitioner took only the clinical science and clinical competence portions of the examination and therefore did not obtain a certified FLEX weighted average score. The Minnesota basic sciences examination taken by Petitioner was not the same basic sciences examination administered as part of the FLEX examination. (Testimony of Faircloth, Joint Exhibit No. 1)
Recommendation That Respondent enter a Final Order denying Petitioner's application for licensure by endorsement. DONE and ENTERED this 16th day of June, 1983, in Tallahassee, Florida. THOMAS C. OLDHAM Division of Administrative Hearings The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32301 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 16th day of June, 1983. COPIES FURNISHED: Immaculate Espejo-Asuncion, M.D. Dorothy J. Faircloth 80 Battle Creek Place Executive Director St. Paul, Minnesota 55119 Board of Medical Examiners 130 North Monroe Street John Griffin, Esquire Tallahassee, Florida 32301 Department of Legal Affairs The Capitol Tallahassee, Florida 32301 Fred Roche, Secretary Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32301
The Issue Whether Petitioner is entitled to credit for his answers to questions 42 and 81 of the morning session of the Fundamentals of Engineering Examination portion of the engineering licensure examination given on April 15, 2000.
Findings Of Fact Worku took the Fundamentals of Engineering Examination portion of the examination for licensure to practice as an engineer intern on April 15, 2000. The examination is a national multiple-choice examination developed and administered by the National Council of Examiners for Engineers and Surveyors (NCEES). The examination is divided into a morning session and an afternoon session. The questions in the morning session are worth one raw point each. The questions in the afternoon session are worth two raw points each. Worku challenged questions 42 and 81, which were on the morning session of the examination. Worku received 56 raw points for the morning session and 52 raw points for the afternoon session for a total raw score of 108 on the examination. Based on the NCEES' Score Conversion Table, a raw score of 108 converts to a score of 69. A converted score of 70, which equates to a raw score of 109-113, is a passing score. Question 81 asked the examinee to identify the geometric shape that was given by an equation provided in the question. Each examinee was given a reference manual during the examination. The manual contains general formulas for the types of geometric shapes listed as possible answers to question 81. The equation given in question 81 was for a specific shape and was not listed among the general formulas in the reference manual. Worku felt that because the general equation was not used that the equation was stated incorrectly. However, the equation was stated correctly. The equation differed from the equation listed in the reference manual because it was for a special shape of the geometric figure. Worku did not answer question 81 correctly. Question 42 dealt with recrystallization as it relates to metal. The question asks the examinee to pick the answer which explains the reference to the term "recrystallization" in the question. Worku contends that there are two correct answers to question 42 and that the answer which he provided is one of the correct answers. The answer which Worku provided is not a correct answer. It refers to the process of annealing, which is the process of decreasing the toughness of a metal. Recrystallization can be a part, but is not always part of annealing. Recrystallization and annealing are not synonymous terms; thus Worku is not entitled to credit for question 42.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a Final Order be entered finding that Amanuel Worku failed the Engineering Fundamentals Examination with a score of 69. DONE AND ENTERED this 5th day of January, 2001, in Tallahassee, Leon County, Florida. ___________________________________ Susan B. Kirkland Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 5th day of January, 2001. COPIES FURNISHED: Amanuel Worku 18492 Northwest 52nd Path Miami, Florida 33055 Douglas Sunshine, Esquire Florida Engineers Management Corporation 1208 Hays Street Tallahassee, Florida 32301 Natalie A. Lowe, Executive Director Board of Professional Engineers 1208 Hays Street Tallahassee, Florida 32301 Barbara D. Auger, General counsel Department of Business and Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792
The Issue Whether Petitioner meets the requirements of Section 471.015(3), Florida Statutes (2007), for licensure as a professional engineer by endorsement.
Findings Of Fact Petitioner attended Old Dominion University, Norfolk, Virginia, from fall of 1983, to May 16, 1987. He graduated May 16, 1987, with a Bachelor of Science Degree in Engineering Technology, with a major in Mechanical Engineering Technology. There is no affirmative evidence that Old Dominion University's curriculum demonstrates a deficient level of competence necessary to practice engineering in the State of Florida in the capacity of a Professional Engineer to protect public health and safety. There is no affirmative evidence of conditions unique to the State of Florida that warrant a level of competence beyond that demonstrated by Petitioner's Degree in Engineering Technology. Petitioner passed the National Council of Examiners for Engineering and Surveying Examination Part I (NCEES) Fundamentals of Engineering examination on April 11, 1987. Petitioner passed the NCEES Principles and Practices examination on October 27, 1995. Petitioner received a professional engineering license to practice in the Commonwealth (State) of Virginia on January 30, 1996. Petitioner received a professional engineering license to practice in the State of Alabama on May 30, 2003. Petitioner received a professional engineering license to practice in the State of Texas in 2005. Petitioner received a professional engineering license to practice in the State of Wisconsin in 2005. Petitioner applied for a Florida professional engineering license by endorsement on July 12, 2007. Petitioner has over four years' active engineering experience, meeting the requirements set forth in Section 471.013(1)(a), Florida Statutes. There is no evidence that the Florida Board of Professional Engineers requested supplemental information beyond that required by the Respondent's Application for Licensure by Endorsement, but Petitioner had every opportunity to present evidence in the present de novo proceeding. The Notice of Denial issued by the Florida Board of Professional Engineers on January 14, 2008, reads, in pertinent part: The Applicant does not satisfy the Education requirements of Chapter [sic] 471.015 that incorporates by reference Chapter [sic] 471.013 Florida Statutes. Your application failed to meet requirements of Section 471.013 (1) (a) F.S. Under this provision of the law, you must evidence a degree from an EAC/ABET accredited engineering program. You hold a Bachelor of Science in Engineering Technology Degree from Old Dominion University, Norfolk, Virginia. The Applicant does not have a Board approved degree.
Recommendation Based on the foregoing Findings of Facts and Conclusions of Law, it is RECOMMENDED that the Florida Board of Professional Engineers enter a final order denying Petitioner's application for licensure as a professional engineer by endorsement. DONE AND ENTERED this 28th day of July, 2008, in Tallahassee, Leon County, Florida. S ELLA JANE P. DAVIS Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 28th day of July, 2008.
The Issue Whether Petitioner is entitled to additional credit for his solutions to four problems on the Principles and Practice of Engineering portion of the engineering licensure examination administered on October 30, 1998, by the National Council of Examiners for Engineers and Surveyors.
Findings Of Fact Based upon the evidence adduced at hearing and the record as a whole, the following findings of fact are made: On October 30, 1998, as part of his effort to obtain a Florida engineering license, Petitioner sat for the Principles and Practice of Engineering Examination (Examination). This is a national examination developed and administered by the National Council of Examiners for Engineers and Surveyors (NCEES). Petitioner chose to be tested in civil engineering. Petitioner received a raw score of 45 on the Examination. For the civil engineering specialization, a raw score of 45 converts to a score of 67. To pass the Examination, a converted score of 70 is needed. Petitioner formally requested (in writing, by letter dated March 26, 1999) that his solutions to Problems 120, 125, and 222 on the Examination be rescored. Petitioner's written request was made to Natalie Lowe of the Board, who forwarded it to the NCEES. Appended to Petitioner's letter to Ms. Lowe were two pages of "scratch paper" on which Petitioner had written during his post-examination review on March 19, 1999. On the first page were written comments he had made regarding the scoring of Problems 120 and 125. On the second page were the following written comments he had made regarding the scoring of Problems 220 and 222: 220 a, b, & c 2 parts b & c correct. Min. mark I should get[:] At least 5 instead of 2 and maybe 7. There is an error. 222 ok The NCEES's rescoring of Petitioner's solutions to Problems 120, 125, and 222 resulted in his receiving a raw score of 43 (or a converted score of 65, 5 points less than he needed to pass the Examination). The Board received the NCEES's rescoring results on May 12, 1999. The Board subsequently referred the matter to the Division to conduct an administrative hearing. At the administrative hearing that was held pursuant to the Board's referral, Petitioner challenged the grading of his solutions to Problems 120, 125, and 220 of the Examination, and indicated that he had "no dispute concerning the grading of [his solution to Problem] 222," notwithstanding that he had requested, in his March 26, 1999, letter to Ms. Lowe, that his solution to Problem 222 be rescored. Petitioner explained that he had made this request as a result of inadvertence and that he had actually intended to seek rescoring of his solution to Problem 220, not Problem 222. Problems 120, 125, and 222 were worth ten raw points each. Problem 120 contained four subparts (or requirements). Petitioner initially received four raw points for his solution to Problem 120. Rescoring did not result in any change to this score. Petitioner solved two subparts of Problem 120 correctly (subparts (a) and (b)). The solutions to the other two subparts of Problem 120 (subparts (c) and (d)), however, were incorrect inasmuch as Petitioner had neglected, in making the lateral force calculations and drawing the diagrams required by these subparts, to include the force attributable to the movement of the groundwater referred to in the problem. Therefore, in accordance with the requirements and guidelines of the NCEES scoring plan for this problem, the highest raw score that he could have received for his solution to this problem was a four, which is the score he received. Problem 125 contained three subparts (or requirements). Petitioner initially received a raw score of two for his solution to Problem 125. Upon rescoring, no change was made this raw score. Petitioner correctly solved only one of the three subparts of Problem 125 (subpart (c)). In his solution to subpart (a) of Problem 125, Petitioner did not provide, as required by this subpart, the quantities of water, cement, and aggregate necessary for the project described in the problem. Petitioner's solution to subpart (b) did not describe one of the acceptable slump increasing methods that the candidates were required describe in their solution to this subpart. Accordingly, giving Petitioner a raw score of two for his solution to Problem 125 was consistent with the requirements and guidelines of the NCEES scoring plan for this problem. Petitioner received a raw score of two for his solution to Problem 220. He did not request, in his March 26, 1999, letter to Ms. Lowe, a rescoring of his solution to this problem, and, as a result, his solution was not rescored. At the administrative hearing, Petitioner testified on his own behalf regarding the scoring of this solution and, during his testimony, contended that the score he received was too low; however, neither a copy of the problem, nor a copy of the NCEES scoring plan for this problem, was offered into evidence. Accordingly, the record is insufficient to support a finding that the score Petitioner received for his solution to Problem 220 was undeservedly low in light of the NCEES scoring plan for this problem. Petitioner initially received a raw score of eight for his solution to Problem 220. Rescoring resulted in this score being reduced two points to a six. Petitioner did not present any evidence supporting the position (which he advances in his Proposed Recommended Order) that he should have received a higher score for his solution to this problem, and, consequently, Respondent's expert, in his testimony at hearing, did not address the matter. While there were exhibits offered (by Respondent) and received into evidence relating to the scoring of Petitioner's solution to Problem 222, it is not apparent from a review of these exhibits that such scoring deviated from the requirements of the NCEES scoring plan for this problem (which was received into evidence as part of Respondent's Exhibit 12).
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a final order be entered rejecting Petitioner's challenge to the failing score he received from the NCEES on the Principles and Practice of Engineering portion of the October 30, 1998, engineering licensure examination. DONE AND ENTERED this 20th day of December, 1999, in Tallahassee, Leon County, Florida. STUART M. LERNER Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 20th day of December, 1999.
Findings Of Fact In April 1995, Abraham S. Inlong (Petitioner) took the Electrical Engineer part of the Professional Engineering Examination (Examination). A minimum grade of 70 is required to pass the Examination. The Department of Business and Professional Regulation, Board of Professional Engineers (Respondent) notified Petitioner that he had failed the Examination, having received a grade of 69.10. The Examination is a national examination and is graded by national examiners. Respondent issues licenses to practice professional engineering in the State of Florida and administers the Examination on behalf of the State. Petitioner challenges, the answer selected by the national examiners to Problem 433, Question 6 of the Examination, which is A. Respondent selected D as the answer, which states that A, B, and C are all correct. As part of the instructions for candidates taking the Examination, the candidates were to choose the best answer. The best answer is the correct answer. Respondent's response to Problem 433, Question 6 was regraded by the national examiners. They denied Respondent any additional credit. The best and correct answer to Problem 433, Question 6 is the answer identified by Respondent as the answer by the national examiners, i. e., A. The answer selected by Petitioner is not the best and correct answer. A diagram is part of the challenged problem and question. The diagram is clear and unambiguous. The scope of knowledge required for the challenged problem and question is not beyond the knowledge reasonably expected from a candidate for licensure. The challenged problem and question contain sufficient information for a candidate for licensure to select the best and correct answer. Additional information was unnecessary, including whether the system was balanced or unbalanced. The challenged problem and question are clear and unambiguous. The challenged problem and question are not devoid of logic and reason. The challenged problem and question are valid. Statistics indicate that 60 percent of the candidates for licensure (candidates), who took the Examination, answered Problem 433 correctly and that 48 percent of the candidates answered Problem 433, Question 6 correctly.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that the Department of Business and Professional Regulation, Board of Professional Engineers, enter a final order dismissing Abraham S. Inlong's examination challenge and denying him licensure. DONE AND ENTERED this 1st day of August, 1996, in Tallahassee, Leon County, Florida. ERROL H. POWELL, Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 1st day of August, 1996. APPENDIX TO RECOMMENDED ORDER, CASE NO. 96-0031 The following rulings are made on the parties' proposed findings of fact: Petitioner's Proposed Findings of Fact Partially accepted in findings of fact 1 and 2. Partially accepted in finding of fact 4. Partially accepted in findings of fact 4 and 8. Partially accepted in finding of fact 7. Rejected as being not supported by the greater weight of the evidence, not supported by the more credible evidence, argument, or a conclusion of law. Rejected as being not supported by the greater weight of the evidence, not supported by the more credible evidence, argument, or a conclusion of law. Rejected as being not supported by the greater weight of the evidence, not supported by the more credible evidence, argument, or a conclusion of law. Rejected as being not supported by the greater weight of the evidence, or not supported by the more credible evidence. Rejected as being not supported by the greater weight of the evidence, or not supported by the more credible evidence. Respondent's Proposed Findings of Fact 1. Partially accepted in finding of fact 1. 2. Partially accepted in finding of fact 2. 3. Partially accepted in finding of fact 2. 4. Partially accepted in finding of fact 2. 5. See Preliminary Statement. 6. See Preliminary Statement. 7. Partially accepted in finding of fact 4. 8. Partially accepted in finding of fact 4. 9. Partially accepted in finding of fact 7. 10. Partially accepted in finding of fact 11. 11. Partially accepted in finding of fact 10. 12. Partially accepted in finding of fact 9. 13. Partially accepted in finding of fact 10. 14. Partially accepted in finding of fact 10. Partially accepted in findings of fact 9 - 12. Partially accepted in finding of fact 12. Partially accepted in finding of fact 6. Rejected as being subordinate, argument, or a conclusion of law. Partially accepted in finding of fact 8. Partially accepted in finding of fact 14. Partially accepted in finding of fact 13. Rejected as being subordinate, or unnecessary. Rejected as being subordinate, or unnecessary. Rejected as being subordinate, or unnecessary. NOTE--Where a proposed finding has been partially accepted, the remainder has been rejected as being subordinate, irrelevant, unnecessary, not supported by the greater weight of the evidence, not supported by the more credible evidence, argument, or a conclusion of law. COPIES FURNISHED: Harold M. Braxton, Esquire One Datran Center, Suite 400 9100 South Dadeland Boulevard Miami, Florida 33156-7815 R. Beth Atchison Assistant General Counsel Department of Business and Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0750 Angel Gonzalez, Executive Director Department of Business and Professional Regulation Board of Professional Engineers 1940 North Monroe Street Tallahassee, Florida 32399-0755 Lynda Goodgame, General Counsel Department of Business and Professional Regulation Northwood Centre 1940 North Monroe Street Tallahassee, Florida 32399-0792
The Issue The issues in this case are whether Petitioner, Gary P. Santoro (“Petitioner” or “Mr. Santoro”), undeservedly received a failed grade on the Construction Business and Finance Examination (“Examination”) for licensure as an air-conditioning contractor; whether any questions on the examination had more than one correct answer; whether the examination is unfair; whether there is transparency in the examination review process; and whether the examination grading process is arbitrary and capricious.
Findings Of Fact Mr. Santoro took the Examination on November 16, 2018. Petitioner failed the Examination because he scored less than 70 percent correct. The Examination contains 125 questions, 120 of which are scored. The other five are not scored and are considered “pilot” questions for potential use on future examinations. In order to pass the Examination, a candidate must obtain a score of at least 70 percent. All scored questions on the Examination are weighted equally. As a result of failing to pass the Examination, Petitioner was notified of his results. All questions on the Examination had a single correct answer. Cynthia Woodley, Ph.D., employed by Professional Testing, Inc. (“PTI”), as the chief operating officer, is an expert in psychometrics and exam development. She holds a master’s degree in vocational education and a doctorate in curriculum and instruction with a specialization in measurement. Her current position calls for her to manage a number of licensure and certification exam programs. She explained at length how specific questions become part of a professional licensure exam. To develop questions, her company brings in any number of subject matter experts, people actually employed in the professions being tested, and they help develop subject matter questions for a particular exam. That was the process used for development of the Examination in this matter. Once the subject matter experts are trained in exam question writing techniques, they write questions, which are reviewed by other subject matter experts to determine whether the questions are fair and understandable enough to be answered by prospective test takers. Generally, five subject matter experts review each question before it makes its way onto an exam. PTI measures the “P value” of the questions by determining what percent of individuals taking a given exam answer a particular question correctly. For example, a P value of .90 means that 90 percent of the people taking the exam answered a particular question correctly. PTI looks for a wide range of P values in its exam questions. If a P value is too low, say .40, the company might reexamine that question to determine whether it should be removed from future exams since fewer than half the people taking the exam answered it correctly. The business and finance portion of the exam is given to all contractors, regardless of their specialty, with the exception of pool service contractors. Here, Petitioner, a HVAC contractor was administered the same Examination as plumbing contractors, electrical contractors, general contractors, etc. Each of the 120 questions on the exam in this case was equally weighted. There were also five pilot questions inserted into the exam, which did not count towards the total score, but were included as test questions for future exams. Petitioner provided hearsay documents regarding computer hacking and computer glitches associated with some exams administered around the United States. However, he did not connect the articles submitted into evidence to the exam administered in this case or any exam administered by the Department in Florida. Dr. Woodley was familiar with the allegations of computer glitches in testing, but testified that the problems were with K-12 testing in schools, not with professional licensure exams, such as administered by the Department. Therefore, since the hearsay evidence was not linked to the exam at issue or similar professional licensure exams given in Florida, it is entitled to no weight in arriving at the decision in this case. Question BF 1290 has a single correct answer, which is answer “C.” Petitioner selected answer “B.” Petitioner was unable to demonstrate that the answer he selected was correct. Question BF 0473 has a single correct answer, which is answer “A.” Petitioner selected answer “C.” This question asks for an answer of general applicability. Petitioner’s claim that his answer is equally correct is based on a narrow exception in law. Accordingly, Petitioner was not able to demonstrate that the answer he selected was correct. Question BF 0162 has a single correct answer, which is answer “B.” Petitioner selected answer “C.” Petitioner was unable to demonstrate that the answer he selected was correct. Question BF 1691 has a single correct answer, which is answer “C.” Petitioner selected answer “D.” Petitioner was unable to demonstrate that the answer he selected was correct. Petitioner was unable to submit sufficient evidence to show that the Examination is unfair, that there is insufficient transparency in the examination review process, or that the examination grading process is arbitrary and capricious. Accordingly, he cannot prevail in his challenge to the Examination. Petitioner testified that he took and passed the HVAC contractors special license examination on his first attempt. He has taken the Examination on numerous occasions and is yet to be successful. He testified he studied hard for every administration of the exam, but just cannot reach the finish line successfully. While that is unfortunate, the evidence does not support that his failure to succeed on the Examination is the fault of the exam itself or of the Department either in its contracting to have the exam created or in the administration of the exam. From the way he conducted himself at hearing, Petitioner appears to be an intelligent, diligent, and successful individual in his HVAC business. For some unknown reason he has been unable to successfully complete the Examination. His persistence in retaking the Examination multiple times is admirable and should ultimately pay off with his successful passage of the Examination.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that the Construction Industry Licensing Board enter a final order upholding the Department’s Amended Grade Report finding that Petitioner failed to achieve a passing score on the Construction Business and Finance Examination, which he took on November 16, 2018. DONE AND ENTERED this 23rd day of August, 2019, in Tallahassee, Leon County, Florida. S ROBERT S. COHEN Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 23rd day of August, 2019. COPIES FURNISHED: Thomas G. Thomas, Esquire Department of Business and Professional Regulation 2601 Blair Stone Road Tallahassee, Florida 32399-2202 (eServed) Gary Peter Santoro Hometown Air & Services 8229 Blaikie Court Sarasota, Florida 34240-8323 (eServed) Ray Treadwell, General Counsel Office of the General Counsel Department of Business and Professional Regulation 2601 Blair Stone Road Tallahassee, Florida 32399-2202 (eServed) Daniel Biggins, Executive Director Construction Industry Licensing Board Department of Business and Professional Regulation 2601 Blair Stone Road Tallahassee, Florida 32399 (eServed) Halsey Beshears, Secretary Department of Business and Professional Regulation 2601 Blair Stone Road Tallahassee, Florida 32399-2202 (eServed)
The Issue The basic issue in this case is whether the Petitioner should be given a passing grade on the April, 1987, professional engineering examination. At the hearing the specific issues in dispute were narrowed to whether the Petitioner should be given a higher grade on each of three questions on the examination. At the hearing the Petitioner testified on his own behalf and presented the testimony of two other witnesses. He also offered several documentary exhibits into evidence. The Respondent offered the testimony of one witness and also offered several exhibits. Subsequent to the hearing a transcript of the hearing was filed with the Hearing Officer and the parties were given a reasonable time thereafter within which to file their proposed recommended orders. Both parties filed post-hearing submissions containing proposed findings of fact, conclusions of law, and recommendations. The parties' proposals have been given careful consideration in the preparation of this recommended order. All findings of fact proposed by all parties are addressed in the Appendix which is attached to and incorporated into this recommended order.
Findings Of Fact Based on the stipulations and admissions of the parties, on the exhibits received in evidence, and on the testimony of the witnesses at hearing, I make the following findings of fact. The April, 1987, professional engineering examination required an applicant to work four problems in the morning session and four problems in the afternoon session, for a total of eight problems. In order to pass the examination, the applicant had to achieve an average score of six points for all eight problems, or a raw score of forty-eight points. Mr. Schmidt's examination was given a total score of forty points, comprised of scores as follows: 10, 8, 5, 5, 4, 4, 3, and 1. Mr. Schmidt, therefore, needs eight additional raw points in order to receive a passing grade on the examination. An additional requirement is that in order to receive a passing grade on the examination, the applicant must score six points or more on at least five of the eight questions. Mr. Schmidt is challenging three questions on the exam, questions 114, 411 and 418. On question 114, Mr. Schmidt was given a score of four. On question 411, Mr. Schmidt was given a score of five. On question 418, Mr. Schmidt was given a score of three. At the commencement of the hearing, the Respondent stipulated that Mr. Schmidt's score of question 418 should be increased to five. The Item Specific Scoring Plan (ISSP) is a device utilized to standardize graders so that a person grading a specific problem for various different candidates would consistently apply the same score to the same type of deficiency throughout the scoring process. There was an individualized Item Specific Scoring Plan for each problem given on the subject examination. Each of the Item Specific Scoring Plans contains objective criteria for assigning from 0 to 10 points to a candidate's answer to each question. There is no evidence that the Item Specific Scoring Plans are defective or arbitrary and capricious. The percentage of successful candidates on the chemical engineering examination has been rather low on recent examinations. Approximately 15% passed the April, 1986, exam. Only 2.9% passed the October, 1986, exam, and 25% passed the April, 1987, exam. During that same period of time the success rate was generally (but not always) higher for candidates for licensure in other fields of engineering. The grade of four given to Mr. Schmidt's response to question number 114 is consistent with the individualized Item Specific Scoring Plan for that question. The grade of five given to Mr. Schmidt's response to question number 411 is consistent with the individualized Item Specific Scoring Plan for that question. The grade of three given to Mr. Schmidt's response to question number 418 is not consistent with the individualized Item Specific Scoring Plan for that question. The parties have stipulated that Mr. Schmidt's grade on question number 418 should be at least five. The evidence is insufficient to show that Mr. Schmidt is entitled to a higher grade than five on question number 418.
Recommendation Based on all of the foregoing, I recommend that the Board of Professional Engineers issue a final order to the following effect: Increasing Petitioner's score on question 418 from three to five, leaving Petitioner's other scores unchanged, and assigning to Petitioner a final grade of forty-two. DONE AND ORDERED this 11th day of March, 1988, at Tallahassee, Florida. MICHAEL M. PARRISH, Hearing Officer Division of Administrative Hearings The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 11th day of March, 1988. APPENDIX TO RECOMMENDED ORDER, CASE NO. 87-4175 The following are my specific rulings on all of the proposed findings of fact submitted by the parties. Findings proposed by Petitioner: Petitioner's proposed findings regarding problem number 114 are essentially correct summaries of the testimony as far as they go. Nevertheless, most of them have been omitted as unnecessary subordinate details, particularly in view of the further testimony of Dr. O'Connell to the effect that he had no quarrel with the ISSP for this question and to the testimony of both Dr. O'Connell and Dr. Hanley to the effect that the grade given to Petitioner on this question is consistent with the ISSP. Petitioner's proposed findings regarding problem number 411 have for the most part been rejected as irrelevant on the basis of testimony by both Dr. O'Connell and Dr. Hanley to the effect that the ISSP required evidence of a trial and error solution and that such a solution is not shown in the Petitioner's answer. Petitioner's proposed findings regarding problem number 418 are essentially correct summaries of the testimony as far as they go. Nevertheless, most of them have been omitted as unnecessary subordinate details, in view of additional evidence to the effect that the Petitioner's boxed answer to this question was not a reasonable answer. With regard to the penultimate paragraph of the Petitioner's proposed findings, the first two sentences are essentially correct, but also irrelevant, because the burden of proof is on the Petitioner rather than on `the Respondent. With regard to the remainder of the penultimate paragraph, I have made findings regarding the success rate of chemical engineers, but find that evidence, standing along, insufficient to establish any impropriety in the examination. The final paragraph of the Petitioner's proposed findings is more in the nature of argument than proposed facts. It may well be that the Petitioner received less prehearing information from the Respondent than he was entitled to receive, but those are matters which should be raised before rather than after the hearing, and are matters which are waived if not timely asserted. Findings proposed by Respondent: Paragraph 1: Accepted. Paragraph 2: Accepted. Paragraph 3: Omitted as unnecessary subordinate details. Paragraph 4: Omitted as unnecessary subordinate details. Paragraph 5: The essence of this paragraph has been accepted, but most details have been omitted an unnecessary. Paragraph 6: Accepted. Paragraph 7: Accepted. Paragraph 8: Accepted in substance. Paragraph 9: Accepted. Paragraph 10: Accepted. Paragraph 11: Accepted. Paragraph 12: Omitted as unnecessary subordinate details. COPIES FURNISHED: Mr. Daniel B. Schmidt 2209 Northeast 15th Terrace Gainesville, Florida 32601 H. Reynolds Sampson, Esquire Assistant General Counsel Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32399-0750 William O'Neil, Esquire General Counsel Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32399-0750 Allen R. Smith, Executive Director Board of Professional Engineers 130 North Monroe Street Tallahassee, Florida 32399-0750
The Issue The issue presented for decision herein is whether or not the Petitioner successfully completed the answers posed on the April, 1987 professional engineer's examination.
Findings Of Fact Petitioner took the April, 1987 professional engineering examination and was advised that he failed the principles and practice portion of the examine. His raw score was 45 points and the parties stipulated that he needed a minimum raw score of 48 points to pass the examination. In his request for hearing, Petitioner challenged questions 120, 123 and 420. However, during the hearing, he only presented testimony and challenged question 420. Question 420 is worth 10 points and is set forth in its entirety in Petitioner's Exhibit Number 1. For reasons of test security, the exhibit has been sealed. Question 420 requires the examinee to explore the area regarding "braced excavations" and explores the principles involved in such excavations. Question 420 requires the examinee to calculate the safety factor for a braced excavation including the depth of excavation which would cause failure by "bottom heaving". Petitioner, in calculating the safety factor, made a mathematical error when he incorporated the B-prime value calculation which was inserted into the equation in making his calculations. Question 420 does not direct the applicant to apply the calculations to either a square excavation or to a rectangular excavation. Petitioner assumed the shape of the excavation to be square and calculated the factor of safety according to that assumption. In assuming the square excavation, Petitioner did not make the more conservative calculation that will be required in making the safety factor calculation for a rectangular excavation. In this regard, an examination of Petitioner's work sheet indicates that he referenced the correct calculation on his work sheet but the calculation was not transferred to or utilized in the equation. Respondent utilizes the standard scoring plan outline, which is more commonly known as the Items Specific Scoring Plan (ISSP) which is used by the scorers in grading the exam. The ISSP provides a scoring breakdown for each question so that certain uniform criteria are met by all applicants. For example, four points are given for a correct solution on a specific question regardless of the scorer. This criteria is supplied by the person or persons who prepared the exam. The criteria indicates "in problem-specific terms, the types of deficiencies that would lead to scoring at each of the eleven (0-10) points on the scale". The ISSP awards six points on question 420 when the applicants meets the following standards: "all categories satisfied, applicant demonstrate minimally adequate knowledge in all relevant aspect of the item." ISSP awards seven points on question 420 when the applicant's answer meets the following standard: "all categories satisfied, obtains solution, but chooses less than optimum approach. Solution is awkward but reasonable". The ISSP awards eight points on question 420 when the applicant's answer meets the following standards: "all categories satisfied. Errors attributable to misread tables or calculating devices. Errors would be corrected by routine checking. Results reasonable, though not correct". The ISSP awards nine points on question 420 when the applicant's answer meets the following standard: "all categories satisfied, correct solution but excessively conservative in choice of working values; or presentation lacking in completeness of equations, diagrams, orderly steps in solution, etc." The ISSP criteria for awarding nine points as to question 420 clearly requires that the Petitioner calculate the correct solution without mathematical errors. The Petitioner's answer was not correct regardless of the assumption as to the shape of the excavation since he made a mathematical error. The ISSP criteria for awarding eight points as to question 420 allows Petitioner to calculate the answer with mathematical errors with the requirements that the results are reasonable. Petitioner made a mathematical error although his result was reasonable. His answer fits the criteria for the award of eight points in conformity with the ISSP criteria. Petitioner received six points for his answer to question 420 whereas he is entitled to an award of eight points.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that: Respondent enter a Final Order determining that Petitioner failed the principles and practice portion of the April, 1987 engineering examination. RECOMMENDED this 30th day of June 1988, in Tallahassee, Florida. JAMES E. BRADWELL Hearing Officer Division of Administrative Hearings The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32301 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 30th day of June, 1988. COPIES FURNISHED: Glen E. Wichinsky, Esquire 900 Glades Road, 5th Floor Boca Raton, Florida 33431 Michael A. Mone', Esquire Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32399-0750 Allen R. Smith, Jr. Executive Director Department of Professional Regulation, Board of Professional Engineers 130 North Monroe Street Tallahassee, Florida 32399-0750 William O'Neil, Esquire General Counsel Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32399-0750
The Issue The ultimate issue in this proceeding is whether proposed Florida Administrative Code Rule 61G15-21 is an invalid exercise of delegated legislative authority.
Findings Of Fact Florida Administrative Code Rule 61G15-21.004, in relevant part, states: The criteria for determining the minimum score necessary for passing the Engineering Fundamentals Examination shall be developed through the collective judgment of qualified experts appointed by NCEES to set the raw score that represents the minimum amount of knowledge necessary to pass the examination. The judges shall use a Modified Angoff Method in determining the minimally acceptable raw score necessary to pass the Fundamentals of Engineering Examination. Using the above mentioned Modified Angoff Method, the judges will indicate the probability that a minimally knowledgeable Fundamentals of Engineering examinee would answer any specific questions correctly. The probability of a correct response is then assigned to each question. Each judge will then make an estimate of the percentage of minimally knowledgeable examinees who would know the answer to each question. The totals each of the judges is added together and divided by the number of judges to determine the overall estimate of the minimum standards necessary. The minimum number of correct answers required to achieve a passing score will take into account the relative difficulty of each examination through scaling and equating each examination to the base examination. The raw score necessary to show competence shall be deemed to be a 70 on a scale of 100. A passing grade on Part Two of the examination is defined as a grade of 70 or better. The grades are determined by a group of knowledgeable professional engineers, who are familiar with engineering practice and with what is required for an applicable engineering practice and with what is required for an applicable engineering task. These professional engineers will establish a minimum passing score on each individual test item (i.e., examination problem). An Item Specific Scoring Plan (ISSP) will be prepared for each examination item based upon the NCEES standard scoring plan outline form. An ISSP will be developed by persons who are familiar with each discipline including the item author, the item scorer, and other NCEES experts. On a scale of 0-10, six (6) will be a minimum passing standard and scores between six (6) and ten (10) will be considered to be passing scores for each examination item. A score of five (5) or lower will be considered an unsatisfactory score for that item and examinee will be considered to have failed that item. To pass, an examinee must average six (6) or greater on his/her choice of eight (8) exam items, that is, the raw score must be forty- eight (48) or greater based on a scale of eighty (80). This raw score is then converted to a base 100 on which, as is noted above, a passing grade will be seventy (70). The proposed changes to Florida Administrative Code Rule 61G15-21.004, in relevant part, state: The passing grade for the Engineering Fundamentals Examination is 70 or better. The criteria for determining the minimum score necessary for passing the Engineering Fundamentals Examination shall be developed through the collective judgment of qualified experts appointed by NCEES to set the raw score that represents the minimum amount of knowledge necessary to pass the examination. The judges shall use a Modified Angoff Method in determining the minimally acceptable raw score necessary to pass the Fundamentals of Engineering Examination. Using the above mentioned Modified Angoff Method, the judges will indicate the probability that a minimally knowledgeable Fundamentals of Engineering examinee would answer any specific questions correctly. The probability of a correct response is then assigned to each question. Each judge will then make an estimate of the percentage of minimally knowledgeable examinees who would know the answer to each question. The totals each of the judges is added together and divided by the number of judges to determine the overall estimate of the minimum standards necessary. The minimum number of correct answers required to achieve a passing score will take into account the relative difficulty of each examination through scaling and equating each examination to the base examination. The raw score necessary to show competence shall be deemed to be a 70 on a scale of 100. The passing grade for the Principles and Practice Examination is 70 or better. A passing grade on Part Two of the examination is defined as a grade of 70 or better. The grades are determined by a group of knowledgeable professional engineers, who are familiar with engineering practice and with what is required for an applicable engineering practice and with what is required for an applicable engineering task. These professional engineers will establish a minimum passing score on each individual test item (i.e., examination problem). An Item Specific Scoring Plan (ISSP) will be prepared for each examination item based upon the NCEES standard scoring plan outline form. An ISSP will be developed by persons who are familiar with each discipline including the item author, the item scorer, and other NCEES experts. On a scale of 0-10, six (6) will be a minimum passing standard and scores between six (6) and ten (10) will be considered to be passing scores for each examination item. A score of five (5) or lower will be considered an unsatisfactory score for that item and examinee will be considered to have failed that item. To pass, an examinee must average six (6) or greater on his/her choice of eight (8) exam items, that is, the raw score must be forty- eight (48) or greater based on a scale of eighty (80). This raw score is then converted to a base 100 on which, as is noted above, a passing grade will be seventy (70). Petitioner resides in Tampa, Florida. On April 11, 2003, Petitioner took a national examination that Petitioner must pass to be licensed by the state as a professional engineer. On July 1, 2003, Petitioner received a letter from the Board advising Petitioner that he had received a failing grade on the examination. On July 2, 2003, Petitioner unsuccessfully requested the raw scores on his examination from a representative of the National Council of Examiners for Engineering and Surveying (NCEES). The NCEES is the national testing entity that conducts examinations and determines scores for the professional engineer examination required by the state. On July 9, 2003, Petitioner submitted a formal request to the Board for all of the raw scores related to Petitioner "and all past P.E. Exams that the Petitioner had taken." A representative of the Board denied Petitioner's request explaining that the raw scores are kept by the NCEES and "it is not their policy to release them." The Board's representative stated that the Board was in the process of adopting new rules "that were in-line with the policies of the NCEES." On July 31, 2003, Petitioner requested the Board to provide Petitioner with any statute or rule that authorized the Board to deny Petitioner's request for raw scores pursuant to Section 119.07(1)(a), Florida Statutes (2003). On the same day, counsel for the Board explained to Petitioner that the Board is not denying the request. The Board is unable to comply with the request because the Board does not have physical possession of the raw scores. Petitioner and counsel for Respondent engaged in subsequent discussions that are not material to this proceeding. On August 6, 2003, Petitioner requested counsel for Respondent to provide Petitioner with copies of the proposed rule changes that the Board intended to consider on August 8, 2003. On August 27, 2003, Petitioner filed a petition with the Board challenging existing Florida Administrative Code Rule 61G15-21.004. The petition alleged that parts of the existing rule are invalid. Petitioner did not file a challenge to the existing rule with DOAH. The Petition for Hearing states that Petitioner is filing the Petition for Hearing pursuant to Subsections 120.56(1) and (3)(b), Florida Statutes (2003). However, the statement of how Petitioner's substantial interests are affected is limited to the proposed changes to the existing rule. During the hearing conducted on January 29, 2004, Petitioner explained that he does not assert that the existing rule is invalid. Rather, Petitioner argues that the Board deviates from the existing rule by not providing examinees with copies of their raw scores and by failing to use raw scores in the determination of whether an applicant achieved a passing grade on the exam. Petitioner further argues that the existing rule benefits Petitioner by purportedly requiring the Board to use raw scores in the determination of passing grades. The elimination of that requirement in the proposed rule arguably will adversely affect Petitioner's substantial interests. The Petition for Hearing requests several forms of relief. The Petition for Hearing seeks an order granting Petitioner access to raw scores, a determination that Petitioner has met the minimum standards required under the existing rule, and an order that the Board grant a license to Petitioner. The Petition for Hearing does not request an order determining that the proposed rule changes constitute an invalid exercise of delegated legislative authority.
