The Issue Is Petitioner entitled to one additional point on the October 1996 Professional Civil Engineer Examination so as to achieve a passing score for licensure in Florida?
Findings Of Fact Petitioner took the Civil Engineer Examination given in October 1996. The Department of Business and Professional Regulation's Bureau of Testing notified Petitioner by Examination Grade Report dated February 17, 1997, that she had earned a score of 69.00 on the Civil Engineer Examination. The minimum passing score for the Civil Engineer Examination is 70.00. Petitioner timely requested formal hearing and challenged only Question 120, for which she received no points. Petitioner is trained as a materials engineer. Question 120 is a soils and foundation problem outside her concentrated area of study. It is an open book examination question. Petitioner selected the correct equation from the applicable manual, but acknowledged that she solved the variables of that equation incorrectly. The National Council of Examiners for Engineering and Surveying (NCEES) produced, distributed, and was responsible for grading the examinations. Petitioner contended that the examiner who graded her answer sheet applied different criteria than the examination criteria published by the NCEES. Petitioner further contended that since one criterion her grader actually used was merely to "write the correct equation," she should be awarded at least one point on that basis. However, a comparison of the actual grader's handwritten "summary" on Petitioner's Solution Pamphlet (Respondent's Exhibit 3) and the NCEES's Solutions and Scoring Plan (Respondent's Exhibit 2) does not bear out Petitioner's theory. It is clear that out of five possible parts of the question, which five parts total two points' credit each, merely selecting the correct equation from an open text would not amount to two points, or even one point, credit. I accept as more competent, credible and persuasive the testimony of Eugene N. Beauchamps, the current Chairman of the NCEES Examination Policy Committee and a Florida licensed Professional Engineer, that the grader's "summary" describes what he actually reviewed in Petitioner's written solution to Question 120 rather than establishing one or more different grading criteria. In order to receive a score of two on Question 120, the candidate was required to demonstrate any one of five requirements listed in the NCEES Solution and Scoring Plan for "2-Rudimentary Knowledge." The first requirement in the NCEES Solution and Scoring Plan (Respondent's Exhibit 2) for receiving a score of two points is, "Determines effective overburden stress at mid- depth of clay layer." The remaining four NCEES scoring criteria required that the examinee: Computes the change in effective stress at mid- depth of the clay layer due to placement of the fill. Computes the primary consolidation settlement, based on a change in effective stress, due to the fill surcharge. Evaluates the Average Degree of Consolidation and the Time Factor. Determines the waiting period after fill placement recognizing the existence of double-drained conditions. In order to gain two more points (total 4 points) so as to demonstrate "More Than Rudimentary Knowledge But Insufficient to Demonstrate Minimum Competence," Petitioner would have to have met two of the five bulleted criteria. For two more points (total 6 points) for "Minimum Competence," Petitioner would have had to score three bullets. For two more points (total 8 points) for "More than Minimum But Less Than Exceptional Competence," Petitioner would have had to score four bullets. Finally, to attain "Exceptional Competence" for 10 total points, Petitioner would have had to score all five bullets. In the first correct equation for answering Question 120, "p sub zero" (p naught) equals the present effective overburden pressure, which represents what clay was present before anything was put on top of the clay layer. "P" equals the total pressure acting at mid-height of the consolidating clay layer or the pressure of the dirt and the water in the dirt. "H" equals the thickness of the consolidating clay layer. Petitioner's solution for the first bullet, "determining the effective overburden stress at mid-depth of clay layer," indicated p sub zero (p naught) as the "present effective overburden pressure," but it incorrectly calculated p sub zero equaling 125 pounds multiplied by 13 feet. This is incorrect because the effective overburden pressure would not include 13 feet of fill. The 13 feet of fill is not part of p sub zero, the present effective overburden pressure. Petitioner's solution for the first bullet, also multiplied water, represented by 62.4, by 12, which is incorrect. She should have used a multiplier of 10 to receive credit for this problem. The grader indicated the correct equation was used incorrectly by Petitioner because of the two foregoing incorrect calculations. The equation, as Petitioner stated it, was correct and her multiplication was correct. Her solution identified P sub zero as present effective overburden pressure but present effective overburden pressure would not include the fill. Petitioner had the correct equation for the present effective overburden pressure and her mathematics were correct. However, she did not use the consolidation equation correctly, not obtaining the correct percentage of primary consolidation. As stated, the problem did not consider the fill as part of the present effective overburden pressure. Her solution also contained the correctly written time rate of settlement equation but failed to use it, and no waiting period was determined. The practical result of Petitioner's error could range from a cracked building to a collapsed building, depending upon the degree of error to site and materials.
Recommendation Upon the foregoing findings of fact and conclusions of law, it is RECOMMENDED that the Department of Business and Professional Regulation enter a Final Order denying Petitioner's challenge and affirming her score as one point below passing. RECOMMENDED this 3rd day of March, 1998, in Tallahassee, Leon County, Florida. ELLA JANE P. DAVIS Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 3rd day of March, 1998. COPIES FURNISHED: Susan E. Wilson 3581 Jose Terrace Jacksonville, Florida 32217 R. Beth Atchison Assistant General Counsel Department of Business and Profession Regulation 1940 North Monroe Street Tallahassee, Florida 32399 Angel Gonzalez, Executive Director Department of Business and Profession Regulation 1940 North Monroe Street Tallahassee, Florida 32399 Lynda L. Goodgame General Counsel Department of Business and Profession Regulation 1940 North Monroe Street Tallahassee, Florida 32399
Findings Of Fact The Petitioner, James Ilardi, was an unsuccessful candidate for the June, 1989 General Contractor's Construction Examination in the State of Florida. He is an experienced contractor and is licensed in the State of South Carolina. He is the past President of the Charleston Contractor's Association in South Carolina. He has experience with most types of building construction, including office buildings, military facilities, hospitals, factories and other large projects. He served as Chief Executive Officer for a design and construction firm for a period of ten years. The Respondent is an agency of the State of Florida charged with administering the certified general contractor's examination and with regulating the licensure and practice of construction contractors in the State of Florida. The Petitioner sat for the certified general contractor's examination in June, 1989. He has challenged the scoring of his answers to questions 2, 11, 12, 17, 19 and 33 on that examination. During the course of the hearing, he abandoned his challenges to questions 2, 17, 19 and 33. If he were accorded correct answers to either of the remaining challenged questions, numbers 11 or 12, he would have a sufficient score to obtain a passing grade of 70 on that examination. Both questions 11 and 12 used a "critical path network diagram" for use in working out the correct answer to the questions. The Petitioner criticized the diagram as being obscure, difficult to read and containing error. He maintained that it was not supported by the representations found in the reference materials recommended by the Respondent, in its "Instructions to Candidates", as being the material to use to arrive at answers to the questions. The Petitioner contends that the size of the diagram, "the multiple fonts, the difference in the intensity of the print, and the use of symbols all contribute to the obscurity and illegibility of the diagram, itself". In particular, he complains that the symbol listing includes a symbol which he did not find on the diagram. That is, the symbol for "structural steel" and "steel bar joists, which is two straight vertical parallel lines. He also complains that general practice in the construction industry, in his experience, and as indicated in the reference work "Construction Contracting", pages 325-326, one of the references listed for candidates to use in answering these questions, recommends against the use of symbols in lieu of abbreviated notations for description of activities on such a diagram. The main complaint he had concerning the use of symbols, however, was the fact that use of symbols, and having to constantly defer to the symbol legend on the exam materials, was time-consuming and was not generally accepted industry practice or procedure. He contends that the diagram contains error or is obscure and does not conform to the Respondent's recommended reference materials nor to industry standards and. is deficient in format, design and reproductive quality. Thus, he maintains that questions 11 and 12 do not adequately test the knowledge or skills necessary for licensure as a general contractor. The Petitioner acknowledged that the questions at issue had been reviewed twice by the Respondent's examination content specialist and that an "item analysis and review process" by the Respondent's expert resulted in the Respondent maintaining its position that the two questions and supporting materials were valid in fairly testing the knowledge of general contractor licensure candidates. In summary, the Petitioner contends that as to question 11, the symbol for steel bar joists, the two parallel vertical lines, does not appear on the diagram; therefore, he was unable to determine whether his answer was correct or not. As to question number 12, he maintains, in essence, that the use of symbols instead of brief abbreviated descriptions of the activities involved, accompanying the arrows in the diagram which indicate the critical path for the activity in question (paint work), render answering the question confusing and time consuming in having to constantly refer to the symbol legend and look for the symbols. He states that, in his 20 years of construction industry experience, he has not had to use symbols in working with a critical path diagram. The Petitioner did not demonstrate, however, that the use of symbols was incorrect procedure as delineated in the reference materials supplied to the candidates and which they were instructed to use in answering the questions on the examination. The Respondent produced the testimony of Mr. Olson, a Florida certified general contractor, who is also employed with the National Assessment Institute which developed this examination. Mr. Olson, however, did not, himself, have a hand in developing the examination. Mr. Olson did, however, review the Petitioner's challenges to the questions at issue and his responses, reviewed questions 11 and 12, as well as the Respondent's asserted correct answers to those questions and the methodology used in reaching those answers. Mr. Olson established that this was an "open-book" examination and the candidates were informed of and supplied all necessary reference materials to answer these two questions. The only optional consideration was that candidates could have used a calculator to speed up their calculations and were informed that it was permissible to use a calculator. Question 11 required candidates to calculate the total time necessary to install structural steel and steel bar joists in interpreting the activity network represented by the diagram in question. They were asked to calculate whether the installation was ahead of schedule or behind schedule and by how much. Mr. Olson established that the correct response was "C", which is two days behind schedule. Mr. Olson demonstrated that it was quite possible for a candidate to make this calculation and track this in formation on the diagram provided the candidates, through reading the path with the symbols, which alphabetically represent the activity, and which are numerical in representing the time in days. He established that this is very typical of the construction industry, related to the preparation, reading and interpreting of blueprints. A tremendous amount of symbols and legends are typically used in preparing and interpreting blueprints. Mr. Olson established that the pertinent number, 85 days, could be calculated for installation of structural steel and steel bar joists, based upon the information supplied to the candidates. By using the diagram and the information supplied with the question, the candidate can calculate that the actual number of days that were taken for the job was 87 days and therefore, that the project, at that point, was two days behind schedule. Mr. Olson performed this calculation by using the actual diagram the Petitioner used and reference information the Petitioner was given to use in answering the actual examination question at issue. He also established that the two parallel lines representing steel bar joists and structural steel on the diagram, and in the symbol legend supplied with the diagram, were indicated on the diagram supplied to Mr. Ilardi at the examination. Mr. Olson also established that the reference quoted for question number 11 was walkers Building Estimator's Reference Book, which, indeed, listed the type of activity network depicted in the diagram used by candidates for question number 11 and 12. Mr. Olson also established that question number 12 requires a candidate to work through an activity network diagram to find the amount of days necessary from the beginning of a project to the time the painting activity begins. He established that the answer could be obtained without the use of any other reference materials other than the information depicted on the diagram, itself, associated with the question. He established that the only correct answer from that information on the diagram could be "D" or 153 days. The Petitioner did not establish that his answer to question number 12, nor to question number 11 for that matter, was a correct answer and did not establish that there was any misleading quality or ambiguity in the wording of the questions and the associated information which would mislead a candidate into calculating the wrong answers or that there was erroneous information depicted in the reference materials or the diagram which would result in the candidate being misled into giving a wrong answer to questions 11 and 12.. Mr. Ilardi challenged the examination as to the testing environment, as that relates to the ambient light level in the examination room and to the acoustic qualities of the room. He also asserted that the test was not standardized throughout the State and was biased due to age, because of the perceived hearing and vision difficulties which he believed were caused by the acoustics in the examination room and the light available. Other than stating his opinions in this regard, he produced no testimony or evidence concerning these alleged qualities of the testing environment. It was demonstrated by she Respondent that, indeed, the test is standardized throughout the State and is the one given to all candidates in Florida, regardless of the test location.
Recommendation Having considered the foregoing Findings of Fact, Conclusions of Law, the evidence of record, and the candor and demeanor of the witnesses, it is therefore RECOMMENDED that a Final Order be entered denying Petitioner's request to receive a passing grade on the certified general contractor's licensure examination. DONE and ENTERED this 4th day of May, 1990, in Tallahassee, Leon County, Florida. P. MICHAEL RUFF Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904)488-9675 Filed with the Clerk of the Division of Administrative Hearings this 4th day of May, 1990. APPENDIX TO RECOMMENDED ORDER CASE NO. 89-3784 Petitioner's Proposed Findings of Fact Rejected. The Petitioner was not qualified as an expert witness. Other than that, this finding is accepted. Rejected, as not in accord with the preponderant weight of the evidence. Rejected, as not supported by the preponderant weight of the evidence. 4.A.-4.C. Accepted. 4.D. Rejected, as not in accordance with the preponderant weight of the evidence. Accepted, but not itself materially dispositive. Rejected, as not in accordance with the preponderant weight of the evidence. Rejected, as not in accordance with the preponderant weight of the evidence. Rejected, as not in accordance with the preponderant weight of the evidence and as subordinate to the Hearing Officer's Findings of Fact on this subject matter. Rejected, as not constituting a finding of fact, but rather a quotation from the transcript of the proceedings. Rejected, as not in accordance with the preponderant weight of the evidence and as subordinate to the Hearing Officer's Findings of Fact on this subject matter. Rejected, as immaterial and not probative of the issues of whether the questions were ambiguous or misleading or whether the Petitioner's answers were correct. Rejected, as not in accordance with the preponderant weight of the evidence. Rejected, as not in accordance with the preponderant weight of the evidence. Rejected, as not in accordance with the preponderant weight of the evidence, and as not materially dispositive. 4.1. Rejected, as not materially dispositive. Rejected, as immaterial. Rejected, as immaterial. Accepted, but not a matter of factual dispute and immaterial. Respondent's Findings of Fact 1-10. Accepted. COPIES FURNISHED: Fred Seely, Executive Director Department of Professional Regulation Construction Industry Licensing Board P.O. Box 2 Jacksonville, FL 32202 Kenneth D. Easley, Esq. General Counsel Department of Professional Regulation 1940 N. Monroe Street, Ste. 60 Tallahassee, FL 32399-0792 E. Harper Field, Esq. Deputy General Counsel Department of Professional Regulation 1940 N. Monroe Street, Ste. 60 Tallahassee, FL 32399-0792 Mr. James Ilardi P.O. Box 8095 Jacksonville, FL 32239
The Issue The issue presented is whether Mr. Lord should be granted additional credit for his answer to question number 144 on the April 1990 Professional Engineer licensure examination.
Findings Of Fact Mr. Lord (Candidate #301402) received a score of 66.3 percent on the April 20, 1991, Principals and Practice portion of the Professional Engineer examination. A minimum passing score was 70.0 percent. Mr. Lord challenged the scoring of his response to question number 144. Question number 144 is an essay question involving an assembly line problem where four separate stations are used to assemble a product in sequence. A fifth station can assist in maximizing the number of finished products produced per hour, and is capable of performing all operations. The correct answer to question number 144 was 100 products per hour, while Mr. Lord's answer was 25 pieces per hour. Petitioner received a score of 2 (out of a possible 10) points on question number 144. This was based on the scoring plan developed for the exam by the National Council of Examiners for Engineering and Surveying. Mr. Lord used a method of averaging station assembly times to determine the maximum average number of products each station could produce. The averaging method gave a solution which did not identify the central issue presented by the essay question: identifying and eliminating the bottlenecks in production. Mr. Lord also made an assumption that the initial four stations could do all operations, thus defining the model inaccurately. This misreading allowed Mr. Lord to use an averaging methodology. Mr. Granata, the Department's expert, testified that it is a coincidence of the numbers that if you multiply Respondent's answer (25) by four (the initial number of machines) you get the Board's answer (100). Mr. Greenbaum, Petitioner's expert witness, testified that Petitioner's answer is "unique" and that he, as an expert, would have answered the question using a methodology similar to the one developed by the Department's expert, Mr. Granata, and by the NCEE (National Council of Examiners for Engineering).
Recommendation Based upon the foregoing Findings of Fact and Conclusions of Law, it is recommended that the challenge to the grading of Mr. Lord's response to question 144 on the April 1990 Professional Engineer licensure examination be dismissed. RECOMMENDED this 14th day of March, 1991, at Tallahassee, Florida. WILLIAM R. DORSEY, JR. Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 14th day of March, 1991. COPIES FURNISHED: William F. Whitson, Law Clerk Department of Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792 Curtis Lord 1416A Old Lystra Road Chapel Hill, NC 27514 Rex Smith, Executive Director Department of Professional Regulation Board of Professional Engineers 1940 North Monroe Street Tallahassee, Florida 32399-0792 Jack McRay, General Counsel Department of Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792
Findings Of Fact Petitioner is a registered electrical contractor doing business as Howard Hall Electric. On October 16, 1979, Petitioner filed his application to become a certified electrical contractor. Prior to filing his application, Petitioner knew the next examination for such certification was scheduled to be given on November 2, 1979. At its meeting on October 18 and 19, 1979, the board approved Petitioner's application to sit for the Electrical Contractors' Certification Examination. By letter dated October 24, 1979, the Board advised Petitioner of the approval and provided Petitioner with information concerning the November 2, 1979, examination. The information provided included a listing of those areas of competency to be covered by the certification examination, and specifically set forth that the examination would include problems relating to accounting. Petitioner was provided by the Board a reference book list of those books permitted to be utilized during the "open-book" examination. The list did not include a reference book for accounting. Petitioner took the examination on November 2, 1979. On December 3, 1979, the Board directed a letter to the Petitioner advising him that he had failed the examination, having achieved a score of 67. The rules of the Board require that a score of 70 be attained in order to pass the examination. Of the candidates taking the examination on November 2, 1979, 20 persons of the 26 sitting for the examination were successful. Further, 19 of the 24 persons taking the accounting portion of the examination were successful. Petitioner requested a review of his examination, and such review was afforded to him by the Board. Additionally, an analysis of the examination itself was performed by the Office of Examination Services of the Department of Professional Regulation. The Board, which had drafted the examination, reviewed the examination and Petitioner's answers to the questions thereon and determined that the examination was fair and properly graded as to the Petitioner. The Office of Examination Services performed an item analyzation as to the number of candidates responding correctly and incorrectly as to each question on the examination. Although the Office of Examination Services determined that several questions on the examination could have misled some candidates, most candidates responded correctly, and most candidates successfully passed the examination. Although one of the books on the reference list provided by the Board was out of print and unavailable, the examination contained no questions dealing with that subject matter In performing its analysis of the examination, the Office of Examination Services contacted Professor William Hillison of Florida State University to obtain his opinion of the questions in the accounting section of the examination. Dr. Hillison felt that most of the questions in the accounting section were capable of being answered correctly by Florida State University students in their sophomore year in the introductory accounting courses offered by that school. Although Professor Hillison believed that several of the questions in the accounting section were problematic as to the terminology utilized, no testimony was presented that his students would be unable to answer the questions or that the questions were beyond a level of expertise expected to be possessed by a businessman having a general knowledge of management, finance, accounting, and any other functional areas of business.
Recommendation Based upon the foregoing findings of fact and conclusions of law, it is RECOMMENDED THAT: Petitioner's application for licensure as a certified electrical contractor be denied. RECOMMENDED this 7th day of May, 1980, in Tallahassee, Florida. LINDA M. RIGOT Hearing Officer Division of Administrative Hearings Department of Administration Room 101, Collins Building Tallahassee, Florida 32301 (904) 488-9675 COPIES FURNISHED: Paul A. Lehrman, Esquire 103 North Gadsden Street Tallahassee, Florida 32301 Patricia R. Gleason, Esquire Assistant Attorney General Department of Legal Affairs The Capitol Tallahassee, Florida 32301 Frederick H. Wilsen, Esquire Legal Section Department of Professional Regulation 2009 Apalachee Parkway Tallahassee, Florida 32301 Nancy Kelley Wittenberg, Secretary Department of Professional Regulation The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32301
Findings Of Fact On the October 1992 examination for licensure as a Professional Engineer Petitioner received an overall grade of 69.1 on Principles and Practice. An overall grade of 70 is required to pass the examination. The examination for Professional Engineer is a national examination prepared and graded by the National Council of Engineering Examiners (NCEE). On question 124 Petitioner calculated an angle to be 25.717 degrees correctly but when this angle was used to solve a latter part of the problem it was transposed as 21.717 degrees. The calculation performed with the transposed number was correct but because of the use of the wrong number of degrees the final answer was incorrect. On question 124 Petitioner received a score of 8 out of a possible 10. Petitioner contends he should have received a score of 10. The Final Scoring Plan for problem 124 provides that a score of 10 demonstrates applicant is EXCEPTIONALLY COMPETENT (It is not necessary that the solution be perfect.) Correct approach to horizontal curve geometry and coordinate computations. All answers to the nearest plus or minus 0.01 foot. To receive a grade of 8 the scoring plan provides: MORE THAN MINIMUM BUT LESS THAN EXCEPTIONAL COMPETENCE. Generally correct approach to the problem solution, but a solution with one math error or one error in logic or a solution with answers outside of the plus or minus 0.01 foot range or correct solution to parts (b) and (c) only. It was in part (c) of the problem that Petitioner transposed the wrong angle. All of the answers produced by the approximately 1000 applicants who took question 124 were graded by one grader. When Petitioner requested this grade be reviewed it was sent back to NCEE where the Petitioner's answer again received a grade of 8. The grading system for all of the problems on the NCEE examinations are on a scale of 0-10 at two-point intervals. There are no odd numbered scores given on any question. Problem 120 which Petitioner also challenges involved calculating the cost of fill material received from two separate sources with different distances to haul, different prices per cubic yard, and with the fill having different void ratios. Petitioner's calculations were accurate except that in his calculations Petitioner added two figures together rather than subtracting one from the other as he should have done. This was done twice in solving this problem causing an error of nearly twice the cost differential analysis (from $298,000 to $580,000). Petitioner's expert witness opined that the maximum deduction of two points in problem 124 was excessive; however, he concurred that the nationwide examination prepared and graded by NCEE is the best solution to qualifying Professional Engineers.
Recommendation Based on the foregoing, it is, hereby, RECOMMENDED: That a final order be entered dismissing the challenge by Martin Marquez to the final grade he was given on the October 1992 examination for licensure as a professional engineer. DONE AND RECOMMENDED this 4th day of January, 1994, in Tallahassee, Leon County, Florida. K. N. AYERS Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904)488-9675 Filed with the Clerk of the Division of Administrative Hearings this 4th day of January, 1994. COPIES FURNISHED: Vytas J. Urba Assistant General Counsel Department of Business and Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792 Martin Marquez 5412 Walstone Court Tampa, Florida 33624 Jack McRay Acting General Counsel Department of Business and Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792 Angel Gonzalez Executive Director Department of Business and Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792
The Issue The issues in this case are whether certain questions within the June 2002 construction building contractor examination are invalid, and whether Petitioner should receive credit for certain answers scored as incorrect.
Findings Of Fact In June 2002, Petitioner sat for the construction building contractor examination. Shortly following the exam, Petitioner was advised that he incorrectly answered 17 of the 50 exam questions and did not attain the minimum passing score of 70 percent, but received a failing scaled score of 66 percent. Petitioner timely challenged the validity and scoring of eight questions, including questions 8, 14, 17, 33, 34, 38, 43, and 44. In order for Petitioner to acquire a passing score, Petitioner must prove that certain challenged questions are invalid or demonstrate that he is entitled to receive credit for his answers. Specifically, Petitioner must demonstrate that either three questions should be stricken from the exam providing Petitioner with 70.2 percent, two questions should be stricken and one answer scored as correct providing Petitioner with 70.8 percent or two answers should scored as correct providing Petitioner with 70 percent. QUESTION 8 Exam Question 8 asks, "According to AIA-A201, who determines the interest rate that the contractor can charge on due and unpaid payments?" Petitioner's expert, Mr. Uman, argues that the parties to the contract are not defined within the question and it is therefore misleading. However, the credited answer D, "all the parties must agree on the rate" is within the provided reference material and is clearly the best answer. It is not misleading and Petitioner's argument lacks merit. In addition, 89.47 percent of the test-takers correctly answered Question 8. QUESTION 14 Exam Question 14 is wordy and involves computations. It requires the test-taker to calculate the number of "labor" hours required per 100 pieces to build a wall, given certain pricing and wall construction information. Question 14 is ambiguous and confusing on its face. While the question asks for labor hours, the facts provide a fixed combined hourly cost for a mason and laborer's hour. There is no distinction made between "labor" hours and a "laborer's" hours. Mr. Collier admitted that there is some apparent confusion between "labor" costs and the "laborer's" costs. Mr. Palm further agreed and indicated that he fully understood Petitioner's rationale to divide the labor costs in half and choose answer A. Furthermore, it is clear that Petitioner's perception of the question was not unique. In fact, only 46.62 percent of the test-takers correctly answered Question 14. QUESTION 17 Exam Question 17 asks, "During the bid process, which document has priority in the event of conflicting information?" Clearly, the correct answer is B, "addenda." Petitioner's argument regarding "competitively bid projects" is without merit. Mr. Palm succinctly explained that Petitioner's selection was obviously incorrect because "plans don't change during the bid process unless there is an addenda issued." Moreover, 75.56 percent of the test-takers correctly answered Question 17. QUESTION 33 Exam Question 33 identifies a situation that where drawings differ from written specifications and where there is no legal precedent that one is more binding than the other. The question specifically calls for the best procedure according to the listed and available reference. While Mr. Uman argues that the answer does not appear within the reference material in a clear manner, the exact text of the question and answer are in fact within the material. Petitioner's argument lacks credibility. QUESTION 34 Exam Question 34 asks the test-taker "what is the EARLIEST workday for completing the masonry work?" given the number of crew, the number of hours required, and the ratio constant of the crew. Although 80.45 percent of the test-takers correctly answered Question 34, Mr. Uman argues that the question could have been answered without reference to the Builder's Guide to Accounting material and therefore, was misleading. Petitioner's argument is devoid of common sense. QUESTION 38 Exam Question 38 asks the test-taker to identify the activity that "a specialty structural contractor is qualified" to perform. Petitioner's expert, Mr. Uman, again argues that the question is misleading since the credited correct answer "perform non-structural work" is not written verbatim in the provided reference material. To the contrary however, all of the alternative choices are clearly listed in the reference material as activities specifically prohibited by specialty structure contractors. Furthermore, page 2B17 to 61G415.015 of the Contractor's Manual specifically states that: The specialty structure contractor whose services are limited shall not perform any work that alters the structural integrity of the building including but not limited to roof trusses. Respondent's experts, Mr. Collier and Mr. Palm, agree that Question 38 is clear. Moreover, 53.38 percent of test- takers correctly answered the question. While the question appears to require enhanced reasoning skills and is generally more difficult, it is not misleading. Petitioner's assertions are without merit. QUESTION 43 Exam Question 43 asks, "Which accounting method should be used by a contractor if the contractor is unable to reasonably estimate the amount of progress to date on a job or the total costs remaining to fulfill the contract?" Mr. Uman argues that the question is ambiguous and the reference material is "not terribly clear." He further alleges that when a contractor cannot estimate progress, the contractor cannot establish a "completed contract method," the credited correct answer. Respondent's experts disagree. While it is true that Mr. Palm agreed that all of the choices are accounting methods which is inconsistent with Mr. Collier's testimony, the reference material is clear. In fact, 58.65 percent of the test-takers correctly answered Question 43. Petitioner presented insufficient evidence that he should receive credit for his answer or that Question 43 should be invalidated. QUESTION 44 Exam Question 44 provides detailed information regarding a standard form contract and asks, "Based ONLY on the information given above, what is the amount of the current payment due?" In addition, however, as Mr. Uman points out, the standard form referred to in the problem was mistakenly misidentified as Form 201 instead of Form 702. While it is clear that the referenced form was mislabeled, the precise form number was incidental, unrelated to the question, and unnecessary to compute the answer. In fact, Mr. Palm explains that the problem was "just a mathematical exercise." According to Mr. Collier, the question was not misleading, and the incorrect reference was irrelevant. "It's simple math, industry knowledge." Furthermore, Petitioner's answer is clearly incorrect because "he failed to deduct the retainage." Finally, 54.89 percent of the test-takers correctly answered Question 44.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a final order be entered invalidating only Question 14, re-computing Petitioner's examination score, and dismissing his challenge. DONE AND ENTERED this 1st day of October, 2003, in Tallahassee, Leon County, Florida. S WILLIAM R. PFEIFFER Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 1st day of October, 2003. COPIES FURNISHED: Nickolas Ekonomides, Esquire 791 Bayway Boulevard Clearwater, Florida 33767 Charles F. Tunnicliff, Esquire Department of Business and Professional Regulation 1940 North Monroe Street, Suite 60 Tallahassee, Florida 32399-2202 Nancy P. Campiglia, General Counsel Department of Business and Professional Regulation Northwood Centre 1940 North Monroe Street Tallahassee, Florida 32399-2202 Robert Crabill, Executive Director Construction Industry Licensing Board Department of Business and Professional Regulation Northwood Centre 1940 North Monroe Street Tallahassee, Florida 32399-0792
The Issue Whether Petitioner is entitled to additional credit for his responses to the "Principles and Practice" portion of the electrical engineer examination administered by Respondent in October 1996.
Findings Of Fact Petitioner took the electrical engineer licensing examination administered by Respondent in October 1996. Respondent is the agency of the State of Florida with the duty to regulate the practice of electrical engineering in Florida. Pursuant to Section 471.015, Florida Statutes, an applicant for licensure as an electrical engineer is required to successfully pass both parts of a licensure examination.1 The electrical engineer licensure examination at issue in this proceeding was developed and graded by the National Council of Examiners for Engineering and Surveying (NCEES). Following the initial grading of the "Principles and Practice" section of the exam, Petitioner was awarded a score of 68. A total score of 70 was required to pass that portion of the examination. Petitioner thereafter timely challenged the grading of two questions on the "Principles and Practice" portion of the exam. His challenge was limited to Questions 130 and 132. Petitioner did not specifically challenge Question 131. In response to that challenge, Respondent sent Petitioner’s examination package back to NCEES to have the "Principles and Practice" portion of the examination re-graded. NCEES re-graded all of Petitioner's answers to the "Principles and Practice" portion of the examination, including his responses to Questions 130, 131, and 132. NCEES initially awarded Petitioner a score of 2 points for his answer to Question 130. When the answer was re-graded, Petitioner was not awarded any additional credit for his answer to Question 130. The record in this proceeding established that Petitioner's answer to Question 130 was properly re-graded. Petitioner is not entitled to any additional credit for his response to Question 130. NCEES initially awarded Petitioner a score of 2 points for his answer to Question 132. When the answer was re-graded, Petitioner was awarded a score of 4 points for his answer to Question 132. The record in this proceeding established that Petitioner's answer to Question 132 was properly re-graded. Petitioner is entitled to a score of 4 points for his answer to Question 132. NCEES initially awarded Petitioner a score of 8 points for his answer to Question 131. When the answer was re-graded, Petitioner was awarded a score of 6 points for his answer to Question 131. The record in this proceeding established that Petitioner's answer to Question 131 was properly re-graded. Petitioner is entitled to a score of 6 points for his answer to Question 131. Petitioner is not entitled to a score of 8 for his answer to Question 131. Each of the three questions at issue in this proceeding is a problem that requires multiple steps and computations to solve. If a candidate correctly answers all parts of the question a score of 10 points is awarded. Partial credit can be awarded based on how many of the parts of the question are correctly answered. There is no allegation that the three questions involved in this proceeding are ambiguous or otherwise inappropriate for a licensure examination. The record is not clear when Respondent notified Petitioner of its position following the re-grading of the questions at issue. It is clear that Petitioner was aware of Respondent's position prior to the start of the formal hearing. During the formal hearing and in his post-hearing submittal, Petitioner challenged Respondent's right to re-grade Question 131 since he had not specifically challenged that question. Petitioner has not asserted that he was provided insufficient notice of Respondent's position.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that Respondent enter a Final Order that awards Petitioner a score of 68 on the "Principles and Practice" portion of the October 1996 licensure examination. DONE AND ENTERED this 11th day of December, 1997, in Tallahassee, Leon County, Florida. CLAUDE B. ARRINGTON Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (904) 488-9675 SUNCOM 278-9675 Fax Filing (904) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 11th day of December, 1997.
The Issue Whether Petitioner is entitled to additional credit for his responses to Questions 23 and 27 of the Contract Administration section of the General Contractor licensure examination administered in July 1996, and, if so, whether the additional credit would give him a passing grade. Whether Petitioner is entitled to additional credit for his responses to Questions 11, 23, and 35 of the Contract Administration section of the General Contractor licensure examination administered in April 1997 and, if so, whether the additional credit would give him a passing grade.
Findings Of Fact Petitioner took the Contract Administration section of the General Contractor’s licensure examination in July 1996 and in April 1997. Between the two exams, Petitioner passed all sections of the examination except the Contract Administration section. Petitioner’s score on the Contract Administration section of the July 1996 examination, as graded by Respondent’s Bureau of Testing, was 65. His score on the Contract Administration section of the April 1997 examination was 67.5. For both examinations, there were 40 questions on the Contract Administration section. A candidate had to achieve a score of 70 to pass that section of the examination. Because each question was equally weighted, a candidate would have to correctly answer 28 questions to earn the passing score. All questions challenged by Petitioner were multiple- choice questions where the candidate was instructed to give the best answer from four possible choices. Prior to the examinations, the candidates were given a list of approved reference materials. The candidates were permitted to refer to those reference materials while taking the examinations. Respondent’s score of 65 on the July 1996 examination was based on the Bureau of Testing’s determination that Petitioner correctly answered 26 of the 40 questions. To earn a passing grade on the Contract Administration section of the July 1996 examination, Petitioner would have to receive credit for correctly answering two additional questions. His score of 67.5 on the April 1997 was based on the determination that he correctly answered 27 of the 40 questions. To earn a passing grade on the Contract Administration section of the April 1997 examination, Petitioner would have to receive credit for correctly answering one additional question. QUESTION 23 OF THE JULY 1996 EXAM The correct answer for Question 23 of the July examination is choice “D.” Of the four possible responses, choice “D” is the best answer to the question. Petitioner’s answer to this question was choice “A.” Petitioner did not receive credit for his response to this question because he did not select the best answer. The answer selected by Petitioner would not be the most accurate and cost-effective because the methodology he selected would not detect errors made by the first person performing the computations. The challenged question is a question that a candidate for licensure should be able to answer. The challenged question is not beyond the scope of knowledge that a candidate for licensure should have. The challenged question is not ambiguous. Petitioner is not entitled to additional credit for his response to Question 23 of the July 1996 exam. QUESTION 27 OF THE JULY 1996 EXAM The correct answer for Question 27 of the July examination is choice “C.” This correct answer is supported by reference materials made available to all candidates. Petitioner’s answer to this question was choice “B.” Petitioner did not receive credit for his response to this question because he did not select the correct answer to the question. The challenged question is a question that a candidate for licensure should be able to answer. The challenged question is not beyond the scope of knowledge that a candidate for licensure should have. The challenged question is not ambiguous. Petitioner is not entitled to additional credit for his response to Question 27 of the July 1996 exam. QUESTION 11 OF THE APRIL 1997 EXAM The correct answer for Question 11 of the April 1997 examination is choice “C.” This correct answer is supported by reference materials made available to all candidates. Petitioner’s answer to this question was choice “D.” Petitioner did not receive credit for his response to this question because he did not select the correct answer to the question. The challenged question is a question that a candidate for licensure should be able to answer. The challenged question is not beyond the scope of knowledge that a candidate for licensure should have. The challenged question is not ambiguous. Petitioner is not entitled to additional credit for his response to Question 11 of the April 1997 exam. QUESTION 23 OF THE APRIL 1997 EXAM The best answer for Question 23 of the April 1997 examination is choice “C.” This correct answer is supported by reference materials made available to all candidates. Petitioner’s answer to this question was choice “A.” While there is some support in the reference material for Petitioner's answer, the greater weight of the evidence established that his choice was not the best answer. Petitioner did not receive credit for his response to this question because he did not select the best answer to the question. The challenged question is a question that a candidate for licensure should be able to answer. The challenged question is not beyond the scope of knowledge that a candidate for licensure should have. The challenged question is not ambiguous. Petitioner is not entitled to additional credit for his response to Question 23 of the April 1997 exam. QUESTION 35 OF THE APRIL 1997 EXAM The correct answer for Question 11 of the April 1997 examination is choice “C.” This correct answer is supported by reference materials made available to all candidates. Petitioner’s answer to this question was choice “D.” Petitioner did not receive credit for his response to this question because he did not select the correct answer to the question. The challenged question is a question that a candidate for licensure should be able to answer. The challenged question is not beyond the scope of knowledge that a candidate for licensure should have. The challenged question is not ambiguous. Petitioner is not entitled to additional credit for his response to Question 11 of the April 1997 exam.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that Respondent enter a Final Order that dismisses the challenges brought by Petitioner to Questions 23 and 27 on the July 1996 exam and to Questions 11, 23, and 35 of the April 1997 exam. DONE AND ENTERED this 3rd day of December, 1997, in Tallahassee, Leon County, Florida. CLAUDE B. ARRINGTON Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (904) 488-9675 SUNCOM 278-9675 Fax Filing (904) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 3rd day of December, 1997. COPIES FURNISHED: R. Beth Atchison, Esquire Department of Business and Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0750 Mr. Kenneth Marshall 624 Southwest 11th Court Fort Lauderdale, Florida 33315 John Preston Seiler, Esquire 2900 East Oakland Park Boulevard, No. 200 Fort Lauderdale, Florida 33306 Lynda L. Goodgame, General Counsel Department of Business and Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792 Rodney Hurst, Executive Director Construction Industry Licensing Board 7960 Arlington Expressway, Suite 300 Jacksonville, Florida 32211-7467
The Issue Whether Petitioner is entitled to credit for his answers to questions 42 and 81 of the morning session of the Fundamentals of Engineering Examination portion of the engineering licensure examination given on April 15, 2000.
Findings Of Fact Worku took the Fundamentals of Engineering Examination portion of the examination for licensure to practice as an engineer intern on April 15, 2000. The examination is a national multiple-choice examination developed and administered by the National Council of Examiners for Engineers and Surveyors (NCEES). The examination is divided into a morning session and an afternoon session. The questions in the morning session are worth one raw point each. The questions in the afternoon session are worth two raw points each. Worku challenged questions 42 and 81, which were on the morning session of the examination. Worku received 56 raw points for the morning session and 52 raw points for the afternoon session for a total raw score of 108 on the examination. Based on the NCEES' Score Conversion Table, a raw score of 108 converts to a score of 69. A converted score of 70, which equates to a raw score of 109-113, is a passing score. Question 81 asked the examinee to identify the geometric shape that was given by an equation provided in the question. Each examinee was given a reference manual during the examination. The manual contains general formulas for the types of geometric shapes listed as possible answers to question 81. The equation given in question 81 was for a specific shape and was not listed among the general formulas in the reference manual. Worku felt that because the general equation was not used that the equation was stated incorrectly. However, the equation was stated correctly. The equation differed from the equation listed in the reference manual because it was for a special shape of the geometric figure. Worku did not answer question 81 correctly. Question 42 dealt with recrystallization as it relates to metal. The question asks the examinee to pick the answer which explains the reference to the term "recrystallization" in the question. Worku contends that there are two correct answers to question 42 and that the answer which he provided is one of the correct answers. The answer which Worku provided is not a correct answer. It refers to the process of annealing, which is the process of decreasing the toughness of a metal. Recrystallization can be a part, but is not always part of annealing. Recrystallization and annealing are not synonymous terms; thus Worku is not entitled to credit for question 42.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a Final Order be entered finding that Amanuel Worku failed the Engineering Fundamentals Examination with a score of 69. DONE AND ENTERED this 5th day of January, 2001, in Tallahassee, Leon County, Florida. ___________________________________ Susan B. Kirkland Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 5th day of January, 2001. COPIES FURNISHED: Amanuel Worku 18492 Northwest 52nd Path Miami, Florida 33055 Douglas Sunshine, Esquire Florida Engineers Management Corporation 1208 Hays Street Tallahassee, Florida 32301 Natalie A. Lowe, Executive Director Board of Professional Engineers 1208 Hays Street Tallahassee, Florida 32301 Barbara D. Auger, General counsel Department of Business and Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792
The Issue Whether Petitioner is eligible for licensure by endorsement as a professional engineer and/or waiver of Part I of the engineering licensing examination.
Findings Of Fact From 1969 through 1974, Petitioner attended the Lipetsk Branch of the Moscow Institute of Steel and Alloys. In 1974, Petitioner graduated from the Lipetsk Polytechnical Institute (Institute) in Russia, with a degree in industrial and civil engineering. The degree in civil engineering earned by Petitioner is equivalent to a bachelor of science degree in civil engineering in the United States. Upon graduation from the Institute, Petitioner commenced her professional employment as an engineer on August 30, 1974, at the LIPTSKGRAZHDANPROEKT Design Institute. In January 1976, Petitioner was employed as a professional engineer at the State Design Institute DNEPRPROEKKTSTALKONSTRUKSIYA (DNEPR), where she was continuously employed until leaving the Soviet Union in December 1993. There are no specific licensing or registration requirements in Russia with respect to engineers. Therefore, after earning a degree in industrial and civil engineering, Petitioner could work as an engineer in Russia without taking any professional examination. However, in 1979, Petitioner took an examination in Russia that allowed her to sign her own drawings and calculations. During Petitioner's tenure at the DNEPR, she achieved the status of Senior Engineer in 1986; was promoted to the position of Category II Engineer for Steel Structures in 1988; was promoted to the post of Category I Engineer for Steel Structures in 1990; and was elevated to the position of Leading Engineer in 1991. To achieve the status of Category II Engineer for Steel Structures and Category I Engineer for Steel Structures at DNEPR, Petitioner had to take an examination in 1988 and in 1990, respectively. The promotion to each of these positions was predicated upon Petitioner's passing these examinations and demonstrating expertise in the areas of economics, chemistry, mathematics, physics, building materials, corrosion prevention, resistance of materials, and construction mechanics. As a result of passing the examinations in 1988 and 1990, Petitioner was not only promoted, but also received salary increases. Petitioner believes that the two examinations she took in Russia in 1988 and in 1990, while working at the DNEPR were substantially equivalent to the Fundamentals Examination. However, no evidence was presented to support this claim. The Fundamentals Examination is one component of the engineering licensing examination, and is designed to assess whether an individual is qualified to practice in this state as an engineer intern. This examination is usually taken either in the applicant's last year in engineering school or shortly after graduation. With regard to format, the Fundamentals Examination is an eight-hour examination and consists of 120 multiple-choice questions. The Principles and Practice Examination is the second part of the engineering licensing examination and is taken after successful completion of the Fundamentals Examination. Oscar E. Olsen, a structural engineer and owner of O.E. Olsen and Associates, a structural engineering firm, is currently Petitioner's employer. Mr. Olsen, who is generally familiar with the Fundamentals Examination, testified that the list of subjects covered on the two examinations taken by Petitioner in 1988 and 1990, coincide with the subject matter on the Fundamentals Examination. Mr. Olsen further testified that it appeared to him that the two examinations taken by Petitioner were comparable to the Fundamental Examinations required in Florida. Notwithstanding his testimony that the exams taken by Petitioner are substantially equivalent to the Fundamentals Examination, Mr. Olsen admitted that he has never seen or reviewed the examinations taken by Petitioner while she was in Russia. It is impossible to render a reasonable opinion as to whether the two examinations taken by Petitioner in Russia are substantially equivalent to the Fundamentals Examination, where the only information provided with regard to the former is a list of subject areas covered. Such a list gives no indication of the depth and specific content of the subject matter on the examinations; the difficulty of the examinations; the passing scores; the number and format of the questions; and the length of the examinations.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is recommended that Respondent, the Board of Professional Engineers, enter a Final Order denying Petitioner's request for waiver of Part I, the Fundamentals Examination, and for licensure by endorsement. DONE AND ENTERED this 9th day of December, 1997, in Tallahassee, Leon County, Florida. CAROLYN S. HOLIFIELD Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (904) 488-9675 SUNCOM 278-9675 Fax Filing (904) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 9th day of December, 1997. COPIES FURNISHED: Murray Silverstein, Esquire Powell, Carney, Hayes, and Silverstein One Plaza, Suite 1210 St. Petersburg, Florida 33731-1689 Edwin A. Bayo Assistant Attorney General Office of the Attorney General The Capitol, Plaza 01 Tallahassee, Florida 32399-1050 Angel Gonzalez Executive Director Board of Professional Engineers Northwood Centre 1940 North Monroe Street Tallahassee, Florida 32399-0755 Lynda L. Goodgame, General Counsel Department of Business and Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792
