The Issue The issue for determination is whether Petitioner is eligible for licensure by the Board of Professional Engineers.
Findings Of Fact In October 1996, Henry A. Vidal (Petitioner) took the Principles and Practice part of the Electrical Engineer Examination (Examination). A minimum score of 70 is required to pass the Examination. The Department of Business and Professional Regulation, Board of Professional Engineers (Respondent) notified Petitioner that he had not successfully completed the Examination, having received a score of 67. The Examination is a national examination and is graded by national examiners. Petitioner challenges questions numbered 131 and 133 on the Examination. A scoring plan is used for grading each question. For question numbered 131, the highest score achievable is 10. According to the scoring plan, correctly solving any one part of the problem in the challenged question earns a score of 2; correctly solving any two parts, earns a score of 4; correctly solving any three parts, earns a score of 6; correctly solving any four parts, earns a score of 8; and correctly determining five specific items, even though the solution need not be perfect, earns a score of 10. Petitioner received a score of 4 on question numbered 131. Regarding question numbered 131, under the scoring plan, Petitioner is not entitled to any additional points. Even though Petitioner may have indicated his knowledge of the problem in the challenged question, he failed to solve the problem correctly, e.g., omitting a component and miscalculating. Petitioner solved two parts correctly, earning a score of 4. For question numbered 133, the highest score achievable is 10. According to the scoring plan, there are ten parts to the problem in the challenged question and correctly solving one or two parts, earns a score of 2; correctly solving three or four parts, earns a score of 4; correctly solving five or six parts, earns a score of 6; correctly solving seven or eight parts, earns a score of 8; and correctly solving nine or ten parts, earns a score of 10. Petitioner received a score of 8 on question numbered 133. Regarding question numbered 133, under the scoring plan, Petitioner is not entitled to any additional points. Even though Petitioner may have indicated his knowledge of the problem in the challenged question, he failed to solve the problem correctly, e.g., using the incorrect quantity. Petitioner solved eight parts correctly, earning a score of 8. The examiners for the Examination re-graded Petitioner's answers to questions numbered 131 and 133. Petitioner was denied additional credit for the challenged questions by the examiners. Petitioner's answers were not arbitrarily or capriciously graded. The grading process was not devoid of logic and reason. The scoring plan was properly used. Questions numbered 131 and 133 are not beyond the scope of knowledge that is required of a candidate for licensure as an electrical engineer and are capable of being answered by such a candidate for licensure. Considering the proof, the opinions of Respondent's expert were more persuasive. The evidence presented was insufficient to warrant additional credit to Petitioner on questions numbered 131 and 133.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that the Department of Business and Professional Regulation, Board of Professional Engineers enter a final order dismissing the examination challenge of Henry A. Vidal and denying him licensure. DONE AND ENTERED this 27th day of March, 1998, in Tallahassee, Leon County, Florida. ERROL H. POWELL Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 Filed with the Clerk of the Division of Administrative Hearings this 27th day of March, 1998. COPIES FURNISHED: Henry A. Vidal, pro se 5832 Alton Road Miami Beach, Florida 33140 R. Beth Atchison Assistant General Counsel Department of Business and Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792 Lynda L. Goodgame, General Counsel Department of Business and Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792 Angel Gonzalez, Executive Director Department of Business and Professional Regulation Board of Professional Engineers 1940 North Monroe Street Tallahassee, Florida 32399-0792
Findings Of Fact Bobby Serota is licensed as an electrical contractor in Dade, Broward and Palm Beach Counties and is fully qualified by experience and training to take the FECLB examination. Petitioner is presented of Serota and Maggi Electrical Company, Inc. In 1979, the company failed to remit to the Internal Revenue Service (IRS) payroll taxes when due, and the IRS placed a lien against the company for some $24,000 for taxes, penalties and interest. Serota entered into an agreement with the IRS to repay this indebtedness at the rate of $1500 per month and is current on those payments. If this scheduled is maintained the lien will be satisfied in January, 1982. The examination for which Serota has applied is given twice per year. The next examination will be given in December, 1981, or January, 1982.
Recommendation From the foregoing it is concluded that Petitioner is fully qualified to sit for the next examination but for the IRS lien filed against his company. This IRS lien will be liquidated by the time the next examination is given provided Petitioner keeps his payments to the IRS current. It is, therefore, RECOMMENDED that Bobby Serota be qualified to sit for the next electrical contractors examination provided that he submits to the Board by 1 December 1981, a statement showing his payments to the IRS are current. ENTERED this 14th day of August, 1981, in Tallahassee, Leon County, Florida. K. N. AYERS Hearing Officer Division of Administrative Hearings 2009 Apalachee Parkway Tallahassee, Florida 32301 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 14th day of August, 1981. COPIES FURNISHED: Mr. Bobby Serota 2040C Tigertail Boulevard Dania, Florida 33004 Susan Tully, Esquire Assistant Attorney General Department of Legal Affairs Administrative Law Section The Capitol Tallahassee, Florida 32301 Nancy Kelley Wittenberg, Secretary Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32301 =================================================================
The Issue Whether Petitioner is entitled to licensure as a certified electrical contractor pursuant to the provisions of Section 489.514, Florida Statutes.
Findings Of Fact At all times material hereto, Petitioner, William Davidson Schaefer (Petitioner), was a licensed electrical contractor, having been issued License No. ER-0008163. This license, issued to Petitioner after he fulfilled the competency requirements of the Pinellas County Construction Licensing Board, allows him to practice electrical contracting in Pinellas County, Florida. To meet the competency requirements of the Pinellas County Construction Licensing Board necessary to obtain an electrical contracting license, Petitioner had to successfully complete a written examination. In 1981, when Petitioner received his license, the test required by the Pinellas County Construction Licensing Board was administered by Construction Exams, Inc., the sole test provider for Pinellas County. Petitioner took the Electrical Contractor's Examination administered by Construction Exams, Inc. on June 26, 1981, and earned a passing score of 86.5%. Petitioner has practiced electrical contracting in Pinellas County since 1981 and has been sole owner of Lester Electric, Inc., an electrical contracting company, since 1983. Petitioner's license is active and in good standing. Moreover, during the time that Petitioner has practiced electrical contracting, he has not been the subject of any complaints filed with, or discipline imposed by, the Pinellas County Construction Licensing Board. On or about May 8, 2000, Petitioner applied to the Electrical Contractors' Board (Board) for certification as an electrical contractor pursuant to the "grandfathering" provisions of Section 489.514, Florida Statutes. On or about May 26, 2000, the Board denied Petitioner's application for certification as an electrical contractor because he did not provide information upon which the Board could determine that the examination administered by Construction Exams, Inc. is substantially similar to the state examination. The exam administered by Construction Exams, Inc. contained a technical section and a general business section. However, Petitioner does not recall if the examination included a section or questions on safety. On the Examination Verification Form submitted to the Board as part of Petitioner's application, the Pinellas County Construction Licensing Board verified that the examination taken by Petitioner in 1981 included a technical section and a general business section. However, in response to a question on the form asking if the examination had included "fire alarm questions," the Pinellas County Construction Licensing Board marked the response, "Not sure." The company, Construction Exams, Inc., that administered the examination that Petitioner took in 1981 is no longer in business. Petitioner sought to obtain a copy of the examination from the Pinellas County Construction Licensing Board, but learned that the local board did not have a copy of the examination. Except for the time he was taking the examination, Petitioner never had nor has he been able to obtain a copy of the examination from any source. Although Petitioner does not recall if the examination that he took in 1981 included questions on safety and/or fire alarms, he was able to obtain information about some of the areas covered on the examination. Based on the document Petitioner was able to obtain, it appears that the examination he took included questions relative to the mechanics' lien law, workers' compensation law, first aid, OSHA regulations, federal tax law and the national electrical code. The state's Certified Electrical Contractor Exam includes a technical section, a general business section, and a safety section. The examination consists of 150 multiple choice questions, is an open-book test, and includes both a morning session and an afternoon session. Given that Petitioner took the examination more than 20 years ago, it is understandable that he can not recall all the questions and/or sections that were covered on the examination, and that he was unable to obtain a copy of the examination from any source. However, without a copy of the examination or other documents which sufficiently detail the contents of the examination Petitioner took in 1981, it is impossible to determine if that examination is substantially similar to the state examination. Petitioner failed to provide the Board with any information upon which it could make a determination that the examination he took is substantially similar to the state examination required for certification as an electrical contractor.
Recommendation Base on the foregoing Findings of Facts and Conclusions of Law, it is RECOMMENDED that the Board enter a final order denying Petitioner's application for licensure as a certified electrical contractor. DONE AND ENTERED this 31st day of January, 2002, in Tallahassee, Leon County, Florida. CAROLYN S. HOLIFIELD Administrative Law Judge Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-3060 (850) 488-9675 SUNCOM 278-9675 Fax Filing (850) 921-6847 www.doah.state.fl.us Filed with the Clerk of the Division of Administrative Hearings this 31st day of January, 2002. COPIES FURNISHED: Robert C. Decker, Esquire Decker Beeler, P.A. 25 Second Street, North, Suite 320 St. Petersburg, Florida 33701 Barbara R. Edwards Assistant General Counsel Department of Legal Affairs The Capitol, Plaza Level 01 Tallahassee, Florida 32399-1050 Hardy L. Roberts, III, General Counsel Department of Business and Professional Regulation Northwood Centre 1940 North Monroe Street Tallahassee, Florida 32399-2202 Anthony B. Spivey, Executive Director Electrical Contractors Licensing Board Department of Business and Professional Regulation Northwood Centre 1940 North Monroe Street Tallahassee, Florida 32399-0792
Findings Of Fact Based on the stipulations and admissions of the parties, the exhibits received in evidence, and the testimony of the witnesses at the hearing in this case, I make the following findings of fact. Findings based on stipulations and admissions of the parties The Petitioners, John Eugene Harden and Dova Cauthen, qualified for and were administered the January 1982 Electrical Contractors' Licensing Examination. After their examinations were graded and regraded, Petitioners were notified that they had not received a "Passing" score of 75 or more. The Petitioners, John Eugene Harden and Dova Cauthen, qualified for and were administered the July 1982 Electrical Contractors' Licensing Examination. After their examinations were graded and regraded, Petitioners were notified that they had not received a "Passing" score of 75 or more. Both Petitioners reside in Dade County, Florida. The Respondent Department of Professional Regulation (hereafter DPR or the "Department") is an agency of the State of Florida. The Respondent Electrical Contractors' Licensing Board (hereafter referred to as the "Board") is an agency of the State of Florida statutorily responsible, along with DPR, for licensing certified electrical contractors. The Office of the Executive Director of the Board is located at 130 North Monroe Street, Tallahassee, Florida. The business address of Petitioner Harden is Harden Electric, 311 N.E. 8th Street, Homestead, Florida 33030. The business address of Petitioner Cauthen is 959 N.E. 79th Street, Miami, Florida 33138. 8. On March 20, 1981, Rules 21GG-6.01 (2), 21GG-6.01 (3), 21GG-6.01 (4), of the Rules of the Electrical Contractors' Licensing Board, were amended. Rule 21GG-6.01 (2) altered the format of the licensing examination so that the formerly entirely open book examination became a part open book, part closed book examination. Rule 21GG-6.01 (4) raised the passing grade on the licensing examination from 70 to 75. Rule 21GG-6.01 (3) altered the technical format. On December 3, 1981, Susan Tully, counsel to the Electrical Contractors' Licensing Board, caused a change to be made in Rule 21GG-6.01 (1) (c) of the Rules of the Electrical Contractors' Licensing Board. This change was made without formal notice or informal notice to the public and without a vote of the Electrical Contractors' Licensing Board, although the change was discussed at a Board meeting. None of the procedures set forth in Section 120.54 of the Florida Statutes were followed in amending this Rule. Liz Cloud was the Bureau Chief of the Division of Elections, Bureau of Administrative Code, Department of State. The address of the Bureau is Room 1802, The Capitol Building, Tallahassee, Florida. The change in Rule 21GG-6.01 (1)(c) eliminated parts 72 A, B, C and D and indicated that the entire Fire Safety Code (and not just the aforementioned parts) would be a subject of the Electrical Contractors' Licensing Examinations. In fact, the reason for the alleged "technical change" was that the Board intended and tested examinees in the January and July 1982 Licensing Examinations on materials in parts of the Fire Safety Code in addition to those contained in 72 A, B, C and D of the Fire Safety Code. Petitioner Harden specifically requested to review his January and July 1982 Electrical Contractors' Licensing Examinations. On March 25, 1982, Petitioner Harden went to Tallahassee, Florida to review his January 1982 Licensing Examination papers, but although he requested an "examination review" he was never provided with his own examination booklet or a copy thereof. During this alleged "examination review" Mr. Harden wrote written objections to the January 1982 examination on the forms provided to him based on the master copy of the examination provided to him. On August 31, 1982, Petitioner Harden went to Tallahassee, Florida to review his July 1982 Licensing Examination papers, but although he requested an "examination review" he was never provided with his own examination booklet or a copy thereof. During this alleged "examination review" Mr. Harden wrote written objections to the July 1982 examination on the forms provided to him based on the master copy of the examination provided to him. Petitioner Cauthen specifically requested an "examination review" with respect to her January and July 1982 Licensing Examination papers. On March 17, 1982, Petitioner Cauthen went to Tallahassee, Florida to review her January 1982 Licensing Exami-nation papers, but although she requested an "examination review" she was never provided with her own examination booklet or a copy thereof. During this alleged "examination review" Ms. Cauthen wrote written objections to the January 1982 examination on the forms provided to her based on the master copy of the examination provided to her. On August, 19, 1982 Petitioner Cauthen went to Tallahassee, Florida to review her July 1982 Licensing Examination papers, but although she requested an "examination review" she was never provided with her own examination booklet or a copy thereof. During this alleged "examination review" Ms. Cauthen wrote written objections to the July 1982 examination on the forms provided to her based on the master copy of the examination provided to her. Petitioners Harden and Cauthen sought Board review of their January and July 1982 Electrical Contractors' Licensing Examinations. Petitioners were advised in July 1983 that no copies of their actual booklets exist; Petitioners were advised in October 1983 that their actual booklets were shredded. At the November 8, 1982, meeting of the Board, Ms. Ida Cameron representing DPR, presented to the Board a package of information (assembled in package form) for the Board to consider during the examination review. With regard to Question Number 71 on the afternoon portion of the July 1982 Licensing Examination, two of the four possible responses, "A" and "C" were credited. Candidates like Petitioner Cauthen who answered "B" received no credit for the question. Petitioners Harden and Cauthen have requested Chapter 120.57 hearings with respect to their January and July 1982 licensing examinations and the review, grading and agency action with respect to same. Although request for production was specifically made for said packages of information with respect to the January 1982 and July 1982 licensing examinations in February, 1983, no packages have been produced to date. DPR destroyed the Petitioners' examination booklets before the end of the two year period immediately following each of the 1982 examinations. That Section 455.217 of the Florida Statutes requires the Board "by rule" to designate areas of competency to be covered by each licensing examination. That Section 455.217 states that the Board shall "by rule specify the general areas of competency to be covered by each examination, the relative weight to be assigned in grading each area tested, and the score necessary to achieve a passing grade." That the amendment of Rule 21GG-6.01 (2) required candidates to commit to memory portions of the electrical code, accounting, law, worker's compensation rules, federal employer's tax guide, A1A General Conditions, business practices; legal and insurance requirements. In the July 1982 Electrical Contractors' Licensing Examination candidates were given one hour more time in which to take the examination than was given during the January 1982 examination. Rule 21GG-6.01 (4) was amended in conjunction with Rules 21GG-6.01 (1)(a), (2) and (3) at a board hearing in March, 1981. Rule 21GG-6.01 (4) raised the passing score on the January 1982 Electrical Contractors' Examination and the July 1982 Electrical Contractors' Examination from 70 to 75. The amendment to Rule 21GG-6.01 (4) required that electrical contractors pass the certification examination with a score of 75 percent, whereas all other construction industry licensing board contractors licensed by the Department of Professional Regulation (13 other categories) were merely required to achieve a 70 percent pass score. That Section 455.217 of the Florida Statutes provides that "The board shall make rules providing for reexamination of any applicants who have failed the examination." That DPR did not and has never provided Petitioners, their attorneys or agents with their own examination booklets for the January and July 1982 Electrical Contractors' Licensing Examinations. DPR has provided Petitioners only with copies of "master" examinations for their review. That Section 455.217 of the Florida Statutes provides that the Board shall make available an examination review procedure for applicants. That the Respondents produced Notice of Destruction of Examination Booklets and Other Examination Materials dated April 14, 1982, which allegedly evidences destruction of Petitioners' examination booklets for the January 7, 1982, Examination on April 14, 1982. That the Respondents produced Notice of Destruction of Examination Booklets and Other Examination Materials dated October 15, 1982, which allegedly evidences destruction of Petitioners' examination booklets for the July 13, 1982, Examination on October 15, 1982. The findings in paragraphs 1 through 33, immediately above, are based directly on the stipulations of the parties, most of which stipulations were memorialized at the beginning of the hearing. The findings in the following paragraphs are based primarily on testimony and exhibits, but some of them are also based in whole or in part on stipulations. In the findings which follow there are certain to be at least some repetitious findings in the course of putting matters into context and making additional findings which are related to some of the stipulated findings. I have tried to avoid all unnecessary repetition, but a certain amount is necessary for clarity and a certain amount is unavoidable due to the sheer size of the task at hand. Findings on background matters and on matters relating to more than one rule Both of the Petitioners in this rule challenge proceeding are individuals who have applied to the Electrical Contractors' Licensing Board for licensure as certified electrical contractors. Both of them have been approved to sit for the licensure examination. Petitioner Harden took the Board's licensure examination on each of the following occasions: July 1981, January 1982, July 1982, and January 1983. The Board has not given him a passing grade on any of those' four examinations. Petitioner Cauthen took the Board's licensure examination on two occasions: January 1982 and July 1982. The Board has not given her a passing grade on either of those two examinations. The grade notifications received by these Petitioners show, inter alia, that Petitioner Cauthen received a grade of 73 on the July 1982 examination. Both of these Petitioners have presently pending formal proceedings under Section 120.57(1), Florida Statutes, in which they are challenging various matters related to the preparation of, administration of, scoring of, and inherent validity of the Board's January 1982 and July 1982 licensure examinations. The Electrical Contractors' Licensing Board certification examination is different from a master electrician examination. However, the two examinations are in many ways similar because of the overlap in the nature of the subject matter to be tested on both examinations. The passing score or cut score on the local master electrician examination administered by Dade County is 70 percent. Most of the questions on that examination are about the National Electric Code. Part of the Dade County master electrician exam is closed book. Prior to 1972, persons wishing to engage in electrical contracting in the state of Florida were required to be licensed by the local governments in the areas in which they sought to operate. Since 1972, persons wishing to engage in electrical contracting in the state of Florida must be licensed by a unit of local government or by the Electrical Contractors' Licensing Board. Persons who are licensed by the Electrical Contractors' Licensing Board are known as certified electrical contractors. A certified electrical contractor can engage in electrical contracting anywhere in the state of Florida without local licensure. Persons who are licensed by one or more local governments (typically a municipality or a county) are known as registered electrical contractors. Registered electrical con-tractors are licensed to engage in electrical contracting only in the geographic areas encompassed by the boundaries of the local government entities that issued their local licenses. There is, however, a certain amount of reciprocity from one local government to another. Certification as a state certified electrical contractor does not authorize the electrical contractor to work as an electrician, although a certified electrical contractor can pull permits. A person does not have to be a licensed electrician in order to become a state certified electrical contractor, although many electrical contractors are also licensed as journeyman or master electricians. Candidates for the electrical contractor licensure examination have a great $ variety in the nature and scope of their background and experience. This variety in background and experience is among the reasons which cause testing for minimum competence as an electrical contractor not to be an exact science. As between certification and registration, certification by the Electrical Contractors' Licensing Board is not a major factor in the ability to compete for business. A person who has a statewide certification can save some money by avoiding the expense of obtaining local competency cards, but as a general rule a registered electrical contractor can work just about anywhere in the state due to reciprocity. Especially, a person who has passed a Block master electrician examination or a Block local electrical contractor's examination can work just about anywhere in the state because most counties in Florida accept the Block examination. Registered electrical contractors regularly compete for business with certified electrical contractors. For example, Petitioner Cauthen's company is presently licensed in Monroe, Dade, and Broward counties, where it does a considerable amount of business. Petitioner Cauthen's company bids on lots of contracts and submits bids in competition with both registered and certified electrical contractors. Thus, the company is already in competition with certified electrical contractors. Similarly Board Member Isaacs, whose certified company does 90 percent of its work in Duval County, has regular competition from registered electrical contractors. Board Member Isaacs competes with approximately 250 electrical contractors. Of that 250, approximately 175 are registered and the others are certified. A much bigger factor in competition than the registration versus certification issue is the cost of doing business in more than one area or the cost of doing business at a location that is distant from one's primary base of operations. Only about fifty electrical contracting firms regularly compete for business over the entire state of Florida. Accordingly, a restriction on the number of persons licensed by the Board as certified electrical contractors would have minimal, if any, limitation on the competition faced by those members of the Board who are certified electrical contractors. The Electrical Contractors' Licensing Board admin-istered its own certification licensure examination from 1972 through 1980. During that period of time the Board administered the examination a total of twenty-two times. During those twenty-two sessions of Board administered examinations, a total of 824 candidates sat for the examination, of which 392 were successful. Although the percentage of candidates who were successful on a particular Board administered examination ranged from a low of 20.7 percent to a high of 78.8 percent, the average passing rate of all candidates on all twenty- two of the Board administered examinations was 47.57 percent. (By way of comparison, it is interesting to note that the percentage of candidates who are successful on the Block master electrician examination is between 30 percent and 35 percent of those who take the examination.) Further, on fifteen of the twenty-two occasions on which the Board administered the examination, the percentage of candidates who were successful was 50 percent or less. In 1979, the regulation of professions and occupations was reorganized. The Department of Professional Regulation (the Department) was created as an umbrella agency over numerous boards, including the Electrical Contractors' Licensing Board and the Construction Industry Licensing Board. The responsibility for examining applicants, which in the case of the Electrical Contractors' Licensing Board had been handled by the Board members themselves, was taken over by the Office of Examination Services (O.E.S.). Toward the end of 1980 and the beginning of 1981, O.E.S. did not like what the Board was doing and the Board did not like what O.E.S. was doing. There was a general lack of trust between the two entities, there was poor communication between the two entities, and the relationship between them at that time might best be described as estranged. Although both entities made efforts at cooperation with the other, such efforts were not always effective or well received. As a result of the poor communication between the two entities, certain personal concerns over Board actions by individuals within the O.E.S. were never communicated to the Board (and therefore could not be answered. 4/ The first examination administered by the O.E.S. was in January 1981. Of the fifty candidates who took the January 1981 examination, forty-six were successful. This was a passing rate of 92 percent. In view of the Board's experience when it was administering its own examination, the Board was understandably surprised and concerned when the percentage of candidates passing the first O.E.S. administered examination was almost twice the average passing percentage on the Board administered examinations. The Board had no evidence that the overall qualifications or capabilities of the applicants examined by O.E.S. at the January 1981 examination were any higher than the capabilities of those examined previously. To the contrary, a review of their qualifications based on the information in their applications indicated that their qualifications were substantially the same as those of previous candidates tested by the Board. Also, the admission standards for the January 1981 examination were the same as those for prior examinations. The Board concerns about the O.E.S. administered January 1981 examination included the following matters, among others, memorialized at a Board meeting discussing the examinations: The candidates had been allowed to take any reference material desired into the exami- nation. Previously the Board had allowed only reference books listed as part of the application form. There was a very high pass rate in compar- ison to all past examinations. There appeared to be too few calculation questions. The questions had been placed on the paper in sequence with the reference book materials. There was a possibility that notes were taken into the examination which would have given advantage to the candidates. The Board's Examination Committee had been under the assumption that the entire examination would be presented for review of the questions. Instead the only questions presented were ones questionable under Department criteria for measuring competency. It was explained, from past experience, that persons conducting the seminars for exams had obtained the entire exam content from persons taking the examination in the past. It had been done with a camera which was taken into the examination. The Board, when administer- ing the examination, had been very strict on what was used in performing the examination. In the last exam the security was very poor. The Board felt there were so few calculation questions on the O.E.S. administered examination in January of 1981 that the examination was not a proper or sufficient examination. This was due at least in part to the fact that O.E.S. had difficulty covering all areas of the examination with the desired number of questions because the O.E.S. bank of questions was very limited at that time. Previous Board examinations were open book with certain reference material allowed. When the Office of Examination Services took over the administration of the January 1981 exams, it sent to the candidates a form letter adapted from the Construction Industry Licensing Board. This form letter instructed the candidates that they would be able to bring into the examination any notes and other materials desired. This was contrary to the past practice of the Board and contrary to the Board's wishes. The Board was very frustrated and concerned about the circumstances which led up to the January 1981 examination because the O.E.S. had refused to allow the Board to have any input into the examination and the Board thought the O.E.S. had come up with an apprentice level examination. In the Board's opinion, the January 1981 examination prepared by O.E.S. clearly tested at a level less than that of minimum competency. And, although O.E.S. did not agree with the Board that the January examination was invalid, O.E.S. did agree that the examination was a lot easier than they had thought it would be. The Electrical Contractors' Licensing Board did not conduct any formal studies or formal analysis prior to making the 1981 amendments to Rule 21GG-6.01 changing the format of the examination and the cut score. However, the Board's Rules Committee did a great deal of work on the matter and the matter was discussed extensively at Board meetings. In this regard it is important to keep in mind that the Board members (with the exception of the two lay members) were all experienced practicing electrical contractors who were familiar with the requirements of day-to-day electrical contracting. The Board's decision to change part of the examination to closed book was due to a concern that people with no electrical knowledge could become licensed if the examination was all open book and had a low percentage of technical questions. The Board felt that more than half of the examination should be technical questions. The closed book National Electrical Code questions were for the purpose of testing what a person with experience in the field of electrical contracting should know about everyday matters. The primary, if not the sole, motivation for the Board's 1981 amendments to Rule 21GG-6.01 was the Board's concern about the quality of the O.E.S. administered examination and the Board's feeling that, due to its estranged relationship with O.E.S., the only vehicle through which it could effectively influence the quality of future examinations was through rule- making. Those amendments were not motivated by any desire on the part of the Board to restrict competition in the field of electrical contracting. During the past few years the job requirements of an electrical contractor have remained substantially the same. Block and Associates (hereinafter "Block") is a company based in Gainesville, Florida, that writes licensure examinations for contractors in various trades. Block writes such examinations for cities, counties, and states. Block has prepared electrical contracting licensure examinations for the states of Florida, Georgia, and Oklahoma, as well as for St. Johns County, Florida. Block prepares licensure examinations for just about anything that involves electricity, including such things as electrical contracting, electrical journeyman, electrical-master, low voltage, elevator, burglar alarm and fire alarm Block prepares master electrician examinations for over one hundred governmental entities. The Block electrical master exams and the Block electrical contractor exams use some of the same questions. Subsequent to the 1982 examinations which form the gravamen of these Petitioners' related proceedings under Section 120.57, Florida Statutes, the ECLB has contracted with Block and Associates to prepare the Board's certification licensure examination. The Board has never said anything to Block about wanting to achieve any particular passing rate or wanting to have any particular percentage of the candidates taking the examination achieve a passing score. The Board has never interfered with Block's autonomy in the preparation of the electrical contractor exam. All of Block's electrical contractor examinations include business questions. It is important to test for business skills because an electrical contractor who gets into business trouble may start cutting corners and cutting corners is a hazard to the public. Some of Block's electrical contractor examinations also have specific sections on safety. Block always does a post-administration statistical analysis of the examinations questions it uses. The reason for this is to find out if anything is wrong with the questions; in other words, to determine whether the questions are valid. The computer program used by Block to check the validity of its tests was prepared for Block by a professor in the College of Education at the University of Florida. Block uses a computer to conduct a validity analysis of each test it administers. Findings regarding Rule 21GG- 6.01(1)(c) of the Electrical Contractors' Licensing Board Rule 21GG-6.01(1)(c) of the Electrical Contractors' Licensing Board reads as follows (with the portion challenged by the Petitioners underscored): The areas of competency to be covered by the certification examination shall be as follows: (a) *** (c) Safety, which shall include but not be limited to, OSHA regulations, life safety codes, and the Fire Safety Code (NFPA). Prior to the December 1981 amendment which is challenged here, Rule 2100-6.01(1)(c) read as follows: The areas of competency to be covered by the certification examination shall be as follows: (a) *** (c) Safety, which shall include but not be limited to, OSHA regulations, life safety codes, and the fire safety code (NFPA 72A, B, C and D). The Board's purpose in amending the rule to delete the reference to "72A, B, C and D" was to make it clear to candidates for examination that the Board' intended to include in the safety portion of its examinations questions from portions of Volume Seven of the NFPA other than Chapters 72 A, B, C, and D of that volume. Volume Seven of the NFPA contains quite a bit of material in addition to the material included in Chapters 72 A, B, C, and D of that volume. In view of the modifying phrase "shall include but not be limited to," the amendment to delete the reference to Chapters 72 A, B, C and D was not a necessary prerequisite to the use of examination questions based on other portions of Volume Seven of the NFPA. The Board could ask the same examination questions before and after the amendment. Several weeks before each examination, the Department of Professional Regulation sent all candidates for examination, including these Petitioners, a notice to appear for the examination. The notice to appear included a list of reference books on which the examination was to be based. That list of reference books contained a specific reference to Volume Seven of the NFPA. All sixteen volumes which comprise the entire NFPA were not listed as reference books. Neither of these Petitioners demonstrated that he or she was genuinely confused or misdirected by the amendment to Rule 21GG-6.01(1)(c). Neither Petitioner contended he or she had studied all sixteen volumes of the NFPA. Instead, both Petitioners studied from the books on the reference list. Neither Petitioner has an application for the examination pending; neither claims an intention to take the examination again. Findings regarding Rule 21GG- 6.01(1), (2), (3), and (4) of the Electrical Contractors' Licensing Board At the time of the examinations which are the subject of these Petitioners' related cases under Section 120.57, Florida Statutes, Rule 21GG- 6.01(1), (2), (3), and (4) of the Electrical Contractors' Licensing Board read as follows, in pertinent part: The areas of competency to be covered by the certification examination shall be as follows: Technical, which shall include, but not be limited to, electrical calculations, estimating, designs, and electrical schematics; and which shall be divided into two (2) separate areas, one containing electrical calculations, the other containing Code-related questions not requiring calculations. General business, which shall include but not be limited to, problems relating to accounting, law, insurance, workers' compen- sation and social security; The format of the examination shall be as follows: The portions of the examination con- taining the electrical calculations and $ safety questions shall be open book. The applicant is responsible for bringing and may.. use during these portions the applicable code books, reference materials as approved by the Board, and noiseless mechanical or non- mechanical instruments he wishes to use. The portions of the examination con- taining the noncalculation technical questions and all business questions shall be closed-book. The applicant will not be permitted to use the reference materials listed in 2(a) or any other reference materials. Security measures as set forth by the Department shall be followed during both portions of the examination. The relative grading weight to be assigned to each area of competency shall be approximately as follows: Technical - 60 percent Electrical Calculations-40 percent of Test Code-related questions-20 percent of Test General business - 30 percent Safety - 10 percent An applicant shall be required to achieve a score of a general average of not less than seventy-five percent (75 percent) in order to pass the examination and be certified for licensure. There shall not be a practical or clinical examination. The language quoted above is the language of the relevant portions of the rule as it read after the March 1981 amendments to the rule. The principal amendments in March of 1981 may be summarized as follows: (1) changes which divided technical questions on the examination into two separate areas, (2) changes which made part of the examination open book and part closed book [it was previously all open book, and (3) a change in the minimum passing score from 70 percent to 75 percent. These Petitioners challenge the validity of all three of the principal amendments. As originally proposed, the March 1981 amendments to subsection (2)(a) of Rule 21GG-6.01 would have permitted a candidate to bring "any notes" to the open book portion of the examination. During the adoption process the words "and any notes" were deleted from the amendment by the Board. The words "and any notes" did not appear in Rule 21GG-6.01 prior to the 1981 amendments. Nor was it the practice of the Board prior to 1981 to permit candidates for examination to take any notes into the examination when it was administered by the Board. Findings regarding examination content and relative grading weights In November of 1983 the Electrical Contractors' Licensing Board again amended Rule 21GG-6.01(3) to change the relative grading weights of the areas of competency to be tested. After November of 1983 the relative grading weights of the areas of competency were as follows: Technical increased from 60 percent to 65 percent; electrical calculations increased from 40 percent to 45 percent; code related questions remained 20 percent of the examination; general business was decreased from 30 percent to 25 percent of the examination; and safety remained 10 percent of the examination. 5/ The licensing examination given by the Board has historically contained materials testing knowledge of electrical work and also materials testing the business qualifications of the applicants. Since the inception of the Board's licensing exam, the electrical work portions have contained electrical calculations. Throughout the time the Board has been administering licensure examinations for certification, the percentages of the examination devoted to particular subject areas have been based upon the Board's belief as to the appropriate levels of knowledge needed by a certified electrical contractor. The weighting of the examination was equitable when it was weighted 60 percent technical, 30 percent business, and 10 percent safety, and it is still equitable now that it is weighted 65 percent technical, 25 percent business, and 10 percent safety. The Board changed to the current percentages at the suggestion of Block and Associates. The Board's examination has had similar ratios for a long time, at least as far back as 1971. The proportions of the examination devoted to each particular subject matter did not change due to the March 1981 amendments. With the exception of the January 1981 examination put together by O.E.S., electrical calculations had historically been 40 percent of the test. Since the Board felt this percentage should be maintained, and since it was necessary to divide those calculations from the other portion of the technical section (since one would be tested in the closed book portion and the other in the open book portion), the division of the technical part of the exam was set out in the rule. On an electrical contractor licensure examination it is appropriate to include in the area of "technical" questions, questions dealing with the following subjects: electrical calculations, parts of estimating, and designs and electrical schematics. In the "business" portion of an electrical contractor examination, it is appropriate to include questions dealing with the following: accounting, worker compensation, and social security. Findings regarding closed book versus open book examinations Local licensing examinations had, in 1981, included a closed book portion. Local licensing examinations and state licensing examinations given in other states still include such a closed book portion. The basic Block examination has always included a closed book portion. Closed book examinations are not all that unusual in occupational and professional licensure testing. The CPA an Nursing examinations are closed book. Also, virtually all of the electrical examinations administered by Block and Associates include a closed book portion. The advantage of a closed book examination technique is that it is easier to identify the candidates who have had practical experience in the subject matter being tested. A closed book examination is a better test for field experience and for general knowledge of the subject matter being tested. Certain questions known as "anchor" questions was given both in the open book examination before the format change and in the closed book section after the format changed. The relative performance by candidates on the same questions in the two formats shows the format change not to have prejudiced the candidates. Further, an examination analysis of the results of the closed book portions of the ECLB examinations reveals that, based on candidate performance, the closed book portion of the examinations was easier than the open book portion. This also shows that the format change did not prejudice the candidates. Findings regarding "cut scores" From 1972 until the rule changes in 1981, the minimum passing score, or "cut score," set by the Board for the certification licensure examination was 70 percent. Cut scores of both 70 percent and 75 percent are very common cut scores for licensure examinations in the fields of electrical contracting, journeyman electrician, and master electrician, as well as licensure examinations in other occupations and professions. Many local licensure examinations have a 75 percent cut score. Standing alone, the cut score to be applied to a future examination is somewhat lacking in specific significance. A cut score must be considered in relation to the content of the examination to which it is to be applied. All of the testing experts who testified at the hearing agreed that setting an examination cub score is an inherently arbitrary decision. In the final analysis it is a judgment call that cannot be made with scientific exactitude and is unavoidably arbitrary to a certain extent. As explained by one of the Petitioners' testing experts, even though statistical methodology is available for the determination of cut scores, to a large extent the cut score is a random decision, the validity of which can be assessed only in relationship to the specific testing instrument to which it is applied. For example, during the course of Block's preparation of its first licensure examination in 1958 for the City of Ormond Beach, when it came time to decide what cut score to use, the five experts who were preparing the examination talked it over and decided that 75 percent was the equivalent' of a good. "C" when compared to academic grades, and they decided to use 75 percent as their cut score. It is not possible to be much more scientific or precise than that in setting cut scores, especially when one has a group of candidates of varied experience and background taking the examination. A skilled test preparer can construct an examination of equal validity within a range of cut scores from 65 percent to 80 percent if the test preparer knows at the time of constructing the examination what the cut score will be. With any cut score in that range, a skilled test preparer can raise or lower the percentage of candidates who will actually pass the examination by careful selection of the questions to be used on the examination. By using easy questions, the person preparing the examination can insure that more people will pass a test with a high cut score. Similarly, by using hard questions, the person preparing the examination can insure that fewer people will pass an examination with a low cut score. On some standardized licensure examinations the cut score is determined after the examination results are examined. In other words, the examination results are "curved" based on the performance of the group of candidates who take a particular session of the examination and the actual cut score is determined in relationship to the raw scores achieved by each particular group of candidates. This flexible method of setting cut scores seems to work well on standardized examinations which are administered to large numbers of candidates, but it is questionable whether it would work very well with small groups of candidates. The Board's examinations have historically been administered to small groups of candidates. Findings regarding the effects of changes on testing instruments. In order for a licensure examination to accomplish the purpose for which it is administered, it should, of course, be valid and reliable. Several of the Petitioners' expert witnesses described what might be characterized as the best way to make changes to an examination or as the ideal way to make changes to an examination. Nevertheless, the manner in which the Electrical Contractors' Licensing Board went about making the changes to the examination which were incorporated in the March 1981 rule changes was a reasonable and logical response to the circumstances faced by the Board. It was perhaps not the best way to have resolved matters, but it was a reasonable response. The Board's action in this regard was not arbitrary or capricious. Even the Petitioners' most persuasive expert in the field of testing conceded that if the content experts (in this case the Board members) felt that given a specific content domain and given a specific item bank the testing instrument measured less than minimum competency, a logical response would be to raise the cut score. Another logical reaction to that situation would be to change a portion of the examination from open book to closed book. Both actions would be reasonable and logical responses to that type of problem. Where there has been a modification in the format of a testing instrument, an accepted methodology for analysis of the effects of format modification is the use of repetitive questions from prior testing instruments. These repetitive questions are known as "anchor" questions. If a statistically significant deviation in performance on the anchor questions is demonstrated, the format modification requires further analysis through other statistical tools. However, if an analysis of the anchor questions shows inconclusive or mixed results on the anchor questions (such as equal or improved candidate performance on those questions), it may then be concluded that the format change is not significant to candidate performance and may be an appropriate format change relative to the profession or occupation being examined. Content validity is the most practical' measure of the validity of a licensure examination. The content validity of an examination depends on the extent to which the questions on an examination may be accepted as representative of performance within a specifically defined content domain of which the examination instrument is a sample. Content validation would be the best way to determine the validity of the examinations which were administered in 1982 pursuant to the March 1981 rule amendments. One method of establishing content validity is to have a group of experts identify the domains of knowledge that are applicable to the profession or occupation being tested. The establishment of content validity relies heavily on the opinions and judgments of people who are experts in the relevant profession or occupation. Expert judgment plays a integral part in developing the definition of the content domain to be tested. To the extent that the content domain of Boar examinations was established by the March 1981 amendments to Rule 21GG-6.01(3), the content domain was established on the basis of the expert judgment of persons who were experts in the field of electrical contracting, namely, the members of the Electrical Contractors' Licensing Board. The relative grading weights established in the 1981 amendments to Rule 21GG-6.01(3) have at least a possible correlation to electrical contractor competence. In fact, the persuasive expert testimony establishes that those relative grading weights did bear a reasonable relationship to electrical contractor competence. The current slightly different relative grading weights also bear a reasonable relationship to electrical contractor competence even though there has been no recent change in the nature of the responsibilities of electrical contractors. In this regard it must be remembered that testing is not an exact science and no test for minimum competency can ever be expected to be an exact model of actual work experience. The best that can be expected is a reasonable model. There are various accepted methodologies for the creation of standardized examinations, adherence to which tends to enhance the likelihood that the examination instrument finally produced will be valid and reliable. However, adherence to those accepted procedures is not a necessary prerequisite to creation of a valid and reliable examination. This is particularly true when one is going to be testing small groups of people with varied backgrounds instead of the massive groups of people with similar backgrounds for whom standardized tests are more typically designed. In the final analysis the only practical and reliable measure of the validity of an examination is by statistical analysis of the examination after it has been administered. Given the nature of the circumstances faced by the Board at the time of the March 1981 amendments to the examination format and cut score, given the nature of the pool of candidates to be examined, given the nature of the changes contemplated by the Board, and given the very nature of the process of testing for minimum competency--which involves perhaps as much art as it does science-- there is no study or data which would have been particularly useful to the Board in helping to determine exactly what the effect of their changes would be. Such effects can only be determined or measured with any degree of accuracy after the administration of an examination that incorporated the changes. Following the administration of such an examination, it is possible to perform a statistical analysis of all questions used on the examination and to eliminate or give credit for any questions which are shown by statistical analysis to be invalid or unreliable. This is precisely the process that is used by Block in the validation of their examinations and is an accepted testing procedure. It would have served no useful purpose to have conducted a trial run of an examination using licensed certified electrical contractors as a test group for the new examination format. First, it would be virtually impossible to try to put together an accurate cross-section of certified electrical contractors to use as a test group. Second, one would expect them all to pass the examination, so when they did so nothing of value would have been learned. Finally, the administration of such a trial run would risk the possibility of compromising examination question security. One aspect of accepted methodology for the preparation of standardized examinations is the definition of the content domain of the examination, i.e., a determination of what knowledge is essential to demonstrate that the candidates for licensure are minimally competent. This aspect of examination preparation is often accomplished by performing a formal job analysis, which is, in essence, a study of all of the usual tasks performed by a person engaged in the occupation or profession to be tested, including an evaluation of the relative importance of each of those tasks to minimum competence. The content domain can also be defined on the basis of the judgment of a group of experts in the occupation or profession to be tested. With the exception of the lay members who were added in recent years, all of the members of the Electrical Contractors' Licensing Board are, and have been, persons certified to engage in electrical contracting in the state of Florida and actively engaged in the electrical contracting business. Therefore, at all relevant times all of the professional members of the Board had extensive personal knowledge of what was involved in the practice of electrical contracting, which personal knowledge was as useful in defining content domain as would have been a formal job analysis. (In this regard it is important to note that even with the addition of lay members to the Board in recent years, the experienced professional members have continued to constitute a substantial majority of the Board.) Findings regarding Rule 21GG-6.0 of the Electrical Contractors' Licensing Board Rule 21GG-6.03 of the Electrical Contractors' Licensing Board reads as follows: An examinee is entitled to review his examination questions, answers, papers, grades and grading key used in the certification examination; however, no applicant may copy any materials provided for his review. Such review shall be conducted during regular business hours, in the presence of a representative of the Board at the Board's official headquarters. If, following the review of his exami- nation, an examinee believes that an error was made in the grading of his examination, or in the evaluation of his answers, he may request the Board to review his examination. Requests for Board review must be in writing, state with specificity the reason why review is requested, and be received within thirty (30) days after the examinee received notice that he failed the examination. (3) Upon receipt of a request for Board review, the examination shall be reviewed by the Board at the next regularly scheduled Board meeting. If it is found that an error was made, the grade received by the examinee may be adjusted to reflect the correction. The examinee shall be notified of the final decision. The Petitioners' only challenge to Rule 21GG-6.03 is predicated upon their concern that it may be misapplied to them by the Board. Findings regarding Rule 21-11.11(3) of the Department of Professional Regulation as it existed prior to the October 1982 amendments Prior to the October 1982 amendments, Rule 21-11.11(3) of the Department of Professional Regulation read as follows: (3) Examination grade reviews shall be conducted at a site designated by the Department. The candidate and his/her attorney or other qualified representative shall be allowed to attend the examination grade review. A candidate may attend only one review per examination administration. The above quoted version of the rule was in effect at the time of the Petitioners' reviews of their January and July 1982 examinations. Findings regarding Rule 21-11.11(3) of the Department of Professional Regulation, as amended in October of 198 Rule 21-11.11(3) of the Department of Professional Regulation, as amended in October of 1982, reads as follows, in pertinent part: A candidate taking a Department exam- nation may request and receive an appointment for review until such times as the exam- ination records are destroyed in accordance with Chapters 455, 119 and 267, Florida Statutes. However, unless otherwise provided by a rule of the appropriate Board within the Department, candidates may review their exam- ination for the purpose of filing objections to the examination for the Board's consideration under the following conditions and time frame: Within thirty (30) days of the date of the grade notification letter the candidate shall notify the Department of his/her desir to review the examination for the purpose of filing objections for consideration. Such review shall have been completed within the next thirty (30) days after the first thirty (30) days defined in (a) above. At the examination review, the candi- date shall be permitted to record on forms provided by the Department any and all objections to the examination the candidate desires the appropriate Board to review. Such forms shall remain in the custody of the Office of Examination Services for presen- tation to the appropriate Board at the next available Board meeting as an official agenda item. The candidate shall not copy" questions from the test booklet. The candidate may write on a separate paper in the presence of the Office of Examination Services employee, any objection or question he/she has to the written examination. The candidate shall leave the written objections and questions with the Office of Examination Services employee when he/she leaves the review room but she/she shall be permitted to leave with a form listing the question numbers he/she finds to be controversial. In the instance of a written exami- nation, all objections will be presented to the appropriate Board for consideration. Upon completion of the Board's review of written examination items the Department shall notify the reviewing candidate of the Board's decision. If the Board does not concur with the candidate's objections then the candidate will be notified in writing of this and the thirty (30) day appeal time per- iod shall begin to run from the date of this notice. Findings regarding Rule 21- 11.11(13) of the Department of Professional Regulation (later renumbered as Rule 21-11.11(3)(1)j Rule 21-11.11(13) of the Department of Professional Regulation, which was later renumbered as Rule 21-11.11(3)(1), reads as follows: If the consultant finds that the original grade was not rendered in accordance with the grading criteria, then he/she twill regrade that portion, or the entire examination, whichever is appropriate, pursuant to appli- cable statutes and rules. If it is not possible to regrade the examination, the candidate will be allowed to retake the examination at no charge. It is clear from the text of Rule 21-11.11(3)(j) that the language of Rule 21-11.11(3)(1) quoted immediately above is intended to apply only to practical examinations. It does not purport to apply to written examinations. These Petitioners took only written examinations, they have not taken any practical examinations. Findings regarding Rule 21-11.14 of the Department of Professional Regulation Rule 21-11.14 of the Department of Professional Regulation reads as follows, in pertinent part: Unless otherwise provided by a rule of the appropriate board within the Department, Security and Monitoring procedures shall be as follows: (10) Disposition of Test Booklets. Secured processing of Answer Sheets Test booklets for the state devel- oped examinations shall be disposed of and filed in accordance with the following procedure: 1. Ten copies of the examination book- lets shall be retained for ninety (90) days. This procedure shall insure that there are adequate copies of the booklets available for the board to review in their review of preliminary analysis of the examination and review sessions if review responsibilities are retained by the board. After the above defined ninety (90) day period the retention schedule shall change from ten copies to four copies. In the event any irregularity occurs during the examination with any state developed booklet, it shall be the examination supervisor's responsibility to prepare a detailed report of such irregularity and to retain the booklet in question in the secured files for a period of ninety (90) days. Destruction of examination booklets and related materials described in B.2.b., above: When in accordance with procedure, it is appropriate to destroy test booklets, it shall be the Archives's responsibility to schedule such destruction. In all instances there shall be evidenced in writing by the examination supervisor and a witness on a form which shall evidence the date of destruction and the official in charge of such destruction and a witness. When examination booklets are being prepared by the Department of Professional Regulation prior to an examination, the booklets are carefully inspected to make sure that all of the booklets are identical. Following that inspection the booklets are sealed and stored in a secure place in order to insure, among other things, that no changes are made to any of the examination booklets before they are handed out to the candidates. After an examination is given, the Department of Professional Regulation retrieves all of the examination booklets, including all booklets that were used by all of the candidates, and retains them in a secure place until the excess booklets can be destroyed. The examination supervisor selects the booklets which are to be retained from among the booklets that were not handed out to the candidates at the examination. In the normal course of events all of the examination booklets that were actually handled by the candidates at the examination are destroyed within a very few months of the date of the examination. With the exception of the examination booklet of one other candidate (which exception is not relevant to the disposition of this rule challenge proceeding), all of the examination booklets which were handed out to candidates during the examinations taken by these two Petitioners were destroyed approximately 90 days after each of the examinations. When such destruction took place, the Department retained copies of the examination booklets which had not been used by any candidate, which copies were identical to the copies that had been handed out to the candidates during the examination. As part of the examination instructions, all candidates for examination are advised not toe write anything in their examination booklets because all of the booklets used by the candidates will be shredded. They are specifically told to do all of their computations on sheets of work paper that are provided to them at the examination. All candidates are specifically told that the only things they turn in that will be saved are their answer sheets and their sheets of work paper. Findings regarding "unwritten" and "unpublished" rules of the Electrical Contractors' Licensing Board. The findings of fact immediately below relate to the eight "unwritten" and "unpublished" alleged rules of the Electrical Contractors' Licensing Board which are described in subparagraphs (F), (O), (P), (V), (X), (Y), (Z), and (FF) at pages 1 through 5 of the Petition. (The descriptions of these alleged rules are quoted at pages 2 through 6 of this Final Order.) One of these "unpublished" rules is alleged to be a rule to the effect that the Board requires more than minimum competency in order for a candidate to receive state certification and licensure as an electrical contractor. The other seven "unwritten" or "unpublished" rules of the Electrical Contractors' Licensing Board alleged in the Petition are all related in one way or another to the Board's alleged free form actions in the course of its review of the two examinations which have been challenged by these Petitioners in related proceedings under Section 120.57(1), Florida Statutes. None of the evidence regarding these matters proved the existence of an agency statement of general applicability purporting in and of itself to have the direct and consistent effect of law. For reasons which are explained in the Conclusions of Law portion of this Final Order, the evidence is insufficient to establish that the Electrical Contractors' Licensing Board has any "unwritten" or unpublished5? rules such as those described in subparagraphs (F), (O), (P), (V), (X), (Y), (Z), and (FF) of the Petition. 6/ Findings regarding "unwritten" and "unpublished" rules of the Department of Professional Regulation The findings of fact immediately below relate to the six "unwritten" and "unpublished" alleged rules of the Department of Professional Regulation which are described in subparagraphs (G), (J), (1), (L), (Q), and (R) at pages 1 through 5 of the Petition. The descriptions of these alleged rules are quoted at pages 2 through 6 of this Final Order.) These six "unwritten" or "unpublished" alleged rules of the Department of Professional Regulation are all related in one way or another to actions of functionaries of the Department in the course of performing the Department's role in the administration and review of the two examinations which have been challenged by these Petitioners in related proceedings under Section 120.57(1), Florida Statutes. None of the evidence regarding these matters proved the existence of an agency statement of general applicability purporting in and of itself to have the direct and consistent effect of law. For reasons which are explained in the Conclusions of Law portion of this Final Order, the evidence is insufficient to establish that the Department of Professional Regulation has any "unwritten" or "unpublished" rules such as those described in subparagraphs (G),(J), (I), (L), (Q), and (R).7 Findings regarding "unwritten" and "unpublished" rules of both the E1Electrical -Contractors' Licensing Board and the Department of Professional Regulation The findings of fact immediately below relate to the ten "unwritten" and "unpublished" alleged rules of both the Electrical Contractors' Licensing Board and the Department of Professional Regulation which are described in subparagraphs (M), (N), (S), (T), (U), (AA), (BB), (CC), (DD), and (EE) at pages 1 through 5 of the Petition. (The descriptions of these alleged rules are quoted at pages 2 through 6 of this Final Order.) These ten "unwritten" or "unpublished" alleged rules of both the Electrical Contractors' Licensing Board and the Department of Professional Regulation are all related in one way or another to actions allegedly taken by the Board and the Department in the performance of their respective functions related to the administration and review of the two examinations which have been challenged by these Petitioners in related proceedings under Section 120.57(1), Florida Statutes. None of the evidence regarding these matters proved the existence of an agency statement of general applicability purporting in and of itself to have the direct and consistent effect of law. For reasons which are explained in the Conclusions of Law portion of this Final Order, the evidence is insufficient to establish that both the Electrical Contractors' Licensing Board and the Department of Professional Regulation have any "unwritten" or "unpublished" rules such as those described in subparagraphs (M), (N), (S), (T), (U), (AA), (BB), (CC), (DD), and (EE) of the Petition.8
Findings Of Fact In July, 1987, the Petitioner, John Viciguerra, took the master electrician examination given by the Department of Professional Regulation for the Electrical Contractors' Licensing Board. He received a grade of 74.5. A grade of 75 is passing. One of the questions on the examination, number B-22, worth half a point, read: The branch circuit load in amps for one 8 KW residential range, rated 110/220 is closest to--amps. a) 14 c) 29 b) 19 d) 35 The Petitioner's answer, "d," was marked incorrect. The correct answer, according to the Respondent, is "c." The Petitioner got his answer by simply applying Ohm's Law and dividing 8000 watts by 220 volts equals 36.36, or 35. The Respondent got its answer by reference to Article 220-19 of the National Electrical Code. Note 4 to Article 220-19 states: Branch-Circuit Load. It shall be permissible to compute the branch-circuit load for one range in accordance with Table 220-19. Article 220.19 states in pertinent part: Electric Ranges and Other Cooking Appliances--Dwelling Units(s). The feeder demand load for household electric ranges, wall-mounted ovens, counter-mounted cooking units, and other household cooking appliances individually rated in excess of 1 3/4 KW shall be permitted to be computed in accordance with Table 220-19. Table 220-19 says to use 80% of the rated wattage of the range. The answer, according to the Respondent, therefore is 80% of 8000 watts divided by 220 equals 29.09, or 29. The examination instructions for part B tell the examinees to choose the best answer and to use the general rule in the Code unless directed to an exception. Examination question B-22, and the answer it was seeking, fairly tests the candidate's knowledge of the Code. Essentially, the question was testing for the examinee's familiarity with the demand load factor. If the question had given the examinees more information to make this clearer, all of the examinees would have been spoon-fed the answer, making the question worthless. Similarly, if "d" is a correct answer because use of the demand factor table is just "permissible," B-22 could not test for knowledge of the Code because an examinee could always choose to "over-design" the electrical wiring for purposes of his answer by ignoring the demand factor and always using 100% of the load of the appliance even in a residential setting. In short, answer "c" is better than answer "d". 94% of the examinees who had the top quarter overall grades on the examination answered B-22 "c". Only 42% of the middle half, and only 33% of the bottom quarter, answered it "c." The only other answer selected by any of the examinees was the Petitioner's choice, "d". These statistics suggest that the examinees who best mastered the information tested by the examination in general, and the Code in particular, chose "c" as the answer to B-22. Those with less mastery of the subject matter chose the answer the Petitioner chose, "d". Question B-22 fairly, adequately and reliably tests for the examinees' knowledge of the National Electrical Code.
Recommendation Based on the foregoing Findings Of Fact and Conclusions Of Law, it is recommended that the Electrical Contractors' Licensing Board enter a final order dismissing the Petitioner's appeal and establishing his grade on the July, 1987, master electrician examination as 74.5. RECOMMENDED this 1st day of July, 1988 in Tallahassee, Florida. J. LAWRENCE JOHNSTON Hearing Officer Division of Administrative Hearings The Oakland Building 2009 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 1st day of July, 1988. COPIES FURNISHED: Michael S. Schwartzberg, Esquire 405 Central Avenue, 7th Floor St. Petersburg, Florida 33701 H. Reynolds Sampson, Esquire Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32399-0750 Pat Ard Executive Director Electrical Contractors Licensing Board Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32399-0750 William O'Neil, Esquire General Counsel Department of Professional Regulation 130 North Monroe Street Tallahassee, Florida 32399-0750
Findings Of Fact Petitioner is an experienced and successful alarm system contractor licensed in Rhode Island and Massachusetts. Petitioner sought licensure as an alarm system contractor in Florida and sat for the Alarm System II Contractor's Examination administered by Respondent in January 1992. Applicants for licensure as alarm system contractors must pass the examination to be qualified for licensure. Petitioner's final grade on the examination was 70, but the minimum passing grade was 75. Petitioner did not pass the examination and, consequently, he was denied licensure. All challenged questions were multiple choice questions and the candidates were to select the best answer from the four possible answers provided. Candidates were allowed to use approved source materials during this open book examination. Petitioner challenged Questions #1, 17, 18, 19, and 76 because the content of each question pertained to accounting. For the reasons to be discussed in the Conclusions of Law portion of this Recommended Order, Petitioner's contention that accounting questions should not be included on the examination is rejected. The answer Petitioner selected for Question #1 was not the best answer to the question. Consequently, Petitioner was properly denied credit for his response to Question #1. The answer Petitioner selected for Question #17 was not the best answer to the question. Consequently, Petitioner was properly denied credit for his response to Question #17. The answer Petitioner selected for Question 18 was the best answer for the question, and he was awarded appropriate credit for that correct answer. The answer Petitioner selected for Question #19 was not the best answer to the question. Consequently, Petitioner was properly denied credit for his response to Question #19. The answer Petitioner selected for Question 76 was the best answer for the question, and he was awarded appropriate credit for that correct answer. Petitioner challenged Question #6 contending that the question was badly worded and that there were three possible answers to the question. Petitioner selected answer "B" as his answer to the question, but argued at hearing that answers "A", "B", or "C" are also correct answers. Respondent asserts that answer "C" is the best answer to the question. Petitioner failed to establish that Question #6 was impermissibly vague or that Respondent's determination that answer "C" was the best answer to the question was devoid of logic or reason. The answer Petitioner selected for Question #6 was not the best answer to the question. Consequently, Petitioner was properly denied credit for his response to Question #6. Petitioner challenged Question #23. The answer Petitioner selected for Question #23 was not the best answer to the question. Consequently, Petitioner was properly denied credit for his response to Question #23. Petitioner challenged Question #25 on the basis that the question was a trick question and that there were three possible answers to the question. Petitioner selected answer "B" as his answer to the question, but argued at hearing that answers "A", "B", or "C" are also correct answers. Respondent asserts that answer "A" is the best answer to the question. Petitioner established that his answer to the question was as correct as the answer selected by Respondent as the best answer to the question. Consequently, Petitioner was improperly denied credit for his response to Question #25. Petitioner challenged Question #78 and argued that the source material upon which Respondent based its answer is obsolete. Petitioner chose answer "A" while Respondent asserts that answer "D" is the best answer to the question. Respondent's answer appears in "Design Applications of Security Fire Alarm Systems", a reference book to which the candidates were permitted to refer while taking the examination. While Petitioner was very critical of this reference book, he failed to establish that Respondent could not rely on the book or that the determination by Respondent that answer "D" was the best answer to the question was devoid of logic or reason. Petitioner failed to establish that Question #78 was an improper question or that he was entitled to credit for his answer to the question. At the formal hearing, Petitioner raised for the first time a challenge to Question #83, a question pertaining to the use of coaxial cable. Petitioner contends that because alarm system contractors do not routinely use coaxial cable, the question is improper and should be thrown out. Petitioner concedes that the information necessary to correctly answer the question was in the resource material to which the candidates were permitted to refer while taking the examination and that he gave the wrong answer to the question. Petitioner failed to establish that Question #83 pertained to an improper subject or that he was entitled to credit for his response to the question. Petitioner challenged Question #98. After the examination was administered, the Electrical Contractors Licensing Board rejected this question from every candidate's examination as being outside the scope of practice. Consequently, that question was not a factor in the scoring of Petitioner's examination.
Recommendation Based on the foregoing Findings of Fact and Conclusions of Law, it is RECOMMENDED that a Final Order be entered which awards Petitioner credit for his answer to Question #25, but which denies him additional credit for his answers to the other challenged questions. It is further recommended that the examination questions and Petitioner's Exhibit 6 pertaining to certain of the examination questions be sealed as confidential exhibits. DONE AND ENTERED this 19th day of January, 1993, in Tallahassee, Leon County, Florida. CLAUDE B. ARRINGTON Hearing Officer Division of Administrative Hearings The DeSoto Building 1230 Apalachee Parkway Tallahassee, Florida 32399-1550 (904) 488-9675 Filed with the Clerk of the Division of Administrative Hearings this 19th day of January, 1993. APPENDIX TO RECOMMENDED ORDER, CASE NO. 92-4924 The post-hearing submittal filed by Petitioner consists of argument and suggestions as to measures the Respondent should take to improve the examination, but does not contain proposed findings of fact that require a ruling from the undersigned. The proposed findings of fact submitted by Respondent are adopted in material part by the Recommended Order. COPIES FURNISHED: Joseph A. Trillo 800 Jeffrey Street Boca Raton, Florida 33487 Vytas J. Urba, Esquire Assistant General Counsel Department of Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0750 Daniel O'Brien, Executive Director Department Of Professional Regulation Electrical Contractors Licensing Board 1940 North Monroe Street Tallahassee, Florida 32399-0792 Jack McRay, General Counsel Department of Professional Regulation 1940 North Monroe Street Tallahassee, Florida 32399-0792
