- What is the PCOA?
- Why is the PCOA needed?
- When and where will the PCOA be administered?
- How do the colleges and schools of pharmacy register for the assessment?
- How is the PCOA scored?
- What information is provided in the score reports?
The PCOA is a 220 item multiple-choice assessment developed by the National Association of Boards of Pharmacy (NABP). The content of the PCOA follows its blueprint, which covers four content areas and 28 subtopics (see page 8 for a detailed listing). The PCOA is intended to be a valuable and integral component of the process that colleges and schools use to assess student performance in pharmacy curriculum. The data obtained from the PCOA will provide participating colleges and schools of pharmacy with detailed feedback related to the subject matter covered throughout the professional pharmacy curriculum. Data can also be used to provide information to individual students on their performance with regard to the curriculum. Because the PCOA is administered on an annual basis, resulting data are both formative and summative in measuring student progress and allow comparisons to be made to a national reference group.
The colleges and schools of pharmacy have expressed a need for an objective assessment that is psychometrically validated to assist with measuring performance. The PCOA can be administered across years of study in order to evaluate progress.The PCOA can be used:
- To measure the overall performance of pharmacy students and compare their scores to a representative national sample of students
- As a tool for faculty to provide constructive feedback on the performance of the student and to track individuals' scores from year to year and individual growth over time
- To document improvement in student performance after the college's or school's curriculum has been modified or updated
- For research and correlational studies with existing assessments such as Pharmacy College Admission Test scores, current grades, and future North American Pharmacist Licensure Examination (NAPLEX) administrations.
As a component and outcome measure of the evaluation plan suggested by the Accreditation Council for Pharmacy Education (ACPE) Standards. As such, the PCOA:
- Has formative and summative measures
- Provides for collective analyses of findings
- Evaluates trends over time
- Includes standardized instruments and data analyses
- Documents that the college or school is providing the scientific foundation necessary for achievement of the professional competencies
Starting in 2013, colleges and schools of pharmacy may choose a date within three testing windows. Thus, the college or school can choose a date in late winter, late spring, or fall. The assessment is administered on the campus of each participating college or school of pharmacy, so no additional or unusual travel is required of the students. In 2013, all colleges and schools of pharmacy may also choose either the computer-based or the paper-based PCOA.
In early fall, NABP will provide registration materials, PCOA testing policies, and proctor requirements to all the colleges and schools of pharmacy. Registration for the assessment must be returned to NABP at least 90 days prior to the start of the testing window and include a listing of the names of all students that will be taking the assessment, the assessment fees ($75 per assessment), and the designated college or school of pharmacy contact's information.
NABP uses a Rasch-based item response theory model to produce individual scores. Rigorous psychometric analyses are performed to assess model fit, item functioning, accuracy of the key, and form-level reliability. Scores are produced for the total assessment as well as for each of the content areas. Assessment forms from each annual administration are equated. As a result, scores across administrations are placed on the same measurement continuum, which permits accurate comparisons to be made between the content area scores and between the scores from one year to the next.
Two types of score reports are provided: one is customized for each individual student and another is prepared as a school-level summary report. Both types of score reports are sent to the pharmacy school. Student reports are provided to pharmacy school faculty so that they may disseminate to individual students. It is recommended that faculty meet with students to provide and discuss individual results and plan for the students' next program year. Scores are provided within four weeks of the last day of the testing window in which you take the assessment.
Student score reports include students' scale scores and their national percentile for their program year for the total assessment and for the four content areas. Additionally, the percent of items correct on the 28 subtopics is provided.
School score reports include summaries of data for the particular college or school by program year, including the number of examinees, mean school scale scores, mean school percent correct, and mean school percentile. For information about the norm based reference group, the mean national scale score and mean national percent correct scores are provided. All these scores are provided for the total assessment as well as for each of the four content areas. Also, the average percent of items correct on the 28 subtopics is included, as is the mean number of items correct for the national reference group. Finally, a score roster listing the college's or schools' students' scores (in a condensed format) is provided.
Download a Sample Score Report (PDF).