In order to provide the foundation for a legally defensible credentialing program, there are critical considerations that need to occur for the planning and execution of a job analysis study. What is a job analysis? Why is it necessary? Who conducts a job analysis? When is one needed?
In a recent job analysis, which simultaneously studied four certification programs, we explored the what, why, who and when.
Respecting the clear sequential link between the four jobs under study, a multilevel approach was implemented to examine the job roles together. Content validation strategies were implemented to establish links between the tasks performed by job incumbents and the content being assessed on the respective certification examinations. To that end, certified job incumbents were utilized as subject matter experts (SMEs) to assist in identifying the essential tasks performed in the four job roles being studied. The multilevel job analysis study included the following steps:
- Review of existing test specifications
- Interviews with SMEs, across the four levels of certification
- Creation and refinement of domain structures and corresponding task and knowledge statements by a Job Analysis Advisory Panel of current practitioners, across all four certification levels
- National survey of target practitioners at each certification level, through which they provided ratings of the importance and frequency of performance of job tasks
- Analysis survey responses, including review of demographic data for representativeness of the practitioner populations
- Recommendation of revised written exam blueprint for each certification level, derived from the survey data analysis results and the subsequent, informed advice of the Job Analysis Advisory Panel
This month at ATP’s Innovation in Testing conference in San Antonio, there are three main learning objectives we will provide in this session:
- Understanding of the fundamentals of job analysis, including the answers to who, what, why, and when questions.
- Awareness of issues to consider regarding various components of a job analysis study.
- Insight into one’s role in the successful planning and execution of a job analysis study.
During this session, attendees will also gain insight into how to assess a credentialing program's need for a job analysis study and initiate dialogue amongst colleagues and stakeholders regarding key job analysis components, while having the opportunity to generate and direct specific job analysis questions to the on site personnel.
If you’re interested in learning more about the What, Why, Who, and When of a job analysis, please join me and my fellow presenter – Jeremy Abbey, American Culinary Federation – for this ATP session scheduled for Monday, February 19th, from 5:30 p.m. – 7:00 p.m.
We look forward to seeing you there!
Pamela Ing Stemmer, Ph.D., is Senior Psychometrician at PSI. Contact her at pstemmer@psionline.com or by phone at 913.895.4709.
Click here for more information about PSI’s comprehensive testing solutions.
