Inside the PMP Question Writing Process
October 08, 2020
When you hear the words “PMP Exam” what springs to mind?
If you already have the credential, then probably the study period and stress associated with obtaining it. If you are thinking of taking the exam, then maybe some apprehension and anxiety. An effective way to reduce this anxiety is through learning about the exam goals and approach. Information is power, and it never hurts to be more aware of the process before taking the exam.
The Credential vs. the Exam
Obtaining the PMP credential requires more than just passing an exam. It also involves an assessment of education, project management experience and validation of project management education/training.
Discussing the relative merit of the PMP or the application process is outside the scope of this article. Anyone interested in learning more about the credential in general, is advised to see the PMI website. Instead, we will focus on PMP exam questions for those interested in taking the exam.
We will investigate how PMP exam questions are created and referenced to existing resources. Understanding the process can help anyone studying for the exam learn smarter and reduce stress – which can be a performance inhibitor.
Where do PMP Questions Come From?
The PMP exam is designed to test the application of generally accepted project management knowledge and skills. So to create valuable questions, PMI needs to understand what the generally accepted knowledge and skills in use by project managers are. This is achieved by a Role Delineation Study, a survey of practicing project managers that asks them to list the tools, techniques, knowledge and skills needed to complete their job effectively.
Based on the research and questionnaire findings of the Role Delineation Study an Exam Content Outline of approved topics is created. This filtering of possible exam topics is shown below.
Question writers (know as item writers) write questions based only on the topics in the Exam Content Outline. Additionally, each question has to be linked to two reference publications to help verify it is based on agreed practice rather than the interpretation of the item writer.
So, item writers use the Exam Content Outline as a list of topics and reference publications as the source of truth to create questions for the exam. It is worth noting that typically each of the reference publications contains coverage of topics outside of the exam content outline that will not be featured in the exam. Instead, only content that relates to the exam content outline can have questions based on it. This complete process is depicted below:
Why This is Useful
Just like running a project, understanding what is in scope and out of scope is critical for success. If a topic is not in the Exam Content Outline, you do not need to study it. It might still be useful and valuable to you as a project manager, but it will not be in the exam.
This whole selection process has been completed recently. Project management professions were surveyed about the practices and skills they use. The current PMP Exam Content Outline that describes the scope of the exam for the remainder of 2020 has been updated to a new PMP Exam Content Outline that defines the scope of the exam from 2021 onwards.
For more details about how the PMP exam is changing in 2021 see this article that explains some of the content changes and the adoption of other question types beyond Multiple Choice Questions (MCQ).
What PMP Questions Test (and What They Do Not)
The science of instructional design often references ‘Bloom’s Taxonomy’ as a framework to describe the levels of thinking and comprehension involved when learning new material. Like many established theories, it has been criticized as limited or outdated by some researchers, but it is still widely used.
Bloom’s taxonomy describes a hierarchy that starts from a base of simple recall and progresses through layers of understanding and application until people can create new approaches based on the underlying ideas.
Everybody goes through these stages as part of learning and being able to use new skills. The stages can be divided into two main categories of recall and application.
Effective exams have a combination of recall and application type questions, with a preference for the application of knowledge. An example of a question that tests recall only would be:
A communications management plan is a document that includes descriptions of:
- Project-level performance reports
- Activity-level status reports
- Stakeholder interaction requirements
- Responsibility assignments
Correct answer: C. Here we just need to recall that a communications management plan contains information about stakeholder interaction requirements. However, the PMP exam uses predominantly application-type questions that first outline a scenario and then present a question. These elevate the question from recall to application. For example:
Your team planned to complete six stories in the current iteration. But as you reach the end of the iteration, only four of them are done. What should you do?
- Return the remaining stories to the backlog for re-planning
- Ask the product owner to extend the iteration
- Work on the remaining stories when you can fit them in
- Schedule the remaining stories at the start of the next iteration
Correct answer: A. In this example, we have to first interpret the scenario by analyzing the situation, then evaluate the best response. It tests for more than just recall of facts or concepts, instead, it requires us to apply an understanding of timeboxes and backlog prioritization.
The goal of question writing is to test candidates' application of knowledge, not just recall. For this reason, most questions in the PMP exam are situational. Meaning they present a scenario and question then ask for the best response for that situation. These types of questions test a candidate at the ‘Apply’ and ‘Analyze’ levels of Bloom’s taxonomy by requiring them to use their knowledge in the setting of the scenario and make connections between topics.
It’s Not So Bad, You’ve Got This
Exams can be stressful, so it is natural to avoid thinking about them too much. However, understanding some of the design principles behind the exam can help to calm our nerves.
The exam topics come from Role Delineation Studies of real practitioners, not sadistic academics. The whole scope is defined in the Exam Content Outline and does not encompass every project management technique. Questions are based on scenarios to make sure we understand and can apply the concepts, not to confuse us with long-winded stories.
Like switching the light on to illuminate the source of a scary noise at night, more information usually reveals less for us to fear rather than the monster we had been dreading. Learning a little about the PMP exam structure explains a few factors and gives us one less thing to worry about.
[Note: For more articles from Mike Griffiths, visit his blog at www.LeadingAnswers.com. Mike first wrote this article for ProjectManagement.com here.]
Comments