Psychometric Manager

At Palo Alto Networks everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life.

We have the vision of a world where each day is safer and more secure than the one before. These arent easy goals to accomplish - but were not here for easy. Were here for better. We are a company built on the foundation of challenging and disrupting the way things are done, and were looking for innovators who are as committed to shaping the future of cybersecurity as we are.

The education team inspires cybersecurity professionals around the world. They drive awareness, in-depth understanding, and adoption through our customers. You motivate audiences around the world through our suite of products to promote the full adoption of our services to protect digital environments. It's a meaningful career path, one that requires constant learning and evolution.

This is a remote-based position in the US. Location anywhere in the US.

Your Career

The Psychometric Manager is responsible for managing the integrity, validity and reliability of technical examinations as well as the overall health and security of all examinations. This is not limited to item performance, form equating, standard settings, beta exam releases and exam security plan and executions. This position ensures that the certification exams are industry leading and meet the highest quality standards.

The Psychometric manager works collaboratively with volunteers, external vendors and the test development team focusing on supporting the growth and evolvement of the Palo Alto Networks credentialing portfolio across the entire landscape of Palo Alto Networks technology.

You will be interacting across the enablement team and the psychometric Subject Matter Experts (SME) to maintain best-in-class credential programs across Enterprise and Cloud platforms.

Your Impact

Manage the integrity, validity and reliability of technical examinations as well as the overall health of all technical examinations but not limited to:

• Designs and conducts job analysis studies, including surveys and focus groups, and develops exam specifications.
• Designs and guides assembly of credentialing examinations to meet psychometric criteria for validity, reliability and fairness.
• Performs standard setting studies and guides SMEs in the establishment of a passing standard (cut score).
• Conducts statistical analysis of test items and assessments.
• Designs and implements pre-administration and post-administration equating and linking designs to ensure measurement equivalence of alternate forms of examinations.
• Design and develop performance-based assessments and examinations with alternative item types.
• Managing exams form development, QA and publishing team.
• Participating actively in the review of all draft test forms (Beta) for designated programs and rescoring.
• Understand expectations, meet deadlines and deliver high quality performance
• Create efficiencies in internal psychometric and security processes and initiatives.
• Create reports and present outcomes and deliverables to colleagues and stakeholders, including technical and non-technical audiences.
• Contributing to annual planning and goal-setting activities.
• Work closely with testing and psychometric vendors.
• Participates in industry testing conferences .
• Other duties as assigned.
• Approximately 25% travel.

Your Experience

• Ph.D. in Educational Measurement, Quantitative Research Methods.
• A minimum of 5 years of experience in IT test development and psychometric methods.
• Psychometrics, advanced statistical methods, research methods, measurement theory, and test development.
• Experience in providing credentialing and psychometrics technical guidance to non-technical audiences.
• Strong verbal and written communication skills.
• Proficiency with Google Suite statistical software (e.g., SPSS, SAS, or R).
• Experience with IRT measurement models and applications (e.g., Winsteps, Parscale, BILOG) strongly preferred.
• Experience with project management processes and applications strongly preferred.
• Experience with NCCA and ISO-IEC 17024 accreditation standards.

#li-JM1

Our Commitment

Were trailblazers that dream big, take risks, and challenge cybersecuritys status quo. Its simple: we cant accomplish our mission without diverse teams innovating, together.

We are committed to providing reasonable accommodations for all qualified individuals with a disability. If you require assistance or accommodation due to a disability or special need, please contact us at [email protected]

Palo Alto Networks is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.

All your information will be kept confidential according to EEO guidelines.

I'm interested