Test Design & Validation

What is it?

A key principle to keep in mind when introducing assessments to your selection and promotional procedures is to implement measures that have demonstrated validity for your specific application. In other words, evidence needs to be presented that the test is job-related and correlates to on-the-job performance. Test validation is the process of establishing job-relatedness of a test.

Validation Methods

There are 3 main methods of conducting validation studies.

Criterion-related validity: data provide evidence of a statistical relationship between test performance and important job factors. In other words, the test is predictive of important elements of work behavior. A person who scores high on the test will perform better on the job than someone who receives a low score.

Content-related validity: evidence is provided to demonstrate that the composition of the test reflects important job-related behavior. Test items directly measure important requirements and qualifications of the job such that the test mirrors behavior directly observed on the job. For example, a content-valid physical ability test for firefighters reflects the minimum strength required to perform safely and efficiently the essential tasks of a firefighter.

Construct-related validity: multiple data demonstrate that the test measures the construct or characteristic it claims to measure and that the construct is important to success on the job. This method typically pertains to assessments that measure abstract traits of an individual such as personality factors or values.

Benefits & Justification:

Validated assessments provide significant cost savings through:

• Enhanced Employee Productivity

• Improved Work Force Quality

• Reduced Manpower Needs

• Reduced Compensation Costs

• Reduced Machine Down-Time

• Reduced Training Time

Although the effectiveness of utilizing validated tests may not be evident immediately, results over a year and hundreds of applicants can be astounding. Take for example the results of a predictive criterion-related validation study (Click on link for the full study) that was conducted for a major toy manufacturer. The toy manufacturer, who conducted the study on the validated assessment battery that was developed by Applied Assessments, found that the assessment program had a significant impact on the organization's profitability.

Other Considerations :

In addition to formal test validation services Applied Assessments assists clients with critical features to implementing a successful assessment process. These elements include:

establishing cut-off scores
minimizing adverse impact
training test administrators
establishing re-test guidelines
guarding test security
computerizing assessment administration
addressing ADA disability issues

As you can see, there are a multitude of considerations when implementing an assessment program. For over 30 years Applied Assessments has conducted validation studies for clients in the US and internationally. Our clients encompass small as well as large organizations in diverse industries.

We partner with you to evaluate and select tests for your intended use or develop customized tests for your proprietary application. Our assessment systems conform to the professional and legal guidelines for establishing the validity of employment tests. Principles of content, construct and criterion-related validity will be employed as appropriate in supporting the job-relatedness of your selection process.

Related Topics

Job Analysis & Design

Assessment batteries validated by Applied Assessments have targeted:

A Preliminary Screening Tool for Managerial, Professional and Supervisory Candidates

Personality Tests: How effective are they when making selection decisions?

Remember: Technology can't succeed where Human Capital fails!