Prevent Cheating in Assessments with a ‘Psychometric Fingerprint’

The way we process information and respond in assessment tests is as individual as the ridges on our fingertips. We know this because thousands of ‘data points’ are available when someone completes an assessment. For example, their response time, the options they choose, how often they correct themselves in the test and even whether they fiddle with the mouse or move their tablet while they’re thinking. All of these individual details that candidates reveal about themselves when they complete an assessment can now be collected, compiled and interpreted to provide a ‘psychometric fingerprint’ of each of your candidates.

So as well as finding out what score someone achieved in the test – which was all you could do in the past – you can now detect ‘how’ they completed the assessment. Our research shows that the way someone undertakes a test remains remarkably stable regardless of which type of assessment they’re given.

Two benefits
Implementing assessments that track and reveal a psychometric fingerprint will provide two key benefits. Firstly, you’ll quickly be able to tell whether the same individual completed each test. Employers sometimes ask candidates to undertake an ‘authentication assessment’ prior to their appointment, to verify whether their results match the scores of the assessments used earlier in the selection process. Unfortunately, these results can be misleading. A candidate who achieves a high score on a numerical reasoning test may also score highly on a verbal reasoning and an abstract reasoning test. But some people are strong in numerical and verbal reasoning and do not score well in abstract reasoning tests. So if you’re just looking at the test results, it can be difficult to tell whether the same candidate sat all of the assessments. However, the candidate’s psychometric fingerprint – the way they’ve ‘processed’ each assessment – would clearly show you if someone else had taken any of the tests.

The second benefit is that a psychometric fingerprint can help you to identify a candidate’s potential. Let’s say that two candidates achieve the same score in an assessment, how do you choose which of them has the highest potential?

The answer emerges from a new truth about psychometric testing. Assessment providers usually assume that each test taker is seeing their test for the first time. But this isn’t true anymore. Even with randomised questions and adaptive tests – which adapt to the answers given – candidates can ‘train’ themselves to perform well in a particular test. When we repeat a test, we get better at it. There is a clear ‘training effect’. So two candidates may achieve the same score but one may have trained more to accomplish that. This creates an unlevel playing field. For example, if the ‘test’ was to run a mile, the two candidates would finish at the same time – but one may have trained for six months to achieve that, while the other may not have trained at all. Which of them has the greater potential?

A psychometric fingerprint helps you identify how much ‘training’ has been undertaken to achieve a test score. One simple indicator is how much time the candidate spends reading the instructions. If they skip the instruction sequence and go directly into the test – and achieve a good score – you can assume they’ve done that assessment before.

A whole host of next-generation assessments – from ability tests to situational judgement questionnaires – are now being built which collect the data that reveals a psychometric fingerprint. The challenge in developing these tests is to decide what data is required. A test provider can then create a combination of measurement points which will provide that information and they’ll analyse and interpret each candidate’s responses.

Psychometric fingerprints will forever change the use and the purpose of assessments. Increasingly, you’ll want to know not just what score a candidate achieved but how they went about it.