Professor Peter Saville recently appeared on BBC TV to discuss the Saville Consulting Wave Psychometric Personality Assessment. The BBC’s Technology Correspondent, Rory Cellan-Jones underwent the Wave questionnaire and then received feedback from Professor Saville.

The Leadership Report discussed by Professor Saville is powered by Wave Professional Styles and based on Saville Consulting’s brand new Leadership Model. It has been validated both against theoretical leadership constructs and empirically using international workplace performance and effectiveness criterion data.

It combines styles, situations and underlying leadership potential to assess the impact of leadership on people, tasks and the growth of the organization as a whole. As it is based on the Wave model, the Leadership Report can also distinguish between motives and talents and highlights areas of potential over or under-rating.

The Leadership Report has a wide range of applications including in selection, succession planning, coaching or development and in assessing a leader’s fit to their environment.

PsyAsia International is offering a 15% discount on Saville Consulting Wave training for anybody who registers after viewing this video and before 15 December 2010. Use promotion code BBC when booking your place. The next courses will run in March 2011 in Singapore and Hong Kong. Full details at http://www.psyasia.com/saville-consulting-wave-training-module.php.

Introduction

Psychologist Vincent Wong carried out an analysis of psychometric tests in use in Singapore and across Asia.  In this analysis, more than 40 tests were reviewed which involved no less than 20 test developers.  There were several focuses in the analysis which included practical information of the tests (information such as price and practical design issues), construct of the test, report design, technical details and training requirements.

Practical Information

Pricing

There exists a wide pricing range among tests developed by different test developers. In the lower end of the continuum one test provider provides tests for free in their entire product range and a section of the chargeable report will be produced. Obviously for user to obtain useful information they have to pay for the full report and this is certainly a marketing strategy. However in the perspective of psychometric this practice serious harm the integrity of the test as anybody can get access to the tests for unlimited number of times. Therefore it can only been seen as tests for people who are interested in trying out tests, rather than being usable in organizational settings. For more protected tests, prices range from USD$10 to more than USD$120 with some of the providers charge per usage while the others charge for subscription fee as well (usually paid annually).

Design

In this analysis, several design dimensions of the test were considered and they were the split between ipsative and normative measures, the type of scales that were employed, and other practical issue like medium of test administration.

The majority of the personality assessment tools (over 80%) employ normative measures (the type of psychometric tools that compare the respondent with a group of similar others, or the norm group) while the remaining ones employ an ipsative style (the type of psychometric tools that determine the preference among different personality traits within the respondent). Two exceptional case was identified which employs a mixed style, i.e. normative plus ipsative. The reason behind the popularity of normative style might down to the fact that for tests that were designed for selection purpose normative style was the better style to go with as it actually compare the respondents with the others. On the other hand ipsative measures can provide us with better knowledge about the preference or strength within the respondents. In line with this we found that most of the ipsative tests were preference or value tests which were designed for coaching or counselling purposes, although some ipsative measures that were designed for selection purposes were also identified. For the only tests that incorporated both normative and ipsative styles, the underlying connotation of the difference between normative and ipsative scales were utilized and it represented the discrepancy between the real and ideal self of the respondents.

The type of scale used by the tests is actually a function of whether they are ipsative or normative tests. For normative test the most popular scale type used was 5-point Likert Scale (Likert Scale is the type of scale that respondents choose among several options for the one that represent their thought most). 7-point scale was also quite common and there were a few occurrences of 3-point and 9-point scales. Other than using Likert scales, a few normative tests employed true or false scale. For ipsative tests force-choice scale was employed. One of the more popular version of ipsative scales asked the respondents to pick the option that describes them the best (usually termed as ‘most like me’) as well as option that describes them the worst (usually termed as ‘least like me’). Another appearing version of ipsative scale asked the respondents to put the available options into order, although this version was very uncommon.

Most of the surveyed tests, if not all, were designed for completing on computerized environment. While some of the tests can be administered online in an unsupervised manner, there were quite a few that required supervised administration. Whereas there were few test that provided different versions for supervised and unsupervised administration. Having more than one version allowed the result to be checked in a supervised manner after the candidates had passed the unsupervised session. Paper and pencil version of the tests were usually available with similar price of the computerized version although there were a few tests that did not provide paper and pencil version.

Although all the surveyed tests were not designed to be completed in a designated time, timer was identified in one test and it served the function of checking against random or thoughtful responses.

Measured Attributes

Personality

Among the different attributes, personality was the most popular one being measured. The majority of the personality measurements were built on the Big Five model of personality identified by Costa and McCrae (1985). While some of them retained the original five factors within the tests, about half of the surveyed tests restructured the factor compositions based on the result of the factor analysis or other theoretical support, for example one test split the factor of conscientiousness into ‘Industriousness’ and ‘Methodicalness’ while another developer incorporate the five factor model with behavioural tendencies and came up with a seven factor model. Another common phenomenon observed was that under each of the five factors the primary factors (ranges from 3-5 facets, also known as facets) were also measured, and they were actually more commonly used by test developers in report generation and interpretation. This was probably because the primary factors offer more detailed information thus higher flexibility in using them. Besides the Big Five model, another very popular personality model employed by test developers was Jung’s (1920) typology of personality. For instance two of the tests were developed from this theory as their entire theoretical foundation but one employed the original categorical model while the other one developed a continuum model.  Besides building upon one theory, many tests extract personality factors from multiple personality theories and some of them measured as many as 34 personality dimensions. Example of the measured personality dimension includes ambition, initiative, concern for others, flexibility, and energy. Nearly most of the surveyed personality tests served multiple functions which included selection, training/development need analysis, counselling and other related applications such as personal development, conflict management and team building. Test developers further added the applicability of personality tests in different situations by providing multiple versions of reports alongside with a general personality profile.

Value, Motive and Preference

Another popular attributes being measured were value, motive and preference. Although these are three distinct attributes, we found it was common that test publisher combine either two or all three attributes into one test. These tests were less commonly employed in the situation of selection but more widely used in counselling and developmental scenarios, although some of them were also designed to be used in selection as well. For tests that measures value and motive, normative measures were found to be more common and ipsative measures were more common among preference tests.  Another related attribute being measured was interest and they were mainly designed to be a career development tool.

Others

Other measured attributes included measure of leadership styles, team role, behavioural tendency, Emotional Intelligence, self-efficacy, work ethic, interpersonal communication, sales orientation, customer service orientation, learning style and even work effectiveness tendency.

Report Style

Nearly all of the surveyed tests have multiple reports and they are all in narrative form alongside with a graphic representation (usually bar charts) of the measured characteristic. However there was one test that did not employ narrative style in their report at all. Graphical representations with a sentence long description for each factor were employed instead of the narrative format. 2 dimensional typology graphs and score matrix were also employed for some type of reports. Some reports made use of different colours in representing different dimensions being measured yet some others used colour to indicate extreme scores (for example green representing high scores while red representing low scores). Colour was also frequently employed for matching test scores with a standard or an established profile, with green meaning a good match and red representing a poor match.

Report Content

Generic  Personality Profile

For all the surveyed tests, there was at least some form of generic personality profile provided in the report, whether in the form of narrative writing, matrix of scores, 2 dimensional typology graphs, bar charts or broken line graphs. Most commonly the personality profile was consisted of a graphical representation of the test scores on different dimensions with a brief descriptive narrative alongside it. In this generic personality profile the test scores, usually in form of sten scores or percentile were presented. Raw scores were also found in some reports. About half of the survey tests also presented the variation of the test score in the report and a few had an explanation on the meaning behind that. In all cases primary dimensions measured by the tests were reported in this section. Secondary or higher-level composite dimensions were also frequently reported in this section.

Strengths and Limitations

Strengths and limitations were another very popular qualities being reported, although we identified a few tests that do not report them. In reporting strengths and limitations some tests referred them to very specific behavioural terms while there existed some tests simply referred high or low scores in particular dimensions as strengths or limitations. Few tests incorporated contextual factors into the reporting of strengths and limitations were identified and they were more common in purpose-specific reports (for example reports designed for leadership development or team building). Overall tests tended to present information about strengths and limitations of the candidates.

Competencies

Leadership, team work, interpersonal skills or orientation and problem solving orientation were found to be the most popular competencies being tapped. Other competencies being tackled by the surveyed tests included achievement orientation, customer service orientation, management style, decision making, planning and organization, influence and negotiation, delivery, creativity, analytic orientation, coping style and thinking style. Rather than being measured directly in the tests, these competencies were often generated from several primary dimensions of personality. They were found to be written in context of work and behavioural terms were employed heavily in order to aid comprehensibility of the report. Furthermore competency based reports were identified and leadership related reports were the one which appeared most. Competency based reports for sales and managerial positions were also popular.

Interview prompts

Interview prompts were found in some reports. These included general instruction of how to use the report correctly to enhance the effectiveness of a follow-up interview as well as specific suggested interview questions to be asked for a particular candidate. The number of interview prompts varies from three to ten plus suggested questions and some reports even included the expected answer from the candidate. These interview prompts also served as a check or back up of the validity of the tests.

Training (Development) Needs

Several tests with a separated training need or developmental report were identified. For tests that did not have a designated report for training needs, it was surprising to found that the section outlining training was absent for majority of the surveyed tests, given most of them were designed to be used in training need analysis. When present, the training needs outlined (or some tests referred it to be ‘action plans’) were usually generated from the unfit aspects identified or areas that were not up to the normative standard. Simple description about the needs per se was common and a few reports were found to be providing concrete training suggestions.

Cultural Fit

Cultural fit information was identified in a few test reports. This information could include the fit of the candidate with the organizational culture, task nature as well as co-workers and it existed in several forms. The more popular way to compute it was comparing between the candidate’s score with the norm or an ideal profile. One test generated this information by comparing the candidate with the best performers. Yet another test presented the information in light of the candidate himself by stating what culture or environment will be the best fit for the candidate.

Technical Information

Technical information of the test included normative data, reliability and validity data as well as development procedure of the test. They are the most important information to be readily accessible to the public but unfortunately some of them were virtually absent for some of the surveyed tests. Normative data were found to be the most reported information and reliability data followed. However evidence for validity as well as development procedure of the test were absent for some of the tests despite the claim of ‘scientifically validated’ in their marketing materials. For tests that did not provide any of the above mentioned information the integrity of them were seriously in doubt.

Training Requirement

Training requirement of the tests varied from no need training for an extreme case (which was the free online test) to BPS Level B plus additional training (approximately 7 days of training in total). For most of the tests 2-3 days of training for the specific test was common but this type of training would not be recognized by a different test provider. The BPS (British Psychological Society) Competence in Occupational Testing was found to be the most widely accepted qualification by the test providers. Most of the tests could be administered by a BPS Level B qualified user but there existed some tests which required a conversion training (1-2 days long) in order to be a qualified user of them.

It’s perhaps quite natural to believe that the Chinese personality is so different to others that it requires a special psychometric test to assess it. What better way to sell your new Chinese personality test than to state that it is “high time a test for the Chinese” were developed. However, this throws doubt upon the utility of rigorously developed international psychometric tests of personality.

Given the above, we embarked on a research program to assess whether Chinese people differ significantly comparied to others in terms of personality structure and whether personality tests that purport to assess Chinese Personality are able to predict any more work performance than internationally developed tests have already been proven to do!

You can read our research findings it: personality.cn, our Chinese Personality at Work Research Site.

No time to read the whole site? Here’s a quick summary:

Locally developed psychometric tests which purport to assess “indigenous” aspects of Chinese Personality were found to be less reliable than reputable internationally developed tests of personality. Furthermore, there is a big question as to whether so-called “indigenous” traits are Chinese-specific. Issues such as traditionalism or face also exist in other cultures! Moreover, the research has demonstrated that whatever we choose to believe about Chinese Personality, locally developed (Hong Kong) tests of “indigenous” personality add nothing to the prediction of performance at work that is not already accounted for by reputable internationally developed personality tests.

We present this research in a free HRM webinar which you can watch here. We held a vote at the beginning and end of our webinar whereby we asked attendees if they believed that Chinese Personality is so different that Chinese people need their own personality test. At the beginning of the webinar, the majority of the attendees said yes! By the end of the webinar only one attendee still believed this to be the case!  We recommend choosing well designed psychometric tests with high reliability and validity. Personality is a universal construct, thus locally developed tests may have little benefit to the hiring manager!

If people are differentially motivated on the basis of individual differences, this implies important practical consequences with respect to staffing decisions and the selection of the right motivational techniques for managers. In two different samples (students facing graduation vs full-time employees), the relationships between personality traits and the preference for job characteristics concerning either extrinsic (job environment) or intrinsic job features (work itself) were investigated. Two personality traits [openness to experience and core self-evaluations (CSE)] were consistently found to be positively related to the preference concerning work characteristics, and CSE showed incremental validity with regard to intrinsic work motivation factors (e.g., experienced meaningfulness, autonomy). Furthermore, age was differentially linked to those job characteristics. The results are discussed with regards to the optimal Person-Job Fit and the practical utility of the personality constructs.

The full research paper can be found here: http://www.ingentaconnect.com/content/bpl/ijsa/2010/00000018/00000001/art00003

If the claims of some HR practitioners in Asia are founded, we may need customised Personality Tests for every group out there, Singaporeans included. Is this really the case? Find out what science tells us at PsyAsia’s FREE webinar on Chinese Personality and its assessment for predicting workplace performance. Full details of the webinar can be found by clicking the graphic below:

Register for the Free HRM Webinar

Study Abstract:

This study examined fairness reactions to 10 selection methods in a sample of 240 Romanian employees. The results showed that Romanian employees rated work samples, interviews, written ability tests, and resumes as favorable, but graphology, ethnicity, and personal contacts as unfavorable. Perceived predictive validity was identified as the strongest predictor of process favorability ratings. Implications for research and practice are discussed.

Link to journal:

http://www.ingentaconnect.com/content/bpl/ijsa/2010/00000018/00000001/art00009

PsyAsia International is pleased to once again be supporting Singapore’s Human Resource professionals as a sponsor of the Singapore Human Resources Institute’s Annual Human Resource Congress.

The Singapore HR Congress and Business-Connect Exposition 2010 will address the newly derived term of HR TransmutationTM and explore the topic in deeper context.  The current economic churning has made it explicitly clear that industry is not just facing another downturn but it is accompanied by impactful structural, demographic and mindset changes across industry and top management cannot afford to respond with anything less than a complete overhaul of the system to survive and sustain. Renowned speakers and leaders from the HR fraternity will share their experiences and provide useful insights on the know-how of managing paradoxes in a turbulent world.

PsyAsia’s clients are entitled to a 35% discount on the price of conference tickets.  Please contact us in the first instance to avail of this special offer.

“A strong and capable HR community can be the catalyst and change agents to initiate and implement people development efforts in organisations, and help build stronger capabilities amongst our business leaders and managers.”

PM Lee Hsien Loong
11th World HR Congress 2006 organised by SHRI

PsyAsia International is Asia’s leading independent distributor of Psychometric Tests of Personality and Aptitude. From offices across Asia, including Singapore and Hong Kong, our psychologists assist the world’s top organisations and local governments to recruit, select, assess and retain the best employees. Our services are only offered by fully registered organisational psychologists with years of experience in their field. PsyAsia also offers world-class training in Psychometric Testing in Singapore, Malaysia, Hong Kong and Online.

The goal of this research was to study display rules and emotional suppression in an employment interview. Participants, 74 graduating university students, were told that their videotaped performance in a simulated job interview would be evaluated by personnel experts. In a post-interview questionnaire, participants were asked about the display rules influencing their behavior in the interview. They were also asked whether they had tried to suppress or hide (negative) emotions during the interview. More men than women stated that they had tried to hide or suppress their feelings; these participants were classified as (emotion) suppressors. Participants who stated that they had not tried to hide or suppress their feelings during the interview were classified as nonsuppressors. The validity of self-reported suppression was supported by the external evaluations of two judges, who observed less nonverbal expressiveness (hand to head movements) in suppressors of both sexes and less anxiety in female suppressors. Suppressors were evaluated as more competent than nonsuppressors. In women, but not in men, emotional suppression was associated with increased self-reports of depressed state in the post-interview questionnaire.

Sourced from: Latest Issue of International Journal of Selection and Assessment

In this article, the authors discuss the six studies appearing in the `Applicant Perspectives in Selection’ special issue of International Journal of Selection and Assessment and identify three overarching themes. The first involves, how applicants work to control the impressions employers have of them, highlighting how applicants are active impression managers in selection contexts. The second involves, the broad theme of the kinds of information applicants get, how they get it, and how they react to it. The third involves, how context might shape applicant reactions. The authors highlight areas of future research consistent with these themes and close with some recommendations for practice.