Tag: hero

  • Psyched For Business Podcast Episode 17

    Psyched For Business Podcast Episode 17

    Episode 17:
    The Psychology of Cyber Security with Bec McKeown

    Richard is joined by Bec McKeown from Mind Science, who is a chartered psychologist and Human Performance Expert.

    In this episode, we’ll learn more about cyber security and psychology plus what makes businesses more susceptible to different types cyber harm. We will also delve into cyber incident response, how data leaks can impact the reputation of a business and why aptitude and mindset are the most important factors when recruiting for cyber roles. 

    Subscribe to the podcast on your favourite platform:

    Apple Podcasts

    Spotify

    Amazon/Audible

    Pocketcasts

    Other Platforms


    Episode 17 – Transcript 

    Voiceover  0:00  
    Welcome to Psyched for Business, helping business leaders understand and apply cutting edge business psychology principles in the workplace.

    Richard Anderson  0:13  
    Hi, and welcome to another episode of Psyched for Business. I’m your host Richard Anderson. And today as always, we’re diving into the world of psychology and business. In today’s episode, I’m joined by Bec McKeown, the chartered occupational psychologist who specializes in cybersecurity. In this episode, we unravel the psychology behind cyber threats, incident response, and the essential skills needed to navigate in this dynamic field. Discover how cyber criminals exploit cognitive biases, the art of manipulation and why vulnerability isn’t just about traits, but rather how our brains process information. I really enjoyed this discussion with Bec. I hope you do too. And thanks again for listening. Bec McKeown, welcome to Psyched for Business. Thanks for joining me, how are you doing?

    Bec McKeown  1:00  
    Oh, you’re more than welcome. Thank you for asking me. Yeah, doing great. Thank you very much. Looking forward to having to chat with you. About this whole Cyber thing

    Richard Anderson  1:09  
    me too. And I have to admit, I have been extra excited about this one because genuinely and I mean this when I say it, cybersecurity and psychology are two really interesting topics that I have a broad interest in certainly, nor deep knowledge around. So I’m really looking forward to getting stuck in so I know that you’re, you’re a chartered psychologist, you’ve gone through all the BPS accreditation, you’ve been doing that for a little while now. And you’ve got a specific emphasis on the whole world of cybersecurity. I’m really interested Bec and I know the listeners will be as well. How did you get into that world?

    Bec McKeown  1:43  
    completely by accident. I think there’s any psychologist that works in cybersecurity in defense, you probably find they come across it by accident. Happy accident, but certainly wasn’t planned thing. I started off doing a degree in psychology degree with the Open University because something to do what I had a small child never thought I’d make a career of it, then found myself doing a master’s degree in Applied Psychology at Cranfield University. And the plan was to go off and do organizational change and culture type things because that’s where my interests were. Then I ended up not doing that and staying at University and working in aviation because aircraft cabin safety was sort of like well, that’s interesting. didn’t know it was a thing. So did a little bit of that. Then I ended up working a lot with the Ministry of Defense on a contract trusted research. Yeah, chasing tanks around prairies in Canada. And that led me then to working at a defense Academy in Shrivenham, which is UK military base. And I got into working on the cyber master’s program there. Okay. So Oh, okay. I’m a psychologist, what my doing cybersecurity gadgets and techie stuff. And, yeah, so it’s a bit of a meandering path,

    Richard Anderson  3:13  
    not it’s really interested in it. And what a time not to be involved in cybersecurity, I guess specifically, from a psychology perspective. I’ve told you previously, but for the listeners, I’m in the process or my company is in the process of going through the ISO 27,001 accreditation, which you’ll be very familiar with Bec and maybe we can go into that a little more detail, but it’s all about information and cybersecurity. And there are things in there that I had no clue about. And I understand the importance of psychology in that. But let’s not assume maybe that the listeners know everything about cybersecurity. And maybe let’s start with a bit of a broad overview of the terms and what do we mean Bec by cybersecurity? What does it mean, and why is it important?

    Bec McKeown  3:58  
    Yeah. I went on to the website of the National Cybersecurity Center. So that’s the UK is a place to go if you want to information on cybersecurity. And they define it is how individuals and organizations reduce the risk of a cyber attack. So broadly speaking, to stop people attacking you, well, that’s fine. However, what does that actually mean? And I think today, it’s become so important. We all do our banking online, we shop online, our emails, we have social media. And there’s a thing called IoT devices, Internet of Things. Doorbell and all of this, you know, your hive stuff that you have in your home. And I think that there’s probably underappreciated risk that having all of these gadgets has fortress. You kind of know that when you’ve got your own laptop that you need some sort of security product in it. So you buy one and you press it to have a clean up every now and again. Probably about the limit. Yeah. that was my limit, I know that bad things happen. But that was it, really. So I think that’s sort of a bit of an overview about it. But why is it so important, and there’s been some really interesting research done on categorizing cyber harms, okay. And they’re categorized into five different things, you’ve got a physical and digital harm. So physical harm. Think about if there is a cyber attack that looks and prevents people from moving goods around the country, imagine if that ordered petrol tankers couldn’t move to deliver, because of a cyber attack, we’d all be stuffed. So that’s called Digital harm. things called a denial of service attack means that they overwhelm a website and you can’t use it. So if you want to go and do your banking, and they’re being subjected to an attack, you can’t access your accounts. So that type of thing, economic you can have your money stolen, simple as that. reputational harm is a massive big one in the cybersecurity industry. I’ve recently had letters from two different pension companies to say that my details have been compromised, okay. Well, you know, so my, the dark web for any old criminal to apply for credit to my name, or whatever. And they’ve had to deal with that. So obviously, their reputation as an organization is massively damaged by that. psychological harm? Well, I’ve been made to feel quite anxious about this, because I feel quite vulnerable. Now, when I didn’t know until they told me and they’ve given us all a Experian Credit thing, you know, that you can have free year’s memberships. It happens. But that has made me feel a little bit anxious. And then you’ve got sort of social and societal harm, and you think about, we all hear about cyber attacks, you know, with Russia and Ukraine and things like that. And it always seems like it’s something going on somewhere else. But I think the NHS was subject to a cyber attack a few years back. Well, that was just the harm across the whole of our society. Yeah. So to me, I think when you start realizing that that’s the sort of impact, you start to appreciate that maybe there’s a little bit more to this cybersecurity thing than something that’s just talked about. Yeah,

    Richard Anderson  7:29  
    absolutely. I mean, that was one of the things that that I was going to ask you, but you’ve pretty much answered this affects everybody, doesn’t it? I mean, I think there was, I’d maybe had a preconception or misconception, as it turns out, that it will be big tech firms that are gathering lots of data, and maybe government agencies and these types of organizations that will be at risk most for cyber attacks. But really, it could be any type of business. And that’s pretty much what we’re seeing here, isn’t it?

    Speaker 3  7:55  
    Or any type of business or even as individuals and individuals? Yeah, you know, we sort of forget about that. And there’s generally two types of tat attacks as targeted attacks, which is the ones that you’re probably talking about there, where they’ll go after big multinational or a government. And so that’s that, then there’s untargeted attacks, which is these phishing things. And I’m sure that you’ve received links, I know, I certainly have as to oh, here’s, here’s the unpaid invoice that you asked for. You click on it, then you’ve got malware in your system. And it’s probably tracking you it might be tracking your bank details, that sort of thing. You’ve got things that are caught is called Water holing. And you get an email from allegedly from your bank that says you need to go in and change something. And then when you click on a website looks real, you have to be quite good at spotting, checking different things to check if it is real or not. So there’s all of that sort of thing that goes on. So it can be individuals, it can be companies. And you think with ransom, where attacking in a big company to get their details. And you hold that, you know, if you don’t pay me X amount of millions of pounds, I’m going to let this go. But there’s the the untargeted thing is all of that things where they’re just attacking so many people, millions of people across the globe at once. And it’s just the sheer volume of people, that certain percentage will always click on those links.

    Richard Anderson  9:21  
    Yeah, yeah. I’d love to get into that in a little more detail. Interesting, what you’re talking about there with the phishing emails, the phishing with a PH of course, and different phishing attacks. And I remember maybe five years ago when I’d got a phishing email come through and I had to wire somebody a million pounds I got a million pounds in the first place, of course, wire somebody a million pounds or whatever would happen and it was really easy to spot but Bec, let’s be honest, these are getting better now. They’re getting better and better. And even this weekend, or it was Monday morning, I had a colleague said to me, Rich did you send me an email over the weekend, asking me to do something that’s said no, not at all. And the colleague and it said Richard Anderson on the email founder of Evolve Assess. And obviously, it didn’t have my email address and probably didn’t, didn’t look anywhere. But that’s that’s some of the things that we need to to educate people around, isn’t it? Because

    Bec McKeown  10:15  
    much, much better. Yeah. It’s long, long gone are the days of some African king who’s got some money that if you were wise to that one, recently popular one has been within organizations that somebody will get an email from the managing director or the founder. Yeah, like yourself and say, can you release these funds for me? So if you’re in finance department and your MD, asked you to release some funds, chances are you might do it? Absolutely. That type of thing. And the other thing to think about with that is that they’re starting to use social engineering now as well. Now, I find that as a psychologist utterly fascinating. But when are people at their most vulnerable? And when I say vulnerable, I don’t mean that necessarily in the true meaning of the word. But what are you doing on a Friday afternoon at work? When it’s a long bank holiday, or you you know, the Christmas holidays are coming at you finish enough? You want to get out early, your mind already left the office and on to Christmas shopping? Or whatever it is you do? So you find that sort of Friday of a bank holiday, that’s when there’s more likely to something to happen? Because they know people have lowered their guard because of the time. Isn’t all of that sort of thing.

    Richard Anderson  11:30  
    Yeah, of course, 

    Bec McKeown  11:31  
    Very much started to become part of it now.

    Richard Anderson  11:34  
    Yeah, absolutely. I think. So there’s obviously a few different ways of looking at susceptibility, I guess, would be the word to a cyber attack, whether that’s an individual, whether it’s a business, whether it’s an individual within the business, presumably, I know that there’s a there’s a couple of different components that you look up there, I guess. One is how we how we maybe prevent a cyber attack from occurring within a business. And presumably there’s tips and tricks and things that we can do within that. And I guess the second component is, if a cyber attack or a cyber risk has occurred, then how do we respond? And how do we react in that in that situation. But if we look to maybe dissect those, those two things, so I made a few assumptions there. But I’m guessing that might be the way that we behave, or the our kind of personality, our psychological makeup that makes us more vulnerable or more susceptible to, to clicking on a phishing email or kind of thinking out loud here, what what do you find typically in organizations is

    Bec McKeown  12:38  
    I think it’s more really not necessarily about personality traits, and all of that sort of thing, because a lot of cybersecurity people say, Well, you know, is there a side? Yeah, what’s the risk of somebody? Can we get them to take a test so we can know what their risk is. And I think that attribute in somebody as a risk based on their personality characteristics is, there’s a whole amount of stuff around that that’s just quite wrong. Okay, it’s more about understanding how the brain works. Because it’s a limited capacity information processor. So it’s all sorts of things. It’s a cognitive biases and heuristics, which your audience will know what I’m talking about, basically, shortcuts that the brain takes. So it doesn’t notice certain things that’s going on. If you’re being very busy, you’ll do something more quickly. And you won’t take as much notice, if it’s something you familiar with, you won’t necessarily look at the detail. So for example, if you’re driving through your local village or town, you won’t look at the road signs, they’ve always been there. Yeah, just ignore, you don’t need to know they’re there anymore. When you go somewhere new, you’re more likely to notice them, because you’re looking at them for cues of where to go and all that. So it’s all about understanding how that works. And then how you can use those things to sort of slip in when people are unaware. And that’s why I said when I mean vulnerable, that’s probably what I mean, rather than vulnerable is they’re just busy doing something else. But then you’ve got the influence side to it. So persuasion techniques. So what language do they use when they’re sending these emails? Because people will, if it’s urgent, and they perceive it to be a problem that needs sorting, they’re more likely to just jump in and sort it rather than think carefully. So I think one of the things that we see quite often in terms of guarding against this, if somebody’s pushing you to do something quickly, that in itself is a cue that you need to perhaps think a little bit more carefully about what’s going on. Yeah. So how to manipulate people really, isn’t it? Yeah.

    Richard Anderson  14:37  
    So this is about being very much being aware. And again, that’s a misconception that I have, because I I probably bought into the whole idea of risk. In truth. I just assume that would be the case that some of us are maybe more risk prone than others. But as you said, there’s probably a whole other conversation around that side of things. Yeah.

    Bec McKeown  14:56  
    I mean, there’s a thing called insider risk. Okay, this Again, if think is of interest to psychologists, when you’re looking at the culture of an organization, you’ve got a lot of people that are very unhappy. They’re not, you know, the insider threat is people doing things on purpose. So well be that they’ve you know you might have a developer who’s developed some code and left a back door open, knowing that it could be easily abused, because they’re about to leave because the company has treated them badly. It’s all sorts of things that go on, so does the insider threat thing. But most of it is really about people making mistakes. And we all make mistakes, because we do. So. Yeah,

    Richard Anderson  15:38  
    It’s about is it about preventing mistakes? Is it about how we deal with the mistakes? How we learn from those?

    Bec McKeown  15:45  
    Yeah, definitely. I think there’s very much been in cybersecurity a thing where sort of the person is the weakest link? Yeah, it’s always that machinery will stop attacks. It’s always the people that let them in. But then you think about that, is that how do people feel about that? You are the weakest link, you’re hopeless? Well, you know, it’s not my job. I’m not IT. You know, so there’s all of that sort of thing going on as well, because people might be the weak link, but if they’re a weak link it’s because they don’t understand. They don’t know. And there’s a lot of assumptions that everybody knows that cybersecurity is not just the IT department Well, I didn’t know that until I started working on it. I will be honest, when I’ve done my mandatory training in organizations that I’ve worked in health and safety, manual handling cybersecurity, what am I doing when I’m doing that mandatory training? I’ve had another nagging email from my manager, I’ve got loads of stuff to do. I’m not really interested in this. I’m going to get through it as quickly as I can tick the boxes, get a pass mark, move on completely forget everything that I’ve learned. Yeah, a session? You know, I think that that that sort of part of it as well.

    Richard Anderson  16:58  
    It is. And I guess while we’re on that topic of learning, I guess it was one of the just to kind of go back to what I said right at the beginning. So the ISO 27,001 certification that we’re going through at the minute, I guess it’s the incorrect me back where I’m wrong here. But it’s it kind of industry standard kind of recognition for adhering to the correct regulations, rules around things like information security, of which obviously, cybersecurity kind of falls under that. And we’re a small business Bec when when we’ve got seven staff. But we’ve wanted to do this for a long time, because many of the clients who we work with, they’re bigger organizations, they take these things very, very seriously as of course, we all should. And as part of tech, either tender processes or procurement processes, I had to fill in reams of documentation, all the potential of this standard, and then it got to the point where it was okay, well, we’ll just go through it. So one of the things that I’m trying to do with the team is to change the culture and kind of educate people across the entire team and make sure that people are taking this seriously rather than a tick box exercise. But one of the things that I struggle with a little bit too in one of the packs that we’ve got is a PowerPoint slide deck where you just walk through and explain it to people. And know that that’s not going to go in, you know, if I if I’m just stood there talking through a PowerPoint slide deck. So what’s your stance on the education piece, and I guess the change and the, you know, the cultural change, I’ve got a small business, you work with lots of much bigger organizations. But I would imagine that’s quite a challenge.

    Bec McKeown  18:36  
    So it’s very much a challenge. And it’s very much acknowledged within the industry that recognition that awareness training doesn’t work. Yeah, there is no direct link between awareness and changing behavior. It’s moderated by seven year, lots of different things. I think it’s the theory of planned behavior, and reasoned action. So for the psychotherapists out there will, hopefully. But what it is, is basically is that just because you’re aware of something doesn’t mean it’s gonna change your behavior, and you’ve got to care about it. To make somebody care about it in amongst all of the other things that they have to care about, is the massive problem. One of the things that we say is that your average slide deck probably isn’t going to cut it. It’s about making it a bit more personal. And it is a lot easier for somebody like yourself, the seven of you know these people well. And they’re probably quite invested in the business in a way that you’re not when you’re working for multiple 1000s. For me, it’s it’s about thinking about like the Internet of Things thing I talked about a little bit earlier, when you start to realize that it can hit you at home. I think some of the good training that I’ve seen is and when it’s how do you explain to my elderly parents so they don’t? Yeah, you know, fall victim to one of these things. So that sort of made me take a little bit more notice because it’s something I care about is my parents welfare. So that was one thing. People like to have gamification, so they want, you know, they want badges for completing levels, they want a leaderboard and all of that sort of thing. So that works for other people. And I think there’s also the thing about having training that’s relevant to you. Because when I worked at the university, I had to do manual handling training. I didn’t manually handle anything heavier than a book, you know. It was just a complete and utter waste.

    Richard Anderson  19:48  
    Tick-Box exercise. Exactly. Yeah, yeah.

    Bec McKeown  20:35  
    So what position in the company does somebody have, what level of knowledge do they need to have, and don’t overwhelm them, don’t just give everybody that’s the quickest way to lose an audience. And more recently, I was working for immersive labs, and they have a crisis simulator. And we’ve started to look at using that. So people who are either in a working in finance or on reception, or in a warehouse, so wouldn’t necessarily be involved in anything cyber, would actually do one of these crisis stimulators and start to realize, now if you’re there, and you’re suddenly responsible, so you’ve had this cyber attack, you’ve got your customers complaining, you’ve got your IT department and wanting to shut everything down. Yeah, we’ve got the money thing direct, say, No, don’t shut everything down, we’ve got our reputation our customers still need, then you’ve got some tweets going out on Twitter. So you’ve started to get in, you know, incoming calls from national press and things like when you put people into that position, and they start to see a slightly different side to it, they take a whole lot more notice, now, it’s not realistic for them, then they’re gonna have to make a decision about how to deal with, you know, PR and all of that sort of thing. But I think that it just grabs attention in such a way and makes you think about things that’s going to sit better with you. And from doing that exercise, you then might take a little bit more notice of the bog standard awareness thing, because you’ve had this. I mean, they’re great fun to do takes about an hour, but the conversations that go on in the room, and you know, it’s not, it’s a safe space, you know, you’re not really under any threat, but it just, it surfaces, all sorts of things. So there’s lots of different ways of doing it. And I think it’s being aware of you can’t make people be interested in everything. So give them a basic level of that.

    Richard Anderson  22:30  
    Yeah, because that’s the biggest challenge. But that’s, that’s really, really interesting stuff. And it’s definitely something that I need to consider as well. Because even even with seven stuff, although you’ve said, Yeah, it’ll be a lot easier to get to a seven than a big organization, there are things within those seven people that I could cover that aren’t going to be relevant, to each one of those seven people, I need to keep it interesting. I think that’s the, that’s the key there. So make one of the, I guess the expressions or topics that we hear about very often within the whole world of cybersecurity is incident response, or Incident Response Management and I know that you do a lot of work in that particular area. I guess we’re gonna, we’re gonna assume it means how you respond to a cyber incident. But I’d be keen for you to go into a little more detail on that. What what kinds of things do you see in organizations when there is an incident? And how do people typically go about responding to those incidents? 

    Bec McKeown  23:28  
    Yeah, I worked mostly with enterprise organizations. So they’re large, they tend to have really big ones have dedicated cyber response teams. Yeah, you’ll be pleased to know there is an ISO for crisis management response, Yeah, so what you find is, is there is there is a lot of guidance on how to spot the attack what to do when it comes in. It’s called a playbook. So what do you do when you realize somebody comes up to us as a, hey, there’s something going on in our network, we need to just check that it is actually something going on, because you can’t have you know, an almighty response to something that’s nothing. So that sort of initial early stages of that, of identifying what’s going on, and then it’s sort of trying to work out the impact it’s going to have and then that’s when it gets escalated it to match your response level. Yeah, yeah. And there is a playbook about who needs to be involved. And what you tend to find is that you have a crisis response team. It’s either that’s what they do, or you have people from within the organization who form a team when it’s necessary. You’d have people from the IT department, the legal department, the HR department, marketing and PR. Yeah, because they’ve all got a part to play. That’s great to a certain extent, because when something happens, you know what you’re going to do and you’ve rehearsed it, hopefully, hopefully, fingers crossed. But then what that doesn’t take into account and this is the sort of work that I’ve been doing, is that people’s individual reactions to it. Yeah, cool. The adrenaline starts flowing because you suddenly realize something bad’s happening within the organization, reputational damage all of that stuff I’ve talked about earlier. So then what happens then is well, when adrenaline’s flowing, the rational thinking goes down, there’s deep learning goes up. So then you start to have what’s called cognitive narrowing. So your brain is now focusing on the immediate threat. It’s not necessarily taking in all of the information that you need to understand exactly what’s going on. You’re going to have knee jerk reactions that aren’t thought through. This is where it can massively go wrong, where you can deny something’s happening, and then the media find out that it happened, and then you look bad because you lied in the first place. It’s all sorts of chaos ensues, basically. And the research that I did when I was at Cranfield University was on what sort of skills do you need to deal with that? Is thing called a VUCA. Environment is volatile, uncertain, complex and ambiguous.

    Richard Anderson  26:15  
    That’s the environment when there’s been when you’re under threat,

    Bec McKeown  26:18  
    and that from military research that I’m interested in, but it translates so well into cybersecurity, which is why down that path relief, because you don’t know what’s happening, it’s all very happening very quick, you have to make decisions with high cost, high stakes consequences, based on not very much information. So the incomplete you can’t be sure of it, you don’t know if you’re gonna, you know, make the right decision. Wicked problems, I don’t know if that’s a wicked problem, basically, because whatever you do in one area is going to have a negative impact on another. And this sort of, there’s a thing called cognitive agility, which is a set of thinking skills that help you stop, take a breath and start to be creative in your thinking about do are we sure this is where this information is coming from? Do we know what we’re gonna do? Are we making the right decision?

    Richard Anderson  27:11  
    So that’s that’s the education piece around the cognitive agility that despite the fact that the adrenaline’s flowing, the fight or flight response to catastrophizing, it’s about taking a step back.

    Bec McKeown  27:22  
    And then sort of testing your thinking. 

    Richard Anderson  27:25  
    Because the automatic reaction for the same for the majority of people, but especially if reputational damage is on the line, that’s going to be what you know, it’s going to be that fight or flight response here.

    Bec McKeown  27:35  
    Fight flight or freeze, some people just

    Richard Anderson  27:38  
    Freeze, yeah, freeze what do I do Yeah.

    Bec McKeown  27:41  
    Although Yeah, jumping to doing something they think is best without thinking it through. So how to counter that. But the other thing you find that I find interesting is, is that when you see these product management teams in action, it’s about relationships, because you’ve got lots of different people from lots of different parts of the organization, that don’t necessarily work together. And they’ve all got different priorities. Those in charge of the system want to shut it down. Because as soon as that system shut down, you can manage things. Like say somebody from the operation side, or the business side is not going to want to shut down because a bank, maybe student wants customers to be able to access their funds to carry out transactions. The big bank might be responsible for salaries of 1000s, millions of people, you know what, they get paid on time. And then like I say, you’ve got the PR people, you’ve got HR saying, well, actually, we can’t blame, you know, the junior down in accounts because they pressed the wrong button. So there’s a whole bunch of stuff going on. But because each of those people have a different priority, don’t necessarily understand how that fits in there. See the big picture? You tend to get a lot of friction. Yeah, I can imagine. Yeah. So you’ve got friction with that, then you’ve got the friction because some people just don’t get on. And then you’ve got people who are some people are very happy with making decisions in uncertainty. Other people won’t move until they’ve collected more information that in itself can cause friction in the decision making and mean that nothing happens because you’re too busy arguing, yeah, who’s right, who works, what and how to move. So there’s a whole bunch of relationship and team stuff going on there as well. And that is what makes it all so fascinating, really is how on earth do you deal with all of that? Yeah,

    Richard Anderson  29:33  
    I was just I was just about to ask because I can imagine that that somebody there who needs much more information to gather before they’re happy to make a decision, and then somebody who’s a little bit more gung ho for want of a better expression that just wants to get it done. That’s gonna cause tension, but it causes friction. So do you either yourself Bec or the the organizations that you work with for these types of scenarios, big incidents? Do you have like a, like a rehearsal? I can’t think of the word that it would be just to see how the dynamic of the different individuals and the different teams would, would work. So it’s to see where the where the issues are, or whatever is that something that you often do?

    Bec McKeown  30:14  
    the often do they have a lot of people with tabletop exercise, which is exactly that is all from it. Yeah. Great things to do, because it’s very involved. Every he needs to be involved is involved, but they’re very massively resource intensive. So they probably only do them once a year. If that, yeah. That’s a problem, because it’s very much focused on the process. I’m not seeing a huge amount of people focus on the when we do an after action review, like military people do, what else what was supposed to happen, what actually happened and why it either becomes very much a blame game, or you didn’t do your pet, and we did our bit sort of thing, that’s not helpful. So again, that’s sort of about building the right sort of culture. But I think that what I try and do is to encourage people to look at the behavioral side of things and to get people to engage with it. Because if you can learn from it that, you know, this particular group of people have one mindset, this other group have another mindset. And it was those sorts of things that caused the friction, you can then while you’re doing this training, you can have those conversations in slow time where the adrenaline is not flowing, then you can sort out we’re actually if we were in this situation, we would pay a ransom, we wouldn’t pay ransom, you know, those sorts of questions. Because the last thing you need when you’re in that situation is to be having difficult conversations, if you already know the answers to the obvious things. Having those conversations in the safe time will build up those relationships. So they’re a bit more strong when they actually sit in a real real life event.

    Richard Anderson  31:56  
    Interesting. And how much does resilience play a part in this as a skill? I guess is that is that a big thing, resilience in these types of scenarios? Does it tie into The cognitive agility component,

    Bec McKeown  32:13  
    Resilience is a massive buzzword at the minute you see all over LinkedIn, everybody’s talking. Yeah,

    Richard Anderson  32:17  
    that’s why I said it, I was trying to impress you.

    Bec McKeown  32:21  
    Resilience scores and all that sort of thing. And resilience is made up of lots of different things. So in cybersecurity, you’ve got resilient technology, people and processes. So those three things are capability. And the focus in cybersecurity very much is processes and technology, we forget about the people side of things. Resilience, you’ve got to have resilient teams and things I’ve just been talking about. There’s a bond team that even if they’re very different, which is great, because you need that diversity of thought. But they’re more resilient, because they’re a high performing team. And you’ve built that team to be that way. And then you’ve got individual resilience. And the last piece of research I was looking at suggested, I think it was Robertson Cooper, and they suggest that they’re sort of, you’re more resilient if you’re part of a team because you’ve got that social support, so you’re not on your own. If you’ve got the mindset whereby you can look at things that go wrong in a positive light, see what you can learn from them. So the Robertson Cooper model of resilience is structured around four different key components of resilience. So you’ve got social support, which is being part of a team and knowing that you’re not going to deal with it on your own confidence. So the confidence to know that actually, you can deal with this sort of thing. adaptability to learn from your mistakes, and to use that learning in other situations. And again, I think that’s very much linked to confidence, and then also a purposefulness. So it’s really about understanding where you are in your learning journey. So you kind of there’s some sense of purpose that you’ve got for everything that you’re trying to learn. Okay, it makes sense.

    Richard Anderson  34:09  
    Yeah, absolutely. Absolutely. It is genuinely really interesting stuff. One of the things that I’m that I’m, I’m keen to learn a little bit more about, and I think your audience will be as well as when it comes to to the recruitment, or the selection of individuals that you choose to have within your organization, especially when it comes to cyber security. I assume Is it is it something that we need to recruit based on certification levels of experience, those sorts of things? What what’s your what’s your take on on the selection and the recruitment? 

    Bec McKeown  34:48  
    Yeah that’s a really good question. Because again, that’s a massive hot topic in cybersecurity at the moment. Yeah. Because I think there’s recognition of how the Harvard experience is when things how many certifications is another Thing. But just because you’ve got a certificate doesn’t make you good job, tick box. And again, isn’t that really awesome? So there’s a move now towards, particularly the technical side of things towards aptitude. So if you have aptitude and mindset that you’re curious, open minded, you enjoy challenge, you know quite tenacious. And you’ve got an interest in cybersecurity, you can be trained, because you’ve got all of those key aptitudes. So I think there’s quite a gap in the market really, in terms of assessment for starting to build those sorts of aptitude tests they’re interested in. And I certainly know that government departments are very interested in that sort of thing and making some strides in that direction. But I think that it’s quite a good time for anybody involved in assessment really to sort of do that research and find out what it is about. And the other thing that I found is I think is a gap is competency frameworks. frameworks that deal with different things that you can do the technical person in cybersecurity fairy, I haven’t been able to find a single framework that deals with the more competency side, the soft skill side, and people don’t like using the word soft skills. Yeah. But those, you know, the leadership, the cognitive agility, the relationship skills, the decision making, problem solving, all of that sort of thing. I haven’t found a single competency framework that sits within cybersecurity for that. And that’s driving me absolutely nuts. I think there’s certain you can transfer across. But nobody has seemed to have come up with a particular one for cybersecurity. The ISO that I mentioned, I think is the only thing that I’ve seen that go somewhere towards that. And it’s more of a framework of skills. It’s not a competency framework. Yeah, I think there’s a lot that psychology has to offer.

    Richard Anderson  36:54  
    Yeah, so new competency frameworks, potentially new ways of assessing people for these particular roles. Because it’s such a big thing at the minute, but you know, in general, you know, what’s ubiquitous, there’s this whole kind of notion of cybersecurity and the importance of this is massive, so we can’t select and assess and recruit against it. And there’s a problem isn’t the so yes. And there’s some really interesting things there. But, but but Bec I mean, I’ve really, really enjoyed this this conversation, a company we’ve been talking for so long already. I’m really keen for you to if any of the audience’s is interested in having a further discussion with you about any of the aspects of what we talked about. Are you happy for us to put your your LinkedIn profile in, in the post? Is there a website that people should be looking at?

    Bec McKeown  37:44  
    Oh, definitely. Yes. my LinkedIn profile, my website is very much work in progress. Yeah, well, it’s always a work in progress. It just exists. So let’s, let’s not go there. But yeah, certainly put my LinkedIn profile on because I think there’s certain there’s a whole bunch of stuff that there’s plenty of space for psychology and psychologists in cybersecurity and it’d be nice to see a few more of us around.

    Richard Anderson  38:11  
    Absolutely brilliant. We’re really appreciate your time back. Thanks ever so much.

    Bec McKeown  38:15  
    More than welcome. It’s been great chatting. Thank you. Yeah, really enjoyed it. Thanks.

    Voiceover  38:20  
    Thanks for listening to Psyched for Business. For shownotes, resources and more visit evolveassess.com

  • Psyched For Business Podcast Episode 16

    Psyched For Business Podcast Episode 16

    Episode 16:
    Improving Business Culture in 2023 with Paula Brockwell

    Richard is joined by occupational psychologist Paula Brockwell, from the Employee Experience Project, who specialises in helping Strategic HR improve culture.

    In this episode, we’ll learn more about how businesses can improve both culture and employee experience in 2023. We will also delve into how hybrid working has affected culture and what kills a business’s culture. 

    Subscribe to the podcast on your favourite platform:

    Apple Podcasts

    Spotify

    Amazon/Audible

    Pocketcasts

    Other Platforms


    Episode 16 – Transcript 

    Voiceover  0:00  
    Welcome to Psyched For Business, helping business leaders understand and apply cutting edge business psychology principles in the workplace.

    Richard Anderson  0:12  
    Hi, and welcome to Psyched for Business. I’m your host, Richard Anderson founder at Evolve Assess. In today’s episode I’m joined by Occupational psychologist Paula Brockwell, who is a specialist in helping HR teams improve culture across their business. In this episode, we talk through all things culture and employee experience. And Paula offers some brilliant insights in how businesses can look to improve this in 2023. I hope you enjoy the episode. Thanks again for listening. 

    Paula Brockwell. Welcome to Psyched For Business. Thanks for joining me. 

    Paula Brockwell  0:45  
    Thanks for having me. 

    Richard Anderson  0:47  
    It’s a pleasure, pleasure to have you on this lovely Friday, overcast Friday as it is in England. And you just told me before we started recording, Paula, that culture is your favorite subject, your favorite topic to talk about? So I plan this all around culture. So you’ll be pleased to be pleased to learn that we have a little chat about culture. Why not? But I think what, and obviously I’ve done an intro kind of separately to this, of course, Paula, to introduce yourself, but I’m never going to introduce you as well as you can introduce yourself. So if you’d be happy to, would you mind telling the audience kind of who you are or what you do?

    Paula Brockwell  1:22  
    Yeah, absolutely. Well, so my name is Paula Brockwell. I’m an occupational psychologist. And honestly, I’ve been kicking about this stuff for a long time, you know, kind of doing everything from leadership development, to culture fit assessments and things like that over the years, but I find my home probably about 10 years ago, in culture change, and really trying to look at how you influence behaviors and influence whole organizations to get people to behave how they want. So I’m a bit obsessed with it. Really, I just love creating kind of happy, healthy environments for people to really succeed at work.

    Richard Anderson  1:57  
    Well, it’s a fascinating subject. And I know that you call yourself on LinkedIn, the Culture Cultivator. Is that Is that right? Yeah, it’s a really, really catchy title, I think. So culture is something that really interests me. It’s something that I’ve always, I always like to think that I’ve prided myself on building a great culture in my business. But I’m always going to say that Paula, of course, I guess, the real, honest people will be my employees. But I guess if we take a step back, and maybe kind of start with a bit of a blank slate, what do we mean by culture? In a company organizational culture? What’s it all about?

    Paula Brockwell  2:30  
    Yeah, well, for me, it’s about how it feels to work here. In all honesty, if we ask the question of what does it mean, it’s that added up bit of what does it mean in terms of how it feels to work here, and how is culture defined, it’s all the systems, the processes, the ingredients, habits, beliefs, behaviors that make people feel as they do, but also act as they do. So culture is this weird kind of self reinforcing thing where it encourages people to behave certain ways, but how we behave also influences the culture. So it’s this strange kind of feedback loop that happens in terms of encourages people to be a certain way. But then how we are actually influences how it feels, which in turn encourages people to behave in a certain way.

    Richard Anderson  3:13  
    It’s really interesting. So if we were, again, blank slate, obviously, great definition of culture, but what if I wanted to, for my business, start to define the culture, I don’t know whether that will be the right term. But if I define my culture, what would be? So if you were to, you know, come into my business? Or if you would even be a fly on the wall? What would you be recommending that I do to define a culture that I want? So the ways in which I want my employees to behave and the spirit or whatever that might be across the team within a culture? What, what should I start by doing? 

    Paula Brockwell  3:45  
    Yeah, well, for me, I think, you know, a lot of a lot of the cultural models out there are really complex around looking at different kind of micro pieces of the ecosystem and saying, you know, we’ve got to look exactly, our leadership’s got to look exactly like this, etc. For me, though, the starting point really is harnessing that the idea of employee experience and having a conversation with people about how do we need it to feel here for us to be able to deliver our business results. So I think there’s a big thing about simplicity, that idea of everyday experience, how does it feel is massively uniting easy for everybody to access and really easy to measure and stay accountable against? But I think there’s also a big piece about, how does it need to be here for the business to succeed? So we’ve got to understand that culture isn’t just a nice to have, it’s a tool for the business to thrive and succeed. And so understanding where you’re going with your business, what your goals are, what does that mean in terms of the type of talent, the tone of behavior that you need? And then translating that into the experience that will help that type of talent and that tone of behavior thrive is really important. So understand, where you want to get to and what you’re trying to deliver and what your people need. Yeah, and then connect well, how does it need To feel here for people to feel really happily excited about making that happen. That, for me is the magic of culture. And I think a lot of times we overcomplicate it into lots of different models and measures, but just how do we make it fit on your what does it need to feel like for people to do, what we need them to do is really what it boils down to?

    Richard Anderson  5:18  
    Yeah interesting. So how much of it and again, this might be the one of the maybe the overcomplicated models that you’ve just referred to, but But how much of it kind of ties in to company values?

    Paula Brockwell  5:31  
    Yeah, so I think values are really interesting, you know, if I’m completely honest, and maybe I’ll be a bit contentious here, but I’ve never really seen new values or imposed values work in an organization. I think company values, people try to use values to say this is the intent, this is how we would like you to behave. So it’s trying to direct that tone of behavior, but they’re massively broad words that we can all interpret differently. So you know, what you think is innovative, as a head of a tech company might be really different to what I think’s innovative. As a psychologist who’s, you know, digging into the past and things potentially, maybe not. Probably is different in turn, particularly thinking about innovative tech, we’ll have very different views on that. I’m excited that I’ve got a Calendly link at the moment, let’s be honest. So but, you know, so how I describe innovative will be really different from how you describe it. And so, if we’re trying to use those words, to unite, we’re not going to be able to because everybody brings a different frame of reference to it. So they’re interesting, they’re great if you can capture what’s if the values have already aligned, and you can capture what’s already existing in the business great. But for true kind of culture, transformation and cultivation, I didn’t really think that that helpful, because people get excited about building them, but then they don’t really know how to enact them, and they don’t know how to evaluate them, or encourage them because there’s such a big concept. So for me, that peace around, how does it feel here? That’s our values alive? You know, are they acting I? And are they having an impact on people? So they’re almost like, that’s the back of the same equation. It’s just at the back end of it values and input that’s really difficult to quantify the outcome, the employee experiences the outcome. And I guess I, for me, that shift is massively important within culture change. It’s a bit like the evolution that performance management took, say, 10 years ago, when we stopped saying you need to make 10 widgets an hour and said, and said, you know, make 10 amazing, you know, whatever microphones that people want to buy, or get 10 People buying these things. So inputs versus outcomes, a lot of the HR world and the performance and business world has shifted to outcome focus. But culture still focuses on inputs and values in a lot of places, which for me, is a reason why it’s not doing what it needs to do a lot of the time.

    Richard Anderson  7:51  
    Culture should all be kind of governed by that whole output or outcome focus, or even though the example that you gave before that we might have a different idea of what’s innovative in technology. So presumably, that doesn’t much matter, as long as we’re heading and aiming towards the same goal. And it feels the same for both of us. Absolutely. As far as the vision of the company is concerned.

    Paula Brockwell  8:11  
    Yeah, absolutely. So yeah, you know, if if the goal in fact is that we feel that we are, that we’re both kind of trying new things that we feel like we’re experimenting, that we feel open, you know, that we feel other people are open to new ideas and approaches. So if you if we were working in the same business, and you came to me and said, I’ve got this really great bit of tech that I think would fix things for you. And you should be holding me accountable to say Yes, sounds amazing. Let’s apply that let’s take an innovative approach. But that’s more about making, making you feel like I’m open to ideas and open to your views, and that you’re valued and considered and driving that innovation through input rather than me being something that I probably don’t need to be in the system. Really, it would be your job to bring that to me and me to adopt it.

    Richard Anderson  8:59  
    Of course, but yeah, it’s a really interesting way of looking at like it. So when when, okay, so we’re talking about how it feels to be here and outcome kind of generate? And is that something that is typically kind of, I was going to use the word dictator, that will be the wrong word. But is that something that’s kind of implemented by the owners of the company’s senior management initially? How does that how does that in your experience, how does that typically work?

    Paula Brockwell  9:24  
    Yeah, you know, I think there’s a really interesting thing, again, that’s happening within the HR field, where often culture is seen as something that’s owned by HR and a lot of HR functions are transforming themselves into the people and culture function. That seems to be the the next iteration of, of HR. My view, in all honesty is that HR or the cultivators, the owners, I guess, the champions of culture, but actually the people who really make it happen are everyone you know, it’s got to be owned by the leaders in terms of the tone that definition of what group looks like because they Are the people who are setting the strategic direction, but they’ve also got the ability to influence the infrastructure, the systems, the business model will impact the culture. So if on one side a business model, a tone of decision making resourcing is being set by business leaders, but then they’re asking HR to set a culture that is totally counter to what’s happening operationally, it’s never going to come together. So really, those two pieces of the system need to come together and say, This is what Britain needs to look like, while listening to everyone else, listening to colleagues about what they need to be able to thrive. That’s the magic comes from everybody being part of it, but leaders and HR leaders really coming together and owning that and HRs being enablers of culture, rather than the owners of it, I think,

    Richard Anderson  10:46  
    Yeah, of course, presumably, for businesses who maybe don’t have an independent HR function, it would just be those leaders because I think one of the one of the areas that I’ve got real interest in as in you know, this already is kind of small business and businesses that are growing from being kind of startups or microsized business, particularly in the tech space. Often, you’ll, you’ll see, you’ll again, you’ll notice yourself that a lot of tech companies are global get VC funding investment, and then they’ll scale rapidly and they’ll be recruiting lots and lots and lots of people that can imagine that for those types of businesses, maybe just before they’ve they’ve brought in an HR function, a specific HR function. But then all of a sudden, they’re bringing in a lot of employees, I can imagine that culture drift in that type of organization. And I’m not just saying tech, this will be the world over no doubt. But do you see that quite often that the culture will will drift completely from what it was when the company first started out?

    Paula Brockwell  11:42  
    Absolutely, because I think often in that kind of small startup kind of starting to scale up situation. You don’t have to naturally cultivate it. The team is small enough that direct leadership impact how you recruit the team makeup will self regulate, and set a culture that works. So where it becomes needed to more consciously cultivate it, I think is particularly as well in a systemized way you consciously cultivate it when you’re a small team Anyway, don’t you? But in a more systemized way, if you’re going to do that, as you grow, often what you find is you get dilution or drift as it’s absolutely right. And I think one of the things that great leaders can do is if they know they’re going to scale as capture the magic while you’re small, so define what has made you great, understand that systemize it define that bit around how you want it to feel around here. And then you can start to make conscious efforts in your growth about how do you consciously cultivate that, and I use the word cultivate, because I think culture is a bit like, a culture is a bit like gardening, almost, you know, you choose if you know what flowers you want, you choose the soil, you decide how often you need to water, you figure out what plants go beside each other to complement each other. So if you’re doing that piece, as you scale, you’re giving yourself a real chance to succeed. But you’ve, you’ve got to, well, you don’t have to do it early, but it’s helpful to do it while the magic is still really clear. Because then you can say, This is what our magic recipe for growth is. Let’s see how we protect that as we work our way through.

    Richard Anderson  13:12  
    Yeah, brilliant. So, so just again, just to maybe use me as an example. So I’ve got, there’ll be about six of us. And there is six of us in the team. But let’s say that we want to turn the team into nine or 10 people by the end of this year, I mean, that’s ambitious, like not gonna happen by the end of the year, but still, you know, it’s a, it’s a, it’s a big growth almost, you know, 100% Extra members of staff probably over the coming, you know, let’s say nine months or whatever. Now, obviously, I love my team, we’ve got a you know, what, how I, what I feel is a brilliant culture, again, you have to double check that with them and I hope that would say the same thing. But but for me, it’s massively important that that culture is maintained, because it’s going to be it’ll be it’ll be horrendous if we have a completely different culture, not just for me, but for the employees that have been there up until this point. So if you were if you were supporting me Paula, it will be, you know, presumably after hire for for cultural fit, but what are the maybe what, what’s the what’s the biggest or the most important thing that you would tell me to do in order to make sure that the next four employees that I take on mirror the culture that we’ve built so far, 

    Paula Brockwell  14:18  
    What I would suggest is less about culture fit in all honesty, and more about culture. And so thinking about where you’re going and high how your tone needs, because what you do as a team of six versus what you do as a team of nine or 12, or 24 Some of that you’ll really be able to keep and protect, but some of it might need to shift a little bit to ensure that you don’t get you know, small group, there’s a risk as you scale of in group out group etc. You know, that kind of informalness of family that can become with small group becomes difficult when you think about performance management and goal alignment as you get bigger. So recognizing the small bits that you might need to evolve, not let go off but evolve and look at how they might play out a bit differently in a bigger team. I would say is the first piece. And then I would start to think about, well, how do my new hires add to that? How did they help me evolve that systemize that prepare for enacting that in a bigger team and bring my current team along on that journey? Because there will be a transition and an evolution for them? So, for me, I would say the first step is more about, well, where are we at the minute what’s really working, but how might that be challenged? Or, you know, stress tested a bit with a bigger team? Is that really going to deliver what I need? Or do we need to evolve any bits? And then start to think about in that ideal culture moving forward? How will these people really compliment and flavor and build build to the magic that we’ve got, rather than just kind of slotting in perhaps to what we have already? Because it will invariably lead to change a little bit at least?

    Richard Anderson  15:47  
    Yeah, of course. No, that makes complete sense. And I guess I’m just looking at through the lens of a small business owner, there are lots of inevitably huge organizations that this affects massively, I would imagine, how has and so how I’m just trying to think of how to phrase this question, but how has remote working or hybrid working or everything, you know, the the new way of working since the pandemic, has that affected culture across organizations? Or is that just not that isn’t just not coming to play? Maybe I’m overthinking that? Well.

    Paula Brockwell  16:23  
    I think it has massively. A lot of the clients that I’m working with now are really grappling with that sense of connection and communication. You know, those are being really shy for them in terms of how do they support people in that, I suppose I’ve got a bigger question. I’ve always got a bigger question than I. But, you know, for me, I think the pandemic fundamentally shifted people’s connection to work and their expectation of how work fits into the rest of their life. And so some of the challenges around connection are about remote or flexible, working and less, you know, just face time with each other. And the fact that businesses maybe haven’t evolved, how they use that time together, or how they create meaningful connections, they’ve just tried to do it, as they’ve always done and it’s not working. So there’s some evolution that’s needed on that. But I also think that there needs to be an acceptance that work isn’t the be all and end all for a lot of people now and actually creating that more balanced deal and making it feel helping people identify what’s in it for them, and what work helping them really see what role works needs to play for them line moving forward to support that reconnection is important. I think this kind of tendency to just try and pull people back into the office and get them back to the good old days, you know, everybody’s around the water cooler, the magical happen again, I think that’s really missing the mark, because it doesn’t pick up on the fact that actually for some people, their view of work, and their view of how work fits has just fundamentally shifted. And that’s not going to answer it is going to make them go and find a job that’s more flexible, where there still be the same challenges. Really, I don’t know, there’s some businesses here doing it really well. I don’t know if you’ve seen this as well. But you know, like, I used to work in, in recruitment in the very early stages. When I worked in a recruiter I was, I was part of the kind of big scale Assessment and Selection teams for for building government, big government departments at the time. And so I know a lot of people from that time who know I work in big kind of recruitment process outsourcing businesses, and a lot of them do work and have worked for 10 or 15 years virtually, because it’s, you know, multinational accounts, working across the globe. And they do a great job of creating that connection in that team sense. And I think what we actually need to do is look at where it’s already working and learn some lessons from that, rather than deciding it isn’t working. Really. Yeah, no, I my flexible working soapbox.

    Richard Anderson  18:47  
    Well, it’s a really interesting topic. And we can probably talk for ages on it because it’s, it’s, it’s been a challenge for me personally, because when I when I first started, and I’ve talked about this a couple of times on podcasts previously, when I started doing doing the business that I’m done doing evolve, I started and I did it from home exclusively. And it was kind of six years ago, just just six years, I think to the day tomorrow, randomly enough, but um, but at that time, I was working exclusively from home because I couldn’t afford an office that was the reason that I didn’t choose to have an office that was that was the reality at the time. And it wasn’t a choice but but the funny thing is Paula at the time, it seemed to me that every single person I was speaking to was in an office and they were having a good time with colleagues it was just me by myself and as an extrovert naturally, I really struggled and when I started the company out of the first couple of employees Ashleigh who you know for example, she She’s exactly the same she wanted to work in an office and then the next person wanted to work in an office and it was really tricky because when I’ve interviewed recently it’s been very much you know, what’s the flexibility here? You know, can can we work from home and it’s not a problem to work from home we do. I mean, I’m at home as we say no, I normally do kind of three and two, but it’s a really tough one as well because I’m going to have certain People that want that level of Well, everyone wants flexibility, of course, but certain people who want to work at home, some people want to work in the office. And it’s just, yeah, it’s a really interesting, interesting one, what you said, and as you rightly say that there are loads of people who are doing it really well. 

    Paula Brockwell  20:14  
    I think there’s a bit in there about curating correction connection point. So I’ve been I’ve got one client who I’ve worked with through the whole pandemic, supporting them in terms of creating that calms and connection, the like, and, and they did very much make the choice of trying to get people back into the office setting a minimum number of days, and they only said two days a week. But one of the things, we got a lot of feedback on that whenever it first started to help them evolve the approach. And one of the things that they heard and responded to really quickly was people being massively frustrated that they were coming into the office to spend a day on teams calls anyway, when they felt like they could have done that at home. And so we were really talking about that definition of how do you use your office days? How do you manage team or cross team diaries to make sure that people have have those connection points. So I think there’s a thing about a healthy dose of purpose and curating your contact with people to build that connection. So if you are, if you have got a team with different preferences, you’re being really clear about what the benefit of coming together or not coming together is so that then people can make the right choices about how to connect or not to connect really?

    Richard Anderson  21:21  
    Absolutely. So So one of the things I’ve you know, as you know, poor off, I follow quite closely on LinkedIn, where we’ve been connected for a little while, it’s nice to see an active poster on LinkedIn, I always try and do the same myself and getting better than I was brilliant. But you talk a lot about employee experience and kind of how that ties into culture. It’s not something I’m hugely familiar with. In truth, I’d love to learn more. But why have you? Why have you chosen the route of employee experience when it comes to your posts and the work that you do? 

    Paula Brockwell  21:50  
    Yeah, well I think, you know, having worked in culture for a long time, I think that, you know, I started to really focus on this breadth of culture, while working within the wellbeing space. And I think that, particularly 10 years ago, when I started to work, there, still probably quite a lot, now, people wanted interventions that were just focused on changing individuals behaviors, rather than thinking about how you support people to really be the best they can be. So, you know, kind of, it just frustrated me that culture change often focuses on what individuals need to do rather than the whole system, how it influences them. And I think the lovely thing about employee experience is it uses user centered design to really put colleagues at the heart of figuring out what’s the best thing to do, and what’s the change that what’s the change that they see needs to happen. And for me, there’s a whole thing about you’ve got to activate the whole herd, if you want to make that whole change happen. And employee experience does that like a big part of it? In all honesty, I think there’s, you know, there’s a massive movement happening within it. And a big part of it is about taking the employee lifecycle and designing the key contact points with colleagues to maximize value around those using that user centered design approach. I’m less interested in that if I’m honest, I feel like you know, that’s something that organizations can do pretty independently with a bit of process mapping. What I’m more interested in is all those other moments that people have, and how do you really set your organizational ecosystem to allowing people to succeed, and really kind of those moments to encourage people to behave the way that you want them to? Because they feel motivated and excited to do so. Really?

    Richard Anderson  23:29  
    Yeah. Interesting. So user centric design, would you mind just explaining what what that means for the layperson?

    Paula Brockwell  23:35  
    All right. So yeah, sorry. Yeah, the idea of it really is, is that you, you put the user and their experience at the center of anything that you do. So often, whenever we design processes, we think about the process owners and how things are easy for them and how they get the information that they need. But that really, that design process flips that on the side, or, you know, when its head and thinks about, well, how do the end users of this process? Or, the ultimate recipients of this? How will this make them feel? And how can we maximize positive impact for them? So it comes really from Tech Design kind of user interface, process design around that, it then headed into the customer experience in terms of driving customer experience? And it’s beautifully making its way into the employee experience space, which I think is absolutely right, because we need to think about how we’re making colleagues feel, if we want them to feel like if we want them to behave, how we want them to really

    Richard Anderson  24:29  
    bring brilliant. So I’ve read a little bit, obviously a little bit of preparation, of course, for this podcast, but seen it previously on LinkedIn, the EX index that you’ve that you’ve recently bought, there is a reason I’ve seen it recently. But would you tell me a little bit more about that?

    Paula Brockwell  24:49  
    Yeah, absolutely. Yeah. It is pretty recent. But to be honest, it’s kind of come from that last, you know, 10 years of working with businesses and I think being in a lot of boardrooms, where I’m talking to leaders and really trying to get them to see that connection between the business and the environment that you create through either your own behavior or the choices that you make around operating models, strategic priorities, whatever it may be helping them see how the environment that you create impacts the behaviors that you get. So trying to break through that narrative of being brought in on a consultancy project. And somebody said to me, you just need to make those people more personally responsible, and helping them break down and say, Look, all of these things in your environment are telling those people not to take responsibility to ask you for permission to double check things that it’s risky to make mistakes, because they’re negatively impacted, or whatever it may be, to help people see how the system is encouraging people to behave in different ways. But that conversation can be really loopy and muddy. And people can feel quite defensive in it, because you’re encouraging them to look at themselves, as well as everything else. So I kind of used all that experience and all those conversations and a shedload of research around, you know, what drives certain behaviors and work to say, let’s just break this down. So what the EX index does in short, is it it allows you to kind of say, these are things that are acceptable to us around here, this is the sort of this is kind of what we do, and then gives you back an indication of well, what does that mean across five cultural pillars? How would we, how are you likely to describe your culture? But what does that mean in terms of how people are likely to feel and therefore how are they likely to behave? So it’s a great way, if you’ve either got some really great behaviors that you want to get a sense of, how do I replicate these you can see, probably what’s driving it. And it’s useful to do some more stuff that enables that. But also on the other side, it allows you to identify what I call your culture killer. So the things where maybe it’s personal responsibility, maybe it’s risk aversion, maybe it’s a discomfort with change those things that no matter what you try and do to get rid of them just seem to hang around, what that’s probably telling you is there’s some unconscious stuff in your environment that you’re not noticing, that’s encouraging those behaviors to stay. And the EX index kind of helps you identify those so that you can start to kind of say, right, well, this is the stuff, you know, this is why it’s happening. So I’ve got to go back and look at my system, if I want those behaviors to change, I’ve got to stop blaming those people and tweak my system to get.

    Richard Anderson  27:20  
    So yes, it sounds really interesting. So the cultural killers or the culture killers that you talked about before? Do you ever find that? Are they completely unique on a kind of case by case basis? Or do you find that some are more apparent than others?

    Paula Brockwell  27:34  
    Yeah, do you know, it’s pretty common? To be honest, you know, there, there were some things that, you know, very similar, you know, it really, really is, a lot of human behavior can be bundled into categories. And I think there’s a range, there’s probably, there’s probably four or five other are there for me in my model. Anyway, there’s kind of five categories of, of culture killers that drive things through that are likely to impact things. So, you know, I think people different organizations will have a different mix of those things, because it all comes down to legacy history and those inherent systems and norms that are in place. But I’ve never, I don’t think, well, for a long time, I haven’t been surprised when I’ve seen certain behaviors, because I normally see where they’re coming from and the ecosystem. So it’s a bit like, you know, individual human behavior, we’re all quite predictable sausage is really, you know, you can codify it. So, organizations work the same way, when they’re just massive. They’re just big systems, you know, that. If you push one lever, you can’t, you know, you get something like the other end. So once you start to look at it as a whole system, suddenly, it makes sense, where a lot of I think the challenge that a lot of businesses have is they look at one part of the system. And they’re like, Why, either Why are my leaders doing this? Or why are my colleagues doing this, and they look so much at the individuals that they can’t understand what’s driving it. But as soon as you step back and look at that bigger picture, suddenly you can see what’s influencing through the whole system. That’s, that’s so important to me in my approach is that I just think you can, you can try and train stuff, I have people, but it won’t work. Because the system is encouraging them to do stuff, you know, that bit around stepping back to make a difference, I think is massively important. And I’ve got to a point in my career, where if somebody’s not asking me to do that, I just say no thanks, because I’m not interested in squeezing and squeezing one part of the system that hasn’t got the capacity to change by itself.

    Richard Anderson  29:28  
    Not I quite agree. And I was just thinking of a bit of a random and probably quite a basic example. So when I think and again, it’s a little bit abstract to me, because I’ve never worked in a big organization with lots of different departments, but I hear anecdotally from other people when they have the challenges that maybe they have in terms of culture, and they might have a team are a bunch of teams and you know, nine out of 10 teams might be adopting and you know, have a fantastic culture and then there’s one team there. You have a you know, a middle manager, Team Leader. or whatever, that’s a bit of a bully, that that’s not treating the team very well. And then all of a sudden, that entire team that they’ve got their heads down when they go to work, they’re leaving left, right and center. And if you were doing like an audit kind of culturally, and it was one particular individual, you know, is that is that something? Is that often part of a bigger picture? or can that often just be that one individual?

    Paula Brockwell  30:21  
    Yeah, so sometimes it is just an individual. I think the question then comes when it when I do things like cultural audit, what I will look at is each part of the system, what’s going on and influencing this. And typically, you’ll find that, that you can get isolated behavior, where it’s the challenge for me, the more systemic issues come if that thing has been if that behavior has been tolerated or permitted for a long period of time, then that’s at that point, you might step back and say, right, systemically, you need to have a think about this in terms of how you manage performance, or high, or, you know, one of the things that can often happen in cultures is performance, performance is prioritized over behavior. So a very high performing manager who delivers a huge amount of commercial return to a business or whatever it may be, their behavior is tolerated because of that value. So where that’s normally one of the reasons why those behavioral challenges or those team difficulties are tolerated for longer problem for longer issue or longer time points. But that doesn’t taking that systemic approach doesn’t mean that you don’t sometimes you see that there is something going on within a particular team. In my view, looking at that manager, you would want to think about, well, what’s driven that behavior? What’s encouraged it? Is it is it personally driven? Is it something about the the way they’ve been led? Is that something about the way the system is set up in terms of the pressure of the priorities? Is that about the business model? And what they’re exceeding what is being expected of them, etc. So you’d want to ask some bigger questions to avoid popping another manager in there and finding that the circumstances encourage the same behaviors for them? 

    Richard Anderson  32:01  
    Yeah. And if that’s been tolerated for a long period of time, then the issue is far more deep rooted, and it’s culturally across the business rather than that, that one particular individual? Interesting. Yeah, go on, sorry.

    Paula Brockwell  32:13  
    I was just gonna say, I think there’s a thing is there, you know, from that example, it’s a good example of, you know, not complicating it for the sake of it understood, like, absolutely be curious and understand the root cause. So take a broad enough perspective that you understand the root causes, but always look for the simplest answer and the simplest solution. And I think that’s important. You know, it’s yeah, looking broadly doesn’t mean overcomplicating it, it just means making sure that you’re excluding all the possibilities to get to the true answer, I think.

    Richard Anderson  32:40  
    Yeah, quite agree. I think that’s it. That’s exactly here. In terms of cultural audit, I think that’s what we said cultural audit, a culture audit, and do a lot of this sort of thing for businesses, how you know, how we how do you typically go about that polar view, we’re going into a big organization who’s got a few issues around culture, or they’re experiencing cultural drift, and they want to get back on track? What what would be the typical thing that you would that you would do with these organizations?

    Paula Brockwell  33:12  
    Yeah, well, so typically, I kind of use cultural the cultural audit, for me is more about kind of shorter, sharper issues and what’s going on within, you know, either teams or individuals. So I do like remediation work. If If, as you said, you know, a manager or leaders is behaving in a way that’s unhelpful, then often, I’ll do some one to one work to really understand what drives them, what motivates them, what’s going on to drive those unhelpful behaviors and give them some feedback and coaching to support them to move into a different mode, as well as helping the business to support them differently? So I think it depends on what you’re auditing, really, when I work in a larger, cultural, you know, larger organizational level, I try to avoid, avoid, if I’m honest, the the kind of culture audit approach, what I much prefer to do is support businesses to be focused more on Well, where are we going on things? So rather than where, you know, let’s come in and use a standard model to evaluate the gaps because no culture, you know, no culture for me should evaluate against a single model. For me, what we should really do at that whole business level in particular is say, the right back to the start of our conversation, what does good look like for your context, your business goals, and where you want to go set your ideal standard? And then let’s evaluate the gap in terms of where your current businesses so technically, do I then do a cultural audit against that standard? Yes. Do I like using that language? No, because it sounds like we’re just looking at it’s probably it’s probably more about the opportunities. But if you see the journey that people then need to take, what you can then start to do was really say, right, well, let’s have a look at your heaven forbid your whole ecosystem. I love it, don’t I? But I’ve got like a tool that I use, which I’ve grandly titled The Cultural Catalyst Map, but the idea is that it’s estimize that ecosystem kind of creates like a dashboard that saying, Let’s go across all the parts of your organization that are likely to influence where you are live versus where you want to get to. And let’s red, amber, green those against your ideal state. And then basically, what you’re doing is given a single dashboard, that’s saying, well, here’s your reds, and here’s your Amber’s, let’s figure out which ones are gonna give you the most bang for your buck to get closer to your ideal. And then clients really use that to pick off the bits they want to work on, but then continue to evaluate their progress. So for me, it’s really important to support self sufficiency. So I set that up so that they can evaluate that reevaluate themselves and their progress over time. So then they can just use that, you know, again, kind of going back to the tech space, you know, learning lessons from what’s worked, and really big implementations, taking a more sprint based approach. So let’s do a few things, evaluate progress, see where our dashboard is, try few more things that keep going in that way, which I think really, really keeps that focus and clarity in terms of what’s important and where we are knowing rather than, Oh, God, we’ve got this massive thing to do in the next five years. 

    Richard Anderson  36:08  
    Yeah I was glad that you mentioned that about kind of monitoring and evaluating as time goes on as well, because it’s one thing to put in these grids, implementing the grid, you process or kind of intervention when it comes to kind of cultural alignment and fit. But if you’re not monitoring that, and make sure that you’re not drifting again, in three months time, or whatever, that’s that’s got to be the most important thing.

    Paula Brockwell  36:30  
    It’s a bit like gorilla warfare, like you, you must find this in leading your own team, you know, sometimes you think something’s going to be amazing, and really take hold, and they go, Oh, yeah. All right, then. And it’s exactly the same in culture, you know, you’ve got to go with where, you know, if you want to move the masses, you’ve got to go with what catches their attention. So often, if you try and create a single linear plan and cultural change, you’re going to be disappointed and frustrated, if you take small bursts, you can see what fires light, and you go with those. And for me that agile approach to finding where what builds momentum and pushing them as that as that ball rolls down the hill, giving it all the support, it needs to gain momentum and direct to get that, for me is the way to make the magic happen.

    Richard Anderson  37:12  
    Yeah, love it. Yeah, really love it. So Paula, I can’t believe the time I can’t believe we’ve already done almost 40 minutes really enjoyed speaking has been really, really interesting. And just to give you the opportunity to tell any of the listeners how they can get in touch with you, if they want to speak about anything relating to their organizational culture. How will they do that?

    Paula Brockwell  37:32  
    Yeah, well, so as you said, I’m lurking on LinkedIn a lot. So if people want to connect to my LinkedIn profile and send me a DM, feel free, I’ll give you have a copy of my, either the free link to my EX index. So if anyone’s interested in just having a look at their current culture, and making that link through then I’ll provide that. And the only other thing is I’m doing a webinar actually in a few weeks time, the 18th of July on Culture killers. So if you check out my LinkedIn profile, you’ll find a bit more on that if you’re a bit interested in hearing a bit more detail about that.

    Richard Anderson  38:07  
    Fantastic. Can I come to that as well? 

    Paula Brockwell  38:09  
    Yeah, absolutely. 

    Richard Anderson  38:12  
    Get myself signed up. But yes, we will put a link to the E x index and the information about the webinar all in the blog post that this goes out. As part of yes, we’ll make sure that we get it up before that before that date of it. Absolutely. And then we’ll we’ll do by the brilliant while. I’m Paula Brockwell. Really, really enjoyed having you on Psyched For Business. Thank you very much.

    Paula Brockwell  38:33  
    Thank you. Appreciate it.

    Voiceover  38:37  
    Thanks for listening to Psyched For Business for shownotes resources and more visit evolveassess.com

    Notes and references:

    1. ‘Confront your Culture Killers: Unlock Great Culture Cultivation and Change’ Webinar –https://www.eventbrite.co.uk/e/confront-your-culture-killers-unlock-great-culture-cultivation-and-change-tickets-668675736127?aff=oddtdtcreator

    2. https://www.canva.com/design/DAFU3Baifqg/xx4__bR3HQS-7H1ZZMtriQ/edit?utm_content=DAFU3Baifqg&utm_campaign=designshare&utm_medium=link2&utm_source=sharebutton

  • Psyched For Business Podcast Episode 15

    Psyched For Business Podcast Episode 15

    Episode 15:
    What does validity mean in assessments and how do we evaluate it? – with Andrew Munro

    Richard is joined by Andrew Munro for the second time. Andrew is a chartered psychologist with over 30 years experience in the corporate sector, a conference speaker, and author. 

    In this episode we’ll cover what validity means in assessments and how it can be evaluated. We will also delve further into the methodologies and metrics that can be used to assess validity as well as the importance of transparency and simplicity. 

    Subscribe to the podcast on your favourite platform:

    Apple Podcasts

    Spotify

    Amazon/Audible

    Pocketcasts

    Other Platforms


    Episode 15 – Transcript 

    Voiceover  0:00  
    Welcome to Psyched for Business, helping business leaders understand and apply cutting edge business psychology principles in the workplace.

    Richard Anderson  0:12  
    Hi, and welcome to Psyched for Business. My name is Richard Anderson. Thank you for joining me. In today’s episode, I’m joined by chartered psychologist Andrew Munro. I’m really delighted to have Andrew back on the podcast for the second time, the first one we recorded was called Why do intelligent people do stupid things? And that’s also well worth a listen. But in today’s episode, we cover the very interesting and slightly contentious topic of validity in assessment. What does it mean? How is it evaluated? And is all what it seems I hope you enjoy the episode. Thanks again for listening. Andrew Munro, welcome back to Psyched for Business. It’s great to have you on the show. Again, thank you for joining me, how are you doing?

    Andrew Munro  0:54  
    All, good. And thanks for asking me back. I enjoyed hugely our last discussion. That was that was great fun.

    Richard Anderson  1:02  
    Yeah, me too, Andrew. And the listeners won’t know this. But I’ll tell them you’re sitting in very exotic country at the minute. Albania you are telling me all about it. And I’m suitably envious after say. So we, we hope you’re having a good time out there. But listen, just to just to I guess briefly recap on the introduction that I that I gave you last time in the first podcast. So you’re a chartered psychologist, of course, you’ve worked in the area of assessment. And I’m going to emphasize the word validity because of course, that’s what this podcast is all about. You’ve done that for 30 years now. You’re a Director of Talent World Consulting you’re also an associate of Envisia Learning. And you’ve also and I must put this in, I very much enjoy your book A to Z, and Back Again: Adventures and Misadventures in a Talent World. Andrew, you know, we’ve decided, and we had a little bit of deliberation, you and I, after the last podcast about what the next one could be about. And we’ve decided to yeah, we’ve decided to make it all about the topic of validity. 

    There’s a few reasons why we’ve done that I’m really looking forward to getting stuck into this topic. We both know, it’s a slightly contentious one, to say the least it splits a lot of opinion. So yeah, I’m really looking forward to getting stuck in. Good, good. Okay, so if you’re happy for me to, I’m going to kick off by summarizing a small section of its A to Z and Back Again, your book. So I’m going to open quotes now and say:

    A Conjuring act pulls the White Rabbit of validity out of the hat of a data set. Here, the magic depends on missing the sleight of hand that one generalizes with a puff of smoke and well positioned mirrors from a data set that is small and unrepresentative sample. Number two waves the wand of statistical trickery and corrections to astonish and baffle. Three saws the glamorous assistant in half, but avoids cross validation with a different data set. Number four climbs the Indian rope to disappear out of view, without reference to any independent replication. At this point, even the rabbit look surprised that it managed to jump out of the magician’s hat to appear in a test publishers manual. It’s very amusing. It’s very hard hitting. There’s a lot going on there. Start off Andrew if you’re happy to by giving us an unplugged summary of validity, please.

    Andrew Munro  3:42  
    Okay, Richard, thanks for that passage, I think Masoud my co-author and I think we both got a bit carried away with that conjuring analogy. Wee bit overblown. But the point is, validity is in a bit of a mess. This is an unplugged podcast. And we can put in the technical stuff, definitions, methodologies, and so on into the transcript notes. For my working definition for this conversation over the next 30 minutes or so. Is there validity establishes if an assessment does what it claims – as simple as that. And without a specific claim it becomes a very slippery construct. And it’s one that’s open to all sorts of interpretation and endless circular debates.

    Richard Anderson  4:35  
    And I’ve certainly seen that I have to say but why don’t we kick off with an example of what you mean if you’ve got one

    Andrew Munro  4:43  
    A vendor is selling a language based assessment. He uses text textual analysis to generate insights into personality. And the website announces our science is validated and has over 20,000 citations on Google Scholar, okay, I then scroll down the listings for a range of applications, including recruitment. That’s what I’m interested in right now. And I read an article called Predicting Mental Health Status in Remote and Rural Farming Communities. I have no doubt whatsoever that linguistic analysis methods can be affected, you might, you might want to run our sentiment analysis on your own LinkedIn posts, Richard, and you’ll, you’ll get the idea. But the vendors making a generalized statements about a promising methodology is not a specific claim. And it’s not relevant to my requirement to, for example, implement a test to recruit staff and social care sector.

    Richard Anderson  5:52  
    Yeah, yeah, makes total sense. And thinking about you, of course, have been on both sides of the table, haven’t you? So you’ve been a client. But you’ve also been a consultant when it comes to validity and tests and those types of things. So if you put yourself in, in your shoes, when you were a client reviewing claimed assessment validity from different vendors, what was your own experience?

    Andrew Munro  6:18  
    Oh, lots, actually. But specific one of my bosses, asked me to meet a potential new assessment vendor. The specific tool had intuitive appeal. It had a very differentiated position in the test marketplace. And my boss and I, we both thought it might complement some of the aspects of our talents, our processes.

    Richard Anderson  6:43  
    Bet you were looking forward to the meeting. 

    Andrew Munro  6:45  
    Yeah, absolutely. So as part of the pitch, the vendor walked through the deck. I don’t know if you remember those days. One slide made the extraordinary claim of predictive power, expressed as a validity coefficient of point nine, three, a figure on unheard of in talent assessments. I asked her how was this figure derived? And practically, what did this level of predicts predictive validity mean?

    Richard Anderson  7:17  
    Okay. And so just to go back to that validity coefficient, so she said nought, point nine, three, I think you said so. Yeah, just for the for the benefit of our listeners validity coefficient. What does that mean, in layman’s terms, like the company would, I don’t know, have a 93%? Accuracy in future assessment? Yeah, I don’t know. But like business performance, increasing by 93%? What does that mean?

    Andrew Munro  7:46  
    Well, you ask. And I did, and I was none the wiser. And things actually got a bit more awkward. When I asked about the methodology that had generated this figure of point nine, three, and we’re back to the conjuring trick, and the rabbit from a rabbit from the hat. And my boss he did the diplomatic thing and concluded the meeting. And that was that really?

    Richard Anderson  8:15  
    Well, I’m glad you asked the same question that that I did, that makes me feel a little bit better. But um, let’s Okay, so let’s go into that a bit more. So what are the factors? Well, what was what was what are the factors that affect validity for you?

    Andrew Munro  8:34  
    So let me answer your question this way Richard a few years ago, with my good friend, Dr. Paul Barrett we both posted a competition on LinkedIn. And an award would be given to the test publisher who could provide evidence of the business impact of a personality test in a selection context. This was going to be a variation of the paranormal challenge. This is the one where a magician and sceptic James Randi offered $1 million to anyone who could show evidence of a paranormal power or events. Yeah, over 1000 people applied none more successful. Spoon Bending Uri Geller, he refused to take the challenge.

    Richard Anderson  9:26  
    Sounds like a brave challenge that you set in, in our world of validity then. So what conditions were set like what were the parameters? What did you What did you do to award the million dollars?

    Andrew Munro  9:40  
    Okay, why don’t you have a go yourself or Richard?

    Richard Anderson  9:46  
    Okay, so let’s say something like thinking about validity. So an improvement on current process maybe or just I suppose a tangible evidence of business benefit

    Andrew Munro  10:01  
    You’re thinking as sensible person or Richard, but you’re not thinking as a psychometrician. I won’t run through all the criteria. But for example, number one, a base rate of current success had to be available. Is the new test and improvement on existing selection processes. Is it even better than tossing a coin?

    Richard Anderson  10:25  
    Yeah, I get it that that that that that makes sense as a starter, what else did you have in there?

    Andrew Munro  10:29  
    All right, number two, there had to be a decent sample size. We set it a modest 150. So this was going to rule out the personality test that relies on validation from 45 bus drivers, 63 zookeepers. And it’s the kind of nonsense the BPS, the British Psychological Society. The test review process gives out Smarties for when it comes to evaluate test publisher resolutions.

    Richard Anderson  11:02  
    Okay. I like it. Okay, so 150. Okay, base rate of current success. What else?

    Andrew Munro  11:10  
    And the most important condition. And I think this turned out to be the most demanding. Successful candidates were tracked, and meaningful performance data linked to business outcomes, sales, productivity service, they were obtained after a year. So rather than rely on subjective supervisory ratings, objective criteria, work outcomes of some organizational value, had to be applied to meet the criteria of the of the psychometric challenge.

    Richard Anderson  11:46  
    Okay. So I’m no expert in validity as you as you know, Andrew, but it does crop up from time to time. And one of the things that I often observe or think is that, isn’t it pretty difficult to obtain those sorts of metrics in a lot of businesses that you’ve required to meet the challenge?

    Andrew Munro  12:08  
    It’s a fair point. And I know, you want to come on to talk about metrics. But quickly, I’ll mention a paradox. On the one hand, the test publisher say that objective testing is required, because managers are completely hopeless in recruitment interviews, performance appraisal, and talent reviews. Not true, by the way, but that’s the narrative. Yeah, we need the rigor that psychometric testing provides. And it does provide rigor. I’m not arguing against our psychometric testing. But hold on a minute, what’s the metric for validation? The evaluations that you psychometricians are criticizing in the first place.

    Richard Anderson  12:56  
    Yeah. So almost the test validation almost hinges on the lack of validity that it’s arguing against in the first place. Yeah, I see the paradox. 100%. Okay, then how do they how did the competition run? Were you nervous about the outcome? I mean, million dollars on the table.

    Andrew Munro  13:17  
    I had complete faith in Paul. So it was a very entertaining exchange. And we reviewed many, many submissions. There are a fair number of challenges about the criteria and the methodology, which were completely reasonable. A few tests publishers got rather heated. But to answer your question, no, no study met the conditions.

    Richard Anderson  13:47  
    Yeah. So just like Randi then, the million dollars was never awarded?

    Andrew Munro  13:51  
    Yeah, absolutely. Absolutely. Good. My wife was relieved. That example, was based on personality testing in our selection scenario. But we’re trying to make a more fundamental points, that we need to look at validity in context. And here, I would highlight another factor, which is often neglected:  selection ratios. If I’m in the position of recruiting only one out of every 30 applicants, I’m in a very different ballgame to being forced to choose one in three applicants.

    Richard Anderson  14:34  
    Yeah, I mean, that that is a very fair point that it might actually thinking about and explain something. So one of the things that I was always puzzled by was that piece about Google and Google made the decision to abandon the use of the cognitive ability tests. They found zero correlation between the test results and the performance of those individuals in the roles. Excuse me. But thinking about it in just the point you made there, if you’ve got a hiring ratio that is only probably allowing you to recruit one candidate out of, I mean, hundreds of applicants, probably then how are you going to see any correlation at all or much of one anyway?

    Andrew Munro  15:15  
    For an analytics company, very surprisingly, Google forgot the problem of restriction of range. If the majority of your shortlisted candidates are at the 95th percentile or above, on cognitive aptitudes, why would you expect much differentiation and performance from the test scores within a very highly selected group? And here Google should have looked at other potential predictors in the assessment process?

    Richard Anderson  15:46  
    Because I think a lot of companies just followed suit, didn’t they? Because Google is supposed to be the exemplar the shining, best practice, but they’re not representative of every company out there. Because, you know, other companies, they’ll not have anything near the volume of applicants that the Google get.

    Andrew Munro  16:05  
    Yeah, it was a big mistake. Yeah.

    Richard Anderson  16:07  
    And I think, as I remember it with Google, they had problems with the, you know, when the algorithm the number crunchers came up with, an algorithm for promotion readiness within the business and the line managers refused to accept it.

    Andrew Munro  16:27  
    A few issues on that one, Richard, one was about ownership of decision making. Mainly however, I suspect even Google’s managers didn’t trust their own algorithm on this one. Yeah. And with good reason, which I think you want to explore and cover a bit later.

    Richard Anderson  16:47  
    Excellent. Okay, so just very quickly, to summarize the last part of this discussion, or the last part of the conversation that we just had there. So you’re saying that validity must be considered in the round? You know, I get that there’s something that’s niggling a little bit. And I think that we should maybe explore a little further, would you mind just doubling back on the issue of validity and what it means? So I’ve heard quite a few times and again, it’s nice because I’m, obviously we work with, you know, assessment psychometric technology, but I’m not involved in the validity aspect of it. And one of the things sitting on the periphery almost, I hear the term meta-analysis, when it comes to validity and validation studies. Would you mind telling our listeners what do we mean by meta-analysis Andrew?

    Andrew Munro  17:40  
    So meta-analysis is a methodology to consolidate hundreds of different studies from different samples. And the procedure is intended to well basically iron out the wrinkles to correct for various statistical anomalies, from all the vagaries of different research designs, and the outcome, to summarize the evidence for the validity of different assessment methods.

    Richard Anderson  18:09  
    Okay, so given we know what we know, from the meta-analysis research, I suppose we can generalize to say that this assessment method has solid validity. And as a practitioner, I guess we can use it with confidence

    Andrew Munro  18:28  
    Yes and no, but mainly no. Meta analytical studies, they certainly do provide an overview of which assessment methods deserve more or less attention. So we can rule out graphology as a selection method, no robust study at any time was found any validity for it. But, and this is the big but, meta-analysis suggests an assessment might work. But that’s a far cry from claiming it actually does work within a practical setting. And here, we’re back to the issues of context, base rates and so on. The other issue for practitioners is which meta analytical study do we sign up to? Do you know the BBC docu-sitcom The Thick Of It?

    Richard Anderson  19:24  
    Yeah, yeah, of course. Yeah.

    Andrew Munro  19:26  
    And there’s a line from Malcolm Tucker. So Malcolm’s the political spin doctor, and he’s saying to a civil servant. I won’t attempt the voice of the actor Peter Capaldi. You’ve been speaking to the wrong expert. You’ve got to ask the right expert. And there’s a bit of which expert in the world of meta-analysis.

    Richard Anderson  19:51  
    Okay, I got Yeah. I checked the reference that you sent me you know, the LinkedIn post by  Paul Barrett. And he rank ordered the results from four different meta analytical studies, basically to find conflict in summaries. And as I understand that, because of the different assumptions of statistical methodology, they came up with quite different conclusions. It’s it just seems really messy.

    Andrew Munro  20:24  
    It is, but it’s largely one of the makings of the psychometricians, through a lack of transparency, and also applying statistical wheezes. That in principle indicate validity. But in practice are a million miles from real life application,

    Richard Anderson  20:43  
    it’s really interesting stuff I have to say. Okay, why don’t we move on to methodology and metrics?

    Andrew Munro  20:52  
    Yep. Because if we don’t have the relevant metrics, no magical methodology, we’ll pull our white rabbit from the hat.

    Richard Anderson  21:01  
    Exactly. So let’s go back to what we were talking about around objective measures of work performance, they’re often much more difficult to access as we’ve as we’ve previously touched on. So if an organization doesn’t know, who is or isn’t, you know, within the staff base, having a business impact, whether that service responsiveness, productivity, sales, innovation, whatever, that seems to me to be a bit of a more fundamental problem.

    Andrew Munro  21:34  
    Of course, if an organization can’t differentiate levels of performance and other around success outcomes, its yardstick for validation becomes next to a meaningless. Yeah.

    Richard Anderson  21:46  
    Okay, so just to check my understanding on this. So we’re going to identify a key success metric on many metrics, and check the relationship with these metrics that we’ve identified against the scores on the assessment that we want to validate. I’m assuming that if we find a decent relationship between the two, then there’s going to be potential to improve performance on that success outcome, whether that’s in selection or in their learning and development practices. And then of course, we apply that.

    Andrew Munro  22:23  
    Yeah, I mean, that’s how the methodology works. Imagine a scenario. And we want to validate a test that we think has potential to improve the effectiveness of surgical teams in the National Health Service. This is not trivial. This test has the potential to save patient lives. What metric would you draw on for test validation?

    Richard Anderson  22:49  
    Well, I guess in, in that example, maybe outcomes from operations over time, something like that, I guess, preferably across a range of hospitals and medical procedures. 

    Andrew Munro  23:06  
    Yeah. But what if we find if the head surgeon of hospital is so extraordinarily talented, that he or she and her teams end up taking on the difficult cases that other surgeons and other hospitals don’t go near? Their apparent success rates might be relatively lower vis a vis their peers in other hospitals, but only because only because they are so successful.

    Richard Anderson  23:36  
    I see, the problem there,

    Andrew Munro  23:39  
    Or just to keep the NHS theme going, what if we find nursing teams, which report higher, higher error rates during operations, turn out in fact, to be the better teams. The better teams encourage honesty and acceptance of mistakes to learn. Conversely, the worst nursing teams cover up their mistakes and report lower error rates,

    Richard Anderson  24:09  
    Black box thinking. So that reminds me of the Cobra effect, which, which no doubt you’re aware of. And it’s it, I suppose it’s a great example of the law of negative, unintended consequences. And for anybody who isn’t familiar with the story of the Cobra effect, it was during British rule in India, and I think the government were becoming increasingly concerned about the number of venomous cobras in I think it was Delhi. I think the government basically offered a bounty for anybody that could bring in a dead Cobra and obviously the consequence of that you had a lot of entrepreneurial opportunists who began to breed cobras, and the government obviously once it realized what was going on the end of the program, but the other consequence to that was that the Cobra breeders who You were left with basically 1000s of worthless snakes, the free the Cobras, and it grew. So it was infinitely worse than it was in the first place.

    Andrew Munro  25:09  
    It’s a great example. We have to choose our metrics with great care as part of our validation projects.

    Richard Anderson  25:20  
    Absolutely. So okay, so we’ve run our validation study, let’s assume that. And again, assuming that we’ve got a decent data set, and that the metrics that we’ve decided on in terms of success, are the robust the defensible, how do we report back and use the findings for practical improvements in assessment and development?

    Andrew Munro  25:46  
    The standard format, which we’ve touched on briefly is the correlation coefficient. And this is the typical statistic, which gets reported in test publisher manuals, as well as in research articles.

    Richard Anderson  26:02  
    Okay, so just again, just to touch on that term, the correlation coefficient. We’ll try and get it explained for the layman. What do we mean by the correlation coefficient? Andrew?

    Andrew Munro  26:15  
    Yeah, good question. I mean, this is validation unplugged. So the validity coefficient is an index running between zero and one. Zero relationship means there isn’t a relationship between test scores, and whatever success criterion is being applied – work performance being the most common – through to 1, a perfect correlation. In the assessment space, we are typically looking at validity coefficients of .3 to .5.

    Richard Anderson  26:50  
    Got it? Makes sense.

    Andrew Munro  26:54  
    Couple of risks with the correlation coefficient. The most obvious is this number is a spurious number. A bit of a tangent, but bear with me, Richard, so what? What do you think the correlation is between  per capita cheese consumption and death rates through being tangled up in bedsheets?

    Richard Anderson  27:20  
    Okay. That’s an interesting question. I think I might know where you’re going. But you know, intuitively, I would say, zero. But then unless we think that the cheese apparently gives us nightmares, and then nightmares creates, like night time panic, and you become snarled up with the sheets, I suppose. Perhaps a very, very, very, very small correlation.

    Andrew Munro  27:47  
    As it turns out, it’s a heft .94. Wow, extraordinary results. And there’s a great website, and it’s worth posting the link in the transcripts, that reports more of these types of spurious correlations. They’re great fun. Robert Matthews, mathematics professor at Birmingham, he said correlations are like coincidences. We would take them less seriously, if we’re more aware of how easily we find them. So first off, let’s check, we’re not fooling ourselves by being fooled by randomness, correlations that are thrown up as statistically significant, but are just a consequence of the games. We play in statistics and have no practical value,

    Richard Anderson  28:39  
    Lies, damn lies, and statistics.

    Andrew Munro  28:42  
    And the other giveaway is phony precision. If spurious correlations are too good to be true, phony precision is the red flag that something odd is going on.

    Richard Anderson  28:56  
    Okay. And you’re sceptical of studies that report a correlation to more than two decimal points.

    Andrew Munro  29:06  
    Yeah, someone’s playing the science game without understanding science, okay. And it’s the law of phony precision that caught out a very well-known us psychologist with her positivity ratio. Embarrassed by the finding that this was all flim flam, she said quote, I didn’t understand the maths. Okay. She still continues to promote the book though. 

    And the final observation and I know we are sort of slightly, plugging, plugging back rather than unplugged is that a correlation coefficients is a summary index. You report a validity coefficient or point five. So far, so good. It is a respectable figure. But what does the pattern of test scores mapped to the success criteria look like? 

    In life, show me the money is good advice. In the validity world, visualize the data is great advice. Literally display the pattern visually on a scatterplot to indicate the relationship between test scores, x axis and the success criteria on the Y axis. Is it a nice clustering of dots indicating a clear pattern? Or is it just a mess of our plotted data? 

    And there’s a terrific site on correlation coefficients that asks the question, what does a correlation of point five look like? The answer, once you plot all the permutations on a scattergram is pretty pretty much anything you like

    Richard Anderson  30:53  
    Right? So what then are the alternatives to the correlation coefficient.

    Andrew Munro  31:00  
    My preference is to apply good old fashioned expectancy tables. So here, we group our data, or data points into quadrants low and high test scores, vis a vis low and high criterion scores. And we report as percentages and it sounds simplistic, it isn’t. It’s a variation of an approach the actuaries use all the time to forecast likely outcomes. And to my mind it is a much more direct and meaningful way to interpret validation results, rather than the abstraction of a number, the number of the correlation coefficient.

    Richard Anderson  31:42  
    That’s really interesting. Okay, so that I think is a good link to the final topic, we said we discuss and that’s all about validity in its application in decision making for selection. So the question, how do we translate the validity studies into a decision making model that improves? For example, recruitment?

    Andrew Munro  32:05  
    A possible tangent, tangent again? But a thought has just been that triggered? Are we selecting in for exceptional levels of success? Or are we screening out to avoid damaging failure?

    Richard Anderson  32:25  
    Okay, well, what do you mean by that? Could you would you expand a little bit please?

    Andrew Munro  32:30  
    There are some roles where more is more, sales is a good example. Every successful appointment you make has a direct impact on the company’s bottom line. So we therefore want to select the outstanding performers. There are some roles however, where less is more. You take the head of safety at a nuclear processing company. Brilliance isn’t going to put much on the bottom line, but incompetence will have devastating consequences. And our validity research should guide our strategy – selecting in or screening out. And expectancy tables are way better at highlighting which selection strategy is optimal, rather than use a single index of the validity coefficients.

    Richard Anderson  33:26  
    And in your experience, then how open would you say companies are in the way that they implement their assessment processes

    Andrew Munro  33:35  
    Two strategies, one is explicit. And there’s a clear logic which is open is transparent. It’s defensible. And there’s a theory behind how we’ve used the validity research to shape our decision making algorithm to connect cause and consequence. The second is the mysterious secret sauce of proprietary intellectual property. This is becoming increasingly common and linked to development, development and the use of AI and assessment. 

    Here the assessment isn’t interested in theory, we’re only interested in patterns or associations that connect test data to a metric of success. And the problem – without a model of cause and effect – we get excited with number one, back to the randomness of number crunching. And secondly, potential bias from the data set that generated the numbers in the first place,

    Richard Anderson  34:42  
    Okay, and wasn’t it Amazon? They got caught out with this, this whole approach and as I recall it, they brought in artificial intelligence to review the job applicant resumes – CVS. The idea was to widen the talent pool by scanning the internet for suitable candidates. And I think the machine learning that they used, which was screening out applicants, it was using data from an overwhelming proportion of males of males, based on previous applicants, and as a result the new recruiting engine did not like women. And the project was abandoned.

    Andrew Munro  35:26  
    Yeah, yeah. Earlier this week, I saw a McKinsey Report. And the researchers announced companies are already using AI to create sustainable talent pipelines. At this stage, I would say, one, I doubt it very much. But do share a few examples. And secondly, if these companies are – without any kind of validation – they’re being very, very brave, if not reckless. 

    Another example, one of my clients was using a well-known assessment application from one of the big global consultancies, no names, but lots of shame. And my client was concerned the results didn’t quite feel right. Okay. That was her intuition. She’s a highly experienced professional. She’s worked with lots of assessment tools. And she had a bit of unease about  the report outcomes

    How did it play out? Well, I said, trust your intuition. Ask the vendor for the original test data, the data before the black box weights recalibrates and does its other magical stuff. And we can analyse what’s going on. The firm refused to share the data. When an assessment firm isn’t prepared to collaborate as part of an independent validation review, someone’s fooling someone. It’s a bit like the Wizard of Oz, don’t look behind the curtain. Yeah, of course not. If it is only bluff and bananas behind the behind the curtain. 

    Apart from the secrecy, my other reservation is the complexity of the algorithms hidden away inside the black box. One for another discussion, probably. But complexity is fragile, complicated algorithms break down very quickly. 

    And the other worrying aspect of the black box is the impact on diversity and inclusion. You mentioned Amazon. A few other firms are facing legal challenge over black box decision making more will in future. I have no doubt of that whatsoever. 

    Richard Anderson  37:53  
    Yeah, I’m sure I’m sure you’re right. I mean, that was fascinating listening, Andrew, I’m going to probably attempt a bit of a summary of the conversation if that’s okay. So I think that the key takeaways, I suppose, number one, we seem to be making validity, probably a lot more complicated than it needs to be, I guess, you know, in Unplugged, the question is, what is the specific claim made by an assessment? What’s the evidence to support that claim? For practitioners, this seems a much more helpful question than show me the number of like a validity coefficient, for example.

    Andrew Munro  38:38  
    Yes, keep it grounded, keep it practical, rather than abstract.

    Richard Anderson  38:44  
    So I know that we’ve mentioned unplugged as a term throughout this podcast and another one, I guess. So if we’re not clear on what the definition of work success and the metrics that we use to validate the assessment, there’s there’s going to be a real risk. Firstly, I guess simply selecting from the past, and those that line minute managers have previously rated highly. And secondly, the hazard of the negative unintended consequences that we discussed before if our metrics don’t reflect the reality of success.

    Andrew Munro  39:21  
    And just to jump in on that one, another example Richard, there’s a well-known measure of Dark Side leadership, the Hogan Development Survey. And this profiler identifies the negative traits, dysfunctional, destructive behaviours of leadership. And it was once deployed in a validation exercise at West Point. West Point is the Academy for future, military, military leaders in the US. And the research is in the public domain. And a bit of a surprising finding; several of the dark side dimensions – narcissism being overly dramatic. being critical of others, being overly focused on rule compliance actually had a positive effect – I’ll repeat that actually had a positive effect on the cadets’ leadership development over time. The authors conclude the results require some explanation. While they certainly do when the so called Dark Side turns out to be the bright side of success, something strange is going on in the validity world.

    Richard Anderson  40:35  
    Yeah. Interesting. Very strange. Okay, I guess the other observation would be the need for transparency and simplicity in the process of validation, like how it’s reported, how the findings are then incorporated into organizational processes. We might run into problems legally. And ethically if we’re not going to ask what’s in the black box.

    Andrew Munro  41:02  
    In three minutes, Richard, you’ve distilled my 30 minutes of our wandering wonderings in validity world into a clear unplugged summary or at least our version of an unplugged summary. And I’m sure many of many of our listeners might disagree, but I think that’s a good summary. Richard.

    Richard Anderson  41:27  
    Brilliant, and it was the 30 minutes that you mentioned was fantastic to listen to. And there’s a huge thank you, Andrew, I guess a couple of things. Just before we bring things to a close. A transcript is going to be available like it was last time as part of this podcast, which will be incorporated in the whole blog post on our website will also have references in there from the various different sources that Andrew was cited and discussed. Andrew, I must ask this in the last podcast, you talked about the sequel to A to Z coming out soon Is it is it available yet?

    Andrew Munro  42:06  
    Z to A, that one had to be pushed back a wee bit due to a couple of other projects. The plan is for autumn now, Richard but thanks. Thanks for the plug on Unplugged.

    Richard Anderson  42:20  
    Plug on unplug there you go. Brilliant Andrew. Well, thanks ever so much yet again. Really enjoyed the discussion. And thank you for joining me on Psyched for Business.

    Andrew Munro  42:29  
    But you’re very welcome, Richard. Thank you.

    Richard Anderson  42:32  
    Thanks, Andrew.

    Voiceover  42:33  
    Thanks for listening to Psyched for business. For Show Notes resources and more. Visit evolveassess.com

    Notes and references
    1. Types of validity; http://psychyogi.org/types-of-validity/
    2. “You’ve been speaking to the wrong expert. You’ve got to ask the right expert.” “The Thick Of It”; https://youtu.be/lADB9Qu53CY)
    3. Spurious Correlations. https://www.tylervigen.com/spurious-correlations
    4. “What does a 0.5 correlation look like?”; https://janhove.github.io/ teaching/2016/11/21/what-correlations-look-like
    5. “If your ratio was greater than 2.9013 positive emotions to 1 negative emotion you were flourishing in life.”; https://www.theguardian.com/science/2014/jan/19/mathematics-of-happiness-debunked-nick-brown
    6. “For example, let’s say you’re training an AI model to filter job candidates so you only need to interview a fraction of the applicants. Clearly, you want candidates that will do well in the job. So you get some numbers together on your old employees, and make a model that predicts which candidates will succeed. Great. First round of interviews and in front of you are 15 white men who mentioned golf — your CEO’s favourite pastime — on their resume. Why? Well, those are the kinds of people who have been promoted over the past 50 years.”
    Why AI is Arguably Less Conscious Than a Fruit Fly; https://www.webworm.co/p/insulttolife?
    7. The State of Organizations 2023: Ten shifts transforming organizations; https://www.mckinsey.com/capabilities/people-and-organizational-performance/our-insights/the-state-of-organizations-2023#/
    8. Leader development and the dark side of personality, P.D. Harms et al; The Leadership Quarterly, 2011
    9. From A To Z And Back Again; https://www.amazon.co.uk/Back-Again-Adventures-Misadventures-Talent/dp/1914424204

  • Psyched For Business Podcast Episode 14

    Psyched For Business Podcast Episode 14

    Episode 14:
    The Importance of Measuring and Evaluating L&D with Dr Peter Pease

    Richard is joined by business psychologist and L&D practitioner Dr Peter Pease, who has over 20 years experience in running his own businesses relating to learning and development. 

    In this episode, we’ll learn more about why learning and development is often one of the first functions to go in an economic downfall and what impact L&D can actually have. We will also delve into how successful L&D can be measured and consider the return on investment available to businesses. 

    Subscribe to the podcast on your favourite platform:

    Apple Podcasts

    Spotify

    Amazon/Audible

    Pocketcasts

    Other Platforms


    Episode 14 – Transcript 

    Voiceover  0:00  
    Welcome to Psyched for Business, helping business leaders understand and apply cutting edge business psychology principles in the workplace.

    Richard Anderson  0:14  
    Hi, and welcome to Psyched for Business. My name is Richard Anderson. Thank you for joining me. In this episode I’m joined by Dr. Peter Pease. Peter is a business psychologist and l&d practitioner, who has over 20 years experience in running his own business relating to learning and development. In this episode, Peter talks us through the importance of measurement and evaluating L&D, it’s a subject I’m very interested in, and I hope you’ve enjoyed the episode. Thanks again for listening.

    Peter Pease, welcome to Psyched for Business. How are you doing? 

    Peter Pease  0:48  
    Very well. Thank you. Thanks very much for having me on. 

    Richard Anderson  0:51  
    Well, I’ve been trying to get you on probably for the thick end of a year. But I don’t think our paths have perfectly aligned to do this. But you and I, when when did we? When did we first meet? In fact, I know when it was it was just before COVID? Because we had a meeting, you came into the office and I think it was February. And I thought you were clairvoyant, because you said something along the lines of I think this is going to be a little bit worse than this. This might be this might be a big problem for all of us. And what you were right about that? 

    Peter Pease  1:26  
    Yeah, no, I was well, I’d actually I think just been to Ireland, I sort of finished my PhD, I had a sabbatical. The reason I came to see us because I was looking for a platform to turn my PhD into a psychometric test, because I developed a psychometric as part of my PhD. And I think I just been in Ireland for a week. And we were just in that thing where I think Ireland had maybe just locked down. And I came back from Ireland thinking, what are we doing? You know, why aren’t we? Why aren’t we acting, acting now? And and yeah, maybe that was my anxiety and caution, kind of litigate being on display there. But yeah, I was. And yeah, and I think I was right. But, but I think a lot of other people. Yeah, I mean, I think a lot of other people much cleverer than me, were suggesting that, that, you know, we needed to do something and doing crazy and the thing that was three years ago, now, we’re sitting here on the 22nd of March as we record this, yeah, three years as possible. Yeah. 

    Richard Anderson  2:33  
    Got to know you’ve, you know, very well, I would say over the last three years, we’ve been fortunate to work with you, and you’ve been a, you know, a great contact, referring to me for various different things. And, Peter, it’s funny, because I’m going to ask you to introduce yourself in a second. And I know that you’ve worn many hats throughout your career. So I’m very keen to hear how you introduce yourself. And I know you’ve been in academia, you’ve been in business, and entrepreneur, lots of different things. So who is Peter Pease? 

    Peter Pease  3:02  
    Well, that could take up the next. undefined if you think of that as a kind of a more philosophical question. I’m still struggling with what the? But yeah, so me. I originally did an undergraduate course in psychology at Durham, I graduated in 1987. And then set up my own business in learning and development, which is kind of what I did for the next 25 years. I think it’s fair to say that in the early to mid 80s, we were pretty much taught that in terms of psychometrics, they didn’t have a huge amount to offer the world of business. People like Samsung and Holdsworth, SHL were kind of getting going. And there were some sort of green shoots. So I kind of went into business and into the learning and development world kind of really thinking that, you know, psychometric psychology, you know, it was it was a really interesting thing. I was interested in it, but I didn’t really see much sort of, of practical value, how wrong how wrong was I and as things developed over over the next sort of 2025 years or so, my business trajectory, mainly around learning and development, we grew to at one stage having 120 employees and 1200 learners in a single year. We did quite a lot of public sector UK based stuff. We work with big names like, you know, Nike and PepsiCo. Rolls Royce. We did most things you could think of leadership, management development, a lot of sales enablement, sales training, little bit of stuff around compliance. We also had a recruitment business at one stage and did a lot of IT stuff. As I said, I could go on for a very long time. It’s interesting. I’ll fast track that. 2011 We sold our last lending endeavor. Our business which was actually in logistics and renewables, and that is still going strong, I’m pleased to say. And I decided at that stage that I wanted to do something else with my life. In fairness, I was probably pretty burnt out, we’d had a sort of difficult few years after 2007. And I decided to get back into academia. So I did a master’s in occupational psychology at Northumbria University was that that was good. And we might talk a bit about that, because I decided to do some research around learning journeys and about how salespeople learn. Yeah, that was part of my master’s thesis. And I still use some of that. So maybe we could pick up on that as part of this rambling, rambling conversation. And then I, after my master’s, I played around with one or two other business ideas, try doing something retailing with my daughter, which kind of didn’t really get going. And then in 2015, I landed at Northumbria again, and ended up running with some colleagues, a business startup program for, for undergraduates three year degree program, where they learned by doing rather than by having lectures, very much sort of co-creating the learning. And alongside that I did a PhD, where I developed a model of psychological capital specifically for early startup entrepreneurs. But the model applies equally well to salespeople, to leaders and managers. And I guess just picking up on that the thing I was interested in there was how you measure the stuff that changes, I think, a lot of personality, measurement and a lot of the psychometrics, we do try to capture what somebody is like, at a particular point in time, what I’m kind of really interested in is how we measure the things that change things that we can influence. And there are models around things like psychological hope, optimism, resilience, that you can change over time, but they’re not like they’re not fleeting things like emotions, like, you know, you might feel happy or sad, fleetingly sets these things that are relatively stable, but not as stable as your personality. So I finished my finished my PhD, was working part time at the university. And then I thought about trying to do something with my PhD stuff around business startups and business growth. But that didn’t really kind of take off. And what I’ve ended up doing, I left the University last year in 2022, although I’m still acting as a visiting, visiting lecturer there. I’ve been playing around with learning analytics with measurement and evaluation in learning and development. And we’ve just finished a big kind of piece of research on that, which I’d be really happy to talk about as well. 

    Richard Anderson  8:16  
    Well, Peter, that’s a fantastic introduction, and probably loads to dissect there and a few directions that we can take the conversation, but maybe let’s start at the beginning. I’m really interested in learning, ironically, from you why, why learning and developing because I know it’s an area that you’re hugely passionate about. But But what why l&d?

    Peter Pease  8:33  
    I think it probably started when I was at school. And I would sit in classrooms and and I think I can remember doing this when I was literally nine or 10. And I would assess the teachers, I would see some really horrible, isn’t it? But some of them. And bear in mind, you know, I was at a single SEC school in the in the 1970s and 80s. And We gave our teachers a really hard time gave each other quite a hard time. Yeah. And I’m probably slightly ashamed of some of the some of the antics that we that we used to do. And I do want to tell you one or two stories about that this might not make it to the podcast, but as we say, so if you’ve got a class of 30 children, yeah. And people start making random noises, it can a noise, it can annoy the teacher quite a bit. 

    So what we worked out is that if you hum, you can’t actually tell where the noise is coming from. And we would we would have this thing where different people in different parts of the room would start humming. The teacher would go around the room getting increasingly cross, you know, not knowing Wherever, wherever, wherever noise is coming from. Yeah. 

    So I think I classified teachers into three or four different sorts, that were the ones who were, you know, really fierce, who you didn’t mess around with. But who may or may not have been good teachers, but you certainly didn’t mess around with them. There were the ones who were a bit hopeless, who we spent an awful lot of time trying to distract. And most of them weren’t particularly good teachers, either, because he didn’t learn a great deal, I suppose it’s whether you learn anything, which is, which is what matters. And then there was some in the middle who kind of had this sweet spot where they were, they had a lot of presents, they managed to control the class, they made the topic interesting, they were really good at explaining things in an adaptive way. So that, you know, if I didn’t understand something, they worked out how to explain it to me, so that it made sense to me. But they also managed to make it fun. And there were a small number of teachers who were kind of good at doing that. So when I left university and decided to set up my own business, it wasn’t originally going to be around learning or training and development as we called it, then. But we kind of drifted into that. 

    But it was much more around corporate corporate learning. So there’s a bit of me that I think is kind of always wanted to be a teacher. And certainly when I was at school, we had this kind of Cadet thing. And I ended up being an instructor teaching other people how to how to do how to do stuff in the cadets. And I’ve kind of got that, I don’t know if it’s a genetic thing. But I’ve kind of got that predisposition. And I sometimes have conversations with other psychologists about, you know, whether you’re really into kind of selection, assessment, or whether you’re more into assessment for learning and development. And I’m through and through learning and developments interested in that. And if I’m completely honest, and I’m sorry, if I offend any of your listeners here, I find I find selection assessment, quite dull. It’s just doesn’t do it. It just doesn’t do it. For me, what we’ll have to do is next time, we’ll have to get somebody on the really passionate about selection assessment. And they can say, well, maybe I can just facilitate this, this sort of panel and even talk about why. I just thought no, I Yeah. I mean, I have some of the issues are ethical. But but it’s actually I think more that what what gets my juices going is being with a group of people seeing the light switch on, yeah, helping them to grow. Our company, kind of strapline for that sort of first 25 years was developing human potential. And I kind of feel that we have the potential as human beings, to help other people to develop. 

    Richard Anderson  12:59  
    And, and I think there is, you know, whether it’s as a parent or a teacher or a trainer, I personally think there’s no greater joy, than than being able to do that. Yeah, if you if you can see somebody improve, or somebody grow in a particular area, and you’ve had some sort of involvement with that, I can imagine this, there’s very few things more rewarding. And you see it with kids. And now, you know, as you know, I’ve got two two young children and my elder has come on leaps and bounds recently, I think that in a huge part of the teaching that he’s received, and he’s had kind of tailored learning to his specific requirements and needs. And I think that’s, that’s massively important. So I’m fully with you on on that. And it’s funny with learning and development, because I’ve worked as you know, for some time, not just in Evolve, but I’ve been in this kind of world of HR tech for a considerable period of time, and sold solutions and partnered with organizations in learning and development. But it’s only been very recently where I’ve probably realized the importance of that for our staff. So we have I think, maybe seven stuff soon to be, hopefully soon to be nine. And I think it’s really, really important to have staff go through learning or training programs. But it’s only been recently I’ve decided to do that as previously. I’ve probably seen it as a little bit of a nice to have, do you do you find that that’s quite a common approach or a common sorry, attitude with people that l&d is maybe a maybe a nice to have, particularly for smaller businesses? 

    Peter Pease  14:43  
    Yeah, I think that’s a really good question. So for companies of your size, to be investing as much money as you do in learning and development, I think is is unusual. It’s really good. I think yeah, as you know, we’ve some bits and pieces together on this. And I think I’ve said to you, you know, we kind of had a sort of a team development session. And I’ve rarely seen a team, even in a company as small as yours, which is, you know, so happy. So on political. So, you know, we talk about psychological safety a lot. And you know, you can’t learn if you haven’t got psychological safety. 

    Richard Anderson  15:28  
    So yeah, I think listeners who don’t know what psychological safety is Peter, would you mind just explaining that? 

    Peter Pease  15:33  
    Yeah, so I’m not an expert on psychological. And I know other people, you know, somebody’s doing a PhD on it. But yeah, that’s, that’s a good, good question. So psychological safety, is about having an environment where people feel able to speak openly. And honestly, there’s a lot more to it than that. But it means that if I don’t understand something, I can say, I don’t understand that without feeling that I’m going to get sort of, you know, dismissed or laughed out, it means that if somebody in the team or in the session, is doing something that is upsetting me, I feel like I can call that out. And I can say, actually, you know, that language you’re using, you know, I find that a bit offensive, and nobody’s gonna, you will, will will always have situations of conflict within teams. But it’s having that fundamental trust that you can, you can say what you need to say, without without feeling that there are going to be repercussions. I just Google psychological safety. I mean, it’s it’s becoming a really big thing. And there are various tools out there that you can psychometric instruments you can use to measure levels of psychological safety. Yeah. 

    But coming coming back to the bigger question, learning and development is, I think, really interesting, because if you think about it, when organizations get into trouble, so it might be they get taken to an employment tribunal, or, or it might be that one of the directors, you know, has to leave because he’s done something inappropriate, or she’s done something inappropriate. The solution very often is around training and development. So we have, we have a situation where we will have to do loads of compliance training. Because if something goes wrong, we can then say to the regulatory authorities, we’ve done the training, we’re covered. Yeah. But the but the counter to that is in an economic downturn, learning and development is often one of the functions that gets cut first. And I think that that is often because it doesn’t manage to justify its existence, it doesn’t manage to show that the money that is invested in it actually delivers a tangible return. And it’s not because that’s more difficult to do. So you have you’re pulling together a business case for learning and development, you’re trying to demonstrate return on investment, is it? Is it is it a bit more subjective as it is it is it is really difficult, it’s really difficult to do. And I think that if I go back to the early days of my business, when I was actually sending other people on on training courses, they would come back and they and I would say, Oh, hey, how was how was it? And they’d say, Oh, it was great fun. And I’d say yeah, but did you actually learn any fish? And we did, you know, within within our training and development programs, we created tools, so that people not only filled in a happy sheet to say whether they’d enjoyed it or not. But they actually created an action list of things they were going to do differently, we would audit the action list. And as far as possible, we would try and do some sort of cost benefit analysis within within that process. But it is really difficult to do. Yeah, I went to the ATD conference in the States last year. And there were 18 sessions on kind of impact measurement and evaluation. And one of the one of the sessions I attended, which must have had about 120 people in the opening question from the person running the session was, how many people here collect level one data and by level one data, I’ll say a bit more about that in a moment. That means kind of like the happy sheets the learner reaction, what what in the states are often referred to as smile sheets. Kirkpatrick is level one, you know, so they asked how many people collect level one data and never get around to analyzing it, and over half the audience put their hands up

    Okay, yeah. And I think that tell it is it is difficult to do, even even at that level. But I think one of the promises that we kind of often end up trying to measure the wrong the wrong things. So we put a huge amount of effort into measuring learner learner reaction, not into trying to measure whether or not people’s behavior has changed, and whether or not that has had an impact on organizational input, also, in order to denotational organizational performance. So So, so just so I’ve understood that so the way that we’re measuring the impact of l&d is probably is, we’re probably using the wrong the wrong, the wrong way of measuring it. So we need to be measuring behavioral change, or the the model, the model that’s been used since the 1950s, was developed by somebody called Donald Kirkpatrick. If you talk to learning and development people, we’ve done this big piece of research, I think, out of 300 and odd people that that that I’ve had conversations with over the last year, only one hasn’t heard of. Kirkpatrick Yeah. So the Kirkpatrick levels are our level one learning reaction. Level two is whether or not knowledge has been gained. So people measure that with tests. And I know, with some of your sort of tests that you run for clients who will be measuring, you know, knowledge.

    And I know that your previous company that you worked at, you know, learner assessment was a key part of what has been on the platforms. The third thing is behavior change, okay. And that is, you know, whether or not people have actually changed the way they behave on the job. And the fourth thing is impact on the organization or results. Now, since that model came out, some some other levels have been added. So levels zero now is often referred to as what people get off their learning management systems. Because bear in my back in the back in the good old days, if you wanted to do training, you were sent on a training course. And you then, you know, you either implemented what you learned or you didn’t, or you didn’t understand what you’d been taught, or you did. And it was much more discreet. Whereas now, an awful lot of training, the majority of learning and development is actually delivered through elearning. And it’s fragmented. So you have, you know, which learners go on which courses, how often do they engage with the courses? Do they complete them? Do they progress from this level to the next level. So there’s all of this kind of level zero data just about attendance and completion, which is also in the pot. And then some people called guy called Jack Phillips, in the back 30 years ago, developed a model specifically around ROI, return on investment, which he described as level five. And he ran something in the state school, the ROI Institute. And they do a lot of really interesting work around just measuring, just measuring ROI. But you asked another question, is it difficult to measure? The other thing is that it’s really difficult to actually tease out the effects of learning and development. Okay. 

    So if I give you a tell you a story that so we, we did some work for a brewery in your kind of almost hometown? Yeah. And you eat or that we did some we did some sales training. And over a series of months, and the sales levels went up enormously. And we thought we’ve done a fantastic job. They thought we’ve done a fantastic job, salespeople thought we’ve done a fantastic job. And then the marketing people came along and said, the average temperature this summer was 1.6 degrees higher than it was last summer. So the reason people have drank more beer is because it’s been warmer. Brackets, nothing to do with the learning.

    Speaker 3  24:23  
    So how you tease out the effects is kind of kind of difficult. Yes. So that’s one thing. And then the other thing is, and we’ll I can now bore you a bit with my master’s research is is actually that, that we learn naturally, anyway. Okay. So there’s a model that I know we’ve talked about before, which is kind of like the 7020 10 model, which a lot of learning and development people are using now, which is where 70% of your learning actually just takes place on the job? Yes. 20 Send is kind of through semi structured social learning. And only 10% is through going off on on doing courses. Okay. So how do we how do we, you know, capture all of that? And it’s not easy to do?

    Richard Anderson  25:17  
    Yeah, no, it’s not. And I’m just thinking now, when you’re talking about the 70%, I wonder, and maybe this will take us off on a tangent, maybe we shouldn’t go there. But how difficult it is now that a lot of people, you know, tremendous amount of people are now working completely remotely. And I would imagine that learning and development, and that’s 70% might have been easier on the job when we’re in the office together, and we’re seeing other departments and people and what they do, and I don’t know, anywhere, just that yeah, no,

    Speaker 3  25:47  
    I think I think that’s a really good point. And when we went hybrid or remote during the pandemic, and there were loads of discussions, my thing was just, you know, I kept on banging on about because it wasn’t something that people kind of thought of first and foremost, was the kind of social learning that takes place at work. So if you think about it, so if I go, if I go to my, my masters,

    Peter Pease  26:16  
    I’m cool, because because it because it is kind of relevant is I decided that I wanted to look at the effectiveness of sales training, yes, because my experience was that people would go on sales training courses, and their sales performance would tend to improve, and then it would kind of tail off. And when I looked into it, there’s quite a lot of evidence that we sales training, people go on a sales training course. And it has a half life of about 45 days or so the, you know, over Yeah, over 90 to 120 day, so three to four months, most people’s performance will have got almost back to where it was before they went on the training. And so is that about reinforcement is that about, you know, what is what, what, what is going on. So, what I decided to do was rather than taking a typical thing of taking sales training, and then trying to evaluate the impact is I did a piece of qualitative research. And I interviewed I think about 20, top performing salespeople. And I asked them to about their kind of learning journeys that they had taken from being a complete rookie, somebody who had never been in selling before, to some to,

    to where they were now, which was kind of like, you know, identified by their employer as being one of their sort of top performing salespeople. And it was really, really interesting, because only one person, and okay, and this wasn’t a statistically valid sample here. So you can’t really generalize. But only one person mentioned formalized training, as having had a profound impact interest in his training and development. Quite a lot of people mentioned maybe maybe six or seven mentioned, the onboarding, the induction program that they that they’ve been through. But for most people, the things the themes that came out of it were around trial and error.

    So there was one guy who, who’s started off selling trucks. And, you know, on his first day, he was sent out into the wilderness to sell trucks, didn’t know much about trucks didn’t know anything about selling went into this large, large, large office, we asked who was responsible for buying trucks, and was pointed out to a man in man in man at the end of the room. So he walked up to him and said, Hello, I’m whatever his name was from wherever he was. And, and, you know, Can I Can I, can I talk to you about where you buy your trucks from? And the response was, from the guy sitting behind the desk was eff off. This was literally day one. And and he said, he said, Oh, I was just hoping you might give me five minutes of your time. And the second response was was, I told you, and that was it. So you know, what did he learned from that? Well, I guess he learned an element of resilience. And he carried on carried on gaining, but a lot of other people, particularly people, a little quite a few people working in recruitment businesses, who said they just learned so much from sitting in a room with their colleagues and hearing what they did. And I think probably the most important thing

    I was having a coach or a mentor, who was kind of, you know, who kind of helped them and listened in on their calls and and saw them saw them saw them through it. And have you done any sales training along the way, with any of your training? Please, please do turn it around. Yes, I have done sales training. But I have to admit, I haven’t done sales training formally in a long time, it must be 10 years since I’ve done it. And it was based on kind of more models and methodologies. And it was very much kind of classroom based training. If you like through a through an external consultant, it was very good. And actually, I did it with two lady that I’ve had on this this podcast previously called Jackie, she was she was great. But it was maybe one, one or two days of training, I had a little bit of coaching from from a sales manager in a previous role, but not Not, not a huge amount. But But I mean, I’m not saying I’m the greatest salesperson in the world, and you know, far from it. But I would quite agree to go along with that I think you make you make mistakes, it’s trial and error. And that’s definitely been what I think that’s definitely what’s improved, improve my communication and sales skills generally. But in terms of developing any of your team members have you’re sorry, I thought you met me personally. That’s fine as well.

    Richard Anderson  31:30  
    Yes, so I have because I know the importance of it. So my my colleague will who’s who kind of works in our kind of sales marketing role, he was pretty new to it. So one of the first things that I wanted to do was give him training and coaching. So we’ve worked with an external consultant who has worked very closely with will. And we also are starting to use coaching technology, as well. around that, and I’m about to invest again, in potentially both me and him in a in a sales coach as well, because I know the importance of it. And it doesn’t matter how experienced you are or how old you get, I mean, I’ve made countless mistakes, and I’ll have a lot of bad habits that need addressing. So yes, sorry, that’s a long answer to the question. And not not at all. It’s a good, but I think and I wonder if you resonate with this, and we’re not. Sales is a small part of what I’ve done sort of sales training, but but I think it’s quite interesting, because it’s sort of very much in the moment, and you kind of get, you know, you either have a result or you don’t. But I think I always find most difficult. And I wonder if you do too, is when you go on a joint sales call or sales meeting with somebody is actually being able to sit back and let them mess it up. Yeah.

    Peter Pease  32:54  
    And, and I had occasions where I mean, I actually did this professionally with a with a with a with a sales team, for a client, and I would go out on calls with these people. And when they got to the point where I thought, well, they really have lost the sale here, I would come in and kind of rescue it. Yeah. And then when I did the feedback session afterwards, rather than and I just kind of say, you know, what, how did that go? Rather than then saying, Yeah, well, I got, you know, I didn’t quite do this. And I was, you know, it was really great. They typically say, Well, you know, when you came in and you said whatever I was just about to say that. 

    And, and so actually learning to sit on your hands and see somebody else fail effectively, I think is incredibly difficult, but incredibly important. I fully agree. And it’s funny as you talk through customer my memory back to my very first sales job. And it was for a company that sold software resources in education. So it’s education resources for a specific subject within education. And we used to go into schools and pitch that it was very much a kind of pitching a product. It was a product, we do all of the qualification beforehand. And I remember going out with my all sales director, a guy called Stuart Horton, who was fantastic news, it must have influence on me.

    And he sat there as a car crash this presentation to this group of teachers, and it was bloody awful. It was I was just at a presentation skills were poor. I couldn’t command the room. I couldn’t answer the questions that were asking me and he sat there and he was brilliant II could stand up in front of anybody and he would have them you know, wrapped around his little fingers. He was one of them was just a great salesperson and and he just sat there and said nothing. And I must have thought he must be mortified if you’re watching me, you know, this car crash. But um, but he did that really, really well. And I have to say it was good for me. It was good for me that he let me do that because I got to learn from the experience and got his feedback afterwards. We didn’t win the day.

    But But there you go. So that is important. We had we had one, somebody who I’m employed to do tele sales, yeah. Years and years and years ago. And so I’m just going to say that I had a message saying we lost connection. So So I had somebody who worked for me years and years and years ago, in telesales. And we brought in some technology so that we could record phone calls. Hi. So I actually recorded so this is in the days of cassette tapes, which some of your listeners might not even know what they are. So so we had it, and I listened to her sales calls, on the way into work in the car the next day, and I almost crashed the car. absolutely appalling. So what I did, and I don’t know if this was the right thing or the wrong thing, but I gave her the cassette, and I let her go into a room, and I let her listen to it for half an hour. And then I said to her, after we sat down that she looked absolutely ashen afterwards. And I said, what what do you what are your thoughts? And she said, Peter, I think you should fire me.

    And it was really, it was really sad. But it was so powerful, it was so much more powerful than anything I could have said or done. And actually, she turned out to be absolutely fantastic. And, you know, grew out of the role I had for her in no time at all into a face to face selling role and then left us and went on and did amazing things afterwards. But going back to this master’s research, yeah. And, and one of my key thoughts from that, is that human beings are our learning machines.

    So what we, what we need to be doing is enabling people to learn, not teaching them stuff. So if you look at your children, and you look at how they learned how to walk, you know, there wasn’t an awful lot that you could have done to to help them do that. Other than other than kind of make sure there weren’t too many sharp objects around, encouraging them, you know, maybe sort of holding them up a little bit. But they’d have done that anyway, they’d have clambered up and then headed off and fall now. Think about how you learn to ride a bike and different people do it in different ways. But you, you know, you don’t do a lecture on the dynamics of know how to ride a bike you there’s a lot of trial and error. Certainly, you know, we tend to use balanced bikes now, which we didn’t have it have in my day. But then think about driving a car. And, you know, there you then you know, formalized training does become more important, you do need to have theory and knowledge. And so it kind of becomes it kind of becomes more complex. And I think part of the challenge for us is to work out what bits we can do that actually make that actually make a difference. And, and if I kind of bring this back to psychometrics. 

    I think that where psychometrics can really help with learning and development is kind of in helping people with self awareness. So, you know, I’ve got clients and and I know you’ve got clients who use tests, psychic psychometric tests as or assessments to help their learners inform their journey. Yes. And I guess the thing that I’m still playing around with developing is how we also then create assessments that people use to measure to measure progress. And if you look at a lot of the assessments that learning and development people design and use, that they’re not psychometrically valid, not there. If you look at the competency models that a lot of people use, you know, they don’t have any predictive validity. They’re just a string of kind of kind of words. So one of the things that that I think is sad is that there are far fewer occupational psychologists or business psychologists in learning and development than there are in all certainly encountered or mainstream l&d There lots of them acting, do learning and development roles like coaching, but in terms of working with main four main sort of workforce development, there are far fewer than that in that area than there are in than there are in selection. And I think, you know, by bringing our kind of measurement skills to learning and development, this

    Richard Anderson  40:00  
    A huge amount that we can add to the process. Yeah, yeah, I quite agree. And it’s only been, like I said, within your support and those with this, but but on evolve that, we’ve started to try and formalize and try and put something in place when it comes to learning and development, because I think that’s something else as well. It’s a little bit of a, I guess, a minefield, or it’s a bit of a, it’s a huge challenge as a small business owner, when you know, you have to do these things. But if you’ve never done it before, where do you where do you start? And I know that you’re really passionate about small business and startups, and I think kind of applying these techniques to small businesses is as important as it is, for these, you know, large businesses with l&d functions and divisions. 

    Peter Pease  40:47  
    Yeah, no, absolutely. Absolutely. And, yeah, and I think that, you know, there’s a, there’s a kind of science that, that, that psychologists and, you know, kind of evidence based mentality that we can kind of bring that, that perhaps, you know, add something to, to what other learning and development professionals can bring, can bring as well. That’s really interesting. So I know that you’re also doing, and I’m keen for us to briefly discuss this, before we finish off the podcast, you’re doing some other research or some ongoing research projects into this area, you happy to talk through what you’re doing on that front? Yeah. So as I’ve kind of worn down from the university, and looked at measurement and evaluation within learning and development, I’ve ended up you know, talking to loads of people, I’ve been off to conferences and expos. And I kind of feel like, nobody’s really got all the answers on that. So what we did back end of last year is we did a piece of research, quantitative research, with learning and development leaders in the UK, and North America, and Ireland. And we’ve got 350 people completed, completed that it accounts for more than 2 million employees worth of of learning responsibility. 

    Richard Anderson  42:18  
    And some kind of really interesting thoughts and conclusions from that. I know, we’ve discussed that we might kind of look at that in another episode. Yeah, absolutely. I’ll be slightly running out of time now, but but there’s some really interesting stuff coming coming out of that if you’re if you’re interested in how you, it’s not just about measuring the impact of learning and development, but it’s about how you can collect data from your learning and development, that then then helps you make better decisions so that you spend your learning and development pounds and dollars better in the future. sounds really interesting. We’ll definitely do that. We’ll get another podcast. And if you’re hoping to join me, I’ve really enjoyed this one. So we’ll definitely do another one.

    And I guess just to just to run things up, Peter, in that case, if anybody wants to discuss any of these topics in a little more detail with yours, give our guests the chance to see where where people can contact you. I’ll put I think as part of this podcast, we always put a blog post up there with a transcript. Are you happy for us to put your your link to LinkedIn on there? 

    Peter Pease  43:28  
    Yeah, no, that would be fine. Or and my email address as well very happy to talk to anybody kind of informally about about kind of learning and development type of type of type of matters. And I guess it wouldn’t be right if I didn’t finish off by you know, asking listeners a couple of questions. So so I just like you to think back on what you’ve just listened to. And ask yourself, What’s one thing I’ve learned from this session? Secondly, what’s one thing I might do differently as a result of listening to this session, you know, because I’m a teacher, and I can’t help myself. 

    Richard Anderson  44:04  
    Brilliant, what a perfect way to end it. So Peter Pease, thanks ever so much. Really appreciate your time. And thanks for joining me on Psyched for Business. Thank you.

    Voiceover  44:14  
    Thanks for listening to Psyched for Business for shownotes resources and more visit evolveassess.com

  • Psyched For Business Podcast Episode 13

    Psyched For Business Podcast Episode 13

    Episode 13:
    Building the foundations for a progressive organisation in 2023 with Richard Wood

    Richard is joined by Richard Wood from The Ready, who is a business psychologist and organisational development and leadership consultant.

    In this episode, we’ll learn more about how to support individuals and organisations to become better places or better at their jobs. We will also delve into how organisations are set up, alternative ways to structure them and the best steps to take for a modernised workplace. 

    Subscribe to the podcast on your favourite platform:

    Apple Podcasts

    Spotify

    Amazon/Audible

    Pocketcasts

    Other Platforms


    Episode 13 – Transcript 

    Voiceover  0:00  
    Welcome to Psyched for Business, helping business leaders understand and apply cutting edge business psychology principles in the workplace.

    Richard Anderson  0:10  
    Hi, and welcome to Psyched for Business. I’m Richard Anderson. Thank you for joining me. In this episode, I’m joined by Richard Wood from The Ready. Richard is a business psychologist and organizational development and transformation consultant. In this episode, Richard outlines how progressive organizations have a very unique way of working. And he talks through some of the steps that can be taken to modernise the workplace in 2023. Thanks for listening. Richard would welcome to Psyched for Business. How are you doing?

    Richard Wood  0:40  
    I’m good, good to be chatting to you, Richard,

    Richard Anderson  0:42  
    Great to be chatting to you too. And obviously business psychologist, organizational development and leadership consultant, I know that you do some great work. You’ve been living abroad for a few years. But I’ll let you give your own intro. And I think you know, as far as this podcast is concerned, I think we’ve got a really interesting topic. And you’ve got a really unique and interesting approach to how you support individuals and organizations to become better places and better individuals at their job. And I know that you’ve got a very unique question that you’re asking, we can get into the ins and outs of that throughout this podcast. But if you’d be happy to maybe give a little bit of background first Richard, if you tell us kind of who you are, and what you do,

    Richard Wood  1:19  
    I’ll try to keep it brief so you can get into the the juicy stuff. So I’m Richard Wood, I said business psychologist, psychology through my life, from a levels to university to my post grad for quite a few years later, especially focused on occupational Organizational Psychology, like the psychology of work and business and how people show up inside the organizations where they spend a lot of their life. That’s where I am now that a lot of my journey workwise happened in China, I was in China for 14 years, coming back in 2020. Back to the UK. And that was fine. I did a lot of stuff in education, teaching English teaching international college programs, and then moved into consulting when I found my kind of passion of leadership and organizational culture and employee engagement and psychometrics and that type of thing. And then continued in that individual development place like management, development, leadership development, those types of things for finding a new area of born out of frustration with like how things are looking at how things could be I looked at the future of work, new ways of working different ways of organizing. And then that led me to where I am today at the ready and doing consulting for different companies on how how they can work better and how to evolve and make progress as an organization as a whole. So focus on the organization now, and less on the individual.

    Richard Anderson  2:36  
    Fantastic. And how different was it working across in China to over here?

    Richard Wood  2:40  
    Massively different. And I found the question slightly differently, how different is it working in the UK to working in China because most of my career is there, like a third of my life has been there. And most of the previous years he was when I was a child, but that really count. Everyone emphasizes the the differences, obviously language and culture and all of the visible things. But there’s a lot of similarities. When you start talking about work, you know, there’s hierarchy, and there’s internal politics, there’s communication is how they show up is different, but the themes are really, really similar. Saying that, you know, training was a big challenge to learn how to operate inside a new environment, not just the language, but how things work is really different. And I’ve had the reverse culture shock coming back here where the paces is slower in getting things done, in some ways, but also it’s less chaotic and sometimes more more predictable, which is has its benefits. So you might might take longer, but you get exactly what it says on the tin.

    Richard Anderson  3:36  
    Yes, of course. I guess in future it might open up additional working opportunities across both nations as well and obviously you’ll be fluent no doubt in Mandarin.

    Richard Wood  3:48  
    Yeah, I am. That’s something I’ve worked at as a way to become an independent functioning human inside that environment. I didn’t have to rely on other people to help me do things. Yeah. Plus using it as a working language once I got to a certain level I landed on the streets in a taxi and the restaurant but also did some formal learning as well as a as a foreigner in a Chinese University education program. So I felt that as well which gets you into the culture as well because it’s a Chinese style of education.

    Richard Anderson  4:14  
    What was the most useful just out of interest because I’m not having an okay level of French I did that to a level of very, very basic level of Spanish but I’m by no means I mean, I couldn’t barely hold my own in conversations, but I would imagine the informal conversations will be almost as useful as the formal stuff is that fair?

    Richard Wood  4:32  
    It is fair because that’s what you’re doing day to day, like going to the shop to find something in the supermarket or asking directions and just having a chat getting to know someone is is always the first step so building relationships needs chitchat or casual conversation. I think that is the key view it can be really good at their professional stuff, but no one wants to talk to you because you haven’t connected them getting where you want. You’re not winning, you’re gonna lose gonna lose out on that one. Also, they’re very forgiving. The Chinese are very forgiving for a foreigner speaking the language made. So it’s kind of a surprise, a shock, also a really pleasant experience like, oh, wow, someone has made the effort to say, yeah, if you say hello, thank you people were like, wow, you speak Chinese, you’re so good. If you actually string a sentence together, or a paragraph or do a speech or a training session,

    Richard Anderson  5:14  
    it’s often the other way around. Because obviously, this English is the international language in the the business model. And everybody, you know, uses English, but Well, yes, that’s why I’m always in awe of anybody who can who can speak other languages, fluently as I am of people who speak English, when the name of the speaker of the language is so brilliant. So getting back to the kind of the juicy part of the podcast talking about organizations and how they work, how they operate. And you mentioned something before, and I made a quick note of it. So how things are at the minute, versus how things couldn’t be. And I know that you’ve done a lot of work around kind of how organizations are set up traditionally and historically versus how they could be set up in the future. So tell me a little bit more about about how you look at organizations and how they how things could be within organizations,

    Richard Wood  6:00  
    there’s so much here, if you look at some of the historical reasons why the organizations are like they are, it can be quite troubling, look at workers don’t get to make decisions, because they weren’t considered to be smart enough to make decisions, they just get told what to do. And that’s the birth of management almost like we will tell you how to do this manufacturing process, because we designed it the way we think can be done better. And you just learn that and repeat it. And it takes away the autonomy, and the agency from the the individuals. So if you look at that, from a manufacturing point of view, and then that gets replicated inside what we call an alcohol knowledge work, the same thing that you need to do this process, do it this way, because of compliance because of quality control. And it takes away innovation and takes away the chance for new possibilities and ways to make things easier. So there’s a lot of load, inside of cognitive load inside people’s work. That is not actually the work, it’s thinking about all of the things that are constraining or holding back or guiding the work, which isn’t necessarily what grown up adults need. They’re just like a space to be able to work and know where they’re going and what they’re supposed to be doing that run free. You know, they can they can, they can figure things out and maybe find new ways or better ways, or that’s the basis of it. Also, when we do a presentation, at the end, we have one slide and it’s what’s this, and it’s an organizational chart, you know, Organa gram, and you’ve got the little boxes and the lines going down and down and more and more boxes as you go further down and ask the question, when is that from? When is this picture from and people like I have a guess that you can’t see it, but you can picture it in your mind.

    Richard Anderson  7:36  
    I can imagine. I’m gonna say it was quite a while ago, I wouldn’t I guess but yeah, 50 years, maybe 60 years.

    Richard Wood  7:43  
    It’s the one that shines like 100 years? Well, luckily, 110 over 10 years now. And then what’s the difference? For one for 2022? Pretty much nothing. Yeah, everything else we’ve done has changed in those 110 years. We communicate how we travel, how we live or the devices we have. But if we still organize or represent our organization in exactly the same way, something’s amiss, the society has changed, cultures have changed, technology has changed. All kinds of things have changed because of the interdependencies between those different things. I think why is it kind of impossible for me that that the organization’s haven’t evolved at the same in the same way at the same rate?

    Richard Anderson  8:24  
    Yeah. And we just accept that it’s the way that things are. It’s just the way that an organization is set up. And I guess that that’s probably for anybody who wanted to start a new business tomorrow there would probably follow that structure of that diagram that we’re talking about. Yeah,

    Unknown Speaker  8:38  
    Exactly. So you look at some people say that I’m a startup. And that’s great, because you don’t have all of the baggage of 100,000, people and organization, all of the bureaucracy and all of the layers that come with it. But if you take the same approach, it has the same problems, it just might not kind of manifest themselves immediately. Because if you’ve only got three people, it’s hard to have a big hierarchy, but it’s still there, the foundations are still there. So if you kind of if you feel good start as you mean to go on, it’s easier to design well at the beginning than it is to try and change a company when it gets when it gets really, really big.

    Richard Anderson  9:12  
    And I would imagine and correct me if I’m wrong here, Richard, but I would imagine a lot of its knowledge. I mean, I started, we could even talk about my company. If it will be useful, though, you know, we’re a small outfit, we have seven staff and I guess we would loosely follow that broad organizational structure of which however many 1000s of other companies do already but but for me, it’s maybe a knowledge piece as well. So what are the alternative ways of looking at how I can structure my organization? And I guess what would the questions be that you would go into an organization and ask people in order for them to help change or maybe look at how that’s set up? The first thing

    Richard Wood  9:49  
    is, it’s not the chart necessarily. That is the problem if it’s like this is the structure of where things are. There’s just there’s a certain value to that because at least it’s it’s written down is visible people can refer to it, if you believe that that is how information flows and how work gets done. That’s quite different. Because the value flow from department to department is not, it’s not shown that how the work gets done is not shown in an organizational chart. So that’s just where people sit or who’s reporting to whom in, in a chain of command type of approach, which has a certain value, but if it’s the only way you look at it, it’s the only lens you have, then then it’s more problematic. So that’s part one is kind of disclaimer, too. I, there’s nothing inherently wrong with that unless you Yeah, no, no, no, you did. And that’s what happens inside the organization. Or we can’t do this, because it’s in that box, not my box. And that’s only because there’s a box, yeah, why do these things have to go into two separate boxes. So you know, familiar with, with silos, if you create a silo, then a silo is there if you break that down or work across silos, so one of the things we do inside already, and there’s other approaches to this, there’s holacracy. And so sociocracy is based on on circles, just to change your shape, maybe. But also, it’s not because there’s distributed authority inside a circle, and it’s not layered upon layer, there might be a, an overarching circle, that includes the heads of all of the different circles for making the organizational wide decision. So like, the head of the head of the hiring circle, the head of the training circle, the head of the psychometric circle, all come to gather inside the master circle, so to speak, of a super circle. And it’s a different way of organizing, because there’s more equality of the distribution of power, and people are close to the decisions that affect them. And it’s very clear line between what they can and can’t decide what they are or aren’t responsible for accountable for. So it’s, we have this authority, and we have this amount of money that we can spend as this circle, if we need more, we have to go one step further up. And you can be on multiple circles, you can have multiple roles. So there’s just more dynamism about it. And imagine a whenever the round Knights of the Round Table, if you’re, if equal, you’re looking at each other, there’s no one that’s necessarily at the head, someone is the head of the circle, that doesn’t necessarily mean that the person with all of the power, they might have certain rights that are afforded to them, because they have been elected into that role. But they still can also be deselected from that role, and somebody else can be nominated. So it’s much more dynamic, where the role is not your job. And the role is one of many roles that you have, yes, you feel as needed by the organization, or how the team or the circle believe you’re still serving the purpose of that group. If that changes, you can change the person. So it’s much less less fixed, more agile, more nimble, more flexible, whichever word you’d like to use. And maybe that’s hard to imagine. But it can work. And it takes a lot of effort to change from one to another or to start like that at the beginning.

    Richard Anderson  12:54  
    Yeah, I can imagine it would and just trying to visualize and kind of picture those circles as you’re talking. Now. I think the fact that there’s more dynamism, the fact that it’s more agile, I guess, one of the things that I was thinking about, as you were speaking, there is quiet quitting, which is this popular term that we we all hear about, I guess you’re if you’ve got silos, and you’ve got a very rigid structure to your day, and this is what you do and nothing else, you’re more likely to probably experience or quiet quit. And maybe if people have got more responsibilities or more dynamism, or the ability to work across multiple teams, or have different roles and responsibilities across the organization, there’s going to be more buy in to the organization from its staff. Is that Is that something that you found? Have you found that people become more engaged employee engagement increases for things like that?

    Richard Wood  13:42  
    I think that’s right, because partially, there’s the choice, you can choose to a certain degree where you would like to go, which circles you’d like to be what role you would like to take inside circle or whichever structure you you have. And sometimes you be involved in the co creation of defining what that role is, what what is its purpose, what are the accountabilities? What decision rights does this role have? And once you’ve decided to it, and everyone has consented to it, then if you there’s also built into that, and if you don’t do it, you how you will you will be held accountable. And it’s not about how many hours you’ve done or what output you’ve got, it’s the results that are the outcomes that you’re looking at on the role level and on the team or the group or the circle level. So once that’s been defined together, steering as a group, people, do you feel more ownership because they literally have that and it’s not if there’s a mistake and you fail you, you will be gone? It’s like no, it’s the collective responsibility of, well, how do we solve that we didn’t hit our targets therefore, something is getting in the way or we’re not doing something we could be and that’s continually have life cycles of learning and evolving how we are doing this. So we can better enable us moving in the right direction towards the goals that we’ve set. So it’s, it’s a change of mindset as well. It’s not just our being engage is also being fully accountable and putting things down. So you can enable yourself to continue to be engaged. If you’ve defined that yourself, and you define it in a way that doesn’t inspire you, then you’ve set yourself up for failure. I mean, who would do that? Well, yeah, very few people, some people would, but very few people will do like we believe people inherently want to do good work. They’re motivated, they don’t want to go to work and not work. But choose the wrong place, or they’ve been hired into the wrong position. If there’s a problem fairly early on in the funnel. If they’ve been selected correctly for the right kind of role, then they want to do the work. And they want to do well, because that’s how humans do it.

    Richard Anderson  15:38  
    That’s what why and of course it is. Yeah. So if you’re going into an organization, Richard, and you’re speaking to the leadership team, or whoever it is that you have these initial conversations with, and you’re looking at an organization that’s maybe done things that traditional or the old school, we’re talking about that that kind of chart from 100 odd years ago, what are the telltale signs for you, when you’re speaking to people that would lead you to believe well, actually, this is we may need to modernize this, this organization.

    Richard Wood  16:06  
    A lot of times people are, they’re stuck. As in, we’ve tried all kinds of stuff. We’ve tried culture change, we’ve tried training, we’ve tried a whole host of other consulting interventions and things aren’t happening, or we had, we made some progress. And now and now we’re stuck in our head of reorganization, and we’ve got a new structure a core. And so you’ve got the What have you got that the how, if you’re, you’re stuck and talking about people aren’t doing this, they aren’t doing that. If you’re blaming the people, well, that’s interesting, because people can only do what the system or the you know, the environment allows them to do. If you allow them to not do anything, then that is something that will happen if you have a place that nourishes them, and they can find the way to do the work in the easiest way to get better results, then that will also happen. So we talked about the fish in the aquarium. So if you blame the fish for what’s happening in the aquarium, it’s like, well, if it’s around aquarium, you can only swim in a circle, you know, it changed the shape that people can swim slightly differently. So if you, even if you take the fish out to learn something new, and they come back, they can still only swim around around around in a circle. So you have to look at both of them. If you want to massive change, and you need to change the environment, change the aquarium change the system change where people are actually doing the work.

    Richard Anderson  17:25  
    Yeah, because when I was doing a little bit of reading, before this podcast, it was that as part of the article, it said, you know, leaders might blame members of staff, the staff might say we’ve got the wrong leaders in place. But if we’re not going to change, fundamentally the system itself, then this is gonna go on in perpetuity. Yeah.

    Richard Wood  17:44  
    And the blame is difficult when it’s easy to get into the blame game. But saying like, people are lazy, they just don’t do it is visible, someone’s not doing it that you can probably deny that. But the reason why and the root cause are really sometimes difficult to identify what is actually causing Richard to not hit his sales targets, is he rubbish at sales, or as our product rubbish or our prices wrong? It’s like possibly none of those things, it might not be so, so tangible, something completely different. They spending 25 hours a week filling out a spreadsheet to report to somebody who doesn’t read a spreadsheet about how many hours you spent talking to clients like it can be that like, Well, why is that? Why you’re saying well, because I spend too much time filling out stuff about sales when I’m not when I should actually be out selling? And it’s okay, that makes sense. Why don’t we stop doing that? Okay, let’s stop doing that. Oh, you sound more? Okay. It’s very simple to say. But it’s hard to break down some of the processes that are already there.

    Richard Anderson  18:44  
    Yeah, of course, that was a brilliant example that you said about sending the spreadsheet, somebody is not going to read it because we’ve all seen and heard of these things happening in organizations. But one of the things that really gets me is so many meetings and meetings about meetings and meetings about a meeting about a meeting. And I would imagine that, you know, I’ve seen that happen in small businesses, I would imagine it happens a lot in larger businesses. I mean, if you tally of all the times that are all the time that it takes to have all of these wasted meetings, let’s pull it I mean, if you started quantify that, and think how much money that’s going to cost longer term, I mean, I would imagine that’s crazy.

    Richard Wood  19:18  
    Yeah. And you pull on meetings, it’s a good one. It’s a lot of where we start when we have an intervention with a client, because it’s when people get together. It’s also there’s too many meetings, the wrong type of meetings, the wrong people at the meetings, meetings, to prepare for meetings, all of these things. And also, if you got an executive team, or all of the people are on X, hundreds of 1000s of dollars a year and you got 20 of them in the room for two hours a week. That’s been really, really expensive if, especially if it creates no, no value. So one of my pet hates on a personal level is the Monday morning update meeting. Well, you’ve just come back from the weekend. Yeah. So you want to hash out what happened last week? Who you updating for? Why does it have to be a meeting? Is there a better question? Is there a better time for that meeting? I mean, I wouldn’t put it on Friday afternoon, either that’s just find a time or even do it doesn’t even need to be a meeting, could it be done using modern technology or something else? So I think the Monday morning meeting can be a killer. I mean, there’s there’s always exceptions, that could be a well designed meeting on Monday at nine o’clock, just because that’s the only time people have they then do that. But not just to satisfy the boss’s curiosity that everyone has been busy last week, expect them to remember what they’ve done last week, on the Monday morning, before they’ve had their first cup of

    Richard Anderson  20:39  
    coffee. And then it becomes habitual. And everybody’s doing it every single Monday, and nobody wants to be there. And nobody’s really listening. Anybody else is up there. They’re just waiting for the chance. All of that sort of love to me been sitting original job doesn’t always happen like that. But there’s all of those things that to probably for that. So again, if you’re if you’re talking about these things on an organizational level, and you’re trying to dig deep when you go into an organization to find out what are the barriers, and why do we feel stuck? How do you go about doing it? Do you speak to individual contributions and leadership teams? How does that,

    Richard Wood  21:11  
    how does that work, but don’t try to do the same thing for every single member of the organization at the same time, it’s too big, and you won’t get anywhere that would be the takers, but also, on an individual level, possibly too small. So I like the A team would we’d like the unit and engaging multiple teams, depending on the scope of the work, and keep it small, so and safe. If you’ve got eight people, 12 people, if they do something slightly different in a organization of several 100, several 1000 10s of 1000s, then it might even be a blip on the radar. But it could be the place where momentum starts to start small, get people doing different things. And then from that, Team A who do they work with most closely at teams BCD. And then kind of you go out there and some people like it seem to be getting good results. What are you doing? Or are your team seem to be happy and productive? What are you doing differently? Just kind of pique the interest of the people around you that way? You’ve seen everyone’s different? You didn’t? Yeah, we didn’t do all of that kind of supervisory management stuff. You seem to be doing lots of enabling things like how does that work? And just just is a natural, sometimes is an organic way of that progressing? Sometimes you kind of need to be saying like, are you worried it a lot that’s going to discuss how you can work better with it? Because yeah, it’s not there yet. Somebody has to be really explicit that they do that, because there’s an interface there that is struggling, and everyone’s frustrated. So let’s get it all out on the table. Like, why are you frustrated are because of this and that, alright, let’s find a way to overcome that and see what see what works. And if it works, then we go to the next thing. If it doesn’t we we try something else

    Richard Anderson  22:46  
    is that about having an open forum where people can speak very candidly and very openly about some of the challenges that they come across in the workplace, because one of the things that we do a lot of as you would imagine this 360 feedback and part of 360 feedback is that there’s a prerequisite that certain parts of it, have an element of anonymity there. So you know, you can feedback on your manager, but you don’t necessarily want the manager to know who those individuals are. How do you kind of navigate that part of the process?

    Richard Wood  23:15  
    Yeah, that’s a really good question. And there’s no right answer here, because it’d be cool to start where they are, if the team are in that area, and that mindset that psychological states where they don’t feel that they can be totally open. Yeah, then go with some anonymity of, well, you know, ask that question, what’s holding you back from doing the best work of your life? And just people know the answer to that? Will they share the answer that is two different things, people know what annoys them will get gets them down? You know, what, you know, some extreme cases are what makes them cry on the way home from work, you know, they know what court is causing that. And if you can find a way to get that out onto a set of sticky notes or shared document where you don’t know who’s done what, and just like, oh, wow, seven people said they feel stressed out about doing the annual budget thing, because because it’s theater. All right, well, that’s a signal. Of course, it doesn’t necessarily mean it’s the answer, but it’s a signal. Okay, what’s behind that, and then you dig into that. So using some of the tools online collaboration tools mural, for example, we use quite a lot inside of Microsoft Word document on online or Google Doc or something where you don’t have to show who’s doing what you can just get the things down there. And it doesn’t have to be done verbally, it doesn’t have to be done live or synchronously can do it asynchronously, which helps sometimes really anonymity if you don’t know who went in where, but it can really get some of that stuff out. At the same time. You need to build the space and the environment of the group. So it’s easier to share those things proactively at the time when they’re happening not let’s wait until the next big intervention or the best big workshop is I will how can we make it so it’s easy to do that? There’s no answer to that for it depends on on the team, the selection of individuals, exactly what the issue is, but there are a selection of approaches that you can do to get at that.

    Richard Anderson  24:59  
    Yeah. Oh, brilliant. So I would imagine one of the things that you’ll do if you’re collecting all of this information, you’re giving people a forum for feeding back about what’s, what they’re struggling with, or what’s holding them back in their roles, you’re inevitably going to end up collecting lots of data, whether that’s sticky notes, whether it’s mural Word docs, whatever, what like, what do you do with that data? And how can you go about taking that data and Megan recommendations, as a result of that, there

    Richard Wood  25:26  
    was something called the operating system, Canvas. So people are familiar with operating system on your phone, same kind of thing. But for organizations, and this is a tool, I’ll briefly briefly introduce it. So it includes 12 dimensions, or 12 fields of the canvas, which have been found to cover a lot of progressive organizations do things differently in these 12 areas. It’s not the only things that that are done differently inside progressive or evolutionary organizations. But it’s 12 are the ones where a lot of them are doing things differently, for example, purpose and strategy, workflow, membership, compensation, these types of things. And we might color code as well, like, what are we doing? Well, it’s not just what’s what’s going on? And what are we doing? Well, what are we doing? Okay, what are we doing? Not not so well, and map it on the canvas? And like, oh, look, actually, our meetings are mostly yellow, so they’re okay. But authorities is, there’s a hell of a lot of red. So we kind of that is our problem. And that’s like flashing warning flags here. And you look at not just what the like, for example, the sticky notes, say, but you look at where they land. Okay, we have a, we haven’t potentially have an issue here in authority. But it might be that the root cause of that comes from inflammation or strategy, because what showing up as a problem with authority that I don’t know how I can make decisions, it might just because you don’t have a clue what decisions need to be made, not because you don’t have the actual authority to make the decision is just that the strategy is lacking clarity. So it could be I don’t know if I can make that decision, I understand what I’m supposed to be doing. But I’m not sure I am allowed to. So you have to kind of dig one layer down into Oh, really? What is that? And this tool, the canvas is one way of just making sense of it to to organize or structure the input as a sense, making tough what is going on? What does that show us about the themes and the underlying root causes of the good things? And not so good things about how we how we are working? And then we say like, would we make recommendations? Yes. But would we also say, Okay, what, what can be done about this? And that’s a hard question at the beginning, because the same thing, I don’t know what can be done, like, just pick something that you think you can’t do? And then let’s see if we can just do that, or something that you’re doing, you don’t want to do? Can we just stop that? What is the smallest thing we can possibly do based on what we’ve seen, I don’t know if I can make a decision. Alright, so you can choose not to make the decision. Or you can just to make the decision and see what happens. And if you all agree like Oh, for the next month, we’re just going to make the decision, we think is right and see, if we’re still alive at the end of the at the end of the month, as long as I like business critical has to be safe. So it’s not going to bring down the entire organization, but it’s within a certain boundary or certain constraint, just don’t make that decision. So it’s like

    Richard Anderson  28:02  
    experimental things that you would progressively monitor over a period of time, something you’ve never done before that you could try and see what the impact is.

    Richard Wood  28:09  
    Exactly. And it’s about experimentation that what is the the tension about the problem? What is the practice that we could do? So the tension is, I don’t know, whether I can make decisions, practices can be alright. Either you clarify what your decision rights are, which takes quite a lot of effort. Or it could be just try making the decision. And the experiment would be let’s do that for four weeks, six weeks, 12 weeks? And then we do a retrospective like that. What difference did that make? Did that unblock the work? Or did that cause more problems? And doesn’t mean if it cause more problems? We don’t do it? So well? What are the other problems? And what do we do with those and just keep on covering and this like the snowball effect, it could feel overwhelming, it could be that at least I have a small piece that I know that I’m trying something with. And just to build that sense of autonomy, about a half, I get this one thing. And then there’s other things that I will ignore for a bit. And then once this is been tested, we either go again on the same issue or we go again, on a different issue, because that one is under control. It’s good enough.

    Richard Anderson  29:08  
    Yeah. And of course, I guess the alternative to not experimenting or not doing these things, whether it’s recommendations or experimentation is that things will remain the same. And there’ll be no progress next time. Because one of the things I was thinking, Oh, well, how much pushback do you get from organizations to implement new experiments and those types of things? But I guess and I’m not deliberately answering my own question here and jump in, is if you’ve been commissioned to do the work in the first place, then there must be at least often to an element of change.

    Richard Wood  29:34  
    Yes, I must say yes. And no is one of my favorite answers. Like, yes, there’ll be someone who is like, yeah, we need to try something different. We, we understand that and people are good. We’re really open to experimentation and like, okay, cool. We really want the team to do an expert. Oh, hang on. You want the team to do experimentation? No, no, no, no, no, no, no, no. Also you like also you should team you. If you don’t experiment with giving away some of your power. That you kind of expect other people to suddenly suddenly Magica this extra power that you haven’t given up, because you those things are in conflict with with each other. So it sort of kind of that’s quite a simple way of looking at it. But it is it is important that. So that’s where we come up sometimes like, oh, no, no, not not me. Yeah. But no, no, that’s number one. Let’s start there. Like, yes, you are you collective view is where we’re starting in not, you versus them. That’s, that probably is one of the dynamics we’re trying to, we’re going to cut down on. Yeah, that

    Richard Anderson  30:29  
    makes total sense. Then you talked before about progressive organizations. Normally, I know that you didn’t use the word adhering to the operating system, Canvas book, but kind of align themselves more to the more traditional, I’m using the word traditional, again, you know, I’m probably using the wrong terminology. But you know, where I’m going with that, what makes an organization have the appetite to go from that more traditional, old fashioned model, if you’d like to be coming up progressive model, and maybe looking at things like the canvas as it is a productivity, because you give the example before it was a really good one, when you said that people were felt stuck, and they’ve tried a lot of different things, and nothing seems to be working? What’s the real kind of the straw that breaks the camel’s back to for somebody to get in touch? And say, Look, we need some support. Is it outpour? Is it employee engagement? What What kind of causes people to engage your services?

    Richard Wood  31:22  
    That’s a good question with quite a few answers. So broad, broad stroke things as good imagine that it could be are that the pulse survey or the employee engagement survey showing that stress levels are high or workload is too high, or people are thinking of quitting. So that’s the kind of the people side of things could be a trigger for that could be business outcomes. We’re trying to achieve something big, we’ve got all these massive targets or objectives that we’ve been given. And the way we are working, it hasn’t done the done the business yet. So it’s we are striving for something business. And we need something radical, because business as usual, is not serving us anymore. Does that realization of I can’t do this by myself. So that’d be a leader of a business unit or a project team or a whole whole organization, aren’t there? That’s, that’s not right. But you’ve never heard this before, the pandemic had a big impact as well, like, because when that happened, everyone started going doing virtual meetings. And it brought up quite a lot of opportunity for our well now, in London, we’re doing all these meetings online. So why don’t we just include London and Paris and Frankfurt, and even Singapore and like, that just becomes a standard. And that’s a whole new way of working. So it creates an opportunity also created a whole heap of challenges. So we thought that was a cool idea to finally do this cross functional, international grouping to get all of these experts together working on on a team tickets spot that was inspired by agile or something, but we don’t know how to do it. And we need someone’s help with the with the ways work, how do we set up the team? How to run the team? How do we know it’s working and with that, so a brand new clean slate that we we know we need to do this, and we don’t know how it’s just complete helplessness or despair, complete data that trigger there, because of the situation we’ve been thrown into because of external factors.

    Richard Anderson  33:10  
    Of course, I think that, you know, the fact that the pandemic came about, and that we completely changed the way in which we work and abroad was forward however many years quicker than, than we were expected to move forward. Anyway, it’s probably, I don’t know whether this is true on the whole, but I guess a lot of more, a lot more people see new ways and innovative ways of working and experimentation is maybe they see it as less risky now than they might have done at one time, because they’ve seen how much things have changed when we’ve been kind of forced into working in a particular way and how productive a lot of people have become as a result of

    Richard Wood  33:43  
    that. Yeah, and it brings about some of the things you’ve already broken the traditional model, in a sense, so if you don’t know how it’s supposed to be then you have the opportunity to deliberately and intentionally designed how it how it will be. If you do that in a more collaborative or human, more people positive way that a unit believe that people can do it, if you give them the space, then that will bring something else because you can’t look over someone’s shoulder when their shoulders are 1015 miles away 100 miles away so you like Deuce do something else. You can’t just walk up to someone at the coffee machine when it’s not there. And then when you go back to the office you can keep keep some of those some of those things like oh, we should have a set rhythm of meetings because we we have this for needs and we kind of mush them together in this terrible meeting. Why don’t we have like the coordination meeting and the one where we get stuff done and then the one where we talk about the communication with the rest of the organization you can have different way of thinking and organizing the work means that just build up new hassle and muscles and habits have this new way of working on it. It will almost by osmosis just seep into the ways of working no matter where it started if it started in the face to face or it can go into the yeah Virtual advisor and vice versa.

    Richard Anderson  35:02  
    Brilliant. So what do you find Richard the most rewarding when it comes to bringing about organizational change? Because I would imagine changing anything is going to be hugely rewarding if you’ve supported in bringing it about, but is there anything in particular, any examples that you might have of things that have felt really rewarding?

    Richard Wood  35:21  
    There’s a couple of things that stand out actually. One is like when people call you out on kind of violating one of the principles that you introduced to them, like, oh, hang out, that doesn’t seem to be yeah, like I call you, you’ve now you’ve now passed you’ve graduated from? Because it’s, there’s different principles we talked about, you know, like default to transparency like you didn’t share that in advance you know, you didn’t that was that was on your computer, not in a shared document, you didn’t share the link like, okay, cool. You are, you’re right. And it’s that call out because you know, that someone is taking it to heart and it’s not somebody else telling them that you remember this. The other ones are like the reflections of people that have been doing stuff for a while and say that this has changed my life, not just my work. So one example would be, we have this safe to try principle. People don’t just use it at work, like is this idea is this proposal? Is this experiment safe to try they use it at work that we’re going to buy a house and we need to re mortgage the house? And like, Is this safe to try for us and they do it with husbands or wives or partners and children and stuff? Like Well, that’s that’s cool, because it isn’t just about work. These these approaches can be used anywhere really, as long as it’s, you know, people feel you’re a bit quirky in a bit strange, but that’s okay. Because it does. It gets you in the right conversation. Like is it cetera? I’m not sure I’m feeling uncomfortable with XYZ. Cool. Let’s have a look at how do we make it safe to try or we can’t afford a house that much. Let’s bring the price down. Okay, now I feel, you know, take 50,000 Off the top price range. I feel more comfortable with that. I think we can afford it that okay, cool. A lot people don’t communicate, but they’re making it really explicit. And watching people just run with it and do it in their own their own ways is really, really cool. And then they like, report back whenever I catch up with them. Like, yeah, I do it like this. And I do that with my mom and the dad. And it’s really funny. Like, okay, cool. I unexpected, tangential experiences that they they create themselves. No, absolutely.

    Richard Anderson  37:11  
    Fantastic. Brilliant. Just to kind of finish finish up, Richard. I’ve loved the love the conversation. And I think we’ll finish on if you’re happy just to talk a little bit about the ready, maybe and and yourself and how you can support organizations. I know that obviously we’ve talked throughout this podcast around that and do the thing I was going to ask is, is there any way that we can point people in the direction of more information on the operating system canvas? Because I know that it’s a nice document that’s downloadable that people can can look through as well?

    Richard Wood  37:39  
    Sure, yeah. So the ready is a future of work consulting company. They’re doing organization design and transformation in the form of workshops and advisory services and full on transformation services. So that’s good for different sizes of organizations and scopes of work. And what that entails is, as you can imagine, from the conversation, all kinds of stuff. So we would really, we’re really interested in speaking to people who are like passionate about changing the world of work, changing how they work. Not that we have all the answers of what you’re supposed to be doing. But we can help with that. How are you going to get there? How can you do that in a better way that less friction more smoother, more human friendly, that’s everything. So go to the ready.com If I can plug another podcast on your podcast the the brave new work podcast on Apple, iTunes, and any anywhere you get your podcasts from, and from me look me up on on LinkedIn. Richard would that’d be good. And I’ll share a link to the article that has the operating system canvas, which explains what it is and it gives you the ability to download and that’ll be that’s a medium workspace that already has it has other articles and other interesting pieces that people might want to have a look at.

    Richard Anderson  38:51  
    Fantastic. Well, Richard wood, thank you very much for your time really enjoyed speaking to and we’ll catch up soon. Thanks, Richard. I really enjoyed the chat. Thank you. Me too. Take care.

    Voiceover  39:00  
    Thanks for listening to Psyched for Business for show notes resources and more visit www.evolveassess.com

  • Psyched For Business Podcast Episode 12

    Psyched For Business Podcast Episode 12

    Episode 12:
    An extrovert’s journey to starting a solopreneur coaching business with Josh Jeffries

    Richard Anderson is joined by Josh Jeffries, a self proclaimed extrovert who started his own coaching business.

    In a world where distractions and the fast pace of life have made it harder for us to listen to each other, Josh believes that coaching provides a sacred space where people can be heard and listened to deeply.

    As an extrovert, Josh initially struggled with his impulse to speak during his coaching training, but he was challenged to suspend his judgment and practice deep listening, a skill that he believes is essential for an effective coach.

    In this episode, we’ll learn more about Josh’s journey and the insights he has gained throughout his coaching experience. So sit back, relax, and join us as we explore the power of listening in coaching, and how it can benefit entrepreneurs and business owners. Thank you for tuning in.

    Subscribe to the podcast on your favourite platform:

    Apple Podcasts

    Spotify

    Amazon/Audible

    Pocketcasts

    Other Platforms


    Episode 12 – Transcript 

    Voiceover:
    Welcome to Psyched For Business, helping business leaders understand and apply cutting edge business psychology principles in the workplace.

    Richard Anderson:
    Hi, and welcome to Psyched For Business. I’m Richard Anderson, thanks for joining me. In this episode, we’re joined by Josh Jeffries, who is an extrovert, who started his own coaching business. We find out why he did that, and some of the things that he’d found out throughout the experience. I hope you enjoy, thanks again for listening.
    Josh Jeffries, welcome to Psyched For Business. How are you doing? Thank-you for joining me.

    Josh Jeffries:
    Yeah, no, thanks for having me. I’m good, thanks. A little bit disheveled. Got a toddler who’s not sleeping very well, so apologies for the eye bags. But yeah, I’m well.

    Richard Anderson:
    You never have to apologize for anything like that with me, Josh. I’ve been through that twice myself. It’s a difficult time, but a fun one, isn’t it?

    Josh Jeffries:
    It certainly is, yeah.

    Richard Anderson:
    Fantastic. Well thanks again Josh, for making the time. I’ve enjoyed getting to know you over the last few weeks. I know that we share a number of things in common. I know that you’re an extrovert. You started a business. You’re a solopreneur, as I was at one stage. We’ve both got toddlers. There’s a lot that we’ve got in common.
    I think for the listeners, they’ll be really interested in hearing more about your journey. That’s obviously what this podcast is going to be all about, you taking us through that journey. But as a bit of a start, would you be happy to tell us a little bit about yourself, and how you got into the world of coaching?

    Josh Jeffries:
    Yeah, sure. I’m originally from Oxford. Now a south Londoner. Which is touch, being an Arsenal fan, so usually I’ve spend a lot of my time north of the river over the last few years. But now I reside in south London. I’m married to Ellie, got a little daughter. I’ve been coaching full time, coaching for about seven years. It’s quite an interesting route in, I suppose.
    I first heard about coaching through a friend of mine who invited me up to Scotland, to work on his estate. Which sounds very bougie, but my mate was the office manager on a consultancy up in Scotland. He was training as a psychologist, and as a coach. I went up to work the grounds during my first summer as a student. I was just working the grounds with this groundskeeper in Scotland, which was unbelievable. It was on Loch Tay, up in Perthshire.

    Richard Anderson:
    Lovely.

    Josh Jeffries:
    Yeah, so it was incredible. I didn’t really know anything about coaching. I think like a lot of people, I didn’t really know coaching existed as a profession. When I heard about it, learned a bit about the psychology behind it, some of the theories behind it, and what coaching could do, I was just fascinated by it to be honest. I knew, I think I was 21 at the time, I knew then that if there was any chance that I could become a coach, then I would take it. So I did. That was my first exposure to it.
    Then I went to uni, went through uni, and then I worked for an amazing charity in London, actually as a trainee coach. So my first experience of coaching was working with young people at risk of social exclusion. So 16 to 25 year olds who were out of work, and struggling just in life, and struggling to get back into work, or into education. Essentially we would recruit them at job centers, and then onto a six week pre-employability course. We’d coach them in groups, and one to one, to help them with mindset. Help them with CV writing, with interview preparation, with job applications.
    A lot of mindset though is really helping them actually get job ready. So that when they actually get into work, they can sustain employment. Then we would also coach them for a year after they got into work, to help them sustain employment. An amazing charity, I still follow them today. I’m still in touch with lost of people who work there. They’re called Spear. Well, the charity is called Resurgo, but the Spear program is where I worked.
    During my time there, I did a course called Coaching For Leadership, which was essentially a crash course in coaching. Actually, to this day, it’s hands down some of the best training I’ve ever had. Even after seven years of doing it full time, it was amazing. So that was my introduction. A window into coaching up in Scotland, and then it was an opportunity to actually start coaching with Spear. Then I did that, and really fell in love with it, and knew that that was what I wanted to do.

    Richard Anderson:
    I think it’s brilliant as well, at such a young age. You said you were 21 when you went up to Scotland, and you did that. It’s nice to know what you want to do, and stay true to that, and obviously you’ve done that. You obviously had a stage working for other organizations in coaching. You’ve mentioned one already. But then you’ve gone off, and you’re now a solopreneur, so you started your own business, earlier on this year? Back end of last year?

    Josh Jeffries:
    Yeah, March this year, yeah.

    Richard Anderson:
    March of this year, brilliant. You’ve called it Capital Traits. Why don’t you tell us why you’ve called it Capital Traits, and what’s it all about?

    Josh Jeffries:
    So just quickly going back, after I left Spear, I joined a company called Acre. They’re an amazing global recruitment consultancy, who operate in sustainability. They had a learning and development that they had just launched. I’d been there for two years in a recruitment capacity, so training as a recruitment consultant. Just cutting my teeth in the world of sales and recruitment, which is good. Good fun.
    I got an opportunity to join their L&D startup. It was called Acre Framework. So I joined them after two years at Acre. One of the first things I did as part of my training there was to take some training with SHL’s occupational personality questionnaire, the OPQ. Which is a trait based psychometric tool. So we would use the OPQ. We also had a bespoke competency framework, which we used to support leadership development. We would assess people, give them feedback on their results, and help them formulate a development plan with that.
    Then from there, we grew out a coaching business, which I helped to spearhead. I did a transformational coaching diploma with Animas, which is a center for coaching. So I had this psychometric qualification. I had this coaching diploma, and then did that for five years. I absolutely loved it. Over the course of my career, and a relatively short one, I appreciate, but I’ve had exposure to different assessments. Type based indicators, trait based indicators, Myers-Briggs insights. You name it, I’ve been through it.
    I just fell in love with the OPQ as a really powerful tool, which I felt was a really good launchpad for an amazing conversation about self awareness. About personality. About working styles. About strengths, development gaps, all kinds of things. I’d never used it as an in or an out, too predictive a measure, or definitive a measure, but as a launchpad for a conversation.
    I really enjoyed the world of trait based assessments. So when I came to start my own business, I was thinking about names, and what do I want to call it? I thought, “Well, Capital Traits made sense,” because I guess you could say my business is about helping people to capitalize on their key traits that make them uniquely them. We all have capital traits. Traits that come more naturally to us, that make us uniquely us. I think the more we can play to those, whilst also of course growing your self awareness, and mitigating things that don’t come so naturally to us, the more effective we can be, and the more likely we are to thrive, in life and at work. So Capital Traits had a ring to it, and I just went for it.

    Richard Anderson:
    It sounds brilliant. It rolls off the tongue, and makes complete sense when you explain it. You started talking about psychometrics, so I wouldn’t mind touching on that for another minute or two, if you’re happy to. So trait based tools, type based tools, I’ve actually recorded a couple of these podcasts where we’ve looked at the differences between these tools. It’s a really interesting topic, for anybody who’s not familiar with type versus trait.
    But you mentioned the OPQ, the SHL occupational personality questionnaire. What do you love about that particular tool? When you say it acts as a launchpad for discussion, in what capacity? How does that normally work?

    Josh Jeffries:
    Yeah, so most of your listeners will be way more familiar with this stuff than I am, to be honest. I’m not a psychometrician. I wouldn’t call myself a psychometrician, because I don’t have a clinical or business psychology background. I’m a bit of a black sheep, to be honest. I’m a coach who trained with how to use the OPQ.
    What I love about it is that it doesn’t put anyone in a box. Maybe that’s a bias that I have. I don’t like being put in a box, or being told that this is who I am. I’ve seen it in the past, where that can be a little bit dangerous. I think personality type tools are super interesting, and actually usually very accurate. My concern with them is that people start over-identifying with their types, or the caricatures that they’ve been placed with.
    I’ve seen it before. It becomes a self fulfilling prophecy. People are like, “Oh, I’m so red,” or, “That’s such a yellow thing to do. That’s so blue of you. Oh, you’re a classic ENFP,” or whatever. This is not me slighting those type based indicators, because I think they’re great and useful. I just think they’ve got to be taken with a pinch of salt.
    What I like about the OPQ in particular, is that puts your personality on a continuum of one to ten, based on reference. There are 32 different behaviors, so it’s quite granular. It’s quite light touch. It’s not too deep and predictive. I’ve seen it evolve over time as well. How you report on the OPQ depends on where you’re at, your mindset, the environment you’re in, how candid you’ve been with the questionnaire. So there’s a number of factors, and it can change. It can evolve slightly. Some things don’t evolve much, because we are relatively fixed in some ways. But some things do change, if you’re intentional about them. I just feel like it gives you quite a lot of room for maneuver. Quite interesting to work with.

    Richard Anderson:
    It’s coming from a place of genuine curiosity, because I’ve never sat the OPQ. It’s funny, because you said before, “I’m not a psychometrician. I’m not an absolute expert in psychometrics.” But Josh, we’ve developed a psychometric platform, and I’m nowhere near as expert as I probably should be in these things. It’s fine to talk about the technology, from my perspective, but when it comes to the ins and outs of the tools, so it is just genuinely interesting. I think I could probably do with sitting a number of these types of tools, and maybe having some coaching delivered myself.

    Josh Jeffries:
    I’ll pay one out to you and Matt.

    Richard Anderson:
    There you go, fantastic stuff. Brilliant, okay. So what I’m really interested in, and I probably should have asked you this before, but I’ll ask it now. You talked, how you got into coaching, and how your initial experience or observation of coaching. What do you love best about it? You mentioned trying to get people into jobs before. Was it the satisfaction of them getting into jobs, based on the coaching that you provided them? Was it that? What do you love best about coaching, Josh?

    Josh Jeffries:
    So I’ll give you quite a philosophical answer.

    Richard Anderson:
    Go for it.

    Josh Jeffries:
    I’ll be interested to hear if you agree with this or not, because it could make for an interesting discussion. But I’m of the feeling that generally in life, in society, we’re getting worse at listening to each other. I think there’s a number of factors. We’re constantly distracted. Our phones, digitalization, work emails, life is busy. The world’s uncertain and volatile, and complex and all of that. It’s pretty hectic times. I think there’s a knock-on effect on the quality of relationships. There’s a knock-on effect on the quality of listening. I’ve felt it, certainly as a friend. Just the way, from what I observe.
    What I love about coaching is that, it is this uninterrupted space, where people get to speak. They get to think out loud. They get to be listened to, and listened for. I listen to my clients, and I listen for my clients, and it’s deep listening you’re doing. Clients love it, and I love it. I’ve got a coach that I see once a month. Selfishly, it’s my time just to brain dump, to think out loud. To bounce ideas back and forth. To have my assumptions challenged. I just think it’s a wonderful, quite a sacred space.
    The answer really, what do I love about it, is I find it’s an incredible privilege to hold that space for people. If what I think is true, that generally we’re getting worse at listening, then as a coach, I get to hold an amazing space for people to be listened to. That’s a profound privilege.

    Richard Anderson:
    Yeah, I think that’s a great answer. You asked me what I thought, whether I agreed or not. I certainly do. I think listening skills, they’re not what they once were. I wonder how much of that’s down to mobile phones, and being addicted to things like Instagram, Twitter, and whatever it might be. That you just become immersed in your phone. Therefore …
    I was listening to a podcast fairly recently, I can’t remember the name of the podcast. But it was along those lines, where it was talking about listening skills, or concentration skills, or skills that have to be practiced. They can’t just be taken for granted. I wonder how much mobile phones and computers, or whatever it might be, are having an effect on those skills that we probably should have just naturally, but maybe struggle with. So I do agree with that. Would you therefore say that, for a coach to be effective, you need to be an incredible listener?

    Josh Jeffries:
    Yeah, 100%. This is funny though, because I think in a way, my coaching training was exactly what I needed to help me, with respect to my natural preferences and personality type. I’m an extrovert. We’ll talk about this in a bit. I’m an extrovert, but I’m also really outspoken. I’m quite chatty. I interject, or try not to. But yeah, I interject, I speak up. I’m quick to speak up. I have a lot of ideas. I get very energized, and very passionate. So actually, when I went through my coaching training, I was massively struck and challenged by my impulse to speak.
    Actually, it was a real disciplined training for me, to bite my tongue. To suspend my judgment. To really listen, and listen at a deep level, and do what they call third person listening. Listening to and for, and from different perspectives. It’s quite a deep practice. It was exactly what I needed.

    Richard Anderson:
    Third person listening? Sorry, Josh, just dissect that. What does that mean, please?

    Josh Jeffries:
    Yeah, so third person listening, there’s me and you. There’s what would be called a transactional conversation. I speak, you speak. Then third person listening is almost like you’re the third person in the room, observing what’s being said. You hold a more objective position to the exchange. So as a coach, you practice third person listening, or global listening some people call it. There’s different terms for it, but it’s essentially listening on a deeper level.
    So when I say I listen to you, and I’ve listened for you, I’m listening to what you’re saying. But I’m also, as I get to know you, and according to my intuition, etc, I’m listening on your behalf as well.

    Richard Anderson:
    Yeah, brilliant. So a coach has to be a superb listener. What do you think about the coachee, or the person who is being coached? How much do they have to be willing to talk? Do you find that that’s ever an issue? Because I think we hear a lot these days, particularly when it comes to our mental health, and fitness, and those types of things, that people aren’t willing to speak. Do you find that that’s ever a challenge? Is that a prerequisite to having good coaching? I’m listening, but you’ve got to have someone who’s willing to talk?

    Josh Jeffries:
    Yeah, definitely. It’s interesting, because when I first started coaching for Acre, when I was at Acre Frameworks before, it was a slightly different business model to the one I operate. We would partner with clients, big clients, often with global teams. The client would make coaching available to a whole team. An amazingly generous gift to give to your team. “Here’s six sessions to use with a coach.”
    It was really interesting, noticing the people that would jump at that, and take it up, and others that you would have to nudge and chase, and say, “You haven’t booked in a session. Would you like to book in a session?” It just went to show for me, that some people, they’re a bit more, not suspicious, but they don’t feel they need it. Or they personally find the one to one space a little bit intimidating, or a bit much. Maybe it’s just not what they need right there, in that moment in their life or career, so they’re a bit more hesitant or whatever.
    So yeah, you do. So I’m a bit different, in that I wouldn’t sell a coaching package now, and make it available to a whole team. Or prescribe coaching, and say, “You’ve got to go to six sessions.” Not that Acre did, but it’s a bit different. I really want to work with people that really want to work with me, and really value the space.
    But equally, I think some people need a little bit of a nudge sometimes to open up. I’m working with someone at the moment who took me up on the offer of coaching. He came and asked to do coaching. But actually, in our sessions, for the first few sessions really struggled to speak freely. Just because he’d never had to do it before. He’d never done it before.
    You can create as psychologically safe an environment as you like. You can be as approachable and friendly as you’d like. But some people, it just takes time, and actually you just need to go at their pace. Just because you’ve got a session, it’s confidential, and no one’s going to interrupt you, doesn’t mean you’re suddenly going to start going for it, and bring loads of ideas and goals to the session.

    Richard Anderson:
    Yeah, of course. I think the reason I ask that is because, I’ve told you this fairly recently, I started some coaching myself this year, for the first time ever. It wasn’t until I was sat in the room with my coach, who’s been absolutely brilliant, and sat down with her, and was asked questions, or given the opportunity to have a forum there to speak. Even until I was in that situation, I thought, “Well this isn’t going to be for me. Why would somebody coach me? Am I good enough to be coached?” Maybe there’s the imposter syndrome that kicks in. Or, “I only need a coach if I’ve got a massive worry that’s in the back of my head.”
    But now, I genuinely would encourage, based on the experience that I’ve had, anybody to go and seek the services of a coach. Because I think there’s always areas that you can improve. It might be imposter syndrome for one person, and it has been for me, and catastrophizing. I’m very open with these things, so I think it’s important to talk about a worse case scenario, which is often with business. What if there’s a problem with a business? Or difficult conversations, or whatever it has to be. But I think it’s massively important for everybody.
    But one thing that has always struck me, and I don’t know how much you see of this, or even if you’ve got a view on it. But coaching is often reserved for leadership within a lot of organizations. A lot of the budgets go towards developing leaders, rather than individual contributors. But I can see the merits of putting it across the business. Josh, I don’t know how you feel about that?

    Josh Jeffries:
    Yeah, you’re singing from the same hymn sheet. Just quickly, on what you’ve just said about what you bring to a session. What’s really useful, so in your sessions you might want to do some journaling before you go to your session. Because it might help you to formulate your ideas. Ultimately, sometimes it’s just nice to go into a session, blank canvas, see where it goes. I find sometimes I do that with my coach, and it’s great. I send out coaching preparation forms for some people, because we’re all different. We all think differently-

    Richard Anderson:
    Yeah, of course.

    Josh Jeffries:
    Some people like to reflect and write, and then they come and they share their ideas. Coaching ultimately is different to counseling. Coaching, it should have a fairly forward momentum to it. There should be a thrust. There should be some goals. You should know, a coach and a client should know what you’re aiming for. It’s usually good to have a bit of a game plan, or some goals, objectives, and a bit of preparation really helps that. So I would always encourage clients, if you’re seeing a coach, you get out what you put in, so go prepared for your session, knowing what you want to talk about, as often as you can.
    Then yeah, on the latter point, yeah, I’m totally with you. My strap line, or my mission, and I’ve recently come up with this mission. A few weeks ago, it dropped into my consciousness. I was like, “Yes, that’s why I’m doing this business.” It’s to democratize leadership development. Capital Traits exists to democratize leadership development.
    What that means is, it’s exactly what you’ve just said. Coaching is often a luxury reserved for senior professionals at the twilight of their careers. Don’t get me wrong, that’s great, because as leaders in your businesses, you are the culture carriers. You’re often the gatekeepers of the business. You role model a lot. Often what you role model is going to form and shape the culture and the environment of your business. So it’s hugely important that leaders are getting coaching, and are growing in self awareness, etc.
    But I’d say potentially more important is that you develop a culture of coaching in your business, by making things like a personality assessment and coaching accessible to as many people as possible. If you think about it, the earlier you sew that into your business, over time you’re going to reap the benefits. It sounds a bit harsh on leaders, or senior people, and I don’t mean it this way. But you could argue that by the time you’ve reached a certain point in your career, you’ve been successful, and you’re now a leader in a business. Spending loads of money on leadership teams, and investing heavily in leadership teams, sometimes can be a little bit of a wasted resource.
    Because leaders are successful for a reason, right? They’re there for a reason. But they maybe haven’t all got into those positions because of their natural leadership ability. A lot of them have gotten there because of longevity, and because they’re experts in their field, so they become leaders in the business. Maybe they’re not thinking so much about culture, behaviors, how to develop a coaching culture and a leadership culture. They’re maybe not thinking so much about that. But they’re business leaders in their own right, and they’re great.
    So it’s, you’ve got to do both, I personally think. You’ve got to do both. I think the businesses that do more at the junior level, at the entry level, and really sew in at that level, will reap the benefits. The only problem is, as you know, coaching is just ridiculously expensive a lot of the time. Personality assessments are so expensive. So it makes it really difficult for businesses to invest in making coaching accessible to everyone. But that’s one of the things that I’m trying to change. I don’t think it needs to be as expensive as it has been.

    Richard Anderson:
    I know that you’re hugely passionate about that, and I completely agree with you. I love that, coaching-

    Josh Jeffries:
    I sound like a sales person if you get me-

    Richard Anderson:
    No, I-

    Josh Jeffries:
    … like I’m selling it, if I get too into it. But it’s crazy what people are charging, and I don’t think it needs to be the case.

    Richard Anderson:
    No, absolutely. It’s funny, when you talk about coaching culture, because again, not to labor the point. But until this year, when I started my own coaching, and I saw the benefits, and reaped the rewards and the results of that, where I thought, “Well, if this is working for me, why can’t this work across my team?” Obviously we’re a small business, and one of the things that you’re always thinking about as a small business is expenditure. How expensive things are. Return on investment. All of that stuff. I know what the return on investment on these types of tools are. But I guess not everybody will know that.
    I think part of the reason that I know that is because I live in this world, and we work with a number of different coaches, and people who, L&D practitioners, and those sorts of things. But I think for small businesses as well Josh, in particular there’s massive opportunity out there for people to buy into that whole coaching culture.

    Josh Jeffries:
    Return on investment in L&D is the white whale. Even really seeing L&D practitioners that I’ve spoken to, I’m talking 30 years in the industry, leading L&D for some of the biggest companies in the world. Even they really struggle to tell a really compelling story on the return on investment for L&D. Because it is quite abstract, ultimately. It’s always going to be difficult.
    You often see relatively vague statistics about engagement levels, and productivity, and that kind of thing. But really, the proof of the pudding is in talking to people. It’s in qualitative insights around how people are feeling, how they’re performing, how they’re doing, what’s changed? Then you will, if you track it, you will see the return on investment. But yeah, it’s challenging.

    Richard Anderson:
    It is, absolutely.

    Josh Jeffries:
    Having to quantify, yeah.

    Richard Anderson:
    Of course. You’ve given some really good insight so far, Josh, into the world of coaching, and how you got into that. But I’m really interested in why you’ve started your business, and why now of all times?

    Josh Jeffries:
    Yeah, well it was a really bizarre time to start my business, actually. I mean on paper. On paper it was a bizarre time. It wasn’t bizarre to me. But from the outside in, it might look strange. I’m really lucky to have had a really amazing relationship with my former employer. I still work with Acre in an associate capacity. I don’t have a bad word to say about them. They’re an incredible business, and I had an amazing relationship with my previous line manager as well, Anna Keen. I’ll make sure I send this to her, so she hears this. But yeah, so she was a great mentor to me, and a formidable businesswoman. A great role model.
    She and I had a very transparent relationship, in terms of where I was going within the company, where my ambitions lay, etc. So it was really open and honest. I told her years ago, that I wanted to start my own practice one day. We used to talk regularly about it. It would come up in what we called alliance conversations, which was appraisal conversations. So we’d check in on it every now and again.
    Then in my fifth year, sixth year working with her, we just sat down. I said, “I think it’s time.” She said, “I had a feeling you might say that,” and said, “What can we do to help?” It was really freeing, actually. We agreed an end date, and I launched. So I was really lucky. But in terms of why, there were a few factors.
    I was working from home, like the rest of the world, or many certainly in professional services. So I was working from home, in my spare room. I’m a massive extrovert, and I wasn’t getting any of the benefits of being an extrovert in the workplace. IE, I wasn’t going in, seeing my team. I wasn’t in the office having water cooler chats, as the Americans call it, or just coffee chats, or after work beers, which I used to love. So all the benefits of being an extrovert in the workplace had gone, with lockdown and work from home and stuff.
    I found myself actually really busy with work, and I was spending a lot more time one to one, over camera, doing virtual coaching or assessments. It was just a case of, “I could be doing this for myself. I’ve always wanted to do it for myself. Why don’t I just do it?” It was a weird time, in that I’d just lost my mom. It was really out of the blue. A really tough time for me and the family. But the silver lining meant that we had a modest windfall coming, some inheritance coming, and I knew that there was a safety blanket coming for me and my family, that meant that for the next year, if it didn’t work out, I could afford to pay for the heating, and put food on the table if need be.
    So I had this security blanket. I thought, “Do you know what? Now is as good a time as any.” I had a vision for it. I’d always been thinking about what it would look like, what I’d do. So I just went for it, and it’s been amazing, honestly. It’s been so cool. Loved it. I love being a solopreneur. I always get that name wrong, as a solo business owner. I think I-

    Richard Anderson:
    Yeah, [inaudible 00:29:23].

    Josh Jeffries:
    But yeah, not without its challenges, as you and I have discussed.

    Richard Anderson:
    Yeah, of course. It’s brilliant that you had a really supportive previous employer in Acre as well, that knew that that was your dream, and that was your aspiration and ambition, and supported you with that. Obviously you’ve still got a great relationship. I think that’s massively important. I had a very similar experience with my previous company, a company called Perfect Image, since we’re naming names. A couple of those guys might listen to that, who knows? But yeah, I think that’s massively important.
    You mentioned the fact that you’re a massive extrovert. So I guess it was, you might as well be doing this for yourself if you’re not getting those benefits. Like you say, that’s really-

    Josh Jeffries:
    Kind of, yeah.

    Richard Anderson:
    Yeah, that’s really interesting. Being a massive extrovert, and now being a solopreneur, which I think is the right term. It sounds good anyway. You’ve said it’s been a fantastic experience. But is there any element of working for yourself that you have found difficult, given that you are an extrovert?

    Josh Jeffries:
    The obvious one, I work in a garden office at the bottom of my garden. An amazing little space we’ve created. Sometimes I just wish there was someone just over there, that I could just have a quick chat with, or distract. I was on a webinar recently with a psychologist called Nikita, who I really admire. Again, it’s important that we nod to people that have played an impact. Had an impact-

    Richard Anderson:
    I know Nikita.

    Josh Jeffries:
    Oh yeah, he’s amazing. I learned so much from him. But he was saying, he was describing extroverts as like meerkats. He said you can always spot an extrovert in the office, because every now and again, they’ll just pop their head up above. Just see who they can distract, just for a couple of minutes. I was that guy. I love coaching, I love the one to one stuff. I like to think I can be disciplined when I need to be. But I also love to just have a quick chat, distract someone, have a laugh. That’s what I miss. I really miss that.
    I miss, I’m getting better now, but I miss having a network of like minded people in the same boat as me. I’m going now, finding those people, and joining network groups and stuff like that. I’ve found a guy who was a friend of a friend, who we meet up with every couple of weeks now. We meet up and work in a BrewDog, Waterloo, which has a coworking space. So we’re there together. Which is always dangerous, because you work in this coworking space, and then the bar is just downstairs. But it’s so fun.
    When we work together, I actually get loads done. But we’re in the same world. We chat psychology. We chat assessments, and startup life. It has just been great working with him. His name is Mike Brown, might as well say that. Hello, Mike. Yeah, so that’s the main one. How about you? Because you’re now, you’ve got a team, but-

    Richard Anderson:
    Yeah, we do now. I have a team now, and I was very keen to get one as soon as I was able to afford one, really. That was the crux of it. When I started, as you know, I’ve got a co-founder, Matt. But there was only me full time at the business for quite some time. I would say probably for the first, maybe eight months or thereabouts. Because I’m an extrovert too, and I’d been so used to being office based.
    When I was working from home at the beginning, when we started Evolve, that was in the days where it wasn’t normal to work from home. Most people worked at … I won’t say it wasn’t normal, but the majority of people in my world worked in an office, so I found that really difficult, because everyone was, my wife was going out to work every day. Friends were always out and about at work. I was moving from the bedroom, to the kitchen, to the dining room where I worked. I was in a really small dining room. It wasn’t set up as a-

    Josh Jeffries:
    Did you have kids at this point?

    Richard Anderson:
    We’d just had our first. He was three months when I did it. So is there ever a right time to do it, Josh? There you go.

    Josh Jeffries:
    Yeah, I know. No.

    Richard Anderson:
    You could say there’s never a right time.

    Josh Jeffries:
    But that you described there, with a three month old, moving from the dining room to the kitchen to the spare room, whatever, that is one of the toughest things about working from home, I think for anyone. Everyone’s got their challenges. I had a couple of mates who were in flats with housemates, and they only had one communal area. So their kitchen and dining room was quite pokey. They worked in their bedroom, and they lived in their bedroom basically. So everyone’s got their challenges. But I think parenting during lockdown, and starting up your own business, must have been very interesting.

    Richard Anderson:
    Yes, it was very interesting. It was very difficult. I didn’t, or I don’t, I do now actually, because the kids are in bunk beds, but I didn’t have a spare room. So I was working basically in the kitchen. We’ve moved houses, and I should have probably thought, given that I didn’t really have a spare area the previous time, I should have just gotten a bigger house. But anyway, there you go. That’s another story for another time. But yeah, working in the kitchen, and then having, at the time, a three year old as he was, and a fairly newborn. Because my second was born in May 2020, so right in the middle of lockdown. So that was good fun.
    But I have to be honest, Josh. As soon as I was able to go back to the office, I took the opportunity. So in the July or August, or whatever. I took the necessary precautions, but I just needed to get out of the house, and get a bit more normality. So what’s the plan for you, as time goes on? I don’t know whether you’ve got one of those five year plans in place or whatever. But I just mean in terms of they next year or two. Do you think you’ll look to recruit? Or will you stay solo? Or coworking spots permanently?

    Josh Jeffries:
    It’s the golden question, isn’t it? Firstly, I’m learning every day right now, so it’s hard to think about the five year plan. But what I will say is, I personally think that, again this would be an interesting one for you to disagree with or not. But a bit idealistic of me, I think that the purpose of work, or the purpose of work, is employment. I think businesses exist to employ people, and I think it’s an incredible privilege, if you have a viable business, what an amazing privilege to be able to provide employment for people. I think that’s what makes the world go round.
    So yeah, I think starting my own business, if I didn’t have plans to hire someone, that would be disingenuous of me. But that said, it’s slowly slowly, right? I’ve got lots to work on, but lots of great clients right now. I say lots. I’ve got good clients right now. I’m relaxed. But I need a lot more clients, and a lot more of a viable revenue stream, and replicable lower hanging fruit, to justify bringing someone in to help. But that said, I’d love to. I’d love to bring someone in.
    I often meet people, and I think, “You’d be an amazing coach.” Or, “You’d be great at what I do. I’d love to take you under my wing, or just bring you in somehow,” and I can’t right now. It’s frustrating. But yeah, so the answer is yes, I’d love to hire someone. Right now though, it’s about nine months in. It’s about just building things out-

    Richard Anderson:
    Building the business.

    Josh Jeffries:
    Yeah.

    Richard Anderson:
    It’s really exciting, isn’t it? I’m sure people like this exist. Maybe I should have done some research before I say what I’m about to say. But it would be nice as well, I think, if there were coaches for entrepreneurs, or people who have started their own business-

    Josh Jeffries:
    Oh yeah, [inaudible 00:36:32]-

    Richard Anderson:
    I did a few LinkedIn videos, just to give some of my thoughts about all my experiences of starting a business. What I did well, what I didn’t do so well. What I would have preferred to do if I had my time again. Those types of things. Because I feel as though the support maybe isn’t out there for people who have never done it before. They’ve always worked for somebody else. They’ve always wanted to have their own business, for whatever reason that might be. Then they end up in that position, and you think, “Well crikey, what am I going to do now?” That was what it was like for me.
    I know that there will be mentors out there. But I think to have the ability to seek the services of a coach maybe that you could just sit down and, “This is really hard.” You know, “Let me give you some tips.” All of that stuff. I think that would be quite cool.

    Josh Jeffries:
    There’s loads out there. In fact, in some sense, sometimes you go on LinkedIn and you think, “God, it’s a really saturated market, isn’t it? Everyone seems to be a coach these days.” But that’s probably just because of my network. But there’s loads out there. I would say that with specific coaching, business coaching, startup coaching, you want a coach or a mentor who’s been there and done it. It’s really worth doing your research on where they’re coming from, and why they have niched into that world. Because if you’ve niched as a coach to help entrepreneurs, or to help scale startups, then hopefully you’ve got a track record, and you can say, “Meet this CEO who I worked with, and hear it from the horse’s mouth.”
    So I think, yeah, there’s loads out there. I think now, more important than ever to do your research on who you’re working with. Meet them, sense check them, and really get to know each other, and understand each other’s aims before you commit. But yeah, definitely something. I lean on someone who knows a lot more about coaching than I do. I’ll meet with him once a month, and he’s been great for me.

    Richard Anderson:
    It’s brilliant. I think the education piece needs to be there as well as the people, because you probably have a load of coaches in your network on LinkedIn, and those types of things. I probably do as well now, but at one stage I didn’t, and at one stage I didn’t realize that that was even a thing. I knew that coaching existed, but coaching for startups and entrepreneurs. It’s only been with the benefit of hindsight, and a few years experience under my belt, that I thought, “Well if I’d known about that at the time.” So maybe that education piece needs to be a bit more out there.
    I know that doing things like this, podcasts talking about the benefits of coaching, and all of that sort of stuff are going to help. But the more people that can get out to, I think the better for me.

    Josh Jeffries:
    For sure.

    Richard Anderson:
    Brilliant. Josh, I’m really grateful for all of the insights that you’ve given throughout the last 40 minutes or so. It’s been really, really interesting. I, as always, want to give you the opportunity to talk a little bit more about Capital Traits. Maybe for any listeners who might be interested in contacting you, or picking your brains about these things. The floor is yours. Give us a little bit more about Capital Traits, and how people can contact you.

    Josh Jeffries:
    Gosh, I should have rehearsed an elevator pitch for this moment. So if you contact me on LinkedIn, or just get through to me on the website, which is capitaltraits.com, I’d love to speak to anyone with whom the mission resonates. So if you are a business owner, or a leader with a budget, and you resonate with that mission to democratize leadership development, and make coaching and support in a form of assessments to help develop self awareness, and leadership competence in your business, get in touch. Because it doesn’t need to break the bank, and I’d love to work with anyone who’s keen to hear more.
    I don’t have a powerful marketing suite behind me, or a sales funnel. So the best way to get to know me is to reach out. Drop me a message. We can arrange a quick call, and see how we can work together. But yeah, thanks so much for having me on the podcast, Richard. It’s my first time podcasting. It’s been great. I need to work on not rambling, which I’m doing now. Something, I need to be probably more succinct. But no, it’s been really fun. Really, really fun. Thank-you.

    Richard Anderson:
    You would never think it’s your first one, believe you me. But no, I really, really appreciate your time, Josh. It’s really interesting to hear about your story as well. I’m always keen. You know that it’s a big passion of mine, people starting businesses, and also coaching is a big passion of mine now as well. So it’s really, really interesting for me personally, and I know that the listeners will feel the same. So just to say, thank-you very much, and we’ll speak soon.

    Josh Jeffries:
    Cheers, Richard. See you soon.

    Richard Anderson:
    Take care, Josh. Thanks.

    Speaker 1:
    Thanks for listening to Psyched For Business. For show notes, resources, and more, visit evolveassess.com.

    S

  • Psyched For Business Podcast Episode 11

    Psyched For Business Podcast Episode 11

    Episode 11:
    Everything you wanted to know about Psychometrics but were afraid to ask with Tameron Chappell

    Discover the answers to all your unanswered questions about psychometrics on this episode of Psyched for Business.

    Host Richard Anderson sits down with expert occupational psychologist Tameron Chappell to explore the topic in depth. With Tameron’s extensive experience in consulting and applying psychometric tools in businesses, she sheds light on a range of subjects that listeners may have been curious about but hesitant to ask.

    Tune in for a comprehensive and engaging discussion on the ins and outs of psychometrics in this enlightening episode of Psyched For Business.

    Subscribe to the podcast on your favourite platform:

    Apple Podcasts

    Spotify

    Amazon/Audible

    Pocketcasts

    Other Platforms


    Episode 11 – Transcript 

    Voiceover  0:00  
    Welcome to Psyched for Business, helping business leaders understand and apply cutting edge business psychology principles in the workplace. 

    Richard Anderson  0:11  
    Hi, and welcome to Psyched for Business. My name is Richard Anderson. Thank you for joining me. In this episode I sit down with occupational psychologist Tamron Chappell and pick her brains about all things psychometrics. Tameron is a psychometric specialist who was consulted and applied psychometric tools across many businesses for both recruitment and development. So this is everything you’ve always wanted to know about psychometrics, but were too afraid to ask. I hope you enjoy. Thanks again for listening. Tamron Chappell thank you very much for joining me. Welcome to Psyched for Business.

    Tameron Chappell  0:42  
    Lovely to be here.

    Richard Anderson  0:44  
    Great. I’ve been very much looking forward to having you on because we’ve got to what I think is a very interesting topic today. And I was just certainly before we started recording there that that I am the layman when it comes to psychometrics, obviously, we’ve developed psychometric software. But I’m brand new to this when it comes to the ins and outs of all these different tests, questionnaires, assessments, and I think in the world of psychometrics, there’s probably a lot of dare I say jargon or terminology that’s used that is often assumed that everybody understands. And for a lot of people that use psychometrics or are looking to use psychometrics, it’s quite daunting, I think. So we’re going to use this time Tameron with an expert as you are to, I guess, demystify psychometrics or everything we wanted to know about psychometrics for such a long period of time, but we’re too afraid to ask. So we’ll get into that. But before we do all of that time, and would you just be happy to introduce yourself, so kind of who you are and what you do.

    Tameron Chappell  1:37  
    My official title is a chartered occupational psychologist, which for those in the know and know about our profession, it just means that I’m registered with the HCPC, as well as the Association for Business Psychologists and the British Psychological Society. So I’m registered with all of them. So I can call myself that protected title. But basically, what it means is, I focus on using the models and ideas and theories from psychology in the place of work to help people be more effective at work. And I pull on different ideas too, because I’m also trained in a psychodynamic approach. So I use transactional analysis and systemic constellations and internal family systems, which are all kind of from the psychotherapeutic side of the world. And I am quite happy for those to sit alongside that had numbers of psychometrics. So I’d like what they can both offer.

    Richard Anderson  2:30  
    So the psychodynamic stuff that sounds really interesting. It’s maybe we’ll maybe get into that later on, or it’s probably a full new topic. Of course, it is. Brilliant. So you’re obviously well qualified to speak about psychometrics. How long have you been working in the world of, how long have you been expert in psychometrics?

    Tameron Chappell  2:46  
    Well, expert’s an interesting title as well, it implies that I have all the knowledge and the power, I think I would say, I’m a specialist. So I’ve maybe read more books and read more LinkedIn articles and been to more conferences, shall we say? But I started out in academia. So I was really interested in psychology and the psychology of language particularly, and how language influences how you think what happens to your language when you’ve had trauma. So research and ideas and models and knowledge have always been really interesting. But I wanted to have more of a practical focus to it. So it’s great to have a theory, but then how does it actually work? So I set up my own consultancy, which sounds grand it was me it was moving out of academia into as my mum calls it, the real world. But so I’ve always had part of my own practice, I guess it’s called and a job as well. So I’ve worked in various places in a in a psychometrics publisher briefly, in a company that was helping to create change in the NHS, in a tech recruitment firm in leadership consulting firms in learning and development organisations. So that’s allowed me to have quite a broad range of experiences and clients, different professions and different approaches. And I think it’s that wealth of experience and exposure to different organisations, different people, different ways of working in the professional background that they bring. That means they can feel comfortable saying I’m a specialist and have a lot of knowledge but the expert bit I was supposed to say that my LinkedIn profile, and I haven’t got it in there for the search terms, but it does sit a little uncomfortable because of the power dynamics.

    Richard Anderson  4:40  
    Okay, we’ve got a thought leader in there yet.

    Tameron Chappell  4:42  
    Oh, no, I don’t think I

    Richard Anderson  4:44  
    that’s another one akin to expert, I guess. But I’ll use specialist respectfully, of course, it’s more

    Tameron Chappell  4:48  
    about my own analysis and psychodynamics as to whether I want to be viewed as the expert or not. I have a lot of knowledge and I’m happy to share it.

    Richard Anderson  4:57  
    Brilliant. Well, look, we look forward to that. I think Probably the easiest place to start, or the most obvious place to start is what do we mean by psychometric metrics?

    Tameron Chappell  5:06  
    It’s both an inclusive and exclusive word, isn’t it? It’s a good conversation opener if people go, Wow, what are those? In essence, it means psychological measurement. So psychometrics is just the measurement of psychological concepts. Personality, basically, splitting the word up, personality measurement. That’s what it is. But the common all language use of the word cycle has all of that baggage that we bring to it. I think lots of people in business particularly think, all psychometrics, they’re a scary word, I don’t know about them, I project onto them that they’re really detailed and excluding. So it depends what you bring to the word, but it basically just means measuring personality.

    Richard Anderson  6:00  
    Brilliant, so measuring personality through psychometrics. We know that they’re used for both recruitment and development, but I guess very differently.

    Tameron Chappell  6:09  
    Well, this is the big question that is totally, always debated on LinkedIn in various stages. And it points to another question that we’re going to come to which is difference between type and trait and Myers Briggs, and why everyone, so it all sort of comes together in some way. So strap in.

    Richard Anderson  6:29  
    So why in that case, why do we use psychometrics? Why is it a good thing for a business to implement a psychometric?

    Tameron Chappell  6:36  
    So let’s start there, and then explain why because it’s a way of measuring something that’s consistent in order to predict future. So businesses want to predict what’s happening, right, because then you can plan, then you can adjust, you can manage, so they want to be able to predict what’s going on, we live in a really chaotic place, even more so in the last few years than we thought was possible. So predicting how people will behave in certain environments has value to it, because you want to be able to plan and know what to expect. So in essence, psychometrics are useful because it helps you make better predictions about how people will behave in a role. It’s not perfect. I’m married to a nuclear physicist, and we have had many a discussion over the years about the social psychology and personality, and how can you predict sort of things. So we talked about correlations. And we’ve got validity and all of the terminology, that basically saying mathematically, we can be certain about what it is we’re saying here. But he kind of laughs and scoffs as a nuclear physicist going, there’s no predictability there. But I remind him, we’re dealing with people, not laws of nature. So it’s as good as we can get. But there is a whole range of ways of measuring people’s factory settings, looking at what they how they’re likely to behave. And that’s not to say that you want then be able to change and learn different ways of behaving, because that’s in essence, what we’re doing as we go through our working lives, we are learning how to behave in different roles in different situations. That doesn’t mean the fundamental who you are in your personality shifts. But it does mean that you learn to apply it in different roles, and you learn to extend your kind of corridor of comfort about where you can work. So if you’re looking at the heart theory, personality does not really change from the age of about 30, late 20s, early 30s. So if you’re looking at the research, and you look at a population level of of all of the data together, there aren’t large shifts in personality, once you hit that kind of age 30. But if you speak to individuals, anecdotally, they say, Oh, I’ve, I’ve really changed in my career, or something happened in my life that really was pivotal for me. And I changed how I did things. So it depends on and this is an age old debate, whether you view personality is more mobile and human brains is able to change more, or whether there really is a genetic component that’s there. That’s for a whole different talk, we won’t go to from my point of view, I think that we’re knowing more and more about how plastic brains are in terms of being able to learn and adapt, and that’s as what we are as humans. I think we have factory settings is the way I describe it. So that’s the trait level of personality. So the things that the evidence base says, if you look at one point in time, and you look in two years time or three years time, there’s a pretty good likelihood that they’ll be pretty similar, especially when they get to be older. So that’s the trait based approach where you’re comparing someone to everyone else around them. So you know how much of something somebody’s got. So it’s like height, we all have a height, we all sit somewhere on a continuum of our height, and the majority of us are about the same height. So the lowest people are average, and average doesn’t mean mediocre, right? It means about the same. And then there are some who are a bit taller and a little bit shorter, and some who are really tall and some are really short. So it gets narrower towards the end, like the bell curve of Absolutely, it’s the bell shaped curve. So that’s what trait personality has, as its underpinning assumption, we all have some level of this bit of personality. And we sit on that curve somewhere. So we’re either like everyone else in the middle, or we’re at the extremes. And the more extreme you are, the more that’s likely to be a standout strength, because there’s not as many people as you have got it. And the less likely it is for you to be able to flex your style to work in a different way, or to work with people who are at the opposite end of the scale, say,

    Richard Anderson  11:13  
    so maybe that’s a strength on the development area, because I suppose as a layman, from the outside looking in, he would imagine if somebody’s right at the end there, and they’re fantastic at one trade for one of a better expression, then that’s a great thing. But if they can’t adapt their personalities or behaviours to the other things, it’s gonna be a bit of a challenge.

    Tameron Chappell  11:30  
    So that’s why when you’re looking for either development, but particularly for recruitment, you’re looking at the individual and their makeup, their factory settings, what their personalities like. And it has to be within the context of where they’re operating. So someone could have a standout strength, that’s fabulous in the job they’ve done so far, really not fit for purpose in the context of the job that they’re applying for. Because of the nature of the work, the people they’re working with the long term expectations in the role, whole manner of things. So trait personality allows you to have that conversation with, say, the hiring manager and the organisation to think beyond the individual. And think about the context in which they’re going to be working and operating, and also who their colleagues might be, and what their personalities might be like, and whether that’s a good fit or not. Because we know from the research that diversity, cognitive diversity, thinking differently, is valuable for an organisation for innovation, for responding to changing context for customers, all of those reasons. But if you haven’t got the right situation set up. So you haven’t got the right culture that allows people to bring that cognitive diversity to bear to share it, if you haven’t got the right psychological safety in place, then it doesn’t matter how diverse your team is, in some ways, they won’t share

    Richard Anderson  12:56  
    that ideas to the table, and all of that sort of stuff

    Tameron Chappell  12:59  
    shouted down because it’s negative or whatever reason. And similarly, we know that diversity is good for a team. So we could recruit people that are really different. But when you’re working with someone who’s really different from you, it’s really hard, right? It’s harder than working with someone who’s similar. And so cognitive diversity is something we need diversity of personalities, something we need in a team. And by its very nature that makes it harder to work well together in a team. So trait personality can really help predict that for a organisation, type personality is not to be used in recruitment.

    Richard Anderson  13:44  
    And the questions I was going to ask you,

    Tameron Chappell  13:46  
    in essence, the reason is, and I think most people who just dip a little bit into this area will know that for some reason, you know, you’re not supposed to use one, and you’re supposed to use another but they might not know why. And they might not know and type and try. Which one is it not quite sure. In essence, we talked about that bell shaped curve, the track tool allows you to be somewhere along there. And so you can compare with other people, a type tool takes a line down the middle, and forces you to decide which side of the fence you’re on. You’re one type or you’re another. And so by doing that, you’re minimising the construct of personality, because you’re one thing or another as opposed to, oh, all manner of things on this

    Richard Anderson  14:35  
    person. You’re forcing somebody down on one particular Yeah.

    Tameron Chappell  14:38  
    And if you remember about what we said, the way that mathematically a bell shaped curve works, the majority of people are average. So the majority of people will go, sometimes I’m not sad. Sometimes I’m not. So it’s not really very strong for me, whereas the ones that the extreme will go, Yes, I am that type. I am an extrovert, hurray. MBTI I don’t like that at all. I’m an introvert and I know that this is some of the problems I’ve experienced. And because all those extroverts are talking and doing whatever it is, that is definitely me. And then the majority of people who are average go, sometimes I am sometimes I’m not, which is why on LinkedIn, you get this, I’m an introverted extrovert, or am an extrovert introvert. Actually, you’re just somewhere along that extrovert curve, but you’re probably average. And so you can do a bit of both, whereas those at the extremes go, that’s me. It’s recognised me, it’s awesome. It’s not predictable enough. And it’s not nuanced enough to use for a recruitment decision, because it’s not reproducible enough. So for those people who are at the extreme ends, type tools are probably quite reliable. Because they say, I’m still

    Richard Anderson  15:53  
    really, really it’s fairly obvious that you’re going to be one side or the other. Yeah. Whereas if

    Tameron Chappell  15:56  
    you’re in the middle, which most people are, sometimes I am, sometimes I’m not. And the thing about type tools is they can also ask about your whole self inside work outside work. And they don’t always narrow down to how am I in the work setting. And because we have many roles that we play, we may be in the average on, say, extraversion, but in a work setting, were slightly more extroverted than how we are when we’re at home. It’s just not as predictable. It’s not as robust in terms of how confident you can be to say, when you look again, at this person, they’ll still be in that same spot. Whereas trade does that a bit better,

    Richard Anderson  16:39  
    much more, like consistent, probably I would imagine, legally defensible from a recruitment point of view as well, because I would imagine if you’re selecting somebody based on the results of a personality type questionnaire, you could probably have a few problems.

    Tameron Chappell  16:52  
    You should not select the one. No, it’s a definite no, no. But people don’t explain why it’s not a no as in, oh, you idiot, why would you use that because that doesn’t explain it at all. It’s because of the way the nature of the tool doesn’t allow you to have someone who’s a little bit like this or a little bit more like that. Or it’s a reductionist view of personality, in essence. So it’s almost like you’re making a decision about someone with a blindfold on and one arm behind your back, you’re not using the fool tool to find out where they are. They’re often used for development brilliantly, because it’s about team interaction, because sometimes, this is the first time that people have come across the idea that, Oh, there’s something like personality, and we can be really different in our factory settings. And that might be why I really don’t get on with John at work because he’s at the opposite end. So for a development tool for a team building tool, they’re amazing. And it’s usually the first encounter people have with these kinds of tools. But they don’t really look at emotional reactivity, which is one aspect of trait tools that look at the whole of personality. emotional reactivity are, as many models call it neuroticism, psychologist, favourite. Everybody’s neurotic because of that normal distribution, we are all neurotic to some level, but because of the stigma around that particular word, everyday use neurotic means a certain thing and we only expect it to mean people who are very highly emotionally reactive. So tend to use in polite company emotional reactivity as the descriptor. So type tools don’t usually look at emotional reactivity. They’re looking for a much more positivist viewpoint about the rest of personality, about how you make decisions, how you connect with others, about how you organise yourselves, it’s looking at that side of personality, it depends on the tool, some dip a bit more in, but as a as a broad brushstroke type tools, look at less of the personality range, and they look at it in a reductionist way to put you in a bucket. And they are less predictable and less consistent over time, because you can move move from buckets.

    Richard Anderson  19:23  
    I mean, I’m really, really interested in everything that you’ve gone through so far, I’ve probably got a lot of questions and quite a bit to unpack. So I’ll just find a way to get I am really interested in going back to the types of that you’ve just talked about, because I want to give a quick story about when I’ve used them before, and I got a lot of benefit from a development perspective. But just to go back to the trait type assessments that are typically used, often used for recruitment as psychologists and psychometricians. How do we demonstrate the trade best tools of which I’m sure there are very many, how do we prove that they are predictive? What are the types of measures that you would undertake to say that this is doing what it shouldn’t be doing.

    Tameron Chappell  20:03  
    That’s both an interesting and a tricky question, in some ways, happy to launch in on my opinion on this. There are some amazing publishers out there that devote their whole time and energy into creating really statistically robust ways of showing that there tool is solid, predictable, consistent. And there’s a whole range of jargon of return. Okay? Yeah. Terminology, reliability, validity, construct validity, there are there as to whether you’re measuring what you say you’re measuring, whether you’re measuring it, first time you measure it, you’re measuring it the same way, the second way, whether what you’re measuring is actually measuring what you think you’re measuring. So if you say you’re looking at emotional intelligence, are you really looking at emotional intelligence? Or is your questionnaire just very consistent and asking about something completely different, right? So there’s lots of statistical jargon terms, and I’m not trying to minimise them, because they are very solid. And they’re there mathematically, to look at that. That is usually the area that when I work with HR colleagues, and then people who are less psychometrically, knowledgeable, shall we say, not interested, they know that these things exist. And they really just want to know, is your test the same as the others in terms of consistent all of those things? So I don’t personally think that the big decision maker, although if you go on a course, they often say look at the reliability, look at the validity, look at the figure it should be within this range. If it’s a well known test, if it’s an established publisher, you can almost bet that they’ve got all of their work and the solid Ness behind

    Richard Anderson  21:55  
    1000s of completions of these things and so much data to

    Tameron Chappell  21:59  
    absolutely, I think often when I’m talking to clients about this, yes, that’s important. And I don’t want to minimise it. But it’s the conversation I find is more useful to say, what do you want to use the tool for? How do you want to use it in your organisation? What’s your view of leadership competencies frameworks, so that, then you choose the test that best aligns with what they’re trying to do, how they want to work, whether they’ve got people who are trained in the use of it, whether they haven’t whether, so there’s so many tools there in the market, some very, very good and solid, some developing and growing, and some that actually have a great facade of robustness. And when you poke around, it’s not there. But if you go with a view of what’s your credibility and questioning, to say, what’s your background, in your tool? Where do you come from? How do you deal with this? Have you, for instance, got British Psychological Society? Yeah, exactly. But that is a process as well, that’s quite involved. So some of them are newer tools that are just stablishing haven’t got the data yet. But that doesn’t mean you can’t use them. It’s about going in mindfully knowing that it’s a tool to start a conversation or a process. And if you use it as a tool to help you do something, and you’re clear on your purpose, then they are fantastic. And you can, I wouldn’t advocate it, but you can even use some of the less robust tools, if it means, you know, the limits of what it can do in its predictability. And it’s just for the start of the conversation with your team. Yeah, it’s about the application of it. But unfortunately, because of the way the businesses and because of the way we are in business and who we are as individuals, it’s hard to say. So why is your why is this tool better than the other one, and publishers are trying to sell their own tool? And if they’re doing their job? Well, they should all be measuring the same thing, which is the Big Five trait personalities are variations of search. So they should be looking at the same stuff. So therefore, it’s how are they asking about it? What do their reports look like? Does it fit with my organisational view? Can I get good support from the publisher? There’s all manner of other reasons that you need to take into account when choosing a personality tool.

    Richard Anderson  24:40  
    Yes, I’ve seen a lot of these things. And prior to that we host a lot of these newer tools as well that are going through the process of trying to be might be trying to become accredited or certified through the British Psychological Society. And obviously that’s a big task in and of itself. And I guess as long as they follow the principles of that the likelihood is that eventually there will be a career Did you mentioned just there the Big Five personality traits? The big red personality traits? Yeah, I was gonna say titles mature all the terminology. But and somebody once said, I mean, I can’t remember who it was the psychologists don’t often agree on a lot, but they agree that they also agree on the five personality traits. So would you say that for the tread based tools that we’ve been focusing on? The majority of them focused around those five areas? And what are those five areas?

    Tameron Chappell  25:25  
    Yeah, yeah, listeners might not be old enough to get this reference is that the ROM seal approach to personality? If you remember those, it does exactly what it says on the tin. So the big five, five, of overarching descriptions, domains of personality, they are universal. They’re across gender, they’re across ethnicity, they’re across nationalities, they’re across age, there are exceptions, but we know about them. On the whole, we’re pretty sure after about 4050 years worth of research building up that the Big Five, the big five. Now, there’s subtleties around it. And if people are interested, there’s actually a meta two that sits above it. There’s research that’s emerged, that there’s sort of plasticity and stability, and then the five sit underneath, which fits more with your neuro psychology and dopamine receptors. So the theory is still evolving and developing, but the big five has been more consistent than many psychology theories. So you’re absolutely right. We don’t agree on many things. We’ve all got opinions, but we do sort of agree on that. And still, there’s a little disagreement around the corners and the edges, but it’s consistent enough that it’s a good benchmark, to then explore. What does this mean, and it’s nuances for you. So the big five is about personality and predictability. But one of the things that can be off putting are confusing, that’s not always explained properly, is that the big five are talking about personality behaviours, how you’re likely to manifest, but then we move into competencies. So that’s more behaviorally focused, how do I actually manifest my extraversion in a leader ship position, for instance. So they’re similar, there is an overlap between facets and personality and competencies. The good publishers that have been around for a while and established and have got a great data set will have their own competency models where they’ve got the personality behind it, the five, and then they’ve got what they know, from research, predicting what kind of behaviours, those are going to show up as in the workplace. And they’ve triangulated and confirmed that by looking at other people’s view of you, and performance ratings, and how you actually output because personality is a theoretical construct in that sense. And so businesses often go it’s all well and good. But so what, what does this mean for how people are going to actually do things in their business. So that interface between traits, personality and competencies, some publishers do that for you. So they give you their competency based model, which absolutely can be used in recruitment, and it helps organisations that kind of kind of does the thinking for them to know they look at the competencies and say, These are the ones that we know this role needs. So then you can question against those and assess against those in the recruitment process, knowing that what sits underneath them is the predictability of personality. But not all publishers have that. So in answer to one of the questions that we discussed before, we’ll talk about this, why is a psychologist useful? Why should we go to someone who specialist specialises in this? Because it doesn’t have to be a psychologist, it can be someone who is just psychology and formed. So ABP does a great job of talking about business psychology, and using the models of it. It’s about understanding, the personality sits underneath this. And the behaviours are things that you want to see and predict. And it’s not 100% link, but you know, which ones are more consistent than others? And you know that the way some of them fit together, a little cluster of those can point to a certain nuance or a certain trickiness for a certain role. So it’s more about seeing them as a predictive tool to use as a conversation as opposed to what they might experience often people who’ve gone away without that personality knowledge or that psychology knowledge or that assessment knowledge backing them up. We’ll think I’ve worked with people. I’m pretty good at reading people. I’ll go on one of the publishers courses Does that give me access to this tool? And then I’ll go out there and apply it to everybody and everything. Whereas I think someone who’s got a background in personality and psychology and assessment in that way will say, there are a number of tools that sit behind me, and I will pick the one that works best. Whilst I’ve understood what the client needs is rather than I’ve been other costs are paid for this tool and get to use this tool in every situation, which is polarising. But that’s often where people are coming from if they’ve come to psychometrics later, because they’re expensive, right? They’re expensive to buy expensive to training. So you want to get your money’s worth if you’ve gone on that training. And it’s hard to then apply another one that, of course,

    Richard Anderson  30:49  
    even what you’re explaining there. Tamron, in terms of the differences between personalities, and behaviours, and behaviours are the manifestation of the personality traits that you display. In a law. I think even that there, that’s what I need a psychologist to explain that a specialist in the area that differences between those things, I think that’s crucially important. And I guess as well, if you’re a psychologist, and you’re supporting a client, with recruiting leadership, whoever it is, across the organisation, the you can, I guess, from from the outside looking into, you can be a little bit more objective in the process, you’ve got the expertise of how to interpret the psychometric reports, and results, and also have that level of objectivity as well, from outside.

    Tameron Chappell  31:28  
    Yeah, my view and I work with clients is I try to advise, so it’s not about saying, or right and wrong, because no one learns that way. It’s a here’s from my experience, this works well, here’s the questions you need to consider when you make a decision. And then it’s down to the client to make that decision. But I would often advocate using a trait tool for recruitment that you then use for onboarding development. So quite like a bug off a buy one, get one free offer. And so if you use a recruitment tool, so it’s just a trick tool, because you won’t use the Type tool, use the recruitment tool, then you’re missing a trick, really, if you’re not then using that information, to help you create a great onboarding experience for that person. Also identify development goals as they come in, in that role, and then use that for the whole team to help them fit together. So it’s all about a joined up process. As an organisation, if you use psychometrics well, then it’s part of your recruitment process, which is where the high risk decisions and the costs are right, you get the wrong people in, it’s costly in money terms, but also in the people impact and the resource. So it’s often easier to have a conversation with a client, and they’re more willing to use a psychometric at recruitment. But then it’s, it’s sort of tidied away in a box in the recruitment only zone. And then they might go use the Type tool or something completely different for development, because they need it to be more fun. Whereas there are some recruitment tools that are specifically created now to make that bridge to be able to work as a development tool as well. And I think why wouldn’t you use the same tool if you can, because then you’ve got the language embedded in the organisation, and you’re helping your line managers to understand how teams fit together, and individuals fit together. And they can take that knowledge into the recruitment decision. Whereas if you’re using a type tool to make those development decisions, it’s not robust enough to take that into a recruitment decision, because it just doesn’t have the nuances of it. So why not use the tool that’s more in depth to start with, and then just apply it in a development way and depend, but I think that’s where the skill comes. Because the team tools, the typing tools, and you said, I’m not sure which way it is, basically, do you think are you one type or another, then that’s the type tool. And then the other one is the trade one. So the typing tools have great marketing collateral, they have merchandise, they have mats on the floor, they have all the things that make them fun and team development II. So you want to use them, you want to use those more. And a trade tool is often more worthy and more academically solid and doesn’t and people can’t feel the fun in it, but you can still apply it in the same way and some of the some of the tools on the market specifically bridge that gap and do it very well. So that’s where I look for if I’m advising an organisation, in adopting recruitment practices, then it’s I would say look at these tools that you can still use for development because you want to connect those functions which often are separate in an organisation as well so it helps to join up the organisation to

    Richard Anderson  34:57  
    I guess that’s the beauty of the position that you hold as well with the Client is that you can make recommendations based on what you think is going to be best for them. And if it’s going to be one that bridges the gap, you’ve probably got access to multiple tools. And you can give them pros and cons and all that sort of stuff around those two, just to recap the personality traits, the Big Five, openness, I’m testing myself here.

    Tameron Chappell  35:18  
    Sorry, I didn’t tell you what they were ocean. So the big five is also called the ocean model. So ocean the acronym is Oh, for openness, C for conscientiousness, E for extraversion, a for agreeableness, and the psychologist, favourite and neuroticism. So, openness is on that dimension. It’s about openness to new ideas, new values, depending on which model which Big Five model you want to go through, but it’s mostly about that strategic thinking at the top end to the more operational here and now practical, focused piece to that bigger picture, blue sky thinking versus operational deliveries where it sits in a business sense. And I work at the C suite. So I forget people coming in saying, right, we need a new chief operating officer, they need to be able to set this strategy blue sky thinking that they need to roll up their sleeves, and actually make sure our systems work. And you say, okay, great, they sit at opposite ends of the same personality dimension. So let’s have a conversation about what this will actually need. Do you need blue sky strategic thinking? Isn’t there no one that set the strategy already, you need that wide open view about the future and difference? Or do you need someone that’s more about take what we have and improve it and tweak it continuous improvement, because then that helps me know when a candidate comes, and I look at their psychometrics, whether they’re someone who’s going to be at that blue sky end, who is less likely not unlikely, less likely to be able to do the rolling the sleeves up and paying attention to processes but whereas if you’ve got someone who’s brilliant at the process side of things, there’s not necessarily a muscle that they’ve used very often to do that strategic setting piece. And often I find people are promoted through their technical skills, their ability to get stuff done, make money for the business, pull the team together, even but with the focus of output, and then as they get more senior in the organisation, it’s all well known, we need you to move out of that stuff that you’re good at, and move into strategy and think about strategy. But what you’ve done is we’ve spent the whole of your career practising down at one end of that openness, dimension, and then they’re going now now you’ve got to step up to the C suite and the strategic piece. And that’s a different things. And some people can do that because their personality underpins it. And some find it much harder. And so you need to set the expectations of the line manager as to what will be possible, but also help them understand what development to put in place to help them be successful in the role. So psychometrics are useful for that conversation. So yeah, openness, conscientiousness is as we think it’s about how structured you are, how long you take to make decisions, how self confident you are, in terms of meeting your goals. So it’s not just confidence and ambition, which is extraversion, it’s about confidence in competence. In that sense. conscientiousness extraversion is the one that most people have heard of, because we talk endlessly on LinkedIn about extraversion and introversion. But in a in a big five way, extraversion is about energy, where you get it from and where you get to. So ambition sits in there as well, that drive to achieve sits in extraversion in some models, but it is about energy and connection. So it’s often about optimism and pace, how speedy you are at getting things done, and how much you like to connect with people depending on model again, which is different from agreeableness which is about interpersonal sensitivity, and quality and investment in relationship. So you can have extroverts who are really good at connecting with people less interested in investing time in the relationship. And what you see on LinkedIn is people saying I’m an introverted extrovert, I build relationships all you know, and it’s like, actually, no, you’re, you’re confounding extraversion, and it’s pure sense and interpersonal sensitivity. You can have an introvert who is very good at building relationships because they have great interpersonal skills in that agreeableness side. Similarly, you can get an extrovert who’s great at connecting with people less interested in carrying on that relationship, and they’re usually the ones you meet at conferences. It’s great to meet you connect, never see them again, or they see someone over your over your shoulder who they think is more important. And they go off that way.

    Richard Anderson  40:08  
    I suppose for my perspective, I would assume that extroverts would always want to be building relationships and maintain and the politics, it’s really good point that you make.

    Tameron Chappell  40:16  
    It’s about the connection. So it’s like a Duracell bunny. In some ways, an extrovert needs to connect with their external environment, in order to keep their energy levels up. So they’re the ones that tend to chat more, talk more, connect more with people. But whether they’re then invested in the quality of the relationship is within that agreeableness piece, whether I asked you questions whether I really speak to you whether I’ve got good levels of trust that’s in the agreeableness side of things. So they all fit together. But they’re artistically more separate, so that you can look at where someone is high on one and low on the other. If they’re high in both, then it kind of all fits with that typing approach. Yes, you’re a extrovert. But most people have quite a spiky profile in that they’ve got high on one low on another average on some. And so it’s that pulling it all together. That’s the bit this endlessly fascinating. I think, from my point of view,

    Richard Anderson  41:15  
    it really is one of the things I was going to chat to you about. And I’ve loved the conversation so far. But I was thinking just from a type personality type perspective. So when you and I had a conversation a few weeks ago, I said, you know, I’m a little bit ashamed to admit this. But I haven’t done a great deal of personality tests, assessments questionnaires, but we did one with the team. And the intention is, by the way, the caveat here is I am going to do more that is 100%, the intensive, the least I can do given what I do for a living. But I know that there’s a number of different tools that are available. And we took on one of the type tools, it wasn’t the MBTI. But it was the 32 personality types, tools. And we had a great time as a team. And we’re a small team timer. And there was there was maybe six of us did this exercise, and we had the reports dissected and gone through and I came out as for what this means an EN F p that was my personality types to you will probably explain what these things mean, in a second, but but one thing that struck a chord with what you said before, is how you work with both people that might have different personality types to you. And I realised that my business partner, and also Ashley, who I work I’ve worked very closely with for years, they are pretty much the direct opposite personality types. To me, I think at least one of them was an ISTJ. It opened up a really fascinating discussion about how we started to learn more about each other. And it’s probably things that each of us do in a small environment that get on each other’s nerves on occasion. Chairman, right. Yeah, exactly. One of the examples that that was given in the session was that if I get an email pop up, and I always thought this was because I’d always kind of work in business development, if I got an email am I going to seal in or something like that? I was always desperate to read it straight away. Whereas my colleague, Ashley, it distracts her. So she they ignore the emails. So I’m thinking why should I not reply to that email? Yeah, because that’s what I would do. It’s just different. And I thought that was really, really interesting. So I wonder if you would mind you spending a couple of minutes on these type tools. So let’s say I’m an ENFP, Ashley or Matt? And is TJ. And so you mentioned about the differences before? But I mean, what would you do with a, you know, a small team or the recommendation would be for people using the Type tool.

    Tameron Chappell  43:26  
    There are some great tech tools in the market, there are some less than great ones and and measure greatness in terms of how well what they’re asking you to do to file yourself into one bucket or another is true to the concept of what they’re trying to fall you into in that sense. So I use type tools all the time with teams ones, particularly that it’s there, we move to this, we want to come together, we want to explore what this means for us. And we don’t want to go too deep yet, because I’ve read on your list that you’re a psychologist. And so we’re not going down the psychodynamic route, but we’ll we’ll start with this. It’s about an exploration, it’s about a conversation. So it’s there as a lens to basically bring into awareness, some of the things that people knew already, that I do it differently from you, and sometimes that you’re successful at it, and sometimes I am, because there’s different contexts out there. But what happens is, because of the psychodynamics, we often move into blame and I’m okay you’re not okay. Or if there’s no psychological safety, it’s, we should do what we’re told to do. So there’s all of those are the layers that sit on top of personality. So personality is a very good, safe way in to whatever you need to discuss and wherever you’re ready as a team to discuss. So I’m often called in by clients when teams are not working very effectively, usually because they’ve tried various things first and It’s not, it’s not helped. It’s not done something to help shift. But I do sometimes get to work with just normal old teams. And that’s a joyous because if you’re right, we’re going to use the Type tool, let’s get in there and just explain what it means. So the way I go about it is, I usually have plenty of conversations upfront with individuals to help them understand where they are first, before they come into the team. So the way that you set up the conversation is, I think, where the USP is, in some ways for being a psychologist or for having this kind of people knowledge partner, bring to him, because we know about safety, as in personal safety, about risk. And so you can structure your interventions with a team, knowing that that feels on the surface, like it’s a trivial decision, but it actually makes a fundamental difference. So for each one of these is, if I’m new to working with a team, who if they don’t know me, necessarily, and I don’t necessarily know about them, but they’re curious enough to do something with a personality to, then there’s lots of conversations up front to explain what the tool is to answer the questions that you’re asking. There’s no stupid question, just where’s your curiosity come? And I’ll answer that in the best way I can in a pragmatic way. But they are not perfect. And they are not to judge. So you sort of setting the scene of this is an exploration and we’re coming together to explore what this means. They’re not right or wrong. There’s no right or wrong and personality. It’s how far along the extremes Am I so I know how much I can change or not. And how much I’m going to be different from everyone else, that’s really useful. So if you’re at an extreme, that means there are far fewer people out there that are like you, and the majority of people you work with are going to be really different. So that’s good to know. And I’ve had many people go, I always knew that. But I didn’t realise I was on the 98th percentile, say. So that makes a lot of sense. So then you go right from your awareness, everyone’s going to be, say, less conscientious than you. So that allows you to then have the conversation with your colleagues to let I know where I am. And know this is what I need for myself for my work. You’re at the opposite end, you like to get things done at the last minute, how are we going to actually productively work together about this, and what all this mean, that we put in place for ourselves, so that we have done that before? It gets tricky. I’m originally from the Lake District, and when he went out walking, so we used to go with the school trips, you’d always have a foul weather alternative route. So if the weather was really crummy, which is often the latest, you had to give somebody your fall weather alternative route, so you might be going up on the fell. But if the weather was really crummy, you were going to come down the valley. So it was before mobile phones, if you got lost, they’d know the two places to look for you. So I often use that as a foul weather alternative route is, you have the conversations up front about what we’re going to do when it gets tricky. How are we going to figure out how we make decisions together, given that we’ve got different decision making styles. And so all of that thing around setting a team charter, you can label it as that in a leadership book development approach. But what he’s trying to do is create some resilience in the team, when the going is good when you’ve got that good relationship, because the good times people get along with it. And bumble along it’s when things are tricky. So when you’re under pressure when you’re stressed when you’re not feeling so well when the business is doing not so well. When you meet someone who’s really different and it’s an it throws the team. And so thinking about this in a transactional way up front, that gives you not only permission to raise it as a topic when it gets tricky, but it also gives you a bit of resilience in their plan, a foul weather alternative route.

    Richard Anderson  49:10  
    I love the analogy. Yeah, I absolutely see that. And that’s fantastic tamarind. From my perspective, if I look at the six or seven members of my team, and I’ve already already told you the the examples of people having the direct opposite personality types to me to ensure that we work as productively as we possibly can. And we all get on in harmony and all that sort of stuff. What would your recommendations be to a small team, for example, that have lots of different personality types?

    Tameron Chappell  49:37  
    Yeah, that stuff we were just talking about around the team charter and the resilience and the fairweather alternatives that is all valuable time spent for a team at any stage, but definitely when they’re coming together. So that etiquette of how will we work together that sort of meta discussion with Greg coming together and talking about our outputs, and who’s going to tell At what tasks, but the conversation around? How will we go about this? How will we communicate can always be done even around a project? How are we going to manage this together knowing our styles, but I think there’s something really useful just to take away in some ways around meetings. So for me, in the many years I’ve been working with teams, meetings are sort of the make or break place, and in many ways, and so there are some quite fundamental things you can do in a meeting, which speaks to the inclusion piece as well, if you’re trying to create, if you’re bringing cognitive diversity as well as visible diversity to your organisation, then it’s about whether people feel like they belong or not, whether they’re welcome. So psychological safety is crucial to setup. But some of the practical things you can do is to know about extraversion introversion is key one and conscientiousness. So that kind of P and J in MBTI, speak at some level, but the extraversion introversion, one knowing how extroverts think and talk and act, and how introverts do can help you structure a more productive meeting that is inclusive for everyone. And if you’re looking at the inclusivity, from the lens of personality, then we all have personalities, we all have somewhere along that bell shaped curve, our personality. So if you’re thinking about it that way, then inclusivity can sometimes bridge the gap of where the polarizations are in diversity in other ways. But that’s for another conversation. Some of the examples practically are extroverts and conscientiousness, because it’s confounded, because that’s about how organised you like to be in some ways, and how structured you are. Extroverts are usually able to think on their feet, talk things out. And in fact, the talking itself, formulates ideas, and the connecting with others allows them to have those ideas. So extroverts often don’t finish their sentence and go somewhere else if they’re high on openness and ideas as well. And so in a meeting, they can blank, a meeting, they can wing it, they can discuss and chat, which means if they’re lower in conscientiousness, they might not have read all the papers about the meeting, they might not have got the agenda out in time, if they’re the one leading it, they might not have prepared enough and thought about what do we want to get out of this meeting, and it becomes a talking shop. And so the more reflective thinkers, either they can’t get a word in edgeways, or they haven’t been given enough information in advance to start to process and think so they can’t bring their contribution to the meeting. So sometimes we see people who are new on this journey, and they go, I have been on a course or I’ve watched a TED talk or something, me as the extrovert. That’s enough for me. What about you, introvert? What’s your thinking on this? And it’s like the internet goes on. I had time to think yet. Come on, just give me a fresh thinking, you know, it’s a fundamental, different process. And you need to have brought some preparation in advance for everyone, actually, not just for more reflective thinkers. Everybody, I think, will appreciate a well run meeting, that you know, what you’re going to focus on, there’s an agenda somewhere, even if it’s a loose one. But you’ve all agreed in advance, and you’ve got some information you come, it’s got a clear structure, you know what you want to get out of it, you check in with people, you allow a bit of chitchat at the beginning, because that’s good for connection and for building trust and humanity. And the extroverts can do that chat, and those who are higher on agreeableness can connect and ask people, but you’ve also got the structure for those who like to stay task focus that 10 minutes in, we start the agenda. So I would say, once you’ve just explored and had a conversation with your colleague and said, Oh, look where I am on whatever scale or two you choose, oh, that’s where you are, oh, let’s talk about where we go. That focusing on a really good quality meeting, is where I think you can make the biggest games for different personalities, I think means is

    Richard Anderson  54:23  
    is a huge thing. And I think a lot of this as well. Tamron is, is knowledge of the importance of these tools. And you know, I would imagine a lot a lot of larger organisations and big established businesses will all know the benefits and the merits of personality traits, types, questionnaires, whatever that might be. But I think for small businesses, in spite of the fact that we build technology to deliver these things, actually using them, it wasn’t until I’d use them and seen how beneficial they could be that I’ve now decided this is massively important that we need to keep to keep on there. So I think, for people to be equipped with that knowledge of how important these things are as massively On hopefully podcasts like this will be helping people, right when people do that. But retirement listen to that, thanks so much for talking through that. It’s been really, really interesting to listen to, I’ve certainly learned a huge amount in the last hour or so. And I’m sure the audience will have done as well. You’ve talked a little bit throughout, but tell us a little bit about how you can support businesses and the types of projects you get involved with. Yeah,

    Tameron Chappell  55:22  
    so I called in at various levels, really, for recruitment purposes. So I write personality profiles for hiring practices, I tend to do that as an associate, because organisations aren’t doing that all the time, especially at the senior level, where they tend to buy someone in because it’s a high risk decision, and they will go okay, this is the one where we’ll go and find a psychologist to help us with this. I would love to do more further down the organisation. But I know there’s restrictions in terms of costing and price. But there are newer tools that are coming on the market that embed the same philosophy and the same robustness. But their price point is a bit lower. And I think people creating their own psychometric tools, which is what you offer, give some of that opportunity as well. So I go in at the recruitment piece. And I love that bit. It’s like fitting people jigsaws together, but my passion lies in working with teams in how they fit together, how effective they are. And I really like working in startups, particularly tech startups, or engineering, places, traditionally, where there might not have had access to the ideas of personality. And where they have, they might have been dismissive, because as I’m married to a nuclear physicist, you know, it’s like the load of rubbish that is soft skills, it’s outside, I actually really, really like working in that space. Because the simple conversations around how to make teams work better together, how to help people fit better together, is often really, really appreciated and can make quite radical changes for a technology team say, or for an IT function, then I’ve got to try and work with those, those people in the rest of the organisation. So I think psychometrics are really useful in that space, to have a bit of data to go, here you are, you’re on the 98th percentile, so 97% of the population are going to be quite different from you on this. So this is why you might need to adjust. And you might need to do this. I like working with teams in that way. But particularly around startups, because it can add so much value. There’s lots of money in startup land, particularly in tech space at the moment. And so investment is thrown at people who are ambitious and driven and have an idea. And there’s not enough knowledge out there around the interpersonal dynamics, and how people fit together in small teams. There’s nowhere to hide, if you don’t get on with a colleague. And it’s such a fast changing world that there are so many pressures that I think personality and a knowledge about personality would make the biggest difference in that space fully agree with that. Yeah, that’s where I like to work. But usually where I’m bought into work is in big corporates and in recruitment, because they’re further along the journey and knowing what these tools do. They know the business value of it, they know the risks associated with it, and they have a budget that they will allocate to it. So that’s where I am mostly.

    Richard Anderson  58:37  
    Well, that’s fantastic time and we’ll put your details as part of the blog post. We’ll be happy for us to and this will go out alongside a transcript blog, and I’ll tidy it up because we’ll be using some AI transcript software and on one of them or two on your horse Richard Anderson instead of it’s still not perfect yet, or I do. I do have a few laughs and hopefully the majority of people know that it’s a transcript and it’s not my written English but anyway. Well, thanks so much for the

    Tameron Chappell  59:03  
    vowels, I think no, don’t always translate

    Richard Anderson  59:08  
    quite clearly. Brilliant. Thanks, Tam and enjoy the rest.

    Tameron Chappell  59:12  
    Thank you for letting me extrovertedly talk at you. With you alongside you. I’ve really enjoyed it.

    Voiceover  59:21  
    Thanks for listening to Psyched for Business,  for show notes resources and more visit evolveassess.com

  • Psyched For Business Podcast Episode 10

    Psyched For Business Podcast Episode 10

    Episode 10:
    The journey to Africa’s first psychometric with Nankhonde Kasonde-van den Broek

    Richard is joined by Nankhonde Kasonde-van den Broek founder of Zanga African Metrics, who has pioneered the first psychometric assessment specifically for the continent of Africa.  In this episode Nankhonde and Richard discuss her vision, the journey, and the process to building the first African psychometric.

    Subscribe to the podcast on your favourite platform:

    Apple Podcasts

    Spotify

    Amazon/Audible

    Pocketcasts

    Other Platforms


    Episode 10 – Transcript 

    Voiceover  0:00  
    Welcome to Psyched for Business, helping business leaders understand and apply cutting edge business psychology principles in the workplace.

    Richard Anderson  0:10  
    Hi and welcome to Psyched for Business. My name is Richard Anderson, thank you for joining. In this episode I’m joined by Nankhonde Kasonde-van den Broek, founder at Zanga African Metrics, and she’s pioneered the first psychometric assessment specifically for the continent of Africa. In this episode, Nankhonde talks us through her vision, that journey and the process to building the first African psychometric. Enjoy the episode. Nankhonde, welcome to the show. Thank you very much for your time. How are you today? Happy Friday.

    Nankhonde Kasonde-van den Broek  0:44  
    Happy Friday, Richard. I’m great. And it’s a pleasure to be on your show.

    Richard Anderson  0:48  
    Now, it’s a pleasure to have you and I love that T shirt, the Zanga African metrics t shirt that you’re supporting. And people will see that when we release the clips of the podcast. But I’ve been really excited to have you on Nankhonde  , I’ve had the pleasure of getting to know you probably over the last couple of years, and you’ve done something incredibly pioneering and you’ve built Africa’s first psychometric, which I’m really, really keen to get into throughout the duration of this podcast and all the listeners will be really interested in that. So we’ll do that in a second. But as a bit of a starting point, would you be happy to just introduce yourself, Nankhonde, who you are and what you do.

    Nankhonde Kasonde-van den Broek  1:24  
    So I am Nankhonde Kasonde-van den Broek, and I am an executive coach based in Lusaka, Zambia, which is in southern Africa. And I’ve been a coach for about 12 years now. It’s been a privilege to practice transformation, change management and leadership development in my country. And this has been really a follow on to my first if I want to call it that way, my first career in international development, globally.

    Richard Anderson  1:54  
    Brilliant. And, and obviously, you’ve been doing that for a long period of time. And I remember a couple of years ago, when we first started having conversations, you said to me, Richard, I’ve got a vision, I’ve got a clear vision. And I want to develop the first psychometric test, not just to be used, of course, in Zambia, but across the continent of Africa. And I know that you told me the reasons for that but I think it’d be really good to let the listeners hear what what those were. So what was the vision? What was the vision in the first instance Nankhonde? Why did you want to build psychometrics specifically for Africa?

    Unknown Speaker  2:27  
    You know, I’ve been an executive coach for 12 years here, and not just in Zambia, working across eight African countries over this period. And I think initially, I was starting to understand that through my coaching, the way that I was able to observe impact was linked to my ability to translate, if I can call it the Western tools and methods that I had been trained in to the local culture. And this was very intriguing for me, because I had been using different tools to support coaching and organisations and started to realise that there were differences in the coaching experiences, where the culture was allowed to come forward, and actually be part of the conversation and the exploration, should I if I can put it that way, and trying to get to the bottom of understanding what was happening in particular coaching scenarios. And through that, I clearly started to pick up and code, these behaviours that were coming through, and their source and the source was the culture. And it was very interesting for me, because I’ve been trained in the West. And I really appreciated being grounded International, international best practice in management and leadership development, in terms of understanding psychology from a coaching perspective, and organisational behaviour, this grounding for me needed to be taken a step further, in my practice, to reflect the people I was coaching, the fact that they’re African. And the fact that they their experience is really driven by the cultural influences and nuances. And so I had been using psychometric assessments to help establish baselines to measure growth, because I was always influenced by being able to not only have a create the safety in the container, understand the objectives for the change. But eventually, over the years in my practice, metrics, and measuring transformation became even more important. And so the psychometric tools helped me to do that. And so I put the pieces together and got these tools that helped me establish a baseline have got this lens that’s looking into the culture, and it’s not being reflected in the tools so why not build the tool? So I was trying to solve my own problem and add more value to my clients by actually seeing them and seeing them in the session. Meaning that I see you as an African I see all of you, I don’t just see the professional you I see the culture and the environment that emerging market contexts are coming from. And that all has a role to play in this transformation. 

    Richard Anderson  5:06  
    Culture is such an important thing Nankhonde we’re hearing about it more and more. And I love that the you’ve been trained in the psychometrics that were potentially built for a western audience or using Western methodologies. But you want it to adapt that for an African cultural standpoint. What did you build in that case? So you’ve talked about kind of the why and why there was a need for this, but what did you go about doing what is what is Zanga Metrics?

    Nankhonde Kasonde-van den Broek  5:31  
    So Zanga African Metrics is a pursuit. And it’s a vision to provide solutions that help change in individuals and in teams and organisations from an African lens, I really wanted to appreciate and respect the international theories and tools that I have been trained in, but give them a local face, and give them the opportunity to really be leveraged to be optimised in this context and environment. So Zanga African metrics is about that. This company has been built and established to develop a tangible tool that can be used to establish a baseline from a management and leadership perspective, that not only gives feedback on performance and potential around cognitive and behavioural competencies, but layers it will five cultural dimensions, and those five cultural dimensions that I eventually came down to, because there were quite a few initially, when we started looking at the different aspects of the culture coming forward in the coaching sessions, I had about 15 of them. And I kept sort of trying to understand the linkages and the connections and the duplications and eventually came down to five. And these five cultural dimensions that are layered in the tool, beliefs, community, loyalty, respect, and pride. And so we’ve got our competency framework that has four pillars, it looks at your mindset, how you think relationships, how you relate with others, leadership, how you lead yourself, and how you lead and develop others. And finally, execution, how you get the job done, so the psychometric assessment that we built, looks at management and leadership competencies that I think are relevant and important in an organisational setting in an African context. And it’s really designed towards developing people. And so with that lens, the five dimensions are cross cutting, and through the design of the assessment, you can actually pick up the relationship to the five cultural dimensions in terms of how they influence decision making in an organisational context. And we don’t say that it’s right or wrong, we just say that it’s present. And if we’re going to really add value to our audience, who are African clients, then we recognise and see them through these cultural dimensions, and support them to appreciate how they’re influencing their decision making. 

    Richard Anderson  7:56  
    Of course it’s much more fit for purpose now that you’ve got to specifically towards those those cultural dimensions that you’ve talked about. And at what stage in the process, I guess, in the development process on the typically used Nankhonde, would you would you place these assessments in advance of going through training programmes, and maybe afterwards, how does that typically occur?

    Nankhonde Kasonde-van den Broek  8:15  
    So the assessment itself is actually developed to use either for recruitment, it does give you feedback, and it gives you feedback in terms of how you are performing against currently, and it doesn’t define you, it just gives you a status quo at this point in time about how you are performing in these four areas that we address through our competency frameworks that can be used for recruitment. And that is because we do have raw scores behind it, that we have been able to map to standard scores. And so that allows us to give a ranking of people in a particular cohort for recruitment of particular positions. At the same time, our initial vision for this, in terms of my work as a coach was with for development, for allowing managers and leaders to have a baseline that helps them appreciate who they are and where they are at any stage in their career and how best to develop them.

    Richard Anderson  9:09  
    Brilliant. And I think even though, you know, we’ve talked about recruitment and development and even though tool can be used for either aspect, and obviously working with leaders to develop leaders within an organisation, even from a recruitment standpoint, if you’re providing people with a little bit of feedback and information about where they’re at on the dimension, that’s a development tool in and of itself, even though it’s being used the application is for recruitment. So what you’ve done is fantastic. Brilliant. So you’ve talked through the why and the what behind Zanga African Metrics. I’m really keen and I know the audience will be because we have a lot of people that are considering developing their own psychometrics, and they’ll want to hear it from somebody who’s been there and literally worn the t shirt. So I’d be really keen to get into the process. So you were new to psychometrics. You know, you’d worked as a as a coach or consultant for a long time. You weren’t new to psychometric by using them, but building your own, it was a new process. So where did you start? Blank Slate,

    Nankhonde Kasonde-van den Broek  10:07  
    I think sometimes that I do get to ideas that I have to implement. I searched initially for a psychometric assessment that has a lens through the African culture and some cultural dimensions. And so I didn’t initially set out to build my own, I looked at the work of Philip Brzezinski. And I tried to find other tools that had taken that into account. I couldn’t find it, I couldn’t find anywhere on the continent. And maybe they’re there. And I wasn’t able to find them in my search. But it was quite a thorough search. And we realised that the number of assessments for management and leadership development tailored to the African culture and context are limited. And also it means that the norm group, so the comparison groups behind the assessments that help the understand the population, you’re being compared against, skewed towards the west. And so all this started, it was like peeling an onion went through solving this problem. And so I decided, then, well, if it doesn’t exist, let’s do it. Let’s build it, let’s contribute to the knowledge. And let’s contribute to African thought leadership in this space, and build the tool. And so that was the first exciting idea, then the process started, how and with whom, and I must say that I’m really delighted with the process, because it started by looking for people who can help me build this. And I identified first Sten10, Ben Williams, at Sten10 through LinkedIn, and through LinkedIn, I started engaging him on my idea, and we got an a call. And one of his great team members at the time, Kiki was brilliant, because Ben immediately knew that the cultural aspect was important in here to find somebody from his team of business psychologists who could relate and appreciate what I was trying to communicate. And so I worked very well with Kiki. Kiki helped me basically take out what was in my mind, and bring her expertise and her training through business psychology, to help us come up with what is now the Zangha, African Metrics and Zangha 1.0. And, in fact, in at the time, it was 1.0. But when we’re now on Zangha 2.0, because we’ve incorporated some of the feedback, so the process required relationships, and the relationships, search started through my networks and understanding who can I find who is in this space who can help me having connected to Ben, Ben, Ben introduced me to you, Richard, because once we had designed it, we now needed to develop it. And my relationship in the design and work with Sten10, I would say, was really a mutual partnership. Because when I came to them, I was quite clear that I had done my homework, I had sort of narrowed down my cultural dimensions, I had looked at the competency framework that I wanted to work with and narrowed down to those four pillars. And under each for each of the four pillars, there are four areas that they look at, in the questionnaire, we designed the assessment built in the cultural dimensions, then we had to develop the platform itself and the tool. And that’s where the relationship introduced evolve assessment solutions. I think what is key is that at every stage of the process, from the design into the development, there has been a mutual respect for each other. And there has been an appreciation that we are doing something new. And because we’re doing something new, there’s going to be a lot of questions, and we’re ready to figure them out together. And for me, that was brilliant. I wanted to work with people I knew had experience in the different areas, even looking on the continent, I did search from a Zambian perspective and not from an African continent perspective, for the skills that would help me design and develop this. And because of my global networks, and I think this is why it’s so important to serve and and be supported by local and global networks, is because the opportunity came to then work with the local team, I put together to make sure that my ideas and my categorization of the culture into these five dimensions made sense locally. And then I was able to bring the Global Partnership to the local team, and actually go from design to development with evolve assessment solutions. And that process was really over a period, you know, as you’re aware, it took us time to, to work from the design to the development to the testing.

    Richard Anderson  14:44  
    It’s been an absolute pleasure working on the project. And it’s funny because with projects of this nature, and when I say with projects of this nature, this is incredibly unique. You’ve got to be able to share the vision as well together I think and and obviously you’ve got a very entrepreneurial mindset with this. There’s this really a gap there that we’re looking to try and fill. And one of the things you were talking then Nankhonde that struck a chord. And it’s probably something that I’ve taken for granted a little bit because at this stage that I get involved, or we get involved as a company in these types of processes, all of the very, very hard work has been done, you could say, and obviously, we do a lot of hard work with building software to deliver. But there’s the questions and the items that go into a psychometric questionnaire, or psychometric test. But one thing I never considered was how much work you’d have to put into creating the dimensions and the behaviours that you want them to assess as well. But that wasn’t something that just happened overnight.

    Nankhonde Kasonde-van den Broek  15:37  
    No, it didn’t. And I must say, the other assessment tools that I’m certified in, really did some of the groundwork for me, because I didn’t study industrial psychology. My background is management. So I studied management. And I’ve always been fascinated by you know, how do people manage resources and organisations to achieve results. And so I had to then appreciate that the tools I’m accredited in, introduced me to the design of assessments, because the certification process takes you through the training in understanding what the assessment is designed to measure, and how to apply it and use it for impact with clients. And so I had that foundation, but really, I had to learn. And that’s what took me also to, to register to do the BPS test user certification training, the British Psychological Society test user certification training, to understand some of the terms that later clicky went on to use in our work, the validity, the credibility, the items, standard scores. So I had to do a lot of work myself, just to be able to come to the table with enough knowledge that could help me make decisions. And as an entrepreneur, I carry this mindset in everything I do, if I have to learn something, I’ll do it, I’ll study it. And I’ll be obsessed by it. And really, I think we the assessment development process became an obsession, because I would come out of the different sessions of development, design and development. And I would literally have to go online, and literally have to have calls with other colleagues who use assessments and solutions to just help understand what we were building and what I was understanding. So I did a lot of groundwork myself, I taught myself a lot of what I was then able to bring to the table, but knew that my knowledge and capacity really reached its limit, you know, the Peter Principle, and that’s where leveraging the other people’s skills in the network became very important.

    Richard Anderson  17:44  
    And you talked about the network and finding initially Ben through LinkedIn, it’s these tools are fantastic on the and the fact that we, you know, we’ve managed to build this relationship on different continents and using tools such as the ones that we’re using today. It’s incredible, we’re very fortunate in 2022, I think for the types of relationships that we can build because of the technology that we have at our disposal. And I guess as well Nankhonde, probably a, an iterative process. And it’s probably something that you’re constantly going to be reviewing the psychometrics or the results, the benchmarking the norms, potentially different versions of it, as time goes on.

    Nankhonde Kasonde-van den Broek  18:18  
    I had four objectives in the vision for this. And it was what does success look like? Success, for me looks like an assessment solution that is reflective of the population I’m trying to support. So make it relevant, make it accessible, and sustainable. So that meant actually ensuring that it was available on different platforms or devices. So whether it’s a laptop, or smartphone, you know, because the context here also is that not everybody will easily have access to device, or the internet. So I really wanted to address that, that make it relevant was the first thing I was trying to achieve. And also put it at a price point. That means that it’s not only used at middle to senior executive levels and organisations, it can be used throughout and much earlier. And this is because at every level, because we want people to arrive into the C suite, having built a solid foundation that has been prepared at each stage. And it’s so important in this African culture and context because people are coming from different experiences. And the nature of the of developing countries is that you can’t assume that the foundation people come into management and supervisory roles is is the same and that’s relevant globally. But even more so here. So you want to have this this playing field that we use tools to help even as people progress in their careers, so make it relevant and accessible. The second area was make it have impact in this context, it must be able to provide data for transformation, data for organisational change on performance and potential and linkage to then analytics that will help not just ELA and learning and development teams but So CEOs make decisions around how to manage and support their talent. And so collect the data. Even more important within that data is the first African norm group has the data, this population, but it’s actually, for the first time, when we look at the backgrounds to assessments, it says 90% is Western, maybe another 5% is African and often Africa is grouped in Middle East and Africa. So let’s reverse that. Let’s make a population that’s 90%. African, but still also have those benchmarks of Middle Eastern and possibly Europe and North America. This is important for me, because we want to be able to see what are the game changers in terms of human capital development on this continent, I want to be measured against the growth of the continent, we’re going through the Africa free trade agreement process, where Africa is actually opening doors to its markets to itself, we’ve looked externally for so long. And we’re finally figuring out how to leverage our relationships, and create a picture of the potential to not only trade but also grow and develop in a different way. And so for me, this data means let’s assess then each other in terms of leadership development, for for somebody in Zambia, let’s map you and compare you to somebody in Rwanda, or in Guyana, or in Kenya. And let’s see how we’re doing. Let’s create that data of development across the continent. And then let’s see how we can then live it with Western data. Because we still want benchmarks we all want to grow. And so for me, the data is so key and that data being generated is wealth, it’s gold. Because I think for the first time, we’re going to fully appreciate how some of these cultural nuances that the assessment captures, are actually reflected in the day to day and can support more impact.

    Richard Anderson  21:57  
    I mean, it’s so important to have a norm group or a benchmark group, a group in which somebody individual is compared against that’s a relevant group can’t be a completely irrelevant group, because it’s not going to measure what it’s supposed to measure. If it’s not against the, you know, an appropriate groups, I think what you’re doing is absolutely fantastic. I’m keen to find out a little bit more Nankhonde about the impact that this has had so far on what you’ve seen so far with rolling out Zanga African metrics and how it’s gone down in Africa so far.

    Nankhonde Kasonde-van den Broek  22:27  
    Interesting. So when we were doing the testing, we did approach respondents from seven African countries. And that was important, because we wanted to get the demographics that reflect not just Zambia, but also different regions across Africa, it was very important to understand that if we’re going to be able to have a credible assessment tool that speaks to the African context, we would need to ensure that other African regions are also included in the process, even though Zambia is the anchor and the home of the solution. And so impact wise, the feedback I’ve received is that this is pioneering this is new, because the fact that it is anchored in international best practice in management and leadership means that already, there’s some credibility. And there’s some references in terms of the theoretical frameworks behind what we’re trying to assess and measure. Now the cultural dimension is where I think the next level and the perspective changes. Because the perspective then goes from this tool that is robust and is credible, to the fact that it is now not as robust and credible, it is reflective, and it is relevant. And so that combination for me was really what I had an idea for what success should look like, the feedback I wanted to receive from the either coaches who were part of supporting the development, or the respondents who have used it and the clients we’ve worked with, has to understand, does it help you achieve your objectives at the end of the day, we’re trying to help you manage your talent. But we want to help you manage your talent in a way that you can create create learning pathways to success, that are reflective of your population or your employees. And the feedback we’ve had so far has been that the cultural dimensions really speak to some of the challenges that have ended up having people on performance improvement plans for the wrong reasons. It hasn’t been because they’re not competent. It is because when we look at some of the multinationals, we’re working with some of the insights into what growth should look like. And the predictability of behaviour from a management and leadership perspective, leaves out some of these lenses into the culture and so their blind spots into some of the reasons why people end up on performance improvement plans. And through the coaching and the conversations. The feedback has been that you’ve picked it up. And in fact, we have people who have been able to appreciate better what they need to do to To Change to achieve the results that the organisation is not seeing. And it hasn’t always been because of competence, it has been sometimes increased awareness around how some of the choices and decisions are being influenced by the culture. And to see where it’s present this when the assessment we call this application, meaning that it’s present, we all have a cultural aspects that are reflective in how we show up at work. So awareness is that its present, we move to application, meaning that you can see it’s more in the way this person makes decisions. And then adaptation is that it’s present in a way that it’s going to have an influence and impact in an organisational setting on the final outcome. That’s where the predictability of what the person is going to do changes. And so the feedback we’ve received from our clients, and I’m so happy that we’ve been able to implement Zenga, 1.0 and Xanga, 2.0, with clients in two financial institutions, one government department and one MnO. And we’re currently in the process of rolling out the Xanga, one point or 360 feedback assessments tool that has already been pre requested by three clients. And so it’s been really exciting to understand that the awareness and visibility of what we’ve built is coming forward. And as that increases, we’re now getting more requests to understand what is this tool that we’re using that is on the continent? And how can we actually get more information and how in terms of how we could potentially apply it in our organisation. And I think what has supported the timing of the birth of Xander African metrics is the global movement around cultural and diversity, if we’re going to really work on being more inclusive in organisations bringing equity and equality, we also need tools that we use as a standard that help us do that, and help us see the differences, not to focus too much on the differences in terms of why people are different, but rather use the differences as a lens to compliment. And I think the fact that we are able to bring in the cultural dimensions recognises that we are different. And in our differences. There are different factors that influence how we make decisions, and surely those perspectives can enrich an outcome. And so I’m really excited to be part of conversations about cultural and the diversity and inclusion globally. But even more so on the continent, because it’s interesting that from an African perspective, for example, Zambia, we have 73 ethnic groups. And although we have, the main languages that we use in some of our work is other seven main languages, we have always had diversity, or even within this culture. So this is a given, we have to build these tools, because it is who we are. And this is how we have learned to coexist.

    Richard Anderson  28:05  
    I mean, you speak so passionately about it Nankhonde. I love the fact that the feedback that you’ve received, is probably the very feedback that you were hoping to receive that the cultural component to this, which is all the hard work that you’ve put in all of that research. That’s the bit that’s getting the best, the best feedback and the fact that it’s relevant culturally. And I know of all the great conversations that you’ve been having. So you touched on looking at building the 360 tool. You’ve also mentioned the fact that you’ve built you initially had Zanga, 1.0. And now you have 2.0. And that’s based on feedback that you’ve been receiving from from clients and people that you’re speaking to, what’s the future look like? So, you know, if you look, five years into the future, what do you see for Zanga African metrics?

    Nankhonde Kasonde-van den Broek  28:48  
    So five years from now, interesting question. And what I see is an acquisition. From a business perspective, I believe, what we have built is a very valuable solution that will eventually become part of the suite of tools that a larger firm will acquire. And I do believe in partnerships, I believe in mergers and acquisitions. I think we create something good alone, but we create something great together. And so for me, in the next five years, I do see us merged or acquired by a larger firm, who is going to bring their size to a whole new level for Xanga. And the opportunity for this conversation that we’ve ignited in so many ways. At the same time. I also see as producing quite a lot of data about performance and potential from a management and leadership development perspective in organisations across Africa. So adding to not only the statistical qualitative, but also quantitative information about how change happens in this culture and this context on the continent. but also how to develop leaders to drive results. And I think it’s also speaking to in the next five years, what I believe is a shift in terms of, I believe what financial digital solutions did for the financial sector. Technology is doing for human capital development. And so I see more use of technology to facilitate and enable human capital development in a different way. And I think that’s where the fact that the assessment solutions being online means that they can be used by anybody anywhere. And so I do think there’s an opportunity for Sangha African metrics to even go beyond the African continent. When I gave, I received feedback from other cultures, I was interested to find out that because of the way we design the assessment solution, it’s not specific to Africa. And the cultural dimensions don’t tend to give you feedback to say, like I mentioned earlier that it’s right or wrong, it just says it’s there. And it is what it is, we’re using it as a almost a frame through which to see and support development. Because of that, the next five years, also has possibly Zanga metrics being Zanka metrics, from the Middle East, and Zanga metrics from Asia. Because those five cultural dimensions, the feedback I’ve received is that they’re so relevant, and speak into those cultures. And so I do see us over the next five years, going beyond the African continent, and being part of a much wider and larger solution, and contribution to the world.

    Richard Anderson  31:34  
    There’s an enormous amount of growth opportunity by the sounds of it. And I know that from what you’ve told me previously, as well, listen, Nankhonde just looking at the time, but that’s been absolutely fantastic. Thank you so much for making the time is there is there anything else that I haven’t asked that you would like to you would like to mention, while while you’re here,

    Nankhonde Kasonde-van den Broek  31:52  
    The only thing that I want to say is to say, really thank you to you, when we engage, you stepped into new territory, same same as Ben, it was so fascinating to bring you into my world. And as I brought you into my world, I also feel that I learned more about the sort of assessment solutions that you’ve been building for different for different clients, and how there was an opportunity to learn from here from an African perspective, and develop this global conversation around assessment solutions. And I really appreciate the fact that we have the story, we’ve built the story together. And I hope it’s going to inspire others to be a bit more daring. And to also understand that you can do it, I remember when I gave feedback to Ben and Kiki, that I want the rating scale to change, I don’t want to work zero to five or one to five, I actually wanted to have opposing statements, which forced people to determine first which statement is more like them, and then which one is less or more or more like them. through that whole process. I was given the evidence and the story and the theory behind why the Likert scales are developed and how this may not work. And I said it’s going to work because we’re gonna make it work. Because in this culture, you have to understand that social desirability is very high. And so we have to put people into a perspective where they have to choose. And so that world and stepping into it with me, is something that I want to thank you for. And Ben, because we have pioneered and created something new. And it did require some stretching of your understanding of how we were going to do this. But every time you both came back to me and said, Okay, well look into it, and came back with a solution. So I love that. And I really want to share with anybody who wants to do something like this, maybe not as as broad or as different. But working with Evolve Assessment Solutions and Sten10, for me, was the perfect partnership.

    Richard Anderson  33:55  
    Perfect Nankhonde. We didn’t script that at all. I didn’t ask you to do that. Didn’t you? Volunteer that so thank you so much. Absolutely. I’ve loved been involved in the project, you know, and having played a small part in it and can’t wait to see what the future brings. And I’m sure we your dreams will come true with it. But listen, Nankhonde thank you very, very much for making the time and thanks for coming to be a guest on Psyched For Business. I’ve loved having you on here in terms of how people can contact you if they want to find out a little bit more about Zanga African Metrics. Are you happy for me to put that your LinkedIn or website address on the blog post?

    Nankhonde Kasonde-van den Broek  34:29  
    You can put our LinkedIn and our websites link on the post in the podcast.

    Richard Anderson  34:34  
    Well, thanks for the time Nankhonde.

    Nankhonde Kasonde-van den Broek  34:36  
    It’s been a pleasure. Thanks.

    Voiceover  34:39  
    Thanks for listening to psych for business for show notes resources and more visit www.evolveassess.com

  • Psyched For Business Podcast Episode 9

    Psyched For Business Podcast Episode 9

    Episode 9:
    An overview of Neurodiversity in Assessments with Rob Dominic

    Richard is joined by Rob Dominic, an occupational psychologist and Founder of Viewpoint Psychology. In this episode, Rob gives us a great overview into neurodiversity and assessment.


    They cover:
    ✔️ Defining Neurodiversity
    ✔️ The importance of inclusion 
    ✔️ How employers can become a more accommodating neurodiverse workplace
    ✔️ Situational judgement tests, fairness, and neurodiversity
    and much more besides.

    Subscribe to the podcast on your favourite platform:

    Apple Podcasts

    Spotify

    Amazon/Audible

    Pocketcasts

    Other Platforms


    Episode 09 – Transcript 

    Voiceover (00:00:00):
    Welcome to Psyched for Business, helping Business Leaders understand and apply cutting edge business psychology principles in the workplace.

    Richard Anderson (00:00:11):
    Hi, and welcome to Psych for Business. I’m Richard Anderson. Thank you for joining me. In this episode, I’m joined by Rob Dominic. Rob is an occupational psychologist and Founder of Viewpoint Psychology. In this episode, Rob gives us a great overview into neurodiversity and assessment. I hope you enjoy and thanks for listening. So Rob Dominic, welcome to the show. Thanks for joining me. How are you doing?

    Rob Dominic (00:00:33):
    I’m good, thank you.

    Richard Anderson (00:00:34):
    Brilliant. Well, I’m really glad to have you on. I know that we’ve been talking about this for some time. We’ve also got to know each other fairly well, I would say this year, and I know that you’ve got a lot of insights to share, so I’ve been looking forward to this one. We’re going to talk, Rob, about neurodiversity and specifically about neurodiversity when it comes to assessment, which is a very, very important topic. But before we get into that, would you be happy just to give a bit of an introduction to yourself and your background and what you do?

    Rob Dominic (00:01:05):
    So, Rob Dominic, I’m a occupational psychologist by background. I have been for about 23 or 24 years. Mainly my focus, I mean it’s changed over the years, but mainly it’s around assessment, particularly in the last sort of 12, 15 years. So whether that’s designing assessment tools such as sort of ability tests or personality questionnaires, or whether it’s actually performing kind of deep dive interviews typically with kind of one-to-one, but leaders for two and a half hours to understand their kind of leadership qualities. So, I’d say assessments probably quite a big area for me.

    Richard Anderson (00:01:40):
    Brilliant. And we share that of course, in common mean less so on the consultancy and the development of these things, but certainly on the technology. So Rob, let’s go into the topic of neurodiversity. It’s funny because it’s a topic that we’re hearing more and more about for very good reason of course. You get a lot of influences on social media and LinkedIn and those types of platforms talking about this and bringing this subject into the forefront of people’s minds, which like I say is a really important thing. But what about just a bit of a definition to begin with, Rob, what do we mean by neurodiversity?

    Rob Dominic (00:02:17):
    Yeah, so I think neurodiversity is based on this idea that there are neurological variances within the brain and essentially that those should be recognized and if you like, respected, just like any other kind of human variation that we might have, like gender or eye colour, et cetera. What’s kind of important to recognize is that there isn’t really a standard human brain. There’s no one brain that we can then compare all other brains against to say, look, this is how it should be. A little bit like our fingerprint being unique for each individual. 

    So our brains, they are so complex that there isn’t one exactly alike another. So I think it’s those quite wide range, sort of natural neurological differences in the brain that affect the way we learn, how we think and how we kind of process information. So everyone’s brains wired differently. We all have our own unique way of thinking, interacting, and experiencing the world. So those kind of differences, I guess from a neurodiversity perspective means that what one person may find easy, another person might struggle with or vice versa. And I think ultimately it’s really about inclusion and ensuring that people in society are treated equally, if you like.

    Richard Anderson (00:03:45):
    Yeah, and you mentioned that word inclusion there. So we know that there’s a lot of businesses out there that are putting diversity inclusion strategies in place and they’re being measured against those. We’ve known for quite some time or I feel like we’ve known for quite some time about inclusion when it comes to things like gender, ethnicity, age, they’re fairly established I would say. Would you say that maybe neurodiversity is the new kid on the block?

    Rob Dominic (00:04:09):
    Yeah, yeah, absolutely. If I reflect on what we’re kind of asked to do as assessment experts in our work is that often organizations want to know for example, say how a test is performing and they’ll ask questions around gender, they’ll ask questions on ethnicity and on age grouping. And recently we actually submitted some of our tests to the British Psychological Society for their review. And that’s considered to be the kind of gold standard in terms of how tests are evaluated. 

    That’s the information amongst some other things that they want, but there’s no request for information around kind of neurodiversity. So I think you’re right in that, as you say, that kind of new kid on the block here it is, I think we’ve known about differences in terms of like learning differences in individuals some time. But actually it’s only recently that there’s a kind of lens that’s been put on this and organizations are starting to see it’s something that they need to take very seriously and I think that’s happening. But they’re also starting to ask questions about what can they do to make sure that they are as inclusive as possible in terms of attracting candidates that are neurodiverse.

    Richard Anderson (00:05:22):
    Yeah, because ultimately neurodivergence is an asset of course to any business. So we talked a little bit about the brain being different in each individual. So when it comes to neurodiversity, we’re talking things like autism, ADHD, dyslexia, dyspraxia, these are all kind of labels you might see within that umbrella term of neurodiversity. But, you know, when it comes to assessment, is there a one size fits all or do you have to treat all of these different areas within neurodiversity very, very differently.

    Rob Dominic (00:05:55):
    I mean, you hit a lot of the common sort of categories if you like, or labels. Tourette’s syndrome would probably be the only other one I’d add to that as the kind of really common ones. But I think what we are seeing in terms of assessment is that there isn’t exactly a one size fits all. That’s for us a kind of systematically removing barriers from an assessment would be the kind of gold standard. That’s what we really want is that therefore it’s one and actually it doesn’t impact on any one individual differently to others. 

    So that’s our gold standard. What we tend to actually do is really focus around making a kind of accommodations or reasonable adjustments to test and make sure that actually that they reduce the impact, if you like, on individuals that have a part of a kind of neurominority.
    What we see is a more spiky profile when it comes to that neurodiversity because there are greater highs and greater lows in terms of some of the strengths. If we go to that kind of the list that you went through around the more common labels, so ADHD, you’re looking at around about 4% of the population that have ADHD and there are potential strengths that come with that and there are sort of potential differences too. So things like creativity, passion, authenticity of what some other kind of real strengths. I think Greta Thunberg talked a bit about it from my own perspective, calling it, you know, superpower.

    But some of the differences are that inattention are the hyperactivity, there’s a kind of impulsiveness that sort of comes with that. Whereas autism, they think now that’s a roundabout 2% of the population that are autistic. You get with that kind of honesty, you get the kind of concentration, you get that kind of fine detail processing often have great memories particularly for the sort of detail, but they perceive the world differently.

    If you are an organization that’s perhaps using an interview as part of its kind of recruitment process like many other organizations will do, if you are expecting someone particularly that’s autistic to be able to present themselves kind of fluently, to be able to read the room in terms of some other body language that people might be demonstrating and sort of pick up on more of the kind of social aspects of that, then chances are that these candidates aren’t going to do that and in effect you would be discriminating against them on that basis. They perceive the world very differently. Social cues, sensory difficulties, so just things like fluorescent lighting as well can be quite challenging for some people who are autistic and they can often come across as being quite sort of blunt and direct.

    Dyslexia is probably another big one. About 10% of the population are dyslexic. Interestingly, some other kind of research that I’ve seen on dyslexia and entrepreneurs, is that they estimate around about 35% of entrepreneurs are dyslexic. Again, some other, if you like, the superpowers that come with those are creativity, sort of visual thinking, you’ve got mechanical skills. You again, that authenticity that comes with it, but perhaps less in terms of the language processing, organization, motor skills. 

    Dyspraxia is another one if you wanted to think about that one. 6% of the population often have great verbal skills, empathy, intuition, honesty or kind of positive traits that come with them, but might be quite clumsy. The fine motor and gross motor skills tend not to be the best. Can struggle with eye contact. So again, in an interview setting, their eyes can kind of move around much more and can be a little disorganized.

    Richard Anderson (00:09:47):
    So very different superpowers but very different challenges in each of the groups.

    Rob Dominic (00:09:52):
    If you really kind of focus on something like autism, Alan Turing, I think one of the quotes that he’s quite famous for is that he said, “Sometimes it’s the people that no one imagines anything of who do the things no one can imagine.” He was autistic. And I think what we’ve seen in society is that autistic people of largely been overlooked in terms of the contribution that they can make. I think the majority of autistic adults are unemployed. They tend to have poor mental health whilst kind of being unemployed and poor mental health might be linked. Actually they’re not linked to autism and we’ve tended to view autism really as a disease.

    Richard Anderson (00:10:35):
    So the mental health is probably or could be attributed to the way that they’ve either been treated or the life experiences that they’ve had because they’ve not been given the same opportunities as neurotypical people.

    Rob Dominic (00:10:44):
    Yeah. And suicide rates or attempted suicide rates are extremely high in autistic individuals but yet they have fantastic attention to detail that kind of detail, that strong interest in systems, understanding how things work, interested in experimentation, modifying systems. And I think that’s where things like invention or being able to kind of think really differently about something kind of comes into play. We often call it like pattern recognition. And so it’s the things that are predictable and once you’ve kind of got that pattern, being able to flip it and turn it round and look at it differently and play with it, means that actually you can start to think very differently about something. So a little bit like Alan Turing in terms of the kind of code breaking often considered as the kind of founding sort of father of kind of the early computer.

    Richard Anderson (00:11:39):
    Well yeah. Where would we be without him? That’s a hugely important message. It’s really interesting and important stuff, Rob. I think when we use assessments for recruitment selection, especially with bigger organizations, sometimes we need to be practical in the sense that you get hundreds, potentially thousands of applicants for certain roles with certain organizations and more often than not there needs to be some sort of sift put in there and often that’s some type of psychometric assessment. So how do we strike the balance between ensuring that we’re giving neurodiverse or neurodivergent individuals the opportunity to get through to the next stage after that assessment, but at the same time knowing that as businesses they have a job on responsibility to be able to sift and get X amount of people through the process. So how do we strike the balance? Ultimately it’s about making the assessments fair and inclusive, presumably for neurodivergent individuals.

    Rob Dominic (00:12:33):
    A lot of testing in this aspect requires what we would refer to as kind of reasonable adjustments or accommodations. And that doesn’t just kind of end with assessment. That kind of is then taken into the workplace as well. So there are certain accommodations that need to be made just as you would for someone that was physically disabled. We kind of accept that and make certain adjustments about the desk and et cetera, but also therefore need to be made for individuals that are neurodivergent and have specific needs. But if you like, your sort of invisible needs there. 

    So typically it is about kind of adjustments. That can be something as simple as extending the time of a test to redesigning an alternative form of that test in order to get at the kind of qualities that you are really looking for.

    So if I go back to that example of the interview where you might expect someone to be kind of fluent holding eye contact, being able to pick up on the kind of cues of sort of the behaviour of the interviewer. If those are the things that you are expecting and you’re not seeing those, then actually you might be making a judgement on. So devising a new assessment for them, is it really about focusing on what are the skills that you really need? So it might be around coding or depending on the role, whatever the kind of qualities you’re looking for. So it’s really about focusing on what you want to assess and finding a way of doing that that works for the individual and removing everything else from it. 

    As I said before, it’s kind of ultimately what you want in your assessment process or from your assessment tools is systematic fairness in that actually the test itself doesn’t require reasonable adjustment because it doesn’t have that impact. And I think what we are seeing as one of, you know, an opportunity to gain as much of that kind of systematic fairness from a test is the situational judgement test, which is really about kind of presenting different scenarios to candidates about a particular role and then giving them some options to look at and evaluate and to decide which are the most appropriate or least appropriate kind of responses to take in those situations. 

    So some of the work that we’ve been doing with Mencap over the last few months has been really valuable for us. It’s really given us some different things to think about. For example, the kind of use of the language that you’ve got within your test need to be simple, need to avoid where you can kind of long words, and I don’t mean sort of just words that are uncommon, but actually the length of the words with all the letters was really about kind of keeping it simple but also another thing that we’ve done to all of our tests now is kind of included the use of illustrations because what became really clear is if your situational judgement test either had a video of the scenario and therefore doesn’t require any reading, that was seen as hugely positive or if you had some sort of illustration of the situation that kind of brought it to life, reduced the requirement to kind of use, if you like, your own imagination and put yourself into that situation because you can see it sort of more visually in front of you. And those help to convey the meaning of the situation more fluently for individuals that were neurodiverse.

    Richard Anderson (00:16:03):
    So adding those extra layers if you like, so that video or that imagery to the question, give it a bit of a level playing field there for those neurodivergent individuals. That’s interesting Rob. So situational judgement tests have been shown to be the fairest. Is there still, because I mean I’ve had a podcast that I’ve recorded fairly recently about the, the concept of intelligence, just general intelligence and we’re talking about IQ tests and then ability tests, numerical verbal reasoning, those types of things. Has there been any research in terms of how those types of tests might either discriminate or not offer a level playing field to neurodivergent individuals? ‘Cause they’re timed and those types of things. I can imagine there’ll be immense pressure there for somebody sitting it

    Rob Dominic (00:16:47):
    The moment we time a test or that we have something which is cognitively loaded. So it’s kind of, you know, challenging and you know, there’s a right or wrong kind of response to it, then you are at risk of having some sort of adverse impact on a group or a category of individuals, so that there’s always a risk of that because of those two kind of elements that come with the testing. The history or the kind of the back dropping which kind of we are now looking at sort of individuals that are neurodiverse versus, I mean it’s a really unpleasant one, in terms of how individuals that are or autistic or neurodiverse in general have been treated. 

    So we’ve tried to, in our history as well as other countries in a sense try to prevent individuals that have learning difficulties from reproducing. I mean there’s a lot in terms of the historical kind of understanding of this, which I think needs to be kind of taken into perspective when we start thinking about it because it’s quite ugly in terms of, you know, some of the actions that have been taken against people. And if you think about Alan Turing in terms of how he was treated for things that were, he was different for at the time and we perhaps think it’s kind of not acceptable today, but as you say, also we’re still learning. 

    So there are still discoveries being made and differences that are being found. And as I said at the beginning, the brain, there isn’t one kind of template to say, look, this is normal, we are all wired differently. And I think what we really need is kind of much more research into it, a better understanding. And what we really want to move towards is actually seeing this as something which is kind of every day because as I said, 20% of the population are classified as neurodivergent, even the term neurodivergent, really what we’re talking neurominorities is probably better terminology for it. So we need to find a language around it, how we express it that is also inclusive, that celebrates some of those kind of differences rather than shame them. And I think too much of our history has been around kind of shaming. As I say, we kind of considered autism a disease. I mean that’s just a terrible sort of start point in terms of a language for it. 

    So what we really need is more studies and build our understanding of it. And so Simon Baron-Cohen has probably been one of the kind of pioneers, particularly around autism, and we want big data and one of the kind of studies that he’s done that comes to mind is they took 600,000 people and then 36,000 autistic people in their study. So that is big data and they’ve actually given them three questionnaires. 

    So one was a measure of EQ, so if you like empathy. Another was a measure around kind of systems interests, so that kind of understanding systems. And then the final one was around autistic traits because we all have some level of autism or autistic traits are within us, it’s just some are much more severe than others. So it’s not like we don’t have any of it because actually we’ve all got bits. And what they then did is that they divided the people into those that were STEM versus non-STEM. So that’s the kind of science technology, engineering, mathematics kind of careers. And what they found is that people in STEM have more autistic traits. 

    So in terms of that autism sort of questionnaire that they completed they had more autistic traits and they also found that females tended to be higher on the empathy and males more on the systematizing. And this isn’t about kind of stereotyping because it wasn’t that they were trying to say that all males and all females have these differences. Gender wasn’t the predictor, but there was a difference there that was kind of noticed. 
    And what they also found is that autistic people were either quite high on systemizing or extremely high on systemizing. So they have that difficulty with empathizing. So in terms of kind of managing relationships, so which must make it hugely challenging for them to show up at an interview in an organization and present themselves in the best possible way because so much of an interview relies on the ability to kind of relate to another person around kind of communicating fluently, getting your kind of best side across, understanding if you like, what the individual is implying through the way they’re saying things, the kind of social cues and being able to miss that \ must make it hugely challenging.

    Richard Anderson (00:21:45):
    Yeah, I completely agree. I mean you need to have the appropriate, whether it’s assessment or interview in place for the individuals that you’re going to recruit into that particular role. So we’ve talked Rob about situational judgement tests and how we’re seeing that they’re more or they’re fairer or more inclusive. But what’s the reason for that? Why would you say they’re more inclusive above and beyond something like inability or cognitive ability test?

    Rob Dominic (00:22:14):
    So we’ve been developing situational judgement tests for quite a number of years now and we’ve built up good databases, so of tens of thousands of data of people that have completed tests that we’ve developed. Through a lot of that we’ve been able to track things like gender, ethnicity and age groups because again, organizations are very familiar with tracking that type of information to make sure their recruitment process is a fair one. So we’ve been able to get that data and what we are seeing is a kind of clear pattern across all of the different types of situational judgement tests that we’ve got and we’ve got some from customer service through to graduates and managers is that they tend to be a much fairer and a more inclusive type of test for gender, ethnicity and age. So you don’t observe the same sorts of differences that you might with other sort of more particularly say some of the cognitive test.

    We think that one of the reasons for that really comes down to the fact that they’re untimed. So you can take as long as you’d like if you’d like. So whereas the vast majority of cognitive tests are timed, so you are looking for someone’s what we refer to as kind of maximal performance. So you have 15 minutes or 20 minutes, however long the test is, do your best in that time period and you see a complete focus on a test. 

    So a test which is untimed obviously means that you can relax into it a little bit more. You don’t get the same sort of performance anxiety as you might do with something that is timed. And then I think the other particularly important part of a situational judgment test is they’re not cognitively complex. They assess behaviour and whilst they’re challenging in the sense that you don’t always kind of see them, you know, it’s not an obvious sort of responses that you’re looking for, they don’t have the same kind of right or wrong type response as you might do say with a numerical reasoning type test.

    So it’s really about assessing something which is much more accessible and you can make that more accessible in terms of the language that you use. So anyone, regardless of their experience that they’ve had can come at these sorts of tests, read the scenario, read the options there and fully understand it without having any experience of say being a leader, you could still complete a situational judgment, test focused on leadership skills and understand and respond to the items in a way that kind of represents you. And I think that accessibility of them is another tremendous sort of advantage that it has around making them more inclusive.

    Richard Anderson (00:24:55):
    So we talk about tests being discriminatory and I like that term adverse impact studies that are often or should be always undertaken on tests to make sure they’re not adversely impacting any particular group. And I know from my experience that’s typically been age, gender, ethnicity, those types of things. Do you ever think Rob will get to a point where we can do adverse impact studies on neurodiversity and if so, will we have to capture that information up front from candidates?

    Rob Dominic (00:25:26):
    I mean it’s a really good point and I think that’s actually what we need. We need more studies done on individuals and to understand kind of those that are neurodivergent versus those that aren’t and also the different types of neurodivergent categories because we need to understand how our assessments are impacting individuals so we can make better choices about changing them or better choices about the reasonable adjustments or accommodations that we would make for individuals. And then unfortunately, as you said at the beginning, neurodiversity is kind of the new kid on the block, so we don’t really … we’re not there in our thinking yet. Organizations seem to be very much aware of it, very much interested in it and want to be kind of doing the right thing. We’re having a lot of conversations with companies about it, but there’s still a sensitivity around asking questions for it.

    So individuals need to feel that if they are providing this information on themselves, that it’s a safe environment to do so and that they’re not going to be treated any differently. And as we’ve already talked about with some other kind of, you know, historical background to some of this, that’s not been the case. So you don’t have a sort of very open, willing group of individuals that are happy to share this information about themselves because typically it’s been used against them. If you’ve got Tourette’s and you went to school, chances are you would’ve been bullied. It’s not something that we have traditionally seen as a positive, but it is something we need to start embracing much more and understanding the kind of positives that come with it because that certainly has that impact.

    So we need to encourage organizations to start asking about this and we need to be able to include it in some of the validation studies that we’re doing with our tests because we would want to change them. And you want to make sure that everyone’s kind of treated fairly because it’s a basic human right.

    Richard Anderson (00:27:24):
    Of course it is. And it’s one thing for organizations to create that environment as part of that application process in which candidates can readily volunteer that information as part of that application, but also for the candidates to do it themselves. Because I suppose we can draw some solids from the fact that if you went back, and I’m guessing here, Rob, and correct me if I’m wrong, but if you went back 20, 30 years, we might have said the same thing about things like ethnicity, age, gender, but now we are getting that information and we are able to perform those adverse impact studies.

    Rob Dominic (00:27:58):
    And I think the more research that’s done on it, both in terms of organizations like mine that are building tests, but also within academia, more of that that’s done, the more collaboration that kind of happens with organizations, with companies but also with other organizations like Mencap that are interested in neurodiversity. I think that’s to our benefit and to everyone’s benefit, but it’s a sensitive topic at the moment and I think it’s one that we need to get much more used to it being something which is every day. I’d quite like to get to the point where we say my colleague’s autistic.

    Richard Anderson (00:28:39):
    Of course it would. Fully agree. Brilliant. Rob. I’ve really enjoyed that discussion. I think we’ve got lots of takeaways from it in terms of what we need to do, what the evidence or what you’ve seen so far is happening with neurodiversity and assessment, what we need to do, I’d be keen if you’re happy to just if you wouldn’t mind telling the listeners how they could contact you if they want any more information or they want to get in touch with it to any of the services that you provide, how do they do that?

    Rob Dominic (00:29:07):
    Obviously if they already have your email address, they can kind of reach out to you to get to me, but our website is viewpoint-psychology.com or you can contact me either through the website there or you can find me on LinkedIn is another easy way to get in contact with me.

    Richard Anderson (00:29:22):
    Brilliant. Rob, thank you very much for your time.

    Rob Dominic (00:29:26):
    Thank you.

    Voiceover (00:29:27):
    Thanks for listening to Psyched for Business. For show notes, resources and more, visit evolveassess.com.

  • Psyched For Business Podcast Episode 8

    Psyched For Business Podcast Episode 8

    Episode 8:
    Picking the brains of the assessment agony uncle

    In this podcast episode, Richard Anderson is joined by Ben Williams, a chartered occupational psychologist, assessment design expert and Managing Director at Sten10.


    In this episode, we cover:
    ✅ How Ben got started in the world of occupational psychology and assessment
    ✅ A whistle-stop tour of the range of bespoke assessment projects that he gets involved with.

    Subscribe to the podcast on your favourite platform:

    Apple Podcasts

    Spotify

    Amazon/Audible

    Pocketcasts

    Other Platforms


    Episode 08 – Transcript 

    [00:01]
    Welcome to Psyched for Business, helping Business Leaders understand and apply Cutting edge business psychology principles in the workplace.

    [00:10]
    Richard Anderson: Hi, and welcome to Psyched for Business. I’m Richard Anderson. Thank you very much for joining me. In this episode, I’m joined by Ben Williams, Managing Director at Sten10. Ben is a chartered occupational psychologist and assessment design expert. In this episode, Ben talks us through how he got into the world of assessment and psychology and also gives us a whistle stop tour of the various bespoke assessment projects that he gets involved with. Thanks again for listening. Ben Williams, what a delight to have you on. How are you doing?

    [00:41]
    Ben Williams: I’m very well, thanks Rich. I was up at 5:30 AM to speak to a client in Australia, so a little bit blurry eyed. So, apologies.

    [00:49]
    Richard Anderson: Then you’ve come after that directly from a talk, haven’t you? That you were given, the agony. What was that about?

    [00:54]
    Ben Williams: Initially, it was a new feature on LinkedIn that popped up audio events. So, a little bit like the clubhouse app where people can just talk into a microphone, chat, almost like a live podcast where you can pick a topic and you can all contribute in a more democratic way perhaps than a Zoom call where everyone’s just talking over each other and it’s a bit of a mess. Nice technology. But what I was doing was acting without wanting to blow one’s own trumpet an oracle on all things assessments. So people came with questions about rating scales. What kind of rating sales should you use at assessment center? People asked about personality questionnaires, should you use normative or positive for selection of development. There was people who are MSC students through to leadership consultants through to in-house people, questions about how do you measure empathy and develop people on that front. So, we had a little discussion about the skill of building upon one’s empathy, but also the motivation to do it. Because some people just won’t see the business case for it and they’ll just say on, I’m not going to spend all my time listening to people’s feelings. So yeah, it’s really interesting discussion.

    [02:00]
    Richard Anderson: You weren’t blowing your own children. I think it’s the very fact that you are an oracle in those things that I was very keen to speak and obviously, you and I have known each other for, I was trying to work this out recently, but it must be over 10 years, in the past life of mine. You were a kind of partner, organization of ours, I think when you were independent maybe before you started Sten10. And we probably haven’t had a full conversation about what got you into this world in the first place. So, I’d be keen if you’d be happy to just indulge me for a couple of minutes and kind of take me back to why psychology, to begin with business psychology, you know, that’s one area of psychology, but why did you decide to go into business psychology and then assessment? We’ll get on the assessment bit.

    [02:37]
    Ben Williams: I can go earlier than that if you like, Rich.

    [02:39]
    Richard Anderson: Yeah. Why not?

    [02:40]
    Ben Williams: When I was a baby, no, for my A Levels, I’d chosen English and history and they said, those are two tough subjects. You want an easy third subject? And they said, psychology’s easy. And I said, yeah, go on. I didn’t really know much about it. Then when I started it, and it’s interesting that I didn’t realize that even at 16 years old, what appealed to me then has led to my career now. It was about putting a number to things that I thought were not measurable. So, five factors of personality, seven chunks of information we can hold in our short term memory. And I was like, what? Like you can measure this stuff. So that got me more interested in that than dissecting Ted Hughes crow for the umpteenth time in English or reading about crop rotation in the 14th century with history. So, I then did my undergraduate in experimental psychology because I still thought maybe I’ll be a clinical psychologist. I learned about the full spectrum of psychology, but always everything that could be shown through evidence based rather than lie on this sofa. And talk to me about your childhood. So, it was less the psychoanalysis, more experimental. Tried out an experience in a prison as work experience rather than her majesty’s pleasure in the forensic psychology department. So, I thought might go into that. At the time, I was pretty young and I couldn’t quite separate out ethically shaking hands with someone who had murdered someone but also perhaps needed my help. And I thought I would struggle with that on a day basis to be able to switch off afterwards.

    [04:13]
    Richard Anderson: And was that an interesting, you think you’d still think the same now?

    [04:16]
    Ben Williams: I think I’d be a bit more mature now. I mean, especially since becoming a dad, I think my empathy levels have gone through the roof, especially given the behavior of my children. I can empathize with prisoners now. I think it would change, but it was quite interesting actually because that whole empathy piece and what you need in order to work in some of these settings. So, we looked at a study back when I was working at one of the test publishers that looked at what makes a good nurse. And actually having an empathy for others, whilst you might think is a good thing to have is actually quite tough to have because you can’t switch off after work. And these nurses find that they’re quite stressed if they can’t switch off after work. So actually if you’re working at a prison as a psychologist, you benefit from being able to switch off afterwards and not caring about these. So it’s really quite an interesting one. So, business psychology was basically because one of my other tutors was OPP, Oxford psychologist press, Robert McHenry, who was always like a really interesting tutor, but also he had a very exotic lifestyle. So, he’d be traveling around the world. He’d say to me, Ben, I will mark your essays soon, but I’m currently in Africa watching herds of elephant suite past my hotel suites. And he wore a blazer with gold buttons on the cufflink, which I always remembered. I thought that’s a sign of success. So yeah, then I did a master’s at Surrey and entered the world of business psychology that way. So that was, that was my journey into the field.

    [05:43]
    Richard Anderson: It’s a really interesting journey as well. It’s funny because when you talk about doing your A levels, English, history, I did something similar, but I went down the sociology route for the same reason because that’s what people said. Sociology would be an easy one. And I think, well I passed it, Ben and I found it interesting enough, but it was nothing. I think for me it was nothing more than that at that time. I think if I was to do it bit like what you were saying before, you know, with the benefit of a few years of experience, if I was to go and do that again, I think I’d find it much more enjoyable than Emily Brandie or whatever it was that I was studying in English. So that was the journey into business psychology. Obviously we know what you do now and we’ll give you the chance to explain that probably towards the end of the podcast. But what then took you into the world of assessment?

    [06:28]
    Ben Williams: So, there’s an official answer and then there’s a bit of a silly answer. So the kind of a silly answer, which I don’t usually kind of mention is love and I don’t mean love for psychometrics, I mean the love of a woman. So, my current wife and then girlfriend at the test publisher I work for had a particular passion for people development and coaching. One that’s kind of followed her through to today. And when we left the graduate portion of our training, they need to decide where to allocate us and my wife went into the people development team, but they felt, well these two in a relationship, maybe we should keep them separate. I’m not quite sure what they thought we’d be doing on company time if we were in the same team, but, so I was putting actually into the training team. So I trained people for about 18 months in how to use psychometrics and how to assess, which whilst being terrifying at first because you’re dealing with HR professionals who are far more experienced than I was. I took solace in the fact that I’m an expert in this one little niche area and I got every question under the sun thrown at me. I learned how to either bat them away, answer them, postpone them, always I guess just trying to be frank with people. And I guess that that follows through to the webinar thing I did this morning. It was just about listening to questions and responding to them in the moment. So I think that forged my skill in that area. And then I went into the assessment team, so assessment center design assessment, center delivery, before my other two roles after that where I kind of continued that but broadened it out into different client types. The love reason is I was being kept separate from the love of my life. But also I think it goes back to that a level thing. Like I’m intrinsically interested in measuring things that are really hard and intangible to assess. That’s what gets me excited and interesting. I do like the coaching and development side, but yeah, it’s the assessment side where my main interest is.

    [08:28]
    Richard Anderson: And I can imagine that at that fairly young age, which I imagine you were delivering training to HR professionals, that would’ve been a daunting thing. But the fact that you were able to give yourself that level of comfort that I’m an expert in this particular area, I guess that was probably a big learning cur for and that maybe put you on the path that you’ve gone on since.

    [08:47]
    Ben Williams: Yeah.

    [08:48]
    Richard Anderson: Because it can be intimidating, Ben, that sort of thing when you’re young, you’re standing in front of a room full of people and you’re delivering a training session and you’re getting stern looks.

    [08:56]
    Ben Williams: It probably did forge my whole approach to how I act as a consultant because if you blag, it quickly comes unraveled and you just end up being far more embarrassed than if you say, I don’t know that, but great question, I’ll look into it. And just showing that honesty and integrity and upfrontness not only I think leads to people just trusting you more, but it’s less hassle for me personally. So I’m not thinking I’m operating in an area that I’m not an expert in. I’m either in my zone or I’m saying, sorry, that’s not something I can help you with and here’s someone who can.

    [09:31]
    Richard Anderson: I definitely think it’s the right way to go. And so when it comes to assessment or when it came to assessment, particularly at that time or maybe even at this stage, are there any areas or were there any areas that interested you more than others when it came to assessment?

    [09:46]
    Ben Williams: At the time, I was more of an assessment center person, so I liked the idea of creating day, the life experiences. And I think as companies got bolder, we started hearing about things like branding the room in which the assessment center takes place, maybe putting in some fun elements. So, when I worked at TMP, they were busing candidates to the assessment center in a London Open top bus, which had nibbles and things on board. So, all part of the experience and I thought, oh that sounds really fun. And yeah, just trying to give them a, a preview but also sell the job to them. So that was probably my initial interest. And psychometrics were more, oh you use something off the shelf and it’d be interesting, but I wasn’t so much involved in their design. Then as a freelancer, that’s where I started get intense experience doing that, starting off with a bit of work through test publishers, but also through test practice sites. So, writing hundreds and hundreds of abstract reasoning, verbal reasoning, numerical reasoning questions, which I like designing them. Obviously, that number’s a bit of a challenge, but then again that kind of then takes a side step into personality. And now I think probably what’s most interesting to me is trying to assess something new and thinking the best way of doing that. So when a client says we’ve got a model of what makes a great leader, we don’t want to use more of a vanilla off the shelf personality tool, we want the language, the length, the reports all to feel very much like us. Can you help us to create that? So, that’s really interesting. It obviously has its own challenges, but yeah, that’s probably where my interest is at the moment.

    [11:24]
    Richard Anderson: Brilliant. And you’ve given me a few things there in the last minute or so, we could take this probably in a couple of different directions. Now, I’m going to come back to what you’ve just mentioned there when it comes to bespoke assessments, when you know psychometrics in line with somebody’s model or somebody’s brand or whatever it might be. And just take your step back to the assessment center stuff that you’ve just talked about, the open top bus or whatever on the way to the assessment center. So, talk me through a little bit of that because I’ve never done an assessment center in my life, ever. I mean I’ve only, as you know, I’ve only worked for small businesses. And I’m not saying that these are exclusive to large businesses, but I guess they’re more heavily used in larger organizations. So, how does an assessment center typically work and how is it different now compared to what it was at that time?

    [12:09]
    Ben Williams: Yeah, so an assessment center has its roots in the Second World War, I think. They were finding that those people they were promoting to being an officer on the basis upon what education they’d received or who their family was, wasn’t necessarily, or just personal recommendations, wasn’t leading to the best officers. So, they needed a structured way of assessing people against job relevant tasks. So, they instigated the first assessment centers. Over time, that transferred into the commercial world. And it’s really the idea of multiple assessments. You’ve got multiple different competencies. So, unlike an ability test, it’s not looking at just one thing, it’s looking at maybe 8, 10, 12 different competencies in one day or one half day. You’ve got multiple exercises in which to assess them. So, if someone feels they stuffed up the group exercise, they’ve always got a second chance to show that same competency maybe in the interview or even in the personality questionnaire. And then there’s multiple assessors as well. So, you’ve not just got one person’s judgment determining your success or failure with all of those biases that can come in with it. You’ve got multiple different assesses, multiple different perspectives that can then be challenged at the washup session. So, an assessment center is typically, you’ll arrive for the day, you’ll be presented with a brief, usually it’s a fictitious company you’ve joined, you get org chart financial information, some email threads, and then you’ve got a diary of meetings or deadlines you’ve got throughout the day. So, maybe there’s a report that’s due by five o’clock, maybe you’ve got a team discussion about a problem your company’s facing and you need to sort it out together. Maybe there’s a role play with a customer, an angry customer that you need to go to at two. So that’s how they work. And I think over the years, they’ve probably become a little bit more immersive and face valid. So previously there were independent exercises administered when you read off an admin card and time at the stopwatch. Now, they’re far more, this is a day at the office, you manage it as you want to.

    [14:05]
    Richard Anderson: I’m sorry, Ben, just in face valid meaning?

    [14:08]
    Ben Williams: Meaning it looks to be an accurate representation of what you’ll need to do on the job rather than it being set in a, I don’t know if you’re applying for a job in a bank sitting an assessment center exercise that’s set on an oil rig and you’re thinking, hmm, I can’t really see the link. Obviously, the big move was in the pandemic when for that most assessment centers were face to face and all of a sudden, 100% of them had to be either canceled or go online. There’s been challenges and benefits to that. So, some of the benefits obviously are reduced cost of travel and hotels and assessor time is far reduced because they don’t have to travel. There are, I guess mixed views on its fairness. Mostly it’s positive because they say, well look, people don’t need to take a day off work to travel somewhere to an assessment center. They can dial onto it from home. There are some concerns over new biases that might sneak in those. So, when you’re being assessed face to face, you’re at the company’s premises in a little side room. When you’re being assessed from home, I’ve got the world’s most boring background behind me now, but if I had a poster of pulp fiction up there, would that be damaging my credibility as an oracle of psychology and people saying, oh he’s a bit of a flake. Or if I had a poster of Donald Trump here, I love Donald. Could that be leading people to draw certain conclusions about my personality? So yeah, there’s an element of that. I think the big challenge that companies are facing now is that I think virtual assessment centers are here to stay, even if that’s sometimes hybrid and they might do a bit face to face, but its how do you get across what a great place a company is to work when it’s all being done virtually. So, you can’t do the London bus anymore, you can’t do free suites, you can’t do the football table, it’s log on, do eight hours worth of zoom calls and then we’ll tell you whether you’ve got a job or not, how do you entice them to join.

    [16:00]
    Richard Anderson: And how much of that, Ben, is just based on the world in which we live now. I was going to say the majority of companies and I should have some stats around, but many companies work exclusively from home now are certainly hybrid and maybe that’s just the world that we live in now, do you think?

    [16:16]
    Ben Williams: It is and I think that means there are different competencies we need now to when we used to. But whereas, at a face to face assessment center, you get to see the office, you get to see the coffee making machine, you get to maybe chat to a graduate in between. If the assessment center’s done very much at a distance there, there isn’t that human connection. Even if you’re only going to go into the office once a month or entirely remotely, you need to build in opportunities for discussions. You need to maybe have a video tour if you are going to be in the office occasionally, maybe you need that welcome from the CEO at the start of the day. They say, oh they really do care about me. Oh, this got that personal touch. So, it’s trying to win people’s hearts as well as their minds. This looks like a good job, good salary. It’s actually, I want to work here because I like these people.

    [17:01]
    Richard Anderson: So, maybe as the general consensus is often when we speak about the topic of working from home or working remotely, maybe hybrids are the best approach. Probably the same with assessments in there?

    [17:11]
    Ben Williams: Yeah, I mean it’s so different for different companies. I mean I’ve been kind of dragged on a little bit of a journey. I mean when I say dragged, I think we were probably ahead of the curve in that. We moved to four days in the office rather than five, like well before the pandemic thinking, oh well, let’s have Fridays as the day that we don’t have to commute back. And that was quite forward thinking, but then pandemic meant a hundred percent remote and I was a bit reluctant to then say, right now let’s continue that completely. So, we’ve gone from two days in the office a week, now we’re on one day in the office a week and a check-in, constant check-ins on messaging, but also on a Wednesday. But then other companies I know even in the same area, they’ll come in once a month or another company comes in five days a week, they’ve gone straight back to that. It’s really tough and it’s always a balance of, well how are we going to keep the idea generation going, the sense of loyalty and commitment amongst the employees, but also entice people to join us when our competitors are saying, you don’t need to spend any money on travel. You don’t need to devote any of your evenings to the commute back from central London.

    [18:10]
    Richard Anderson: It’s so difficult. And, you know, I share that with you because I don’t know what the right answer is. I wish I did. And, everyone’s got their own. There’s a lot of views on it, I have to say there’s a lot of views on it, but I don’t think anyone’s come up with a perfect solution just yet. That’s assessments center piece. I was just interested. That’s really insightful. It gives me a bit of an idea about how these things are structured because although I know that that’s an area of what you do that I don’t particularly get involved with, it’s nice to kind of hear how that works to reverse to maybe five minutes ago when you were talking about creating those bespoke assessments or a client will come to you with a very specific requirement, they’re looking to measure these leadership competencies or behaviors. How do we go about doing it? That’s something that you get involved with a lot, isn’t it?

    [18:54]
    Ben Williams: Yeah, the shape of Sten10’s businesses really shifts over the years. So at one point, situational judgment tests were over half of all of our work and they’re still a portion of our work, but a much smaller percentage now. But custom psychometrics, so personality questionnaires, motivation questionnaires are now quite a big part of our work. At the moment, it’s typically at the leadership level, a company that either already has a clearly defined model or wants to work with us on their own unique perspective or maybe they’ve written a book and they want to say, look, how can we turn that into a psychometric to a company that books philosophy to help embed our branding. And there’s always a bit of a balance to be struck. So, obviously you can go out and buy tests that have been around for years and will do a great job at assessing someone’s personality, but you’ll need to put in a bit of legwork to interpret the report in the way that you want to. The language might not be quite right. The norms might not be quite right. So, we worked with a company recently, I know that we collaborated on this based in Africa that said actually a lot of the psychometrics on the market have a western bias to the language that’s used, how they interpret competency scores off the back of that. So, we want to develop an Africa first psychometric. So, it’s those kinds of scenarios that people are finding either frustration with or they’ve seen a commercial opportunity to promote their brand that they come to us and they say, help us to create something.

    [20:20]
    Richard Anderson: Many of these types of businesses, they’re entrepreneurial, they’ve maybe spotted that gap in the market, and they think they can do things better and you are there and, of course we’re there to support. We hear that terms, Ben, in psychometrics in an assessment of reliability, validity, those types of things. And without making any assumptions audience wise probably, and I’ll be grateful if you could just kind of define what those terms mean, but how do you ensure that the assessments that you create from scratch are going to be reliable, they’re going to be valid, those types of things. How do you do that?

    [20:52]
    Ben Williams: Reliability is shorthand in layman’s terms for consistency. So just think of consistency. There’s different ways we can see how consistent a test is. It can be to see is it consistent over time? So if I answer this personality questionnaire today, then I go home, have a late night, maybe receive an email, feel a bit more stressed, sit it again tomorrow, will my response be wildly different or is it a bit resilient to that? Is it quite consistent as a measure? And you want that to be as high as possible? And, so I guess how you achieve that is going to be around your administration instructions, telling people in what environment to sit the test in and also how to interpret the question. So, whether you are saying, well look how are you feeling right this second versus how do you generally feel and also writing just very clear questions that can’t be misconstrued depending upon the perspective that you read it from. So, that’s one type of consistency. And the other common one is called internal consistency. So, if you’ve got a questionnaire in a personality tool that might say something like, I don’t know, measuring extroversion, how wild and outgoing and lively are you? And how much energy do you get from others? If you write 10 questions, they should all be measuring extroversion. What you don’t want is one of them sneaking in there that measures something else. So, another of the big five personality traits is agreeableness. So, it’s how much you tend to get on with people, whether you are a warm kind of outgoing person. Now, if you had a question that was meant to be for extroversion but actually talked about how warm and engaging and sympathetic you are, then you say that’s not the same thing and you’re going to find that internal consistency is low. Now you could say, is that just something that psychologists worry about and get themselves caught up in? And it shouldn’t be because if you have an inconsistent scale, if you tell someone, Richard, you are a real extrovert, what does that actually mean? If it’s a whole melting pot of how agreeable you are, how extroverted you are, how much you like persuading people, then it’s, well, what’s exactly going on there? Whereas, if it’s a really tight definition of lively, outgoing, gets energy from others, that means much more. That’s just good, good test question writing and piloting, that’s how you get that. And then validity, again, there’s many types but I’ll only talk about the two most popular, two most important. One is content validity. So, that is the lowest form of legally defensible validity in the UK and it’s generally described as saying, have you done appropriate job analysis? So, you are analyzing the right qualities required in the job. For a bespoke personality questionnaire, I’ll be wanting to see that the areas that they’re proposing measuring have a track record of leading to success for those people in the job so they can say we’ve been in this executive search industry for 15 years and our directors have pulled their collective wisdom and time after time again, these are the traits that lead to success. So you say, okay great, that seems solid. The second type, we often don’t get before launching and that’s because it’s quite tricky to get. So, what you want to do is to see whether a test is called criterion validity, but does a score in a test predict behavior in a job or tenure in a job or customer satisfaction or something like that. And you need to correlate, so you need to do some statistics on it, see how strong that relationship is and you need reasonable sample sizes for that. So, you need at least 50 people to do that and you generally need some time having elapsed because if you’re going to use an ability test to screen people, you need to say, look, are they the best ones six months down the line, a year down the line. So that’s usually done after it’s launched.

    [24:35]
    Richard Anderson: That makes sense. And how long after typically would that?

    [24:39]
    Ben Williams: You’d want to wait at least six months because if someone’s just new into a job, they’re going to need to get their feet under the table and getting to the rhythm of it before you start judging their performance. So yeah, at least six months, ideally a bit longer.

    [24:50]
    Richard Anderson: Okay, brilliant. And while we’re on this topic, I think it’s probably irrelevant to go down the route of scoring. So, how are these assessments typically scored, I know that we hear a lot about raw scores and percentiles and STEM scores of course, where your name came from, who decides and what forms the decision around how we’re going to score this particular test or questionnaire?

    [25:13]
    Ben Williams: Usually, the decision is made in the very early stages of the design when we come up with what’s called a test design blueprint and we talk about all the parameters of the design. If we take some of those ones that you mentioned, so a raw score on its own, you scored nine out of 12, isn’t that meaningful because you don’t know if that’s good, bad, or typical of most people. So, what we do is we norm the scores. So, we say a nine out of 12, how does that compare to most people have sat the test in the past? Usually we take a sample of about a hundred people and then we can report what’s called percentile. So we can say you did better than 30% of people who sat the test before. So nine out of 12 is actually quite bad or you did in the top 10% of people who sat the test before, in which case that’s outstanding. Well done. So, percentile are quite useful for feedback because you can see like the way I just fed it back to you, you can understand it and you can set cutoff points quite clearly. So percentile are good. If you want to start doing anything clever with your score, if you want to start waiting, one test is more or less important than another or you want to start averaging them across a few tests, you can’t do that with percentile because percentile are basically telling you what rank order you came in versus everyone that’s done it before. So, they’re not equal units of measurement. So, that’s where standardized scores come in and it’s like just saying, well look, here’s the bell curve of everyone that sat the test before. The percentile say whether you’re up this end or down that end or in the middle. A standard score is like putting a ruler along the bottom of that and saying, right, we’ve got equal units of measurement now, let’s see what point you came along. So common ones would be a T score, transform score for ability tests or a Sten score for personality questionnaires. And our name Sten10 came from that because Sten10 is about, well it is precisely 2.28% of the population fall at that point. But of course I didn’t realize about the cartoon character Ben 10 when I named the company Sten10 and that’s caused untold confusion when I’m being introduced as Ben 10’s clients. But yeah, so a Sten score is often used for personality because T scores are more granular, they’re more finely divided, but with personality a 1 to 10 is fine.

    [27:25]
    Richard Anderson: It’s really interesting. So I think we’ll put some links up in line with this podcast transcript or something for anybody who’s interested in kind of going into real granular detail with those scoring systems. One thing I’m very keen to speak to you about is a really important topic, of course, is that of diversity and inclusion, that we’re hearing more and more about, we know the importance of it, we hear this term adverse impact when it comes to assessment quite frequently. How do we go about ensuring, you know, if you were creating a test from scratch for a leadership development test, how do you ensure that it won’t adversely impact or an ability test or whatever it might be?

    [28:07]
    Ben Williams: There’s a whole toolkit of things that you can do to try to reduce it. First thing I’d say is that there are differences between certain groups. So, men tend to be more competitive than women on average. And if we come up with a questionnaire that looks at competitiveness and measures it properly, then men will always score a bit higher than women on that and women will always score a bit higher on the more compassionate, empathic scales. So there are group differences that have been seen before countless times and therefore, it doesn’t mean that necessarily your test is wrong, it’s reflecting a real difference. But if you’ve got an aim to equalize opportunity for people from those groups, then you can do things like you can weight certain questions as being more important than others or you can just be bit more modest with your cutoff scores. Because if you set your cutoff point really high, the adverse impact is going to be much larger. We were talking to a client the other day that set their cutoff point at the 80th percentile, but they also had a diversity agenda and you are kind of balancing it. Well yes, that helps get you the numbers down, but that’s not going to help your diversity agenda.

    [29:17]
    Richard Anderson: So it’s what’s dragging that balance?

    [29:20]
    Ben Williams: Yeah. Also, there are some certain, I guess, societal factors that are going to impact upon how people, let’s say from lower socioeconomic groups are going to do in some of these assessments. So, less access to practice materials, less coaching, less role models maybe. And this applies to different ethnic groups as well. Maybe a little bit of bit of stereotype threat, like people like me, I can’t see anyone like me employed here, do I fit? And there’s been quite a bit of research that shows that affects your test performance as well. So, trying to encourage people to reduce that stereotype threat to say, look, there are people of all walks of life and all different groups who work here and getting people to relax before they take it, etc., is all going to help. That’s part of it. When we write the questions, we can put them through gendered language checkers to make sure that they’re not overly biased one way or the other. Verbal reasoning tests tend to be the biggest offenders when it comes to ethnic group differences. And I think the key thing is to say, well look, what’s your test seeking to assess? Is it assessing reasoning skills? In which case, a nonverbal test is going to do that for you. So, instead maybe you should be using an abstract reasoning test. Is it looking at your English language speaking skills? In which case, a better test would be looking at qualifications in English language. So, from the CV or application form. If it is, no, it is verbal reasoning that we’re looking at and we do need to simulate this, then it’s a case of saying, right, well if it’s a genuine like requirement of the role, then making sure that the reading difficulty is as difficult as you need it to be, but no more. So you can look like in word, it has a complexity checker and you can set it at, you can say, well what’s the typical range expected for an A level individual or a 14 year old or a white collar professional. So you can start getting a sense of how complex your questions are and whether you’ve over egged it. So there’s that. There’s also in the design phase, it’s speaking to a diverse range of people in the design phase to make sure there’s nothing culturally specific, any idiomatic language in there, piloting it on a diverse group, norming it on a diverse group. So yeah, there’s a whole host of things that you can do also from a neurodiversity perspective. So what are we going to do with candidates who have dyslexia? Have we built in the facility to change the time? Have we built in the facility to change the color of the font? Does it have screen reader technology for people who are partially sighted? People who have autism actually find certain types of tests more of a challenge than others. So things like situational judgment tests, these hypothetical scenarios. Place yourself in this fictitious imaginary scenario and tell us what you would do. It isn’t so easy to relate to. And in that case, it might just be, well don’t use an SJT in that scenario, actually instead either move them through the process or have an interview to discuss the areas you want to. So yeah, a multifaceted approach.

    [32:27]
    Richard Anderson: No, it’s really interesting stuff, Ben, and I’m guessing here, and please correct me if I’m wrong, but the stuff that we’re talking about when it comes to, particularly with adverse impact and ability tests and those types of things that more often than not applied to recruitment scenarios, recruitment and selection. Are you finding at the minute, and you know, I’ve got my own views on this, are you finding at the minute that your assessments are being used as much in recruitment as they are in learning and development settings? How do you find that? You know, just since Evolve has started, it’s been ups and downs in terms of recruitment, you know, one year or for this six months, then more learning and development, obviously we had the pandemic, we had war for talent, all of those things. What are you finding at the minute?

    [33:11]
    Ben Williams: I think like you, it’s quite up and down. So we’ll be, heads down, recruitment, recruitment, recruitment. I think there are obviously certain cycles in the year for graduate recruitment. So a lot of that will be happening now. So we will have less graduate assessment center design right now because they’ve been rolled out. But that will pick up again in kind of quarter one, quarter two next year. I’d say that, yeah, a lot of the requests for bespoke psychometrics is for use in a selection setting at the moment or as a complimentary bit to a selection setting rather than saying, let’s use this purely as a development tool. It’s probably a side effect of the pandemic with people acquitting their roles, but then applying for new ones and maybe ones that best suited, maybe this is this greater attention to getting the person to job match, right? So they’ll stay for longer and feel satisfied. Maybe that’s driving some of it.

    [34:08]
    Richard Anderson: I guess just to finish off, if you’d be happy to, I know that we’ve talked about this of course throughout, but maybe just letting the audience know kind the different types of things that you do at Sten10. Again, I know that we talked a little bit about it, but maybe a quick whistle stop and how people can get in touch with you if you want to.

    [34:25]
    Ben Williams: Great. Thanks, Rich. So, I’ll just do really quick. We help you to identify what you want to assess. So we design competency frameworks, values frameworks, strengths frameworks, etc. So that’s the foundation. We then help to design people assessments at any stage in the selection process or for development purposes. So, we’ll do right up the front structured application forms, telephone interviews, ability tests, all the way through to the final stages like the assessment center. Whilst we do come up with bespoke assessments, that’s our specific area of expertise, we also publisher agnostic. So, if we think a quicker win is for you to use an off the shelf tool, then we’ll always recommend that. And we’ve got relationships with all of our test partners. We will train, train people how to interview, how to assess, and that’s often to accompany what our interventions, but it doesn’t have to be. And also covering things that unconscious bias and we will evaluate, so we’ll do statistical analyses that will help you to decide which parts of your assessment process are working the best or the hardest, where there might be adverse impact, where you could save time by removing duplication of effort in your assessment process, etc. So, I guess in a nutshell, one stop shop assessment experts. And get in touch at sten10.com.

    [35:41]
    Richard Anderson: There you go. Not Ben 10. Brilliant. We’ll obviously link your LinkedIn profile and the Sten10 website address as part of this blog. But thank you very much. Really, really appreciate your time. Its great catching up as always, and in this setting it was even more interesting for me. But there you go. Thanks, Ben.

    [36:00]
    Ben Williams: Brilliant. Thanks, Rich.

    [36:02]
    Thanks for listening to Psyched for Business. For show notes, resources and more, visit evolveassess.com.