{"id":5235,"date":"2023-11-01T01:54:43","date_gmt":"2023-10-31T22:54:43","guid":{"rendered":"https:\/\/www.matsh.co\/en\/?p=5235"},"modified":"2026-09-25T14:10:38","modified_gmt":"2026-09-25T10:10:38","slug":"recruiting-diverse-teams-to-build-more-ethical-and-equitable-ai","status":"publish","type":"post","link":"https:\/\/matsh.co\/en\/recruiting-diverse-teams-to-build-more-ethical-and-equitable-ai\/","title":{"rendered":"Diverse AI Teams and Responsible AI: Why Representation Is Only One Safeguard"},"content":{"rendered":"<p>Diverse teams can improve the range of perspectives involved in building artificial intelligence, but representation alone does not guarantee that an AI system will be fair, accurate or ethical.<\/p>\n<p>Responsible AI requires both <strong>inclusive participation<\/strong> and <strong>risk-management discipline<\/strong>: clear objectives, appropriate data, testing across relevant groups, transparency, accessibility, human oversight, impact assessment and monitoring after deployment.<\/p>\n<p>This is especially important when AI is used in employment, where automated systems can influence who sees a vacancy, who is shortlisted, how candidates are assessed, how workers are scheduled and how performance is evaluated.<\/p>\n<h2>Why diversity still matters in AI development<\/h2>\n<p>AI systems are socio-technical systems. They are shaped not only by code, but by decisions about:<\/p>\n<ul>\n<li>which problem is worth solving;<\/li>\n<li>how the objective is defined;<\/li>\n<li>which data is collected;<\/li>\n<li>which outcomes count as success;<\/li>\n<li>which harms are considered;<\/li>\n<li>who is affected;<\/li>\n<li>which trade-offs are accepted.<\/li>\n<\/ul>\n<p>A team with a narrow range of experience may be more likely to miss an important user group, accessibility issue, cultural assumption or harmful edge case.<\/p>\n<p>UNESCO&#8217;s Recommendation on the Ethics of Artificial Intelligence places diversity, inclusion, fairness, transparency and human oversight among the core principles of responsible AI.<\/p>\n<p><a href=\"https:\/\/www.unesco.org\/en\/artificial-intelligence\/recommendation-ethics\" target=\"_blank\" rel=\"noopener\">Source: UNESCO, Recommendation on the Ethics of Artificial Intelligence<\/a><\/p>\n<h2>Diverse teams are a safeguard, not a guarantee<\/h2>\n<p>It is possible to have a demographically diverse team and still build a harmful system. It is also possible for a relatively homogeneous team to identify some risks through strong governance and external challenge.<\/p>\n<p>The stronger approach is to combine representation with:<\/p>\n<ul>\n<li>multidisciplinary expertise;<\/li>\n<li>stakeholder participation;<\/li>\n<li>documented risk assessment;<\/li>\n<li>representative testing;<\/li>\n<li>clear accountability;<\/li>\n<li>independent challenge where appropriate.<\/li>\n<\/ul>\n<h2>Start with the objective the AI system is optimising<\/h2>\n<p>Before looking at the model, ask what the system has been told to optimise.<\/p>\n<p>The International Labour Organization&#8217;s 2025 working paper on AI in human-resource management warns that AI systems can encode poorly defined objectives, rely on biased or incomplete data and operate through opaque processes.<\/p>\n<p><a href=\"https:\/\/www.ilo.org\/publications\/ai-human-resource-management-limits-empiricism\" target=\"_blank\" rel=\"noopener\">Source: ILO, AI in Human Resource Management: The Limits of Empiricism, 2025<\/a><\/p>\n<p>A recruitment system designed to predict &#8220;culture fit&#8221;, &#8220;growth mindset&#8221; or &#8220;future potential&#8221; may appear objective while operationalising a vague human concept through weak proxies.<\/p>\n<p>Ask:<\/p>\n<ul>\n<li>What exactly is the system predicting?<\/li>\n<li>Why is that outcome relevant to the job?<\/li>\n<li>What evidence supports the proxy being used?<\/li>\n<li>Could the objective disadvantage a group for reasons unrelated to performance?<\/li>\n<\/ul>\n<h2>Data quality is an ethical issue<\/h2>\n<p>AI systems learn patterns from data. If historical data reflects unequal access, biased decisions or underrepresentation, the system can reproduce those patterns.<\/p>\n<p>Data problems can include:<\/p>\n<ul>\n<li>missing groups;<\/li>\n<li>poorly labelled outcomes;<\/li>\n<li>historical bias;<\/li>\n<li>proxies for protected characteristics;<\/li>\n<li>data collected for a different purpose;<\/li>\n<li>different quality across populations;<\/li>\n<li>language or accessibility gaps.<\/li>\n<\/ul>\n<p>The question is not only whether the dataset is large. It is whether the data is appropriate for the decision the system is being asked to support.<\/p>\n<h2>Employment AI deserves especially careful scrutiny<\/h2>\n<p>Hiring and workforce-management systems affect access to jobs, income and career opportunity.<\/p>\n<p>The ILO&#8217;s 2025 analysis of AI in HR highlights risks in recruitment, compensation, scheduling and performance management, particularly when systems are built on reductive objectives or opaque data-driven assumptions.<\/p>\n<p>The ILO also notes that AI can potentially support fairer and more transparent HR processes when it is designed and governed responsibly.<\/p>\n<h2>Inclusive recruitment teams should not rely on intuition alone<\/h2>\n<p>When recruiting AI professionals, organisations can reduce arbitrary decision-making by using:<\/p>\n<ul>\n<li>job-related selection criteria;<\/li>\n<li>structured interviews;<\/li>\n<li>consistent scoring rubrics;<\/li>\n<li>skills-based assessments;<\/li>\n<li>multiple reviewers for important hiring decisions;<\/li>\n<li>accessible recruitment processes;<\/li>\n<li>monitoring of progression through the recruitment funnel.<\/li>\n<\/ul>\n<p>Diversity goals should not replace job-related assessment. The objective is to widen opportunity and reduce unnecessary barriers while maintaining a clear standard for the work.<\/p>\n<h2>Remove unnecessary barriers from AI job descriptions<\/h2>\n<p>AI teams need a range of roles, not only machine-learning researchers.<\/p>\n<p>Depending on the system, relevant expertise can include:<\/p>\n<ul>\n<li>software and data engineering;<\/li>\n<li>statistics;<\/li>\n<li>product management;<\/li>\n<li>cybersecurity;<\/li>\n<li>privacy;<\/li>\n<li>law and compliance;<\/li>\n<li>human factors;<\/li>\n<li>accessibility;<\/li>\n<li>domain expertise;<\/li>\n<li>ethics and social research;<\/li>\n<li>operations;<\/li>\n<li>user research.<\/li>\n<\/ul>\n<p>Overly narrow degree, pedigree or experience requirements can shrink the talent pool without improving job performance.<\/p>\n<h2>Multidisciplinary teams can see different classes of risk<\/h2>\n<p>An engineer may identify model-performance issues. A domain expert may recognise that the target variable is meaningless in practice. An accessibility specialist may identify a barrier for disabled users. A privacy professional may identify unnecessary data collection. A frontline employee may show that the workflow does not match real work.<\/p>\n<p>This is why NIST describes AI risk management as a multidisciplinary and socio-technical activity rather than a purely technical exercise.<\/p>\n<p><a href=\"https:\/\/www.nist.gov\/itl\/ai-risk-management-framework\" target=\"_blank\" rel=\"noopener\">Source: NIST AI Risk Management Framework<\/a><\/p>\n<h2>Include affected people, not only internal experts<\/h2>\n<p>Internal diversity is useful, but the people building the system are not always the people most affected by it.<\/p>\n<p>Depending on the use case, stakeholder participation can include:<\/p>\n<ul>\n<li>employees;<\/li>\n<li>job applicants;<\/li>\n<li>customers;<\/li>\n<li>worker representatives;<\/li>\n<li>people with disabilities;<\/li>\n<li>community organisations;<\/li>\n<li>subject-matter experts;<\/li>\n<li>people from affected language or cultural groups.<\/li>\n<\/ul>\n<p>Participation is most useful when stakeholders can influence design choices rather than being consulted after the important decisions have already been made.<\/p>\n<h2>Test performance across relevant groups<\/h2>\n<p>An overall accuracy score can hide important differences.<\/p>\n<p>Responsible testing may need to examine:<\/p>\n<ul>\n<li>false-positive and false-negative rates;<\/li>\n<li>performance by relevant demographic group;<\/li>\n<li>language performance;<\/li>\n<li>accessibility;<\/li>\n<li>edge cases;<\/li>\n<li>different devices or environments;<\/li>\n<li>different levels of data quality.<\/li>\n<\/ul>\n<p>Which groups are appropriate to test depends on the use case, population and law.<\/p>\n<h2>Accessibility should be designed in from the start<\/h2>\n<p>AI-enabled recruitment can create barriers for candidates with disabilities when systems assume a narrow range of speech, facial movement, interaction style, device use or response format.<\/p>\n<p>The ILO has highlighted that AI can both improve accessibility and create exclusion depending on how systems are designed and used.<\/p>\n<p><a href=\"https:\/\/www.ilo.org\/resource\/article\/ais-double-edged-sword-new-frontier-employment-people-disabilities\" target=\"_blank\" rel=\"noopener\">Source: ILO, AI&#8217;s double-edged sword and disability employment<\/a><\/p>\n<p>Organisations should provide accessible alternatives and a process for reasonable accommodation appropriate to the jurisdiction.<\/p>\n<h2>Do not assume automation removes human bias<\/h2>\n<p>An automated system can reproduce human bias through historical data, labels, proxies or design choices. It can also create new forms of bias through optimisation and scale.<\/p>\n<p>Human review is still important, but &#8220;human in the loop&#8221; is not enough if the reviewer simply accepts the system&#8217;s output.<\/p>\n<p>Reviewers need:<\/p>\n<ul>\n<li>authority to override;<\/li>\n<li>information about limitations;<\/li>\n<li>time to examine cases;<\/li>\n<li>a process for escalation;<\/li>\n<li>accountability for the final decision.<\/li>\n<\/ul>\n<h2>Human oversight should be meaningful<\/h2>\n<p>UNESCO&#8217;s AI ethics framework emphasises that AI should not displace ultimate human responsibility and accountability.<\/p>\n<p>Meaningful oversight asks:<\/p>\n<ul>\n<li>Who owns the decision?<\/li>\n<li>Can a person explain why the system was used?<\/li>\n<li>Can the affected person challenge an outcome?<\/li>\n<li>Can the system be paused if harms emerge?<\/li>\n<li>Who monitors performance after deployment?<\/li>\n<\/ul>\n<h2>Use impact assessment before high-risk deployment<\/h2>\n<p>UNESCO has developed an Ethical Impact Assessment tool to help organisations examine alignment with its AI ethics principles.<\/p>\n<p><a href=\"https:\/\/www.unesco.org\/en\/articles\/ethical-impact-assessment-tool-recommendation-ethics-artificial-intelligence\" target=\"_blank\" rel=\"noopener\">Source: UNESCO, Ethical Impact Assessment<\/a><\/p>\n<p>Before deploying a consequential system, assess:<\/p>\n<ul>\n<li>intended purpose;<\/li>\n<li>affected populations;<\/li>\n<li>possible benefits;<\/li>\n<li>foreseeable harms;<\/li>\n<li>data sources;<\/li>\n<li>performance limitations;<\/li>\n<li>human oversight;<\/li>\n<li>redress;<\/li>\n<li>monitoring;<\/li>\n<li>conditions for stopping use.<\/li>\n<\/ul>\n<h2>Monitor the system after deployment<\/h2>\n<p>A system that performs acceptably in testing can behave differently when:<\/p>\n<ul>\n<li>the applicant pool changes;<\/li>\n<li>job requirements change;<\/li>\n<li>language changes;<\/li>\n<li>data drifts;<\/li>\n<li>users adapt their behaviour;<\/li>\n<li>the vendor changes the model.<\/li>\n<\/ul>\n<p>Responsible AI requires ongoing monitoring, not a one-time fairness test.<\/p>\n<h2>Vendor tools still require employer accountability<\/h2>\n<p>Buying a recruitment or HR AI product does not remove the organisation&#8217;s responsibility to understand what it is doing.<\/p>\n<p>Ask vendors:<\/p>\n<ul>\n<li>What objective does the model optimise?<\/li>\n<li>Which data was used?<\/li>\n<li>How has the system been tested?<\/li>\n<li>Which populations were included?<\/li>\n<li>What accessibility testing was performed?<\/li>\n<li>What information can be given to affected people?<\/li>\n<li>How are model changes communicated?<\/li>\n<li>Can customers audit outcomes?<\/li>\n<li>How is data retained and protected?<\/li>\n<\/ul>\n<h2>Diversity metrics should cover the employee lifecycle<\/h2>\n<p>If an organisation wants a more representative AI workforce, recruitment is only the first step.<\/p>\n<p>Track, where lawful and appropriate:<\/p>\n<ul>\n<li>applicants;<\/li>\n<li>shortlists;<\/li>\n<li>offers;<\/li>\n<li>acceptance;<\/li>\n<li>retention;<\/li>\n<li>promotion;<\/li>\n<li>pay;<\/li>\n<li>access to important assignments;<\/li>\n<li>leadership representation.<\/li>\n<\/ul>\n<p>A company can hire a diverse entry-level cohort and still lose diversity through promotion or retention patterns.<\/p>\n<h2>Create a team culture where risk can be raised<\/h2>\n<p>Representation is less useful if people do not feel safe challenging a product decision.<\/p>\n<p>Leaders should make it legitimate to ask:<\/p>\n<ul>\n<li>Who could this harm?<\/li>\n<li>Which population are we missing?<\/li>\n<li>What assumption are we making?<\/li>\n<li>What happens if the model is wrong?<\/li>\n<li>Should this decision be automated at all?<\/li>\n<\/ul>\n<h2>A practical responsible-AI staffing model<\/h2>\n<p>For a consequential AI project, consider whether the team has access to:<\/p>\n<ol>\n<li>technical AI expertise;<\/li>\n<li>domain expertise;<\/li>\n<li>data governance;<\/li>\n<li>security;<\/li>\n<li>privacy;<\/li>\n<li>legal\/compliance expertise;<\/li>\n<li>accessibility;<\/li>\n<li>human factors or user research;<\/li>\n<li>affected-user or worker perspectives;<\/li>\n<li>senior accountability for deployment.<\/li>\n<\/ol>\n<p>The exact mix depends on the system and risk.<\/p>\n<h2>Responsible AI is a process, not a diversity statement<\/h2>\n<p>Diversity can make AI teams better able to see risks and serve a wider range of users. But ethical outcomes require an operating system around that diversity: governance, testing, accountability and real stakeholder participation.<\/p>\n<p>The strongest question is therefore not &#8220;Is our AI team diverse?&#8221; It is &#8220;Do we have the perspectives, processes and controls needed to identify and manage the risks this system creates?&#8221;<\/p>\n<h2>MATSH and responsible workplace technology<\/h2>\n<p>MATSH provides professional-development content across leadership, HR, diversity, technology and workplace capability. Organisations adopting AI in HR should combine technical expertise with strong people-management, fairness and governance capability.<\/p>\n<h2>Frequently asked questions<\/h2>\n<h3>Does a diverse AI team automatically produce unbiased AI?<\/h3>\n<p>No. Diversity can broaden perspective, but fairness also depends on objectives, data, testing, governance, oversight and monitoring.<\/p>\n<h3>Why can AI hiring tools be biased?<\/h3>\n<p>Bias can enter through historical data, labels, proxies, poorly defined objectives, non-representative testing or the way the system is deployed.<\/p>\n<h3>Should employers use AI in hiring?<\/h3>\n<p>AI can support recruitment, but employers should assess whether the tool is job-related, accurate, accessible, transparent enough for the use case and governed appropriately under applicable law.<\/p>\n<h3>What is the role of human oversight?<\/h3>\n<p>Humans should retain meaningful responsibility for consequential decisions, understand system limitations, be able to override outputs and provide a route for challenge or redress.<\/p>\n<h3>What should an AI ethics team include?<\/h3>\n<p>There is no universal structure. Consequential projects often need technical, domain, privacy, security, legal, accessibility, human-factors and affected-stakeholder perspectives.<\/p>\n<h2>Related MATSH resources<\/h2>\n<ul>\n<li><a href=\"https:\/\/matsh.co\/en\/digital-skills-for-professionals\/\">Digital Skills for Professionals: What You Need in 2026 and Beyond<\/a><\/li>\n<li><a href=\"https:\/\/matsh.co\/en\/ai-technology-professional-training-2026\/\">AI and Technology in Professional Training<\/a><\/li>\n<li><a href=\"https:\/\/matsh.co\/en\/cybersecurity-upskilling-african-banking\/\">Cybersecurity Upskilling in African Banking<\/a><\/li>\n<\/ul>\n<h2>Sources<\/h2>\n<ul>\n<li><a href=\"https:\/\/www.ilo.org\/publications\/ai-human-resource-management-limits-empiricism\" target=\"_blank\" rel=\"noopener\">ILO &#8211; AI in Human Resource Management: The Limits of Empiricism, 2025<\/a><\/li>\n<li><a href=\"https:\/\/www.nist.gov\/itl\/ai-risk-management-framework\" target=\"_blank\" rel=\"noopener\">NIST &#8211; AI Risk Management Framework<\/a><\/li>\n<li><a href=\"https:\/\/www.unesco.org\/en\/artificial-intelligence\/recommendation-ethics\" target=\"_blank\" rel=\"noopener\">UNESCO &#8211; Recommendation on the Ethics of Artificial Intelligence<\/a><\/li>\n<li><a href=\"https:\/\/www.unesco.org\/en\/articles\/ethical-impact-assessment-tool-recommendation-ethics-artificial-intelligence\" target=\"_blank\" rel=\"noopener\">UNESCO &#8211; Ethical Impact Assessment<\/a><\/li>\n<li><a href=\"https:\/\/www.ilo.org\/resource\/article\/ais-double-edged-sword-new-frontier-employment-people-disabilities\" target=\"_blank\" rel=\"noopener\">ILO &#8211; AI and employment of people with disabilities<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Evidence-led guide to diverse AI teams and responsible AI, covering data quality, testing, accessibility, human oversight, impact assessment and ongoing monitoring.<\/p>\n","protected":false},"author":1,"featured_media":5236,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","footnotes":""},"categories":[268,269],"tags":[],"class_list":["post-5235","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-human-resources","category-recruitment"],"_links":{"self":[{"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/posts\/5235","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/comments?post=5235"}],"version-history":[{"count":5,"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/posts\/5235\/revisions"}],"predecessor-version":[{"id":10312,"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/posts\/5235\/revisions\/10312"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/media\/5236"}],"wp:attachment":[{"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/media?parent=5235"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/categories?post=5235"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/tags?post=5235"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}