Mentivis OS OpenMentivis OS EntrepriseMentivis OS Edu
Contact usDemo
All articles
M · AI & TrainingGeneral

Published 9 September 2026 · Updated 10 October 2026 · By Marie Castelli, Partner, Mentivis

What AI cannot do in training

In training, AI cannot guarantee the accuracy of what it generates without human validation, assess relational or behavioural skills on its own, replace a trainer's support in complex learning, or make up for an organisation that leaves no time to learn. Poorly framed, it can even harm learning. These limits determine where human involvement must be kept.

Pillar: AI compliance and training: the AI Act and the skills to develop

Why identify the limits of AI in training?

Two opposing positions often dominate the debate: rejection ("the human relationship is irreplaceable, AI cannot train") and excessive expectation ("AI will replace trainers"). Both ignore the fact that AI is effective on some tasks and unreliable on others. Knowing which makes it possible to use AI where it adds value and keep human involvement where it is needed.

Knowing these limits is also part of the AI literacy that Article 4 of the AI Act requires organisations to develop among the people who use these systems.

What can AI not do?

Guarantee the accuracy of what it generates.
Language models produce texts that are fluent and seemingly coherent, yet may contain false information. This phenomenon, called hallucination, is described in the scientific literature as a known limitation of text generation (Ji et al., ACM Computing Surveys, 2023). Training content generated on a regulatory, technical or medical subject must therefore be reviewed and validated by an expert: generating is not verifying.

Assess on its own skills that require human judgement.
Public speaking, managerial posture, conflict management or listening in an advisory relationship are assessed through observation. An AI system can check that a learner knows the steps of a negotiation; it cannot judge whether they build the trust needed for it to succeed. These skills require human assessment: observation by a trainer, role-play with feedback, peer assessment.

Guarantee learning by its mere presence.
An experiment with nearly a thousand high school mathematics students (Bastani et al., PNAS, 2025) shows that unrestricted access to a ChatGPT-style assistant improves results during practice, but that students then score 17% lower than those who never had access when they must work on their own. A version designed to guide without giving answers largely mitigated this effect. The educational design of the tool matters as much as the tool itself.

Replace human support in complex learning.
A trainer brings judgement on the learner's particular situation, perceives what goes unsaid and sustains a relationship that supports effort. Feedback from a manager in a real work situation produces learning that AI does not reproduce.

Solve an organisational problem.
If employees have no time to train, if management does not value skills development, or if learners cannot apply what they have learned, no tool will make up for these conditions.

What limits does regulation set?

The AI Act regulates certain uses in training. Since 2 February 2025, it has prohibited AI systems intended to infer the emotions of a person in the workplace and in education institutions, except for medical or safety reasons (Article 5). Systems intended to assess learning outcomes in education and vocational training institutions are among the high-risk systems listed in Annex III, subject to human oversight requirements from 2 December 2027.

UNESCO, in its 2023 guidance on generative AI in education, recommends a human-centred approach, protection of learners' data and validation of tools before educational use.

What this means for a deployment

A sound programme deliberately combines two types of mechanisms:

AI is useful for Humans remain necessary for
Personalising pace and exercises Assessing behavioural and relational skills
Generating content and exercises to be validated Validating content on sensitive subjects
Answering routine questions at any time Supporting complex learning
Measuring and tracking learning Creating the conditions for on-the-job application

Frequently asked questions

Will AI replace trainers?

Not for complex, situational and behavioural learning. It takes over part of content production and support on structured knowledge, which changes the trainer's role without eliminating it.

Can experts be dispensed with to validate AI-generated content?

No for technical, regulatory or sensitive fields. Language models can produce plausible errors; expert validation before release and periodic checks remain necessary.

Can AI harm learning?

Yes, if it gives answers instead of guiding. The study by Bastani et al. (2025) measured lower results among students who had unrestricted access to an assistant, an effect largely mitigated by a version designed for learning.

For which types of training is AI most useful?

For structured, assessable skills: procedural knowledge, regulation, languages, use of tools, provided the content is validated.

Sources

Further reading

Related products: MentivisOS Entreprise, MentivisOS Education

What learners expect from an AI learning platform in 2026
How to choose an AI training system: the right questions to ask