--- title: "AI tutors and learning outcomes: What the Research Says" description: "Plain-language summaries of studies on ai tutors and learning outcomes: methods, findings, effect sizes and limitations." canonical: https://research.askpoppy.ai/topics/ai-tutors/ last_updated: 2026-10-21 --- # AI tutors and learning outcomes: research in plain words What controlled studies say so far about AI tutors: when they help, when they hurt, and why the design of the tutor matters more than the model. ## Summaries (5) ### [Unrestricted ChatGPT help raised practice scores but lowered exam scores](/papers/bastani-2025-generative-ai-without-guardrails-harms-learning/) Hamsa Bastani et al. (2025) · Preregistered randomized controlled trial (field experiment) · Peer-reviewed In a high school in Turkey, students who practised maths with a plain ChatGPT-style GPT-4 assistant did much better during practice, then scored 17% lower than students without AI when they sat a test on their own. A second version with teacher-written prompts that gave hints instead of solutions avoided that drop, but did not beat the no-AI group on the test either. ### [A carefully designed AI tutor beat an active-learning physics class on a short-term test](/papers/kestin-2025-ai-tutoring-outperforms-active-learning/) Greg Kestin et al. (2025) · Randomized controlled trial with a crossover design · Peer-reviewed In a Harvard introductory physics course, students learned more on a short post-test when a lesson was delivered by a custom-built AI tutor at home than when the same material was taught as an in-class active-learning lesson. The tutor was not a plain chatbot: instructors wrote question-specific prompts and solutions and structured each step. ### [Supervised AI tutoring matched human tutors in UK maths classrooms](/papers/learnlm-eedi-2025-ai-tutoring-uk-classrooms-rct/) LearnLM Team (Google) et al. (2025) · Exploratory randomized controlled trial · Preprint (not peer-reviewed at the time of summary) In five UK secondary schools, pupils who got chat tutoring drafted by Google's LearnLM model, with every message checked by an expert tutor, did at least as well as pupils tutored by humans alone, and were 5.5 percentage points more likely to solve new problems on later topics. Tutors approved most AI drafts with little or no editing. ### [Six weeks of teacher-guided AI tutoring improved English results in Nigeria](/papers/de-simone-2025-chalkboards-to-chatbots-nigeria/) Martin De Simone et al. (2025) · Randomized controlled trial · Working paper Senior secondary students in Benin City, Nigeria, who attended twelve after-school English sessions using Microsoft Copilot, with teachers guiding and suggesting prompts, scored about 0.3 standard deviations higher on a final assessment than students who did not. They also did better on the regular end-of-term English exam, which covered more than the programme did. ### [An AI coach for human tutors raised topic mastery, most for weaker tutors](/papers/wang-2024-tutor-copilot-human-ai-tutoring/) Rose Wang et al. (2024) · Preregistered randomized controlled trial · Working paper / preprint Giving human tutors an AI tool that suggests expert-style next moves made their students 4 percentage points more likely to master a topic, and 9 points more likely for students of lower-rated tutors. Tutors with the tool asked more guiding questions and gave away answers less often. End-of-year test scores did not improve significantly. ## Free tools for this - [Best AI tutors that don't just give answers](https://learn.askpoppy.ai/best-ai-tutors-that-dont-give-answers/) - [Compare AI tutors side by side](https://learn.askpoppy.ai/compare/) - [How to tell whether an AI tutor makes you think](https://learn.askpoppy.ai/guides/ai-tutor-that-doesnt-give-answers/) Each summary says what the researchers did, who took part, what they found, the limitations, and whether we read the full paper or only the abstract. ```json {"@context": "https://schema.org", "@type": "ItemList", "itemListElement": [{"@type": "ListItem", "position": 1, "url": "https://research.askpoppy.ai/papers/bastani-2025-generative-ai-without-guardrails-harms-learning/", "name": "Unrestricted ChatGPT help raised practice scores but lowered exam scores"}, {"@type": "ListItem", "position": 2, "url": "https://research.askpoppy.ai/papers/kestin-2025-ai-tutoring-outperforms-active-learning/", "name": "A carefully designed AI tutor beat an active-learning physics class on a short-term test"}, {"@type": "ListItem", "position": 3, "url": "https://research.askpoppy.ai/papers/learnlm-eedi-2025-ai-tutoring-uk-classrooms-rct/", "name": "Supervised AI tutoring matched human tutors in UK maths classrooms"}, {"@type": "ListItem", "position": 4, "url": "https://research.askpoppy.ai/papers/de-simone-2025-chalkboards-to-chatbots-nigeria/", "name": "Six weeks of teacher-guided AI tutoring improved English results in Nigeria"}, {"@type": "ListItem", "position": 5, "url": "https://research.askpoppy.ai/papers/wang-2024-tutor-copilot-human-ai-tutoring/", "name": "An AI coach for human tutors raised topic mastery, most for weaker tutors"}]} {"@context": "https://schema.org", "@type": "CollectionPage", "name": "AI tutors and learning outcomes: What the Research Says", "description": "Plain-language summaries of studies on ai tutors and learning outcomes: methods, findings, effect sizes and limitations.", "url": "https://research.askpoppy.ai/topics/ai-tutors/", "publisher": {"@id": "https://askpoppy.ai/#org"}, "author": {"@type": "Organization", "name": "Ask Poppy team", "url": "https://research.askpoppy.ai/about/", "parentOrganization": {"@id": "https://askpoppy.ai/#org"}}, "datePublished": "2026-10-21", "dateModified": "2026-10-21", "inLanguage": "en"} {"@context": "https://schema.org", "@type": "BreadcrumbList", "itemListElement": [{"@type": "ListItem", "position": 1, "name": "Home", "item": "https://research.askpoppy.ai/"}, {"@type": "ListItem", "position": 2, "name": "Topics", "item": "https://research.askpoppy.ai/#topics"}, {"@type": "ListItem", "position": 3, "name": "AI tutors and learning outcomes", "item": "https://research.askpoppy.ai/topics/ai-tutors/"}]} {"@context": "https://schema.org", "@type": "Organization", "@id": "https://askpoppy.ai/#org", "name": "Ask Poppy", "legalName": "Poppy Labs AS", "url": "https://askpoppy.ai/", "logo": "https://askpoppy.ai/poppy-mark.png", "email": "hello@askpoppy.ai", "foundingLocation": "Oslo, Norway", "address": {"@type": "PostalAddress", "addressLocality": "Oslo", "addressCountry": "NO"}, "founder": {"@type": "Person", "name": "Simon Dreyer"}} ```