Kwame for Science: An AI Teaching Assistant Based on Sentence-BERT for Science Education in West Africa

• URL: http://arxiv.org/abs/2206.13703v2
• Date: Mon, 11 Jul 2022 00:13:42 GMT
• Title: Kwame for Science: An AI Teaching Assistant Based on Sentence-BERT for Science Education in West Africa
• Abstract summary: Africa has a high student-to-teacher ratio which limits students' access to teachers. We extended Kwame, our previous AI teaching assistant, adapted it for science education, and deployed it as a web app.
• Score: 1.6799377888527687
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Africa has a high student-to-teacher ratio which limits students' access to teachers. Consequently, students struggle to get answers to their questions. In this work, we extended Kwame, our previous AI teaching assistant, adapted it for science education, and deployed it as a web app. Kwame for Science answers questions of students based on the Integrated Science subject of the West African Senior Secondary Certificate Examination (WASSCE). Kwame for Science is a Sentence-BERT-based question-answering web app that displays 3 paragraphs as answers along with a confidence score in response to science questions. Additionally, it displays the top 5 related past exam questions and their answers in addition to the 3 paragraphs. Our preliminary evaluation of the Kwame for Science with a 2.5-week real-world deployment showed a top 3 accuracy of 87.5% (n=56) with 190 users across 11 countries. Kwame for Science will enable the delivery of scalable, cost-effective, and quality remote education to millions of people across Africa.

Related papers

• Socrates went Nuclear: Comparing Interaction Strategies for AI systems in a Learning Context using Brain Sensing [66.03354630509942]
  This paper reports on a study where we compare three designs for user-AI interaction in a learning context.<n>Fifty study participants were tasked with learning about nuclear safety protocols.
  arXiv  Detail & Related papers  (2026-09-01T02:24:35Z)
• Adesua: Development and Feasibility Study of an AI WhatsApp Bot for Science Learning in West Africa [0.17590081165362778]
  Adesua is a WhatsApp-based AI Teaching Assistant for science education.<n>System integrates curated textbooks and 33 years of national examination questions with generative AI.<n>Students can ask science questions, take timed or untimed multiple-choice tests by topic or exam year, and receive instant grading.
  arXiv  Detail & Related papers  (2026-05-14T20:04:39Z)
• NSMQ Riddles: A Benchmark of Scientific and Mathematical Riddles for Quizzing Large Language Models [0.15274583259797847]
  Large Language Models (LLMs) have shown good performance on various science educational benchmarks.<n>LLMs tend to be evaluated on datasets from the Western world.<n>We present NSMQ Riddles, a novel benchmark of Scientific and Mathematical Riddles from Ghana's National Science and Maths Quiz (NSMQ) competition.
  arXiv  Detail & Related papers  (2026-05-08T00:00:08Z)
• MSEarth: A Multimodal Scientific Dataset and Benchmark for Phenomena Uncovering in Earth Science [52.43088243363675]
  We introduce MSEarth, a multimodal scientific benchmark curated from high-quality, open-access scientific publications.<n>MSEarth encompasses the five major spheres of Earth science: atmosphere, cryosphere, hydrosphere, lithosphere, and biosphere.<n>MSEarth supports a variety of tasks, including scientific figure captioning, multiple choice questions, and open-ended reasoning challenges.
  arXiv  Detail & Related papers  (2025-05-27T05:30:35Z)
• Embracing AI in Education: Understanding the Surge in Large Language Model Use by Secondary Students [53.20318273452059]
  Large language models (LLMs) like OpenAI's ChatGPT have opened up new avenues in education. Despite school restrictions, our survey of over 300 middle and high school students revealed that a remarkable 70% of students have utilized LLMs. We propose a few ideas to address such issues, including subject-specific models, personalized learning, and AI classrooms.
  arXiv  Detail & Related papers  (2024-11-27T19:19:34Z)
• Could ChatGPT get an Engineering Degree? Evaluating Higher Education Vulnerability to AI Assistants [175.9723801486487]
  We evaluate whether two AI assistants, GPT-3.5 and GPT-4, can adequately answer assessment questions. GPT-4 answers an average of 65.8% of questions correctly, and can even produce the correct answer across at least one prompting strategy for 85.1% of questions. Our results call for revising program-level assessment design in higher education in light of advances in generative AI.
  arXiv  Detail & Related papers  (2024-08-07T12:11:49Z)
• How to Engage Your Readers? Generating Guiding Questions to Promote Active Reading [60.19226384241482]
  We introduce GuidingQ, a dataset of 10K in-text questions from textbooks and scientific articles. We explore various approaches to generate such questions using language models. We conduct a human study to understand the implication of such questions on reading comprehension.
  arXiv  Detail & Related papers  (2024-07-19T13:42:56Z)
• Which questions should I answer? Salience Prediction of Inquisitive Questions [118.097974193544]
  We show that highly salient questions are empirically more likely to be answered in the same article. We further validate our findings by showing that answering salient questions is an indicator of summarization quality in news.
  arXiv  Detail & Related papers  (2024-04-16T21:33:05Z)
• Brilla AI: AI Contestant for the National Science and Maths Quiz [0.7329200485567825]
  This work describes and evaluates the first key output for the NSMQ AI Grand Challenge. It proposes a robust, real-world benchmark for such an AI: "Build an AI to compete live in Ghana's National Science and Maths Quiz (NSMQ) competition and win" In its debut, our AI answered one of the 4 riddles ahead of the 3 human contesting teams, unofficially placing second (tied)
  arXiv  Detail & Related papers  (2024-03-04T03:24:18Z)
• Leveraging AI to Advance Science and Computing Education across Africa: Challenges, Progress and Opportunities [1.2691047660244332]
  We describe our work developing and deploying AI in Education tools in Africa for science and computing education. SuaCode is an AI-powered app that enables Africans to learn to code using their smartphones. AutoGrad is an automated grading, and feedback tool for graphical and interactive coding assignments. Kwame for Science is a web-based AI teaching assistant that provides instant answers to students' science questions.
  arXiv  Detail & Related papers  (2024-02-12T04:10:09Z)
• Real-World Deployment and Evaluation of Kwame for Science, An AI Teaching Assistant for Science Education in West Africa [0.769672852567215]
  Africa has a high student-to-teacher ratio which limits students' access to teachers for educational question answering. We extended Kwame, a bilingual AI teaching assistant for coding education, adapted it for science education, and deployed it as a web app. We deployed Kwame for Science in the real world over 8 months and had 750 users across 32 countries (15 in Africa) and 1.5K questions asked.
  arXiv  Detail & Related papers  (2023-02-21T16:20:17Z)
• Can an AI Win Ghana's National Science and Maths Quiz? An AI Grand Challenge for Education [2.0625936401496237]
  We propose the NSMQ AI Grand Challenge, an AI Grand Challenge for Education using Ghana's National Science and Maths Quiz competition (NSMQ) as a case study. Our proposed grand challenge is to "Build an AI to compete live in Ghana's National Science and Maths Quiz (NSMQ) competition and win - performing better than the best contestants in all rounds and stages of the competition"
  arXiv  Detail & Related papers  (2023-01-30T17:28:33Z)
• Rainier: Reinforced Knowledge Introspector for Commonsense Question Answering [74.90418840431425]
  We present Rainier, or Reinforced Knowledge Introspector, that learns to generate contextually relevant knowledge in response to given questions. Our approach starts by imitating knowledge generated by GPT-3, then learns to generate its own knowledge via reinforcement learning. Our work is the first to report that knowledge generated by models that are orders of magnitude smaller than GPT-3, even without direct supervision on the knowledge itself, can exceed the quality of knowledge elicited from GPT-3 for commonsense QA.
  arXiv  Detail & Related papers  (2022-10-06T17:34:06Z)
• Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering [124.16250115608604]
  We present Science Question Answering (SQA), a new benchmark that consists of 21k multimodal multiple choice questions with a diverse set of science topics and annotations of their answers with corresponding lectures and explanations. We show that SQA improves the question answering performance by 1.20% in few-shot GPT-3 and 3.99% in fine-tuned UnifiedQA. Our analysis further shows that language models, similar to humans, benefit from explanations to learn from fewer data and achieve the same performance with just 40% of the data.
  arXiv  Detail & Related papers  (2022-09-20T07:04:24Z)
• Incremental Knowledge Based Question Answering [52.041815783025186]
  We propose a new incremental KBQA learning framework that can progressively expand learning capacity as humans do. Specifically, it comprises a margin-distilled loss and a collaborative selection method, to overcome the catastrophic forgetting problem. The comprehensive experiments demonstrate its effectiveness and efficiency when working with the evolving knowledge base.
  arXiv  Detail & Related papers  (2021-01-18T09:03:38Z)
• Kwame: A Bilingual AI Teaching Assistant for Online SuaCode Courses [2.4366811507669124]
  We developed a bilingual Artificial Intelligence (AI) Teaching Assistant (TA) that provides answers to students' coding questions from SuaCode courses in English and French. Kwame is a Sentence-BERT (SBERT)-based question-answering (QA) system that we trained and evaluated offline using question-answer pairs created from the course's quizzes, lesson notes and students' questions in past cohorts. Our results showed that fine-tuning on the course data and returning the top 3 and 5 answers improved the accuracy results.
  arXiv  Detail & Related papers  (2020-10-22T02:26:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.