KSAS (Kenpo Set Assisting System) is an AI Android application to learn martial arts movements in online settings.

The pandemic of the last years have forced thousand of instructors and learners to practice psyhomotor activities in online settings. The use of regular videoconference software and e-learning techniques has allowed them to continue their training at home. However, some problems specific to learning and teaching psychomotor activities have been exposed:

  • It is difficult to visualize 3D movements in 2D displays.
  • There is no physical interaction with classmates and teachers.
  • It is difficult to give and obtain feedback to correct/reinforce the movements.

With the purpose of atteanuate those problems we have developed KSAS, an AI assisted Android application that helps to learn the order the order in which a set of movements is executed. The set of movements that you can practice with KSAS is Blocking Set I, a defensive set of movements taught in American Kenpo Karate.

KSAS is built over five different phases:

  • Motion Capture: 3D inertial information of the movements is captured using the inertial sensors of a mobile device.
  • Motion Model: The captured information is modeled as a time series and smoothed by using the EWMA (Exponentially Weighted Moving Averages) algorithm.
  • Motion Analysis: A LSTM neural network is used to analyze the movements and determine which movement has been executed.
  • Motion Response: The results of the analysis are given to the user in the form of haptic and auditory feedback.
  • Motion Reports: The number of errors commited by the learner is stored, and a chart is created to show the progress of the learner.

KSAS is an open source application that follows the philosophy Open Science. The source code of the application is available in our Github website.

KSAS is an application developed during the Master´s Thesis and PhD of Alberto Casas Ortiz, supervised by Olga C. Santos, which received an accesit to the best Master´s Thesis in the awards organized by eMadrid. The application has been presented in AIED 2021 and participated in the Competition on mobile Apps with AI techniques organized by CAEPIA.

Following, there is a video showing a demo of the application.

Selected references:

Casas-Ortiz, A., Echeverria, J. & Santos, O.C. (2023). Intelligent Systems for Psychomotor Learning: A Systematic Review and Two Cases of Study. In Handbook of Artificial Intelligence in Education. Edward Elgar Publishing: Cheltenham, Inglaterra, pp. 390–421, ISBN 9781800375413.

A. Casas-Ortiz & O. C. Santos (2021), “KSAS: A Mobile App with Neural Networks to Guide the Learning of Motor Skills”, in Actas de la XIX Conferencia de la Asociación Española para la Inteligencia Artificial (CAEPIA 20/21), pp. 997–1000.

A. Casas-Ortiz & O. C. Santos (2021), “KSAS: An AI Application to learn Martial Arts Movements in on-line Settings”, Interactive Events at 22nd International Conference on Artificial Intelligence in Education (AIED 2021), pp. 1–4.