UTCPredictor: An uncertainty‐aware novel teaching cases predictor. Issue 6 (23rd September 2019)
- Record Type:
- Journal Article
- Title:
- UTCPredictor: An uncertainty‐aware novel teaching cases predictor. Issue 6 (23rd September 2019)
- Main Title:
- UTCPredictor: An uncertainty‐aware novel teaching cases predictor
- Authors:
- Wu, Xiaoxue
Zheng, Wei
Mu, Dejun
Li, Ning - Abstract:
- Abstract: Teaching cases are crucial for computer science (e.g., software testing) teaching. With the fast development of computer science, old and outdated teaching cases cannot meet the requirements of teaching. Therefore, teachers need to update teaching case repository continually and timely. However, teaching case development is an extremely time‐consuming work. Given today's complex and fast‐moving environment of computer science, teachers often feel blind about about what types of cases should be added for teaching. This paper presents UTCPredictor—an automated approach of predicting novel teaching cases from real production by identifying the most uncertain data, which are always with new features that reflect the latest developments and trends in the field. The implementation of UTCPredictor is based on the idea of interactive machine learning as well as several text mining techniques. To evaluate the effectiveness of UTCPredictor, we take bug report case building in software testing teaching as an example, using UTCPredictor to perform 10‐fold cross‐validation on an existing teaching case set. The performance in terms of indicators; Recall, Precision, and F1‐score, achieved three very competitive values—0.91, 0.94, and 0.85, respectively. We further evaluate the effectiveness of UTCPredictor through a user study and a questionnaire. The results are very positive; the user study indicates that educators can build a teaching case set from latest bug report repositoryAbstract: Teaching cases are crucial for computer science (e.g., software testing) teaching. With the fast development of computer science, old and outdated teaching cases cannot meet the requirements of teaching. Therefore, teachers need to update teaching case repository continually and timely. However, teaching case development is an extremely time‐consuming work. Given today's complex and fast‐moving environment of computer science, teachers often feel blind about about what types of cases should be added for teaching. This paper presents UTCPredictor—an automated approach of predicting novel teaching cases from real production by identifying the most uncertain data, which are always with new features that reflect the latest developments and trends in the field. The implementation of UTCPredictor is based on the idea of interactive machine learning as well as several text mining techniques. To evaluate the effectiveness of UTCPredictor, we take bug report case building in software testing teaching as an example, using UTCPredictor to perform 10‐fold cross‐validation on an existing teaching case set. The performance in terms of indicators; Recall, Precision, and F1‐score, achieved three very competitive values—0.91, 0.94, and 0.85, respectively. We further evaluate the effectiveness of UTCPredictor through a user study and a questionnaire. The results are very positive; the user study indicates that educators can build a teaching case set from latest bug report repository by spending only 8.16%–18.11% time costs compared with traditional manual approach; the responses from 2, 000 students for the questionnaire show that the teaching cases built with UTCPredictor are very popular among students. … (more)
- Is Part Of:
- Computer applications in engineering education. Volume 27:Issue 6(2019)
- Journal:
- Computer applications in engineering education
- Issue:
- Volume 27:Issue 6(2019)
- Issue Display:
- Volume 27, Issue 6 (2019)
- Year:
- 2019
- Volume:
- 27
- Issue:
- 6
- Issue Sort Value:
- 2019-0027-0006-0000
- Page Start:
- 1518
- Page End:
- 1530
- Publication Date:
- 2019-09-23
- Subjects:
- interactive machine learning -- novelty cases prediction -- teaching case building -- uncertainty sampling
Engineering -- Study and teaching (Higher) -- Periodicals
Engineering -- Computer-assisted instruction -- Periodicals
620 - Journal URLs:
- http://onlinelibrary.wiley.com/journal/10.1002/(ISSN)1099-0542 ↗
http://onlinelibrary.wiley.com/ ↗ - DOI:
- 10.1002/cae.22166 ↗
- Languages:
- English
- ISSNs:
- 1061-3773
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - 3393.646000
British Library DSC - BLDSS-3PM
British Library STI - ELD Digital store - Ingest File:
- 12076.xml