An investigation on automatically assessing an application tutorial’s difficulty
| dc.contributor.author | Sabab, Shahed | |
| dc.contributor.examiningcommittee | Tremblay-Savard, Olivier (Computer Science) | en_US |
| dc.contributor.examiningcommittee | Mann, Danny (Biosystems Engineering) | en_US |
| dc.contributor.supervisor | Bunt, Andrea (Computer Science) | en_US |
| dc.date.accessioned | 2020-01-09T16:21:05Z | |
| dc.date.available | 2020-01-09T16:21:05Z | |
| dc.date.issued | 2019-11 | en_US |
| dc.date.submitted | 2020-01-02T18:39:27Z | en |
| dc.degree.discipline | Computer Science | en_US |
| dc.degree.level | Master of Science (M.Sc.) | en_US |
| dc.description.abstract | Online step-by-step tutorials play an integral role in how users learn feature-rich software applications (e.g., Photoshop, AutoCAD, Fusion360). However, when searching for a tutorial, users can find it difficult to assess whether a given tutorial is designed for their level of software expertise. Novice users can struggle when a tutorial is out of their reach, whereas more advanced users can end up wasting time with overly simple, first-principles instruction. To assist users in selecting tutorials based on expertise, I investigate the feasibility of using machine learning techniques to automatically assess and label a tutorial’s difficulty level. Using Photoshop as a testbed, I develop a set of distinguishable tutorial features and use these features to train a classifier that can label a tutorial as either Beginner or Advanced with 85% accuracy. To illustrate a potential application of my classifier, I developed a tutorial selection interface called TutVis. TutVis annotates each tutorial with its difficulty level, along with visual representations of other tutorial features that contribute to this difficulty assessment. An initial evaluation comparing TutVis to two other interfaces (which varied in the number of different tutorial features displayed) showed a strong preference for and use of TutVis’s novel features. | en_US |
| dc.description.note | February 2020 | en_US |
| dc.identifier.uri | http://hdl.handle.net/1993/34467 | |
| dc.language.iso | eng | en_US |
| dc.rights | open access | en_US |
| dc.subject | Topic modeling | en_US |
| dc.subject | Tutorial expertise | en_US |
| dc.subject | TutVis | en_US |
| dc.subject | Assessing difficulty | en_US |
| dc.title | An investigation on automatically assessing an application tutorial’s difficulty | en_US |
| dc.type | master thesis | en_US |