González, J.L.; García, R.; Brunetti, J.M.; Gil, R.; Gimeno, J.M.
Journal of Universal Computer Science, Vol. 19, No. 8, pp. 1025-1046. J.UCS, 2013
ISSN 0948-6968
In order to make Semantic Web tools more appealing to lay-users, a key factor is their Quality in Use, the quality of the user experience when interacting with them. To assess and motivate the improvement of the quality in use, it is necessary to have a quality model that guides its evaluation and facilitates comparability. SWET-QUM is a Quality in Use Model that extends the international standard ISO/IEC 25010:2011 and focuses on Semantic Web Exploration Tools (SWET). These are tools that make it possible for lay-users to browse and visualise Semantic Web data.
|
Quality Factor
|
Effectiveness
|
Efficiency
|
Satisfaction
|
Context Coverage
|
|
Quality factor definition in SWET-QUM
|
Degree to which users can achieve the semantic data exploration tasks with precision and completeness.
|
Degree to which users can achieve tasks by investing an appropriate amount of resources in relation to the effectiveness.
|
Degree to which users are satisfied by the semantic data exploration tool.
|
Degree to which Semantic Web tools can be used in different contexts and adapt to different user mental models.
|
|
Metrics selected and reused from standard
|
· Task success
· Tasks completion
|
· Task time
· Total time
· Task efficiency
· Help requests
|
· Satisfaction questionnaire
|
|
|
Additional metrics proposed by SWET-QUM
|
· UI Component Effectiveness
|
· UI Component Efficiency
|
|
· Task Flexibility
· Layout Flexibility
|
Using SWET-QUM to Compare the Quality in Use of Semantic Web Exploration Tools
González, J.L.; García, R.; Brunetti, J.M.; Gil, R.; Gimeno, J.M.
Journal of Universal Computer Science, Vol. 19, No. 8, pp. 1025-1046. J.UCS, 2013
ISSN 0948-6968
Evaluating the Quality in Use of Semantic Web Exploration Tools featuring Facets and Pivoting
J.M. Brunetti, R. García, R. Gil, J.M. Gimeno, J.L. González
Research Report, 2012