Open Access   Article Go Back

An Empirical Approach for Validation of Inter-Rater Reliability of Identified Candidate Aspects

J.S. Aravindan1 , K. Vivekanandan2

  1. Department of Computer Science, Bharathiar University, Coimbatore, India.
  2. BSMED, Bharathiar University, Coimbatore, India.

Correspondence should be addressed to: soonuaravindan@gmail.com.

Section:Research Paper, Product Type: Journal Paper
Volume-5 , Issue-5 , Page no. 94-100, May-2017

Online published on May 30, 2017

Copyright © J.S. Aravindan, K. Vivekanandan . This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

View this paper at   Google Scholar | DPI Digital Library

XML View
PDF Download

How to Cite this Paper

  • IEEE Citation
  • MLA Citation
  • APA Citation
  • BibTex Citation
  • RIS Citation

IEEE Style Citation: J.S. Aravindan, K. Vivekanandan, “An Empirical Approach for Validation of Inter-Rater Reliability of Identified Candidate Aspects,” International Journal of Computer Sciences and Engineering, Vol.5, Issue.5, pp.94-100, 2017.

MLA Style Citation: J.S. Aravindan, K. Vivekanandan "An Empirical Approach for Validation of Inter-Rater Reliability of Identified Candidate Aspects." International Journal of Computer Sciences and Engineering 5.5 (2017): 94-100.

APA Style Citation: J.S. Aravindan, K. Vivekanandan, (2017). An Empirical Approach for Validation of Inter-Rater Reliability of Identified Candidate Aspects. International Journal of Computer Sciences and Engineering, 5(5), 94-100.

BibTex Style Citation:
@article{Aravindan_2017,
author = {J.S. Aravindan, K. Vivekanandan},
title = {An Empirical Approach for Validation of Inter-Rater Reliability of Identified Candidate Aspects},
journal = {International Journal of Computer Sciences and Engineering},
issue_date = {5 2017},
volume = {5},
Issue = {5},
month = {5},
year = {2017},
issn = {2347-2693},
pages = {94-100},
url = {https://www.ijcseonline.org/full_paper_view.php?paper_id=1270},
publisher = {IJCSE, Indore, INDIA},
}

RIS Style Citation:
TY - JOUR
UR - https://www.ijcseonline.org/full_paper_view.php?paper_id=1270
TI - An Empirical Approach for Validation of Inter-Rater Reliability of Identified Candidate Aspects
T2 - International Journal of Computer Sciences and Engineering
AU - J.S. Aravindan, K. Vivekanandan
PY - 2017
DA - 2017/05/30
PB - IJCSE, Indore, INDIA
SP - 94-100
IS - 5
VL - 5
SN - 2347-2693
ER -

VIEWS PDF XML
562 385 downloads 474 downloads
  
  
           

Abstract

The development of technologies for observing the relevancy of identified candidate aspects of the products and validating the reliability of filed experts is a challenging process. If the identified candidate aspects is taken into consideration for decision making process, the technology has to meet certain feasibility criteria like acceptance of aspects by product experts (Judges). Questionnaires with extracted aspects were distributed to Judges and the candidate aspects are identified. This paper describes the content validity evaluation of identified candidate aspects. The validity of the instrument was evaluated by two field experts who were asked to score each aspect on a 4-point Likert scale (1. Not Relevant, 2. Item need some revision, 3. Relevant but need minor revision, 4. Very Relevant) on relevance of 5 product (Apex AD2600 Progressive-scan DVD player, Canon G3, Creative Labs Nomad Jukebox Zen Xtra 40GB, Nikon Coolpix 4300 and Nokia 6610) datasets and the Kappa Score is calculated.

Key-Words / Index Term

Kappa Score, Aspects, Relevance, Reliability

References

[1] M. Alwan, B. Turner, S. Kell, K. Penberthy, W. Cohn, R. Felder, “Development of Survey Instruments to Guide the Design of Health Status Monitoring Systems for the Elderly: Content Validity Evaluation”, In the Proceedings of the 2006 IEEE International Conference on Information & Communication Technologies (ICTTA 2006), Syria, pp.793-797, 2006.
[2] V. Bhambri, “Data Mining as a Solution for Data Management in Banking Sector”, International Journal of Computer Sciences and Engineering, Vol.1, Issue.1, pp.20-25, 2013.
[3] M. Hu, B. Liu, “Mining and summarizing customer reviews”, In the Proceedings of 2004 ACM SIGKDD international conference on Knowledge discovery and data mining (KDD 2004), New York, pp.168-177, 2004.
[4] J. Cohen, “A Coefficient of Agreement for Nominal Scales” Educational and Psychological Measurement, Vol.20, Issue.1, pp.37-46, 1960.
[5] J. Keyton, T. King, NM. Mabachi, J. Manning, LL. Leonard, D. Schill, “Content analysis procedure book”, Lawrence KS: University of Kansas, Kansas, pp.22-37, 2004.
[6] M. Shelley, K. Krippendorff, “Content Analysis: An Introduction to its Methodology”, Journal of the American Statistical Association, Vol.79, Issue.385, pp.240-144, 1984.