UGC NET
   Top Resources
Xxx posted an Question
April 17, 2021 • 15:42 pm 1 points
  • UGC NET
  • General Paper 1

What's difference between inter-rater & test-retest??

1 Answer(s) Answer Now
  • 0 Likes
  • 2 Comments
  • 0 Shares
  • Rucha rajesh shingvekar best-answer

    Inter-Rater Reliability When multiple people are giving assessments of some kind or are the subjects of some test, then similar people should lead to the same resulting scores. It can be used to calibrate people, for example those being used as observers in an experiment. Inter-rater reliability thus evaluates reliability across different people. Two major ways in which inter-rater reliability is used are (a) testing how similarly people categorize items, and (b) how similarly people score items. This is the best way of assessing reliability when you are using observation, as observer bias very easily creeps in. It does, however, assume you have multiple observers, which is not always the case. Inter-rater reliability is also known as inter-observer reliability or inter-coder reliability. Examples Two people may be asked to categorize pictures of animals as being dogs or cats. A perfectly reliable result would be that they both classify the same pictures in the same way. Observers being used in assessing prisoner stress are asked to assess several 'dummy' people who are briefed to respond in a programmed and consistent way. The variation in results from a standard gives a measure of their reliability. In a test scenario, an IQ test applied to several people with a true score of 120 should result in a score of 120 for everyone. In practice, there will be usually be some variation between people. Test-Retest Reliability An assessment or test of a person should give the same results whenever you apply the test. Test-retest reliability evaluates reliability across time. Reliability can vary with the many factors that affect how a person responds to the test, including their mood, interruptions, time of day, etc. A good test will largely cope with such factors and give relatively little variation. An unreliable test is highly sensitive to such factors and will give widely varying results, even if the person re-takes the same test half an hour later. Generally speaking, the longer the delay between tests, the greater the likely variation. Better tests will give less retest variation with longer delays. Of course the problem with test-retest is that people may have learned and that the second test is likely to give different results. This method is particularly used in experiments that use a no-treatment control group that is measure pre-test and post-test. Examples Various questions for a personality test are tried out with a class of students over several years. This helps the researcher determine those questions and combinations that have better reliability. In the development of national school tests, a class of children are given several tests that are intended to assess the same abilities. A week and a month later, they are given the same tests. With allowances for learning, the variation in the test and retest results are used to assess which tests have better test-retest reliability.

whatsapp-btn

Do You Want Better RANK in Your Exam?

Start Your Preparations with Eduncle’s FREE Study Material

  • Updated Syllabus, Paper Pattern & Full Exam Details
  • Sample Theory of Most Important Topic
  • Model Test Paper with Detailed Solutions
  • Last 5 Years Question Papers & Answers

Sign Up to Download FREE Study Material Worth Rs. 500/-