EssayTools - Maple Programming Help

Online Help

All Products    Maple    MapleSim


Home : Support : Online Help : Education : EssayTools : EssayTools/QuadraticWeightedKappa

EssayTools

  

QuadraticWeightedKappa

  

computes a measure of correlation between two sets of data

 

Calling Sequence

Parameters

Description

Examples

Compatibility

Calling Sequence

QuadraticWeightedKappa( scores1, scores2 )

QuadraticWeightedKappa( scores1, scores2, Min, Max )

Parameters

scores1, scores2

-

list or array of integer data

Min, Max

-

(optional) integers

Description

• 

The QuadraticWeightedKappa command accepts two lists or arrays of numeric data and computes the quadratic weighted kappa value.

• 

The quadratic weight kappa value is useful in the context of essay scoring where you want to measure how well one set of grades correlates to another set of grades.  A value of 1 indicates perfect agreement between the two grade sets.  Typically two sets of grades generated by independent human raters scoring the same sets of essays will achieve a quadratic weight kappa value of .8 or better (for open-ended long-form essay responses).

• 

A negative score indicates an inverse correlation.  The two data sets agree somewhat, but in an opposite trend.

• 

The Min and Max values are computed from the score data if not given.  If the score data does not cover the full range of possible scores then the minimum and maximum possible values can be specified.

• 

This function is part of the EssayTools package, so it can be used in the short form SimilarityScore(..) only after executing the command with(EssayTools). However, it can always be accessed through the long form of the command by using EssayTools[SimilarityScore](..).

Examples

withEssayTools:

QuadraticWeightedKappa9,7,8,7,6,8,3,5,10,8,8,6,6,7,6,1,4,8

0.758620689655172

(1)

QuadraticWeightedKappa9,7,8,7,6,8,3,5,10,3,5,6,6,7,6,1,4,8

0.438095238095238

(2)

QuadraticWeightedKappa9,7,8,7,6,8,3,5,10,1,2,3,4,5,6,7,8,9

0.166666666666667

(3)

QuadraticWeightedKappa9,7,8,7,6,8,3,5,10,9,7,8,7,6,8,3,5,10

1.

(4)

withStatistics:

N1000

N:=1000

(5)

R1LinearAlgebra:-RandomVector[row]N,generator=rand0..10

R1:= 1 .. 1000 VectorrowData Type: anythingStorage: rectangularOrder: Fortran_order

(6)

R2 := zip( proc(a,b) local v := trunc(a+b); `if`(v<0,0,`if`(v>N,N,v)) end,R1,Sample(Normal(0,2),N));

R2:= 1 .. 1000 VectorrowData Type: anythingStorage: rectangularOrder: Fortran_order

(7)

QuadraticWeightedKappaR1&comma;R2

0.837098824348283

(8)

CorrelationR1&comma;R2

0.845135744799198

(9)

Compatibility

• 

The EssayTools[QuadraticWeightedKappa] command was introduced in Maple 17.

• 

For more information on Maple 17 changes, see Updates in Maple 17.

See Also

EssayTools

Statistics[Correlation]

StringTools

 


Download Help Document

Was this information helpful?



Please add your Comment (Optional)
E-mail Address (Optional)
What is ? This question helps us to combat spam