8/12/2019 CAP Paper 2 Schmidt de Carranza

1/5

Running Head: METAANALYSIS CRITIQUE ELL ACCOMMODATIONS

1

CAP Paper II: Testing A!""!dati!ns #!r ELL Learners

Sara$ S$"idt de Carran%a

Minnes!ta State Uni&ersit'( Man)at!

8/12/2019 CAP Paper 2 Schmidt de Carranza

2/5

ELL ACCOMMODATIONS CAP PAPER *

Summary

T$is arti+e e,a"ines t$e pr!-+e" !# Eng+is$ Language Learners .ELLs/ ta)ing $ig$0

sta)es tests( and t$e additi!na+ sets !# pr!-+e"s t$at arise $en a!""!dati!ns are "ade t! tr'

t! "a)e t$ese tests a "!re &a+id and re+ia-+e "easure"ent t!!+2 3eause ELL +earners are

e,trap!+ated as a su-gr!up in testing data( it -ea"e "!re e&ident t$at t$ese students ere n!t

a$ie&ing at as $ig$ a +e&e+ as t$eir "ainstrea" !unterparts2 H!e&er( t$e pr!-+e" re"ained

t$at it as n!t +ear $et$er t$e students4 +! s!res ere aused -' +a) !# !ntent )n!+edge(

+a) !# +inguisti apa-i+it'( !r -!t$2 T$is t$en ga&e rise t! a!""!dati!ns #!r ELL +earners !n

$ig$0sta)es tests2 H!e&er( n!t a++ a!""!dati!ns are reated e5ua+ and t$is stud' see)s t!

e&a+uate t$e &a+idit' and re+ia-i+it' !# a &ariet' !# a!""!dati!ns gi&en ar!ss t$e !untr' !n a

&ariet' !# $ig$ sta)es tests2 T$ere is a+s! an atte"pt t! deter"ine $i$ a!""!dati!ns +!er

t$e +inguisti di##iu+t' !# t$e tests t! assess pure !ntent )n!+edge and &ie &ersa2

Critique and Implications

As t$is as a "eta0ana+'sis !# e,isting data( it is n!t p!ssi-+e t! riti5ue t$e "et$!d!+!g'

!# t$e !rigina+ de&e+!p"ent !# a!""!dati!ns6 $!e&er( it is p!ssi-+e t! riti5ue t$e

"et$!d!+!g' #!r $! studies ere $!sen #!r in+usi!n in t$is "eta0ana+'sis2 T$e aut$!rs $!se

t! e,a"ine t$e e##ets !#

78 .a/ indi&idua+ a!""!dati!ns !r indi&idua+ a!""!dati!ns -und+ed it$

e,tra ti"e( .-/ ere arti+es pu-+is$ed in peer0re&ieed 9!urna+s !r te$nia+ rep!rts

a&ai+a-+e !n+ine( ./ e"p+!'ed an e,peri"enta+ !r 5uasi0e,peri"enta+( !r repeated

"easures design( and .d/ rep!rted su##iient data t! a++! #!r t$e esti"ati!n !# e##et

8/12/2019 CAP Paper 2 Schmidt de Carranza

3/5

ELL ACCOMMODATIONS CAP PAPER

si%es; .ranis( *??@ p2 11*/2

T$e riteria #!r in+usi!n is designed t! !ns!+idate resear$ t$at is reputa-+e and

rep+ia-+e as e++ as re+e&ant t! t$e resear$ 5uesti!n2 T$e aut$!rs a+s! g! !n t! e,p+ain t$e

rati!na+e #!r e,+usi!n !# a nu"-er !# !t$er studies2 T$e rati!na+e #!r e,+usi!n !# studies

in+uded rep!rting !# data( "et$!d!+!gia+ di##erenes( and itati!n !# n!n peer0re&ieed

resear$2 .

8/12/2019 CAP Paper 2 Schmidt de Carranza

4/5

ELL ACCOMMODATIONS CAP PAPER

!nsidered -' se&era+ !# t$e studies in+uded in t$e "eta0ana+'sis2 T$is is !nerning -eause

t$ese p!pu+ati!ns are part !# t$e ELL u"-re++a as e++2

T$e i"p+iati!ns #!r p!+i' t$at arise #r!" t$e #indings !# t$is arti+e are t$at t$ere is a

need t! st!p "a)ing ine##eti&e "!di#iati!ns #!r ELL +earners !n t$ese $ig$ sta)es tests2 T$e

#at t$at !n+' !ne !# t$e se&en a!""!dati!ns "a)es a statistia++' signi#iant p!siti&e

di##erene is indiati&e !# a pressing issue2 A!""!dati!ns t$at are n!t e##eti&e s$!u+d n!t -e

used t! "easure ELL student suess in t$ese assess"ents2 3eause "an' !# t$e

a!""!dati!ns t$at ere n!t #!und t! $a&e statistia++' signi#iant e##ets !n test resu+ts are

aepted as tried and true )n!+edge !# $at !r)s #!r ELL students( and it is surprising t$at

t$ere ere su$ s"a++ e##et si%es resu+ting #r!" t$ese a!""!dati!ns2 T$ere#!re( a -etter use

!# res!ures !u+d -e t! !nentrate !n $at is )n!n t! -e e##eti&e and t! e+i"inate and!r

redue t$e use !# !t$ers t$at are n!t2

8/12/2019 CAP Paper 2 Schmidt de Carranza

5/5

ELL ACCOMMODATIONS CAP PAPER

Re#erenes

ranis D2F2 .*??@/2 A!"!dati!ns #!r Eng+is$

Language Learners Ta)ing Large Sa+e Assess"ents: A Meta0Ana+'sis !n E##eti&eness

and Ga+idit'2 Review of Educational Research. .79/2 P2 11B01*?12