Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative...

48
Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr. Nancy López, Sociology Christopher Erwin, PhD Candidate, Economics Dr. Melissa Binder, Economics Mario Javier Chavez, PhD Student, Sociology 2017 New Mexico Evaluator’s Conference

Transcript of Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative...

Page 1: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

MakingtheInvisibleVisible:AdvancingQuantitativeMethodsinHigherEducationusingCriticalRaceTheoryandIntersectionality

Dr.NancyLópez,SociologyChristopherErwin,PhDCandidate,Economics

Dr.MelissaBinder,EconomicsMarioJavierChavez,PhDStudent,Sociology

2017NewMexicoEvaluator’sConference

Page 2: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Background� UNMInterdisciplinaryResearchTeam

� PaperforthcominginRace,EthnicityandEducation(2017)

� FormoreinformationvisittheInstitutefortheStudyof“Race”andSocialJusticeatrace.unm.edu

Page 3: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

BigPictureQuestions

1. Whatpatternsofeducationalinequalitiesremaininvisiblewhenwetreatrace,gender,andclassasindependent?

Inotherwords,whatpatternsofinequalitiesareundetectedwhenweexaminesix-yearundergraduategraduationratesbyracealone,genderalone,orclassalone?

2. Howdoestimatedachievementgapschangewhenwerecognizethatsuchcharacteristicsaredependentononeanother?

Page 4: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

BigPictureQuestions

3. Howisthesimultaneityofrace/structuralracism,settlercolonialism,genderrelations/patriarchyandclass/capitalismexperienceddifferentlybystudentsaccordingtotheirlocationinintersectingsystemsofpower,privilege,oppressionandresistanceinagivencontext?

Page 5: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

ResearchQuestion� Whatarerace-gender-classachievementgapsinsix-yeargraduationratesanddevelopmentalcoursetakingatamajorpublicuniversityintheAmericansouthwestovertheperiod2000-2015

� BinderandGanderton (2004)studyonbroadmerit-basedlotteryscholarships

� ManystatefundingformulasintheUSassumePELLstatusisaproxyforracialized“achievement”gap—notassumedforgendergap

� Race-gender-classgapsareinvisibleincurrentpolicyconversations

� Researchforsocialjusticepolicyandpractice(praxis-actionandreflection)

Page 6: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

FindingsandArgument� Wefindsurprisingrace-gender-classgapsthatwouldordinarilyremainunseeninconventionalrace-only,gender-only,andclass-onlyreportingongraduationratesanddevelopmentalclassplacement.

� Race,gender,andclassareinterdependentinthecontextofoutcomesinhighereducation

� Wearguethatonemodalityof“QuantCrit”canbeguidedbyleveragingtheontologiesofCriticalRaceTheoryandIntersectionalitytomakethe“invisiblevisible”orshinealightonintracategorical (withingroup)andintercategorical (acrossgroup)intersectinginequalitiesinhighereducationoutcomes.

Page 7: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Aninvitationtoself-reflexivity…� Howcanwetakeaccountofoursociallocationwithinpowerrelations?� Whatisyourlivedrace-gender-classlivedexperience?

ArtbyAugustineRomero(aztlancontemporary.com)

Page 8: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

ConceptualizingandVisualizingIntersectionality� Ongoingself-reflexivityaboutourownsociallocationandcategoryofexperienceinsystemsofpower,privilege,anddisadvantage

Page 9: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

TenetsofCriticalRaceTheory1. Challengestheideaofneutralityinlaw(BrownandJackson,2013)

2. Liberaldemocracyandracismareinherentlyreinforcing(Ladson-Billings,2013)

3. Racialrealism-centralityandpermanenceofracism;Bell:mostracialremediesremainsymbolic(Ladson-Billings,2013)

4. Interestconvergence(Bell)

5. Counterstory/narrativesandresistance(Yasso)

Page 10: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

“QuantCrit”:OpportunityforConceptualClarityandTransparency

� FromZuberi (2001):

� “Theconceptualizationofraceisfundamentaltoallsubsequentuseofracialdata.”

� “Studiesshouldnotrelyonadecontextualizedracialidentity.Itis,infact,thisdecontextualization thathasleadstoracialreasoning.”

Page 11: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

CriticalRaceTheory(CRT)andIndigenousStatistics� “CRTcanbeusedtoquestionthevariableschosen(orignored)inquantitativeresearchaswellasestablishcounter-narrativesinqualitativeresearch”(Brown&Jackson,2013:21)

� FromWalterandAnderson(2013):� “Ratherthanrepresentingneutralnumerics,quantitativedataplayapowerfulroleinconstitutingrealitythroughtheirunderpinningmethodologiesbyvirtueofthesocial,culturalandracialterraininwhichtheyareconceived,collected,analysed,andinterpreted.”

Page 12: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

CriticalRaceTheory(CRT)andIndigenousStatistics� MorefromWalterandAnderson(2013):

� “…Indigenousquantitativemethodologiescanbeconstruedaschallengingcolonizersettlerquantitativepractices.”

� “AnindigenousquantitativemethodologyisaquantitativemethodologythatembodiesanIndigenousstandpoint.”

Page 13: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Intersectionality� FromCollinsandBilge(2016):

� “Intersectionalityisawayofunderstandingandanalyzingcomplexityintheworld,inpeople,andinhumanexperiences.Theeventsandconditionsofsocialandpoliticallifeandtheselfcanseldombeunderstoodasshapedbyonefactor.Theyareshapedbymanyfactorsindiverseandmutuallyinfluencingways.Whenitcomestosocialinequality,people’slivesandtheorganizationofpowerinagivensocietyarebetterunderstoodasbeingshapednotbyasingleaxisofsocialdivision,beitraceorgenderorclass,butbymanyaxesthatworktogetherandinfluenceeachother.Intersectionalityasananalytictoolgivespeoplebetteraccesstothecomplexityoftheworldandofthemselves.”

Page 14: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

VisualMatrixofDomination(Collins,2009)1. Intersectingsystemsofoppression

colonization-patriarchy-sexism-structuralracism-nativism-ableism2. Arrangementsofpower

StructuralDomainofPower

DisciplinaryDomainofPower

InterpersonalDomainofPower

• Organizations• InstitutionalArrangements

• Management• RulesoftheGame

• LivedExperience• Consciousness

Hegemonic/Cultural DomainofPower- PermeatesalllevelsofPower

(IdeologicalGluethatcutsacrossalldomains)

Page 15: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

DynamicCentering:RadicalContextualizedRelationality� “Usingdynamiccenteringformultiplesocialgroupswithdiverseconfigurationsofrace,ethnicity;sexuality,class,age,gender,abilityandcitizenshipstatusshouldexpandsociologyknowledgeevenfurther.Continuingthisongoingprocessofdynamiccenteringshould,overtime,yieldamorecomplexandrobustunderstandingof…multiplesitesofinequalitywhether,health,education,orlawenforcement.”(Collins,2007:594)

Page 16: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Race-Gender-ClassSocialLocationsOntologicalFocus� “Quantitativemethodologiesmightbemoresuccessfulifdistinctcompositevariableswereconstructedtoidentifyhowtherace,classandgendercategoriesworkincombinationtoformadifferentcategoryofexperiencefromthatofanyofthecategoriesoriginallycombined.”(Collins,2007:601)

� Weanalyze20sociallocationsorunique“groups”incontextinourmodels

Page 17: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

RadicalContextualizationofaSouthwesternState� MajorityMinorityState– ACaseStudyofSettlerColonialism(Gómez,2007;Nakano-Glenn,2015)

� Amongthehighestpovertyratesforchildreninthecountry:� 59%ofNativeAmerican� 25%ofHispanic� 20%ofBlack� 10%ofWhite

� 4%ofWhiteslivinginthestatehavelessthanahighschooleducation,comparedto24%ofHispanics

Page 18: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

ComplexIntersectingConfigurationsofInequalities:Race-Gender-Class

� “Ifindthatthereareinfactconfigurationsofinequality,inwhichrace,genderandclassintersectinavarietyofwaysdependingonunderlyingeconomicconditionsinlocaleconomies…Indeed,configurationsrevealthatinlocaleconomiesarealltypesofwageinequalitysystematicallyandsimultaneouslylowerorhigher;complexintersectionsofvariousdimensionsofinequalityarethenorm….Policyandpoliticscanplayanimportantroleindetermining…whichpathischosenandwhichformsofinequalityarefosteredormitigated.”(McCall,2001:6)

Page 19: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

RadicalContextualizationofEducationalOpportunityStructureRACIALIZEDP-12EDUCATIONALOPPORTUNITYSTRUCTURE• CurriculumTracking(IntraschoolDefactoSegregation:AP,Honors,Gifted)

• SchoolResources(Private/Public/Charter;ConcentratedDisadvantage/DefactoSchool-LevelSegregation)

HIGHEREDUCATIONOUTCOMES•RemedialCourses

•6-yearGraduation

SEDIMENTATIONOFSTRUCTURALRACE-GENDER-CLASSGAPSININTERGENERATIONALLIFECHANCES• Education• Employment• Wages• Wealth• LawEnforcement• Health

LOGICMODEL

MaterialBackdrop:HistoricandContemporarySettlerColonialism,Racism,Sexism,Classismandother

StructuralInequalities

Page 20: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Racialized-GenderedEducationalOpportunities

Racial/EthnicOrigin District(%) Honors(%) Gap(%)

Hispanic 67 59 -8White 21 29 8NativeAmerican 4 2 -2Black 2 2 0AsianAmerican 2 4 2Multiracial* 3 3 0*Gifted* 7 9 2

Gender Male(%) Female(%) Gap(%)43 57 -7

ColoringandGenderingHS“Honors”:FeederSchoolDistrict,2009-2016

Page 21: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Racialized-GenderedEducationalOpportunities

Racial/EthnicOrigin District(%) AP(%) Gap(%)

Hispanic 67 61 -6White 21 27 6NativeAmerican 4 3 -1Black 2 2 0AsianAmerican 2 4 2Multiracial* 3 3 0*Gifted* 7 6 -1

Gender Male(%) Female(%) Gap(%)43 57 -7

ColoringandGenderingHS“AP”:FeederSchoolDistrict,2009-2016

Page 22: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Racialized-GenderedEducationalOpportunities

Racial/EthnicOrigin District(%) Gifted(%) Gap(%)

Hispanic 67 48 -19White 21 40 19NativeAmerican 4 2 -2Black 2 1 -1AsianAmerican 2 4 2Multiracial* 3 5 2

Gender Male(%) Female(%) Gap(%)43 57 3

ColoringandGenderingHS“Giftedness”:FeederSchoolDistrict,2009-2016

Page 23: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Data� Cross-sectionaldataonallfull-time,first-timefallenrollees

� Datafrom1980-2015� Graduationdatafrom2000– 2008(n=6,427)� Developmentalcoursetakingdatafrom2000 – 2015(n=13,953)

� Socio-demographicinformation� Race,ethnicity,familyincome,gender

� Highschoolinformation� Typeandlocation,GPA,standardizedtestscores

Page 24: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Data(Con’t)� Collegeinformation

� Developmentalcoursetaking,dateofgraduation

� Raceandethnicitymutuallyexclusive� 5race-ethnicities,2genders,2classindicators� 5x2x2=20uniquesociallocations

� Samplelimitedtoin-statematriculants

� Samplelimitedtotopandbottomincomequartiles

� Missingmany(~40%)self-reportedfamilyincomesfromFAFSA

Page 25: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Table1.DescriptiveStatistics� Inrecentyearsthestudentbodyhas:becomelesswhite,moreHispanic,lesslow-income,takenfewerremedial(developmental)courses.

� Whathashappenedtograduationratesovertime?

Variable 2000-2008 2000-2015

Graduated within 6 Years .406 - Remedial English .294 .268 Remedial Mathematics .326 .301 Any Remedial .431 .397 Female .582 .577 White .406 .371 Black .030 .024 Hispanic .444 .499 American Indian .069 .058 Asian .050 .047 Low-Income .539 .498

Observations

6,427

13,953

Page 26: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Figure1.TrendsinSix-YearGraduationRates� Thegraduationachievementgapappearsstableovertimewhenjustconsideringrace-ethnicity

� Graphicssuchastheseoversimplifythecomplexlandscapeofinequalityinhighereducation

Page 27: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

EmpiricalModel� Hierarchicallinearmodels(studentsclusteredwithinhighschools)

� AKArandominterceptmodel

� Logisticregression� Saturatedmodelwithmaineffectsandfullsetofinteractioneffects

� Outcomesaredegreecompletionanddevelopmentalcourseplacement� Graduationwithin6years� MathematicsandEnglishdevelopmentalcoursetaking

Page 28: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

EmpiricalModel� Ourfocusisondynamicallycenteringstudentsaccordingtorace,ethnicity,gender,andclass

� Resultsarenotcausal

� Achievementgapsareidentified,butnotexplainedcausally

� Manyfactorsnotincludedinthemodelarecorrelatedwithrace,gender,andclassaswellascollegesuccess(e.g.familyresources,parents’education,socialattitudes,etc.)

� Result:endogeneityproblem

Page 29: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

EmpiricalModel� Whysaturatedmodelscanbepowerful:

� Example:naïvewagemodelusingonlygenderandBAcompletion

𝑤𝑎𝑔𝑒% = 𝛽( + 𝛽*𝐹𝑒𝑚𝑎𝑙𝑒% + 𝛽.𝐵𝐴% + 𝛽1𝐹𝑒𝑚𝑎𝑙𝑒% 2 𝐵𝐴% + 𝜀%

� Maineffectsare𝛽* and𝛽.;interactioneffectis𝛽1

� Summingmain/interactioneffectstocalculateaveragewageforeachgroup:

� Menwithoutdegrees:𝛽(� Menwithdegrees:𝛽( + 𝛽.� Womenwithoutdegrees:𝛽( + 𝛽*� Womenwithdegrees:𝛽( + 𝛽* + 𝛽. + 𝛽1

Page 30: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

EmpiricalModel(1) 𝑦%5∗ = 𝛼( + 𝑿𝜷 + 𝒁𝜸 +𝑾𝜹 + ζ5 + 𝜀%5(2) ζ5~𝑁(0, 𝜓)

� i denotesthestudent,j denotesthehighschool

� Errors,𝜀%5,areassumedtohaveastandardlogisticdistributionwithvariance𝜙.

� Modelassumesthatζ5 areindependentacrosshighschoolsandindependentofmainandinteractioneffectsforstudentI

� X isavectorofmaineffects

� Z isavectorofinteractioneffects

� W isavectorofcohorteffects

Page 31: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

EmpiricalModel� Weestimatemarginaleffectsandlinearcombinationsofmarginaleffectswithhigh-income,whitewomenasthereferencegroup

� Likelihoodratiotestdeterminewhetherhierarchicalmodelisanimprovementoverthestandardlogisticmodel(whichignoresthenaturalclusteringofstudentswithinhighschools)

� Weareparticularlyinterestedinintraclass correlationcoefficients,𝜌 = HHIJ

� Largesizewouldsuggestthatfeederhighschoolsplayasignificantroleindeterminingachievementgapsinhighereducation

Page 32: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Results� Six-yeargraduationrates

� Marginaleffects

� Insightful,butdifficultmentalaccounting

� Evidencethatrace,gender,andclassarenotindependent

Variable Marginal Effect

Standard Error

Black -.226 *** .069 Hispanic -.033 .026 American Indian -.093 * .055 Asian .0009 .071 Low-Income -.142 *** .026 Male -.137 *** .025 Black x Low-Income .183 ** .091 Hispanic x Low-Income -.051 .036 American Indian x Low-Income -.161 ** .074 Asian x Low-Income .004 .085 Male x Low-Income -.009 .040 Black x Male .058 .144 Hispanic x Male -.002 .039 American Indian x Male -.140 .091 Asian x Male -.075 .099 Black x Low-Income x Male .050 .175 Hispanic x Low-Income x Male .133 ** .056 American Indian x Low-Income x Male .230 * .123 Asian x Low-Income x Male .141 .124 Likelihood Ratio Statistic 48.39 Residual Intraclass Correlation .026 Observations 6,427

Page 33: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Results� Six-yeargraduationrates

� Linearcombinations

� Easytointerpret

� Revealscomplexityofinequalitylandscape

Variable Marginal Effect

Standard Error

Cell Size

White, High-Income Women (Base) - - - 869 White, Low-Income Women -.142 *** .026 594 White, High-Income Men -.137 *** .025 705 White, Low-Income Men -.288 *** .031 440 Black, High-Income Women -.226 *** .069 57 Black, Low-Income Women -.185 *** .059 76 Black, High-Income Men -.305 ** .126 18 Black, Low-Income Men -.223 *** .077 45 Hispanic, High-Income Women -.033 .026 599 Hispanic, Low-Income Women -.225 *** .024 1,094 Hispanic, High-Income Men -.172 *** .029 462 Hispanic, Low-Income Men -.240 *** .027 699 American Indian, High-Income Women -.093 * .055 85 American Indian, Low-Income Women -.396 *** .050 186 American Indian, High-Income Men -.371 *** .072 66 American Indian, Low-Income Men -.453 *** .066 108 Asian, High-Income Women .0009 .071 50 Asian, Low-Income Women -.137 *** .046 128 Asian, High-Income Men -.211 *** .069 54 Asian, Low-Income Men -.217 *** .055 92 Likelihood Ratio Statistic 48.23 Residual Intraclass Correlation .025 Observations 6,427

Page 34: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Results� DevelopmentalEnglishplacement

� Marginaleffects

� Non-whiteandlow-incomegroupsmorelikelytotakesuchcourses

Variable Marginal Effect

Standard Error

Black .188 *** .047 Hispanic .142 *** .019 American Indian .152 *** .041 Asian .129 *** .049 Low-Income .085 *** .022 Male .032 .021 Black x Low-Income .017 .061 Hispanic x Low-Income .065 ** .026 American Indian x Low-Income .163 *** .049 Asian x Low-Income .129 ** .057 Male x Low-Income .015 .031 Black x Male .020 .081 Hispanic x Male .004 .027 American Indian x Male .074 .056 Asian x Male -.075 .072 Black x Low-Income x Male -.062 .102 Hispanic x Low-Income x Male -.031 .038 American Indian x Low-Income x Male -.179 ** .070 Asian x Low-Income x Male .039 .085 Likelihood Ratio Test Statistic 372.37 Residual Intraclass Correlation .075 Observations 13,953

Page 35: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Results� DevelopmentalEnglishplacement

� Linearcombinations

� Nearlyallgroupsmorelikelytotakecourserelativetobasegroup

Variable Marginal Effect

Standard Error

Cell Size

White, High-Income Women (Base) - - - 1,843 White, Low-Income Women .085 *** .022 1,043 White, High-Income Men .032 .021 1,578 White, Low-Income Men .133 *** .023 718 Black, High-Income Women .188 *** .047 97 Black, Low-Income Women .291 *** .040 118 Black, High-Income Men .240 *** .066 45 Black, Low-Income Men .295 *** .048 75 Hispanic, High-Income Women .142 *** .019 1,665 Hispanic, Low-Income Women .292 *** .018 2,455 Hispanic, High-Income Men .178 *** .020 1,260 Hispanic, Low-Income Men .312 *** .019 1,588 American Indian, High-Income Women .152 *** .041 153 American Indian, Low-Income Women .400 *** .029 331 American Indian, High-Income Men .258 *** .040 126 American Indian, Low-Income Men .342 *** .033 203 Asian, High-Income Women .129 *** .049 118 Asian, Low-Income Women .343 *** .031 233 Asian, High-Income Men .086 .053 117 Asian, Low-Income Men .354 *** .033 187 Likelihood Ratio Test Statistic 372.37 Residual Intraclass Correlation .075 Observations 13,953

Page 36: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Results� Developmentalmathematicsplacement

� Marginaleffects

� Mostlymaineffectssignificant

� Menlesslikelytotakecourses;Asianandwhitestudentssimilar

Variable Marginal Effect

Standard Error

Black .231 *** .049 Hispanic .176 *** .019 American Indian .134 *** .042 Asian -.027 .059 Low-Income .157 *** .020 Male -.103 *** .022 Black x Low-Income -.025 .065 Hispanic x Low-Income -.028 .025 American Indian x Low-Income .053 .052 Asian x Low-Income .014 .069 Male x Low-Income -.062 * .034 Black x Male -.005 .092 Hispanic x Male -.011 .029 American Indian x Male -.013 .067 Asian x Male -.029 .097 Black x Low-Income x Male .127 .116 Hispanic x Low-Income x Male .027 .042 American Indian x Low-Income x Male .006 .083 Asian x Low-Income x Male .025 .114 Likelihood Ratio Test Statistic 407.11 Residual Intraclass Correlation .081 Observations 13,953

Page 37: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Results� Developmentalmathematicsplacement

� Linearcombinations

� Low-incomewomenhavehigherlikelihoodsofbeingplacedinthesecourses

Variable Marginal Effect

Standard Error

Cell Size

White, High-Income Women (Base) - - - 1,843 White, Low-Income Women .157 *** .020 1,043 White, High-Income Men -.103 *** .022 1,578 White, Low-Income Men -.008 .026 718 Black, High-Income Women .231 *** .049 97 Black, Low-Income Women .363 *** .044 118 Black, High-Income Men .123 .078 45 Black, Low-Income Men .320 *** .054 75 Hispanic, High-Income Women .176 *** .019 1,665 Hispanic, Low-Income Women .305 *** .018 2,455 Hispanic, High-Income Men .061 *** .021 1,260 Hispanic, Low-Income Men .155 *** .019 1,588 American Indian, High-Income Women .134 *** .042 153 American Indian, Low-Income Women .345 *** .031 331 American Indian, High-Income Men .018 .053 126 American Indian, Low-Income Men .172 *** .037 203 Asian, High-Income Women -.027 .059 118 Asian, Low-Income Women .145 *** .036 233 Asian, High-Income Men -.159 ** .077 117 Asian, Low-Income Men -.025 .046 187 Likelihood Ratio Test Statistic 372.37 Residual Intraclass Correlation .075 Observations 13,953

Page 38: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

SelectionBias� IncomegatheredfromtheFAFSA,butonly42%ofstudentsfiled

� FAFSAfilersandnon-filerslikelydifferentinseveralways(esp.intermsofincome)

Variable Present Missing Diff.

Graduation within 6 Years .406 .435 -.028*** Remedial English .294 .229 .065*** Remedial Mathematics .326 .269 .057*** Any Remedial .431 .362 .069*** Female .582 .533 .049*** White .406 .578 -.172*** Black .030 .018 .013*** Hispanic .444 .344 .100*** American Indian .069 .023 .047*** Asian .050 .038 .012***

Observations

6,427

8,930

Page 39: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

SelectionBias� MenmuchlesslikelytofileFAFSAs

� WhitestudentsleastlikelygrouptofiletheFAFSA

Group Proportion Missing

Cell Size

White Women .648 4,154 White Men .683 3,614 Black Women .409 225 Black Men .508 128 Hispanic Women .502 3,400 Hispanic Men .541 2,527 American Indian Women .279 376 American Indian Men .356 270 Asian Women .475 339 Asian Men .549 324 Overall .582 15,357

Page 40: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

SelectionBias� Overall,descriptiveevidencesuggeststhatstudentsthatdonotfileaFAFSAmaybeofmoreprivilegedsociallocations(e.g.,white,male,etc.)andalsomayhavesufficientlyhighincometonotqualityfortheFederalPELLGrantProgram.

� Inclusionofthesestudents,whicharguablyhaveagreaterchanceofsucceedingincollege,wouldlikelyonlywidentheachievementgapsweestimateinourmodel

� Forthisreason,webelieveourestimatesarebiaseddownwards(i.e.,conservativeachievementgaps)

Page 41: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Limitations1. Onlyincludesfirst-time,full-timein-statestudents(i.e.,notransfersor

outofstatestudents)

2. Familyincomenotreadilyavailableforallstudents

3. Wishlist:multidimensionalclassorSESstudentcharacteristics,LGBTQandgender

4. Hispanicorigindatadoesnotallowfordisaggregationbyexperiencesbyrace,nativity,generationalstatus

5. AfricanAmericanandAsiandataaresmall;reflectiveoftheschoolandstatedemographics

Page 42: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Conclusions� Graduationfindings:

� Maineffects:blackstudents(23%less)andAmericanIndianstudents(10%less)farlesslikelytograduatethantheirwhitecounterparts

� Moremaineffects:Menapprox.14%lesslikelytograduatethanwomen;low-incomestudentsapprox.14%lesslikelytograduatecomparedtohigh-incomestudents

� Interactioneffects:beingnon-white,comingfromapoorfamily,andbeingmaletendtointeracttoproduceadditionalpenaltiesintermsofgraduationlikelihood

Page 43: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Conclusions� Developmentalcoursetakingfindings:

� Englishcourses:morelikelyfornon-whitestudents(13-19%)andforstudentsfromlow-incomefamilies(9%);menarenomorelikelytotakesuchcoursesthanwomen.Beingnon-whiteandcomingfromapoorfamilytendstoresultinfurtherincreasesinthelikelihoodofbeingplacedinsuchcourses.

� Mathematicscourses:Remedialmathematicscoursetakingismorecommonfornon-white(butnotAsian)students,andlesslikelyformen.Low-incomemenwerelesslikelytobeplacedinremedialmathematics.

Page 44: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

Conclusions� Assumingindependenceofrace,gender,andclassoversimplifiesthecomplexnatureofachievementgapsinhighereducation

� Statisticalsignificanceofinteractioneffectsisevidenceofinterdependence

� Statisticalsignificanceofmaineffectsrevealstheyalsohavetheirownmeasureableeffectsonsuccessincollegeaswell

� Ourpaperoffersanewmethodofassessingtheoftencomplexnatureofinequalityalongmultipleinterdependentindividual-levelcharacteristics

Page 45: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

PolicyImplications� Classisnotaproxyforthefamiliarracial(andgender)achievementgapinsix-yearcollegegraduationorremedialclassplacement

� Revisitpoliciesthatassumeclassisproxyforrace(universalscholarshipprograms,fundingformula,etc.)

� Targetingaidtowardsstudentsfromlow-incomefamiliesmaynotbeenoughifothercharacteristicsgenerallystifletheirabilitytosucceedincollege

Page 46: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

PolicyImplications� Embracingintersectionalknowledgeprojectsinalllocal,state,andfederalreportingforequity—createafeasibledatainfrastructureforP-20thatincludesmeasuresofclass(parentaleducationalattainment,wealth)andotheraxesofinequalityincludingHispanicoriginasseparatefromrace(notanalyticallyequivalent)andsexualorientation

� Revisitlegislationthatconflatesclassstatuswiththeracializedachievementgap

Page 47: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

NextSteps

� Getitinprint!

� Usetwonationallyrepresentativelongitudinalstudies(NELS:88andELS:2002)fromtheDepartmentofEducationtoassesstheexternalvalidityofourfindings

� Employthemethodologyinotherfields,suchaslabormarketoutcomes,criminology,health,etc.

Page 48: Making the Invisible Visible - Wild Apricot...Making the Invisible Visible: Advancing Quantitative Methods in Higher Education using Critical Race Theory and Intersectionality Dr.

2017NewMexicoEvaluator’sConference

ThankYou!� Feelfreetocontacttheauthors:

� NancyLópez: [email protected]� ChristopherErwin: [email protected]

� Invitations:� Censusmini-Symposium,UofMaryland-CollegePark,11/9/178-1:30pm

� CriticalRaceStudiesinEducationAssociation,5/30/18-6/1/18atUNM� Callforpapersmid-August:crsea.org

� Questions?