Performance of quota students in the national exam for evaluating student achievement: evidence on federal higher education institutions

Araujo, Antonia Amanda; Benevides, Alesandra de Araújo; Mariano, Francisca Zilania; Barbosa, Rafael Barros

Acessibilidade / Reportar erro

Brasil

Revista Brasileira de Educação

Español English

Brasil

Español English

sumário « anterior atual seguinte »

Sumário

ARTICLE • Rev. Bras. Educ. 25 • 2020 • https://doi.org/10.1590/S1413-24782020250064 copy

Performance of quota students in the national exam for evaluating student achievement: evidence on federal higher education institutions

Authorship SCIMAGO INSTITUTIONS RANKINGS

ABSTRACT

The performance differential between quota and non-quota students at the National Exam for Evaluating Student Achievement between 2013-2015 is investigated using data from the National Institute for Pedagogical Studies, as well as whether there is a heterogeneous effect between the types of available quotas: ethnic-racial, income, public school, combination, and others. Two methods were used: Balancing by Entropy and Matching by Propensity Score (Pareamento por Escore de Propensão) for multiple treatments. The results show that the quota effect was significant, but negative on the gross grade. In the multiple treatment model, there is a negative and significant effect on ethnic-racial, income, and others quotas. However, they were positive and significant in public and combination schools. It is concluded that the performance is affected in a heterogeneous way depending on the type of quota. In addition, on average, quota students perform below non-quota ones in ENADE.

KEYWORDS
performance differential; quota students; National Exam for Evaluating Student Achievement

Variable	Description
Treatments
Quota holder	1 if entered through the quota policy; 0 otherwise
Quotas	0 if the student did not enter through quotas ; 1 if entered through ethnic-racial criterion; 2 if entered according to income criterion; 3 if entered through public or private school (with a scholarship) criterion; 4 if entered through the combination of criteria; and 5 if entered through another criterion.
Result
General Test Score	Total score in ENADE
Covariates
Gender	1 if male; 0 otherwise
Race	1 if black; 0 otherwise
Marital status	1 if single; 0 otherwise
High_School	1 if all or most of them are from public schools; 0 otherwise
Type of high school
Traditional	1 if traditional; 0 otherwise
Vocational education	1 if vocational education; 0 otherwise
Scholarship	1 if scholarship holder; 0 otherwise
Employment	1 if the student works 40 hours or more a week; 0 otherwise
Educ_mother1	1 if the mother has no schooling or until the 5th year; 0 otherwise
Educ_mother2	1 if the mother has a degree; 0 otherwise
Educ_father1	1 if the father has no education or until the 5th year; 0 otherwise
Educ_father2	1 if the father has a degree; 0 otherwise
Family income	1 if the family’s monthly income is up to 1.5 minimum wages; 0 otherwise
Age	Age in years
Age1	1 if the student is aged between 16 and 25
Age2	1 if the student is aged between 26 and 40
Time	Years difference between the completion of ENADE and the year of entry into the undergraduate program
Prestige	1 if the course that the student is taking is considered prestigious; 0 otherwise
Course region
North	1 if located in the North Region; 0 otherwise
Northeast	1 if located in the Northeast Region; 0 otherwise
South	1 if located in the South Region; 0 otherwise
Midwest	1 if located in the Midwest Region; 0 otherwise

Quota types	Test scores ENADE
	2013-2015		2013		2014		2015
	Mean	SD	Mean	SD	Mean	SD	Mean	SD
Ethnic-racial	46..311	15.987	47.530	17.823	44.491	15.444	49.186	15.539
Income	45.212	15.534	48.156	16.709	43.629	15.320	47.901	15.067
Public school	50.222	14.875	51.841	15.029	48.816	15.027	52.456	14.093
Combination	49.849	15.327	50.028	15.670	48.434	15.210	52.389	15.084
Others	41.564	14.883	47.312	13.974	40.630	14.691	46.702	15.372

Variables	2013-2015				2013				2014				2015
	Quota holders		Non-quota holders		Quota holders		Non-quota holders		Quota holders		Non-quota holders		Quota holders		Non-quota holders
	Mean	SD	Mean	SD	Mean	SD	Mean	SD	Mean	SD	Mean	SD	Mean	SD	Mean	SD
Test score ENADE	48.078	15.431	50.111	15.597	50.568	15.602	52.061	15.005	46.280	15.407	48.254	15.678	51.410	14.667	53.153	15.178
Gender	0.37849	0.48502	0.45081	0.49757	0.29506	0.45613	0.34684	0.47597	0.38490	0.48658	0.48001	0.49960	0.40197	0.49032	0.45585	0.49805
Race	0.16282	0.36921	0.07751	0.26740	0.14763	0.35478	0.05775	0.23329	0.16451	0.37074	0.08848	0.28399	0.16575	0.37188	0.06521	0.24690
Marital status	0.75533	0.42989	0.79813	0.40139	0.86150	0.34546	0.89405	0.30777	0.71461	0.45160	0.76136	0.42625	0.80876	0.39329	0.81756	0.38620
High School	0.94400	0.22990	0.48087	0.499636	0.91927	0.27244	0.36377	0.48109	0.94823	0.22155	0.55657	0.46679	0.94500	0.22799	0.38181	0.48583
Traditional type	0.76083	0.42658	0.84560	0.36132	0.86523	0.34152	0.91133	0.28427	0.71546	0.45120	0.80854	0.39345	0.82714	0.37814	0.88793	0.31544
Technical type	0.09572	0.29422	0.07690	0.26644	0.08904	0.28485	0.06190	0.24099	0.08545	0.27955	0.08229	0.27481	0.12520	0.33097	0.07475	0.26299
Scholarship	0.48327	0.49972	0.46048	0.49843	0.64046	0.47992	0.61473	0.48666	0.50653	0.49996	0.48500	0.49977	0.34875	0.47660	0.28740	0.45255
Employment	0.24525	0.43024	0.23174	0.42195	0.07010	0.25535	0.05840	0.23450	0.25561	0.43621	0.24392	0.42944	0.30236	0.45931	0.32898	0.46985
Educ_mother1	0.36090	0.48026	0.20639	0.40471	0.26551	0.44166	0.12582	0.33166	0.41417	0.49259	0.25739	0.43720	0.27018	0.44408	0.14091	0.34794
Educ_mother2	0.10449	0.30590	0.22715	0.41899	0.13766	0.34459	0.26841	0.44314	0.09000	0.28620	0.19961	0.39971	0.12571	0.33154	0.26414	0.44088
Educ_father1	0.45761	0.49820	0.27087	0.44441	0.37206	0.48342	0.18865	0.39124	0.51468	0.49979	0.32731	0.46923	0.35230	0.47771	0.19319	0.39481
Educ_father2	0.08661	0.28127	0.20869	0.40637	0.10980	0.31269	0.24437	0.42972	0.07222	0.25886	0.18185	0.38523	0.11240	0.31588	0.24958	0.43277
Family income	0.24364	0.42928	0.13855	0.34548	0.24070	0.42756	0.12143	0.32663	0.27344	0.44573	0.16962	0.37530	0.16879	0.37459	0.07552	0.26376
Age1	0.53984	0.49841	0.59897	0.49010	0.67391	0.46884	0.72272	0.44766	0.47887	0.49956	0.54303	0.49814	0.63173	0.48236	0.64470	0.47861
Age2	0.37164	0.48325	0.34260	0.47458	0.29798	0.45743	0.26012	0.43871	0.40461	0.49082	0.38022	0.48544	0.32251	0.46747	0.31130	0.46303
Time	3.9055	1.2225	4.2997	1.5709	3.8748	1.0572	4.1951	1.2476	3.8838	1.2346	4.3501	1.6511	3.9759	1.2621	4.2536	1.5779
Prestige	0.00062	0.02505	0.00137	0.03703	0	0	0.00189	0.04349	0.00029	0.01723	0.006255	0.02500	0.00177	0.04208	0.00281	0.05300
North	0.18750	0.39032	0.13562	0.34239	0.09384	0.29165	0.08436	0.27794	0.24486	0.43001	0.16130	0.36781	0.08554	0.27970	0.11056	0.31360
Notheast	0.28213	0.45004	0.27837	0.44819	0.32343	0.46784	0.28975	0.45365	0.27250	0.44525	0.27549	0.44676	0.28703	0.45240	0.27704	0.44754
South	0.17164	0.37708	0.13906	0.34601	0.23144	0.42181	0.16332	0.36966	0.14524	0.35235	0.12902	0.33523	0.21061	0.40777	0.14577	0.35288
Midwest	0.06555	0.24751	0.09949	0.29932	0.07502	0.26346	0.11039	0.31338	0.06083	0.23902	0.09166	0.28855	0.07312	0.26035	0.11060	0.31364

Covariates	Treatment			Control			Differences			p-value
Covariates	Mean	Variance	Asymmetry	Mean	Variance	Asymmetry	Mean	Variance	Asymmetry	p-value
Gender	0.3787	0.2353	0.5002	0.4512	0.2476	0.1962	-0.0752	-0.0123	0.304	0.000
Race	0.1627	0.1362	1.828	0.07748	0.07148	3.161	0.08522	0.06472	-1.333	0.000
Marital Status	0.7552	0.1849	-1.187	0.7979	0.1612	-1.484	-0.0427	0.0237	297	0.000
High School	0.944	0.055284	-3.863	0.481	0.2496	0.07618	0.463	-0.19431	-3.863	0.000
Traditional type	0.7609	0.1819	-1.223	0.8456	0.1306	-1.912	-0.0847	0.0513	689	0.000
Technical type	0.09558	0.08645	2.751	0.07689	0.07098	3.176	0.01869	0.01547	425	0.000
Scholarship	0.4831	0.2497	0.06775	0.4602	0.2484	0.1597	0.0229	0.0013	-0.0919	0.000
Employment	0.2455	0.1852	1.183	0.232	0.1782	1.27	0.0135	0.007	1.181	0.000
Educ_mother1	0.361	0.2307	0.579	0.2065	0.1639	1.45	0.1545	0.0668	-0.871	0.048
Educ_mother2	0.1045	0.09357	2.586	0.2271	0.1755	1.303	-0.1226	-0.08193	1.283	0.000
Educ_father1	0.4577	0.2482	0.17	0.2709	0.1975	1.031	0.1868	0.0507	-1.030	0.007
Educ_father2	0.08658	0.07909	2.94	0.2087	0.1651	1.434	-0.1221	-0.08601	-1.431	0.000
Family income	0.2436	0.1842	1.195	0.1385	0.1193	2.094	0.1051	0.0649	-899	0.483
Age1	0.5396	0.2484	-0.1589	0.5987	0.2403	-0.4027	-0.0591	0.0081	0.2438	0.079
Age2	0.372	0.2336	0.5297	0.3428	0.2253	0.6623	0.0292	0.0083	-0.1326	0.000
Time	3.906	1.495	0.8005	4.3	2.469	1.482	-0.394	-0.974	-1.481	0.000
Prestige	0.0006292	0.0006289	39.83	0.001377	0.001375	26.89	0.00075	-0.00075	12.94	0.285
North	0.1876	0.1524	1.601	0.1357	0.1173	2.128	0.0519	0.0351	-527	0.000
Northeast	0.2821	0.2025	0.9686	0.2785	0.2009	0.9884	0.0036	0.0016	0.7677	0.000
South	0.1714	0.1421	1.744	0.139	0.1197	2.804	0.0324	0.0224	-1.060	0.000
Midwest	0.06554	0.06124	3.511	0.0995	0.0896	2.676	-0.0339	-0.02836	835	0.000

Covariates	Treatment			Control			Differences			p-value
Covariates	Mean	Variance	Asymmetry	Mean	Variance	Asymmetry	Mean	Variance	Asymmetry	p-value
Gender	0.3787	0.2353	0.5002	0.3787	0.2353	0.5002	0	0	0	0.982
Race	0.1627	0.1362	1.828	0.1627	0.1362	1.828	0	0	0	0.853
Marital status	0.7552	0.1849	-1.187	0.7552	0.1849	-1.187	0	0	0	0.804
High school	0.944	0.05284	-3.863	0.944	0.05284	-3.863	0	0	0	0.722
Traditional type	0.7609	0.1819	-1.223	0.7609	0.1819	-1.223	0	0	0	0.771
Technical type	0.09558	0.08645	2.751	0.09558	0.08645	2.751	0	0	0	0.813
Scholarship	0.4831	0.2497	0.06775	0.4831	0.2497	0.06775	0	0	0	0.971
Employment	0.2455	0.1852	1.183	0.2455	0.1852	1.183	0	0	0	0.960
Educ_mother1	0.361	0.2307	0.579	0.361	0.2307	.579	0	0	0	0.907
Educ_mother2	0.1045	0.09357	2.586	0.1045	0.09357	2.586	0	0	0	0.654
Educ_father1	0.4577	0.2482	0.17	0.4577	0.2482	.17	0	0	0	0.810
Educ_father2	0.08658	0.07909	2.94	0.08659	0.07909	2.94	-0.00001	0	0	0.694
Family Income	0.2436	0.1842	1.195	0.2436	0.1842	1.195	0	0	0	0.831
Age1	0.5396	0.2484	-0.1589	0.5396	0.2484	-0.1589	0	0	0	0.989
Age2	0.372	0.2336	0.5297	0.372	0.2336	0.5297	0	0	0	0.871
Time	3.906	1.495	0.8005	3.906	1.495	0.8005	0	0	0	0.979
Prestige	0.0006292	0.0006289	39.83	0.0006293	0.0006289	39.83	0.0000001	0	0	0.762
North	0.1876	0.1524	1.601	0.1876	0.1524	1.601	0	0	0	0.952
Northeast	0.2821	0.2025	0.9686	0.2821	0.2025	0.9686	0	0	0	0.988
South	0.1714	0.1421	1.744	0.1714	0.1421	1.744	0	0	0	0.938
Midwest	0.06554	0.06124	3.511	0.06554	0.06124	3.511	0	0	0	0.667

Result Variable	Quota holders	Non-quota holders	ATE	(%)	SD	t-test
Test score ENADE	48.079	50.117	-2.038	-4.06	0.10	-20.37

Variables	Treatments
	Ethnic-racial		Income		Public school		Combination		Others
	Coefficient	p-value	Coefficient	p-value	Coefficient	p-value	Coefficient	p-value	Coefficient	p-value
Gender	0.0822127	0.080	-0.0391799	0.418	-0.1892341	0.000	-0.1541321	0.000	-0.2690981	0.000
Race	2.42146	0.000	0.0338291	0.649	-0.2010925	0.000	1.163633	0.000	0.3061779	0.000
Marital status	0.2761764	0.000	0.2583822	0.000	0.2453653	0.000	0.2101809	0.000	-0.1574784	0.000
High school	1.735686	0.000	2.517273	0.000	4.288343	0.000	3.331698	0.000	0.6021486	0.000
Traditional type	0.3985074	0.000	-0.0827084	0.284	0.3427349	0.000	0.142501	0.025	-1.13519	0.000
Technical type	0.2281606	0.015	-0.3149657	0.004	0.2892724	0.000	-0.0648523	0.443	-1.110021	0.000
Scholarship	0.018347	0.639	0.1825231	0.000	0.1907278	0.000	0.1859019	0.000	-0.1652407	0.000
Employment	-0.3368237	0.000	-0.2168624	0.001	-0.2528883	0.000	-0.2364539	0.000	0.3402165	0.000
Educ_mother1	0.0187951	0.690	0.1024509	0.077	-0.0249382	0.263	0.0533111	0.237	0.19389	0.000
Educ_mother2	-0.2304234	0.000	-0.433509	0.000	-0.1659937	0.000	-0.3681685	0.000	-0.0539236	0.367
Educ_father1	0.0135826	0.763	-0.2572064	0.004	-0.0358129	0.091	0.0484722	0.625	0.360556	0.000
Educ_father2	-0.0933321	0.139	-0.2572064	0.006	-0.1274693	0.000	-0.2766585	0.000	-0.1238162	0.069
Family Income	0.1562583	0.000	0.595882	0.000	-0.0759462	0.001	0.0328715	0.460	0.0762599	0.052
Age1	0.0689564	0.468	0.3335827	0.003	0.5391591	0.000	0.2952196	0.001	-1.113874	0.000
Age2	0.1750883	0.046	0.0568177	0.588	0.1743214	0.000	0.0099819	0.901	-0.3514717	0.000
Time	-0.0451715	0.000	-0.1473223	0.000	-0.0964815	0.000	-0.1537905	0.000	-0.2394884	0.000
Prestige	-0.1345502	0.751	-12.39588	0.000	-0.5024968	0.198	0.8982139	0.058	-0.8170621	0.274
North	-0.1706847	0.013	-0.3060784	0.000	-0.4895727	0.000	-0.376322	0.000	0.9092588	0.000
Northeast	0.6446868	0.000	-0.1331396	0.030	0.0152833	0.511	-0.2085642	0.000	0.3523564	0.000
South	0.8628803	0.000	0.0765335	0.282	0.3142073	0.000	-0.6270097	0.000	0.0235961	0.699
Midwest	0.8434541	0.000	-0.6612338	0.000	-0.6670581	0.000	-0.9724663	0.000	-0.1493261	0.045
Constant	-6.312464	0.000	-5.820389	0.000	-5.739137	0.000	-5.925265	0.000	-1.637878	0.000

Quotas		Test score ENADE
Ethnic-racial	Treatment	46.318
	Control	47.759
	ATE	-1.441
		(-3.02%)
	t-test	-4.81
Income	Treatment	45.203
	Control	49.574
	ATE	-4.371
		(-8.82%)
	t-test	-11.97
Public school	Treatment	50.230
	Control	48.680
	ATE	1.550
		(3.18%)
	t-test	11.70
Combination	Treatment	49.825
	Control	48.844
	ATE	0.98
		(2%)
	t-test	3.55
Others	Treatment	41.565
	Control	44.601
	ATE	-3.03
		(-6.8%)
	t-test	-12.92

ANPEd - Associação Nacional de Pós-Graduação e Pesquisa em Educação Rua Visconde de Santa Isabel, 20 - Conjunto 206-208 Vila Isabel - 20560-120, Rio de Janeiro RJ - Brasil, Tel.: (21) 2576 1447, (21) 2265 5521, Fax: (21) 3879 5511 - Rio de Janeiro - RJ - Brazil
E-mail: rbe@anped.org.br

Acompanhe os números deste periódico no seu leitor de RSS

[1] Antonia Amanda Araujo is a master’s student in education from the Universidade Federal do Ceará (UFC). E-mail: antoniaamandaaraujo@gmail.com