NATIONAL ACHIEVEMENT TEST:
An Overview Presented by: NELIA V. BENITO, PhD, CESO IV Director III, NETRC
May 2010
OUTLINE
Recent DepED Memo on NAT Administration
NAT Frequently Asked Questions
Test Results Dissemination through the NETRC Website
NAT Results in Grade 6 and Year 2 (SY 2008-09)
Guidelines in the Utilization of NAT Results
Schematic Diagram on Strategies in the Improvement of NAT Results in Schools 2
DepEd Memo No. 522, s. 2009
3
DepEd Memo No. 522, s. 2009
4
List of Private Madaris included in the NAT-Grade 3 Name of Madrasah
Region/Division
Enrolment
Banaybanay Pilot Madrasah
XI – Davao Oriental
13
Jamiatu Muslim Mindanao
ARMM – Marawi City
15
Amanoddin Mascara Integrated Learning Center
ARMM – Marawi City
19
Khadija Pilot School
ARMM – Marawi City
32
Jamiatu Marawi Al‐Islamia Foundation
ARMM – Marawi City
39
Jamiatu Janobel Filibbien
ARMM – Marawi City
51
Mahad Darul‐Ulom Al Islamie
ARMM – Lanao del Sur
15
Mahad Falah Al Kharie
ARMM – Lanao del Sur
41
As‐Salihen Integrated School
ARMM – Lanao del Sur
27
Koronadal United Muslim Association (KUMA) Learning Center
XII – Koronadal City
6
IBN KHALDON Asian Integrated Inst.
NCR – Taguig City
14
TOTAL
272
5
What is the NAT? The National Achievement Test (NAT) is a Philippine‐made standardized test designed to determine pupils/students’ achievement level, strengths and weaknesses in five key curricular subject areas at the end of the school year.
6
What is the purpose of the NAT? The NAT was developed to measure what pupils/students in Grade Three, Grade Six and Second Year know and can do in five subject areas: Science, Mathematics, English, Filipino, and HeKaSi (Heograpiya, Kasaysayan at Sibika) in elementary and Araling Panlipunan in secondary level. Specifically, the test aims to: 1.
provide empirical information on the achievement level of pupils/students in Grade Three, Grade Six and Second Year to serve as guide for policy makers, administrators, curriculum planners, supervisors, principals and teachers in their respective courses of action. 2. identify and analyze variations on achievement levels across the years by region, division, school and other variables 3. determine the rate of improvement in basic education with respect to individual schools within certain time frames. 7
Who are the target clienteles of the NAT?
Grade 3 ‐ public schools only Grade 6 ‐ both public and private schools Year 2
‐ both public and private schools 8
What is the coverage of the NAT and how many test items does it comprise?
TEST
NAT G3
Subject Area Coverage 1. Science
NAT G6
NAT Y2
1. Science
1. Science
2. Mathematics
2. Mathematics
2. Mathematics
3. English
3. English
3. English
4. Filipino
4. Filipino
4. Filipino
5. HeKaSi
5. Araling Panlipunan
Number of Items Per Subject
30
40
60
Total Number of Items
120
200
300
9
Planning the Test
How is the NAT developed?
Developing the Table of Specifications
Item Writing
Test Assembly and Review of Test Items
Pilot Testing or Try Out of the Test (at least 2 forms of the final test)
Test Development Process
Item Analysis
No Reject
Validity/Reliability
Items Useful
Yes Organize final form of the test
Norming
Preparation of the Test Manual/Examiner’s Handbook
10
What features characterize the NAT?
• A multiple‐choice test • A sampling of competencies intended for the whole year coverage • A standardized test with mostly moderately difficult items • Anchored on Bloom’s Taxonomy of Cognitive Objectives / Dimensions • High‐Ordered Thinking Skills (HOTS) • The performance of an examinee is compared to the performance of a national populace. • The rating is expressed in percentage score or percent of correct responses.
11
What is the rationale of DepEd in administering the NAT in Grade Three, Grade Six and Second Year?
The NAT, which is a system‐based assessment, was specifically designed to gauge learning outcomes across target levels in identified periods of basic education. In particular, it spans from mid assessment of elementary education which falls on the third grade, and then to a terminal exit assessment which falls on the sixth grade. The test results in NAT‐Grade Six can likewise serve as measurement of incoming first year students’ readiness for high school. On the other hand, the NAT for Second Year high school serves as mid assessment of the secondary level. 12
What information is derived from the NAT Certificate of Rating (NAT-COR)?
• Raw scores obtained by an examinee five subjects are reported in a table alongside with the percentage scores. • Total test scores for raw and percentage scores are revealed at the bottom part of the table. • A Mastery Level Descriptive Equivalent on the obtained percentage scores is provided to guide end‐users in interpreting test results. • Percentage of Correct Responses (PCR) per learning competency by subject area is likewise presented to have a glimpse on the performance of the pupil/student in every skill measured in the test. 13
Facsimile of NAT-COR – Grade 6
14
Facsimile of NAT-COR – Grade 6 (back portion)
15
Facsimile of NAT-COR – Year 2
16
Facsimile of NAT-COR – Year 2 (back portion)
17
How are the NAT scores reported and interpreted to each examinee? • The COR comprises the Percentage of Correct Responses (PCR) per learning competency by subject area. The PCR is interpreted using the Achievement Level Descriptive Equivalent below. Achievement Level Percentage Descriptive Equivalent 96% ‐ 100%
Mastered
86 % ‐ 95%
Closely Approximating Mastery
66 % ‐ 85 %
Moving Towards Mastery
35 % ‐ 65%
Average Mastery
16% ‐ 34%
Low Mastery
5% ‐ 15%
Very Low Mastery
0 % ‐ 4%
Absolutely No Mastery
18
Is there a passing score in the NAT?
The NAT has no passing grade or score. It uses the Mean Percentage Score (MPS) to indicate the percentage of correctly answered items in a test. For instance, a 50 MPS would mean that an examinee correctly answered 20 of a 40‐item subject area test. The computation of grades in school, however, is done very differently from the NAT (Refer to DepED Order No. 70, s. 2003, “Revised Grading System for Elementary and Secondary Schools; www.deped.gov.ph). 19
Does an MPS below 75 mean that the examinees failed the test?
An MPS below 75 does not mean that pupils/students who took the test failed it. For instance, a 66 MPS in the total test would mean that the examinees were “moving towards mastery.” The NAT
uses
a
seven‐descriptive
equivalent
of
Achievement Level based on the normal curve wherein an MPS of 75 and above is a national target. 20
Test Results Dissemination
NETRC Website: netrc.sysportal.net • Link to Homepage: http://netrc.sysportal.net/HomePage.aspx
• Link to Individual Accounts: http://netrc.sysportal.net/signin.aspx 21
Webpage on Terms and Conditions
22
NETRC Website Home Page
23
Sample Downloads from the NETRC Website
netrc.sysportal.net
24
Sample Downloads from the NETRC Website
netrc.sysportal.net
25
Sample Downloads from the NETRC Website
netrc.sysportal.net
26
Log In to Individual Account
27
Webpage on Test Results by Testing Program
28
Test Results by Region
29
Sample Download: Regional Performance by CompetenciesNCR (NAT Grade Six SY 08-09) Subject
Category
Filipino
Grade V
Grade VI
Mathematics
Grade V
Grade VI
English
Grade V
Grade VI
Competency
netrc.sysportal.net Mean
SD
1.a
Pagsasalita
80.41
16.99
1.b
Pagbasa
77.01
20.05
1.c
Pagsulat
75.99
34.26
1.d
Pagsasalita
67.43
28.02
1.e
Pagbasa
71.09
14.79
1.f
Pagsulat
72.27
27.49
2.a
Computation of rational numbers
80.84
26.92
2.b
Solve word problems on rational numbers
82.44
29.03
2.c
Identify geometric figures
66.91
35.46
2.d
Solve word problems on measurement
82.97
27.06
2.e
Interpret graphs
73.23
29.18
2.f
Interpret measurement data
65.82
41.04
2.g
Solve word problems on measurement
58.21
25.79
2.h
Computation of rational numbers
75.31
31.72
2.i
Solve word problems on rational numbers
73.94
24.44
2.j
Interpret graphs
75.14
29.80
3.a
Speaking
83.70
22.46
3.b
Reading
72.47
20.45
3.c
Language
62.19
19.76 30
3.d
Reading
53.73
17.97
Sample Download: Regional Performance by CompetenciesNCR (NAT Grade Six SY 08-09) (cont’d) Science
Grade V
Grade VI
HEKASI
Grade V
Grade VI
netrc.sysportal.net
4.a
Identify major parts of a body system and their functions
80.68
30.76
4.b
Explain how a body system works
62.59
27.56
4.c
Classify vertebrates into five subclasses
69.76
32.94
4.d
Describe characteristics of living things for survival
60.25
37.27
4.e
Describe characteristics of different kinds of plants
62.96
36.91
4.f
Differentiate physical from chemical changes
69.25
37.92
4.g
Describe characteristics of planets
56.43
38.12
4.h
Identify major parts of a body system and their functions
53.94
24.00
4.i
Present the feeding interrelationships among living things
64.65
31.25
4.j
Illustrate the interdependence of plants and animals for gases
70.76
30.26
4.k
Cite examples of chemicals which can be harmful to health
76.81
33.81
4.l
Identify energy forms and their uses
55.76
28.89
4.m
Identify factors that affect motion of an object
63.09
31.60
4.n
identify factors that affect climate of a place
60.93
36.07
4.o
Explain theories about the universe
36.08
30.40
5.a
Naipaliwanag ang kinalalagyan at katangiang pisikal ng bansa
81.86
27.49
5.b
Natutukoy ang nagawa ng mga bayani noong panahon ng mga Espanyol
72.41
25.50
5.c
Nauunawaan ang mga unang Pilipino
67.64
28.31
5.d
Nabibigyang halaga ang panahon ng Ikatlong Republika
65.93
31.92
5.e
Naipagkakapuri ang pagiging kabilang ng mga Pilipinong nandarayuhan sa ibang bansa bilang mamamayan ng bansang Pilipinas
79.55
28.21
5.f
Natutukoy ang mga likas na yaman ng teritoryo ng Pilipinas
71.51
25.39
5.g
Nakikilala at nasusuri ang bahaging ginampanan ng pamahalaan at mamamayan para sa kabutihan ng bansa
64.30
5.h
Nasusuri ang pagpapanatili ng kalayaan ng bansa
70.89
32.09
5.i
Nakikilala at naipaliwanag ang kahalagahan ng mamamayan at pamahalaan sa pag-unlad ng bansa
75.53
24.16
22.16
31
Sample Download: Division Performance-Batangas Province
netrc.sysportal.net
32
Sample Download: School Performance-Nasugbu West CS
netrc.sysportal.net
33
NAT Results SY 2008-2009 • Grade 6 • Year 2
34
NAT-G6 2009 National Performance MPS by Subject Area and Total Test Percentage Score
80.00 60.00 40.00 20.00 0.00 MATH
ENGLISH
SCIENCE
FILIPINO
HEKASI
TOTAL TEST
2006
53.66
54.05
46.77
60.68
58.12
54.66
2007
60.29
60.78
51.58
66.02
61.05
59.94
2008
63.89
61.62
57.90
73.18
67.44
64.81
2009
68.70
62.14
59.63
72.21
68.99
66.33
15.04 28.02
8.09 14.97
12.86 27.50
11.53 19.00
2009 vs 2006 % Increase
10.87 18.71
11.67 21.36 35
NATIONAL ACHIEVEMENT TEST - GRADE SIX SY2008-2009
35
NAT-G6 2009 National Performance PUBLIC and PRIVATE (31.8% of private schools) Frequency and Percentage Distribution of EXAMINEES based on the Criteria of Achievement/ Mastery Level Mastery Level
Public F
Mastered
Private %
96-100%
1
0.00%
Closely Approximating Mastery
86-95%
113,047
6.82%
Moving Towards Mastery
66-85%
864,038
Average Mastery
35-65%
Low Mastery
F
%
Overall F
%
0.00%
1
0.00%
353
0.36%
113,400
6.46%
52.16%
19,98 7
20.26%
884,025
50.37%
625,541
37.76%
68,20 1
69.13%
693,742
39.53%
15-34%
53,582
3.23%
10,10 8
10.25%
63,690
3.63%
5-14%
156
0.01%
4
0.00%
160
0.01%
Absolutely No 0-14% 53 0.00% NATIONAL ACHIEVEMENT TEST - GRADE SIX SY2008-2009 Mastery
3
0.00%
56
0.00% 36
Very Low Mastery
36
NAT-G6 2009 National Performance PUBLIC and PRIVATE (31.8% of private schools) Frequency and Percentage Distribution of SCHOOLS based on the Criteria of Achievement/ Mastery Level Mastery Level
Public F
Mastered
Private %
96-100%
F
%
0.00%
Overall F
%
0.00%
0.00%
Closely Approximating Mastery
86-95%
1,033
3.31%
3
0.13%
1,036
3.08%
Moving Towards Mastery
66-85%
16,456
52.75%
114
4.78%
16,570
49.34%
Average Mastery
35-65%
13,367
42.85%
2,235
93.67%
15,602
46.46%
Low Mastery
15-34%
340
1.09.%
34
1.42%
374
1.11%
Very Low Mastery
5-14%
0.00%
0.00%
0.00%
Absolutely No Mastery
0-14%
0.00%
0.00%
0.00%
37
NATIONAL ACHIEVEMENT TEST - GRADE SIX SY2008-2009
37
NAT-Y2 2009 National Performance (Excluding Private Schools) MPS by Subject Area and Total Test
2009vs2006 % Inc./Dec.
-2.81 -6.63
1.17 2.28
0.38 0.88
**Private schools not included NATIONAL ACHIEVEMENT TEST – SECOND YEAR SY 2008-2009
4.55 9.76
-1.14 -2.21
0.43 0.92 38
FREQUENCY AND PERCENTAGE DISTRIBUTION OF EXAMINEES BY ACHIEVEMENT LEVEL (PUBLIC VS. PRIVATE)
Achievement Level 96-100% 86-95% 66-85% 35-65% 15-34% 5-14% 0-4%
Public n
Mastered 0 Closely Approximating Mastery 1,505 Moving Towards Mastery 144,669 Average Mastery 795,182 Low Mastery 229,576 Very Low Mastery 278 Absolutely No Mastery 73 Total 1,171,283
Private %
n
Overall %
0.00 0 0.00 0.13 27 0.01 12.35 16,233 5.04 67.89 231,031 71.69 19.60 74,910 23.24 0.02 48 0.01 0.01 14 0.00 100.00 322,263 100.00
n
%
0 1,532 160,902 1,026,213 304,486 326 87 1,493,546
0.00 0.10 10.77 68.71 20.39 0.02 0.01 100.00 39
FREQUENCY AND PERCENTAGE DISTRIBUTION OF SCHOOLS BY ACHIEVEMENT LEVEL (PUBLIC VS. PRIVATE)
Achievement Level 96-100% 86-95% 66-85% 35-65% 15-34% 5-14% 0-4%
Mastered Closely Approximating Mastery Moving Towards Mastery Average Mastery Low Mastery Very Low Mastery Absolutely No Mastery Total
Public
Private
Overall
n
%
n
%
n
%
0 4 584 5,783 389 0 0 6,760
0.00 0.06 8.64 85.55 5.75 0.00 0.00 100.00
0 0 28 4,116 386 0 0 4,530
0.00 0.01 5.04 71.69 23.24 0.01 0.00 100.00
0 4 612 9,899 775 0 0 11,290
0.00 0.04 5.42 87.68 6.86 0.00 0.00 100.00 40
What are the guidelines in the utilization of NAT results?
DepED Memo. No. 228, s. 2007 “Utilization of the Certificate of Rating in the National Achievement Test in Grade Six for Remedial Instruction in First Year”
41
Schematic Diagram on Strategies in the Improvement of NAT Results in Schools CONTEXT DepEd-NETRC Policy Statement: Maximized utilization of NAT Results: School Level
INPUTS NAT Results: - Institutional Performance Profile - Competency Analysis Profile
THROUGHPUTS
OUTCOMES
Strategies in the Improvement of NAT Results
Division Level
Classroom Level
District Level
Improved NAT Results in the succeeding school year assessment
Stakeholders
School Management
42
FEEDBACK
“Assessment helps us see the difference between teaching and learning.” -Carole Cooper Global Learning Communities 43
Thank you!
44
