Thursday, 18 September 2014

Assessment beyond Levels: the benefits of using standardised assessments for planning and monitoring purposes

Arrangements for assessment in the new curriculum give schools greater opportunity to develop assessment frameworks that are best suited to their own school populations. Although ‘assessment without levels’, a new concept for a generation of teachers brought up on tracking and evaluating progress through reference to levels, initially may pose some challenges to school leaders, in practice, schools have been given greater freedom with regard to developing their own assessment.
In this new climate, where schools are accountable for demonstrating year-on-year progress without using levels, diagnostic, standardised assessments are an excellent way of supporting other school assessments as evidence of progress. As CEM, University of Durham, standardised assessments are an excellent tool for providing valid and reliable information on pupil academic profiling and can work alongside any school assessments already in place, these types of assessments are key in providing informed evidence for progress tracking and for benchmarking pupils’ performance with national norms. In addition, CEM assessments can be used not only to establish a baseline for every pupil or a particular cohort, but can also complement teacher assessment in monitoring learning and assist with reporting of progress to parents and other stakeholders. Many schools looking for reliable ways of demonstrating year-on-year progress by externally verified standardised tests have already embedded CEM assessments into their assessment frameworks to assist with evidence of progress for inspection purposes and own self-evaluation of teaching and learning.
What makes CEM assessments particularly useful to teachers and school leaders, is not only the range of assessments available to suit different ages and key stages in education but also their reliability in terms of future predictions – a feature especially useful for target-setting on individual and cohort basis. Since test development at CEM, the largest provider of standardised school assessments in the world, is researched-based, CEM assessments are trailed on very large samples, which makes the tests quite reliable. CEM have been delivering baseline tests and value added measures for over 30 years to over 3000 secondary schools worldwide.

Range of Assessments
CEM assessments cover all stages of education: from Nursery / EYFS to Post 16 and CEM’s Pscales+ assessments are aimed at supporting pupils with special educational needs.

Aspects Nursery/EYFS (ages 3 – 4)
PIPS Primary (ages 5 – 11)
InCAS Primary (ages 5 – 11)
MidYIS KS3 (ages 11 – 14)
INSIGHT End of KS3 (ages 13 – 14)
Yellis KS4 (ages 14 – 16)
Alis KS5 (16+)
CEM IBE KS5 (16+ IB courses)
Pscales+ All key stages (ages 3 – 19) special schools

CEM assessment are adaptive and computer based, meaning each pupil is challenged at a level that is appropriate to them. They are easy to administer and rapid, comprehensive analysis and feedback are provided for schools, including analytical software.

Primary Schools: aims and benefits of CEM assessments
How can CEM data help schools to measure attainment and track progress?
At primary level, Aspects, PIPS and InCAS assessments provide an objective baseline measure which is invaluable to tracking progress at individual and cohort level. In the absence of levels, they provide an objective, external evaluation and standardisation against national norms or age equivalent scores and, alongside school internal assessment data, assist with year-on-year tracking of progress. Information from on-entry assessments helps with pupil profiling by establishing an initial ability baseline which can be used to inform future teaching and learning, and inform school curriculum planning. The detailed data obtained over time allows teachers to identify pupils’ gaps in learning, monitor individual progress and can be used to inform future teaching and planning of learning activities. At whole school level, the data not only provides robust evidence of progress that can be used for accountability purposes, but can also support monitoring of teaching and learning at cohort level; inform curriculum planning and evaluation; identify staff professional development needs and support school improvement.

Can CEM data be used by teachers for target-setting?
As PIPS and InCAS data identify gaps in learning, this can help with individual target-setting for improvement and mapping pupil progress. Easy access to detailed analysis of performance at cohort level, for example class, year group, subject area, can support school leaders with identifying targets for particular cohorts as well as monitoring and evaluating earlier interventions or particular targets. The predictive nature of the assessments assists with curriculum planning and target-setting for whole cohorts against school expectations or national accountability measures (floor standards).

How can the CEM data help parents understand their child’s attainment and progress?

PIPS and InCAS data provide a wealth of information that can support school assessment data in reporting attainment and progress to parents. Within the changing school landscape, parents need simple and accurate information about their children learning in an easy to understand format. CEM reports identify where children are with their learning against their own prior achievement and/or national standards in a visual format, and parental feedback suggests that parents find PIPS data to be a particularly useful tool in reporting of progress. InCAS data show progress based on age standardized scores so parents can see how pupils’ abilities relate to their chronological age. Where there is an indication of a weakness, parents always welcome early identification. In instances of high achievement, CEM data can be used to report on appropriate level of challenge. A school which introduced sharing of PIPS data with parents reported higher levels of parental engagement and improved parental participation at school events.

How can the CEM assessment data help with providing evidence of progress for school inspectors?
Alongside school assessment data, CEM assessments provide an extra layer of external, robust evidence of pupil progress and attainment. As inspections are focused on the impact of school processes, the ability to demonstrate how a school’s assessment framework contributes to improved outcomes for pupils is crucial to evaluating the effectiveness of teaching and learning, and pupil achievement. In the absence of levels, the data from CEM assessments can be used to support teacher assessment data as evidence of progress at individual and cohort level. The information from baseline assessments, can be also used to establish pupils’ ability levels on entry as compared with national norms. CEM assessment data are a source of reliable, standardised information for inspectors and allow school leaders to demonstrate how the data are used for school self-evaluation and improvement. One school reported that PIPS data helped to establish pupils’ ability levels during inspection. PIPS data along with other school assessment data were used as evidence of outstanding progress made by pupils.

How can CEM assessments inform standardisation and national benchmarking in the absence of levels?
Comparisons with national norms allow teachers to put school assessment data into context and assist with benchmarking of pupils performance, which is particularly useful when schools work in greater isolation and need to demonstrate progress between standardised key stage assessments. CEM assessments are in tune with the new way of assessing progress and attainment in the new curriculum, where the new assessments at the end of key stage 2 will report “secondary readiness” by way of national standardisation (by comparison with others). According to new accountability measures, schools will be expected to get at least 85% of their pupils to the new “secondary ready” standard, which is expected to be reported on a standardised national scale of 80 – 130 with a score of 100 being described as “secondary ready” standard. The new floor standards will be based on key stage 2 results and pupil progress, and schools will be expected to track the rate of progress from a new baseline assessment in Reception. As CEM assessments already provide similar baseline data and can be used for tracking progress throughout primary years based on national standardisation and evidence of individual attainment/progress, together with local school data based on teacher assessment, they can provide robust evidence of progress benchmarked against national standards. For comparison purposes, PIPS assessment feedback is standardised with an average pupil scoring 50. CEM data are ideally placed to contribute to a broad range of information that can be made available to parents and the wider public about the school performance and contribute to the fair and transparent school accountability system.

How can CEM tests help with screening for SEN, EAL and More Able Pupils?
The diagnostic nature of CEM assessments provides data for early identification of special education or EAL needs that can be a barrier to learning. On the other end of the spectrum, early identification of pupils who are particularly able, Gifted & Talented, can assist with curriculum planning and inform teaching and learning to a greater degree. Early identification of specific learning needs is crucial to providing intervention at an appropriate level. The data from subsequent assessments can be used to evaluate school intervention. Diagnostic assessment in InCAS Reading and Maths are supported by research-based remediation advice to empower teachers in the diagnosis of specific learning difficulties and providing the right level of support.

How do CEM assessments contribute to pupils’ voice?
As pupil engagement in learning is key to motivation and improvement, CEM assessments, through measuring attitudes, can provide valuable information for teachers and school leaders regarding pupils’ attitudes to learning. At primary stage, attitudes to mathematics, reading and school are assessed. These data can help with identifying mindsets towards learning in different areas of the school curriculum and can help with bridging pastoral and academic dimensions of the school. The data can also be used for mentoring learning and developing cross-curricular thinking and study skills to improve pupils’ attitudes towards learning. This information is an invaluable addition to academic and pastoral profiling, and can contribute significantly to reporting and discussions with parents.

Secondary Schools: aims and benefits of CEM assessments
The benefits of CEM assessments (MidYIS, INSIGHT, Yellis, Alis and CEM IBE) at secondary school level can be demonstrated through their ability to add an extra dimension to other school data that can be used for monitoring teaching and learning at subject, department/faculty and whole-school level. As students progress through their school career, there is more information available about their progress and attainment. These data provide additional information about students’ academic profiles, making CEM assessments a very accurate and reliable tool for future predictions at individual subject level. This type of information is very useful for curriculum planning at secondary school level and for career advice, including various subject options and/or qualifications at GCSE level and beyond. MidYIS tests have an established reputation for delivering accurate baseline data that can be used as a springboard for progress measures as well as validating “secondary readiness” data. Invaluable feedback for progress tracking includes predictions and chances graphs to external examination as well as a full progress reporting system, currently based on value-added. CEM assessment data can be fully integrated into schools’ information management systems for analysis purposes, and can be used by teachers and leaders to inform school planning, monitoring and for evaluating school effectiveness.

How can CEM data help schools with progress measures and provide standardisation with reference to benchmarking?
As secondary schools move from the five A* to C benchmark performance measure to Progress 8 and average point score (APS), CEM assessments can provide crucial evidence to inform tracking and monitoring student progress. As new accountability measures will assess students on their progress relative to their starting points, schools will need reliable baseline data for accurate progress monitoring. MidYIS can provide an accurate and stable alternative or addition to the new end of key stage 2 secondary readiness measures. In the absence of key stage 3 national standardised assessments, INSIGHT tests can deliver useful data for progress tracking in core subjects with reference to national norms and inform curriculum planning, including qualification choices at 14+. Since ‘progress’ is key to the new accountability measures system, schools will need to develop robust evidence for demonstrating progress, which can be supported by the standardised CEM assessment data. All CEM assessment feedback delivers standardised data and, in case of MidYIS, an average student score is 100. This standardisation can be used by school leaders as an extra validation for progress tracking and provides a national benchmark for identifying the ability levels of particular cohorts of students, as well as individual students. As the tests are designed to measure a ‘typical’ student performance, the data informs teachers about the required level of preparation for external examination. Also, benchmarking pupils’ performance with others of the same age can assist school leaders with the evaluation of school’s teaching and learning or particular interventions, as well as with reporting to parents and inspectors.

How the feedback data can be used to inform target-setting?
Feedback from CEM secondary school assessments can support target-setting at individual and cohort level, including targets for specific subject areas, and can provide performance indicators for Post 16 education. In the absence of levels, CEM data can provide reliable baseline information for setting minimum individual and group targets in different subject areas. This information can be used by subject teachers for monitoring individual attainment and for triangulation purposes with other teacher assessment data. It can be also useful for tutors for monitoring student effort in meeting their minimum targets, and for providing basis for informed teacher-student learning dialogues. The predictive nature of the assessments can assist with curriculum planning and target-setting for whole cohorts against school expectations or national accountability measures. For reporting, monitoring and accountability purposes in the absence of levels, information about likely examination performance can assist with on-track monitoring and with individual and cohort position regarding meeting expected targets. Target predictions are a useful tool in informing teachers about setting appropriate challenge at student and class level, and, at whole school level, can contribute to evaluating the effectiveness of teaching and learning.

To what extent CEM data can be used for reporting purposes?
Comprehensive feedback from CEM assessments, which includes predictions and chances graphs related to external examinations as well as a full value-added reporting system, is a reliable way of communicating progress to parents and other stakeholders, often providing external validation of school assessment data. Parental feedback indicates that parents value assessment feedback that pinpoints their child position in comparison with other students or national standards. Indeed, one of the reason for removing national curriculum levels is that parents found levels confusing as they attached an abstract number to particular attainment without identifying students’ strength or weaknesses. Since CEM assessment data is standardised against a nationally representative sample of schools and the feedback includes the percentile band into which the student’s score falls and identifies into which ability band (A – D) the student’s score belongs, parents can be reliably informed about their child’s ability profile. This type of reporting helps with setting future targets and Individual Pupil Record Sheets (IPRS) provide an accurate record which summarises all the baseline information for a particular student on one sheet. Easy access to data manipulation and analysis can help senior leaders with the analysis of predicted performance for particular cohorts or groups of students. This extra layer of evidence for pupil progress and predictions based on ability profiles provides substantiation regarding school effectiveness when reporting to school inspectors. This is a particularly useful evidence in the absence of levels, where schools are expected to provide reliable data for accountability purposes and demonstrate year-on-year progress between key stage 2 and end of key stage 4 qualifications. CEM assessment data can also support evidence for the effectiveness of school interventions and can provide evidence for reporting pupil achievement by comparisons with different groups of students in the school and nationally.

How can CEM tests help with screening for SEN, EAL and More Able Pupils?
The diagnostic nature of CEM assessments provides data for early identification of special education or EAL needs that can be a barrier to learning. On the other end of the spectrum, early identification of pupils who are particularly able, Gifted & Talented, can assist with curriculum planning and inform teaching and learning to a greater degree, where challenge can be more effectively matched to students’ skills and abilities. Early identification of specific learning needs is crucial to providing intervention at an appropriate level and preventing failure at a later stage. The data from subsequent assessments can be used to evaluate school intervention.

How can feedback from CEM secondary assessments assist school leadership with accountability measures and school improvement?
MidYIS, INSIGHT, Yellis and Alis/CEM IBE standardised assessment data can be used to support effective school self-evaluation and promote school improvement through identifying school’s strengths and weaknesses, and by reference to national benchmarking. CEM feedback can also facilitate monitoring of standards over time, where statistical process control charts show yearly progress measures against statistical significance boundaries. In the absence of levels and no common benchmarking at key stage 3, schools need to ensure that their assessment frameworks provide reliable data for demonstrating students’ progress over time and attainment relative to their baseline on entry. Therefore there is a need for schools to develop systems for tracking student progress in order to present data in support of self-evaluation statements about the progress made by students. Although Ofsted do not have any predetermined view as to what specific system schools should use, inspectors’ main interest is whether the approach adopted by the school is effective in measuring what progress pupils are making and how this relates to their expected level of progress. In order to assist with reliable evidence for demonstrating students’ progress over time, one of the key indicators of school effectiveness, INSIGHT assessments can provide value-added measures of progress over time as compared against pupils of similar abilities in other schools. The feedback from these tests can also show progress from MidYIS tests (progress at key stage 3) and can give predicted grades at GCSE level in a wide range of subjects which are invaluable pieces of data for school leaders with regard to external validation of the effectiveness of teaching and learning, and can assist with curriculum and improvement planning.
Regarding accountability measures, from September 2016, schools will be required to provide information via a standard ‘snapshot’ version on the school website and performance tables giving more detailed information, including access to data of interest to Ofsted, parents and other interested parties. In order to provide accurate and reliable information for the new accountability measures, CEM secondary school assessment data can assist school leaders with robust evidence for pupil progress and the standardised pupil scores for reading, maths and science enable school leaders to make comparisons between students and classes for monitoring, planning and evaluating purposes. School leaders can also benefit from PARIS software which is designed to provide detailed assessment data analysis and produce reports or value added information for cohorts of students to help with progress monitoring and GCSE predictions. This type of data analysis can be also very useful for validating school processes and inspection evidence.
In one of the schools, senior leaders used MidIYS data to monitor teaching and learning and adjusted staffing where the data demonstrated poor cohort progress in a subject area with long-term teacher absence covered by non-specialist staff. In this case, the intervention resulted in recruiting a specialist teacher to cover the absence for improved progress.