Introduction
Back: Preface Table of Contents Next: School System Policies

A. Effective Schools and Effective School Practices

Research on effective schools and school practices has clearly demonstrated that schools and school systems can become more effective. The literature describing the research defines effectiveness as:

  • Having high achievement among all student groups,
  • Having high student and staff attendance,
  • Having high employee and student satisfaction, and
  • Having high public confidence in schools.

Effective schools also "add value" to the performance levels of students: The level of student performance increases uniformly the longer students are in school.

The top 15-20 percent of the student population in each performance and demographic category achieves effectiveness levels. In statistical terms, effectiveness levels are those levels achieved at one standard deviation above the mean of the cohort population and are, therefore, rigorous levels of achievement.

When the following practices and objectives are implemented in a school system, the probability increases that the school system will be effective in all areas. These "Correlates of Effectiveness" include:

  1. Strong instructional leadership provided by the principal.
  2. A comprehensive curriculum¾ emphasis on learning objectives, learning activities, and appropriate achievement measures.
  3. Measurement¾ regular monitoring of student achievement and staff/student attendance.
  4. A safe, orderly, disciplined, and supportive school climate.
  5. High expectations for quality work supported by staff and students.

Effective schools and school systems practice behaviors associated with the conditions (correlates) of effectiveness. More importantly, however, these behaviors are understood, are supported, are practiced, and are observable throughout a school system. Such behaviors can be established through effective school training programs and then adapted to each school system environment. It should be clearly understood that conditions for effectiveness are achieved through the decisions made by adults in the school community and are fully under their direction and control. To this end, effective schools and school systems forge extensive and positive linkages between communities and schools.

B. The Cohort Group
The Process of Matching “Means” Fair Comparisons

An Audit of Educational Effectiveness examines the degree to which the student and staff populations in a school district meet levels of effectiveness. Each school district population is examined against populations nationwide with similar demographics, some of which are currently achieving educational effectiveness and which have firmly established the conditions of effectiveness. The SchoolMatch approach compares student populations rather than school systems in order to provide more fair, accurate, and comprehensive cohort comparisons.

SchoolMatch maintains databases on each of the nation's 15,800 operating public school systems and more than 14,000 accredited private schools. From the SchoolMatch database of public school populations, other student and staff populations in the United States with similar demographic characteristics to the population in the Elmwood Park CUSD 401 were identified. This large group is the Elmwood Park CUSD 401 cohort group.

Within the Elmwood Park CUSD 401 cohort group exist similar populations which have achieved effectiveness in one or more of the areas analyzed by an Audit of Educational Effectiveness (approximately 15-20% of the entire population). Also within the cohort group are student populations which perform at or below the average (mean) for the entire group, in a given category (approximately 15-20% of the population). In order to form the basis for comparison with these demographically similar populations, SchoolMatch calculates the average (mean) performance level for the cohort group in every category analyzed in the audit process. This demographically-matched set of populations (the cohort group) can be described in terms of the average (mean) in each performance area. As a result, we may refer to the cohort group as the mean-matched group.

Once the averages in each measurable category are calculated, the cohort group is then mean-matched. Once the mean for each category is determined, the effectiveness level (one standard deviation above the mean) can be calculated.

The following graph illustrates the distribution of school district student populations within a mean-matched cohort group in relationship to the cohort average in a given performance category:

C. The Audit of Educational Effectiveness Process

An educational effectiveness audit may include most or all of the following:

  1. An analysis of school system policies.
  2. An analysis of test data.
  3. An analysis of attendance data.
  4. An examination of dropout rates.
  5. An examination of Advanced Placement/honors classes.
  6. An analysis of the relationship between grades awarded and other student performance indicators.
  7. An examination of the curricula.
  8. An analysis of school improvement plans.
  9. An examination of the school district technology plan.

The audit also consists of other activities to obtain information about the effectiveness of practices and policies in the school district, including:

  1. Interviews with school district administrators, building administrators, teacher leaders, classroom teachers, students, and parents.
  2. Observations in a sample number of schools.
  3. Administration of perception surveys to a sample number of administrators, parents, and teachers.
  4. Examination of state, regional, and national source documents containing data relevant to the school system being examined.
  5. Examination of accreditation documents when appropriate.

D. Collection and Analysis of School District Data

Auditors use information obtained through various interviews to verify data gathered through data collection forms, documents reviewed before and during the on-site visit (Appendix A), and aggregated responses from perception surveys completed by a sample of parents, teachers and administrators. Professional judgments establish reliability. The continuing observations and analyses of educational researchers have established the validity of effective school practices and the ensuing benefits to school districts that use them. These research data are readily available.

E. The Purpose of an Audit of Educational Effectiveness

The central purpose of an educational effectiveness audit is to identify areas of school system operation or system results that are effective, as well as those areas that can and should be improved. This identification can serve as a basis for school system improvement and for the allocation of resources. Outside (SchoolMatch) auditors may also make recommendations based on the effectiveness of practices in school districts serving similar student populations.

In addition, the audit process and final report will assist the school system to:

  1. Examine school system leadership, structure, and policy development.
  2. Examine appropriateness of school system goals and objectives.
  3. Analyze pupil performance information and establish the degree to which schools are effective.
  4. Analyze the perceptions of parents, teachers, and administrators toward existing school practices and their overall effectiveness.
  5. Establish appropriate school improvement programs.
  6. Establish accountability structures to validate school improvement.

F. A Sample of Student Populations Demographically Similar to the Population of the Elmwood Park CUSD 401

Among student populations in the more than 15,800 public school systems in the United States, the school systems listed here share similar primary demographic characteristics in the categories of education level of school district residents, per capita income, and poverty level of the community. Secondary qualifiers include relative size of the student population and the percent of the student population qualifying for free or reduced-price lunch.

The districts listed below may not be identical to Elmwood Park CUSD 401 in all primary or secondary demographic categories. They represent the closest overall matches nationwide to the Elmwood Park student population. 

	NAME				CITY		STATE
1.	Montville School Distict	Oakdale		CT
2.	Blackstone-Millville		Blackstone	MA
3.	Gibraltar School District	Woodhaven	MI
4.	Burlington Twp.			Burlington	NJ
5.	Hillside Twp.			Hillside	NJ
6.	East Irondequoit CSD		Rochester	NY
7.	Coventry Local SD		Akron		OH
8.	Pottsgrove SD			Pottstown 	PA
9.	King George			King George	VA
10.	Lakewood			North Lakewood	WA

Please be aware that the above listed districts are not aware of their inclusion in this report. They have been selected from the SchoolMatch database. However, we believe that discussions between leaders of the school systems listed and leaders in the Elmwood Park CUSD 401 relative to effective school practices may provide information about how demographically similar school systems manage their resources in pursuit of effectiveness.

G. Levels of Achievement

There are four levels of achievement in effectiveness auditing:

  1. Basic: the minimum that will be accepted.
  2. Normative: achieved by the average of the group.
  3. Effective: levels achieved by the top 15-20 percent of a mean-matched group of student populations (one standard deviation above the mean).
  4. Absolute: levels achieved by only a few student populations. The achievement of 100 percent average daily attendance, for example, would be achievement of an absolute level.

Information related to various levels of achievement is provided in Appendix C. Although researchers differ widely on the meaning and use of test data, most agree that test data (or student performance assessments) are one important measurement of the degree to which schools and school systems are effective.