CORRELATES OF EFFECTIVENESS

The Educational Testing Service conducted surveys in 55 cities across the nation to measure dissatisfaction rates among school District constituents (See 10/27/99 Education Week, "ETS Analysis Tracks Parent Dissatisfaction."). Of the many important observations, one stands out:

Regular surveys of school District constituents are encouraged in order
to continue to garner strong community support.

The SchoolMatch Survey of Perceptions gauges the perceptions of three major school system constituents: administrators, teachers and parents. Survey questions are based on the Correlates of Effectiveness and specific related elements in the following areas:

  1. Strong instructional leadership
  2. A comprehensive curriculum with an emphasis on learning
  3. A positive school climate
  4. Regular monitoring of performance and attendance
  5. High expectations supported by staff and students

More information about the Correlates of Effectiveness and effective school practices may be found in the
Introduction, Part A of this report.

Data Collection:

Information related to the Correlates of Effectiveness is collected in two ways:

The data obtained are used to establish the degree to which the correlates are perceived by each group to be operating in the Exeter Region Cooperative District--SAU 16.

The questionnaire uses a scale of 1-4 to evaluate the various elements of an effectiveness correlate:

An average score of 2.0 or lower for an effectiveness correlate indicates that the correlate is perceived to be established in the school District. Correlates whose average is greater than 2.0 need attention. Likewise, individual elements within a particular correlate can be improved when behaviors associated with effectiveness correlates and their individual elements are established; that is, they are consistently displayed by school personnel. Values less than 2.0 show increasingly positive support, while values over 2.0 indicate declining support for an element or correlate.

Overview of Discussion

The discussion of perception survey results can take many forms. In some cases, auditors may consider variances among responses to individual elements, may comment on the most and least effective elements identified by each group, may identify patterns of agreement and disagreement, or may combine these, and other, approaches. In all cases, the form of the discussion is tailored to the unique variables and patterns within a particular school system.

In analyzing the perception survey data, it is important to look for significant differences and similarities in the aggregate group responses. Identification of such patterns offers school system leadership both pathways to improvement and opportunities to communicate the positive things happening in the District. The site visit team has identified some of the most significant findings related to each correlate of effectiveness.

For this report, SchoolMatch consultants searched for patterns of agreement that revealed the areas of greatest effectiveness and greatest concern for each of the five correlates. Areas of greatest effectiveness were indicated by the lowest mean scores given by each group to individual elements. Conversely, areas of greatest concern were indicated by the highest mean scores given by each group to individual elements. The discussions focus on those elements to which more than one group gave one of their lowest or highest mean scores, even when those scores meet or fall below the 2.0 level.

Please review the summary data presented on the pages following the discussion of results for each correlate in order to locate other patterns which may be helpful in enhancing that correlate within the District.

The following perception survey results were obtained from an analysis of all complete parent, teacher and administrator perception surveys received in the SchoolMatch offices.

A. LEADERSHIP

This factor supports clear efforts to improve school effectiveness and student learning. The district is well organized in support of student priorities when the perceptions meet the value of 2.0. Values less than 2.0 show increasingly positive support, while values over 2.0 indicate declining support for an element or correlate.

An analysis of the perception data for the LEADERSHIP correlate indicates that

the 2.0 level of effectiveness is met by administrators, but not parents or teachers. The results:

Observations:

Parents and teachers show strong agreement on this correlate and on most of the individual elements. Overall, administrators' perceptions of Leadership in the district are more positive than parents' and teachers'. Concerns of parents and teachers are in the areas of communication (elements B and C), instructional leadership (element E), frequency with which building administrators visit classrooms (element F), cohesive teamwork (element J), evaluation procedures to measure progress (element K), and decision-making (elements G and L). Although administrators' scores are all within the range of effectiveness, they give the highest mean score to element F, suggesting they perceive that building administrators do not visit classrooms as frequently as they might. Administrators also give one of the highest mean scores to element K, which may indicate some concern with evaluation procedures to measure school progress.

Taken together, the data on the Leadership correlate suggest the district should examine reasons for the negative perceptions held by parents and teachers. Building administrators would do well to visit classrooms more often to foster a sense of shared community and teamwork within the schools among all personnel. Such visibility may also assist in improving communication within the school system and community. Improved communication can lead to greater involvement of all constituents in decision-making processes that relate to student learning, as well as school evaluation, improvement and management.

Overall Patterns:

Parents and teachers perceive six elements not to be established in the district:

B: Clear and concise communication occurs throughout the school system.

E: The central administration provides instructional leadership.

F: The building administrators visit classrooms frequently.

G: The central administration involves faculty, parents and students in the decision-making process.

K: Schools have set up evaluation procedures to measure progress toward school goals.

L: Decisions are made after hearing from those affected; decisions are based on clear and reasonable criteria.

Parents further identify element C as not established:

C: The building administrators establish school objectives and communicate them to staff and community.

Teachers perceive element J not to be established (parent perceptions approach effectiveness on this element):

J: The district is effective in building cohesive teamwork among staff.

Areas of Greatest Effectiveness:

All groups agree element I is among the most effective areas of Leadership within the district:

I: The district has assembled a high-quality staff and utilizes personnel effectively throughout the school district.

Parents and teachers agree the following element is among the most effective:

D: The building administrators initiate professional development activities for teachers and staff members.

Parents and administrators agree element H is highly effective:

H: The central administration is consistent in carrying out school policy.

Areas of Greatest Concern:

All three groups agree that element F is among the least effective elements of Leadership:

F: The building administrators visit classrooms frequently.

Parents and teachers agree element B is in need of attention:

B: Clear and concise communication occurs throughout the school system.

Teachers and administrators identify element K among the least effective aspects of Leadership:

K: Schools have set up evaluation procedures to measure progress toward school goals.

 

 

INDICATORS OF SCHOOL EFFECTIVENESS: LEADERSHIP

This correlate reflects a clear effort on the part of school district leadership to support improvement

in effectiveness and student learning. A district is well-organized in support of student priorities

when perceptions meet, or fall below, the average of 2.0.

Parents

Teachers

Administrators

Mean scores by responding group:

2.174

2.179

1.740

A

Evidence exists of clear central planning and

organization with timelines

2.090

2.055

1.952

B

Clear and concise communication is practiced; open, functioning

channels exist throughout the school system.

2.350

2.370

1.900

C

The building administrators establish school objectives and

communicate them to staff and community.

2.230

1.937

1.842

D

The building administrators initiate professional

development activities.

1.956

2.008

1.789

E

The central administration provides instructional leadership.

2.132

2.320

1.600

F

The building administrators visit classrooms frequently.

2.427

2.694

2.059

G

The central administration involves faculty, parents and

students in the decision-making process.

2.442

2.336

1.778

H

The central administration is consistent in carrying out

school policy.

2.053

2.071

1.444

I

The district has assembled a high quality staff and

utilizes personnel effectively.

2.030

1.641

1.400

J

The district is effective in building cohesive teamwork

among staff.

2.087

2.228

1.700

K

School evaluation procedures to measure progress toward

school objectives are established.

2.145

2.341

1.941

L

Decisions are made after hearing from those affected; decisions

are based on clear and reasonable criteria.

2.289

2.320

1.824

M

The principal is visible, accessible.

2.073

2.024

1.375


B. EMPHASIS ON LEARNING

This factor indicates that the schools' main priority is the learning of students. Distractions and interruptions of instruction and learning are minimized when this correlate is met at the 2.0 level. Values less than 2.0 show increasingly positive support, while values over 2.0 indicate declining support for an element or correlate.

An analysis of the perception data for the EMPHASIS ON LEARNING correlate indicates that the 2.0 level is met by teachers and administrators, but not by parents. The values given to the correlate are:

Observations:

Overall, parents report more negative perceptions of the Emphasis on Learning than teachers or administrators. Parents' greatest concerns surround areas related to student learning and instruction (elements J, I, H and F), as well as professional development to improve teaching (element E) and recognition of student achievement (element B). Teachers and administrators share with parents concern about distractions and interruptions of classroom learning (element F). Among the greatest concerns of teachers and administrators is that the district does not provide sufficient access to computers and other technology for all students (element N). Parent perceptions of this element approach, but do not achieve, the effectiveness level. Furthermore, while teachers and administrators perceive the district to be highly effective in providing students with opportunities beyond minimum classroom requirements (element C), parents express the concern that the primary considerations in making decisions and resolving issues may not be the learning and interests of students (element I).

These data suggest that priority should be given to addressing the general concerns of all three groups regarding instruction and learning. This would include examining the effectiveness of classroom instruction (with focus on staff development, the frequency and reasons for interruptions and distractions, variety of teaching methods, and decision-making related to student learning), instructional materials (both resource allocation and accessibility, particularly of technology), and recognition of student achievement.

Overall Patterns:

Parents and teachers agree one element is not established in the district:

F: Distractions and interruptions of classroom learning activities are minimized.

Teachers and administrators identify an additional element they perceive not to be established:

N: The district provides students with computer access and makes special arrangements for children who do not have computers at home.

Parents identify five additional elements they perceive not to be effective:

B: The school has established formal procedures which operate throughout the school year to provide recognition for student achievement.

E: There is support throughout the school for professional development activities aimed at improving learning.

H: Teachers use a variety of instructional methods to motivate student learning and increase student participation in learning activities.

I: The primary considerations in the making of decisions and resolving of issues by staff are the learning and interests of students.

J: Instructional materials are given the highest priorities in the allocation of resources.

Areas of Greatest Effectiveness:

All groups agree element G is among the most effective aspects of the Emphasis on Learning in the district:

G: The school library is open during peak times of student availability.

Teachers and administrators agree element C is among the best established elements (parent perceptions approach effectiveness on this element):

C: The school provides students with opportunities for learning beyond minimum classroom requirements.

Areas of Greatest Concern:

Parents and teachers identify element J as being among the least effective elements of the Emphasis on Learning:

J: Instructional materials are given the highest priorities in the allocation of resources.

Parents and administrators agree element I is one of the least effective elements:

I: The primary considerations in the making of decisions and resolving of issues by staff are the learning and interests of students.

Teachers and administrators agree elements F and N are among the least effective:

F: Distractions and interruptions of classroom learning activities are minimized.
(Although not one of their three highest scores, parents perceive that this element is not established in the district.)

N: The district provides students with computer access and makes special arrangements for children who do not have computers at home.
(Parent perceptions approach effectiveness on this element.)

 

INDICATORS OF SCHOOL EFFECTIVENESS: EMPHASIS ON LEARNING

With this factor, it is clear through the allocation of resources, structure of the school, and rationale for decisions, that the school's

main priority is the learning of students. Distractions and interference of instruction and learning are minimized.

Parents

Teachers

Administrators

Mean scores by responding group:

2.100

1.875

1.817

A

Student achievement is continually given formal and

informal recognition.

2.000

1.825

1.737

B

The school has established formal procedures which operate

throughout the school year to provide recognition for student

achievement.

2.110

1.866

1.737

C

The school provides students with opportunities for

learning beyond minimum classroom requirements.

2.074

1.675

1.667

D

Instructional and other school activities focus on student

performance, responsibility, and skill development.

1.939

1.724

1.762

E

There is support throughout the school for professional

development activities aimed at improving teaching.

2.137

1.905

1.857

F

Distractions and interruptions of classroom learning

activities are minimized.

2.145

2.206

2.000

G

The school library is open during peak times of

student availability.

1.962

1.659

1.667

H

Teachers use a variety of instructional methods to motivate

student learning and increase student participation in

learning activities.

2.177

1.698

1.842

I

The primary considerations in the making of decisions and resolving

of issues by staff are the learning and interests of students.

2.243

1.976

2.000

J

Instructional materials are given highest priorities in the

allocation of resources.

2.427

2.041

1.813

K

Audio-visual material and equipment are available and utilized.

2.040

1.680

1.875

L

Instructional aides are utilized to support student learning.

2.042

1.967

1.857

M

The building administrators are visible, accessible.

2.056

1.911

1.500

N

The district provides students with computer access and makes

special arrangements for children who do not have computers

at home.

2.078

2.136

2.105


C. SCHOOL CLIMATE

This factor is manifest in student respect for the physical plant, strong parent involvement and positive staff and student morale. Values less than 2.0 show increasingly positive support, while values over 2.0 indicate declining support for an element or correlate.

An analysis of the perception data for the SCHOOL CLIMATE correlate indicates that the level of 2.0 is met by administrators; parents' and teachers' scores approach 2.0. The values given to the correlate are:

Observations:

An overall pattern of agreement exists among all the groups on the School Climate correlate. The greatest concern of parents, teachers and administrators is the apparent lack of parent volunteering and participation in school committees and functions (elements A and H). In addition, all groups report some degree of negative perception of teacher and student absences (element J) and the broad participation of student groups in school activities (element G).

All groups have more positive perceptions of student participation overall (element B); the apparent contradiction with perceptions on element G may result from a perception that many students take part in activities, but that some groups of students are not involved in many school functions, organizations or events. Positive perceptions also exist of the overall appearance of the schools (element E) and the image of the schools in the local media and community (element I).

The data suggest it would be worthwhile to establish focus groups consisting of parents, teachers, and administrators to examine the reasons for the perceived lack of parent involvement in school activities and functions. Improving communication channels and identifying a variety of strategies to encourage parent participation would be helpful. Increased parent participation may have a positive impact on student involvement and attendance, as well.

Overall Patterns:

All groups perceive one element not to be effective in the district:

H: There is wide parent participation in school committees and functions.

Parents and teachers agree that two additional elements are not established:

G: All student groups participate broadly in school activities.

J: Teacher and student absences are low.
(Administrator perceptions approach effectiveness on this element.)

Teachers and administrators agree one other element is not in place in the district:

A: Parent volunteers contribute widely in the functioning of the school.
(Parent perceptions approach effectiveness on this element.)

Areas of Greatest Effectiveness:

All groups agree element E is among the most effective aspects of School Climate:

E: Appearance of the campus is orderly and well maintained.

Parents and teachers identify elements B and I among the most effective:

B: A high level of student participation and attendance at school functions exists.

I: The school has a positive image in the local media and community.

Areas of Greatest Concern:

All groups agree elements H and J are among the least effective elements of School Climate in the district:

H: There is wide parent participation in school committees and functions.

J: Teacher and student absences are low.

Teachers and administrators agree element A is among the least effective:

A: Parent volunteers contribute widely in the functioning of the school.

INDICATORS OF SCHOOL EFFECTIVENESS:
SCHOOL CLIMATE

Students and parents should exhibit pride and loyalty to their school. The entire school community should possess a commitment to the school's goals. This quality is manifest in student respect for the physical plant, strong parent involvement, and positive staff and student morale.

Parents

Teachers

Administrators

Mean scores by responding group:

2.021

2.069

1.901

A

Parent volunteers contribute widely in the functioning of the school.

2.050

2.621

2.353

B

A high level of student participation and attendance at school functions exists.

1.891

1.857

1.947

C

Incidents of vandalism are minimal.

1.949

1.937

1.889

D

There is a high degree of cooperation
between building administrators and staff.

1.976

1.905

1.556

E

Appearance of the campus is orderly and well maintained.

1.912

1.843

1.650

F

There is acceptance of diverse student backgrounds.

1.990

2.024

1.722

G

All student groups participate broadly in school activities.

2.194

2.168

1.824

H

There is wide parent participation in school committees and functions.

2.228

2.344

2.353

I

The school has a positive image in the local media and community.

1.901

1.802

1.762

J

Teacher and student absences are low.

2.124

2.213

2.063


D. MONITORING STUDENT PROGRESS

This factor indicates that systematic procedures exist for measuring student achievement. Such procedures document achievement in specific areas, establish need for instructional improvement and develop priorities for the allocation of resources. Values less than 2.0 show increasingly positive support, while values over 2.0 indicate declining support for an element or correlate.

Analysis of the perception data for the MONITORING correlate indicates that the 2.0 level is not met by parents and teachers; administrators' score approach 2.0. The values given to the correlate are:

Observations:

One clear concern stands out in the survey results on the Monitoring Student Progress correlate: Parents, teachers and administrators perceive weaknesses in the use, collection and reporting of data (elements C, E, H). District leaders should consider a review of the comprehensiveness of student assessment, the use of student outcome data for planning purposes, and the effectiveness of the processes in place to collect and report data to the school community.

In addition, both parents and administrators show some concern over the criteria for assessment (element A). It may be that the district does not have a clear set of criteria, or that these criteria are not being communicated clearly throughout the district and to families.

Some disagreement exists regarding the provision of individual assistance to students throughout the day (element G). Teachers identify this element as one of the most effective, and parents perceive it as one of the least effective element of the Monitoring correlate. Reasons for this apparent discrepancy may relate to the lack of parent involvement perceived by all groups surveyed (see discussion of the School Climate correlate above); in other words, parents do not see the methods teachers employ with students on a day-to-day basis in the classroom. The discrepancy may also stem from a lack of a shared definition of what constitutes "individual assistance." In any case, it appears there may be a problem with communication between teachers and parents.

Overall Patterns:

All groups agree three elements of the Monitoring Student Progress correlate are not in place in the district:

C: Diagnostic and prescriptive evaluation procedures are implemented to monitor student progress.

E: Achievement tests in the varied subjects are utilized to determine student progress.

H: Data on student learning are regularly collected and reviewed with all members of the school community.

Parents and administrators identify an additional element they perceive to be ineffective:

A: Criteria for the assessment of learning gains are explicit; student knowledge and skills development are stressed.
(Teacher perceptions approach effectiveness on this element.)

Parents identify two additional elements they perceive as not being established:

F: Frequent communication occurs between special program teachers and teachers of regular classes and between counselors and teachers.
(Teacher perceptions approach effectiveness on this element.)

G: Teachers provide students with individual assistance throughout the day.
(Administrator perceptions approach effectiveness on this element.)

Areas of Greatest Effectiveness:

All groups agree that elements B and D are among the most effective element of Monitoring Student Progress in the district. It should be noted, however, that administrator perceptions approach, but do not achieve, effectiveness on element B; and teacher perceptions approach effectiveness on element D.:

B: Clear learning objectives exist throughout the curriculum

D: Attendance data are regularly reviewed, follow-up contacts made with families, and progress recorded.

Areas of Greatest Concern:

All groups agree that element H is among the least effective elements of this correlate:

H: Data on student learning are regularly collected and reviewed with all members of the school community.

Parents and teachers agree element C is among the least effective:

C: Diagnostic and prescriptive evaluation procedures are implemented to monitor student progress.

Teachers and administrators identify element E as one of the least effective:

E: Achievement tests in the varied subjects are utilized to determine student progress.

INDICATORS OF SCHOOL EFFECTIVENESS:
MONITORING STUDENT PROGRESS

This factor stipulates that systematic procedures exist for measuring the achievement of students across a wide spectrum of their learning experiences. Such procedures document the change in student achievement in specific areas, curriculum areas in need of improvement, priorities for the allocation of resources, and others.

Parents

Teachers

Administrators

Mean scores by responding group:

2.172

2.107

2.068

A

Criteria for the assessment of learning gains are explicit; student knowledge and skills development are stressed.

2.115

2.082

2.167

B

Clear learning objectives exist throughout the curriculum.

2.066

2.017

1.900

C

Diagnostic and prescriptive evaluation procedures are implemented to monitor student progress.

2.256

2.183

2.100

D

Attendance data are regularly reviewed, follow-up contacts made with families, and progress recorded.

2.000

2.025

1.882

E

Achievement tests in the varied subjects are utilized to determine student progress.

2.104

2.179

2.105

F

Frequent communication occurs between special program teachers and teachers of regular classes and between counselors and teachers.

2.176

2.041

1.833

G

Teachers provide students with individual assistance throughout the day.

2.244

1.879

2.050

H

Data on student learning are regularly collected and reviewed with all members of the school community.

2.429

2.468

2.563


E. HIGH EXPECTATIONS

This factor indicates the school staff is dedicated to having each student learn at the highest possible level. Challenging experiences are conducted to have students contribute their best work. Values less than 2.0 show increasingly positive support, while values over 2.0 indicate declining support for an element or correlate.

Analysis of the perception data for the HIGH EXPECTATIONS correlate indicates the 2.0 level is met by all three groups. The values given to the correlate by each group are:

Observations:

Overall, there are positive perceptions of the effectiveness of High Expectations in the district. There is some concern, however, regarding test scores on standardized tests (element I) and the rigor of classroom activities and materials (element G). It would be worthwhile to investigate and address the concerns in these areas, especially among parents.

Overall Patterns:

Parents report negative perceptions of element I:

I: Test scores on standardized tests exceed expected scores for comparable schools.

Areas of Greatest Effectiveness:

All agree elements B and D are among the most effective elements of the High Expectations correlate in the district:

B: Rules regarding attendance and promptness are made explicit in class.

D: Students are expected to be fully prepared for class.

Teachers and administrators agree element A is effective:

A: Teachers regularly require learning beyond the classroom, e.g., homework assignments.

Areas of Greatest Concern:

All groups identify element G as being among the least effective elements of this correlate. (It should be noted, however, that teachers' mean score is < 2.0; and parent and administrator perceptions approach effectiveness):

G: Classroom learning activities and materials are at a demanding cognitive level; e.g., materials require analysis, generalizations and evaluation over memorization and recall.

Parents and teachers identify element I among the least effective elements:

I: Test scores on standardized tests exceed expected scores for comparable schools.
(Teacher score is < 2.0, however.)

Parents and administrators identify element F among the least effective:

F: Students are actively engaged with learning activities throughout most of the class time.
(Teacher and administrator scores are </= 2.0.)

Teachers and administrators give highest mean scores to element C:

C: Rules regarding attendance and promptness are applied consistently in class.
(Scores for all groups <= 2.0.)

INDICATORS OF SCHOOL EFFECTIVENESS:
HIGH EXPECTATIONS

This factor stipulates that the school staff is dedicated to having each student reach

his/her potential in terms of learning and personal growth. Challenging experiences

are conducted to have each student reach this goal.

Parents

Teachers

Administrators

Mean scores by responding group:

1.867

1.723

1.858

A

Teachers regularly require learning beyond

the classroom, e.g., homework assignments.

1.703

1.488

1.684

B

Rules regarding attendance and promptness

are made explicit in class.

1.634

1.575

1.722

C

Rules regarding attendance and promptness

are applied consistently in class.

1.823

1.897

2.000

D

Students are expected to be fully prepared

for their classes.

1.673

1.591

1.611

E

During classroom instruction, teacher-student

interaction is the dominant instructional mode.

2.011

1.780

2.056

F

Students are actively engaged with learning

activities throughout most of the class time.

2.041

1.800

2.000

G

Classroom learning activities and materials are at a demanding cognitive level, e.g., materials require analysis, generalizations, and evaluation over memorization and recall.

2.052

1.854

2.053

H

Students are held responsible for missed work.

1.700

1.696

1.789

I

Test scores on standardized tests exceed

expected scores for comparable schools.

2.282

1.860

1.813


Previous Section: Criteria for Effectiveness Back to Table of contents Next Section: General Observations