Educational Assessment, Evaluation and Research

The selected works of Mary E. James

Mary E. James

• Publisher: Routledge
• Year: 2013
• ISBN:
  9781136654817
• Edition: 1
• Topic: Education
• Subtopic: Education General

In the World Library of Educationalists, international experts themselves compile career-long collections of what they judge to be their finest pieces extracts from books, key articles, salient research findings, major theoretical and practical contributions so the world can read them in a single manageable volume, allowing readers to follow th

Part I
Educational Evaluation for Innovation and Change

Chapter 1
School Self-Evaluation for the Improvement of Educational Practice

Some theoretical issues

James, M. (1982) ‘School Initiated Self-Evaluation and the Improvement of Educational Practice: some issues for consideration’. Classroom Action Research Network Bulletin, 5: 17–23.

Introduction

Self-evaluation of the kind that is initiated and conducted within schools by teachers seems to have emerged from two distinct historical contexts: the curriculum development movement in the early and mid-1970s, and increased pressure for public accountability subsequent to the Tyndale affair. In relation to the first, the apparent lack of success of many curriculum projects to ‘take’ in the schools generated such axioms as that of the Humanities Curriculum Project which declared: “no curriculum development within teacher development”. Thereafter some of the ideas and methods associated with the experimental and evaluation stages in national curriculum development projects were recognised as offering possibilities to individual schools and teachers seeking professional development and curriculum change in their particular situation. It is significant that many of those who have promoted the notion of school self-evaluation have also been prominently associated with national projects: Marten Shipman, John Elliott, Barry MacDonald and Helen Simons, for example. Although Lawrence Stenhouse rarely refers to self-evaluation, preferring the notion of the ‘teacher researcher’, many of the principles underlying his conception are similar to ‘self-evaluation’ insofar as they share a purpose directed towards teacher and curriculum development.

Self-evaluation has, however, acquired a second purpose in response to increasing political pressure to make education more accountable. It is argued that the process of self-evaluation can become the basis for schools and teachers to render public accounts of their work. The fact that writers who take this stance are often those who also advocate self-evaluation as a means to improvement in practice (e.g. MacDonald, 1978, Elliott, 1979a, 1979b, Simons 1979, 1981) tends to obscure the fact that these two purposes are in many ways distinct and often make different demands on teachers and schools. Whilst acknowledging that these two strands are very much interwoven in the literature, and conceptually related if one starts to analyse ‘professional’ concepts and models of accountability (see Sockett, 1980) my chief concern is to draw out some of the issues which need to be resolved if self-evaluation is to contribute to professional development and educational improvement. I can offer no ‘answers’ and I suspect that what is appropriate in one context might not be so in another. However I believe the enterprise is worthwhile because, what people generally want to know about any self-evaluation is what happened as a result i.e. what difference it made. What I am suggesting is that change is more likely to occur if certain questions concerning the relation of ‘means’ to ‘ends’ are considered beforehand.

Needs, purposes and strategies

Helen Simons (1981) advances three arguments in support of school self-evaluation. Significantly all are closely related to conceptions of professionality and accountability. Her main point is that the rationale for school self-evaluation lies in its potential to improve professional practice. As such it needs to become a routine procedure, initiated internally in response to the perceived needs of the institution. She believes that this approach is more likely to be sustained, to reflect the way schools really operate, and to preserve the autonomy of teachers. She does not deny the possibility of public accounts as ‘by-products’, but she believes that a self-evaluation procedure that responds merely to political pressures is likely to be half-hearted, ‘one-off’, distorting of reality, engendering defensiveness and hostility in teachers, and incapable of bringing about any genuine change.

Some support for Simons’ views can be found in the work of social scientists who have studied change in a number of organisational settings. For instance Benne, Bennis and Chin (1969) identified three broad categories of strategies for change which they termed power-coercive, normative-re-educative and empiricalrational. Power-coercive strategies are based on the intervention of those with legal authority to alter conditions. Since the commitment of participants will often be lacking, compliance or ‘surface change’ may be all that is achieved. Normative-reeducative strategies, on the other hand, involve either problem-solving concerned with ‘activating forces within the system to alter the system’, or the process of attitude change based on the study of one’s own behaviour. The third group of strategies called empirical-rational, has a largely intellectual appeal. Their influence depends on the effectiveness of an idea or practice being clearly demonstrated by research. Of these three groups of strategies the normative-re-educative category appears to have the greatest potential to bring about genuine improvement, because it is based on fundamental changes in attitudes, values and roles. Helen Simons’ emphasis on the need for self-evaluation to be initiated in response to internally perceived needs, and the importance she attaches to the disclosure of assumptions and values underlying current practices, suggest that she supports a normative-reeducative approach to effective change in schools.

Simons’ second argument is really a development of her first. If public accounts are to be required of schools then time is needed for teachers to acquire the skills necessary to produce such accounts (a point made also by MacDonald, 1978). It is a challenging but, initially at least, also a threatening exercise and pressure to do too much too soon may encourage ‘gilding the lily’. Unsure how the public will react, the temptation might be to present the best possible face, whether or not it accords with reality. Moreover, aspects of schools that seem to require remedial attention might well be ignored unless there exists some added incentive such as a definite promise of help in the form of extra resources. In other words schools are likely to be highly selective in what they choose to investigate for accounting purposes if they are uncertain how information will be used and if no obvious benefit is likely to accrue to them as a result. In the short term, therefore, Simons’ believes that self-evaluation should be encouraged without any reference to accountability demands, although, in the long term, the ‘process’ model she describes might provide the most valid alternative to many current models of accounting procedures. In her words: ‘Evaluation on process lines allows schools to demonstrate and account for what they can reasonably be held to be accountable for, i.e. creating the opportunities for children to learn and for the quality of provision’. This is her third argument in support of school self-evaluation. Apparently, therefore, Helen Simons’ justification for self-evaluation is predominantly educational and professional.

Hoyle (1980) also offers a professional rationale for self-evaluation in a reformulation of a distinction between ‘restricted’ and ‘extended’ professionality, which he first made in the early seventies. In the following extract he suggests that systematic self-evaluation may be a means to ‘extend’ professionality.

By restricted professionality I mean a professionality which is intuitive, classroom focussed, and based on experience rather than theory. The good restricted professional is sensitive to the development of individual pupils, an inventive teacher, and a skilful class manager. He is unencumbered with theory, is not given to compare his work with that of others, tends not to perceive his classroom activities in a broader context, and values his classroom autonomy. The extended professional, on the other hand, is concerned with locating his work with that of other teachers, evaluating his own work systematically, and collaborating with other teachers. Unlike the restricted professional, he is interested in theory and current educational developments. Hence he reads educational books and journals, becomes involved in various professional activities and is concerned to further his own professional development through in-service work. He sees teaching as a rational activity amenable to improvement on the basis of research and development.

(Hoyle, 1980, p. 49)

Stenhouse (1975), however, is critical of the restricted/extended dichotomy. In commenting on a previous formulation he points out that Hoyle’s ideal of the extended professional implies an unquestioning commitment to theory. He argues that such a position undermines the autonomy of the teacher because it invests theory with the status of ‘received wisdom’ to be accepted, rather than ‘provisional’ and open to experimental testing by the teacher in his or her own classroom. It is not altogether clear whether Hoyle is attempting to meet Stenhouse’s criticism in his more recent writing. In any case Stenhouse offers an alternative formulation of extended professionality – revealing that he does not entirely reject the notion:

. . . the outstanding characteristics of the extended professional is a capacity for autonomous professional self-development through systematic self-study, through the work of other teachers and through the testing of ideas by classroom research procedures.

(Stenhouse, 1975, p. 144)

Both Hoyle and Stenhouse tend to emphasise the development of individual teachers, while Simons focuses more particularly on the development of schools. However, nowhere in the current literature of self-evaluation, is the precise relationship between the professional development of individuals and the improvement of practice in institutions fully worked out. This leaves a number of questions unanswered. For instance, are we to assume that schools will automatically improve the quality of their educational provision, if all the individuals within them become fully developed professionals; or is an institution more than the sum of its parts? Are there special conditions to be satisfied and courses of action to be undertaken, for the purposes of institutional improvement, which are quite distinct from the processes associated with professional development? Indeed, are there occasions when individual and institutional development are in conflict? I am inclined to think that some conflict is quite likely, particularly when ‘development’ is associated with a concept of ‘career’. Individuals who are energetically engaged in their own professional development frequently envisage the pattern of their careers extending beyond the single institution; experience in a variety of settings may also be a requirement of full professional development. But if a whole staff is active in this way, and if one consequence is an increase in staff turnover, then the stability of the institution and hence its power to develop as a unit, may be seriously impaired. On the other hand if improvement of practice in the institution, as a whole, becomes the overriding goal then many of the professional needs of individuals may be ignored. However, to formulate the question as either institutional development or personal development would over-simplify a complex relationship, and it should be possible to establish conditions in which the professional development of individuals assists the development of the institution as a whole and vice versa.

While I cannot ignore the implications of the process for individuals, my concern, in this paper, is more with the institution. In this context, therefore, the prefix ‘self’ refers more particularly to the whole school or a significant part of it, such as a department. For this reason, and those outlined in the previous paragraph, it may be helpful to look at another notion developed by Hoyle: that concerning the ‘creativity of the school’. In an article discussing innovation in British schools (Hoyle, 1975) he argued that “institutionalisation has been a problem, since there has been a lag between innovations in curriculum, method and organisation of teaching/learning and necessary changes in what might be termed the ‘deep structure’ of the school.” (Hoyle, 1975, p. 343). Thus, if innovations are to become part of normal institutional practice much depends on the ‘creativity of the school’, that is, its capacity, as a social system, to adapt to and sustain change. According to Hoyle this may necessitate changes in a school’s ‘organisational character’, in particular, its authority structures, its decision-making procedures, its professional relationships, and even its pedagogical ‘code’ (e.g. from traditional/closed to progressive/open or flexible). Here we are faced with a dilemma because such changes in internal organisation are themselves major innovations. Where then is the ‘prime mover’? At the time of writing, the process of self-evaluation is, in most instances, in the category of innovation. Therefore, if Hoyle is right, whether or not it will be effectively institutionalised will significantly depend on the degree of creativity exhibited by the institution and, in particular, its willingness to change its internal organisation.

Levels of evaluation

In her article, Process Evaluation in Schools (1981), Simons emphasises the need to evaluate the school as a whole, or a policy issue which concerns the whole school. The case she makes for whole school evaluation rests principally on her assumption that school policy is an important area for inquiry. She also believes that self-study involving the whole, or a major part, of the institution will contribute to extending the professionality of the teacher group. (In this respect she seems to lend tacit support to Hoyle’s notion of the ‘creativity of the school’.) There is an ambiguity in Simons’ account however. When she writes of studying the school as a whole, she doesn’t make clear whether she means the ‘whole school’, in a literal sense, or some theme, aspect or issue which has ‘school- wide’ implications. The first would seem to me to be totally unmanageable in a single exercise although something approaching it might be achieved in a series of exercises over a number of years: a gradualist, incremental approach. (It is worth considering how ‘practical’, in these terms, are some of the LEA school evaluation schemes which are emerging at this time.) A related issue is whether school self-evaluation can be interpreted as more to do with efficiency (a managerial perspective) than effectiveness of teaching and the quality of learning (an educational perspective). Basically the question is whether self-evaluation at the level of the institution can constitute curriculum evaluation, that is (in the broad sense of ‘curriculum’), the evaluation of the total experience provided for the pupil or student by the school; or whether such exercises will inevitably become the evaluation of teachers (rather than teaching) and management procedures. Thus, when we refer to self-evaluation for institutional improvement we need to consider carefully the sense in which we understand the term ‘improvement’. So far I have assumed, like Helen Simons, that the purpose of institutional self-evaluation can be improvement of the quality of education in the institution as a whole. Other writers deny that self-evaluation operating at this level can have this effect.

Lawrence Stenhouse, for instance, insists that all well-founded curriculum development, and therefore the betterment of educational practice whether at the level of the individual teacher or the school, must be based on the study of classrooms (Stenhouse, 1975). This position is one that has been strongly supported by John Elliott who has argued that the focus of evaluation should be classrooms because this is where the most important educational transactions take place. Moreover, he has suggested that whole school evaluation can be developed on the basis of evaluation across individ...

Table of contents

• Cover
• Title
• Copyright
• Dedication
• Contents
• Acknowledgements
• Introduction
• PART 1 Educational evaluation for innovation and change
• PART 2 Educational assessment and learning
• PART 3 Educational research and the development of curriculum and pedagogy
• Bibliography
• Index