Some Thoughts on Selecting IDEA Objectives
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
Handout 1 Some Thoughts on Selecting IDEA Objectives ( A u g u s t 2 0 0 2 How do we know that teaching is effective or HOW MANY OBJECTIVES SHOULD BE ineffective? The typical student rating system SELECTED? judges effectiveness by the degree to which the Although each of the 12 IDEA objectives is instructor’s methods resemble those of a ―model‖ desirable in the abstract, it is unrealistic to think teacher. In contrast, the IDEA Student Ratings of that, in a single course, students can make Instruction system judges the effectiveness of significant progress on all, or even most, of them. teaching by its impact on students. Its chief Not everything that either the instructor or the indicators of effectiveness are derived by students might wish to accomplish is possible in a answering one question: Do students make single course. Section II of the Directions to progress in achieving objectives selected by the Faculty provides a classification of the 12 instructor? objectives that is intended to help you conceptualize your instructional intentions. The selection of objectives on the Faculty Information Form is a crucial activity for two The teaching methods that facilitate student reasons. First, the IDEA System evaluates progress vary for the different objectives. For this teaching by assessing student progress on these reason, and because of the limited amount of time unique, instructor-chosen objectives. Second, available in a given course, most instructors will objectives provide guidance for selecting teaching be unable to address seriously more than three methods; those that promote progress on one type to five objectives. Those choosing more than five of objective may differ from those that promote objectives commonly spread their efforts too thinly progress on other types. Differential objectives to impact student learning significantly in all areas. make each course a unique learning experience. In selecting "Essential" or "Important" objectives The educational literature is replete with for a particular course, ask three questions: suggestions on how to select and develop goals 1. Is this a significant part of the course? and objectives (e.g., Angelo & Cross, 1993; Davis, 2. Do I do something specific to help the 1993; McKeachie, 1999; Walvoord & Anderson, students accomplish this objective? 1998). Familiarity with this literature should 3. Does the student's progress on this improve the process of conceptualizing and objective affect his or her grade? defining instructional purposes. The purpose of this paper is to offer additional help to participants If the answer to each of these questions is "Yes," in the IDEA System in identifying course then that objective should be identified as E or I on objectives. the Faculty Information Form (FIF). The phrase, "Of no more than minor importance," does not Although objectives can be stated in a variety of mean that such objectives are unimportant. It ways, they should always focus on expected simply recognizes that such objectives are of effects on students, not on the instructor’s actions considerably less importance than those chosen or procedures designed to promote learning. It is as E or I; even if some attention is given to them, desirable for each instructor to develop statements an M should be selected on the FIF. or objectives as precisely and comprehensively as possible. In order to participate effectively in the IDEA program, it will be necessary to interpret WHAT IS MEANT BY EACH IDEA OBJECTIVE? these statements within the framework provided by It would be easier to describe objectives if they the 12 objectives listed on the Faculty Information were mutually exclusive, but they are not. Form. The following discussion is intended to help Instructors typically address more than one users differentiate meaningfully and accurately objective through a single approach. For example, among the 12 objectives of the IDEA System. a theme on ―the meaning of happiness‖ may be assigned to address three objectives; developing writing skills, exploring values, and improving 1
critical thinking. The 12 IDEA objectives have been theories are Gresham's law, the categorical developed over a period of 25 years, both through imperative, and the wave and quantum theories of literature reviews and by consulting faculty who light. Objectives concerned with understanding have used the IDEA system. The intent is to concepts and theories are representative of the provide a useful, practical way to describe the "Comprehension" level of Bloom's cognitive objectives of most college courses. taxonomy. A brief description of each of these objectives, A primary distinction between factual knowledge together with some comments about how they and principles and theories objectives is the may be compared or contrasted, follows. The degree of generalization expected. To learn a fact, objectives are organized into six groups on the the student need not go beyond the fact itself; but basis of statistical and conceptual similarities. The to comprehend principles and theories the student number used to identify each objective (1-12) must extend his/her understanding to multiple corresponds with that used on the Faculty circumstances or examples. This is not meant to Information Form. imply that the learning or memorization of facts is unimportant. A strong factual basis is essential to I. Basic Cognitive Background the mastery of principles and theories and other The first two IDEA objectives focus on the "higher level" intellectual skills; students cannot development of a basic background in the subject. learn to think unless they have something to think 1. Gaining factual knowledge (terminology, about. For academically naive students, gaining classifications, methods, trends) factual knowledge is often an essential first step. 2. Learning fundamental principles, On the other hand, if teaching/learning never goes generalizations, or theories beyond this level, the student will acquire a body of unused--perhaps trivial--knowledge that tends to These objectives are mainly cognitive in nature as be quickly forgotten. distinguished from affective objectives, which focus on feelings or attitudes. They are closely II. Application of Learning related. Both are concerned with the acquisition of Two other objectives focus on applying what has information or knowledge. They differ primarily in been learned to solve problems, make decisions, the level of knowledge and in the degree of or perform specialized functions. These are: generalization. Factual knowledge covers not only 3. Learning to apply course materials (to improve straightforward facts (e. g., when the Declaration rational thinking, problem solving and decisions) of Independence was written; who developed the 4. Developing specific skills, competencies and theory of games), but also terminology (e. g.. what points of view needed by professionals in the the VII cranial nerve is called; or what field most closely related to this course ―onomatopoeia‖ means) and classifications (e. g. stone tools produced by the Mousterian The first of these emphasizes applications of techniques are characterized by . . .). This principles, theories, and concepts to solve a objective stresses learning at its most basic level. problem or arrive at a decision. Course materials Frequently what is required is that students are employed to develop this general intellectual memorize and remember the information taught; skill. It is appropriate in courses where applications because the emphasis is on acquiring information, are intended to develop problem-solving skills-- comprehension is not an issue. For those familiar analysis, synthesis, and evaluation. Decision- with Bloom's Taxonomy making represents the last stage of this process. It (Bloom, et al., 1956) such learning is primarily at should be noted that the effective implementation the "Knowledge" level of the cognitive taxonomy. of decisions may require additional affective or interpersonal skills depicted by Objective 5, Team Though they are similar, it is possible to Skills or Objective 8, Communication Skills. distinguish factual knowledge objectives from principles and theories objectives. There is a Sometimes instructors choose this objective difference between terms that represent simple because their course requires that students apply facts, e.g., the VII cranial nerve is the auditory course material as a means of testing their nerve, and those that represent concepts, e.g., understanding. In such cases Objective 2, reinforcement, a psychological concept that is a Principles and Theories, is probably a more key element in learning theory. Learning the appropriate choice. In other courses, application is meaning of "auditory nerve" essentially requires employed principally to develop professional skills, memorization, while learning the meaning of and Objective 4 (Professional Skills and ―reinforcement‖ requires comprehension, which Viewpoints) should therefore be chosen. Only in embraces many examples. Illustrative principles or courses where a primary goal is to develop a 2
generalized skill in applying course materials to courses. It may also be relevant to other courses concerns or problems should Objective 3 be that use a new language (e.g., mathematics, selected as "Essential" or "Important." statistics, computer science), but Objectives 1 (Factual Knowledge), 2 (Principles and Theories), Objective 4 emphasizes the development of skills and 3 (Applications to Thinking and Problem or attitudes needed by those entering a specific Solving) may be more descriptive of the purpose profession (e. g., calculating physical stresses, of such courses. Effective communication is an developing diagnostic skills, understanding and appropriate objective for any course designed to accepting a code of professional ethics). Such promote clear, grammatically correct writing and/or skills and attitudes should be reflected in the listening and speaking skills. However, if the performance of a professional assignment, not objective is chosen as ―Essential‖ or ―Important,‖ it simply by knowing a ―correct‖ answer. Depending is not enough to simply provide opportunities to upon the degree of complexity, this objective could exercise communication skills; there must also be represent any of several levels in Bloom's deliberate attempts to improve these skills. cognitive taxonomy—―Application,‖ "Analysis," "Synthesis," and "Evaluation." The attitudinal IV. Intellectual Development component is represented in the affective domain Three objectives emphasize higher-level of Bloom’s taxonomy (Krathwohl, et al., 1964). intellectual skills: 7. Gaining a broader understanding and III. Expressiveness. appreciation of intellectual-cultural activity Two objectives focus on learning to express one’s (music, science, literature, etc.) individuality: 10. Developing a clearer understanding of, and 6. Developing creative capacities (writing, commitment to, personal values. inventing, designing, performing in art, music 11. Learning to analyze and critically evaluate drama, etc.) ideas, arguments, and points of view. 8. Developing skills in expressing oneself orally or in writing Being ―intellectually well-balanced‖ has traditionally been regarded as a sign of an Creativity connotes originality, imagination, and educated person, especially by advocates of the expressiveness. While it is often associated with liberal arts. For many years, colleges and the fine arts and literature, it is often relevant to universities offered broad survey courses to give aspects of science, engineering, and other fields their students opportunities to become acquainted where design, research, and innovation are with the content, methods, and importance of the required. The instructional challenge is to help physical and biological sciences, the social students to develop their creative potential. sciences, the fine arts, and the humanities. While "Creativity" requires flexibility and divergence in the popularity of such courses has declined, the thinking – new ways of thinking or expressing commitment to the ideal of providing a basic oneself; pursuing questions for which there is no understanding of, and appreciation for, the broad single correct answer. It implies a stretching and divisions of knowledge has been an enduring expansion of the students' thoughts and ideas and tradition. "Understanding" is often simply the the development of original insights. For these means to an end. By learning to "appreciate,‖ reasons, it often requires overcoming fear and students broaden the range of activities that can encouraging self-confidence. be interesting and rewarding to them; at the same time, they become more ―interesting‖ people Creative capacities are important not only in the themselves. The enthusiasm of teachers who are humanities, but also in science, technology, social immersed in and enthralled with their intellectual- sciences, and many professional courses cultural specialty often spreads to their students. (business, education, law, etc.). The development This objective should be selected as important or of creative capacities is expected more often in essential if the focus of the course is on upper division courses than in lower division broadening intellectual background and increasing courses. For this (or any other) objective to be the breadth of students’ interests and classified as ―Essential‖ or ―Important,‖ it should be appreciations. Such courses are usually directed a significant emphasis in the course and there to non-majors, although they may serve as should be specific instruction or assignments introductory courses for majors as well. designed to promote its development. Objective 10 focuses on the exploration of Objective 8 stresses communication skills. It is personal values and the beliefs and priorities that obviously relevant to composition and speech guide the way one’s life is conducted. They courses, as well as to many language and writing ―explain‖ why we make the choices we do; they 3
describe our conclusions about life’s purposes and courses intended for majors will give some what life’s greatest satisfactions are. Many people emphasis to its development. But because it is have not developed a coherent set of personal also a distinguishing characteristic of the educated values; their life decisions seem to be made by person, those teaching courses intended to default, or by following the norms of their culture support an institution's general education program (conforming to societal expectations). Such people will also find this objective relevant to their pursue goals that have been imposed, not chosen; purposes. for this reason, they have difficulty in finding lasting satisfaction. Except for selected moral V. Lifelong Learning values, there is no consensus about the values Two objectives are concerned with the that ―ought‖ to guide our lives. In fact, the values development of skills helpful in the continual society places on ―liberty‖ and ―individuality‖ pursuit of learning after the formal educational ensure that diverse value patterns are necessary experiences are over. in order to accommodate the wide differences in 9. Learning how to find and use resources for individuals and their circumstances. Still, the answering questions or solving problems. opportunity to lead a personally meaningful, 12. Acquiring an interest in learning more by fulfilling, and satisfying life is enhanced if it is asking questions and seeking answers. guided by thoughtfully chosen, enduring values, regardless of the particular values which are Educators have increasingly become aware of adopted. how quickly knowledge becomes obsolete. We live in a technological, information-based society; Some college courses offer students the effective functioning in this society requires opportunity to explore alternative value systems as continually updating and enlarging knowledge and a means of facilitating this process. Although such skills--lifelong learning. In recognition of this courses usually are oriented around disciplinary reality, many faculty members design courses to content, their true subject matter is the student. If enhance students’ capacities to function as the emphasis is on stimulating a consideration of independent learners. Objective 9 should be alternative goals and life styles, on differentiating chosen as ―Important‖ or ―Essential‖ for courses the basic from the superficial, and on assuming that emphasize the development of independent personal responsibility for life choices, then this learning skills. The emphasis is on skills in finding objective should be considered as important or and using appropriate learning resources, essential. including traditional library searches as well as computer-based information and information Objective 11, critical analysis, deals with one of shared by practitioners and consultants. This the most distinguishing characteristics of the objective is especially appropriate for courses in educated person – discernment. Children accept which students have already acquired sufficient nearly everything that they are told. But as they background information and skill to permit them to mature, contradictions become apparent; not identify the trends or unresolved problems that are everything can be equally true or valid. Educated likely to form the basis for future advances in the persons learn to critically examine information, field. ideas, and arguments in order to arrive at their own understanding or point of view. Improving the Objective 12 also focuses on lifelong learning. capacity for critical thought, a high level cognitive Whereas Objective 9 emphasizes capacities for characteristic, is regarded as a desirable, but locating and using resources, Objective 12 challenging, objective in higher education. stresses developing capacities for identifying Instructors choosing this as an important or salient questions. Finding answers to the wrong essential objective will be less concerned with questions will not improve understanding, problem subject matter mastery or the ability to apply such solving, or decision-making. This objective knowledge to the solution of practical problems involves a fundamental, and often over-looked, than with the capacity to reason logically and the aspect of learning, extending far beyond ability to integrate a series of disparate facts or knowledge of how to use library resources or assertions into a coherent conclusion. Assessment browse the Web. It requires a simulation of the of student progress will stress logical consistency personal and professional challenges graduates and complexity of reasoning rather than will face – challenges whose solution rests both on "correctness." asking the right questions and on finding the right answers. While this objective is frequently cited as The ability to critically evaluate and reason is a one of the purposes of general education, all valuable trait in nearly every line of employment; faculty members who want the success of their therefore, it is expected that many upper division teaching to be judged by the degree to which 4
students acquire an ―inquiring mind‖ should select Frequently, there are differences between the it as ―important‖ or ―essential.‖ instructor's and the students' perception of the relevance of a given objective. It is recommended VI. Team Skills that the course objectives be discussed with the Objective 5 overlaps from the objectives just students, preferably early in the term. It is reviewed. For this reason, it is classified desirable to let students know that they are going separately. to be asked to rate their own progress on these 5. Acquiring skills in working with others as a objectives, and that these ratings are taken member of a team. seriously. Ask them to reflect on their understanding of the course’s purposes and the From feedback provided by employers, community way in which they believe the various parts of the leaders, and alumni, institutions have increasingly course fit into each of the 12 objectives. Student recognized the importance of this objective. Its learning will be enhanced if they are committed to emphasis is on combining the knowledge and clearly formulated objectives. Thus, the skills of a diverse group in ways that enhance its opportunity to consider the relevance of the IDEA capacity to analyze and propose solutions to objectives to their own purposes in taking your assigned problems. The development of team course may, in itself, stimulate success. If student skills involves a complex set of attributes, including perceptions of the importance of the objectives capacities for accepting and appreciating human and their relevance to various portions of the diversity, for listening, for communicating, for course are substantially different from yours, it compromising, and for sharing responsibility in may be helpful to explain your rationale for developing creative proposals and selecting (or not selecting) a given objective. A recommendations. Instructors who emphasize the discussion of such differences will not necessarily development of team skills will note the overlap resolve them, but it will provide a framework for with several other objectives included on the IDEA interpreting student ratings of progress on the list, including Objective 8 Communication Skills, IDEA objectives. This should increase the Objective 3 Applications for Problem Solving, and usefulness of student feedback. Objective 6 Creative Capacities. If the expectation is that all of these skills will be developed, together Based on interviews with a small number of with skills involving effective interpersonal students, we do not believe that holding such a relationships, then this objective should be discussion before the students fill out the IDEA identified as ―Important‖ or ―Essential.‖ Faculty Survey Form will bias results. Students claim that members who establish student teams or their report of progress on objectives is subgroups for more limited purposes, such as uninfluenced by the knowledge that the instructor learning communication skills or developing selected the objective as relevant. However, interpersonal sensitivities, should select less progress is more likely if students and faculty are complex objectives when completing the FIF. agreed on the major purposes of the course. Hence, a discussion of such purposes will not only improve the quality of responses to the IDEA form CONCLUSION but also be beneficial to the learning process. Hopefully, this discussion will help you select IDEA objectives for your courses. To summarize, there are three criteria that are useful in selecting objectives: (1) The objective is a significant part of the course; (2) Specific and substantive techniques and assignments are employed to help the student achieve the objective; and (3) Relevant assessments are made of student achievement of the objective. Objectives should not be regarded as important unless a substantial and explicit effort on the part of the instructor is directed to the achievement of that objective and unless achievement on the objective is meaningfully reflected in the appraisal of student progress. 5
REFERENCES and READINGS ON TEACHING Institutional Performance. San Francisco: IMPROVEMENT Jossey-Bass. Angelo, T. A., & Cross, K. P. (1993). Classroom assessment techniques: A handbook for college Cashin, W. E. (1989). Defining and evaluating teachers (2nd ed.). San Francisco: Jossey- college teaching. IDEA Paper No. 21. Bass. Manhattan, KS: Kansas State University, Center for Faculty Evaluation and Bloom, B. S., Engelhart, M. D., Furst, E. J., Hill, W. Development. (ERIC Document Reproduction H., & Krathwohl, D. R. (1956). Taxonomy of Service No. ED 339 731). educational objectives: Handbook I, the cognitive domain. New York: David McKay. Cashin, W. E. (1990). Student ratings of teaching: Recommendations for use. IDEA Paper No. 22. Davis, B. G. (1993). Tools for Teaching. San Manhattan, KS: Kansas State University, Francisco: Jossey-Bass. Center for Faculty Evaluation and Development. (ERIC Document Reproduction Krathwohl, D. R., Bloom, B. S., & Masia, B. B. Service No. ED 339 732). (1964). Taxonomy of educational objectives: Handbook II, the affective domain. New York: Cashin, W. E. (1996). Developing an effective David McKay. faculty evaluation system. IDEA Paper No. 33. Manhattan, KS: Kansas State University, McKeachie, W. J. (1999, tenth edition). Teaching Center for Faculty Evaluation and Tips. Lexington, MA: D.C. Heath and Company. Development. Walvoord, B. E., & Anderson, V. J. (1998). Centra, J. A. (1993). Reflective Faculty Evaluation: Effective Grading: A Tool for Learning and Enhancing Teaching and Determining Faculty Assessment. San Francisco: Jossey-Bass. Effectiveness. San Francisco: Jossey-Bass. Hoyt, D.P. and Pallett, W. P. (1999). Appraising READINGS ON FACULTY EVALUATION Teaching Effectiveness: Beyond Student Arreola, R. A. (2000, second edition). Developing Ratings. IDEA Paper No. 36. The IDEA Center: a Comprehensive Faculty Evaluation System: A Manhattan, KS. Handbook for College Faculty and Administrators on Designing and Operating a Seldin, Peter (1999). Changing Practices in Comprehensive Faculty Evaluation System. Evaluating Teaching: A Practical Guide to Bolton, MA: Anker Publishing. Improved Faculty Performance and Promotion/Tenure Decisions. Bolton, MA: Braskamp, L. A. & Ory, J. C. (1994). Assessing Anker Publishing. Faculty Work: Enhancing Individual and © 2006 The IDEA Center 6
You can also read