Support Professional Rhode Island Model Evaluation & Support System - Edition II

Page created by Shawn Mccarthy
 
CONTINUE READING
Support Professional Rhode Island Model Evaluation & Support System - Edition II
Support
                                  Professional
Rhode Island Model Evaluation & Support System

                                  Edition II
Support Professional Rhode Island Model Evaluation & Support System - Edition II
The contents of this guidebook were developed under a Race to the Top
grant from the Department of Education. However, those contents do not
necessarily represent the policy of the Department of Education, and you
      should not assume endorsement by the Federal Government.

                                                                           1
Table of Contents
Introduction.......................................................................................................................................... 3
System Overview ................................................................................................................................. 4
   Evaluation Criteria .............................................................................................................................. 4
   Performance Level Descriptors .......................................................................................................... 5
   Evaluation and Support Process ........................................................................................................ 6
Support and Development .................................................................................................................. 8
   Evaluation Conferences (Beginning/Middle/End) ................................................................................ 8
   Professional Growth Plans ................................................................................................................. 9
   Performance Improvement Plans ....................................................................................................... 9
Professional Practice ........................................................................................................................ 10
Professional Responsibilities ........................................................................................................... 11
   Assessing Professional Practice and Responsibilities ...................................................................... 12
Measures of Student Learning .......................................................................................................... 14
   Student Learning Objectives and Student Outcome Objectives ........................................................ 14
      Student Learning/Outcome Objective Decision Tree ..................................................................... 15
      The Student Learning/Outcome Process ...................................................................................... 16
      The Anatomy of Student Learning Objectives & Student Outcome Objectives .............................. 17
      Number and Scope of Student Learning/Outcome Objectives ...................................................... 20
      Baseline Data/Information............................................................................................................. 21
      Rigor of Target .............................................................................................................................. 22
      Quality of Evidence ....................................................................................................................... 23
      Approving Student Learning/Outcome Objectives ......................................................................... 25
      Reviewing Student Learning/Outcome Objectives at the Mid-Year Conference ............................ 25
      Scoring Individual Student Learning/Outcome Objectives ............................................................. 26
      Scoring Student Learning/Outcome Objective Sets ...................................................................... 28
   The Rhode Island Growth Model ...................................................................................................... 29
Calculating a Final Effectiveness Rating ......................................................................................... 30
   Appendix 1: Student Learning/Outcome Objective Scoring Lookup Tables ...................................... 35
   Appendix 2: Online Resources ......................................................................................................... 37
   Appendix 3: Support Professional – Professional Practice Rubric .................................................... 38
   Appendix 4: Support Professional - Professional Responsibilities Rubric ......................................... 55

                                                                                                                                                      2
Introduction
Rhode Island educators believe that implementing a fair, accurate, and meaningful evaluation and
support system for support professionals will help improve student outcomes. The primary purpose of
the Rhode Island Model Support Professional Evaluation and Support System (Rhode Island Model) is
to help all support professionals do their best work in order to help all students grow and learn.

The focus on educator effectiveness is our recognition of the incredible influence support professionals
have on student growth and development. Through the Rhode Island Model, we hope to help create a
culture where all support professionals have a clear understanding of what defines excellence in their
work; are provided with prioritized, specific, and actionable feedback about their performance; and
receive support to continuously improve their effectiveness, regardless of the number of years they
have been working.

How to Use the Guidebook
                                                                       Flexibility Factor
The purpose of this Guidebook is to describe the process
and basic requirements for evaluating and supporting support           The “Flexibility Factor” boxes
professionals with the Rhode Island Model. For aspects of              will be used throughout the
the Rhode Island Model that have room for flexibility and              guidebook to highlight where
school/district-level discretion, we have clearly separated and        schools and districts have an
                                                                       opportunity     to    customize
labeled different options with a Flexibility Factor.
                                                                       aspects of the Rhode Island
To help educators better understand how to best implement              Model and establish policies to
various aspects of the Rhode Island Model, additional                  meet their local needs.
resources are available on the Rhode Island Department of
Education (RIDE) website, including online training modules,
sample Student Learning/Outcome Objectives, and a suite of
calibration protocols designed to help school and district leaders facilitate ongoing calibration exercises.

The Online Resource icon will be used throughout the Guidebook to indicate that a
corresponding resource is available on the RIDE website. A list of the available online
resources can be found in Appendix 2. Please note that additional resources will be
developed over time. Educators can directly access the educator evaluation pages of the
RIDE website at: www.ride.ri.gov/EdEval.

Defining “Support Professional”

The Rhode Island Model Support Professional Evaluation and Support System was designed using the
sets of national standards for the following roles: library media specialists*, school nurse teachers*,
reading specialists*, school counselors, school psychologists, speech language pathologists, and
school social workers. Using this system for any role not previously identified is not recommended.

*For individuals who spend time instructing students, the Teacher Evaluation and Support System may
be a better fit. This is an LEA decision in consideration of alignment to specific local responsibilities.

                                                                                                           3
System Overview

Evaluation Criteria
The Rhode Island Model relies on multiple measures to paint a fair, accurate, and comprehensive
picture of a support professional’s performance. All support professionals will be evaluated on three
criteria:

   1. Professional Practice – A measure of effective service delivery as defined in the Support
      Professionals - Professional Practice Rubric. Service delivery refers to services, supports,
      instruction, programming, and consultation provided by a support professional.

   2. Professional Responsibilities – A measure of the contributions support professionals make as
      members of their learning community as defined in the Professional Responsibilities Rubric.

   3. Student Learning – A measure of support professional’s impact on student learning through
      the use of Student Learning Objectives (SLOs) and/or Student Outcome Objectives (SOOs),
      and the Rhode Island Growth Model (RIGM) when applicable.

Scores from each of the three criteria will be combined to produce a Final Effectiveness Rating of:
Highly Effective, Effective, Developing, or Ineffective.

                                        Professional
                                      Responsibilitiess

                 Professional                                      Student
                   Practice                                        Learning

                                           Final
                                      Effectiveness
                                          Rating

                                                                                                   4
Performance Level Descriptors
Each of the four Final Effectiveness Ratings has an associated Performance Level Descriptor that
provides a general description of what the rating is intended to mean, with the acknowledgement that
exceptions do exist. Performance Level Descriptors can help clarify expectations and promote a
common understanding of the differences between the Final Effectiveness Ratings of: Highly Effective,
Effective, Developing, and Ineffective. Additional information about how to interpret the ratings is
available by examining the detailed scoring rubrics and related evaluation materials. As part the an
inquiry cycle, LEAs are encouraged to review the descriptors, support professionals’ ratings, and
student learning measures to have a complete picture of teaching and learning that can inform LEA
planning.

Highly Effective – A Highly Effective rating indicates outstanding performance by the support
professional. A support professional who earns a Highly Effective rating has a very high, positive
impact on student outcomes and exhibits high-quality professional behaviors regarding service delivery
and professional responsibilities.

Effective – An Effective rating indicates consistently strong performance by the support professional.
A support professional who earns an Effective rating has a high, positive impact on student outcomes
and exhibits high-quality professional behaviors regarding service delivery and professional
responsibilities.

Developing – A Developing rating indicates inconsistent performance or consistently moderate
performance by the support professional. A support professional who earns a Developing rating has
one aspect much weaker than the other (either impact on the student outcomes or professional
behaviors), or is consistently moderate in both.

Ineffective – An Ineffective rating indicates consistently low performance by the support professional.
A support professional who earns an Ineffective rating has a low or negative impact on student
outcomes and exhibits low quality professional behaviors regarding service delivery and professional
responsibilities.

                                                                                                     5
Evaluation and Support Process

The evaluation and support process for support professional prioritizes feedback and reflection and is
anchored by three evaluation conferences at the beginning, middle, and end of year. The following
chart provides an outline of the process for support professionals participating in the full evaluation
process.

             Fall                           Winter                             Spring

           Beginning-of-Year                  Mid-Year                      End-of-Year
             Conference                      Conference                     Conference

            Discuss year                   Discuss overall               Discuss overall
             ahead, including                performance to                 performance for
             SLOs/SOOs and                   date, including                the year,
             Professional                    any available                  including the
             Growth Plan                     formative scores               Final
                                             for Professional               Effectiveness
            Discuss the                     Practice or                    Rating
             support                         Responsibilities
             profession’s                                                  Discuss goals for
             schedule and how               Review progress                the upcoming
             observations will               toward                         school year
             occur                           SLOs/SOOs and
                                             the Professional
            Discuss how to                  Growth Plan
             handle
             confidential
             situations

                       Ongoing feedback based on multiple observations
                            and targeted professional development

                                                                                                          6
Primary and Complementary Evaluators

All support professionals are required to have a primary
evaluator who is responsible for the overall evaluation process,        Flexibility Factor
including assigning final ratings. In many cases the primary
evaluator will be the principal, assistant principal, or special        Evaluators:
education director, but schools and districts are encouraged to            Schools and districts have
think strategically about who is best positioned to evaluate the            the flexibility to decide who
various support professional roles. Considering the holistic                will serve as the primary
nature of the evaluation process, it is important that evaluators           evaluator       for    support
have the capacity to observe and interact with the support                  professionals.
professional on a regular basis. Some districts may also decide            District policy or the local
to use complementary evaluators to assist primary evaluators                collective        bargaining
(e.g., help collect evidence and provide feedback). All                     agreement may allow for
evaluators are required to complete ongoing training on the                 the use of complementary
Rhode Island Model.                                                         evaluators.

                                                                           Schools and districts may
Ensuring Fairness and Accuracy                                              also choose to select
                                                                            individuals based within or
To help ensure fairness and accuracy, the Rhode Island Model                outside the school or district
uses multiple measures to assess performance. We will                       in which they serve as
continue to improve the Rhode Island Model based on feedback                evaluators. This could
from the field and the Technical Advisory Committee, as well as             consist of a single peer
from formal reviews of the data. Additionally,                              evaluator or a team of peer
                                                                            evaluators.
RIDE will:

       periodically monitor the fidelity of implementation of the evaluation process within schools and
        districts and adherence to the Rhode Island Educator Evaluation System Standards;
       provide ongoing implementation support; and
       improve the model in future years based on student achievement and educator development
        data, state needs, and feedback from educators

LEAs will:

       ensure that the model is implemented with fidelity by monitoring implementation, reviewing the
        data produced and decisions made;
       provide procedural safeguards to ensure the integrity of the system, including evaluation
        appeals;
       respond to support professional’s concerns in accordance with district policy and practice,
        collective bargaining agreements, and/or processes set forth by the District Evaluation
        Committee; and
       conduct periodic audits of evaluation data and review evaluations with contradictory outcomes
        (e.g., a support professional has a very high Student Learning score and a very low
        Professional Practice and Professional Responsibilities score).

                                                                                                             7
Support and Development
We believe in a system that encourages educators to work collaboratively and learn best practices from
each other. Every school is unique, and support and development should not look exactly the same for
everyone. However, the Rhode Island Model is designed to facilitate development by:

      Outlining high expectations that are clear and aligned with school, district, and state priorities;
      Establishing a common vocabulary for meeting expectations;
      Encouraging student-focused conversations to share best practices and address common
       challenges;
      Grounding professional development in data-driven collaboration, conferencing, observation,
       and feedback to meet shared goals for student achievement; and
      Providing a reliable process for educators to focus yearly practice and drive student learning.

Evaluation Conferences (Beginning/Middle/End)

The three evaluation conferences represent opportunities for honest, data-driven conversations
focused on promoting continuous improvement.

Beginning-of-Year Conference: Support professional and                    Flexibility Factor
evaluator discuss the support professional’s past performance,
Professional Growth Plan, SLOs/SOOs, how they will be observed,           Evaluation Conferences:
how confidential situations will be handled, and the year ahead.
                                                                          The length of each conference is
Mid-Year Conference: Support Professional and evaluator discuss           decided at the local level, though we
all aspects of the support professional’s performance to date,            recommend at least 15 minutes per
including Professional Practice, Professional Responsibilities, the       conference.     Conference      length
educator’s progress toward the Professional Growth Plan, and              should match the purpose of the
                                                                          conference to meet stated goals.
progress toward the SLOs/SOOs. In some cases, Professional
Growth Plans and SLOs/SOOs may be revised based on
discussion between the support professional and evaluator.

While Final Effectiveness Ratings are not determined until the end of the evaluation cycle, the Mid-Year
Conference is an important point in the year when specific concerns should be addressed, especially if
they indicate that a support professional’s impact on student learning is below expectations. Support
Professionals should already be aware of specific concerns through observation feedback and prior
documentation so that they are not addressed for the first time at the conference. If the support
professional is struggling, and has not started an Improvement Plan by the time of the Mid-Year
Conference, this is an opportunity to craft an initial plan together.

End-of-Year Conferences: Support professional and evaluator review summative feedback on
Professional Practice and Responsibilities and discuss SLO/SOO results. They will also discuss
progress toward the support professional’s Professional Growth Plan. During or soon after the
conference, the evaluator finalizes and shares the Support Professional’s Final Effectiveness rating for
the school year.
                                                                                                       8
Professional Growth Plans
All support professionals will create a Professional Growth Plan at the beginning of the year. This plan
requires at least one concrete goal to focus the support professional’s professional development
throughout the year. More specifically, the Professional Growth Plan should be:

      based on the support professional’s past
       performance (e.g., prior evaluation or self-
       assessment) or a school or district initiative;
                                                                  Flexibility Factor
      specific and measurable, with clear benchmarks for
       success;                                                   Professional Growth Plans:
      aligned with the Professional Practice and/or
       Professional Responsibilities Rubrics; and                    Schools and districts may
      discussed and finalized during or directly after the           determine that a school-
       Beginning-of-Year Conference.                                  wide approach for one
                                                                      professional growth goal is
                                                                      preferable. It is also
Adjusting a Professional Growth Plan Mid-Year
                                                                      important that support
                                                                      professionals are able to set
While it is ideal to establish a goal that is ambitious but
                                                                      individual goals designed to
realistic, the Mid-Year Conference provides a formal                  meet their professional
opportunity for the support professional and evaluator to             improvement needs
review the Professional Growth Plan and make                          identified through past
adjustments if necessary. This could happen if the goal is            performance. This may
achieved before the end of the year or if planned activities          result in some support
                                                                      professionals establishing 2
are not possible.
                                                                      professional growth goals
                                                                      as part of their Plan.
Performance Improvement Plans
                                                                     Support professionals may
                                                                      develop multi-year
A Performance Improvement Plan may be implemented at                  Professional Growth Plans
any time during the school year to help a support                     with annual benchmarks,
professional improve, but must be put in place if a support           activities, and expected
                                                                      results.
professional receives a Final Effectiveness Rating of
Developing or Ineffective.     The Plan should identify
specific supports and support professional actions and
establish a timeline for improvement, as well as frequent
benchmarks and check-ins.

A support professional who has a Performance Improvement Plan will work with an improvement team
to assist him or her to develop the plan. An improvement team may consist solely of the support
professional’s evaluator or of multiple people, depending on the support professional’s needs and the
school and district context.

The Educator Evaluation System Standards require districts to establish personnel policies that use
evaluation information to inform decisions. A support professional who does not demonstrate sufficient
improvement may be subject to personnel actions, according to district policies.

                                                                                                      9
Professional Practice
The Professional Practice Rubric (Appendix 3) represents the Rhode Island Model’s definition of
effective service delivery. More specifically:

      The Professional Practice rubric consists of 8 components organized into 2 domains.

      The Professional Practice Rubric is aligned with the professional standards of the 7 support
       professional roles.

      The Professional Practice Rubric is a holistic scoring tool, not an in-person assessment or
       conference tool. Evaluators should use the Professional Practice and Responsibilities feedback
       form to deliver feedback at least three times during the school year.

      The components are scored holistically according to the rubric at the end of the school year,
       based on evidence collected during the entire school year, although evaluators have the
       flexibility to provide formative scores at the mid-year. Some evidence can be seen in action
       (e.g., use of effective communication) and others may require artifact review (e.g., plans
       effectively for service delivery).

      Scoring bands will be used to determine the overall Professional Practice rating as Exemplary,
       Proficient, Emerging, or Unsatisfactory.

                            Professional Practice Rubric Components

Domain 1: Collaboration                                Domain 2: Service Delivery

1A. Works with educators and families to develop       2A. Establishes service delivery and/or program
strategies and resources to meet the needs of          goals and develops a plan to evaluate them
students
                                                       2B. Plans effectively for service delivery that is based
1B. Uses and models effective communication with       on student data and knowledge of child development
learners, colleagues and/or stakeholders
                                                       2C. Implements service delivery that is student
1C. Builds rapport with students promoting effective   focused ensuring students have greater ownership in
implementation of services                             their education and well being

                                                       2D. Demonstrates flexibility and responsiveness

                                                       2E. Uses appropriate assessments to diagnose or
                                                       identify and monitor student issues or programmatic
                                                       progress and to adjust service/program delivery

                                                                                                            10
Professional Responsibilities
Support Professionals’ roles extend beyond the 2 domains of the Professional Practice Rubric. The
Rhode Island Model recognizes the additional contributions support professionals make to their school
community through the Professional Responsibilities Rubric (Appendix 4). More specifically:

       The Professional Responsibilities Rubric includes 6 components that are aligned with local and
        national standards related to individual support professional disciplines and the Rhode Island
        Code of Professional Responsibility.

       The Professional Responsibilities Rubric is a holistic scoring tool, not an observation or
        conference tool. Evaluators should use the Professional Practice and Responsibilities feedback
        form to deliver feedback at least 3 times during the school year.

       The components are scored holistically according to the rubric at the end of the school year,
        based on evidence collected during the entire school year. Some evidence can be seen in
        action (e.g., use of effective communication) and others may require artifact review (e.g., plans
        effective for service delivery).

       The components of the Professional Responsibilities Rubric are also used as part of teacher
        and building administrator evaluations.

       Support Professionals will be rated on Professional Responsibilities as Exceeds Expectations,
        Meets Expectations, and Does Not Meet Expectations.

         Support Professional - Professional Responsibilities Rubric Components

Domain 1: School Responsibilities and               Domain 2: Professionalism
Communication
                                                    PR3: Acts on the belief that all students can learn and
PR1: Understand and participates in                 advocates for students’ best interests
school/district-based initiatives and activities
                                                    PR4: Works toward a safe, supportive, collaborative
PR2: Solicits and maintains records of, and         culture by demonstrating respect for everyone,
communicates appropriate information about          including other educators, students, parents, and other
students’ behavior, learning needs, and academic    community members in all actions and interactions
progress
                                                    PR5: Acts ethically and with integrity following all
                                                    school, district, and state policies

                                                    PR6: Engages meaningfully in the professional
                                                    development process and enhances professional
                                                    learning by giving and seeking assistance from other
                                                    educators

                                                                                                           11
Assessing Professional Practice and Responsibilities
The Professional Practice and Responsibilities rubrics are
scored holistically at the end of the school year, based on
                                                                     Flexibility Factor
evidence collected during the entire school year. All of the
components on both rubrics can be seen in action, and                Assessing Professional
evaluators should maintain notes that serve as evidence of
                                                                     Practice and Responsibilities
the components.
                                                                        Schools and districts have
Observing a support professional can vary considerably                   the flexibility to determine
from the traditional classroom observation. An evaluator                 the evidence that will be
could observe a support professional during activities such              used for the Professional
as meetings, student group sessions, or during instructional             Practice and
                                                                         Responsibilities
time (depending on the specific role). The goal is to see the
                                                                         components. RIDE
support professional in an authentic situation that is part of           recommends assessing
their role.                                                              components in action
                                                                         whenever possible.
The basic requirements for observing a support professional
include:                                                                Schools and districts can
                                                                         choose to provide
      At least one announced observation, and at least                  “formative scores” at the
       two unannounced for a minimum of three                            mid-year for Professional
                                                                         Practice and
      At a minimum, there is a one-week window during                   Responsibilities
       which the announced observation will occur that is                components. On the Mid-
       communicated to the support professional (for                     Year Conference form in
       example, “I will observe you during the week of                   EPSS there is an option to
                                                                         provide a formative score
       March 19.”). The specific date and time of the
                                                                         for one or more of the
       announced observation does not have to be                         components.
       communicated in advance, but the week of
       notification cannot be the same week as the                      A formative score provided
       observation.                                                      at the mid-year does not
                                                                         have to match the score
      Written feedback is required after each observation               provided at the end-of-year.

A few components of the Professional Practice and
Responsibilities rubrics may benefit from artifact review, including: PP 2B – Plans effectively for service
delivery that is based on student data and knowledge of child development (written plans); and PR 2 –
Solicits and maintains records of, and communicates appropriate information about students’ behavior,
learning needs, and academic progress (written communication and/or communication records).
Additionally:

      The focus of the artifact review should be on quality rather than quantity.

      All artifacts reviewed should be clearly connected to the performance descriptors of one or more
       rubric components.

      One artifact could be used to demonstrate proficiency on more than one component.
                                                                                                        12
Feedback

Written feedback aligned to the Professional Practice and Responsibilities rubrics must be given to
support professionals at least three times each year. The written feedback must align with a specific
observation, but may also include evidence of the support professional’s performance from other
interactions.

High-quality feedback helps support professionals improve by identifying strengths (practices they
should continue) and areas for improvement (changes to their practice that should be prioritized). To be
effective, feedback should be prioritized, specific, actionable, delivered with a supportive
tone, and it should be provided to the support professional as soon after the
observation/artifact review as possible. Additional resources to help evaluators provide
high-quality feedback, including a written feedback review tool, can be found on the RIDE
website at: www.ride.ri.gov/EdEval-Best-Practices-Resources.

Confidentiality Considerations

Many support professionals handle sensitive issues where student and family privacy must be
protected by law. This is particularly a consideration with health and mental health related professions
(school counselors, school nurse teachers, school psychologists, and school social workers). It is
important for evaluators and support professionals to determine a plan at the beginning of the year for
how to handle these confidentiality issues for evaluation purposes. For instance, in a scenario where a
support professional is working with a student in crisis or another sensitive issue, it is important for the
support professional to prioritize the student he/she is working with and arrange a different time for an
evaluator to return for an observation. Evaluators and support professionals should always prioritize
student well-being when deciding upon appropriate times to conduct assessments of Professional
Practice and Responsibilities.

                                                                                                         13
Measures of Student Learning
Improving student learning is at the center of all our work and measuring specific outcomes that will
increase access to learning for students is a critical part of our support professional’s evaluation model.
The Rhode Island Model measures a support professional’s impact on student learning in two ways:
Student Learning Objectives (SLOs) and/or Student Outcome Objectives (SOOs), and the Rhode
Island Growth Model (RIGM). Measures of student learning are included in support professional’s
evaluations because:

      Student learning is a critical measure of support professional effectiveness. Support
       professionals provide services that have a direct impact on access to learning, even if direct
       instruction is not their primary role.

      Student learning measures, when combined with assessment of Professional Practice and
       Professional Responsibilities, improve the accuracy of the Final Effectiveness Ratings for
       support professionals.

      Analyzing student data is a best practice for self-reflection and increased collaboration around
       improving service delivery and student outcomes.

Student Learning Objectives and Student Outcome Objectives
Both SLOs and SOOs can be used as a measure of a support professional’s impact on student
learning, either directly through demonstrated progress toward specific, measureable goals, or through
increasing access to learning. An SLO is a long-term academic goal set for groups of students. An
SOO is a long-term goal that is focused on an outcome that increases access to learning or creates
conditions that facilitate learning. Both SLOs and SOOs can be set for the school year or an interval of
service delivery/instruction appropriate to their assignment (e.g., a single semester). They must be
specific and measureable, based on available student information, and aligned with standards, as well
as any school and district priorities where applicable. Additionally:

      The SLO/SOO process respects the diversity of all support professionals’ roles. The best
       way to measure student outcomes or student access to learning differs from role to role. These
       objectives present an opportunity for support professionals to be actively involved in deciding
       how to best measure the outcomes of goals for their specific population of students, while
       providing a consistent process for all support professionals across the state.

      SLOs/SOOs focus educator attention where it matters most: on student outcomes. Both
       SOOs and SLOs ask support professionals to think strategically about their impact on student
       learning, whether through direct instruction or increasing access to learning.

                                                                                                          14
Student Learning/Outcome Objective Decision Tree

This decision tree is used to assist support professionals (and special educators) in determining
whether they should set SLOs, SOOs, or a combination of both. The determination of a support
professional’s student learning options is based upon the specific role. LEAs need to determine what
type of student learning measure is most appropriate for the specific positions in their LEA.

                                    SLO/SOO Decision Tree

     Do you primarily provide instruction to students?

      Yes                                          No

                        Do you primarily provide specilaized services or manage a
  Set 2 SLOs                                   program?

                                  Yes                               No

                              Set 2 SOOs          Is your role a combination of providing
                                                    instruction and providing specialized
                                                   services and/or managing a program?

                                                         Yes                    No

                                                                          Determine with
                                                   1 SOO and 1            evaluator if you
                                                       SLO               should set an SOO
                                                                             or an SLO

                                                                                                 15
The Student Learning/Outcome Process

The process for setting SLOs and SOOs is the same, regardless of whether an educator is setting
SLOs, SOOs, or a combination of SLOs/SOOs. Support professionals should, whenever possible, work
collaboratively with colleagues to set SLOs/SOOs. The process is meant to foster reflection and
conversation about the essential curriculum, strategies, and assessment tools used in schools across
the state.

The SLO/SOO process mirrors a support professional’s planning, instruction/service delivery, and
assessment cycle as seen by the chart below:

      Preparation           Development             Instruction/Service      Reflection
                                                          Delivery
      Review                Get to know             Teach/implement      Collect, analyze,
       standards, units       students (collect        service delivery      and report final
       of study, past         and analyze              and monitor           evidence of
       service delivery       baseline data)           student               student
       methods, and                                    learning/access       learning/access to
       how they              Re-evaluate              to learning           learning
       improved access        priority
       to learning for        services/content        Discuss progress     Evaluator and
       students               based on student         with colleagues       support
                              needs                    and evaluator(s)      professional
      Review available                                                      review outcomes
       assessments           Draft and submit        Make
       currently used to      SLOs/SOOs                adjustments to       Reflect on
       assign grades                                   SLOs/SOOs by          outcomes to
       and monitor           Receive SLO/SOO          mid-year (if          improve
       students’              approval (revise if      necessary)            implementation
       progress               necessary)                                     and practice
                                                      Revise supports
      Determine priority                              and interventions
       service/s/content                               if students are
                                                       not progressing
      Review available                                as expected
       historical data
                                                      Collect, analyze,
                                                       and report on
                                                       SLO/SOO results

                                                                                                  16
The Anatomy of Student Learning Objectives & Student Outcome
Objectives

The SLO and SOO forms are structured to help educators answer three essential questions.

SLO Form:

   1. What are the most important knowledge/skills I want my students to attain by the end of the
      interval of instruction?

   2. Where are my students now (at the beginning of instruction) with respect to the objective?

   3. Based on what I know about my students, where do I expect them to be by the end of the
      interval of instruction and how will they demonstrate their knowledge/skills?

SOO Form:

   1. What is the most important outcome that will enable students to have better access to education
      through your services?

   2. Where are my students now with respect to this objective?

   3. Based on what I know about them, where do I expect my students to be by the end of the
      interval of service? How will I measure this change?

                                                                                                    17
Anatomy of a Student Learning Objective (Form)

Title – A short name for the SLO
Content Area – The content area(s) to which this SLO applies
Grade Level – The grade level(s) of the students
Students – The number and grade/class of students to whom this SLO applies
Interval of Instruction – The length of the course (e.g., year, semester, quarter)

 Main                       Element                                           Description
Criteria
Essential Question: What are the most important knowledge/skills I want my students to attain by the end of the interval
of instruction?

                                             Identifies the priority content and learning that is expected during the interval of
                                              instruction.
                           Objective         Statement should be broad enough that it captures the major content of an
   Priority of Content

                           Statement          extended instructional period, but focused enough that it can be measured.
                                             Attainment of this objective positions students to be ready for the next level of
                                              work in this content area.
                                             Provides a data-driven and/or curriculum-based explanation for the focus of the
                           Rationale          Student Learning Objective.

                            Aligned          Specifies the standards (e.g., CCSS, Rhode Island GSEs, GLEs, or other state or
                           Standards          national standards) to which this objective is aligned.

Essential Question: Where are my students now (at the beginning of instruction) with respect to the objective?

                         Baseline Data/      Describes students’ baseline knowledge, including the source(s) of data/
                          Information         information and its relation to the overall course objectives.

Essential Question: Based on what I know about my students, where do I expect them to be by the end of the interval of
instruction and how will they demonstrate their knowledge/skills?

                                             Describes where the teacher expects all students to be at the end of the interval
                                              of instruction.
                            Target(s)        The target should be measureable and rigorous, yet attainable for the interval of
   Rigor of Target

                                              instruction.
                                             In most cases, the target should be tiered to reflect students’ differing baselines.

                                             Explains the way in which the target was determined, including the data source
                          Rationale for       (e.g., benchmark assessment, historical data for the students in the course,
                                              historical data from past students) and evidence that indicate the target is both
                           Target(s)          rigorous and attainable for all students.
                                             Rationale should be provided for each target and/or tier.

                                             Describes how student learning will be assessed and why the assessment(s) is
                                              appropriate for measuring the objective.
 Quality of
 Evidence

                                             Describes how the measure of student learning will be administered (e.g., once or
                           Evidence           multiple times; during class or during a designated testing window; by the
                           Source(s)          classroom teacher or someone else).
                                             Describes how the evidence will be collected and scored (e.g., scored by the
                                              classroom teacher individually or by a team of teachers; scored once or a
                                              percentage double-scored).

                                                                                                                              18
Anatomy of a Student Outcome Objective (Form)

Title – A short name for the SOO
Content Area – The service area(s) to which this SOO applies
Grade Level – The grade level(s) of the students
Students – The number of students to whom this SOO applies
Interval of Service – The interval of service defines the period to which the SOO applies. It should mirror the length of time
in which the educator is actively working with students, typically one academic year, one semester or a shorter timeframe,
as justified by the duration of the service(s) being delivered.

 Main                    Element                                               Description
Criteria
Essential Questions: What is the most important outcome that will enable students to have better access to education
through your services?
                            The objective statement describes the specific outcome that the support professional is
            Objective           working to achieve.
Priority of

                               The depth and breadth of the objective statement will vary depending on the Support
 Content

           Statement
                                Professional’s role and assignment, but should be specific enough to clarify the focus of
                                the SOO.
            Rationale  Provides a data-driven explanation for the focus of the SOO and indicates if it is aligned
                                with a school or district priority.
Essential Questions: Where are my students now with respect to the objective?
                                        Information that has been collected or reviewed to support the overall reasoning for the
                          Baseline
                                         student outcome objective.
                           Data /       This information could include survey data, statistics, participation rates, or references to
                        Information      historical trends or observations.
Essential Questions: Based on what I know about my students, where do I expect them to be by the end of the interval of
service? How will I measure this?
                                        Describe where it is expected for groups of students or the school community as a whole to
                         Target(s)       be at the end of the interval of service.
   Rigor of Target

                                        The targets should be measureable and rigorous, yet attainable.
                                        Explains the way in which the target was determined, including the baseline information
                        Rationale        sources and why the target is appropriate for the group of students or the school
                                         community.
                           for          Explains the way in which the target was determined, including the data source (e.g.,
                        Target(s)        benchmark assessment, trend data, or historical data from past students) and evidence
                                         that indicate the target is both rigorous and attainable for all students.
                                        Rationale should be provided for each target and/or tier.
                                        Describes how the objective will be measured and why the evidence source(s) is
                                         appropriate for measuring the objective ( e.g. logs, scoring guides, screening procedures,
                                         surveys)
           Quality of
           Evidence

                        Evidence        Describes how the measure of the student outcome will be collected or administered (e.g.,
                        Source(s)        once or multiple times; during class time or during a designated testing window; by the
                                         support professional or someone else).
                                        Describes how the evidence will be analyzed and/or scored (e.g., scored by the support
                                         professional individually or by a team of support professionals; scored once or a
                                         percentage double-scored).
                        Strategies      Describe the method, strategies or plan that will be used to achieve your goal.

                                                                                                                                   19
Number and Scope of Student Learning/Outcome Objectives

Support Professionals and evaluators should work together to determine how many SLOs/SOOs are
appropriate for their specific role. The minimum number of SLOs/SOOs a support professional may set
is two. Support professionals should discuss their rationale for selecting a particular area of focus with
their evaluators at the beginning of the school year.

Students

A support professional’s SLO/SOO may include all of the students in the school or focus on subgroups
of students (e.g., caseload, specific grade level, course). An individual SLO/SOO that is focused on a
subgroup must include all students in that subgroup with which the objective is aligned. An example for
a school psychologist is below:

         SOO 1: Stress Management                                   SOO 2: Bullying Prevention
                                                                th
  Section A      Section B     Section C                       6 Grade       7th Grade       8th Grade

 SOO 1 includes all students in all three sections             SOO 2 includes all students in all 3 grades
       of the stress management group

Furthermore, percentages or particular groups of students (e.g., students with IEPs) may not be
excluded.

Setting tiered targets according to students’ starting points is recommended because students may
begin at varying levels of preparedness. However, the expectation is that all students should make
gains regardless of where they start. For example, students who begin below grade-level may be
expected to make substantial progress toward course/grade objectives by the end of the interval of
instruction/service delivery, reducing the gap between their current and expected performance, while
students who begin on grade level may be expected to meet or exceed proficiency by the end of the
instructional period.

                           FAQ                                                          FAQ
Can I write an absenteeism clause into my SLO/SOO          I work in a district with high mobility, so my
such as “For those students who are present 80% of the     roster/caseload often looks different by January. How do I
time?”                                                     set targets for students I have never even seen?

No, because support professionals are responsible for      At mid-year, you and your evaluator should compare your
documenting all students’ progress toward the objective,   current roster/caseload to the one upon which the targets were
including their efforts to reach students with extreme     set. If there are substantial differences, adjust the targets as
absenteeism. However, your evaluator can take extreme      necessary to include all of the students you provide services to
absenteeism into account when scoring the SLO/SOO.         and exclude students who are no longer on your
                                                           roster/caseload.

                                                                                                                              20
Baseline Data/Information

Data is information and educators collect information from students every day in order to help them
plan effectively, adjust instruction/service delivery, monitor progress, and assess student performance.
In order to set appropriate long-term goals for students, support professionals must understand where
their students are at the beginning of instruction/service delivery. There are many ways that support
professionals understand their students’ starting points at the beginning of the year. The methodology
chosen should consider:

      Whether there is student assessment data or information from the previous year that could
       influence the current year’s progress (e.g. reading level);

      Sources of available data that shows trends (e.g., survey data, immunization records);

      Baseline data from a pre-test may be helpful when it is important to understand students’ skill or
       knowledge level at the beginning of the course/service delivery. These tests could include a
       support professional-created or commercial assessment and focus on either the current or
       previous grade’s standards and content.

Baseline data/information can be used in two ways for SLOs/SOOs; it can inform the Objective
Statement and contribute to setting Targets. In all scenarios baseline data/information is a must;
however, a pre-test/post-test model is not required and, in some cases, might be inappropriate.

The function of the baseline assessment is to provide information about where students are starting in
order to set appropriate targets. This does not mean that it is necessary to pinpoint projected student
growth, since some targets may focus on reaching a specific level of proficiency. Support professionals
should gather information that helps them understand where their students are in relation to their
preparedness to access the material of the class/services.

For more resources and best practices on gathering baseline data/information see the
online Module: Using Baseline Data/Information to Set SLO Targets on the RIDE website
at: www.ride.ri.gov/EdEval-OnlineModules.

                                                                                                       21
Rigor of Target

When setting the target(s) for an SLO/SOO, the support
professional should start by considering where it is expected for           Where do         Where
groups of students or the school community as a whole to be at the          students        are they
end of the interval of instruction or the interval of service (objective     need to         now?
statement) based on where the students are with respect to the                 be?
objective statement (baseline data).

Not all students begin with the same level of preparedness.
Therefore, targets may be tiered to reflect differentiated
expectations for learning/outcomes.

Setting tiered targets based on students’ prerequisite knowledge and skills helps to ensure that the
targets are rigorous and attainable for all students. Students entering a course or grade level with high
proficiency or robust prerequisite skills will need to be challenged by a higher target. For students
entering a course or grade level with lower proficiency or lacking prerequisite skills, a more modest
target may be appropriate in order to ensure that it is reasonably attainable in the interval of
instruction/service.

That said, the intent of tiered targets is not to calcify achievement gaps. The needs for fairness and
appropriateness should be balanced by the need to challenge lower-achieving students to catch up to
their peers. Additionally, while students in lower tiers may have a lower absolute target, reaching it may
require them to make more progress than students with higher targets, resulting in a closing or
narrowing of the achievement gap(s).

The following graphic shows one example of how to tier targets for an SLO based on students’
preparedness for the content:

     Some students are                                                         Some students are entering
     entering the course                Some students are entering the         the course with prerequisite
    without the necessary                  course with the necessary             knowledge or skills that
  prerequisite knowledge or             prerequisite knowledge or skills.      exceed what is expected or
             skills.                                                                    required.

        Tier 1 Target                            Tier 2 Target                         Tier 3 Target

Support professionals who collaborate on SLOs/SOOs should also confer about targets; however the
targets for each individual support professional must reflect the actual students in their
class(es) or on their caseload. More detailed information about SLO/SOO target setting,
including the online module: Using Baseline Date and Information to Set SLO Targets,
is available on the RIDE website at: www.ride.ri.gov/EdEval-OnlineModules.

                                                                                                        22
Quality of Evidence
High-quality evidence sources are essential for accurately measuring students’ learning. In Rhode
Island, a variety of evidence sources may be used for SLOs/SOOs, including performance tasks,
extended writing, research papers, projects, portfolios, unit assessments, final assessments,
survey data, attendance records, etc. A combination of evidence sources may also be used.
Evidence sources may be created by individual support professionals, teams, district leaders, or
purchased from a commercial vendor. However, all assessments must be reviewed by evaluators.

Selecting the right evidence source for an SLO is about finding the best assessment for the purpose. In
order to make this determination, the question to ask is, “Is this evidence source aligned to what is
being measured?” Alignment of evidence source refers to:

      Content (e.g., The SLO focuses on reading informational text and the evidence source focuses
       on informational text)

      Coverage (e.g., The SLO includes five standards and all five of those standards are addressed
       by the evidence source)

      Complexity (e.g., The SLO addresses a variety of DOK levels and the evidence source
       includes items/tasks aligned with those DOK levels).

The evidence source for an SOO may include:

      data on the outcome itself (e.g., truancy rates, survey data on 11th grade students’ attitudes
       toward drinking and driving);

      indicators related to the outcome (e.g., participation in school social events and clubs as an
       indicator of student engagement); or

      documentation of the action taken on the part of the support professional to move a student,
       group of students, or the school toward the outcome (e.g., creation of an afterschool fitness
       club).

An assessment may be high-quality for a particular purpose, but if it is not aligned to the Objective
Statement of the SLO/SOO, it is not the best choice. Additionally, the use of a single evidence source
can be problematic if it does not capture the full breadth of the Objective Statement. Consider the
following examples:

      The SLO Objective Statement says that students will improve their reading accuracy, fluency,
       and comprehension of literary and informational text, and their ability to convey information
       about what they’ve read. One assessment might be used to measure reading accuracy, fluency,
       and some comprehension of both literary and information text. Another assessment might be
       used to measure deeper reading comprehension and their ability to convey information about
       what they’ve read

      The SOO Objective Statement says that the overall health, wellness, and safety of students will
       improve. One evidence source might be used to track immunization records. A second evidence
       source may track the vision screening results and follow up. A third assessment may be used to
       assess the effectiveness of staff development sessions.
                                                                                                        23
Other considerations for determining the quality of an evidence source include format, item type, and
administration and scoring procedures. In most cases, the evidence source(s) should be as authentic
as possible without being impractical to administer and score.

More information about creating and selecting assessments can be found in the
Comprehensive Assessment System Criteria & Guidance document, available on the
RIDE website at: www.ride.ri.gov/CAS.

RIDE has also developed an Assessment Toolkit to support educators with assessment literacy.
While the Assessment Toolkit was originally designed for teachers, some of the resources will be
helpful for support professionals. The Assessment Toolkit contains four resources:

   1. Creating & Selecting High-Quality Assessments Guidance
   2. Using Baseline Data and Information Guidance
   3. Collaborative Scoring Guidance
   4. Assessment Review Tool

Support professionals can access the Assessment Toolkit on the RIDE website at:
www.ride.ri.gov/EdEval-OnlineModules.

The table on the following page includes further guidance on selecting high-quality assessments.
These Assessment Quality Descriptors represent some of the most important aspects of an
assessment to consider. Some of the criteria are inherent to the assessment (e.g., the purpose), while
others relate to an educator’s use of the assessment (e.g., the scoring process).

Assessment Quality Guidance

              Assessment is aligned with its intended use
              Assessment measures what is intended
              Items represent a variety of DOK levels
              Assessment includes a sufficient number of items to reliably assess content
  High        Assessment includes some higher level DOK constructed response items at least
 Quality       one very challenging item
              Assessment is grade level appropriate and aligned to the curriculum
              Scoring is objective (includes scoring guides and benchmark work), and uses a
               collaborative scoring process
              Assessment is loosely aligned to its intended use
              Assessment mostly measures what is intended
              Items represent more than one level of DOK
Moderate      Assessment includes a sufficient number of items to reliably assess most content
 Quality      Assessment is grade level appropriate
              Scoring may include scoring guides to decrease subjectivity, and/or may include
               collaborative scoring
              Assessment is not aligned to its intended use
              Assessment does not measure what is intended
              Items represent only one level of DOK
  Low
              Assessment includes an insufficient number of items to reliably assess most content
 Quality
              Assessment is not grade level appropriate
              Scoring is open to subjectivity, and/or not collaboratively scored
                                                                                                     24
Approving Student Learning/Outcome Objectives

In order for an SLO/SOO to be approved, it must be
rated as acceptable on three criteria:
                                                                Flexibility Factor
   1. Priority of Content
                                                                Approving Student Learning
                                                                /Outcome Objectives:
   2. Rigor of Target(s)
                                                                Student Learning Objectives
   3. Quality of Evidence                                       should be discussed during the
                                                                Beginning-of-Year Conference
Some SLOs/SOOs will be approvable upon submission,              and approved no later than the
while others will require revisions. An SLO and an SOO          end of the first quarter.
Quality Review Tool have been developed to further
clarify expectations and help support professionals and
evaluators determine if an SLO/SOO is acceptable or
needs revision.

The SLO and SOO Quality Review Tools are available on the RIDE website at:
www.ride.ri.gov/EdEval-Best-Practices-Resources.

Reviewing Student Learning/Outcome Objectives at the Mid-Year
Conference

The Mid-Year Conference offers an opportunity for support professionals to review and discuss their
students’ learning progress with their evaluators. Support professionals and evaluators should work
together to ensure students’ learning needs are effectively addressed through instructional practice and
supports. If students are not progressing as expected, the support professional and evaluator should
collaborate to revise the supports and interventions in place to help accelerate student progress.

If at the Mid-Year Conference it becomes clear that an SLO/SOO is no longer appropriate, it may be
revised. Revisions should be rare, but adjustments may be made if:

      The schedule or assignment has changed significantly
      Class or caseload compositions have changed significantly
      New, higher-quality sources of evidence are available
      Based on new information gathered since they were set, objectives fail to address the
       most important learning or access to learning challenges in the classroom/school.

NOTE: There may be extenuating circumstances that do not fit these four categories in which the
evaluator must use professional judgment.

                                                                                                     25
You can also read