Quality Assurance at Fanshawe College - Lane D. Trotter, Ed.D. Senior Vice President Academic Fanshawe College

Page created by Sean Saunders
 
CONTINUE READING
Quality Assurance at Fanshawe College - Lane D. Trotter, Ed.D. Senior Vice President Academic Fanshawe College
Quality Assurance at
Fanshawe College

                      Lane D. Trotter, Ed.D.
            Senior Vice President Academic
                          Fanshawe College
Quality Assurance at Fanshawe College - Lane D. Trotter, Ed.D. Senior Vice President Academic Fanshawe College
Presentation Outline

• Overview of Fanshawe College
• Definition of Quality Assurance
• Policy Framework
• Program development / renewal
• Program Reviews
   ‐ One year follow-ups
• Key Performance Indicators (KPIs)
• External Audits and Accreditations
• Concluding comments
Quality Assurance at Fanshawe College - Lane D. Trotter, Ed.D. Senior Vice President Academic Fanshawe College
Overview of Fanshawe College
Quality Assurance at Fanshawe College - Lane D. Trotter, Ed.D. Senior Vice President Academic Fanshawe College
Overview of Fanshawe College
                               London Campus
                                                       Woodstock Campus

Students:
• 17,350 FT
• 26,000 PT
                              Centre for Digital        Simcoe Campus
                            and Performance Arts
Campus locations:
•   London
•   St. Thomas / Elgin
•   Woodstock / Oxford
                              Centre for Applied
•   Simcoe / Norfolk     Transportation Technologies
                                                       St. Thomas Campus

Operating Budget:
• $205M
Quality Assurance at Fanshawe College - Lane D. Trotter, Ed.D. Senior Vice President Academic Fanshawe College
Overview of Fanshawe College

2011/12 Full-Time Post-Secondary Programs by
Credential Awarded
60
                        54                            Total = 116

50

40

30                                 21            20
             16
20

                                                                5
10

 0
     Certificate   Diploma   Advanced   Graduate       Collaborative/
                              Diploma   Certificate   Applied Degrees
Quality Assurance at Fanshawe College - Lane D. Trotter, Ed.D. Senior Vice President Academic Fanshawe College
Definition of Quality Assurance
Quality Assurance at Fanshawe College - Lane D. Trotter, Ed.D. Senior Vice President Academic Fanshawe College
Quality Assurance

Definition:

  Are the Policies, Procedures and Practices utilised by
  Fanshawe College to ensure that the College
  provides students with the best educational
  experience possible by having programs and
  curriculum that are current and services that
  support students’ needs
Quality Assurance at Fanshawe College - Lane D. Trotter, Ed.D. Senior Vice President Academic Fanshawe College
Policy Framework
Quality Assurance at Fanshawe College - Lane D. Trotter, Ed.D. Senior Vice President Academic Fanshawe College
Policy Framework

Board of Governor Policies:
  –   A-05 Vision and Mission                Ends Policies:
                                             Set the expectations of the
  –   A-35 Student Success                   Board on what the College is
  –   A-40 Meeting Labour Market Needs       to achieve

  –   D-30.05 College Advisory Committees
  –   D-35 Commitment to Quality            Executive Limitations
  –   D-36 College Programming              Policies:
                                            Set the expectations by the
  –   D-37 Research and Innovation          Board on what the President
                                            shall not fail to do
  –   D-40 Interaction with Students
  –   D-55 Health and Safety
Quality Assurance at Fanshawe College - Lane D. Trotter, Ed.D. Senior Vice President Academic Fanshawe College
Policy Framework
                                            Vision:
                                            Unlocking Potential
                                            Mission:
Board of Governor Policies:                 Provide pathways to success to
                                            success, and exceptional learning
  –   A-05 Vision and Mission               experience, and a global outlook to
  –   A-35 Student Success                  meet student and employer needs.

  –   A-40 Meeting Labour Market Needs
  –   D-30.05 College Advisory Committees
  –   D-35 Commitment to Quality               Executive Limitations
  –   D-36 College Programming                 Policies:
                                               Set the expectations by the
  –   D-37 Research and Innovation             Board on what the President
                                               shall not fail to do
  –   D-40 Interaction with Students
  –   D-55 Health and Safety
Policy Framework
                                                  Vision:
                                                  Unlocking Potential
                                                  Mission:
Board of Governor Policies:                       Provide pathways to success to
                                                  success, and exceptional learning
  –   A-05 Vision and Mission                     experience, and a global outlook to
  –   A-35 Student Success                        meet student and employer needs.

  –   A-40 Meeting Labour Market Needs
  –   D-30.05 College Advisory Committees
                                          The President shall not fail to:
  –   D-35 Commitment to Quality          1. Student Satisfaction with courses
  –   D-36 College Programming               or programs
                                          2. Quality of teaching as evaluated
  –   D-37 Research and Innovation           by students
                                          3. Availability of services, facilities
  –   D-40 Interaction with Students         and equipment to meet students’
  –   D-55 Health and Safety                 needs
                                                  4. Graduate satisfaction
                                                  5. Graduate employment rate
                                                  6. Employer Satisfaction
Policy Framework

College Council Policies:
– 2-A-02 Enrolment of FT Students in        – 2-C-05 Academic Standing
  a PS course                               – 2-C-06 Academic Withdrawals and
– 2-A-03 Admission of Students to College     Termination
  Applied Degree, Diploma and Certificate   – 2-F-01 FT PS Students Taking CE Courses
  Programs                                  – 2-G-01 Student Code of Conduct
– 2-A-10 Prior Learning Assessment          – 2-G-02 Student Appeal of a Decision
– 2-B-01 FT PS Academic Calendar              Affecting Academic Standing or
– 2-B-02 Content of College programs          Progression
– 2-B-10 Program and Course information     – 2-G-03 Student Concerns and Complaints
– 2-B-17 Graduation from Approved           – 2-G-04 Academic Offences
  College Programs                          – 2-G-06 Appeal of Decision Under Students
– 2-B-18 Fanshawe College Credentials         Code of Conduct
– 2-C-02 Evaluations                        – 2-J-03 Complaint Policy for Ombuds Office
– 2-C-04 Course Grade System
Policy Framework

College Council Policies:

           Advises the President on the creation,
           rescission, modification, and monitoring of
           academic policies and procedures of the
           College as well as other matters concerning
           the educational mission of the College
Policy Framework

Senior Leadership Council Policies:
– 2-A-01 Managing Program, Course and         – 2-B-22 FT PS Program Revitalization and
  Student Records                               Rationalization
– 2-A-09 The accommodation of Applicants      – 2-D-01 College Chaplain Services
  & students with Disabilities                – 2-E-01 Student Fees
– 2-A-11 Articulation / Credential            – 2-E-02 Student Awards
  Recognition                                 – 2-F-02 Program-Course Delivery Consistency
– 2-B-03 Review and Formal Evaluation of      – 2-I-01 London Campus Library Policy, Part 1 -
  College Programs                              Print Materials
– 2-B-04 Incidental Cancellation of Classes   – 2-I-02 London Campus Library Policy, Part 2 -
– 2-B-05 Academic Space Scheduling and          Interlibrary Loans
  Timetables                                  – 2-I-01 London Campus Library Policy, Part 3 -
– 2-B-06 Co-operative Education Programs        Non-Print Materials
– 2-B-12 Assigned Off Campus Academic         – 2-I-06 Instructional Equipment Loan Service
  Activity                                    – 2-J-01 Student Work Projects
– 2-B-19 Terms of Reference – College         – 2-J-02 Graduation Ceremonies
  Advisory Committees
Policy Framework

Senior Leadership Council Policies:

          Advises the President on:
          1) general policy and management issues;
          2) positioning the College as a results based
             organisation;
          3) change management and all new major
             initiatives; and
          4) alignment of College committees with
             core business and strategy.
Program Development / Renewal
Program Development / Renewal
Program Development / Renewal

New Program Development and Renewal

  10

   8

   6                          6                                                        6
          5                                                          5
   4                                               4
                                                                         3   3
   2                               1
                                                                                                2
                0
                    1                   1              1   1                                1
   0
       Sep 07 - Apr 08     Sep 08- Apr 09       Sep 09-Apr 10    Sep 10-Apr 11       Sep 11-Apr 12

                    New Programs       Program Modifications    Suspended Programs
Program Development / Renewal

Balanced Scorecard – Performance Metrics
 Pathways, Student
                        Program Quality     Student Activity       Financial Quality
 Choice and Labour
                             (25%)              (25%)                   (25%)
   Market (25%)

                     Balanced Scorecard Scale: 1 - 5
 Unsatisfactory       Marginal      Satisfactory     Very Good         Exceptional
   1 – 1.75          > 1.75 – 2.5   >2.5 – 3.25      >3.25 – 4.0          >4.0
Program Development / Renewal

Pathways, Student Choice and Labour Market
  Pathways - 25%
  Articulations - 25%                                                       >= 5 (ON and
                                         0       1-2      3       4-5
  (n.a. for Prep & Grad Certs)                                                beyond)
  External Formal
                                         0                1                     2+
  Collaborations - 0%
  Laddering - 25%                        0                1                     2+

  Bridging - 25%
                                         0                1                     2+
  (n.a. for Grad Certs)
  Level 1 Course Failure Rate
                                       > 1 SD   > Mean   Mean   < 0.25 SD      < 1 SD
  25%
  Student Choice - 25%
  # of Delivery Options
                                         1                2                     3+
  50%
  # of Intakes
                                         1           2    3        4            5+
  35%
  # of Interprofessional
                                         0                1                     2+
  Collaborations -15%
  Labour Market Responsiveness - 50%

  KPI Related Employment - 100%*       < 1 SD   < Mean   Mean   + 0.5 SD       + 1 SD

  PATHWAYS, STUDENT CHOICE AND LABOUR MARKET - 25%                           Sub-Score
Program Development / Renewal

Program Quality
  Program Excellence - 40%
  KPI Student
                                         < 1 SD    < Mean     Mean       + 0.4 SD      + 1 SD
  Satisfaction - 25%*
  KPI Graduate
                                         < 1 SD    < Mean     Mean       + 0.4 SD     + .75 SD
  Satisfaction - 25%*
  KPI Employer
                                         < 1 SD    < Mean     Mean       + 0.3 SD     + 0.5 SD
  Satisfaction - 0%*
  KPI Graduation
                                         < 1 SD    < Mean     Mean      + 0.75 SD     + 1.25 SD
  Rate - 25%*
  Program SFS Score
                                         < 1 SD    < Mean     Mean      + 0.75 SD     + 1.25 SD
  10%
  OSAP Default Rate - 15%                > 1 SD    Mean +     < Mean    < 0.25 SD      < 1 SD
  Accreditation, Certification & Licensing - 40%
  Program
                                            n.a.    NO       PARTIAL      FULL
  Accreditation - 50%
  Graduate Testing
                                           < 60    61 - 70    71 - 80    81 -90         > 90
  Outcomes - 50%
  Applied Research - 20%
                                                                 1          2       3+ INT or >=1
  Student Research 50%                       0
                                                             INTERNAL   INTERNAL         EXT
                                                                 1          2       3+ INT or >=1
  Faculty Research -50%                      0
                                                             INTERNAL   INTERNAL         EXT
  Faculty Scholarship - ON HOLD
  Experiential Learning - ON HOLD
  PROGRAM QUALITY - 25%                                                              Sub-Score
Program Development / Renewal

Student Activity
  Conversion Rate - 40%

  Eligible Applicants to
                               7:1
  Target - 50%

  # of Offers to Reg as of
                               >5:1     3.6-5:1       3-3.5:1      2-3:1
Program Development / Renewal

Financial Quality
  Revenue - 25%

  PS Grant

  PS Tuition

  International Tuition                Revenue amounts by category for information purposes only

  Misc Rev /Prog
  Specific/ Co-op Fees

                                                               $500,001 -       $1,000,001 -   $3,000,000 and
      Total Revenue
Program Reviews
Program Reviews

Framework:                           Be conducted for all
                                     programs a minimum of once
•   MTCU Binding Policy Directives   every 5 years. For programs
•   Board Policy D-36                that require mandatory
                                     accreditation, the program
•   College Policy 2-B-03            review is to occur at least
                                     one year before the
•   College Policy 2-B-22            accreditation. In addition
                                     there is a 1 year follow up
Program Reviews

Framework:                               Be conducted for all
                                         programs a minimum of once
•   MTCU Binding Policy Directives       every 5 years. For programs
•   Board Policy D-36                    that require mandatory
                                         accreditation, the program
•   College Policy 2-B-03                review is to occur at least
                                         one year before the
•   College Policy 2-B-22                accreditation. In addition
                                         there is a 1 year follow up

          116 FT programs
                              / 5    =       37
          68 CE programs
Program Reviews

    Program Review Event Flow Chart
                                 Event 1: Program Identified

                           Event 2: Orientation to Process Meeting

                           Event 3: Program Mapping Phase I and II

Fanshawe uses         Event 4: Review of S&P data and Int. Assess. report
an 8 step / event
model for its
Program Reviews            Event 5: External Focus Group Meetings

                                Event 6: Final Report Creation

                            Event 7: Presentation of report to CAC

                                Event 8: Action and Follow Up
Key Performance Indicators
Key Performance Indicators

Role of KPIs:
• Are mandated by the Ministry of Training Colleges and
  Universities (MTCU)
• Are carried out on an annual basis by a third party
  company the collects data on all 24 Ontario colleges.
• KPI results can positively / negatively impact a portion of
  the General Purpose Operating Grant (GPOG)
• Provide benchmarking data for the colleges on how they
  are doing against their own past performance as well as
  against the other colleges
Key Performance Indicators

KPI Graduation Rate
Fanshawe vs. Province
  75%

  70%                                                                                     69.3%

  65%
                                                                                          65.0%

        60.1%
  60%

                56.1%
  55%

  50%
         2005/06        2006/07   2007/08        2008/09          2009/10   2010/11   2011/12

                                      Fanshawe         Province
KPI Student Satisfaction with Overall Quality
                       Of Learning Experiences in the Program

                               82%               83%               81%               81%               80%

    100%                 80%               82%               80%               82%               81%

     80%                             82%                                                   81%
                   82%                                 80%               80%

     60%

     40%

     20%

      0%
               2007/08          2008/09           2009/10           2010/11           2011/12

                                Province         Southwest Ontario *           Fanshawe

*Southwest Ontario Colleges includes Conestoga, Fanshawe, Lambton and St. Clair
KPI Student Satisfaction with Overall Quality of Learning
Experiences in the Program – Fanshawe’s Provincial Placement

  100%

           88%       89%                                     88%            87%
                                       87%
   90%

                     83%
            82%                        81%                   81%
   80%                                                                      80%

            77%      77%                                                    76%
   70%                                 73%                   72%

   60%
          2007/08   2008/09           2009/10              2010/11        2011/12

         Fanshawe   Highest College             Lowest College       Provincial Avg
Key Performance Indicators

   KPI Employment Rate

                                         92%               89%               87%               85%               86%
                                   91%               91%
             100%                                                      86%               85%               84%
                             91%
                                               89%
              80%                                                85%               83%               83%

              60%

              40%

              20%

               0%
                         2006/07          2007/08           2008/09           2009/10           2010/11

                                          Province         Southwestern Ontario          Fanshawe

* Southwestern Ontario Colleges include Conestoga, Fanshawe, Lambton, Mohawk, Niagara and St. Clair Colleges
Professor Feedback by Mean Score
                             Full-Time Post-Secondary Programs

         5.00

                           4.41   4.41    4.41   4.35                       4.36   4.37   4.40    4.35
         4.00

         3.00

         2.00

         1.00

         0.00
                                       Fall                                          Winter

                             2008/09                2009/10           2010/11                 2011/12

Instructional Feedback Survey (IFS) was revised and renamed to the Student Feedback Survey (SFS).
The SFS was rolled-out College-wide in Fall 2011.
Key Performance Indicators

KPI Employment Rate
     90.0%

     88.0%
             Fanshawe’s Employment Rate = 86%
     86.0%

     84.0%

     82.0%

     80.0%                                    84%
                      83%
                                                                                              81%
     78.0%                                                            81%

     76.0%
                    Province              ITAL Colleges          Access Colleges          Large Colleges

                                           2010/11 Results      Fanshawe

  • ITAL include Humber, Conestoga, and Sheridan
  • Access Colleges include Centennial, Fanshawe, George Brown, and Mohawk
  • Large Colleges include Algonquin, Centennial, Fanshawe, George Brown, Humber, Mohawk, Seneca, and Sheridan
Key Performance Indicators

KPI Graduate Employment Rate
Fanshawe’s Provincial Placement
   100%

            94%       94%
   95%

            92%                                             91%          90%
                                         89%
   90%
                      89%
                                         87%
   85%                                                      85%          86%
            86%
                      84%
   80%

                                         77%
   75%
                                                            74%
                                                                         73%
   70%
          2006/07    2007/08            2008/09            2009/10     2010/11

          Fanshawe    Highest College             Lowest College     Provincial Avg
Key Performance Indicators

KPI Employer Satisfaction Rate
      95.0%

              Fanshawe’s Employer Satisfaction Rate = 93.5%

      94.0%

      93.0%

      92.0%

                                              93.2%
                     92.8%
                                                                         92.5%                92.6%
      91.0%

      90.0%
                    Province               ITAL Colleges             Access Colleges      Large Colleges

                                                   2010/11 Results

  • ITAL include Humber, Conestoga, and Sheridan
  • Access Colleges include Centennial, Fanshawe, George Brown, and Mohawk
  • Large Colleges include Algonquin, Centennial, Fanshawe, George Brown, Humber, Mohawk, Seneca, and Sheridan
External Audits and Accreditations
External Audits and Accreditations

• In addition to the internal QA structures, the
  college also undergoes regular external reviews:
  – Program Quality Assessment Process Audit (PQAPA)
  – Post Secondary Education Quality Assurance Board
    (PEQAB)
  – External program accreditations
External Audits and Accreditations

PQAPA:
• Is administered through the Ontario College Quality
  Assurance Service
• Occur on a 5 year cycle
• Low ratings can impact part of the GPOG allocation for
  college funding (as can low KPI ratings)
• OCQAS has been internationally accredited by the
  International Network of Quality Assurance Agencies for
  Higher Education (INQAAHE) and as of 2015, will shift
  PQAPA from an audit structure to an accreditation
  structure
External Audits and Accreditations

Overview of the PQAPA Process:

                              Source: http://www.ocqas.org/process.html
External Audits and Accreditations

PEQAB:
• Ministerial consent is required for anyone seeking,
  either directly or indirectly, to grant a degree
• There is a application process to PEQAB
• PEQAB reviews degrees and makes a recommendation
  to the Minister for approval
• College degrees are approved through this process
• The approval for the degree is normally 5-7 years and
  then the Colleges have to undergo a Consent for
  Renewal (re-accreditation)
External Audits and Accreditations

External Accreditation:
• Many programs at Fanshawe undergo a regular program
  accreditation:
   – The majority of the Nursing and Health Science programs require
     external accreditation from various bodies ranging from the CMA,
     CASN, CoDH, CoPh, etc. for students to be eligible for entry to
     practice
   – Programs such as Transport Canada aviation programs also require
     mandatory accreditations and audit as a condition for entry to
     practice
   – Other programs may not require mandatory accreditation but
     pursue accreditation as a means of ensuring currency
• Accreditations can range in length from 1 year to 7 years
Concluding Comments
Concluding Comments

 Quality Assuranceof High Quality organisations
Characteristics
 • is a means of ensuring consistency
 • it does not guarantee quality
 • but it can provide the basis for quality by:
    on-going self evaluation
    comparison of how your institution is performing relative
     to other institutions / organisations
    setting standards to achieve and measuring progress
     toward(s) targets
    Pushing for continuous quality improvement
You can also read