Washington State University Modernization Initiative - ISG Prepared by: OCIO ...
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
Washington State University Modernization Initiative Quality Assurance Assessment – January 16, 2021 – February 15, 2021 Prepared by: ISG February 22, 2021 Copyright © 2021 Information Services Group, Inc. All Rights Reserved
February 22, 2021 Stacy Pearson Project Executive Sponsor and Vice President, Finance and Administration Washington State University Finance and Administration PO Box 641046 Pullman, WA 99164-1045 Sue Langen Deputy Director for Strategy & Management Office of the Chief Information Officer 1500 Jefferson St SE Olympia, WA 98504 Nicole Simpkinson Assistant Director Office of the Chief Information Officer 1500 Jefferson St SE Olympia, WA 98504 Dear Ms. Pearson, Ms. Langen, and Ms. Simpkinson: ISG has completed its Quality Assurance Assessment (the Assessment) of the Washington State University (WSU) Modernization Initiative (the Project) for the period January 16, 2021 through February 15, 2021. This month the Modernization Initiative Steering Committee will convene on Wednesday, February 24. The timing of this assessment provides timely reporting to the Steering Committee. The Assessment was completed in accordance with the requirements of WSU and the State of Washington Office of the Chief Information Officer (OCIO). Workday Project Moves to Support Phase The Project team took WSU live with the Workday Human Capital Management software in December and the Workday Financial Management software beginning in January. The implementation continues to proceed relatively smoothly although a variety of service items have been identified and collectively have the potential to impact the perception of the transition. Delays in invoice payments against contracts represent a risk to the project and the University as WSU’s vendor community registers concerns to campus, college, and central units. The Project Management Office (PMO) meets daily to remain in close communication, assess Project status and address critical topics. Service Requests The PMO reviews service desk statistics daily. These statistics include: Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page i
• Service tickets created and resolved; • Time to resolution; • Source group (e.g., Bursar, General Accounting, HR Services, Payroll, Purchasing); • Workload assignments by Project team member; and • Service tickets by priority (e.g., critical, high). As of February 15, key service desk statistics reported the following: Current QA Previous QA Reporting Period Reporting Period Service Desk Metric (1/16 – 2/15) (1/6 – 1/15)* Total Change Service Requests Submitted 3,760 4,237 7997 -11% Service Requests Resolved 3,594 3,621 7235 -- Resolution Rate 95.6% 85.5% -- 12% Time to Resolution (Days) 1.38 .84 -- 64% Satisfaction Level 4.9 4.9 -- -- *Last month’s QA report included slightly different statistics for the January period due to difference in metric reporting period start and end dates. Trends reported in this schedule are not materially impacted by these revisions. Green shading indicates a positive trend. Service requests and resolution rates are trending positively. Time to resolution remains respectable but has increased due to the time required to resolve higher priority service tickets which are more complex. For the 30 days ending February 16, the Project team met Service Level Agreement (SLA) standards at approximately an 83% rate. Service tickets classified as critical and high have increased from less than ten in the January time frame to the mid-twenties during February. These service tickets relate to a variety of topics, each with a different breadth of impact on the WSU community. Some involve misunderstandings and other items requiring communications with the community. Some relate to conversions, configurations, practices, or reporting. Service tickets related to certain types of invoice payments and particular aspects of grant processing and reporting are most likely to have the broadest impact. February progress has been reported against these unresolved tickets with one exception – a service ticket directed at payroll expenses with a cost share grants worktag which do not appear on Budget to Actual with Encumbrances comparisons. The PMO reviews service tickets classified as critical and high daily. WSU leadership works with the relevant central offices to prioritize resolution tasks with other project and operational tasks. Similarly, Project team members participating in cutover met daily through January 22 to assess progress in terms of data loads, integrations, and reporting, and to methodically proceed through the detailed Project cutover plan. As of February 15, only 26 of the more than 1,400 action items on the plan remained outstanding. Fifteen of the 26 items were not yet due for completion. The eleven outstanding action items primarily related to defect resolutions, bond Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page ii
debt, bank reconciliations, invoice payments on sponsored accounts, and accounts receivable balances. The two conversion-related defects that remain outstanding are currently being reviewed by the responsible central offices and are reported to be nearing completion. Except for the invoice payments and accounts receivable balances, these items have limited impact on the broader WSU community. The Project team hopes to address all the action items prior to the departure of the Deloitte team at the end of March. ISG observed that the conversion process continues to be professionally managed. Members of the WSU user community have accessed knowledge base articles, which are available through the Project website, on approximately 35,000 occasions, up from 23,000 as of January 15. As we noted last month, service desk requests to-date have not been as significant as anticipated given the issue with lower than expected enrollments in Workday training courses. Integrations and Reporting The Project team continues to meet with the Controller’s Office and the State Office of Financial Management (OFM) to finalize work on the Workday – Agency Financial Reporting System (AFRS) interface. Payroll transaction processing – one of the last remaining unresolved items -- has now been successfully addressed. The gift calculator integration has successfully run, and quarterly distributions made. The Project team advanced a new reporting strategy during the assessment period. The strategy focuses on directing college and departmental users to a limited set of currently available reports that are most useful, in preference to completing development of the remaining lower priority report. Reporting team leadership indicates repeated requests for the legacy Business Objects-based “webi budget statements.” Project leadership is aware of these requests and is addressing them by suggesting alternative, Workday-based approaches to providing the information provided previously on the webi statements. Project leadership continues to meet with campus groups and members of the campus community. Feedback is reportedly wide-ranging and, in some cases, reflects the impact of a high level of change on campus, college, and central unit operations resulting from COVID adaptations including funding and staff reductions, spring semester start-up, and the Workday implementation, among other factors. In our January report, we highlighted a post-cutoff observation; namely, that the backlog of invoices awaiting payment in Accounts Payable has grown to a level requiring WSU management attention. Invoices were and reportedly continue to be arriving for payment faster than they can be processed. The elapsed time associated with manual processing of invoices against legacy purchase orders and contracts is problematic and is the primary reason for the backlog. WSU management is aware of this situation and committed to taking steps to address the backlog which include (1) revising the business processes, (2) revising the Workday configuration and (3) temporarily increasing staffing. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page iii
We understand that the business process has been revised. We are unaware of additional changes other than approval for recruitment of additional staff. We are also unaware of reporting related to the University’s backlog of vendor invoices. Although currently a risk to the Project, continuation of this trend has the potential to become an issue that can impact the Project’s success. We note this as a risk in the report and recommend that the PMO review statistics regarding the backlog and actions underway to address it during the daily PMO meeting. Sustainment In previous reports, ISG has suggested labs to allow unit members to convene (most likely virtually) so they could develop, confirm, and practice local procedures. These labs would be supported by Project team members, most likely Business Analysts. Labs remain in the queue of potential Project activities and will be available if Project resources are sufficient. Project leadership has given considerable thought to “assisting the learning curve of end users” and has identified three potential approaches. These include: 1. Listening sessions with the AFOs and their departmental administrators. These would involve eight 60-minute sessions over an 8-week period. College with similar service models could potential participate in the same session. 2. Workshops or open office hours by functional area. These 60-minute sessions would focus on topics such as a) payroll, time and labor, and benefits; b) procurement and expense; c) grants; d) journals – expense changes and budget transfers; and e) recruitment and general Human Resources 3. Reporting sessions which also address security roles introduced by Workday. After confirming the approach with participants, these sessions would provide for an iterative process of addressing and deploying five to ten reports during each iteration. As of February 15, consideration of these approaches remained on-going. Project leadership and Business Analyst availability will be a primary factor in these considerations. During the assessment period, the Project team began reviewing the Workday 2021 R1 update. As we noted in the January report, we also suggest that Project management provide additional consideration to the post-go live organization structure and related roles and responsibilities. Project Status The PMO Status Report for the week ending February 12 was reviewed during the February 16 PMO meeting. The report classifies the overall Project status rating and all components as “green.” ISG classifies the overall Project status as “green” although we believe that invoice processing backlog and throughput should be addressed through periodic PMO review of backlog and throughput statistics until vendor payments are being made timely. Project Activity Project activities during the current assessment period have focused on: Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page iv
• Prioritizing action items; • Resolving a subset of identified defects; • Investigating and resolving a subset of configuration items requiring attention; • Moving remaining financial integrations toward completion; • Addressing tickets received through the Service Desk; • Executing many of the last few remaining tasks in detailed cutover plan; • Issuing the Project monthly newsletter, and preparing other communications to WSU leadership and the WSU community; • Engaging with WSU institutional, academic, and administrative leadership to provide information regarding the status of outstanding items; • Updating the Project website; and • Updating and elaborating the Project Workplan. Assessment Structure This document is structured as follows: 1. Executive Summary We summarize significant data points, progress toward the achievement of important project activities or milestones, and our observations, findings, and recommendations in this section. We also present a high-level dashboard overview. 2. Project Progress and Detailed Assessment by Project Management Area As required by the OCIO and consistent with best practice, we present our initial observations, findings, and recommendations organized by the ten practice areas of project management as promulgated by the Project Management Institute. These ten areas encompass the critical activities of a successful project. 3. Summary of Findings We summarize findings from our assessment with corresponding recommendations. This section will include new findings, as well as open and completed findings. Thank you for this opportunity to serve WSU and the State of Washington. I attest that ISG has prepared this report independently. Please contact me with any questions or comments. Sincerely, David Hemingson, Partner ISG Public Sector Email: isg_usa.highered@isg-one.com Phone: (512) 231-9212 Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page v
Table of Contents EXECUTIVE SUMMARY ......................................................................................................................................... 1 Overview................................................................................................................................................ 1 Dashboard ............................................................................................................................................. 2 ASSESSMENT OF PROJECT PROGRESS ............................................................................................................ 4 Schedule ................................................................................................................................................ 5 Budget ................................................................................................................................................... 6 QUALITY ASSURANCE ASSESSMENT................................................................................................................ 7 PMBOK Practice Area 1: Integration Management .............................................................................. 8 PMBOK Practice Area 2: Scope Management ...................................................................................... 9 PMBOK Practice Area 3: Schedule Management ................................................................................. 9 PMBOK Practice Area 4: Cost Management....................................................................................... 10 PMBOK Practice Area 5: Quality Management .................................................................................. 10 PMBOK Practice Area 6: Resource Management ............................................................................... 11 PMBOK Practice Area 7: Communication Management .................................................................... 13 PMBOK Practice Area 8: Risk Management ....................................................................................... 13 PMBOK Practice Area 9: Procurement Management ........................................................................ 14 PMBOK Practice Area 10: Stakeholder Management ........................................................................ 14 ASSESSMENT OF THE ACCURACY OF THE PROJECT’S TRACKING OF PROGRESS ......................... 17 RISK ASSESSMENT .............................................................................................................................................. 18 SUMMARY OF OBSERVATIONS ....................................................................................................................... 19 SUMMARY OF OPEN FINDINGS ....................................................................................................................... 20 ISG QUALITY ASSURANCE METHODOLOGY ............................................................................................... 21 Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page vi
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 Executive Summary ISG Public Sector (ISG) presents this Quality Assurance (QA) Assessment Report for the Washington State University (WSU or the University) Modernization Initiative for the period January 16, 2021 through February 15, 2021 (the assessment period). Overview This is the thirtieth monthly QA Assessment Report presented by ISG in its role as QA consultant for the WSU Modernization Initiative (the Project). With respect to earlier QA Assessment Reports, we conclude that Project leadership continues to consider the recommendations presented in the reports and is acting to address them. Workday Human Capital Management (including payroll) went live in December 2020. Financials and Procurement processes were activated in January 2021. ISG classifies the overall Project status as “green” although we believe that invoice processing backlog and throughput should be addressed through periodic PMO review of backlog and throughput statistics until vendor payments are being made timely. ISG reports no issue that we classify as a finding.1 We make several observations, noting several risks that will be monitored as the Project progresses.2 We will continue to monitor these risks. 1 An issue is “a situation that is certain and that could affect Project success in a positive or negative manner.” 2 A risk is “an uncertain situation, the likelihood of the situation, and the impacts (which can be positive or negative) that the occurrence of the situation would have on Project success.” Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 1
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 Dashboard This dashboard presents an overview of our assessment of the Project and the ten Project Management Book of Knowledge (PMBOK) practice areas as of February 15, 2021. Project Status Change since Last Findings & Project Management Area Area Status Assessment Observations 1. Integration Management Risk Continues 2. Scope Management -- 3. Schedule Management Risks Reduced 4. Cost Management -- 5. Quality Management -- 6. Resource Management Risks Reduced 7. Communication Management -- 8. Risk Management -- 9. Procurement Management -- 10. Stakeholder Management Risks Reduced Findings & Traditionally High-Risk Areas* Area Status Observations 1. Change Management 2. Integrations/System Remediations 3. Reporting** * Areas that have proven to be high-risk during the implementations of enterprise systems at research universities like WSU. ** Generation of dashboards, analytics, queries, and reports needed for decision-making at all levels of the University and for compliance with regulatory and other third-party reporting. This includes reporting that is impacted by the replacement by Workday of current HCM and Financial data sources. ISG Monitored Areas* Rationale 1. PMO Troika Variance from best practice 2. Inter-agency Agreements Criticality to project success 3. Lack of Critical Path Variance from best practice * Areas monitored by ISG but not rising to a level that requires Project leadership’s attention at this time. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 2
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 Legend Assessment Status Change Risks/issues being addressed Neutral; risks/issues partially being addressed or newly listed Risks/issues increasing Area Status Major finding likely to adversely impact project progress or outcome Finding/issue requiring attention or observation/risk being addressed and monitored No finding or observation requiring action at this time Findings & Observations Finding(s)/issue(s) noted Finding(s)/issue(s) and observation(s)/risk(s) noted Observation(s)/risk(s) noted No finding or observation at this time Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 3
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 Assessment of Project Progress The Project continues to operate in a work-from-home environment. This will continue for the foreseeable future. ISG assigns the Project a “green” status although we believe the risks resulting from the lack of reporting and periodic PMO review of invoice processing backlog and throughput should be addressed. Our observation regarding invoice processing is described in the Integration Management practice area. The Project team continues to: • Develop deliverables corresponding to tasks in the Project Workplan; • Execute Support Phase tasks; and • Elaborate the Project Workplan. Project Staffing The WSU Core Finance and Budget Lead role remains open. Other Project team members have filled this role in the interim but as the Project moves past the initial Support phase this position may need to be filled. Several members of the project team have been out due to personal or family illness. The Deloitte Project Manager has been out for an extended period. His leadership has been missed. Deloitte has provided coverage in his absence. The WSU Change Management Lead has returned from maternity leave. Deloitte Staffing Commitment Deloitte’s original contract was fixed cost. Current services as part of the timeline extension provided by Deloitte under the recently modified SOW are now paid on a time and materials basis. Deloitte’s commitment cumulatively throughout the Project substantially exceeds the anticipated hours presented in the SOW. With respect to the additional services that Deloitte is providing on a time and materials basis, WSU Project management has indicated that Deloitte is meeting WSU expectations. Project Deliverables Status The Deliverables Log indicates that all Support Phase Deliverable Expectation Documents (DEDs) have been submitted to WSU and all have been accepted. WSU formal acknowledgement of Cutover is being reviewed by WSU. The following Support Phase deliverables remain outstanding: • Support – Mid-phase Status Report; Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 4
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 • Lessons Learned; • Final Engagement Report; and • System Acceptance Checklist. The Lessons Learned deliverable is in development. Development of the three other document has yet to begin. All Project deliverables are due for completion by March 12, 2021. ISG has not but would request the opportunity to review all Deploy Phase and Support Phase deliverables. To-date, 3 of the 4 Deploy Phase Deliverable Expectation Documents (DEDs) and half of the Support Phase deliverables have been made available for ISG review. Most deliverables reviewed by ISG have been of quality. In those instances when ISG has not found the deliverables to be of quality, ISG has presented WSU with recommendations to bring the deliverables to a leading practice standard. Project deliverables are being classified consistent with guidelines in the Project Charter and are being posted on a Deliverables Log accessible through the internal Project web site maintained by Deloitte. Project Workplan Project leadership routinely updates the Project Workplan. Based on our assessment of the Project Workplan this period, we conclude that it accurately reflects the status of the Project at this time. Schedule During the assessment period, the Project team: • Prioritized action items; • Resolved a subset of identified defects; • Investigated and resolved a subset of configuration items requiring attention; • Moved remaining financial integrations toward completion; • Addressed tickets received through the Service Desk; • Executed many of the last few remaining tasks in detailed cutover plan; • Issued the Project monthly newsletter, and prepared other communications to WSU leadership and the WSU community; • Engaged with WSU institutional, academic, and administrative leadership to provide information regarding the status of outstanding items; and • Updated the Project website The PMO: • Updated the Project Workplan for current activity; Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 5
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 • Encouraged documentation of project decisions in the Risks, Actions, Issues and Decisions (RAID) log; and • Actively addressed risks including those identified in earlier QA reports. We find that the Project Workplan is being updated on a timely basis. We will continue to monitor the Project Workplan as the Project moves forward. The Project Workplan presents a high-level timeline for the Project with estimated completion dates. The final phase (i.e. the Support Phase) is estimated for completion in mid-March 2021. Budget The Project is operating with sufficient budget. Project Management has provided ISG with a monthly project spend plan for the current fiscal year and an updated report of actual expenses through January 2020. The report indicates that budget tracking is reasonably current, that WSU had allocated a contingency that we consider reasonable and prudent for the Project timeline, and that the Project was running an overall positive variance, before consideration of the contingency. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 6
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 Quality Assurance Assessment ISG presents below its Quality Assurance Assessment for the time period January 16, 2021 through February 15, 2021 (the assessment period). We report our assessment of Project performance for each of the ten Project Management Book of Knowledge (PMBOK) practice areas: 1. Integration Management 6. Resource Management 2. Scope Management 7. Communication Management 3. Schedule Management 8. Risk Management 4. Cost Management 9. Procurement Management 5. Quality Management 10. Stakeholder Management Each section below begins with a definition of the respective practice area. Please refer to the final section of this report, ISG Quality Assurance Methodology, for a description of the ISG Quality Assurance methodology that serves as the basis for this Assessment. On the following pages, ISG discusses the status of each of the ten Practice Management Book of Knowledge (PMBOK) practice areas. As appropriate, we identify observations, findings, risks, and issues and, for each observation or finding, we describe the impact, present our recommendation and report status. Risks and issues are defined consistent with PMBOK standards. A risk is “an uncertain situation, the likelihood of the situation, and the impacts (which can be positive or negative) that the occurrence of the situation would have on Project success.” An issue is “a situation that is certain and that could affect Project success in a positive or negative manner.” The OCIO requires WSU responses to issues raised in QA reports. We commend WSU for its timely attention to both risks and issues, and for its transparency in presenting written responses. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 7
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 PMBOK Practice Area 1: Integration Management Integration management includes the processes and activities needed to identify, define, combine, unify, and coordinate the various processes and project management activities within the project management process groups. Discussion Coordination with Resources Outside the Project Timely completion of operational tasks is dependent upon successful integration with resources not within the direct control of Project leadership. WSU management has concluded that the backlog of invoices awaiting payment in Accounts Payable has grown to a level requiring attention. Invoices are arriving for payment faster than they can be processed. The elapsed time associated with manual processing of invoices against legacy purchase orders and contracts is problematic and is the primary reason for the backlog. Risk Delay in payments for an extended period has the potential to impact the University’s reputation with the supplier and university community, impact the University’s credit standing, and result in suppliers refusing to partner with the University. Recommendation We recommend that WSU and Project management continue to identify ways of reducing the elapsed time required to process invoices against legacy purchase orders and contracts, and monitor progress in reducing the time. We recommend that Project leadership report the status of the backlog daily. Status WSU management is aware of this situation and is taking steps to address the backlog which include (1) revising the business processes, (2) revising the Workday configuration and (3) temporarily increasing staffing. Project management believes that the elapsed time will be reduced as legacy purchase orders are closed. Project management has reported steps taken to address the backlog but has not established a practice of reporting the status of the backlog to the PMO. Status reports may include total invoice backlog count, invoice backlog count by type (e.g., related to legacy purchase order, related to Workday purchase order, unrelated to a purchase order), invoices received and processed by day, and the like. Although currently a risk to the Project, continuation of this trend has the potential to become an issue that can impact the Project’s success. ISG will continue to monitor this risk. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 8
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 Observations regarding the Project Workplan are presented earlier in the “Project Workplan” section of “Assessment of Project Progress.” Observations regarding end user community engagement are presented in the Stakeholder Management section below. PMBOK Practice Area 2: Scope Management Scope management includes the processes required to ensure that the Project includes all the work required, and only the work required, to complete the Project successfully. Discussion University Stores had planned to implement a new inventory system separate from Workday and the Project team planned accordingly. The new system has not been implemented. ISG acknowledges that implementation of inventory functionality in Workday was not in Project scope. Although not a Project risk, this does represent a risk to WSU. Status ISG has identified no reportable Project risks or issues in this area at this time. PMBOK Practice Area 3: Schedule Management Schedule management includes the processes required to manage the timely completion of the Project. Discussion Report and Integration Development Report development efforts have proven to be challenging for the Project team, as they are traditionally for similar projects. The AFRS integration with the OFM is nearing completion. Completion of the AFRS integration will likely remove integrations from the list of risk areas next month. Risk Design, build, and unit test of reports and completion of a few integrations are among the set of tasks past due and/or represent a risk area. Recommendation Continue to monitor these. As appropriate, apply additional Project resources in support of resolution of outstanding operational decisions. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 9
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 Status Development of reports classified as “critical” and “high” has been completed. Ninety-four reports classified as medium and low priority remain outstanding. These are currently projected to be fully completed by the end of April 2021. Reporting team leadership indicates repeated requests for the legacy Business Objects-based “webi budget statements.” Project leadership is aware of these requests and is addressing them by suggesting alternative, Workday-based approaches to providing the information provided previously on the webi statements. The Project team continues to work with the Controller’s Office and OFM to complete the AFRS integration. Payroll transactions have been addressed successfully but a limited set of items remain outstanding. The gift calculator integration has been completed and run, resulting in a successful quarterly distribution of gift funds. PMBOK Practice Area 4: Cost Management Cost management includes the processes involved in planning, estimating, budgeting, financing, funding, managing, and controlling costs so that the Project can be completed within the approved budget. Discussion Observations regarding the Modernization Initiative budget and spend plan are presented earlier in the “Budget” section of “Assessment of Project Progress.” Status ISG has identified no reportable risks or issues in this area at this time. PMBOK Practice Area 5: Quality Management Quality management includes the processes and activities of the performing organization that determine quality policies, objectives, and responsibilities so that the project will satisfy the needs for which it was undertaken. Discussion WSU has incorporated a quality assurance process into its deliverable development process. This process is documented in the Project Management Plan and has been accepted and put into practice by the Project team. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 10
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 We have observed the Project team continuing the cadence for Project deliverable definition and acceptance for deliverables outlined in the Deloitte SOW and included in the Project Workplan. In our assessment, the quality of DEDs, which we review following WSU’s review, and adherence to the definitions has been mixed. With a few exceptions that we have noted in our assessment reports, we have found the final products to be acceptable. Status ISG has identified no reportable risks or issues in this area at this time. PMBOK Practice Area 6: Resource Management Resource management includes the processes that organize, manage, and lead the Project team. Discussion ISG continues to find that WSU has staffed the team with a very professional Project team. We commend Project leadership for the high standards it has established and maintained. Departmental Resource Availability The Project team has analyzed the impact of Workday on departmental operations and continues to be cognizant of campus, college, and other unit interests. Steering Committee members have noted that their staff are experiencing high stress levels due to the complications of COVID-19 and other factors. Risk As Project Management recognizes, the Project is dependent upon resources outside the Project team to accomplish tasks in a timely manner. Recommendation ISG recommends that the Project team: • Continue providing the WSU community with effective communication of Project plans, activities, and decisions. • Continue to develop project plans and communicate anticipated area resource requirements and the timing of critical project activities. Develop and communicate support available to campus, college, and departmental units. • Establish an internal process to identify and resolve key user constraints or other bottlenecks in the impacted WSU community (i.e., outside the Project team). Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 11
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 Status WSU is aware of the risk and is acting to mitigate it. WSU continues to update the WSU community as plans are developed. The Project Team has held a series of Zoom-facilitated, open Workday Expert Q&A Panels to address user community questions. Panels addressed Accounting, Grants, Payroll, Time and Absence and Payroll. Project leadership has given considerable thought to “assisting the learning curve of end users” and has identified three potential approaches to future support. These include: 1. Listening sessions with the AFOs and their departmental administrators. These would involve eight 60-minute sessions over an 8-week period. College with similar service models could potential participate in the same session. 2. Workshops or open office hours by functional area. These 60-minute sessions would focus on topics such as a) payroll, time and labor, and benefits; b) procurement and expense; c) grants; d) journals – expense changes and budget transfers; and e) recruitment and general Human Resources 3. Reporting sessions which also address security roles introduced by Workday. After confirming the approach with participants, these sessions would provide for an iterative process of addressing and deploying five to ten reports during each iteration. As of February 15, consideration of these approaches remained on-going. Project leadership and Business Analyst availability will be a primary factor in these considerations. ISG will continue to monitor. COVID-19 Impact The COVID-19 pandemic has the potential to impact Project team members and other significant resources necessary for Project success. Risk A COVID-19 infection could incapacitate a member or members of the Project team or other significant resources necessary for Project success. Recommendation Continue to monitor the health and safety of Project team members. Develop a contingency plan in case a Project resource is incapacitated. Status During the assessment period, a member of the Project team contracted the COVID-19 virus. The ISG team hopes for his timely and full recovery. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 12
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 Project Management is aware of this risk. ISG will continue to monitor it. PMBOK Practice Area 7: Communication Management Communications management includes the processes that are required to ensure timely and appropriate planning, collection, creation, distribution, storage, retrieval, management, control, monitoring, and the ultimate disposition of project information. Discussion The Project team is maintaining project documentation in a reasonably effective and timely manner. The Project Deliverables Log details planned due dates for Deliverable Expectation Documents (DEDs) and the deliverables themselves, and review responsibilities for completed and current Project phases. As documentation reviews are completed, acceptance is noted in a timely manner. In addition, the Project team is maintaining the Modernization Initiative web site, http://modernization.wsu.edu. In our assessment, the web site represents an excellent orientation to the Project and provides an interested community member with an effective means of understanding the Project, its future course, and setting expectations regarding the impact of new business processes and the Workday software based on Project decisions. The web site communicates events well into the future so that the WSU community can plan to participate effectively in Project events. Status ISG has identified no reportable risks or issues in this area at this time. PMBOK Practice Area 8: Risk Management Risk management includes the processes of conducting risk management planning, identification, analysis, response planning, and controlling risk on a project. Discussion Project leadership is conducting risk meetings approximately monthly. Participation is meaningful and effective. In our assessment, the participants give serious consideration to Project risks and identification of mitigating actions to address them. In addition, key risk topics are reviewed with the Steering Committee. Status ISG has identified no reportable risks or issues in this area at this time. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 13
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 PMBOK Practice Area 9: Procurement Management Procurement management includes the processes necessary to purchase or acquire products, services, or results needed from outside the Project team. Discussion ISG believes the activities in this practice area are on track. Status ISG has identified no reportable risks or issues in this area at this time. PMBOK Practice Area 10: Stakeholder Management Stakeholder management includes the processes required to identify all people or organizations impacted by the project, analyzing stakeholder expectations and impact on the project, and developing appropriate management strategies for effectively engaging stakeholders in project decisions and execution. Discussion The focus on OCM-specific activities has increased as Workday moves into production. Project leadership, recognizing resource constraints, has moved local procedure workshops into the Sustainment period that follows go live. The objective of these workshops is to increase understanding of Workday business processes and increase user confidence in the ability to conduct local operations after Workday goes live. Unit Ability to Adapt to Business Process Changes Most HCM and Finance business processes will be impacted significantly by the introduction of Workday. Risk In some cases, it is not clear that academic and operating unit personnel understand how to adopt and accept the change brought about by the Workday implementation. Recent feedback from the user community indicates that some users are attempting to continue legacy practices using the Workday software. These attempts, in some cases, are creating frustration. User community frustration resulting from attempts of this nature is not unusual when new applications supporting new business processes are implemented. However, these frustrations are often indistinguishable by the user community from others related to temporary, small but inevitable defects in the initial software configuration. The Project team is addressing these defects, in most cases, Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 14
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 timely. The amalgamation of these frustrations in an environment dealing with the impacts of COVID increases the risk of user dissatisfaction. Recommendation As these units further refine their procedures, end users are likely to benefit from an opportunity to test proposed procedures and practice them as a group. Providing the Change Agents and Super Users the tools (e.g., practice tenant) and support to organize these practice sessions, allows them to work through points of concern that they may not encounter previously. WSU Project leadership has determined that resource constraints are such that training labs will not be available until Sustainment. Even with the delay in training lab availability, WSU Project leadership should consider a transition workshop, held with a broad set of units, to address key processes that are be critical to successful local operations. These workshops might be provided to groups of similarly organized units (e.g., central units, academic units with central school support). The Project team has used Zoom effectively to accomplish many Project tasks. We suggest that Zoom can be used to create an effective environment to conduct these labs. Status The Project team prepared a user engagement strategy and plan and departmental impact assessment. These efforts includes tasks to validate business process changes and impacts. The team had planned to publish business processes and anticipated that providing access to these will provide the user community with insight that will be helpful in addressing their interests. WSU Project leadership, recognizing resource constraints, moved local procedure workshops into Sustainment. This represents a risk to the Project that leadership should monitor. The Project Team hosted a set of Zoom-based, open Expert Q&A panels to address user community questions and is considering other approaches to respond to user community concerns. We noted these earlier in the Departmental Resource Availability observation. ISG will continue to monitor it as well. Faculty Readiness Overall readiness in the academic units includes engaging the faculty at the appropriate level for their system use and on a timeline that takes into consideration their academic duties. Risk Faculty will not be prepared for performing business processes/tasks in the new system due to lack of engagement or required training that conflicts with key academic timelines. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 15
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 Recommendation Work with change agents in academic units to fully understand faculty use of the system. Where possible depending upon level of use (core system, self-service), provide training options with flexibility (i.e. micro-learning). Status Training curriculum has been developed with multiple delivery channels. The Change Network is in place with representation from the academic units. The Project team has provided targeted communications to Deans regarding training sessions that are most applicable to faculty. Until grant conversion is complete and faculty have the opportunity to review the status of their grants using Workday reporting, faculty readiness will remain less than fully tested. ISG will continue to monitor this risk. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 16
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 Assessment of the Accuracy of the Project’s Tracking of Progress In ISG’s assessment, the Project Workplan accurately tracks Project progress. Our comments in the “Project Workplan” and “Schedule” sections of the “Assessment of Project Progress” present additional observations regarding the accuracy of the Project’s Tracking of Progress. We note that Status Reports presented at the PMO meeting and to the Steering Committee are deliverable-based and do not reflect all Project tasks reported in the Project Workplan. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 17
QA Assessment for the WSU Modernization Initiative Washington State University February 22, 2021 Risk Assessment ISG summarizes project risks and issues below which are potential or actual barriers to meeting project objectives and milestones, the probability of occurring and impact if they occur, and recommended and observed mitigations. Shaded entries indicate the observation or issue has been closed. Practice Area/Risk/Issue Probability Impact Recommended and Observed Mitigations 1: Risk: Coordination with Address slow throughput items in Accounts Resources Outside the Payable. Track and report invoice backlog Project Medium High until backlog is reduced. Communicate to user community that a set of reports will not be available at go live. Identify key reports from among numerous 3: Risk: Reports and reports available to address post-go live Integrations Medium Low reporting requests. Continue to assist AFOs and departmental users in prioritizing project-related activities. Continue to prioritize service ticket requests taking into consideration departmental requests/demands. Continue 6: Risk: Departmental to monitor the level of departmental Resource Management High Medium satisfaction. 6: Risk: COVID 19 Threat to Continue to monitor Project team health the Project Team Low Medium and safety during COVID 19 pandemic. Continue to respond to departmental requests for assistance in addressing 10: Risk: Unit Ability to process and reporting concerns. Encourage Adapt to Business Process adoption of new Workday-supported Changes High High processes. Leverage change agents to assess faculty satisfaction. Provide training recommendations tailored to faculty 10: Risk: Faculty Readiness Medium Medium interests. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 18
Summary of Observations The table below summarizes risks based on observations from ISG’s QA report as of February 15, 2021. Shaded entries indicate the observation has been closed. Status as of Practice Area/Observation February 15, 2021 1: Coordination with Resources Outside Project. Take steps to address delays in processing invoices related to legacy purchase orders and contracts. Track Monitoring and report backlog. Engage resources outside the Project on an interim basis to gain timely task completion. 3: Reports and Integrations. Monitor pace of development of remaining On-going: reports and completion of the AFRS integration. Monitoring 6: Risk: Departmental Resource Management. Continue to assist AFOs and departmental users in prioritizing project-related activities. Continue to On-going: prioritize service ticket requests taking into consideration departmental Monitoring requests/demands. Continue to monitor the level of departmental satisfaction. 6: COVID 19. Continue to monitor health and safety of the Project team. On-going: Develop contingency plan in case a Project team member is incapacitated. General Monitoring 10: Unit Ability to Adapt to Business Processes Changes. Continue to respond On-going: to departmental requests for assistance in addressing process and reporting Monitoring concerns. Encourage adoption of new Workday-supported processes. 10: Faculty Readiness. Engage faculty through change agents in academic On-going: units. Provide targeted training for faculty. General Monitoring Future reports will reference previous months’ observations that remain open. Open observations and findings closed during the reporting period will be listed and then deleted from the list the month following closure. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 19
Summary of Open Findings WSU has addressed all previous open findings as of ISG’s QA report of February 15, 2021. Shaded entries, if any, indicate the finding has been closed. Status as of Practice Area/Finding February 15, 2021 Recommendation Future reports will reference previous months’ findings that remain open. Open observations and findings closed during the reporting period will be listed and then deleted from the list the month following closure. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 20
ISG Quality Assurance Methodology ISG offers the following description of our Quality Assurance (QA) methodology for enterprise system implementation and organizational transformation projects. Overview ISG conducts QA assessments through: • Periodic review of project progress; • Participation in selected project activities with the objective of confirming representative and meaningful WSU participation, evaluating activity and activity leadership / facilitation (e.g., Deloitte, WSU) effectiveness; and • Review of project deliverables including review of Deliverable Expectation Documents for those deliverables. ISG’s objective is to assess the likelihood that the project activity and the project overall will achieve the expected outcome. This level of participation is designed to provide insight through limited participation in representative sessions, workshops, etc. that drives development of conclusions and recommendations more broadly applicable to the project activity or activities as a whole. ISG prepares monthly QA reports to assess project performance across the ten Project Management Book of Knowledge (PMBOK) practice areas: 1. Integration management 6. Resource management 2. Scope management 7. Communication management 3. Schedule management 8. Risk management 4. Cost management 9. Procurement management 5. Quality management 10. Stakeholder management The focus of the assessment will be forward-looking and phase specific. Development of transition and operational planning and readiness, including planned governance following implementation, will receive QA attention throughout the project. ISG’s QA services are based on significant experience in managing and reviewing numerous, large-scale systems projects for our higher education, state, and local government clients. ISG’s intent is to bring to bear our prior project oversight and QA experience and insights in order to prevent issues rather than reporting on issues after the fact. Examples of process areas that we will examine and assess during our reviews are shown in the following table. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 21
PMBOK Practice Area Sample topics included • Integration management - the processes and activities needed to identify, • Governance and sponsorship define, combine, unify, and coordinate the various processes and project • Managing the PM process management activities within the project management process groups. • Authority / delegation / decision-making • Scope management - the processes required to ensure that the project • Scope definition / requirements includes all the work required, and only the work required, to complete the • Scope change control project successfully. • Deliverables • Schedule management - the processes required to manage the timely • Effort reporting / forecasting completion of the project. • Progress towards milestones / gates • Cost management - the processes involved in planning, estimating, • Budget monitoring budgeting, financing, funding, managing, and controlling costs so that the • Estimating tools and processes project can be completed within the approved budget. • Budget forecasting • Quality management - the processes and activities of the performing • (Other than this QA report) organization that determine quality policies, objectives, and responsibilities • Quality planning so that the project will satisfy the needs for which it was undertaken. • Resource management - the processes that organize, manage, and lead the • Staffing from Contractor and WSU Project team. • Knowledge transfer • Communication management - the processes that are required to ensure • Project documentation / archives timely and appropriate planning, collection, creation, distribution, storage, • Planning and execution of retrieval, management, control, monitoring, and the ultimate disposition of communications project information. • Risk management - the processes of conducting risk management planning, • Identification and ranking of risks identification, analysis, response planning, and controlling risk on a project. • Monitoring and mitigation of risks Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 22
PMBOK Practice Area Sample topics included • Procurement management - the processes necessary to purchase or acquire • Contract management / SOW products, services, or results needed from outside the Project team. management • Software licensing • Stakeholder management - the processes required to identify all people or • Organizational readiness – planning and organizations impacted by the project, analyzing stakeholder expectations execution and impact on the project, and developing appropriate management • Business process redesign, role strategies for effectively engaging stakeholders in project decisions and definition/transition execution. • Training including training facilities, materials, job aids, etc. Copyright © 2021 Information Services Group, Inc. All Rights Reserved Page 23
You can also read