Washington State Department of Labor and Industries Conveyance Management System (CMS) Project - Quality Assurance Services - OCIO Dashboard
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
Washington State
Department of Labor and Industries
Conveyance Management System
(CMS) Project
Quality Assurance Services
Monthly Assessment Report
March 2021
April 23, 2021
ISG Quality Assurance Team
Name Title Phone E-mail
Gena Cruciani Engagement Manager 253.376.0439 gena.cruciani@isg-nw.com
Jeff Closson Quality Assurance Lead 816.598.3345 jeff.closson@isg-nw.com
Revision History
Revision Revision Date Name Notes
0.1 04/16/2021 ISG Draft for Review
0.2 04/21/2021 ISG & Project Team Incorporated PM Feedback
1.0 04/23/2021 ISG & Steering Committee Finalized Assessment with SC Feedback
i Conveyance Monthly Assessment Report - March 2021Table of Contents
Executive Summary ...................................................................................................................... 1
Assessment Period .................................................................................................................... 1
Executive Summary Dashboard .............................................................................................. 2
Historical View of Risk Ratings .................................................................................................. 3
Reporting Period Accomplishments ........................................................................................ 4
QA Recommendation Summary ............................................................................................. 4
High Priority Recommendations .............................................................................................. 4
Detailed Assessment Findings and Recommendations ............................................................ 6
1.0 Integration Management.............................................................................................. 6
2.0 Scope Management ..................................................................................................... 7
3.0 Schedule Management ................................................................................................ 8
4.0 Cost Management ........................................................................................................ 9
5.0 Quality Management .................................................................................................. 10
6.0 Human Resource Management ................................................................................. 12
7.0 Communications Management ................................................................................. 13
8.0 Risk Management ........................................................................................................ 14
9.0 Procurement Management ........................................................................................ 15
10.0 Stakeholder Management .......................................................................................... 16
Appendix A. ISG Discovery Interviews and Meetings.............................................................. 18
Appendix B. ISG Discovery Documentation ............................................................................ 19
Appendix C. ISG Framework Categories and Legend ........................................................... 20
ii Conveyance Monthly Assessment Report - March 2021April 23, 2021
Ms. Annette Taylor, Executive Sponsor
Deputy Assistant Director, Field Services & Public Safety
Washington State Department of Labor and Industries
RE: Conveyance Project - Project Quality Assurance
Contract No. K4443, SOW #3
Follow-on QA Assessment Report – March 2021
Dear Ms. Taylor,
Integrated Solutions Group LLC (ISG) is pleased to provide this Initial Readiness Assessment
Report, per our agreed upon Statement of Work (SOW) to provide Quality Assurance (QA)
services.
The QA Assessment Report that follows contains ISG's finding and recommendations for
the Conveyance Project. It is based on project team and stakeholder activities relative to
the baseline QA recommendations as well as assessment of new project activities and
deliverables.
The QA Assessment Report identifies findings, and recommendations that are based on
the professional experience and judgment of ISG's consulting team. The report was
prepared in an independent manner. Project participants and stakeholders were
consulted only for discovery interviews, informational inquiries, and validation of fact and
assumptions.
Thank you for the opportunity to provide QA services to the Conveyance Project. Please
let me know if you have any questions or comments.
Regards,
Gena Cruciani
Principal
Integrated Solutions Group, LLC
Cc: Robyn Garcia, Project Manager
iii Conveyance Monthly Assessment Report - March 2021Executive Summary
The objective of the Conveyance Project is to replace the Department of Labor and Industries
(L&I) Elevator Program's computer system (Conveyance Management System), used for
managing customer accounts, issuing invoices and permits, storing inspection, and violation
records, scheduling inspections, etc. The existing system is aging and failing. Further, it cannot
be modified cost-effectively to support program improvements recommended by an
independent audit requested by legislators.
The replacement system is intended to serve the Elevator Program with the potential to be
expanded to serve other licensing and permit programs, such as the Electrical Program and
Factory Assembled Structures.
Integrated Solutions Group (ISG) was retained in October of 2020 to provide Quality Assurance
assessment and reporting services to the L&I Executive Sponsor and the Office of the Chief
Information Officer (OCIO).
Assessment Period
The QA Assessment Report outlines ISG's findings from interviews, documents reviewed, and
observations from March 26th through April 22nd. ISG continues to observe a steady velocity as
the project finishes up the Discovery Phase and prepares to begin the Procurement Phase.
The project displays a high level of collaboration and a positive morale both internally and
with external stakeholders. The team and sponsors continue to be proactive and exemplify a
commitment to the objectives of the project.
ISG closed no recommendations and opened one (1) new recommendation during this
reporting period. High-level themes described in the detailed section of this report include:
1. Deloitte Consulting working to finish the Discovery Phase
Deloitte Consulting has now completed all the deliverables as part of the Discovery Phase
including the Fit Gap Assessment, the Market Assessment, and the Overall Assessment. The first
two deliverables have been presented to the Steering Committee, and the third will be
presented in the April meeting. All three of these deliverables will be used to inform the
procurement of a solution and should be incorporated into the Procurement Plan (see New
Recommendation 9.2).
2. Project controls being completed in preparation for the Procurement Phase
The team continues to work on the Project Management Plan (PMP) (Recommendation 1.2)
and several other critical project controls. Based on the delay in approving several of these
documents, the priority of several recommendations has been increased to High including
Recommendations 1.2 (PMP), 2.1 (Scope), 3.1 (Schedule) and 4.1 (Cost). ISG has also
increased the risk ratings of these categories to highlight the crucial nature of completing,
1 Conveyance Monthly Assessment Report - March 2021approving, and socializing these critical project controls. Completion of these foundational
project management controls is important prior to start of the procurement phase so the team
can focus on the next set of critical activities.
Executive Summary Dashboard
ISG assessed the Conveyance project using each of the ten (10) categories in the QA
Framework that align with the Project Management Institute (PMI) Project Management Body
of Knowledge (PMBOK) guidelines and OCIO policy 132. ISG's rating methodology is described
in further detail in Appendix C. ISG Framework Categories and Legend.
Figure 1: QA Assessment Dashboard
2 Conveyance Monthly Assessment Report - March 2021Historical View of Risk Ratings
ISG utilizes visual cues to indicate trending in each area's risk impact assessment, where a
down arrow reflects a lowering risk. Trending will be added to future monthly reports for
comparison purposes.
Impact Assessment Impact Assessment Impact Assessment
rating has decreased rating has not changed rating has increased
from previous from previous reporting from previous
reporting period period reporting period
Table 1: Risk Assessment Rating Trends
Management Impact Initial Jan Feb Mar
Category Trending Assessment Assessment Assessment Assessment
Overall Program Rating
1.0 Integration
2.0 Scope
3.0 Schedule
4.0 Cost
5.0 Quality
6.0 Human Resources
7.0 Communications
8.0 Risk
9.0 Vendor
10.0 Stakeholder
3 Conveyance Monthly Assessment Report - March 2021Reporting Period Accomplishments
✓ Submitted an updated Technology Budget and Gate 2 application for OCIO/OFM
approval
✓ Continued work on the Investment Plan
✓ Completed Discovery Phase Part 2: Market Analysis and presented to the Steering
Committee
✓ Completed Discovery Phase Part 3: Overall Analysis
✓ Continued developing the Project Management Plan (PMP) and associated subplans
✓ Completed process flows for current state Payments and Collections process
✓ Continued work on converting requirements to User Stories and reviewing with business
customers
QA Recommendation Summary
ISG opened one (1) new recommendation in this period and closed one (1) recommendation
leaving eleven (11) open QA recommendations as shown below.
Total QA Recommendations to Date 15
Total QA Recommendations Remaining Open 11
High Priority Recommendations
Five (5) high-priority recommendations are open, as shown in the detailed section of this report
and as summarized below.
Table 2: High Priority Recommendations
High Priority Recommendation Opened
1.2 Develop and socialize a high-level Project Management Plan (PMP) that Oct-2020
outlines all project controls at a high level and points to the detailed plans as they
are developed.
Status Update: The Project Management Plan (PMP) has been drafted.
However, the approval of this critical project control has now been delayed for
several months. It is critical that this plan, and associated sub-plans, are
completed, approved, and socialized to ensure the successful management of
the project.
2.1 Develop and socialize a Scope Management Plan that outlines the change Oct-2020
control processes for the project and prescribes the use of a Requirements
Traceability Matrix (RTM) to manage requirements.
4 Conveyance Monthly Assessment Report - March 2021Status Update: As the project moves from the Discovery Phase to the
Procurement Phase, it is crucial that the Scope Management Plan, which has
been drafted by the project team, is approved by sponsors, socialized to the
team, and put into action.
3.1 Develop, as part of the Project Management Plan (PMP), a Schedule
Management Plan
Status Update: While this critical plan has been drafted, the approval has been
delayed for several months. Once approved and socialized, ISG will close this
recommendation.
4.1 Develop a Cost Management Plan which outlines the process for managing Oct-2020
the project’s budget and expenditures.
Status Update: The project plans on completing the Cost Management Plan by
the end of April 2021. Once approved and socialized, ISG will close this
recommendation.
9.2 NEW Develop a Procurement Plan outlining the approach to the solicitation, Mar-2021
evaluation, selection, and contracting of a Conveyance Management System
solution.
Status Update: This plan should include the strategy, processes, timelines,
resources, and expected outcomes of the Procurement Phase. The defined tasks,
activities, dependencies, and milestones should be included in the Integrated
Project Schedule (IPS) and socialized with the project team and sponsors.
5 Conveyance Monthly Assessment Report - March 2021Detailed Assessment Findings and Recommendations
1.0 Integration Management
Jan Feb Mar
Category Summary
Assessment Assessment Assessment
The project team continues to display a high level of collaboration. The team and
sponsors are committed to the goals of the project. Velocity remains high as the
project approaches the end of the Discovery Phase, planned for completion at the
end of April, and begins the Procurement Phase to select a vendor. 4 4 5
The focus of the project continues to be the Discovery Phase being conducted by
Deloitte Consulting. Deloitte has completed the first two deliverables of this phase, a Fit
Gap Analysis and a Market Research analysis which have been shared with the
Steering Committee. The final deliverable of this phase, an Overall Assessment
Document, has been delivered to the project and will be shared with the Steering
Committee at the April meeting.
The Project Management Plan (PMP) has been drafted but not yet approved or
socialized. While work continues on the refinement and approval of the PMP and other
major project controls, ISG continues to stress the need to complete these plans,
outlined in Recommendation 1.2 and other recommendations within this report, to
ensure the proper management of the project.
Based on the critical nature of this work, ISG has raised the risk rating of this category.
Recommendations Status Priority Current Assessment
1.2 Develop and socialize a high-level The Project Management Plan (PMP) has been drafted. However, the
Open High
Project Management Plan (PMP) approval of this critical project control has now been delayed for several
that outlines all project controls at
months. It is critical that this plan and associated sub-plans are
a high level and points to the
detailed plans as they are completed, approved, and socialized to ensure the project's successful
6 Conveyance Monthly Assessment Report - March 2021Recommendations Status Priority Current Assessment
developed. management.
2.0 Scope Management
Jan Feb Mar
Category Summary
Assessment Assessment Assessment
Deloitte Consulting has now completed all the deliverables as part of the Discovery
Phase. These deliverables include the following:
1. Fit Gap Assessment 3 3 4
2. Market Assessment
3. Overall Assessment
Deliverables 1 and 2 have been presented to the Steering Committee, and the third
will be presented in the April meeting which includes the following:
• An overall summary of findings for the discovery phase
• An assessment of the feasibility of an Enterprise solution for the programs in
scope
• Documentation of alternate or hybrid approaches for business processes or
programs that may not be covered by an Enterprise solution; and
• A roadmap for modernization of programs that may be covered by an
Enterprise solution.
All three of these deliverables will be used to inform the procurement of a solution and
should be incorporated into the Procurement Plan (see New Recommendation 9.2).
The project has drafted a Scope Management Plan and had intended to have it
reviewed and approved by the Steering Committee in February; however, this has not
yet occurred. ISG continues to stress the importance of clearly defining this plan and,
once it is approved and socialized, will close Recommendation 2.1. ISG has raised the
7 Conveyance Monthly Assessment Report - March 2021priority of this recommendation.
Based on the increasing risk of not having a clear plan for managing scope, ISG has
raised the risk rating of this category.
Recommendations Status Priority Current Assessment
2.1 Develop and socialize a Scope As the project moves from the Discovery Phase to the Procurement Phase,
Open High
Management Plan that outlines it is crucial that the Scope Management Plan, which the project team has
the change control processes for drafted, is approved by sponsors, socialized to the team, and put into
the project and prescribes the use action.
of a Requirements Traceability
Matrix (RTM) to manage
requirements.
3.0 Schedule Management
Jan Feb Mar
Category Summary
Assessment Assessment Assessment
The project has a schedule, developed in Microsoft Project, that is used to manage the
activities, tasks, and timelines of the project. The project is currently finishing up the
Discovery Phase and moving into the Procurement Phase. The current schedule for
these phases is as follows: 3 3 4
• Discovery Phase Oct 2020 – Apr 2021
• Procurement Phase Mar 2021 – Feb 2022
• Development Phase Mar 2022 – Mar 2023
• User Readiness Phase Jun 2022 – Jun 2023
While the project is on schedule with these phases, several of the project controls have
yet to be completed, approved, and socialized. This includes the Schedule
Management Plan. This plan has been drafted and was intended to be reviewed and
8 Conveyance Monthly Assessment Report - March 2021approved by the Steering Committee in February. However, to date, it has not been
approved.
ISG has raised the priority of Recommendation 3.2 to High and the risk rating of this
category to stress the need to approve and socialize the Schedule Management Plan
to ensure this critical project control is properly managed.
Recommendations Status Priority Current Assessment
3.2 Develop, as part of the Project While this critical plan has been drafted, the approval has been delayed
Open High
Management Plan (PMP), a for several months. Once approved and socialized, ISG will close this
Schedule Management Plan recommendation.
4.0 Cost Management
Jan Feb Mar
Category Summary
Assessment Assessment Assessment
The project has submitted an updated Technology Budget and the Gate 2 application
for approval by the Office of the Chief Information Officer (OCIO) and the Office of
Financial Management (OFM). The project has amended the Investment Plan based
on the Discovery Phase findings and is currently conducting internal reviews before 4 4 5
being submitted for approval. The project has now built in the OCIO and OFM review
cycles into the project schedule.
ISG continues to stress the need to develop and socialize a Cost Management Plan as
outlined in Recommendation 4.1 and begin formally tracking expenditures using the
Budget Worksheet or equivalent mechanism. To this end, ISG has raised the priority of
this recommendation to High.
ISG has increased the risk rating of this category to stress the importance of completing
a Cost Management Plan outlining how the budget will be managed.
9 Conveyance Monthly Assessment Report - March 2021Recommendations Status Priority Current Assessment
4.1 Develop a Cost Management The project plans on completing the Cost Management Plan by the end of
Open High
Plan which outlines the process for April 2021. Once approved and socialized, ISG will close this
recommendation.
managing the project's budget
and expenditures.
5.0 Quality Management
Jan Feb Mar
Category Summary
Assessment Assessment Assessment
As the project completes the Discovery Phase, conducted by Deloitte Consulting, it
plans to update the Test Plan draft based on the information received from this
process. It will be updated again as a vendor is selected and onboarded, and the
details of the Implementation Phase are outlined. 3 3 3
The project is currently drafting the Quality Management Plan (Recommendation 5.1)
and intends to complete it by the end of April. ISG continues to suggest that this plan
outline how the project plans to align with L&I goals, as outlined in the Project Charter
and listed here:
• L&I Goal 1: Keep workers and the public safe:
o By ensuring elevator inspectors have a reliable system to record elevator
inspection details and upload the results faster so corrections can be
made quicker.
o By ensuring Elevator Program staff have a reliable system to approve
elevator installation plans, issue permits and certificates of safety.
• Goal 3: Make it easier to do business and engage with L&I:
o By providing one tool for customers to view conveyance status, schedule
inspections, pay for permits and report on conveyances.
• Goal 5: Ensure L&I is the employer of choice:
10 Conveyance Monthly Assessment Report - March 2021o By resolving the “pain points” identified in the 2016 Stellar Study, Elevator
Program staff will process inspection data, issue permits, and collect fees
more efficiently.
As stated in the previous report, the Quality Management Plan (QMP) or Quality
management section of the PMP should be updated using “progressive elaboration”
techniques to address quality strategies over time to ensure the project meets its
business goals and objectives. The QMP should address the following:
• Project Objectives: The Project Charter includes a description of the project
goals and objectives. The QMP should identify the business/process
improvement measures and how they will be tracked/reported.
• Deliverable Acceptance: What is the process and roles/responsibilities for
ensuring quality deliverables. Who are the reviewers and approvers, for
example?
• Continuous Process Improvements: How will the project incorporate
retrospectives and lessons learned to ensure improvement to project processes
(after the pilot, for example)?
• Product Quality: What are the high-level strategies for testing configuration prior
to deployment, including roles/responsibilities for the project team, vendor, and
stakeholders?
Once this plan is approved and socialized, ISG will close Recommendation 5.1.
Recommendations Status Priority Current Assessment
5.1 Develop a Quality Management Once the Quality Management Plan, currently in draft, is approved and
Open Med
Plan (QMP) to ensure that quality socialized, ISG will close this recommendation.
objectives are achieved for
technical and application
performance.
11 Conveyance Monthly Assessment Report - March 20216.0 Human Resource Management
Jan Feb Mar
Category Summary
Assessment Assessment Assessment
The team continues to work with resource managers within the agency to determine
what resources will be needed and how to source them. The project reports that they
currently have the necessary resources and plan to onboard an additional Business
Analyst prior to the Implementation Phase. They are also planning on onboarding 3 3 3
Organizational Change Management (OCM) at that time.
The project is currently drafting its Human Resource Management Plan and intends to
complete it by the end of April 2021. ISG continues to stress the importance of
approving and socializing the Human Resource Management Plan, and once this is
done, will close Recommendation 6.1.
Recommendations Status Priority Current Assessment
6.1 Develop a Human Resource The project is currently drafting its Human Resource Management Plan
Open Med
Management Plan with a focus and intends to complete it by the end of April 2021. ISG continues to stress
on activity estimating and the importance of approving and socializing the Human Resource
managing resource needs for the Management Plan, and once this is done, will close this recommendation.
project.
12 Conveyance Monthly Assessment Report - March 20217.0 Communications Management
Jan Feb Mar
Category Summary
Assessment Assessment Assessment
The Communication Plan has been drafted; however, the formal review and approval
have been delayed for several months. ISG continues to stress the need to complete
this essential project control to outline the project’s communication processes, as
outlined in Recommendation 7.1. 4 4 4
The project provides status and other information through a series of regular meetings,
including the following:
• CMS Business Managers meetings (bi-weekly)
• CMS Project Team meetings (bi-weekly)
• CMS Steering Committee meetings (monthly)
• Elevator Safety Advisory Committee (ESAC) meetings (as scheduled)
Monthly status reports are developed and distributed to project stakeholders. These
reports, as well as responses to the Independent QA recommendations and major
project deliverables are posted to the OCIO Dashboard in a timely manner. Based on
this progress, ISG has closed Recommendation 7.2.
Recommendations Status Priority Current Assessment
7.1 Develop and socialize a The Communication Plan has been drafted; however, the formal review
Open Med
Communication Plan that and approval have been delayed for several months. ISG continues to
incorporates a strategy for stress the need to complete this essential project control to outline the
integrating communications project’s communication processes.
across the workstreams.
13 Conveyance Monthly Assessment Report - March 2021Recommendations Status Priority Current Assessment
7.2 Ensure that all relevant project Monthly status reports are developed and distributed to project
Closed Med
information, including monthly stakeholders. These reports, as well as major deliverables, are being
project status, is uploaded to the posted to the OCIO Dashboard in a timely manner. Based on this
OCIO dashboard in a timely progress, ISG has closed this recommendation.
manner.
8.0 Risk Management
Jan Feb Mar
Category Summary
Assessment Assessment Assessment
The project is actively managing risks and issues in the respective logs on the project’s
SharePoint site. The team mitigates these issues where possible and escalates to the
Steering Committee for resolution where necessary. ISG continues to stress the
importance of approving and socializing the Risk Management Plan draft, which 3 3 3
outlines these processes (see Recommendation 8.1 below).
Recommendations Status Priority Current Assessment
8.1 Develop a Risk Management Plan The Risk Management Plan has been drafted. Once approved and
Open Med
which outlines the processes and socialized, ISG will close this recommendation.
tools for the identification,
assignment, mitigation, tracking
and communication of project
risks and issues.
14 Conveyance Monthly Assessment Report - March 20219.0 Vendor Management
Jan Feb Mar
Category Summary
Assessment Assessment Assessment
It is also critical that the approach and processes necessary for the proper
management of the selected vendor or vendors is clearly outlined and agreed upon in
a Vendor Management Plan (see Recommendation 9.1). The project intends to have
this plan developed by the end of May, 2021. 4 4 5
As Deloitte completes the deliverables agreed upon, the Discovery Phase is coming to
an end. The project is now entering the Procurement Phase of the project. The goal of
this phase is to select a product, and a vendor to implement the solution necessary to
address the Conveyance Management needs of the agency. To properly prepare for
this next phase, the project should develop a Procurement Plan which outlines the
approach to selecting a solution. This plan will be informed by the outcomes of the
Discovery Phase. To this end, ISG has opened Recommendation 9.2.
Based on the importance of both of these plans, and the impending start of the
Procurement Phase, ISG has raised the risk rating of this category, and will continue to
monitor progress in this area.
Recommendations Status Priority Current Assessment
9.1 Develop a Vendor Management As the project moves into this next phase, it is critical that the approach
Open Med
Plan outlining the approach and and processes necessary for the proper management of vendors is clearly
roles & responsibilities necessary outlined and agreed upon in a Vendor Management Plan. ISG has
to successfully manage vendors increased the priority of this recommendation to High meaning it should
to ensure the state continues to be addressed as soon as possible.
receive the best value from
project-related contracts.
15 Conveyance Monthly Assessment Report - March 2021Recommendations Status Priority Current Assessment
9.2 Develop a Procurement Plan This plan should include the strategy, processes, timelines, resources, and
New High
outlining the approach to the expected outcomes of the Procurement Phase. The defined tasks,
solicitation, evaluation, selection, activities, dependencies, and milestones should be included in the
and contracting of a Integrated Project Schedule (IPS) and socialized with the project team and
Conveyance Management sponsors.
System solution.
10.0 Stakeholder Management
Jan Feb Mar
Category Summary
Assessment Assessment Assessment
The intention of the project is to select and implement a Commercial Off-the-Shelf
(COTS) or Software as a Service (SaaS) product to provide a Conveyance
Management System (CMS) solution to the Elevator Program. However, the agency is
hoping to select a product that can also address the needs of nine (9) other related 3 3 3
programs in separate initiatives. As the project moves forward with the Procurement
Phase, and eventual selection of a solution, it is critical that the needs of these other
areas remain in focus. Based on the funding, the project’s scope is limited to the needs
of the Elevator Program and can only provide a Conveyance Management System
(CMS). Therefore, choices will have to be made regarding competing priorities of
these other program areas versus the Elevator Program as this solution is selected.
To address these other program areas, the project has included representatives from
each program area in the Discovery sessions and has determined the processes that
are similar across these areas. The project also continues to engage these other
program areas in quarterly Stakeholder meetings. ISG commends the approach to
selecting a more holistic solution that can, in the future, address other program areas,
and suggests that this approach be incorporated in the Stakeholder Management Plan
16 Conveyance Monthly Assessment Report - March 2021(see Recommendation 10.1). The Procurement Plan (See Recommendation 9.2) could
also identify whether other program representatives will participate in vendor selection,
even as observers of demonstrations for example.
Recommendations Status Priority Current Assessment
10.1 Develop a Stakeholder The OCM staff, once onboarded, will be responsible for developing the
Open Med
Management Plan outlining how Stakeholder Management Plan. ISG suggests the incorporation of an
stakeholders will be identified, approach for including the nine (9) related program areas in their
assessed, and communicated
with to ensure a successful stakeholder management activities, as outlined in the Stakeholder
adaptation of the solution. Management section of this report.
17 Conveyance Monthly Assessment Report - March 2021Appendix A. ISG Discovery Interviews and Meetings
ISG conducted interviews as an information gathering and validation process of the discovery
and assessment phase. Interview sessions were designed to gather information in relationship
to the ISG QA Framework. Interviewee questions were prepared in advance by the ISG team
assigning specific QA Framework questions to the roles of individuals being interviewed.
Interviews
• Annette Taylor
• Gerald Brown
• Robyn Garcia
• Tamra Shaefer
Meetings Observed
• Monthly Steering Committee meetings
• Monthly Executive Sponsor Check-Ins
• Bi-weekly PM Check-In meetings
• Bi-weekly Business Managers meetings
• Bi-weekly Project Team meetings
18 Conveyance Monthly Assessment Report - March 2021Appendix B. ISG Discovery Documentation
ISG reviewed the following program documents during this assessment period. ISG's
assessment and findings are based in part on review of the documents reviewed.
1. Steering Committee presentations
2. Monthly Status Reports
3. CMS February 2020 Response to QA Recommendations
4. CMS Schedule (Approved/Baselined)
5. Risk & Issues Log
6. Fated Funding Application Form – LI – Gate 2 040521
7. IT Pool Technology Budget 19-21 – CMS 040121
8. CMS Discovery Phase Deliverables:
• Deliverable 1 - Fit Gap Assessment with Workbook
• Deliverable 2 - Market Assessment
• Deliverable 3 – Overall Assessment
19 Conveyance Monthly Assessment Report - March 2021Appendix C. ISG Framework Categories and Legend
ISG utilizes the following ten (10) areas within its assessment framework. Each of these areas
are assessed, and qualitatively and quantitatively described in the detailed assessment
report.
ISG utilizes the following quantitative system in our assessment process:
ISG QA Process Background and Approach
ISG's process in developing the initial assessment report includes discovery interviews, project
artifact reviews, and meeting attendance. Meeting attendance includes project team
meeting observations. Artifact review includes project plans, status reports, deliverable
documentation, and project management methodology, please refer to (Appendix A & B) for
full list of interviewees and deliverables reviewed.
Assessment/Findings:
Describes ISG assessment findings in narrative and qualitative form. This information is gathered
from key staff interviews and documentation review and is specific to the ISG QA framework
area being assessed.
Impact Rating:
ISG assigns an impact rating that is based on our assessment findings being compared to
industry best practices, similar project benchmarking where appropriate and our consultant's
experience. The rating system is a high, medium, and low impact rating.
20 Conveyance Monthly Assessment Report - March 2021Recommendations:
Identifies ISG's recommendations for moving the program closer to industry best practices and
reducing risks. Implementation of the recommendation is delignated by a high, mid, and low
priority implementation designation. This designation is intended to assist the project team in
determining ISG's position on which recommendations to address in what general order.
21 Conveyance Monthly Assessment Report - March 2021You can also read
