Project Plan Executive Summary Review

  • Summary Review is also available in Portable Document Format (PDF, 533KB)

February 2015

Agenda

  • Overview February 17-20 PAOP Review Session Agenda
  • Refresher of Panel Roles and Responsibilities (February 17-20, 2014)
  • PAOP Voting Process
  • Refresher of PPS Project Plan Scoring
  • Review PAOP Review Resources
  • Presentation of PPS Project Plan Prototype "Forestland"

Overview February 17-20 PAOP Review Session Agenda

Agenda Details

  • Public Comment (February 17, 10:30am - 5:30pm)
    • Introduction from Independent Assessor on high level themes from Project Plan application reviews
    • Public comment period focused on the DSRIP work being conducted by panel
  • Presentation of PPS Project Plans (February 18 - 20; 50 minutes per PPS)
    • PPS Presentation (5 minutes)
      • PPS presentation and comments - PPSs will have the opportunity to present up to 5 slides
  • Independent Assessor Presentation (15 minutes)
    • Presentation will include an overview of the Project Plan evaluation and the scoring recommendations
      • Executive Summary of Project Plan application will be used as the
      • Highlights of the (Strengths & Weaknesses)
      • Overall Score
  • PAOP Discussion and Voting (30 minutes)
    • Panel members will have time to discuss the Project Plan scoring and conduct Q&A with the Independent Assessor
    • Panel members will vote to Approve, Modify, or Reject the recommended scores

Refresher of Panel Roles and Responsibilities
(February 17-20, 2015)

Panel Roles and Responsibilities

  • Panel members will convene February 17th to 20th for a public meeting and a formal presentation of recommended DSRIP Project Plan scores by the IA for each PPS and DSRIP Project.
  • Panel members will use their background and subject matter expertise to review and evaluate the subjective scores for each DSRIP Project Plan for each PPS.
    • The IA will identify the total subjective points that can be increased or decreased by the PAOP.
  • Panel members will participate in a voting process to Accept, Accept with Modification or Reject Ia´s scores.
    • As a reminder, PPS Project Plans are approximately 50% Subjective and 50% Objective scores.
    • Only subjective scores can be modified by the PAOP.

PAOP Charge February 17-20, 2015

Panel members will have the following responsibilities under the DSRIP Program:

  • Conduct reviews and make recommendations on the scores of the subjective components of DSRIP Project Plans (discussed in greater detail in the scoring section of this presentation).
    • Panel members will serve as a secondary review panel to the scoring performed and recommended by the Independent Assessor.
    • Approximately 50% of Project Plan score is subjective and therefore the PAOP can have a significant impact on the level of funding awarded to an individual PPS and a specific project.
    • Please note, any recommended changes made by the PAOP will ultimately be reviewed by the Commissioner of Health, Dr. Howard Zucker and the Centers for Medicare and Medicaid Services (CMS) for final approval.

PAOP Voting Process

Voting Process

  • After the IA presents Project Plan Score recommendations the Panel will have the following three voting options on the PPS Project Plan Scores:
    1. Accept:
      • The Panel can vote to accept the Ia´s recommendations.
    2. Accept with Modifications:
      • The Panel can vote to modify the subjective components of the DSRIP Project Plan scores.
      • Modifications can directly increase or decrease the points awarded, but cannot exceed the total points available.
      • Any modifications to an individual PPS score will result in a redistribution of funds for all PPSs.
        • Any increase to a PPSs score does not require a corresponding decrease (more explanation to follow later in the presentation).
      • Modifications to Project Plans will be sent to the Commissioner and CMS for final approval.
  • After the IA makes Project Plan Score recommendations the Panel will have the following three voting options on the PPS Project Scores:
    1. Reject:
      • If the Panel rejects IA's recommendations this is a vote to reject the PPS Project Plan in its entirety.

PAOP members will have 30 minutes to vote on recommendations following the Independent Assessor's presentation of PPS Project Plan.

  • Q&A- between PAOP Panel and Independent Assessor
  • Approve, Modify, Reject voting process
    • Co-Chairs will open the voting process by calling upon the PAOP members to make a motion by statement
    • A motion will be made
    • Co-Chairs will ask if the motion is seconded
    • If a motion is seconded a discussion of the motion will be held
    • After the motion is discussed the motion can be voted upon
      • A motion will fail if not seconded
      • Progress cannot continue until a motion passes or fails
  • VOTING: A motion will pass with a simple majority of members present

Refresher of PPS Project Plan Scoring

PPS Project Plan Overview

  • PPSs were required to complete the following:
    • (1) DSRIP Project Plan: Organizational Components as part of their submission.
    • (1) DSRIP Project Plan: Project Components for each project the PPS intends to implement.
      • A PPS would complete a minimum of five (5) and a maximum of eleven (11) DSRIP Project Plans.
  • The DSRIP Project Plan: Organizational Components are worth a total of 30% of the total DSRIP Project Plan score.
    • The DSRIP Project Plan: Organizational Components would be scored once with the score contributing to the final score for each DSRIP project.
  • The DSRIP Project Plan: Project Components are worth a total of 70% of the total DSRIP Project Plan score.
    • Each DSRIP Project Plan: Project Components submission would be given its own score.

Scoring the Organizational Components

  • The DSRIP Project Plan: Organizational Components include ten distinct sections that vary in value, in terms of scoring, but touch upon the core components to a PPS achieving the goals of DSRIP.
    • See table on following slide for the organizational sections and their relative value to the DSRIP Project Plan: Organizational Components score.
  • Each question within the DSRIP Project Plan: Organizational Components requires a response from the PPS for the submission to be considered complete.
    • Responses to each question were subject to word limits in an effort to minimize unnecessary narrative.
    • Scored sections will be evaluated based on the extent to which the PPS has addressed the questions.
    • Pass/Fail sections will be evaluated to ensure the PPS has provided an adequate response to the questions.

Section 4. DSRIP Projects

  • Section 4 of the DSRIP Project Plan contains the DSRIP Project Plan: Project Components with sections for each of the 44 DSRIP projects a PPS could select.
  • Each question within the DSRIP Project Plan: Project Components requires a response from the PPS for the submission to be considered complete.
    • Narrative responses will be evaluated based on the extent to which the PPS has addressed the questions.
    • Scale and Speed responses will be evaluated relative to the responses of all PPSs pursing the same project.
    • Responses to each question were subject to word limits in an effort to minimize unnecessary narrative.

DSRIP Project Plan Scoring Overview

  • The Independent Assessor has created a team of six evaluators to review the DSRIP Project Plan submissions from the 25 PPSs.
    • Each evaluator will review and score every DSRIP Project Plan submission independently.
  • There will be two main components that will drive the development of the PPS DSRIP Project Plan Score, which include:
    • DSRIP Project Plan: Organizational Components Scoring (30% of final DSRIP project score)
      • Scores those components that are PPS wide responses.
      • More subjective topics, such as CNA, governance, and cultural competency.
    • DSRIP Project Plan: Project Components Scoring (70% of final DSRIP project score)
      • Includes two components, a subjective component and an objective component.
      • The objective component scores on Speed and Scale cannot be changed by the PAOP, only the subjective scores can be modified.
        • Rewards those PPS Projects that achieve milestones more aggressively (e.g. achieve NCQA PCMH certification).
        • Rewards those projects that have a greater impact towards system transformation (e.g., greater impact to the Medicaid patient population and broad involvement from the providers within the PPS network).
  • PPSs will also have the opportunity to achieve bonus points on the application.
  • The bonus points will be awarded in addition to the calculated application score.
    • For example a PPS receiving 3 bonus points for Workforce Strategies would see their PPS Total Score of 85.50% increased to 88.50%.
  • PPSs cannot achieve a PPS Total Score greater than 100%.
    • Bonus points cannot push a PPS over 100 points.
  • Bonus points are a subjective score therefore they are open to PAOP Accept, Accept with Modification and Reject voting process.

PAOP Review Resources

Scoring Summary Documents

  • Detailed Scoring Summaries of each DSRIP Project Plan application will be made available during the week of February 2-6, 2015.
    • The detailed Scoring Summary documents are 20-25 page documents that that cover the overall scoring, reviewer comments, and a project by project summary (without 2.d.i Bonus ).
    • The detailed Scoring Summary documents will be available on the DSRIP website
    • Panel members will receive hardcopies of the PPS Project Plan detailed Scoring Summaries during the week of February 2-6, 2015.
  • A summary of the PPS Project Scores was released on February 2, 2015
    • The summary provides the final scores, without the bonus points for Project 2.d.i, for each PPS by project
    • The summary of PPS Project Scores can be found on the DSRIP website

PPS Project Plan Subjective Scoring Summary

  • Panel members will receive a one-page scoring summary that illustrates the subjective scoring for all of the Organizational and Project Components of the DSRIP Project Plan applications for each PPS.
  • The summary document will provide the Panel with high level details on the subjective points awarded, the maximum subjective points, the subjective points available for the upward adjustment of the scores by the Panel, and the average subjective points awarded for all PPSs for each Organizational and Project Component.

Presentation of Executive Summary for the PPS Project Plan Prototype "Forestland"

QUESTIONS & ANSWERS

DSRIP e-mail

DSRIP homepage