Section 423.184 - Adding, updating, and removing measures(a)General. CMS adds, updates, and removes measures used to calculate the Star Ratings as provided in this section. CMS lists the measures used for a particular Star Rating each year in the Technical Notes or similar guidance document with publication of the Star Ratings.(b)Review of data quality. CMS reviews the quality of the data on which performance, scoring and rating of a measure is based before using the data to score and rate performance or in calculating a Star Rating. This includes review of variation in scores among MA organizations and Part D plan sponsors, and the accuracy, reliability, and validity of measures and performance data before making a final determination about inclusion of measures in each year's Star Ratings.(c)Adding measures.(1) CMS will continue to review measures that are nationally endorsed and in alignment with the private sector, such as measures developed by National Committee for Quality Assurance (NCQA) and the Pharmacy Quality Alliance (PQA) or endorsed by the National Quality Forum for adoption and use in the Part D Quality Ratings System. CMS may develop its own measures as well when appropriate to measure and reflect performance specific to the Medicare program.(2) In advance of the measurement period, CMS will announce potential new measures and solicit feedback through the process described for changes in and adoption of payment and risk adjustment policies in section 1853(b) of the Act and then subsequently will propose and finalize new measures through rulemaking.(3) New measures added to the Part D Star Ratings program will be on the display page on www.cms.gov for a minimum of 2 years prior to becoming a Star Ratings measure.(4) A measure will remain on the display page for longer than 2 years if CMS finds reliability or validity issues with the measure specification.(d)Updating measures -(1)Non-substantive updates. For measures that are already used for Star Ratings, CMS will update measures so long as the changes in a measure are not substantive. CMS will announce non-substantive updates to measures that occur (or are announced by the measure steward) during or in advance of the measurement period through the process described for changes in and adoption of payment and risk adjustment policies in section 1853(b) of the Act. Non-substantive measure specification updates include those that- (i) Narrow the denominator or population covered by the measure;(ii) Do not meaningfully impact the numerator or denominator of the measure;(iii) Update the clinical codes with no change in the target population or the intent of the measure;(iv) Provide additional clarifications: (A) Adding additional qualifiers that would meet the numerator requirements;(B) Clarifying documentation requirements;(C) Adding additional instructions; or(v) Add alternative data sources or expand modes of data collection.(2)Substantive updates. For measures that are already used for Star Ratings, in the case of measure specification updates that are substantive updates not subject to paragraph (d)(1) of this section, CMS will propose and finalize these measures through rulemaking similar to the process for adding new measures. CMS will initially solicit feedback on whether to make substantive measure updates through the process described for changes in and adoption of payment and risk adjustment policies in section 1853(b) of the Act. Once the update has been made to the measure specification by the measure steward, CMS may continue collection of the performance data for the legacy measure and include it in Star Ratings until the updated measure has been on display for 2 years. CMS will place the updated measure on the display page for at least 2 years prior to using the updated measure to calculate and assign Star Ratings as specified in paragraph (c) of this section.(e)Removing measures.(1) CMS will remove a measure from the Star Ratings program as follows: (i) When the clinical guidelines associated with the specifications of the measure change such that the specifications are no longer believed to align with positive health outcomes, or(ii) A measure shows low statistical reliability.(iii) The measure steward other than CMS retires a measure.(2) CMS will announce in advance of the measurement period the removal of a measure based upon its application of this paragraph (e) through the process described for changes in and adoption of payment and risk adjustment policies in section 1853(b) of the Act in advance of the measurement period.(f)Improvement measure. CMS will calculate improvement measure scores based on a comparison of the measure scores for the current year to the immediately preceding year as provided in this paragraph (f); the improvement measure score would be calculated for Parts C and D separately by taking a weighted sum of net improvement divided by the weighted sum of the number of eligible measures. (1)Identifying eligible measures. Annually, the subset of measures to be included in the Part D improvement measure will be announced through the process described for changes in and adoption of payment and risk adjustment policies in section 1853(b) of the Act. CMS identifies measures to be used in the improvement measure if the measures meet all the following: (i) CMS will include only measures available for the current and previous year in the improvement measures and that have numeric value scores in both the current and prior year.(ii) CMS will exclude any measure for which there was a substantive specification change from the previous year.(iii) The Part D improvement measure will include only Part D measure scores.(iv) CMS excludes any measure that receives a measure-level Star Rating reduction for data integrity concerns for either the current or prior year from the improvement measure(s).(2)Determining eligible contracts. CMS will calculate an improvement score only for contracts that have numeric measure scores for both years in at least half of the measures identified for use applying the standards in paragraphs (f)(1)(i) through (iii) of this section.(3)Special rules for calculation of the improvement score. For any measure used for the improvement measure for which a contract received 5 stars in each of the years examined, but for which the measure score demonstrates a statistically significant decline based on the results of the significance testing (at a level of significance of 0.05) on the change score, the measure will be categorized as having no significant change and included in the count of measures used to determine eligibility for the measure (that is, for the denominator of the improvement measure score).(4)Calculation of the improvement score. The improvement measure will be calculated as follows: (i) The improvement change score (the difference in the measure scores in the 2-year period) will be determined for each measure that has been designated an improvement measure and for which a contract has a numeric score for each of the 2 years examined.(ii) Each contract's improvement change score per measure will be categorized as a significant change or not a significant change by employing a two-tailed t-test with a level of significance of 0.05.(iii) The net improvement per measure category (outcome, access, patient experience, process) would be calculated by finding the difference between the weighted number of significantly improved measures and significantly declined measures, using the measure weights associated with each measure category.(iv) The improvement measure score will then be determined by calculating the weighted sum of the net improvement per measure category divided by the weighted sum of the number of eligible measures.(v) The improvement measure scores will be converted to measure-level Star Ratings by determining the cut points using hierarchical clustering algorithms in accordance with § 423.186(a)(2)(i) through (iii) .(vi) The Part D improvement measure cut points for MA-PDs and PDPs will be determined using separate clustering algorithms in accordance with §§ 422.166(a)(2)(iii) and 423.186(a)(2)(iii) .(g)Data integrity.(1) CMS will reduce a contract's measure rating when CMS determines that a contract's measure data are inaccurate, incomplete, or biased; such determinations may be based on a number of reasons, including mishandling of data, inappropriate processing, or implementation of incorrect practices that have an impact on the accuracy, impartiality, or completeness of the data used for one or more specific measure(s). (i) CMS will reduce measures based on data that a Part D organization must submit to CMS under § 423.514 to 1 star when a contract did not score at least 95 percent on data validation for the applicable reporting section or was not compliant with CMS data validation standards/sub-standards for data directly used to calculate the associated measure.(2) CMS will reduce a measure rating to 1 star for additional concerns that data inaccuracy, incompleteness, or bias have an impact on measure scores and are not specified in paragraphs (g)(1)(i) and (ii) of this section, including a contract's failure to adhere to CAHPS reporting requirements.(h)Review of sponsors' data.(1) A Part D plan sponsor may request that CMS or the IRE review its' contract's appeals data provided that the request is received by the annual deadline set by CMS for the applicable Star Ratings year.(2) A Part D plan sponsor may request that CMS review its' contract's Complaints Tracking Module (CTM) data provided that the request is received by the annual deadline set by CMS for the applicable Star Ratings year.(3) Beginning with the 2025 measurement year (2027 Star Ratings), Part D sponsor may request that CMS review its contract's administrative data for Patient Safety measures provided that the request is received by the annual deadline set by CMS for the applicable Star Ratings year.83 FR 16743, Apr. 16, 2018, as amended at 84 FR 15842, Apr. 16, 2019; 85 FR 19291, Apr. 6, 2020; 86 FR 6118, Jan. 19, 2021; 87 FR 27899, May 9, 2022; 88 FR 22338, Apr. 12, 2023 83 FR 16743, 6/15/2018; as amended at 84 FR 15842, 4/16/2019; 85 FR 19291, 4/6/2020; 86 FR 6118, 3/22/2021; 87 FR 27893, 6/28/2022; 88 FR 22338, 6/5/2023; 89 FR 30835, 6/3/2024