What constitutes an irregularity and what to do about it.
All tests that are part of the Mississippi Statewide Assessment Program require a standardized process of administration. In order for test results to be valid from a standardized test administration, all procedures found in the specific test administration manual must be followed. It is important that the test site personnel follow and present the directions in the test administrator's manual as written. Thus, test site personnel must study the designated manual prior to the test administration to ensure that uniform test administration procedures are followed throughout Mississippi. It is also important that all test site personnel receive training on the District and School Test Security plans and requirements of Appendix F of the Mississippi Public Schools Accountability Standards. This chapter will give definition to what constitutes a testing irregularity and the process a district should follow if one occurs.
Definitions
Testing Irregularities
Examples of testing irregularities include, but are not limited to, the following:
Guidance from Appendix F on Testing Irregularities
Investigating and Reporting
In accordance with MDE security policies and practices, any variation from established procedures in the administration of the Mississippi Statewide Assessment Program should be reported as soon as reasonably possible to MDE via the online incident reporting system or by direct contact by local school personnel, typically a District Test Coordinator or School Test Coordinator or by the delivery vendor. This includes the following:
Testing Irregularity Response Plan
This Testing Irregularity Response Plan (SIRP) is an effort to maximize district test security and to minimize risks. The SIRP is meant to provide a proactive approach to preventing cheating and promoting fair and valid testing.
Additional Guidance from Appendix F on Investigation
Identifying and investigating possible testing irregularities involves a variety of data sources. These include formal testing audits, self-reports of testing irregularities, allegations/complaints related to possible testing irregularities, and results of analyses and reports designed to identify possible irregularities, including the percent of students tested, changes in enrollment, score exceptionalities, erasure report results, and missing documents reports.
The procedure for handling testing irregularities is repeated for each test administration. The Office of Student Assessment will notify the school district in writing when a possible testing irregularity has been identified. Within fifteen working days following a reported potential irregularity/violation and/or receipt of the written notification from the Office of Student Assessment, the district will submit a written report to the Office of Student Assessment. The Office of Student Assessment reserves the right to conduct an independent investigation.
The Office of Student Assessment will evaluate the district report to determine whether the possible testing irregularity has been resolved or the testing irregularity has been verified. If the possible testing irregularity has been resolved, the Office of Student Assessment will notify the district that no further action is required. If a testing irregularity has been verified, the Office of Student Assessment will notify the district superintendent.
In the case of any verified testing irregularity that jeopardized or may have jeopardized the security and integrity of the test(s) or the accuracy of the test results, the Office of Student Assessment will report the irregularity to the Office of Accreditation for appropriate action and follow-up. (See CONSEQUENCES on page 30) In the case of improper student behavior supported by a data forensics company and not disproved in the district report, the Office of Student Assessment will respond to the district superintendent with a request on behalf of the State Superintendent of Education that the district superintendent ask for the invalidation of the suspect test scores and prepare for the students with the suspect test scores to participate in the next test administration. If the district refuses to invalidate the suspect scores, the State Superintendent will have the authority to invalidate the scores.
In case of an allegation of an irregularity that prompts a need for an investigation by the Mississippi Department of Education and the investigation provides substantial evidence that an irregularity has occurred; the State Superintendent will have the authority to invalidate suspect scores. The district superintendent will be notified of the invalidated suspect scores and of the need to prepare students with the suspect scores to participate in the next test administration. (Appendix F, Section V, A)
Additional Guidance from Appendix F on Personal Misconduct Investigation
If an irregularity that represents misconduct or other breaches of test security on the part of district personnel within a school district is identified, the superintendent of the district will be notified of the irregularity. It is the responsibility of the district to conduct an investigation into the allegation and report findings to the Office of Student Assessment. If the Office of Student Assessment concludes that the irregularity was resolved, the district is notified that no further action is necessary.
If the Office of Student Assessment concludes that the irregularity was verified, the district superintendent is notified that the Office of Accreditation is being apprised of the finding.
In case of an allegation of an irregularity or in the case of statistical analyses that prompt a need for an investigation by the Mississippi Department of Education and the investigation provides substantial evidence that an irregularity has occurred, the State Superintendent will have the authority to invalidate suspect test scores. The district superintendent will be notified of the invalidated suspect scores and of the need to prepare students with the suspect scores to participate in the next test administration. The district superintendent will be notified that the Office of Accreditation is being apprised of the findings.
The district attorney may investigate allegations of violations of test security on his own initiative following receipt of allegations, at the request of a school district, or at the request of the Mississippi Department of Education.
After a conviction, the personnel in question will be notified in writing that the evidence of conviction will be presented to the Commission on Educator Licensure and that the Commission is required to take action pursuant to the authority granted in Section 37-16-4, Mississippi Code of 1972, as amended. In the case of improper student behavior supported by the data forensics company and not disproved in the district report, the district superintendent will be asked to request the invalidation of the suspect test scores and prepare for the students with the suspect test scores to participate in the next test administration. (Appendix F, Section V, B)
Consequences
Consequences of violating testing procedures vary based on the severity of the offense and affect three different areas:
Letter of Warning (Affects Institution)
If a violation has been verified that did not result in a substantial probability that the security, accuracy, or validity of the test results has been jeopardized, then the Office of Student Assessment may issue a letter of warning to the school district superintendent to be placed in the district and/or school file. Multiple and/or repeated minor violations that indicate the district and/or school has not corrected issues addressed in previous letters of warning or that the district and/or school has continued to be in noncompliance with the numbered issues listed in Requirements (Section IV) may result in a recommendation for a citation to be placed on the accreditation record. (See B below.) In the case of improper student behavior supported by the data forensics company and not disproved in the district reports, the district will be asked to request the invalidation of the suspect scores. If the improper student behavior is determined to be isolated to an individual student's or to individual students' behavior and not supported or condoned by the district, the district will not receive a letter of warning. The district will be asked in an official letter by the Office of Student Assessment to put measures in place to address and prevent the possibility of such improper behavior being repeated. However, multiple administrations resulting in suspect scores may result in further investigation by the Office of Student Assessment that may lead to further consequences. (Appendix F, Section VI, A)
Citation Placed on the Accreditation Record with No Immediate Action to Downgrade the Accreditation Status (Affects Institution)
The Office of Student Assessment may submit a recommendation to the Commission on School Accreditation that the school's annual performance classification include the label School in Violation of Test Security. (Appendix F, Section VI, B2)
Citation Placed on the Accreditation Record that May Result in Immediate Action to Downgrade the Accreditation Status (Affects Institution)
If it is determined that a violation of a testing requirement jeopardizes the security and integrity of the test(s) or the accuracy of test results, the Office of Student Assessment will issue written notification of the violation to the superintendent of the school district and to the Office of Accreditation.
The Office of Accreditation will note the citation of noncompliance on the district's Accreditation Record Summary and notify the superintendent of this action. The citation of noncompliance will be presented to the Commission on School Accreditation for appropriate action. This citation will remain on record until the district has successfully completed the next scheduled administration of the same test for which the irregularity was originally verified. For example, if the citation is issued for the December paper/pencil Subject Area Administration of the U. S. History Test, the next scheduled administration for the same test will be the December paper/pencil Subject Area administration the following year. The Office of Student Assessment may recommend to the Commission on School Accreditation that the school's annual performance classification include the label School in Violation of Test Security. (Appendix F, Section VI, C)
Invalidation of Scores (Affects Institution and student)
A school will not receive a school performance classification if the test data have been invalidated, and the school performance classification will be noted as Test Data Invalidated. (See Accreditation Policy 3.3.) In the case that the Office of Student Assessment has requested the district superintendent ask for the invalidation of a student's (or students') suspect scores based upon the analyses by the data forensics company and the refusal to do so by the district superintendent, the State Superintendent will have the authority to have suspect score(s) invalidated. At such time, the local district will be notified. (Appendix F, Section VI, D1)
Report to Division of Educator Misconduct (Affects educator)
Violations of testing procedures by an educator can result in a mandated report being made to the Division of Educator Misconduct. These violations of the Mississippi Educator Code of Ethics Standard 9 (Maintenance of Confidentiality) affect the validity of mandatory uniform test results as provided in Section 37-16-4(1). The result can be a loss of licensure.
Miss. Code. tit. 7, pt. 109, ch. 4