FSA Validity Study: Results Valid

FL FSA study finds “test scores should not be used as a sole determinant in decisions” such as graduation, retention or remediation

This morning the Florida Department of Education announced that Alpine Testing Solutions, the Utah company contracted to conduct a validity study on the Florida Standards Assessment (FSA). The report stated and FL-DOE shared that, “the FSA is an accurate way to measure Florida’s students’ mastery of the standards.” Jeffrey S. Solochek of the Tampa Times in his column this morning, ‘Florida tests shouldn’t be used for student-level consequences, report says’, shared that the study stated, “Florida Standards Assessment tests that Florida students took this spring should not be used as the sole factor in deciding whether students graduate, take remedial courses or repeat a grade”. I greatly appreciate Florida Education Pam Stewart’s statement in a press release regarding the study, “because one student interrupted due to administration issues during testing is too many”. Unfortunately Department of Education spokeswoman Meghan Collins shared that the report stated that the test “was validated for broader use”, she added, “the results will be used for group-level decisions”.

While I am pleased that both the study and the Florida Department of Education recognize that the FSA should not be the sole determinant of student progression, I am disheartened that this study will now not just validate the 2015 FSA but worse, validates the improper use of these tests in determining teachers’ evaluations, schools’ grades and may negatively contribute to students’ outcomes. If the Alpine study expresses that the FSA should not be used for determining whether students graduate, take remedial courses or repeat a grade? Then it shouldn’t be used for teachers’ evaluations and schools’ grades either.

I am therefore again imploring Governor Rick Scott to use the authority of his office to immediately sign an executive order to suspend the use of these assessments for students’ grades, course requirements, graduation requirements, any performance pay requirements for teachers and administrators and any accountability/school grades for the 2014–2015 school year. In addition I ask that the Florida Legislature and FL-DOE reevaluate alternative opportunities for students who did not meet the FSA graduation requirements. Our teachers, administrators and staff did an excellent job focusing on the whole student and supported putting the needs of students first. In the end it is that commitment which will result in student success, regardless of a single assessment score.

Below is addition information in a memo by the FL-DOE released this morning about the Alpine Testing Solutions FSA validity study:

The report found that in the Evaluation of Test Items; Evaluation of Field Testing; Evaluation of Test Blueprint and Construction; Evaluation of Test Administration; Evaluation of Scaling, Equating, and Scoring; and Evaluation of Specific Psychometric Validity Questions, the policies and procedures that were followed are generally consistent with expected practices as described in the textbook Standards for Educational and Psychological Testing and other key sources that define best practices in the testing industry.

• Use of FSA Scores for Student-Level Decision Purposes: When evaluating the use of FSA scores for student-level decision purposes, the report noted that the scores for students taking computer-based tests should not be used as a sole determinant for purposes such as promotion or graduation eligibility. In Florida, statewide standardized test scores are never the sole determinant of these decisions. Therefore, students who earned a passing score, even though they were impacted, are still considered to have met the assessment graduation requirement. Those students who did not earn a passing score will still have the opportunity to retake the test or meet the requirement through other approved assessments.
• Use of FSA Scores for Group-Level Decision Purposes: When evaluating the use of FSA scores for group-level decision purposes, such as calculating scores for inclusion in teacher evaluations, calculating school grades and setting achievement level cut scores, the report noted that the evidence supports the use of these data in the aggregate for both paper-based and computer-based assessments. Therefore, the results will be used for group-level decisions, such as calculating scores for inclusion in teacher evaluations, calculating school grades, and setting achievement level cut scores.

To read the Alpine Testing Solutions FSA validity study executive summary, click here.

To read Alpine Testing Solutions FSA validity study the full report, click here.

Comments Off on FSA Validity Study: Results Valid
Filed under: News & Updates