Metro Nashville Public Schools test results show learning loss, unreliable results for early grades

Nashville kindergarten students might have scored higher than 95% of students tested nationally in reading this fall — or at least their parents did.

According to results from Metro Nashville Public Schools' annual Measures of Academic Progress assessment testing this fall, the 4,104 kindergarten students who were tested scored almost twice as high as those tested last year. But district officials acknowledge the data isn't reliable.

The scores, especially in early grades like kindergarten and first grade, "appear to be somewhat inflated," Paul Changas, executive director of research, assessment and evaluation for the district, told school board members Tuesday night.

This is a trend observed in other districts that also administered the tests, known as MAP, virtually this year, Changas said. Though the earliest learners might have struggled with using the computer or reading questions or directions, well-meaning family members likely swooped in to help — leading to unreliable data on how students are actually performing. 

RELATED:With the struggles of remote learning, why educators say 'it's impossible to separate' academics from digital access

Nearly 38,000 students were tested this fall — about 6,300 fewer students than last year — though the test is typically optional for students in grades K-1 and 10 and 11.

Despite the inflated scores for early grades, Changas told the board the scores seemed to level out and "appear to be relatively consistent with past performance” for the majority of students. 

Like most years, the district noticed more measurable learning loss in math than in reading, Changas said. But this is typical, he said. Students might read over the summer, but are unlikely to do daily math problems.

The potential learning loss students have experienced since schools first closed in March thanks to the COVID-19 pandemic has been one of the biggest factors that educators, government officials and even parents have cited as they have pushed for reopening schools in-person. 

Many students haven't been inside a classroom in more than seven months and the learning that takes place at home can vary dramatically. 

In September, the Tennessee Department of Education warned of possible severe learning loss across the state, though some have since questioned the department's data.

PREVIOUSLY:Tennessee education department, districts anticipate dramatic learning loss due to closures

Metro Schools was one of the first large districts in the country to test virtually — the testing window was from Aug. 17 to Sept. 18, while Metro students were still learning remotely from home, Changas said.

As some students return in-person, comparing data between students who are now testing in-person versus those still at home will be challenging, he told the board.

The district has pushed back the second round of MAP testing from November to January, while the phased return of students to in-person classes is still up in the air. Many students will still likely test virtually, Changas said.

Middle school students were set to return to in-person class on Oct. 27 and Nov. 4, but the district put that on pause because of the recent rise in COVID-19 cases. High school students aren't set to return to the classroom until January. 

Therefore the district is stressing the importance of educators using other measurements or factors to track what a student knows and how well they are learning, according to Director of Schools Adrienne Battle.

Some board members, including Emily Masters, questioned why continue using the assessment at all this year if the data is unreliable. Instead, teachers could spend that time teaching, rather than proctoring the test, she said.

MORE FROM METRO:Nashville delays return of in-person class for middle school students as COVID-19 cases rise

DISMISSED:They navigated virtual school, now these Nashville families face an agonizing decision on return to classroom

But both Changas and Mason Bellamy, the district's chief of academics and schools, said there are legal requirements for school districts to use one universal screening tool to see how students are doing. The results are used to monitor exceptional education students' progress and help identify students who might need additional intervention or instruction.

See more of the district's data below.

Meghan Mangrum covers education in Nashville for the USA TODAY NETWORK — Tennessee. Contact her at mmangrum@tennessean.com. Follow her on Twitter @memangrum.