Last Wednesday afternoon at SXSWedu, I was on an
"All Things K-12" panel with awesome folks from government (DOE), big corps (Google), and smaller startups (like Clever) to talk about where technology in education is going. I was the resident classroom teacher! During the course of the panel itself, I made my own big leap in understanding:
Lots of teachers hear "big data" and think of what's available now: test scores and other relatively meaningless data. Biz and Devs hear "big data" and think of what could be available in the future through revolutionary data mining technology. This disconnect is part of why many at SXSWedu wanted the whole "big data" term banned from the edtech lexicon.
Hearing this other perspective led to my first big "YES!" in the big data conversation while sitting on the panel... If we achieve this potential future the biz and dev folks envision, we'll be able to utilize technology to analyze the petabytes of meaningful student work products - essays, videos, games, blog posts, photo essays, and all sorts of other work - to build longitudinal views of each student's growth as well as snapshots of understanding across a whole school and across the whole country.
(Watch the panel and tell me if you can actually
see the lightbulb turn on over my head.)
With this understanding, I could envision a (distant: 10-15 years?) future where we have algorithms that can scan student work products looking, for example, for evidence of a student's ability to connect evidence to a scientific conclusion, but at a much deeper scale than simply looking for "if..., then..." sentence structures. (Such short-cuts in looking for understanding were part of the downfall of the Washington State "WASL" tests, that attempted to more deeply analyze student understanding than multiple choice tests, but the assessment rubrics had such low interrater reliability as to be relatively meaningless.) My previous knowledge of difficultly with
human-performed text analytics and my lack of knowledge of the state of
computer-performed text analytics led to my final assertion that we will definitely still have multiple choice standardized tests in 5 years.
Then came Friday night...