Published on March 18, 2014
IS THERE A ROBOT IN THIS CLASS? THE MECHANIZATION OF STUDENT, TEACHER, AND TEXT IN THE WRITING CLASSROOM @JasonCKTham
DEFINITION Automated essay scoring (AES) is the use of specialized computer programs to assign grades to essays written in an educational setting. It is a method of educational assessment and an application of natural language processing. Its objective is to classify a large set of textual entities into a small number of discrete categories, corresponding to the possible grades – for example, the numbers 1 to 6. Therefore, it can be considered a problem of statistical classification.
The transferability of skills and cost to how students perceive writing…
“More information analysis than regurgitation… to assess students’ writing and reasoning abilities.”
“Partially replacing human graders with computer grading programs could help make those tests cheaper, and get results back to students and teachers faster.”
THE NEW “DEEP BLUE VS. KASPAROV”
“The results demonstrated that overall, automated essay scoring was capable of producing scores similar to human scores for extended-response writing items with equal performance for both source-based and traditional writing genre.
6 9 States Software
Any student who can read can be taught to score very highly on a machine-graded test.
A DOUBLE-EDGED SWORD
Agreement with human ratings is not necessarily the best or only measure of students’ writing proficiency (or the evidence of proficiency in an essay)… The limitation of human scoring as a yardstick for automated scoring is underscored by the human ratings used for some of the tasks in this study, which displayed strange statistical properties and in some cases were in conflict with documented adjudication procedures.
If you go to a business school or an engineering school, they’re not looking for creative writers. They’re looking for people who can communicate ideas. And that’s what the technology is best at evaluating.
ON MECHANIZING THE WRITING CLASSROOM
Teach students to think rhetorically about literacy and their writing.
Propel research on humanistic pedagogy and AES programs
Advocate for the true purposes of writing
CCCC Position Statement on Teaching, Learning, and Assessing Writing in Digital Environment Standards for the Assessment of Reading and Writing (rev. ed., 2009) Framework for Success in Postsecondary Writing (2011) Framework for 21st Century Curriculum and Assessment (2008, 2013)
THANK YOU! @JasonCKTham
This lesson is based around robots and will encourage students to talk ... that robots could do for them in the home. There is a ... writing class:
You are the one who best understands your students, your classroom situation, and ... own robots, writing ... teacher, students can have ...
More and more of us will learn from robots in the future, but human teachers will ... Robots Could Replace Teachers. ... skills and students of all ages ...
Why use Robots in Education ... When robots are used in the classroom, students usually work in ... for all class levels. Next year, there will be 4 new ...
... it is something the ruling class does to keep ... There is already a long-term trend towards ... technical writing and a lot of other ...
This beginner Java tutorial describes fundamentals of programming in the Java programming language
... the erosion of the American middle class and ... there was no evidence that the robots ... Stiglitz describes how the advent of mechanization and ...
Professor Surprises Students With AI Teacher ... depending on the class, but there need to be more students than ... mechanization of tasks ...
AAAI-12 Invited Talks and Presidential ... learning class had over 100,000 enrolled students. ... have had to teach my normal Stanford class ...