Is technology encroaching on our humanity?

There is an increasing level of belief that with just a bit more computing power, another embedded chip we can fix anything from global poverty to climate change. As the ability for computers to create, collect and analyse large chunks of data and develop more and more advanced models of how our world operates, there is a risk that we become blind to technology’s limitations. And when we become blind to its limitations we increasingly apply it in ways that we shouldn’t.

Supporters claim that the algorithms consistently score more accurately than humans and that any impact on employment is just the price of progress. But this argument is simplistic and ignores the fundamental disconnect between the task that the human and the computer undertake in scoring an English test. This disconnect is the ability to understand meaning.

The ability to understand and convey meaning is a skill that humans have but technology lacks. AES is effectively a statistical analysis of words, sentences and punctuation. It can use this to ‘indicate’ the author’s grasp of the English language but at no point can the algorithm assess whether what was written (or said) was meaningful or even understandable.

“The average teaching assistant makes six times as much money as college presidents… In addition, they often receive a plethora of extra benefits such as private jets, vacations in the south seas, starring roles in motion pictures.”

The essay was given the top score of 6 out of 6.

But there is another and potentially bigger issue that this highlights. If algorithms are only assessing the indicators of good communication rather than the ability to effectively understand and convey meaning, then the algorithm is also incapable of giving usable feedback. It could suggest you use more big words, create longer sentences, and remember to capitalise proper nouns but this is a somewhat superficial assessment of your ability to communicate.

This is a classic case of how measuring the things that really matter is difficult. So instead, we take what we can measure and make them the things that matter. It is hard to measure love, good character, happiness and value so instead we measure likes, money, time and sentence length and word count.

Even the proponents of NAPLAN suggest it was never meant to be a ‘high stakes’ assessment but, in the absence of other assessments capable of capturing a broader understanding of what it means to be a good human, it has become one. Schools are narrowing their curriculum and engaging NAPLAN ‘experts’ to help them improve their scores. Students are becoming more stressed and parents are hiring tutors. Whether it was intended or not, NAPLAN has now become a thing that matters. The unintended consequence of this is that children develop to be excellent test takers at the expense of being caring, loving and creative human beings.

But wait.

This is not to suggest that technology doesn’t have a place in helping assess student outcomes. Firstly, it would seem reasonable to apply computers in the testing of things that are computable. Areas such as mathematics, physics and chemistry often involve discrete answers that are either right or wrong. If the test involved showing how an answer was derived, a good testing algorithm could even point out where the mistake was made and provide direction on how to avoid similar mistakes in the future.

It is even reasonable to employ AES or similar technologies in the assessment of creative, subjective and meaning driven subjects such as English Literature and Art. It is just important that we are conscious of a technology’s limitations and apply it correctly. In the case of AES we need to acknowledge that the computer’s assessment is, and should always be, secondary to what the human understands.

Just as it has in the past, the technology will continue to get better and the arguments will become more persuasive that the technology can do the same job that a human does just faster and cheaper. For some work (the information drive, logical, right/wrong types of work) these claims will be entirely true. In such cases, the best strategy is to embrace the technology and move onto other things. But for other work, work based in purpose, communication, creativity and meaning this will always be a lie, no matter how hard it may be to tell the difference. In these cases it is important that we continue to fight for our humanity, to do the work that matters even when we can’t measure it.

Related posts:

In this age of digital distraction, our attention gets pulled away so quickly and so often. This often means that we don’t truly engage in the moment because our brain is trying to do so many things…

The Hungarian labor market is a mixed bag. In recent years, the country has seen a surge in international investment, the majority of which has gone into the industrial sector, particularly the…

Immigrating to a new country can be a complex and challenging process. From understanding immigration laws to preparing the necessary documents, it requires meticulous attention to detail. Many…