AI use in schools: National framework warns Australian schools against risks of bias and discrimination

Schools set to embrace artificial intelligence are being warned about the risks of it being used for “inappropriate purposes” including discrimination against individuals or groups.

The Australian framework for generative AI in schools, released on Thursday night, highlights that risk management should be appropriate for potential consequences.

“These consequences include the potential for errors and algorithmic bias in generative AI content; the misuse of personal or confidential information; and the use of generative AI for inappropriate purposes, such as to discriminate against individuals or groups, or to undermine the integrity of student assessments,” it said.

One of the drawbacks of generative AI is that its algorithms contain inherent bias stemming from the historical data it is trained on, so it often generates biased content.

The framework also warns schools and education departments to steer clear of AI products that sell student data.

Release of the national guidelines comes as WA Education Minister Tony Buti unveiled plans to test the effectiveness of AI tools in reducing teachers’ workloads.

Curtin University data science expert Alex Jenkins said while AI would become an important tool for teachers, curriculums would have to change to prevent students from using chatbot tools to cheat on their homework.

“There is no reliable way to detect whether a piece of text was created by a student or AI,” he said.

WA’s Education Department is still considering whether to lift a ban on students using AI in public schools after giving the green light to teachers.

“The issue for us is the data privacy,” Education director-general Lisa Rodgers said. “It’s not that we’re against it — it’s about how do we support students to use it safely.”

The framework was designed by the national schools AI taskforce after widespread consultation and signed off by education ministers in October.

It will be reviewed at least once a year to keep pace with rapid changes in technology.

Federal Education Minister Jason Clare said while generative AI presented opportunities for students and teachers, there were also risks such as the privacy and safety of school children.

“This framework will help guide all school communities so they can enjoy the potential benefits to teaching and learning that generative AI offers, while mitigating the risks,” he said.

“Importantly, the framework highlights that schools should not use generative AI products that sell student data.”

“If we get this right, generative AI can help personalise education and make learning more compelling and effective, and this framework will help teachers and school communities maximise the potential of this new technology.”