A report examining the use of four educational technology companies’ usage of artificial intelligence was released on 30th March 2022, following a request from Sens. Elizabeth Warren, D-Mass., Edward J. Markey, D-Mass., and Richard Blumenthal, D-Conn. back in 2021.
The companies Gaggle.net, Bark Technologies, GoGuardian and Securly Inc. were found to have misused surveillance technology while students were using the products. The report specifically noted that software monitoring student activity may have been misused for disciplinary purposes resulting in contact with law enforcement and that schools and parents have not been made aware of the use of data being gathered by these softwares.
Additionally, some of the software companies may not have taken adequate action to understand if student activity monitoring software disproportionately targets a select racial group or LGBTQ+ students, further exacerbating the disparities marginalized groups face.
This report builds on increased concerns over artificial intelligence and surveillance technology’s potential for biased algorithms that target vulnerable communities.
A lack of legal regulation and oversight contribute to the interest legislators have in investigating uses of artificial intelligence, particularly in the private sector. These specific concerns follow a report issued by the Center for Democracy and Technology documenting inappropriate surveillance of students.
As the COVID-19 pandemic continues, virtual learning stands to be more prevalent meaning more opportunities for surveillance in educational technology to be used.