Deepfake epidemic hits US schools

Legal measures are being implemented to criminalise the malicious use of deepfakes, but preventive measures and social norming strategies are also needed

Life

Image: Apple

Deepfakes pose a serious threat to schools across America, requiring educators to develop contingency plans for dealing with sexually explicit AI-generated content involving students or staff.

These AI-generated images and videos can be used to spread misinformation, commit fraud or create harmful content, making it critical for schools to address this emerging problem.

Recent incidents have highlighted the dangers of deepfakes in educational environments. In two separate cases, school principals were targeted by AI-generated deepfakes containing racist and violent language aimed at black students. One incident involved a student who created the deepfake, while the other involved a disgruntled athletic director who was subsequently arrested.

The lack of effective technology to combat these AI tools is a major concern for educators. Although legal measures are being taken at both the state and national levels to criminalise the malicious use of deepfakes, experts stress the need for preventive measures and social norming strategies.

Several states have passed laws criminalising the creation or distribution of AI-generated child pornography. At the federal level, Senator Ted Cruz has proposed the Take It Down Act, which criminalises the intentional disclosure of non consensual intimate visual images, including deepfakes.

School districts are grappling with how to respond to this evolving threat. In one case, a Maryland high school athletic director made a false audio recording of the principal in retaliation for an investigation into alleged financial misconduct. Investigators were able to identify the suspect from old logs of computer access.

Another incident involved high school students in New York who used AI to impersonate their high school principal and posted the deepfakes on TikTok. Although the students were punished, the event caused fear and concern among parents and students.

The use of deepfakes in schools raises serious concerns about student safety, privacy and potential harm. Addressing this problem requires a multi-faceted approach with legal frameworks, technological solutions and social awareness campaigns to promote responsible AI use.

Read More: AI deepfake Social media