What Is the Research Telling Us About AI Literacy?

purple-wave

Today is National AI Literacy Day. And if you know me at all, you know this is basically my Super Bowl. I want to spend this day answering one question: “What does the research actually say when it comes to AI literacy?”

I am not a researcher. I am an educator, a practitioner, and someone who is deeply invested in getting this right for the teachers and students I work with. But staying on top of this research has become a big part of my job. If I’m going to push schools to prioritize AI literacy, I better be able to point to the evidence.

This is not a comprehensive literature review by any way, shape, or form. Rather, I am highlighting a few key studies that are informing my work. AI literacy is a rapidly growing field and there are far more studies than I can cover in one post.

First: What’s AI Literacy Anyway? Ew.

There are a lot of definitions of AI literacy out there. A lot a lot. (The number of published definitions literally doubled between 2022 and 2024.) My favorite comes from Digital Promise:

“The knowledge and skills that enable humans to critically understand, use, and evaluate AI systems and tools to safely and ethically participate in an increasingly digital world.”

Three verbs. Understand. Use. Evaluate. They work together — you can’t really have one without the others. If you don’t understand AI, you won’t know how to evaluate it. If you don’t use it, you won’t fully understand it. The cycle is the point.

AI Literacy definition graphic

One study is called What is AI Literacy? Competencies and Design Considerations. It’s definition is:

“A set of competencies that enables individuals to critically evaluate AI technologies, effectively communicate and collaborate with AI, and use AI as a tool online, at home, and in the workplace.”

All the definitions say the same thing in different words. Basically, AI literacy is the foundation of healthy, productive, and ethical AI use.

Now, on to the research on why AI literacy matters.

The AI Magical Thinking Trap

One study I reference in almost every AI training I do is called Lower Artificial Intelligence Literacy Predicts Greater AI Receptivity. The name says it all.

The study found that as a person’s AI literacy increases, their propensity to use AI actually decreases. The researchers call it the magical thinking trap. Here’s the quote directly from the study:

“People with lower AI literacy are more likely to perceive AI as magical and experience feelings of awe in the face of AI’s execution of tasks that seem to require uniquely human attributes.”

When you don’t understand that AI is essentially a prediction machine (statistically guessing the next token) you treat it like it’s magic. You copy-paste outputs without questioning them. You assume it knows more than it does. You hand it the wheel.

That magical thinking doesn’t just hurt learning outcomes. It makes people easier to manipulate.

Companies Are Counting on Magical Thinking

Here’s what I need you to sit with for a second. This study I just mentioned? It’s not an education study. It’s a marketing study. Written by business professors. And the last line of the abstract says:

“These findings suggest that companies may benefit from shifting their marketing efforts and product development toward consumers with lower AI literacy. In addition, efforts to demystify AI may inadvertently reduce its appeal.”

Read that again. Companies are actively identifying people with low AI literacy as their best customers. They are designing products and marketing campaigns to target people with low AI literacy.

AI literacy is not just about using technology better. It is a form of protection.

When Teachers Learn AI Literacy, They Save Time AND Use AI Less

The ChatGPT in Lesson Preparation study split teachers into two groups: one used ChatGPT for lesson planning with a guide that dictated proper use, the other didn’t use any generative AI. The result? Teachers with ChatGPT access spent 31% less time creating lessons with no detectable difference in lesson quality.

Here’s the AI literacy twist: over time, teachers’ use of AI tools dropped from 39% to 29% with time savings persisting. The study’s explanation: “teachers quickly learned where AI added value and where it didn’t. They stopped using it out of habit and started using it with intention.”

That is AI literacy in action.

Students Are Asking Us to Teach Them

So far we have covered what the AI literacy research says about the why. If you need one more reason to teach AI literacy, here it is straight from students themselves.

A Systematic Review of Responses, Attitudes, and Utilization Behaviors on Generative AI for Teaching and Learning in Higher Education is a synthesis of 99 studies on student attitudes toward generative AI found that students are already using it widely, but they lack confidence about quality, ethics, and appropriate use. Here’s a line from the summary:

“Students argue that successful integration of generative AI in education depends on giving students explicit guidance, structured activities, and clear expectations so that they can use these tools critically rather than passively.”

They are asking for guidance. Structure. Clear expectations.

They want to learn how to use it well. And they are asking educators to teach them.

Technical Training Alone Won’t Cut It for Educators

Here’s a study about teacher professional development for AI, and it will shock exactly no one who works in education:

Technical training alone is not enough for educators.

A systematic review of 43 studies found that the schools where teachers actually changed their practice were the ones that combined technical skill-building with:

  • Pedagogical reflection =
  • Ongoing support 
  • A culture that made it safe to experiment and fail

Teachers need AI literacy training! My AI Literacy TECH-Tac-Toe and Advent Calendar are great starting points.

AI literacy is a Now-to-Have

AI literacy is not a nice-to-have. It is a now-to-have.

The research on AI literacy is still growing. There is a lot we don’t yet know about what works, for which students, at which ages. But here’s what we do know: the educators who understand the importance of AI literacy today are the ones who will define what learning looks like tomorrow.

Happy AI Literacy Day.

smiling photo of Lindy wearing a blue blazer

Meet Lindy!

Lindy Hockenbary helps educators and school leaders bring technology and teaching together so every student thrives. With experience as a teacher, tech coach, and curriculum writer, she’s known for making professional learning practical, engaging, and fun.

Design Authentic Assessments AI Can't Fake

You assigned an essay. A student turned it in. It's polished, grammatically perfect. And you know in your gut they didn't write it. Worse? They didn’t learn anything.

Stop chasing AI detectors and start designing copy-paste-proof assessments. Get Lindy's latest guide, The Assessment Puzzle Toolkit!

Free Assessment Toolkit from LindyHoc

You may also like...

Catch Them in the Scroll: Short-Form Style Video in the Classroom

The world has spoken, and it has chosen short-form video as the format of choice. The format of engagement. So I have a question for you: why isn’t there more […]

Doom Scrolling vs. Productive Scrolling: Modeling Healthy Screen Time in a Short-Form Video World

Confession time: I do a lot of scrolling. Not exactly the opening you’d expect from a post about healthy screen time for students, right? Stick with me here. Yes, me. […]

Guide, Don’t Give: A Framework for Using AI as a Learning Tool in K-12

Is AI safe for students? Should you use AI as a learning tool? Should you be using it in your classroom at all?  I get some version of that question […]

Scroll to Top