Learn21's Weekly EdTech Update

February 27, 2025

Don’t be Duped! Using Data to Soup up EdTech Decision-Making

by Kimberly McClain Ed.D.

Let’s be honest - buying educational technology without data is like grocery shopping while hungry. You end up with a cart full of random stuff, some of which might work, but most of which will gather dust (looking at you, 3D printer). That’s where data-driven decision-making comes in - our not-so-secret weapon against impulse buying and shiny object syndrome. 

Collect the Right Data: Not Just a Vibe Check

Before we even think about signing a purchase order for the latest and greatest EdTech tool, we need to gather data. And sadly, “It looked cool at a conference” does not count as data. 

We’re talking about real, measurable data like:

• Student engagement metrics - are students actually using the tech, or does it become another icon on their device?
• Training opportunities - Does the technology come with built-in training, so teachers are more likely to adopt the technology? 
• Teacher adoption rates - Are educators incorporating it into their lessons, or is it collecting virtual cobwebs?
• Learning outcomes - Does it improve comprehension, retention, or critical thinking, or does it just look impressive on a grant application?

Analyze Like a Pro (Or at Least Like Someone Who Read a Few Articles on Analytics)

Data isn’t like a horoscope. Instead of glancing at it and hoping for the best we have to analyze it - statistical trends, comparative studies, and even some good old-fashioned teacher and student feedback. 

Hershkovitz et al. (2024) emphasize that data alone isn’t enough; instructors need clear, user-friendly dashboards with information compiled from EdTech vendors, teachers, students and other sources instead of overwhelming charts to make data actionable. These tools provide both visuals and numbers to guide decisions. For instance, if an app shows students use it for only five minutes before switching to games, it may not be effective.

Compare Before You Commit (No Swiping Right on the First Option)

Remember, just because one district swears by a tool doesn’t mean it’s the right fit for your schools. Take a page from counterfactual analysis (Fernández-Loría et al., 2022), which essentially asks, “What if we had chosen differently?” (Fernández-Loría et al., 2022, Explaining Data-Driven Decisions Made by AI Systems: The Counterfactual Approach). Before you make the final call, consider:

• Are there tools that do the same thing but better, or for less money?
• Have we checked user reviews from actual educators, not just EdTech marketing teams?
• Will this integrate with our existing tech, or are we signing up for a compatibility nightmare? 

Pilot Programs – Because Nobody Wants Buyer’s Remorse

Would you buy a car without a test drive? Would you commit to a lifetime supply of mystery food without a taste test? The same applies to EdTech. Before rolling out new technology across an entire district, run a pilot program. 

• Select a diverse group of teachers and students to test the tech.
• Gather real-time feedback on usability and impact.
• Tweak or ditch it based on actual classroom experiences.

Using this data to drive decisions is key. According to a study on data-driven decisions in higher education (Usher, et al, 2023), instructors who had access to real-time analytics could better adjust their strategies, ensuring that tools were actually beneficial instead of just trendy. 

Review, Adjust, and Repeat: Because Tech Moves Faster Than a Middle School Gossip Chain

The beauty (and curse) of technology is that it changes constantly. What worked in 2023 might be obsolete by 2025. That’s why we need ongoing evaluations of our EdTech investments. Learning analytics tools can help by tracking student progress and engagement, allowing us to see if our shiny new purchase is still pulling its weight.

Final Thoughts: Making Smart Choices and Avoiding EdTech FOMO

At the end of the day, data-driven decision-making saves time, money, and the frustration of watching expensive tools go unused. It helps us choose technology that actually improves learning outcomes instead of just making our schools look high-tech.

So, next time a vendor tries to sell us the "next big thing in education," we’ll smile, pull out our data, and make a data-driven decision.

Media Literacy Minute

New York Launches First-Ever Media Literacy Toolkit for Educators

Governor Kathy Hochul has released New York’s first media literacy toolkit, designed to help educators teach students how to evaluate digital content. The toolkit provides lesson plans, strategies, and best practices for fostering media literacy in classrooms across the state.

Navigating Echo Chambers, Misinformation, and the Shrinking News Cycle

WUWM explores the increasing challenges of navigating today’s fast-paced news environment. The article discusses how echo chambers reinforce existing beliefs, misinformation spreads rapidly, and the shrinking news cycle makes it harder for journalists to provide in-depth, verified reporting. Experts emphasize the importance of media literacy education in helping individuals break out of filter bubbles and critically evaluate sources.

High School Students and Staff Combat Misinformation in the Classroom

A high school in Northwest Tallahassee is taking proactive steps to teach news literacy and prevent misinformation from spreading among students. Teachers and student journalists are working together to fact-check stories, analyze sources, and foster a culture of responsible news consumption. The initiative highlights how schools can play a direct role in equipping students with the skills needed to navigate digital information responsibly [WTXL].

From Data Overload to Actionable Insights: How edWise is Changing the Game

by the edWise Team

Educators are no strangers to data—it’s everywhere. But making sense of it? That’s another story. Whether it’s tracking student progress, managing industry credentials, or ensuring compliance, data shouldn’t be an obstacle—it should be a tool for action.

That’s exactly what edWise is doing. By bringing together the needs of K-12 schools, CTE programs, and district leaders, edWise is turning disconnected data into real insights that drive student success.

Collaboration in Action: Pickaway Ross’ Success

For Pickaway Ross Career Center, data wasn’t just scattered—it was limiting opportunities. Joshua Younge, Director of Curriculum and Data, shared how edWise changed that:

“Before edWise, we were reporting just 445 industry credential submissions, with reimbursements totaling $37,000. Now, we’ve surpassed 2,000 credential submissions, and our reimbursements have jumped to $112,000. That increase has allowed us to reinvest $100,000 into new credential programs for our students.”

With better access to data, Pickaway Ross didn’t just improve reporting—they unlocked more funding, more credentials, and more opportunities for students

Meeting Great Oaks’ Growing Needs

At Great Oaks Career Campus, the challenge was different: efficiently track credentials, work-based learning, and post-graduation outcomes across multiple campuses.

By working with Learn21, Great Oaks has used edWise to streamline reporting, automate tedious data collection, and create real-time insights that help staff focus on supporting students instead of managing spreadsheets. 

What’s Next?

The impact of edWise doesn’t stop at what it does today—it’s evolving based on the needs of the schools using it.

One of the latest innovations? The Student Follow-Up tool. Built in direct response to district feedback, this feature makes it easier for schools to stay connected with graduates, track their career pathways, and meet state reporting requirements—without adding administrative burden. 

edWise isn’t just a tool—it’s the result of schools, educators, and Learn21 working together to solve real challenges with real solutions.

Want to see how edWise can transform your district? Reach out to Learn21 at info@learn21.org to schedule a walkthrough.

Big Ideas

AI-Generated Teaching Videos: Just as Effective as Human-Made?

A new study published in Computers & Education tested whether AI-generated teaching videos could match human-made ones in effectiveness. Researchers produced videos using generative AI tools and compared them with traditional instructor-led videos in an online learning experiment with 447 participants. The results? While human-made videos provided a slightly better learning experience, AI-generated videos produced similar learning outcomes. This suggests that AI could play a significant role in education. How soon will AI-generated lessons become mainstream? 

Logitech’s mmWave Radar Aims to Reinvent Office Space Utilization

Logitech’s latest innovation, Spot, leverages mmWave radar technology to detect human presence with high accuracy—without relying on cameras. Designed for corporate offices, Spot aims to provide real-time occupancy data to help businesses optimize their real estate usage, a pressing concern in the hybrid work era. While the device promises increased efficiency, its implications for privacy and workplace surveillance raise critical questions. As offices adapt to fluctuating in-person attendance, will tools like Spot enhance productivity, or will they amplify concerns over employee monitoring? [The Verge]

AI Accelerates Molecular Evolution

Scientists have used AI to create a glowing molecule that would have taken 500 million years to evolve naturally. This breakthrough could lead to advances in medical imaging, synthetic biology, and even new materials. When AI can compress evolutionary timescales into mere weeks, the possibilities become endless—but so do the ethical and scientific questions. (Live Science)

If you'd like to take a hiatus from Bytes & Insights, please use the Update Profile link below. This will allow you control over which emails you receive from Learn21.

www.learn21.org