RAG is the “killer app” of AI

Bridging the Divide Between Human and AI

RAG is the “killer app” of AI.

Or, at least, it’s the killer app of AI for 2024 ➡️ AI Agents will be the killer app of AI in 2025 and beyond. Watch this space…

Back to RAG – it’s not a specific app. It’s a technique we use with AI that’s simple but incredible effective: we combine a language model with your own documents and data.

Here’s how it works: you have a repository of your own data – your documents, records, or files. RAG enables the language model to access and read these documents, meaning it can generate responses that are specifically tailored to your data.

In technical terms, RAG stands for Retrieval Augmented Generation, and models like ChatGPT, Claude, or Gemini can get to “know” your business and your team’s data, allowing the model to provide answers that are accurate, context-driven, and based on your unique information.

This puts the AI model on steroids – instead of writing generic responses, it uses your data to give you specific answers that make sense for your unique situation.

This means you get answers that are up-to-date, relevant, and specific to your business/team/organisation.

⚠️ This is important because AI is only as good as the data it’s based on. We’ve all heard the phrase “Garbage In, Garbage Out”.

RAG helps us make sure what we put in is relevant and useful to the context of what we want to get out, i.e. NOT garbage.

So, how do you implement RAG? There are many options, some very simple, and some a lot more complex (and expensive). It depends on factors like:

What’s your budget?
– High: Go self-hosted
– Moderate: Consider third-party options
– Low: ChatGPT is your friend

How sensitive is your data?
– Very: Self-hosting is the safest
– Moderate: A trusted vendor works
– Low: Cloud-based is fine

What’s your AI expertise?
– Advanced: Go self-hosted
– Intermediate: Third-party solutions
– Beginner: ChatGPT & similar options

You can’t just switch on RAG and expect instant results:

🗂️ Use up-to-date, clean, and well-organised data.
🔄 Check compatibility with your current systems.
👩‍💻 Train staff to use RAG effectively.
🔒 Ensure you follow data privacy laws.
⚙️ Regularly update and fine-tune your setup.

Would you like help setting up RAG for your business? Comment “RAG” below and I’ll DM you some resources to help you get started.

💡
Your AI Transformation Starts Here
Get The Free AI Toolkit for Strategic Breakthrough Zero Guesswork, Maximum Impact
💡 Your AI Transformation Starts Here:

Get The Free AI Toolkit for Strategic Breakthrough
Zero Guesswork, Maximum Impact

Get Instant Access
Written by Alastair McDermott

I help leadership teams adopt AI the right way: people first, numbers second. I move you beyond the hype, designing and deploying practical systems that automate busywork - the dull bits - so humans can focus on the high-value work only they can do.

The result is measurable capacity: cutting processing times by 92% and unlocking €55,000 per month in extra productivity.

More posts like this.

Bridging the Divide Between Human and AI
AI Strategy

Misleading AI Stories in 2025

Everyone’s worried about AI slop, AI hallucinations, and misinformation. But the slop and misinformation that actually moved markets and changed business decisions this year came from peer-reviewed journals, MIT and Harvard researchers, and books from major publishers with fact-checking teams. Consider: a

Bridging the Divide Between Human and AI
AI Strategy

Navigating the Chaos: How to Prepare for AI Disruption

AI is advancing faster than our institutions can respond. This gap is already causing chaos. Not just disruption, but systemic breakdown. It’s the pacing gap: one line on the graph is AI capability, rising exponentially. The other is how businesses, governments, and

Bridging the Divide Between Human and AI
AI Strategy

Why Talk About ROI First?

When I talk with clients about tech projects, I talk about Return On Investment (ROI) before I ever talk about the actual technology. I do this to solve a problem most engineers don’t even acknowledge: we love building the wrong thing really

Bridging the Divide Between Human and AI
AI Essentials

How to Use AI for Professional Writing

My Workflow for Using AI Without Losing Authority I use AI for a huge amount of my high-stakes professional writing now. Not because it’s smarter than me… ok, I mean, it is, but… But it handles the parts of writing I find

Bridging the Divide Between Human and AI
AI Strategy

Where is the ROI?

Where is the return on investment from AI? Why huge AI time savings don’t seem to impact the bottom line I keep seeing the same thing happen. People tell me they’re saving loads of time with AI, but when leadership looks at

Get regular updates on AI strategies that work.

You're almost there!

I turn AI tech & strategy into clear, actionable insights. You’ll discover how to leverage AI, how to integrate it strategically to get a competitive edge, automate tedious tasks, and improve business decision-making.

– Alastair.