RAG is the “killer app” of AI

Background image - bright geometric symbols on dark background

RAG is the “killer app” of AI.

Or, at least, it’s the killer app of AI for 2024 ➡️ AI Agents will be the killer app of AI in 2025 and beyond. Watch this space…

Back to RAG – it’s not a specific app. It’s a technique we use with AI that’s simple but incredible effective: we combine a language model with your own documents and data.

Here’s how it works: you have a repository of your own data – your documents, records, or files. RAG enables the language model to access and read these documents, meaning it can generate responses that are specifically tailored to your data.

In technical terms, RAG stands for Retrieval Augmented Generation, and models like ChatGPT, Claude, or Gemini can get to “know” your business and your team’s data, allowing the model to provide answers that are accurate, context-driven, and based on your unique information.

This puts the AI model on steroids – instead of writing generic responses, it uses your data to give you specific answers that make sense for your unique situation.

This means you get answers that are up-to-date, relevant, and specific to your business/team/organisation.

⚠️ This is important because AI is only as good as the data it’s based on. We’ve all heard the phrase “Garbage In, Garbage Out”.

RAG helps us make sure what we put in is relevant and useful to the context of what we want to get out, i.e. NOT garbage.

So, how do you implement RAG? There are many options, some very simple, and some a lot more complex (and expensive). It depends on factors like:

What’s your budget?
– High: Go self-hosted
– Moderate: Consider third-party options
– Low: ChatGPT is your friend

How sensitive is your data?
– Very: Self-hosting is the safest
– Moderate: A trusted vendor works
– Low: Cloud-based is fine

What’s your AI expertise?
– Advanced: Go self-hosted
– Intermediate: Third-party solutions
– Beginner: ChatGPT & similar options

You can’t just switch on RAG and expect instant results:

🗂️ Use up-to-date, clean, and well-organised data.
🔄 Check compatibility with your current systems.
👩‍💻 Train staff to use RAG effectively.
🔒 Ensure you follow data privacy laws.
⚙️ Regularly update and fine-tune your setup.

Would you like help setting up RAG for your business? Comment “RAG” below and I’ll DM you some resources to help you get started.

Written by Alastair McDermott

I help business leaders and employees use AI to automate repetitive tasks, increase productivity, and drive innovation, all while keeping a Human First approach. This enables your team to achieve more, focus on strategic initiatives, and make your company a more enjoyable place to work.

Table of Contents

More posts like this.

Background image - bright geometric symbols on dark background
AI Strategy

The AI Job Boom

AI is no longer a niche skill – it’s becoming a core competency. Since late 2022, AI-related job postings have increased by 68%, while overall tech job postings have fallen by 17% and general IT roles have declined by 27%. The trend

Background image - bright geometric symbols on dark background
AI Strategy

AI in Lung Cancer Screening

A Breakthrough in Reducing Radiologist Workload Artificial intelligence (AI) is already transforming healthcare, and a recent study published in the European Journal of Cancer confirms its effectiveness in lung cancer screening. Researchers validated a commercially available AI system using data from the

Background image - bright geometric symbols on dark background
AI Strategy

The Future of Professional Services

Clients will soon realise they’re paying for something AI can do at a fraction of the cost – what’s your next move? AI is Reshaping Professional Services – Are You Ready? AI has fundamentally changed the economics of professional work. Reviewing and

Background image - bright geometric symbols on dark background
AI Strategy

Human-First AI

The Business Case for Human-Centered AI If you think AI is just a cost-cutting tool, you’re making a billion-dollar mistake. AI is a fundamental shift transforming how we work and live. As this revolution unfolds, business leaders face a critical choice in

Blog post header
AI Essentials

How Small Businesses Can Use AI to Save Time and Boost Productivity

Practical AI Applications for Small Businesses I recently led a workshop on AI applications for small businesses with 1-10 employees. Here’s what you need to know to start using AI effectively without major investment or technical expertise. Table of Contents What AI

Background image - bright geometric symbols on dark background
AI Strategy

Should You Disclose AI Use?

AI Disclosure: A Practical Path Forward Artificial intelligence in content creation has sparked plenty of debate. Many of us are trying to figure out how AI fits into our work – and more importantly, how transparent we should be about using it.

Get regular updates on AI strategies that work.

You're almost there!

I turn AI tech & strategy into clear, actionable insights. You’ll discover how to leverage AI, how to integrate it strategically to get a competitive edge, automate tedious tasks, and improve business decision-making.

– Alastair.