Dealing with AI Errors

Background image - bright geometric symbols on dark background

When you’re using an AI chatbot, have you ever felt like you’re talking to a genius one minute, and to a complete idiot the next?

You’re not alone! As you start using AI language models like ChatGPT, Claude, and Gemini more and more, you’ve probably encountered some weird output and basic mistakes that you feel this level of technology should be better at avoiding.

Friendly Robot

There are logical reasons why these mistakes happen! Let’s look at those:

1. Reasoning Errors

Problem: AI often struggles with complex reasoning, leading to illogical answers.

Solution: Break down complex questions into smaller, more digestible chunks. Develop a detailed, step-by-step guide for intricate tasks and iteratively refine AI prompts to enhance clarity. These models are very clever pattern-matching systems, but they’re not actually thinking (yet!).

2. Context Limitations

Problem: AI can lose track of long conversations due to limited context windows.

Solution: Keep your conversations concise and focused. Start new chats for new topics. If you’re continuing a longer conversation, occasionally restate key points to keep the context up to date and help the AI stay focused.

3. Inconsistency

Problem: Responses can vary significantly for similar queries.

Solution: Rephrase your questions if you receive inconsistent answers. Log AI responses to track patterns and identify inconsistencies. Approach this as dealing with a finicky friend – sometimes you need multiple angles to achieve consistency.

4. Misinterpretation

Problem: AI can misunderstand nuances, leading to irrelevant or incorrect answers.

Solution: Use precise, unambiguous language in your questions. Clearly define terms and context to minimize misinterpretation. This is akin to giving clear directions to someone new in town.

5. Over-Reliance on Patterns

Problem: AI may generate plausible-sounding but factually incorrect information.

Solution: Fact-check all significant AI-generated information. Treat AI outputs as preliminary drafts requiring thorough review and validation. This approach prevents the spread of misinformation.

6. Bias and Ethics

Problem: AI can produce biased or inappropriate content based on its training data.

Solution: Maintain strict ethical oversight and address inappropriate outputs immediately. Be vigilant in identifying and correcting bias to uphold professional standards.

7. Ambiguous Outputs

Problem: AI can provide vague or non-committal responses.

Solution: Ask more direct questions and provide additional context to guide the AI. This is similar to pressing for a straight answer from a politician to get the specific information you need.

8. Difficulty with Jargon

Problem: AI struggles with domain-specific terminology and slang.

Solution: Simplify terms or provide clear explanations for jargon. Create a glossary of industry terms to aid the AI’s understanding. Approach this as explaining your tech job to your grandparents – simplify for clarity.

9. Inability to Verify Sources

Problem: AI produces information without citing reliable sources.

Solution: Independently verify all AI-cited information before using it. Implement a standard verification process to ensure credibility, much like confirming a rumor before sharing it.

10. Lack of Context Awareness

Problem: AI may not fully understand user intent without detailed context.

Solution: Provide comprehensive background information before asking your main question. Clearly set the stage to ensure the AI understands the broader context of the discussion.

11. Repetition

Problem: AI may repeat phrases or ideas within a conversation.

Solution: Rephrase prompts or introduce new topics to avoid repetition. This is like changing the radio station when a song gets old, keeping the conversation fresh.

12. Sensitivity to Input Variations

Problem: Small changes in wording can lead to vastly different responses.

Solution: Experiment with different phrasings for the same question. This approach is akin to a scientist tinkering with variables to observe outcomes, helping you find the most effective way to communicate with the AI.

Dealing with these AI quirks can feel difficult at the start, but with more experience you’ll get the hang of it! AI is like a brilliant but sometimes confused intern. It can be incredibly helpful, but it needs your guidance.

As you use AI more, you’ll start to develop a feeling for when it’s hitting the mark and when it’s gone off the deep end.

Written by Alastair McDermott

I help business leaders and employees use AI to automate repetitive tasks, increase productivity, and drive innovation, all while keeping a Human First approach. This enables your team to achieve more, focus on strategic initiatives, and make your company a more enjoyable place to work.

Table of Contents

More posts like this.

Background image - bright geometric symbols on dark background
AI Strategy

The AI Job Boom

AI is no longer a niche skill – it’s becoming a core competency. Since late 2022, AI-related job postings have increased by 68%, while overall tech job postings have fallen by 17% and general IT roles have declined by 27%. The trend

Background image - bright geometric symbols on dark background
AI Strategy

AI in Lung Cancer Screening

A Breakthrough in Reducing Radiologist Workload Artificial intelligence (AI) is already transforming healthcare, and a recent study published in the European Journal of Cancer confirms its effectiveness in lung cancer screening. Researchers validated a commercially available AI system using data from the

Background image - bright geometric symbols on dark background
AI Strategy

The Future of Professional Services

Clients will soon realise they’re paying for something AI can do at a fraction of the cost – what’s your next move? AI is Reshaping Professional Services – Are You Ready? AI has fundamentally changed the economics of professional work. Reviewing and

Background image - bright geometric symbols on dark background
AI Strategy

Human-First AI

The Business Case for Human-Centered AI If you think AI is just a cost-cutting tool, you’re making a billion-dollar mistake. AI is a fundamental shift transforming how we work and live. As this revolution unfolds, business leaders face a critical choice in

Blog post header
AI Essentials

How Small Businesses Can Use AI to Save Time and Boost Productivity

Practical AI Applications for Small Businesses I recently led a workshop on AI applications for small businesses with 1-10 employees. Here’s what you need to know to start using AI effectively without major investment or technical expertise. Table of Contents What AI

Background image - bright geometric symbols on dark background
AI Strategy

Should You Disclose AI Use?

AI Disclosure: A Practical Path Forward Artificial intelligence in content creation has sparked plenty of debate. Many of us are trying to figure out how AI fits into our work – and more importantly, how transparent we should be about using it.

Get regular updates on AI strategies that work.

You're almost there!

I turn AI tech & strategy into clear, actionable insights. You’ll discover how to leverage AI, how to integrate it strategically to get a competitive edge, automate tedious tasks, and improve business decision-making.

– Alastair.