TL;DR

  • Most businesses that "have AI" are wasting 30–60% of their AI spend on the wrong tools, wrong architecture, or zero measurement.
  • The most common mistake: paying enterprise prices for capabilities a free open-source tool covers just as well for typical SMB workloads [1].
  • "We have AI" is not a strategy. If you can't point to a dollar figure, you don't have ROI — you have a subscription.
  • lil.business audits your current AI spend and identifies what's actually delivering value vs. burning budget.

AI spending in small and medium businesses has exploded. According to McKinsey's 2024 State of AI report, over 65% of organisations are now using AI in at least one business function — up from 33% two years earlier [2]. But the same report found that fewer than 30% of those deployments had a clear, measured ROI framework [2].​‌‌‌​​‌‌‍​‌‌‌​‌​​‍​‌‌​‌‌‌‌‍​‌‌‌​​​​‍​​‌​‌‌​‌‍​‌‌​‌‌‌‌‍​‌‌‌​‌‌​‍​‌‌​​‌​‌‍​‌‌‌​​‌​‍​‌‌‌​​​​‍​‌‌​​​​‌‍​‌‌‌‌​​‌‍​‌‌​‌​​‌‍​‌‌​‌‌‌​‍​‌‌​​‌‌‌‍​​‌​‌‌​‌‍​‌‌​​​​‌‍​‌‌​‌​​‌‍​​‌​‌‌​‌‍​‌‌‌​‌​​‍​‌‌​‌‌‌‌‍​‌‌​‌‌‌‌‍​‌‌​‌‌​​‍​‌‌‌​​‌‌

That means most businesses have AI. Most don't know if it's working.

Here are the five most expensive AI mistakes lil.business sees businesses making — and how to fix each one.​‌‌‌​​‌‌‍​‌‌‌​‌​​‍​‌‌​‌‌‌‌‍​‌‌‌​​​​‍​​‌​‌‌​‌‍​‌‌​‌‌‌‌‍​‌‌‌​‌‌​‍​‌‌​​‌​‌‍​‌‌‌​​‌​‍​‌‌‌​​​​‍​‌‌​​​​‌‍​‌‌‌‌​​‌‍​‌‌​‌​​‌‍​‌‌​‌‌‌​‍​‌‌​​‌‌‌‍​​‌​‌‌​‌‍​‌‌​​​​‌‍​‌‌​‌​​‌‍​​‌​‌‌​‌‍​‌‌‌​‌​​‍​‌‌​‌‌‌‌‍​‌‌​‌‌‌‌‍​‌‌​‌‌​​‍​‌‌‌​​‌‌

Mistake 1: Paying Enterprise Prices When Open-Source Works Fine

Why do businesses overpay for AI tools?

The most expensive pattern: signing a $50,000/year enterprise AI contract for a capability that an open-source model running locally handles just as well — often better, given the privacy implications of sending your business data to a third-party API.

Consider document summarisation — one of the most common AI use cases in professional services. A firm might pay $300/month for a ChatGPT Teams subscription to have staff summarise contracts and reports. That same task, run locally with a quantised Llama 3.1 8B model via Ollama, costs the electricity to run a desktop computer.

A

ccording to Andreessen Horowitz's 2024 AI infrastructure report, open-source models have closed 80–90% of the performance gap with frontier closed-source models on most standard business tasks — summarisation, classification, extraction, Q&A over documents [1]. The 10–20% gap matters for very specialised tasks. It doesn't matter for "summarise this invoice."

The fix: Before renewing any AI subscription, ask what specific task it's solving. Then ask whether that task could be handled by an open-source model deployed locally. For most SMB workloads, the answer is yes.

Related: The $0 AI Stack — Automate Your Business Without Spending a Dollar

Mistake 2: Using Cloud AI When On-Device Would Be Cheaper and More Private

Is cloud AI always the best option for business?

Cloud AI — OpenAI, Anthropic, Google Gemini — is convenient. You pay per API call, you get the latest models, and you don't maintain any infrastructure. It's also the most expensive per-token option at scale, and it means your business data transits through someone else's servers.

For a business running 10,000 AI completions/month, cloud API costs typically run $50–$300/month depending on the model tier [3][4]. On a local machine with a capable GPU (an RTX 3060 costs under $400), the same volume of inference costs near-zero once hardware is purchased — amortised over 3–5 years.

More importantly: cloud AI means your data leaves your network. For businesses handling client contracts, financial records, personnel data, or anything subject to Australian Privacy Act obligations, sending that data to a US-based API introduces genuine compliance risk [5]. Gartner predicts that by 2027, 40% of enterprise AI deployments will shift to on-device or on-premises inference — driven primarily by privacy and cost pressures [6].

The fix: Audit what data you're sending to cloud AI APIs. Any sensitive data should be processed locally. Any high-volume, repeatable task (document processing, email drafting, categorisation) is a candidate for on-device inference.

Mistake 3: Not Measuring ROI — "We Have AI" Is Not a Strategy

How do you measure the ROI of AI in a small business?

This is the most common — and most expensive — mistake. A business buys an AI writing tool, an AI CRM assistant, an AI scheduling tool, and an AI analytics platform. Total spend: $800/month. Measured value delivered: unknown, because no one set a baseline before buying and no one tracked anything after.

A Harvard Business Review analysis found that companies with formal AI ROI measurement frameworks were 3× more likely to report positive returns from AI investments than those without [7]. The measurement doesn't need to be complex. It needs to exist.

Every AI tool purchase should answer three questions before you buy:

  1. What specific task does this replace or accelerate?
  2. How much time/money does that task currently cost?
  3. How will I measure whether that cost is reduced after 60 days?

If you can't answer all three, you're not buying a tool — you're buying a hope.

The fix: Before your next AI tool renewal, spend one hour documenting what you bought it to do and whether it's doing that. Cancel anything that can't justify itself in those terms.

Mistake 4: Hiring AI Consultants Who Sell Tools, Not Solutions

What should you look for in an AI consultant for your business?

The AI consulting market has a vendor capture problem. Many consultants are incentivised — through referral agreements, reseller margins, or simple familiarity — to recommend the tools they know rather than the tools that fit your problem.

Deloitte's 2024 Technology Consulting Trends report identified vendor lock-in enabled by consultant incentive structures as one of the top three drivers of wasted enterprise technology spend [8]. The same dynamic plays out at SMB scale: a consultant leads with "you need [specific expensive platform]" before understanding your workflows.

A proper AI engagement starts with a business process audit: where is time being wasted? Where are costs repeatable and predictable? Where does automation have a clear ROI case? The tool selection comes last, not first.

lil.business operates the opposite way. We start with your cost structure and your workflows. We don't have referral agreements with AI vendors. If the answer is open-source, we say open-source. If the answer is "you don't need AI for this yet," we say that too.

The fix: Before engaging any AI consultant, ask them directly: do you receive any referral fees or reseller margins from the tools you recommend? If yes — or if they won't answer clearly — walk away.

Related: How AI Saved One Business $47K/Year on Customer Support

Mistake 5: Not Training Staff — The AI Sits Unused

Why do AI implementations fail in small businesses?

According to McKinsey, implementation and change management — not technology — is the primary reason AI deployments fail to deliver value [2]. You can deploy the best tool in the world. If your team doesn't trust it, doesn't understand when to use it, or is actively hostile out of job security fears, it will sit idle.

McKinsey estimates that AI-augmented knowledge workers are 20–40% more productive on tasks where they actively use AI assistance [2]. If your staff aren't using the tools, you're paying for the subscription and getting none of the benefit. Gartner similarly found that adoption and usage rates — not model capability — are the primary predictor of AI ROI in SMB deployments [9].

Effective training doesn't mean a full-day workshop. It means:

  • Showing people specifically how the tool makes their job easier
  • Building a small internal library of the 5–10 prompts that actually get used
  • Making the AI tool part of an existing workflow, not an extra step
  • Celebrating early wins publicly so adoption builds organically

The fix: When deploying any AI tool, budget at least 20% of your implementation cost for change management and training. If you skip this, assume you're wasting 60–80% of the tool's potential value.

How Much Is Your Business Wasting on AI?

Run this quick audit:

Question Score 1 point each
Do you have AI subscriptions you can't quantify the ROI for?
Are you sending sensitive business data to cloud AI APIs?
Did you buy AI tools without measuring a baseline first?
Did your AI consultant recommend specific products early in the process?
Are there AI tools your staff rarely or never use?

Score 0–1: You're managing AI spend reasonably well. Score 2–3: There's real waste here. Start with the highest-cost tool and apply the fixes above. Score 4–5: You're probably wasting 30–50% of your AI budget. This is worth a proper audit.

lil.business offers an AI spend audit as part of our initial consultation. We identify exactly which tools are earning their keep and which ones should go.

FAQ

How do I know if an AI tool is worth the cost? Before buying: document the specific task, the current time/cost, and your measurement method for 60-day review. After buying: track whether that metric has moved. If it hasn't moved after 60 days of proper use, the tool isn't the right fit. Companies with formal ROI frameworks are 3× more likely to see positive returns [7].

What's the difference between enterprise AI and open-source AI for business? Enterprise AI (OpenAI, Anthropic, Google) provides the most capable models via API with no infrastructure overhead — but costs per-query and sends your data to third-party servers. Open-source AI (Llama, Mistral, Gemma) runs locally on your hardware, costs near-zero after hardware investment, and keeps your data on-premises. For most SMB tasks, open-source performs comparably [1].

Is on-device AI practical for small businesses? Yes, particularly for document processing, email drafting, summarisation, and categorisation. A business laptop with 16GB RAM can run a capable 7B-parameter model locally using Ollama. No GPU required for basic use cases [1].

Should I hire an AI consultant? Only if they start with your business problem, not their tool recommendations. Ask for a process audit before any technology discussion. Ask explicitly whether they earn referral fees or reseller margins. A good AI consultant should be willing to tell you "you don't need AI for this" when that's the right answer [8].

How much should a small business spend on AI tools? There's no universal number, but a useful benchmark: AI tool costs should be less than 30% of the measurable value they deliver. Right-sized AI spend for an SMB typically runs $200–$800/month across all tools, with each line item justified by a measurable outcome [2].

References

[1] Andreessen Horowitz, "The State of Open Source AI," a16z Research, Oct. 2024. [Online]. Available: https://a16z.com/the-state-of-open-source-ai/

[2] McKinsey & Company, "The State of AI in 2024: GenAI Adoption Spikes and Starts to Generate Value," McKinsey Global Institute, May 2024. [Online]. Available: https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-state-of-ai

[3] OpenAI, "API Pricing," OpenAI, 2024. [Online]. Available: https://openai.com/pricing

[4] Anthropic, "API Pricing," Anthropic, 2024. [Online]. Available: https://www.anthropic.com/pricing

[5] Office of the Australian Information Commissioner (OAIC), "Privacy and AI: Australian Privacy Act 1988 Obligations," Australian Government, 2024. [Online]. Available: https://www.oaic.gov.au/privacy/privacy-guidance-for-organisations-and-government-agencies/privacy-and-technology/artificial-intelligence

[6] Gartner, "Predicts 2025: Artificial Intelligence Infrastructure," Gartner Research, Nov. 2024. [Online]. Available: https://www.gartner.com/en/documents/ai-infrastructure-predictions

[7] Harvard Business Review, "Making AI Investments Pay Off," Harvard Business Review, Sep. 2024. [Online]. Available: https://hbr.org/topic/subject/artificial-intelligence

[8] Deloitte, "2024 Technology Consulting and AI Adoption Trends," Deloitte Insights, 2024. [Online]. Available: https://www2.deloitte.com/global/en/pages/technology/articles/technology-consulting-ai-trends.html

[9] Gartner, "Key Factors in AI Adoption Success for SMBs," Gartner Research, 2024. [Online]. Available: https://www.gartner.com/en/small-business/insights/ai-adoption

[10] Freshworks, "AI in Business: ROI Measurement and Adoption Survey," Freshworks Research, 2024. [Online]. Available: https://www.freshworks.com/theworks/research/freshworks-global-ai-report-2024/

Want to save money with AI? Let lilMONSTER show you how.

Why You Might Be Wasting Money on Fancy Robot Helpers You Don't Need

TL;DR

  • According to McKinsey, fewer than 30% of businesses using AI have any clear way of measuring whether it's working [1]. That means most businesses paying for AI don't know if it's doing anything.
  • Free open-source AI tools have closed 80–90% of the performance gap with expensive paid tools for typical business tasks [2].
  • Five common AI money traps — and how to escape each one.
  • lil.business does a free AI spend audit to show you what's worth keeping and what's burning budget.

Imagine you hired five assistants to help with your business. But you never told them what to do. They just sat at their desks looking busy. You paid them every month. And at the end of the year, you had no idea what they'd actually done.

That's what most businesses' AI spending looks like right now.

A 2024 McKinsey report found that fewer than 30% of businesses using AI had any clear way of measuring whether it was working [1]. They had AI. They didn't know if it was doing anything.

Here are the five ways businesses waste money on AI — and exactly how to fix each one.

Waste #1: Paying for the Fancy Version When the Free One Does the Same Job

Think of it like a hammer. You can buy a $5 hammer or a $200 "professional" hammer with titanium handles. If you're hanging a picture, both drive the nail in fine.

Many AI tools work the same way. According to Andreessen Horowitz's 2024 AI infrastructure report, free open-source AI models have closed 80–90% of the performance gap with expensive paid models for typical business tasks — summarising documents, answering questions, drafting emails, sorting files [2]. The remaining 10–20% gap only matters for very specialised work.

So if you're paying $50/month for an AI writing tool to draft routine emails, there's a very good chance a free open-source model running on your own laptop does the same job at zero ongoing cost.

Fix: Before renewing any AI subscription, ask: "What exactly does this do?" Then ask: "Is there a free version that does the same thing?" Most of the time, there is.

Related: The $0 AI Stack — Free Robot Helpers for Your Business

Waste #2: Sending Your Business Secrets to Someone Else's Computer

When you use cloud AI tools like ChatGPT or Google Gemini to process your business documents, those documents travel across the internet to company servers — typically in the United States [3][4].

For sensitive business information, that creates real privacy obligations under the Australian Privacy Act 1988 [5]. Gartner predicts that by 2027, 40% of enterprise AI deployments will shift to on-device or on-premises inference driven by data sovereignty concerns [6].

The alternative — AI that runs on your computer, in your building, where nobody else can see it — is available for free.

Fix: Ask whether the AI tools you use are sending your data outside your business. If yes, and if that data is sensitive, look at local options. lil.business can help you figure out what's safe in the cloud and what should stay local.

Waste #3: Buying AI Without Knowing What Problem You're Solving

This is the most common mistake. Someone heard that AI is important. They signed up for three AI tools. They don't know if any of them are helping.

Here's the test: Can you complete this sentence? "Before we got this AI tool, [task] was taking [time/money]. Now it takes [less time/less money]."

If you can't fill in those blanks, you don't have ROI. You have a subscription.

Harvard Business Review found that companies with formal AI ROI measurement frameworks were 3× more likely to report positive returns from AI investments than those without [7]. The measurement doesn't need to be complicated. It just needs to exist.

Fix: For every AI tool you're paying for, write down what it was bought to do, how much time it saves, and what it costs. If the savings are less than the cost, cancel it.

Waste #4: Hiring Consultants Who Recommend the Most Expensive Tools

Some AI consultants get paid a cut when you buy the tools they recommend. That means they have a financial reason to recommend the expensive ones — even when a free option would work just as well.

Deloitte's 2024 Technology Consulting Trends report identified vendor lock-in enabled by consultant incentive structures as one of the top three drivers of wasted enterprise technology spend [8]. The same pattern plays out at SMB scale every day.

A good AI consultant starts by asking: "What problem are you trying to solve?" A bad one starts by saying: "You need [specific expensive product]."

Fix: Ask any AI consultant up front: "Do you receive any referral fees from the tools you recommend?" If yes, or if they won't answer, be cautious. lil.business doesn't take referral fees — we recommend what's right for you, not what earns us a commission.

Waste #5: Buying AI Tools Your Staff Never Use

The most expensive tool is one that sits unused. McKinsey found that AI-augmented knowledge workers are 20–40% more productive on tasks where they actively use AI assistance [1]. If nobody's using the tools, you're getting 0% of that uplift while paying for 100% of the subscription.

Gartner similarly found that adoption and usage rates — not model capability — are the primary predictor of AI ROI in SMB deployments [9]. The best AI in the world is useless if it stays unopened.

Fix: When you bring in any new AI tool, spend time showing staff specifically how it helps them. Build a small library of the five most useful ways to use it. Don't hand people software — show them how it makes the boring parts of their day disappear.

The Quick Self-Check

Answer these five questions honestly:

  1. Do you pay for AI tools you can't measure the value of?
  2. Are you sending sensitive documents through cloud AI?
  3. Did you buy AI tools without tracking what they were supposed to improve?
  4. Did your AI consultant show you a specific tool before understanding your business?
  5. Are there AI tools your team rarely touches?

1–2 yes: You're doing okay. Review the high-cost items. 3–4 yes: Real waste happening. Start with your most expensive tool. 5 yes: This is worth a proper review with lil.business.

FAQ

How do I know if I'm overpaying for an AI tool? If you can't name a specific task it's making faster or cheaper — and measure that improvement — you're probably overpaying. Companies with formal ROI frameworks are 3× more likely to see positive returns [7].

What's the difference between free AI and paid AI? For most everyday business tasks, not much. Open-source models handle document summarising, email drafting, classification, and data extraction at a quality level very close to the expensive paid tools for typical SMB workloads [2].

Is it risky to use AI tools that are free? Not if they're well-established and actively maintained. Tools like Ollama, n8n, and Chatwoot are used by thousands of businesses worldwide. The risk is in poorly-maintained tools — not in open-source as a category.

How much should I be spending on AI for my business? A rough guide: your AI spend should deliver at least 3× its cost in measurable value. Spending $500/month means pointing to $1,500/month in time saved or revenue generated [1].

References

[1] McKinsey & Company, "The State of AI in 2024: GenAI Adoption Spikes and Starts to Generate Value," McKinsey Global Institute, May 2024. [Online]. Available: https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-state-of-ai

[2] Andreessen Horowitz, "The State of Open Source AI," a16z Research, Oct. 2024. [Online]. Available: https://a16z.com/the-state-of-open-source-ai/

[3] OpenAI, "API Pricing," OpenAI, 2024. [Online]. Available: https://openai.com/pricing

[4] Google, "Gemini for Google Workspace Pricing," Google, 2024. [Online]. Available: https://workspace.google.com/intl/en/pricing/gemini/

[5] Office of the Australian Information Commissioner (OAIC), "Privacy and AI: Australian Privacy Act 1988 Obligations," Australian Government, 2024. [Online]. Available: https://www.oaic.gov.au/privacy/privacy-guidance-for-organisations-and-government-agencies/privacy-and-technology/artificial-intelligence

[6] Gartner, "Predicts 2025: Artificial Intelligence Infrastructure and On-Premises Inference," Gartner Research, Nov. 2024. [Online]. Available: https://www.gartner.com/en/documents/ai-infrastructure-predictions

[7] Harvard Business Review, "Making AI Investments Pay Off," Harvard Business Review, Sep. 2024. [Online]. Available: https://hbr.org/topic/subject/artificial-intelligence

[8] Deloitte, "2024 Technology Consulting and AI Adoption Trends," Deloitte Insights, 2024. [Online]. Available: https://www2.deloitte.com/global/en/pages/technology/articles/technology-consulting-ai-trends.html

[9] Gartner, "Key Factors in AI Adoption Success for SMBs," Gartner Research, 2024. [Online]. Available: https://www.gartner.com/en/small-business/insights/ai-adoption

Want to save money with AI? Let lilMONSTER show you how.

Ready to strengthen your security?

Talk to lilMONSTER. We assess your risks, build the tools, and stay with you after the engagement ends. No clipboard-and-leave consulting.

Get a Free Consultation