Skip to main content

LLMs Don't Hallucinate ABAP. They Overgeneralize It.

· 4 min read
Darshita Chaturvedi
Co-Founder & CEO, Adri AI
Shyam Swaroop
Co-Founder & CTO, Adri AI

We spent months studying the patterns in mistakes LLMs make while writing ABAP code. While many teams frame the risks in terms of "hallucination", we've learned that hallucination is not the core issue in ABAP.

The real problems stem from how LLMs generalize programming patterns and how ABAP fundamentally differs from mainstream programming languages.

How LLMs fail in ABAP
How LLMs fail in ABAP

This blog breaks down:

Why ChatGPT Fails at Finding SAP APIs

· 4 min read
Darshita Chaturvedi
Co-Founder & CEO, Adri AI
Shyam Swaroop
Co-Founder & CTO, Adri AI

If you're building CAP or RAP applications, you've probably asked ChatGPT to find APIs in the SAP Business Accelerator Hub.

I tested ChatGPT with a straightforward request and found three distinct failure patterns that make general-purpose LLMs problematic for SAP API discovery.

How ChatGPT finds incorrect SAP APIs
How ChatGPT finds incorrect SAP APIs

How does Claude's newest model perform in SAP ABAP development?

· One min read
Darshita Chaturvedi
Co-Founder & CEO, Adri AI

Claude Opus 4.5 was released yesterday and is claimed to be "the best model in the world for coding," so I was curious how it performs in ABAP development.

So I asked both Opus 4.5 (the newest model) and Sonnet 4.5 (the previous model by Anthropic) to create an ALV report for sales order analysis using traditional ABAP. See the complete prompt in the attached document.

My first impressions:

Private beta launch

· One min read
Darshita Chaturvedi
Co-Founder & CEO, Adri AI

Yesterday, we opened up free access to our SAP Change Request agent for everyone who requested it earlier.

The response has been amazing! So we're expanding access limits and squashing a few bugs we found along the way.

ChromaSQL Early Preview

· 2 min read
Darshita Chaturvedi
Co-Founder & CEO, Adri AI

Excited to share an early preview of ChromaSQL, a new SQL-like language that helps ABAP developers access SAP’s tribal knowledge in a few seconds instead of wading through SE11/SE84 and stacks of notes. 🎉