Nirmalya Ghosh Applied AI | Technologist

Agentic Text-to-SQL

Agentic Text-to-SQL

Build a system where multiple specialized agents collaborate to answer questions about your data safely. Not a SQL chatbot. A trusted data access layer.

Continue reading ...

Schema Pruning for Text-to-SQL: 93% Less Context, Zero LLM Calls

Schema Pruning for Text-to-SQL: 93% Less Context, Zero LLM Calls

In Part 1, the naïve Text-to-SQL approach sent 8,414 tokens of schema context to generate 16 tokens of SQL - a 526:1 input-to-output ratio. This post engineers the fix: a deterministic schema pruner - context engineering at the schema layer - that selects only the tables relevant to each query, with no LLM dependency.

Continue reading ...

Text-to-SQL the Naïve Way: Why Most Demos Fail in Production

Text-to-SQL the Naïve Way: Why Most Demos Fail in Production

The promise of Text-to-SQL is compelling: let anyone query a database using plain English. The reality is that most implementations silently return wrong data, expose sensitive information, and cost more than they should.

Continue reading ...

TTFT Optimisation: Practical Patterns

How to reduce TTFT in production: practical patterns, implementation strategies, and edge cases to watch for.

Continue reading ...

How Prompt Size Directly Impacts LLM Response Latency

Understanding the mechanics of Time to First Token (TTFT) and why those extra tokens may lead to poor user experience (UX).

Continue reading ...