Robots Atlas>ROBOTS ATLAS
Agents

NLI (No-code / No-click)

1966ActivePublished: 5 May 2026Updated: 5 May 2026Published
Key innovation
Replacing GUI and menu/button navigation with direct natural-language intent expression (speech or text), where an LLM maps the user's utterance to an action, query, or tool call without any clicks.
Category
Agents
Abstraction level
Paradigm
Operation level
Application
Use cases
Coding assistants (Copilot, Cursor, Claude Code) — "write function X" instead of navigating IDE menusNL→SQL and conversational analytics (Vanna, Snowflake Cortex, Tableau Pulse)No-code app and website generators (v0, Lovable, Bolt) — describing intent instead of building via drag-and-dropConfiguring enterprise systems (CRM, ERP) without navigating formsVoice assistants in mobile and in-car applications (Siri, Google Assistant, Alexa)Accessibility: enabling application use by individuals with motor or visual impairmentsAgentic operations — "book a flight and send the confirmation to the team" instead of five separate apps

How it works

The pipeline consists of four layers: (1) input — text or speech (ASR); (2) intent understanding — an LLM or NLU classifier maps the utterance to an action schema and parameters; (3) execution — tool calls (function calling), database queries (NL→SQL), document generation, or agent orchestration; (4) result return — natural language text, structured data, a document, or a UI state change. Session context and memory (short-term + long-term) enable multi-turn dialogue and anaphoric references.

Problem solved

Traditional GUIs impose high cognitive load: users must know the application structure, navigation paths, and UI terminology. NLI eliminates this overhead by allowing users to express intent directly. It also addresses the problem of lengthy enterprise application onboarding and accessibility barriers for users with disabilities, mobile users, and hands-free scenarios.

Components

Input layer (text / speech)Capture

Text field or microphone with ASR converting speech to text.

Intent understanding (LLM / NLU)Understand

LLM or NLU model mapping the utterance to an action schema with parameters and context.

Tool / function calling layerExecute

Function-calling mechanism that executes the recognized intent against APIs, databases, or services.

Context & memoryState

Session and long-term memory enabling multi-turn dialogue and anaphoric references.

Result rendererRespond

Output layer: text, structured data, document, or UI update; optionally TTS.

Disambiguation & fallbackRecover

Clarifying-question mechanism and graceful fallback to GUI when intent is ambiguous.

Implementation

Implementation pitfalls
Intent AmbiguityHigh

Natural language is ambiguous — without clarifying questions, the system executes incorrect actions.

Feature Discoverability GapHigh

In a GUI, available functions are visible to the user; in an NLI, the user has no inherent awareness of system capabilities, making onboarding and worked examples essential.

Tool Call HallucinationsCritical

LLM may invoke a nonexistent function or pass incorrect parameters — schema validation is required.

Destructive operations without confirmationCritical

"Delete all" must include a confirmation step — in a GUI this is handled by a confirm dialog, but in an NLI it must be added deliberately.

Latencja i kosztMedium

Every interaction involves an LLM call — slower and more expensive than a button click.

Difficulty with precise selectionMedium

"Select the third row from the top, second column" — positional operations are easier with a click.

Language Barrier and Accent BiasMedium

ASR and NLU performance degrades for dialects, accents, and domain-specific jargon.

Evolution

1966
ELIZA (Weizenbaum, MIT) — first widely known natural-language interface prototype (therapist).
Inflection point
1972
SHRDLU (Winograd) — NLI manipulating the "blocks world" demonstrates the link between language and action.
1995
Androutsopoulos et al. "Natural Language Interfaces to Databases" — formalization of NL→SQL.
2009
Wolfram Alpha — answer engine with NLI over structured knowledge.
2011
Apple Siri — first mass-market consumer NLI on a smartphone.
2022
ChatGPT brings NLI over general-purpose LLMs to the mainstream (no-code for knowledge).
Inflection point
2023
OpenAI Function Calling and tool ecosystem — NLI becomes an API-invocation layer (no-click).
2024
v0 / Cursor / Lovable — NLI as a method for building applications and code entirely without clicking.
2025
Operator / Computer Use (Anthropic, OpenAI) — NLI extended with GUI control delegated to an agent rather than the user.

Hyperparameters (configurable axes)

ModalityHigh

Text, speech, or multimodal (text + image + speech).

Tool surface sizeCritical

Number and granularity of tools/functions exposed to the model.

Grounding strategyHigh

How responses are grounded: RAG, schema structure, ontology, documents.

Fallback policyMedium

Degradation policy: clarification, GUI suggestion, refusal.

Determinism (temperature)Medium

Generation randomness — critical for executional vs exploratory tasks.

Execution paradigm

Primary mode
Conditional
Activation pattern
Input dependent

Hardware requirements

NLI based on LLMs requires GPU for low inference latency — critical for interactive systems where expected response time is <500ms.