In the absence of the agent, developers would have to construct a query understanding pipeline, which Weaviate claims is challenging to build, maintain, and requires specialized expertise.
The Query Agent, according to Victoria Slocum, machine learning engineer at Weaviate, ditches SQL-to-text querying and uses function calling.
Function calling, in turn, uses an LLM to structure queries using predefined function calls in JSON format, with optional arguments for search, filters, aggregation, and grouping, Slocum explained in a LinkedIn post.