It is evident that there needs to be a balance between query time, quality in terms of performance, but also efficiency. — Introduction The challenge with any LLM implementation is the extent to which simple queries are recognised as such, and no unnecessary computational overhead is created. Or, the implementation fails to adequately address more complex multi-step queries. But there are also queries that fall within the range between these to extremes which…