KisanQRS: A Deep Learning-based Automated Query-Response System for Agricultural Decision-Making

TL;DR

KisanQRS is a deep learning-based system that improves agricultural query responses by clustering and ranking farmer questions, significantly enhancing response accuracy and speed in a large-scale Indian call center dataset.

Contribution

This paper introduces KisanQRS, a novel deep learning framework combining semantic clustering and LSTM-based query mapping for agricultural decision support.

Findings

Achieved 96.58% top F1-score in query mapping

Attained 96.20% NDCG score in answer retrieval

Outperformed traditional techniques significantly

Abstract

Delivering prompt information and guidance to farmers is critical in agricultural decision-making. Farmers helpline centres are heavily reliant on the expertise and availability of call centre agents, leading to inconsistent quality and delayed responses. To this end, this article presents Kisan Query Response System (KisanQRS), a Deep Learning-based robust query-response framework for the agriculture sector. KisanQRS integrates semantic and lexical similarities of farmers queries and employs a rapid threshold-based clustering method. The clustering algorithm is based on a linear search technique to iterate through all queries and organize them into clusters according to their similarity. For query mapping, LSTM is found to be the optimal method. Our proposed answer retrieval method clusters candidate answers for a crop, ranks these answer clusters based on the number of answers in a cluster, and selects the leader of each cluster. The dataset used in our analysis consists of a subset of 34 million call logs from the Kisan Call Centre (KCC), operated under the Government of India. We evaluated the performance of the query mapping module on the data of five major states of India with 3,00,000 samples and the quantifiable outcomes demonstrate that KisanQRS significantly outperforms traditional techniques by achieving 96.58% top F1-score for a state. The answer retrieval module is evaluated on 10,000 samples and it achieves a competitive NDCG score of 96.20%. KisanQRS is useful in enabling farmers to make informed decisions about their farming practices by providing quick and pertinent responses to their queries.