Exploring Data Management Challenges and Solutions in Agile Software Development: A Literature Review and Practitioner Survey
Ahmed Fawzy, Amjed Tahir, Matthias Galster, Peng Liang

TL;DR
This paper reviews data management challenges in agile software development through literature and practitioner insights, highlighting key issues and solutions to improve data integration, quality, and real-time decision-making.
Contribution
It combines a systematic literature review with practitioner surveys to identify challenges and practical solutions in data management for agile projects.
Findings
Major challenges include data integration and real-time analysis
Solutions involve automation tools and ontology-based approaches
Enhanced data quality and decision-making capabilities
Abstract
Context: Managing data related to a software product and its development poses significant challenges for software projects and agile development teams. These include integrating data from diverse sources and ensuring data quality amidst continuous change and adaptation. Objective: The paper systematically explores data management challenges and potential solutions in agile projects, aiming to provide insights into data management challenges and solutions for both researchers and practitioners. Method: We employed a mixed-methods approach, including a systematic literature review (SLR) to understand the state-of-research followed by a survey with practitioners to reflect on the state-of-practice. The SLR reviewed 45 studies, identifying and categorizing data management aspects along with their associated challenges and solutions. The practitioner survey captured practical experiences…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsBig Data and Business Intelligence · Software Engineering Techniques and Practices · Software System Performance and Reliability
