Data Technical Debt: 2022 Data Quality Survey Results
From the Disciplined Agile Applied Blog
by Scott Ambler
This blog explores pragmatic agile and lean strategies for enterprise-class contexts.
Recent Posts
Data Technical Debt: 2022 Data Quality Survey Results
Is Technical Debt A Management Problem? Survey Says...
You Think Your Staff Wants to Go Back to the Office? Think Again.
Contracts, Procurement, Vendors, and Agile
Disciplined Agile 5.4 Released
Categories
#AgileBeyondIT,
#ChoiceIsGood,
ACP,
agile,
Agile Alliance,
agile-manifesto,
book,
Business Agility,
Certification,
Choose your WoW,
Conference,
Context,
Continuous Improvement,
contracts,
COVID-19,
Data Management,
database,
DDJ,
Disciplined Agile,
Enterprise Agile,
estimation,
Fundamentals,
Governance,
GQM,
guesstimation,
http://disciplinedagiledelivery.com/principles/be-awesome/,
India,
information technology,
Introduction,
Kanban,
lean,
MANAGEIndia,
math,
MENA,
Metrics,
mindset,
News,
OKRs,
Organization,
People Management,
Planning,
PMO,
Portfolio Management,
Principle,
Project Management,
Quality,
Ranged Estimates,
Remote Work,
Scrum,
Security,
skill,
software,
Surveys,
Technical Debt,
Technical debt,
Terminology,
Transformation,
value stream,
vendor management,
VMO
Date
As a manager, the quality of the data available to you has a direct impact on your ability to make effective decisions. I ran an informal survey exploring the state of data quality within organizations from April 11 to May 22, 2022. The survey received 66 responses in total. This blog posting shares the key findings of that survey.
Figure 1 explores the perceived importance of data within organizations. This year 95% of respondents indicated that data was considered to be an important asset within their organizations, which is consistent with previous studies that I have run in the past. However, only 54% indicated that they were measuring data quality, which tells me that in many organizations “data is an asset” is merely rhetoric.
Figure 1. How important is data to your organization?

Data Technical Debt
The survey explored issues surrounding data technical debt (DTD), which is a measure of level of data quality (DQ) problems within a data source. Figure 2 summarizes the results of a question that explored the quality of the most recently accessed data source by the respondent. Only 42% of respondents indicated that the data quality was high or very high, and 19% indicated that the data quality was low. Clearly room for improvement.
Figure 2. Quality of production data.

Figure 3 explores whether DTD is taken on intentionally, which is a management decision, with only 36% of respondents providing positive answers. Once again, this is an indication that there is significant room for improvement in many organizations.
Figure 3. Is data technical debt taken on intentionally?

Addressing Data Technical Debt
I also explored whether organizations were addressing DTD effectively. Figure 4 summarizes the result of the question that explored whether organizations had a DTD strategy in place. Figure 5 summarizes the results of a question about the adoption rate of traditional data quality strategies and Figure 6 the adoption rate of agile data quality strategies. In general agile quality strategies are more effective in practice than traditional strategies.
Figure 4. Do you have a strategy to address data technical debt?

Figure 5. Adoption rate of traditional data quality techniques.

Figure 6. Adoption rates of agile data quality techniques.

Posted on: July 11, 2022 11:37 AM |
Permalink
Comments (17)
Please login or join to subscribe to this item
Shanos Kunhahamu
Product Manager, Mobile Wallet| First Abu Dhabi Bank
Dubai, United Arab Emirates
Great read. Thanks for sharing.
Stéphane Parent
Self Employed / Semi-retired| Leader Maker
Prince Edward Island, Canada
Mohammed Abdeldayem
Project Manager| Creet International Contracting Company Ltd.
Jeddah, Makkah, Saudi Arabia
Linda Mullally
Project Manager, Consultant| Seeking next role and freelancing
Ma, United States
These are great metrics. Re: figure 6 - do we have any post-survey data pertaining to the efficacy of the agile adoption of data quality techniques? How did these techniques provide business value/meet strategic goals?
Ahmed Hemdan
Projects Manager| BIN QURAYA HOLDING
Saudi Arabia
Alicia Morgan
Project and Program Management Consultant | Consultant
Dallas, TX, United States
Great article and data. It shows how important data decision making is to business success.
Latha Thamma reddi
Sr Product and Portfolio Management (Automation Innovation)| DXC Technology
Mckinney, Tx, United States
Good article, well explained with data with business making success decision.
Lidong Wang
New York University
New York, Ny, United States
Thank you for posting.
By prioritizing data quality, managers can enhance their decision-making processes, reduce uncertainty, and make more informed choices that align with organizational goals and objectives.
Ehab Gaboub
Ital consult company
Abha, 14, Saudi Arabia
A lot of insights in your data analysis, make me reflect, thank you Scott.
Michael Browning
Director, Cybersecurity| Vanderbilt University
Nashville, United States
Great insight - thank you for sharing!
Please Login/Register to leave a comment.
"We are ashamed of everything that is real about us; ashamed of ourselves, of our relatives, of our incomes, of our accents, of our opinions, of our experience, just as we are ashamed of our naked skins."
- George Bernard Shaw
|