Project Management

Data Technical Debt: 2022 Data Quality Survey Results

From the Disciplined Agile Applied Blog
by
This blog explores pragmatic agile and lean strategies for enterprise-class contexts.

About this Blog

RSS

Recent Posts

Data Technical Debt: 2022 Data Quality Survey Results

Is Technical Debt A Management Problem? Survey Says...

You Think Your Staff Wants to Go Back to the Office? Think Again.

Contracts, Procurement, Vendors, and Agile

Disciplined Agile 5.4 Released

Categories

#AgileBeyondIT, #ChoiceIsGood, ACP, agile, Agile Alliance, agile-manifesto, book, Business Agility, Certification, Choose your WoW, Conference, Context, Continuous Improvement, contracts, COVID-19, Data Management, database, DDJ, Disciplined Agile, Enterprise Agile, estimation, Fundamentals, Governance, GQM, guesstimation, http://disciplinedagiledelivery.com/principles/be-awesome/, India, information technology, Introduction, Kanban, lean, MANAGEIndia, math, MENA, Metrics, mindset, News, OKRs, Organization, People Management, Planning, PMO, Portfolio Management, Principle, Project Management, Quality, Ranged Estimates, Remote Work, Scrum, Security, skill, software, Surveys, Technical Debt, Technical debt, Terminology, Transformation, value stream, vendor management, VMO

Date



As a manager, the quality of the data available to you has a direct impact on your ability to make effective decisions. I ran an informal survey exploring the state of data quality within organizations from April 11 to May 22, 2022.  The survey received 66 responses in total. This blog posting shares the key findings of that survey.

Figure 1 explores the perceived importance of data within organizations.  This year 95% of respondents indicated that data was considered to be an important asset within their organizations, which is consistent with previous studies that I have run in the past.  However, only 54% indicated that they were measuring data quality, which tells me that in many organizations “data is an asset” is merely rhetoric. 

Figure 1. How important is data to your organization?

The Importance of Data

 

Data Technical Debt

The survey explored issues surrounding data technical debt (DTD), which is a measure of level of data quality (DQ) problems within a data source. Figure 2 summarizes the results of a question that explored the quality of the most recently accessed data source by the respondent. Only 42% of respondents indicated that the data quality was high or very high, and 19% indicated that the data quality was low.  Clearly room for improvement.

Figure 2. Quality of production data.

Quality of Production Data

 

Figure 3 explores whether DTD is taken on intentionally, which is a management decision, with only 36% of respondents providing positive answers.  Once again, this is an indication that there is significant room for improvement in many organizations.

Figure 3. Is data technical debt taken on intentionally?

Does management take on data technical debt explicitly?

Addressing Data Technical Debt

I also explored whether organizations were addressing DTD effectively.  Figure 4 summarizes the result of the question that explored whether organizations had a DTD strategy in place.  Figure 5 summarizes the results of a question about the adoption rate of traditional data quality strategies and Figure 6 the adoption rate of agile data quality strategies.  In general agile quality strategies are more effective in practice than traditional strategies.

Figure 4. Do you have a strategy to address data technical debt?

Do you have a strategy to address data technical debt?

 

 

Figure 5. Adoption rate of traditional data quality techniques.

Adoption rate of traditional data quality techniques

 

 

Figure 6. Adoption rates of agile data quality techniques.

Adoption rate of agile data techniques

 

 

Posted on: July 11, 2022 11:37 AM | Permalink

Comments (17)

Please login or join to subscribe to this item
avatar
Shanos Kunhahamu Product Manager, Mobile Wallet| First Abu Dhabi Bank Dubai, United Arab Emirates
Great read. Thanks for sharing.

avatar
Stéphane Parent Self Employed / Semi-retired| Leader Maker Prince Edward Island, Canada
Interesting! Thanks.

avatar
REDA MOHAMED MABROUK Doha, Da, Qatar
Thanks and best regards

avatar
Mohammed Abdeldayem Project Manager| Creet International Contracting Company Ltd. Jeddah, Makkah, Saudi Arabia
Thank you

avatar
Mohamad Al-Hussein IMAR Consultant Saudi Arabia
thanks

avatar
Linda Mullally Project Manager, Consultant| Seeking next role and freelancing Ma, United States
These are great metrics. Re: figure 6 - do we have any post-survey data pertaining to the efficacy of the agile adoption of data quality techniques? How did these techniques provide business value/meet strategic goals?

avatar
Ahmed Hemdan Projects Manager| BIN QURAYA HOLDING Saudi Arabia
thanks

avatar
Alicia Morgan Project and Program Management Consultant | Consultant Dallas, TX, United States
Great article and data. It shows how important data decision making is to business success.

avatar
Latha Thamma reddi Sr Product and Portfolio Management (Automation Innovation)| DXC Technology Mckinney, Tx, United States
Good article, well explained with data with business making success decision.

avatar
Lidong Wang New York University New York, Ny, United States
Thank you for posting.
By prioritizing data quality, managers can enhance their decision-making processes, reduce uncertainty, and make more informed choices that align with organizational goals and objectives.

avatar
MOHAMED MOHAMED Abha, 14, Saudi Arabia
Thanks

avatar
Ehab Gaboub Ital consult company Abha, 14, Saudi Arabia
Thanks

avatar
Surupa Chakravarty Business Development Manager| Infosys Toronto, Ontario, Canada
Thanks for sharing

avatar
Carlos Moralejo Lozano Madrid, Spain
A lot of insights in your data analysis, make me reflect, thank you Scott.

avatar
Michael Browning Director, Cybersecurity| Vanderbilt University Nashville, United States
Great insight - thank you for sharing!

avatar
Mohamed Elsharkawy mit ghamr, DK, Egypt
THANKS

avatar
AHMED ELGOUHARI Jeddah, 2, Saudi Arabia
THANKS

Please Login/Register to leave a comment.

ADVERTISEMENTS

"We are ashamed of everything that is real about us; ashamed of ourselves, of our relatives, of our incomes, of our accents, of our opinions, of our experience, just as we are ashamed of our naked skins."

- George Bernard Shaw

ADVERTISEMENT

Sponsors