What is Enterprise Data Practice (EDP)? It is a community of practice conducted in a complex computing environment where data is considered, collected, generated, processed, stored, transformed, managed and used in an organisation. Each organisation has its unique EDP that involves various datasets from different sources, all information systems/computing technologies/data tools, integration solutions, data stakeholders, activities/processes and governance. It is the reality facing organisations, which continuously operates as part of business operation, changes and evolves as an Enterprise Data Ecosystem (EDE), that is, a human-data-tech ecosystem. Increasing activities in data analytics, data engineering and data governance are conducted as part of EDP in context of EDE. The status and operation conditions of EDE demonstrate the data capability of an organisation in the Big Data era and reflect whether EDP is organised and conducted in an effective, healthy and sustainable management practice.
Data industry and the data space in an organisation are changing and evolving with new concepts, approaches and technologies to deal with new data requirements and issues encountered, which are all happening in EDP or implemented in EDE. Great challenges arise for EDP operation and change management when these individual changes are continuously occurring among the highly entangled and strongly interdependent elements and activities within EDE.
Frustrations and concerns are growing when on-going EDP is becoming more complex, costly in operation (due to not only fast technology changes, continuous evolution of systems, but also workforce growth and changes), and difficult to manage in its changes and evolution in different aspects. EDP operating as the data capability for an organisation may not fail completely but could face serious data risks, and easily operate with data challenges, various data issues, silent data bugs and failures, and serious data debts in different aspects.
Organisations are facing increasing interests and demands for trusted quality data sharing across areas, boundaries and data trading in marketplaces, while, on the other hand, the government is requiring more effective measures for data security and privacy protection, and trusted data operation and readiness for emerging AI/ML applications, in particular agentic AI.