HOW THE CHANGING NATURE OF IT MANDATES NEW APPROACHES AND TECHNOLOGIES
The Evolution of Data Integration
by DAVID S. LINTHICUM
"It’s not a matter of “if” we’re moving in new directions that will challenge your existing approaches to data integration, it’s “when.”
Those who think they can sit on the sidelines and wait for their data integration technology provider to create the solutions they require will be very disappointed.
There is a data-related technology crisis that is almost upon us. Just look at the changing nature of IT, and how we share information from system to system, and from systems to humans. There is the exploding use of cloud-based resources, and database technology built for specific purposes, and the proliferation of devices that now produce and consume information at gigabytes per second.
This only begins the conversation.
The patterns of integration are becoming more complex. Information externalized from existing and emerging systems ranges from complex behaviors bound to data that must be dealt with in very specific ways, to simple structured and unstructured data, and all points in between. The patterns of information change so quickly that existing data integration technologies will soon find an insurmountable divide between the emerging needs and the existing approaches to data integration.
Integration, in terms of problem and solution patterns, has not changed a great deal in the last 20 years. Many of today’s approaches and technologies function much the same as they did in 1997. While the functionality has increased and the prices have dropped, the future gap between the requirements upon this traditional technology and what’s actually on the market will be significant.
What you think you know and understand about integration is about to be tossed out the window. A new breed of technology providers will try to match the capabilities of newer platforms with newer integration strategies, approaches, and technologies. The good news? These more modern approaches and technologies will have the best chances of meeting your future integration needs.
Indeed, they will have to meet your needs, because traditional data integration technology will son be a thing of the past, given the changing nature of information technology. So, what do you need to know? This report summarizes the changes that are occurring, new and emerging patterns of data integration, as well as data integration technology that you can buy today that lives up to these new expectations.
Conclusions reached in this paper include:
• New approaches to managing data, as well as the rapid growth of data, make traditional data integration technology unusable. Data no longer only comes in rows and columns, or semistructured / unstructured hierarchical formats. It’s no longer easy to predict. Thus, there is a need for late binding, declarative approaches, or the ability to determine the schema when reading the data. It often remains where it is, and can’t be changed to accommodate emerging use cases. Modern data integration technology must be prepared to deal with these new changes.
• Cloud computing is turning enterprise IT into complex and distributed systems that span existing data centers, to public clouds. The use of the cloud changes the game, in terms of how data is be leveraged, including the mandate to leverage data where it exists, how it exists, and bring the data together into the right context for the business.
• The rise of services, and, now, microservices, changes the game, in terms of how we leverage and manage data. These services are the new dial tone for cloud computing, and are appearing within the enterprise as well. Data services are services married with data, and they will be the most common mechanism for accessing data as we move forward. Therefore, data integration technology must layer in service directories, service governance, and service identity-based security.
• Now is the time to reinvent your enterprise around these trends. Those who don’t understand the strategic value that a new approach to data integration will have in the emerging world of computing within the next several years will end up caught without the technology they need to be successful. Those who foresee this event can learn to leverage their data assets for more strategic purposes, and thus provide a great deal more value to the business.
Please read the attached whitepaper.