The history of data can be divided into two eras: pre-big data and post-big data.In the pre-big data era, data was mostly structured and exchanged between enterprises through standard mechanisms such as network data mover (NDM). The need for near real-time insights was limited, and data extraction and transformation were batch-oriented and scheduled during non-peak hours to reduce MIPs usage and disruption to online production transactions.Also, data formats were limited, the most common format being delimited flat files with headers and trailers. Both headers and trailers stored important information such as data arrival time, data producer information, and the number of records in the file.To read this article in full, please click her
Read More