Throughout time information has been gathered and stored – from scrolls in ancient times to Big Data stores today. The same challenge that exists today, also existed in the libraries of Alexandria (circa 300BC) and that challenge was being able to access the right information with ease and speed. The solution in Alexandria was to use a catalog to identify scrolls with the key information.
With such a catalog, or index, it was possible to locate the information needed in a very short amount of time. Indeed, Google works in a very similar way today with millions of people using indexing every day.
However, cataloguing becomes a more complex challenge when the required data sits in many different data sources, especially if these data sources are heterogeneous. Imagine trying to figure out how many of your customers have ordered a new iPhone with a pre-paid SIM card of a local provider using your outlets and online-shop.
So, using the same principle as a library index of keywords, and creating an index across data sources, dataWerks has been deployed across large data sets and complex data structures to allow customers ease and speed in accessing their data. It gives a consolidated view of a multitude of databases without creating a new data architecture or moving massive amounts of data.
Across our projects we have not seen anybody else consistently applying this technological approach, while at dataWerks we have continued to refine this particular approach. It means queries run on the index providing the meta information results, and then if necessary, fetching the targeted data from the original source. This is done without having to formulate complex queries and brings the raw data together into useful information. dataWerks have filed to patent this approach and, to the best of our knowledge, are the only solution on the market pursuing this approach.