Generating cubes from smart city web data

A smart city necessitates the incorporation of data sources from multiple providers and data formats. Similar to the Internet Of Things, this data is primarily obtained from web streams producing XML or JSON data. Various combinations of data obtained from different providers can be used to enhance the lives of citizens with respect to different characteristics such as transport, city planning, the environment and housing. However, data provided from these streams is not necessarily in a format suitable for analysis and OLAP queries, despite the fact that these streams often provide measures and some elements of dimensionality often found in OLAP queries. In this research, we present a StarGraph construct which is designed to import web generated data streams and automatically generate the cube format necessary for OLAP queries. Our validation shows how the data streams can be captured as StarGraphs and using a traffc data case study, demonstrates an efficiency for populating and updating the data cube.