Environmental disasters (thunders, earthquakes, etc.)
Communication carrier failures
Human intervention (thieves, vandalism etc.)
Animal intervention (birds’ nests, etc)
The aforementioned parameters may cause abnormal operation of the station’s sensors leading to missing data and recording of irrational/abnormal values. In order for the process to work properly, datasets need to consist of complete and accurate values. This is a common issue identified in workflows that include sensor logging.
The expected workflow will consist of the following steps:
- We have exported an actual dataset from our database consisting of data gathered from 5 GAIATron telemetric stations in the area of Stimagka, Corinthia, Greece between 8/3 – 5/7/2016; the different stations can be identified through the different coordinates that accompany each measurement.
- This dataset has been processed in order to better illustrate the various problematic scenarios, mentioned above, that compromise not only its integrity but also its precision.
- Measurements in the dataset consist of the following: (i) Date of the measurement, (ii) Longitude and (iii) Latitude of the station, (iv) Temperature and (v) Relative Humidity.
- Participants are required to perform a normalization of the data, referring to ensuring that data only include rational values (i.e. values making sense).
- Participants are also required to work on a solution for completing the missing values so that there is a consistency in the time series.
- Last but not least, participants are required to produce and present a graph for each step, showing the evolution from one step to the other; more specifically, a graph representing the initial problematic data, a graph for the normalized and a graph from the filled gaps are expected as outcomes.
Participants are free to select any approach they consider as most appropriate for completing the aforementioned steps, such as selecting the most appropriate methods for normalizing data values and selecting data sources for completing the missing ones. They are also invited to take a step further and work on anything that will provide added value to the service; always with guidance from the NEUROPUBLIC mentors.