Internet of Things Integration Platform
Remote Monitoring, M2M and Device Management Software Platform
AggreGate Platform

Statistical Process Control

Classic monitoring systems save historical metric values in the relational database. It works perfect if polling period is relatively long, old events are regularly purged, and the total number of devices is not too large. But what if we poll ten metrics from one thousand devices every minute and keep data for ten years? We'll need to store 50 billion samples in our database! However, we're truly not interested in minutely statistics that is five years old. For such old data, we'd just like to know yearly averages. And AggreGate IoT Platform has a solution for this case.

AggreGate can store long-term time series data in a Round-Robin Database (RRD). The module responsible for collecting, storing and processing time-series data is called Statistical Process Control (SPC) module, or simply statistics.

Round-robin database aims to handle time-series data, like network bandwidth, temperatures, CPU load, etc. The data is stored in a circular buffer, thus, the system storage footprint remains constant over time.

The RRD database has two important benefits for storing long-term statistical data:

  • Small and constant database size
  • Extremely fast access to the historical data for any time period

Other features of SPC module include:

  • Automatic calculation of rates (e.g. flow rate or traffic)
  • Tracking minutely/hourly/daily/weekly/monthly/yearly averages, minimums and maximums for gauge-type and counter-type values
  • Configurable degradation of precision for older values
  • Concurrent usage with "classic" RDBMS-based non-aggregated historical values storage