X-Road v6 data exchange anomalies, reports and open data
X-Road is a software framework that enables direct secure data exchange over internet between state and private organizations (hereafter “members”). It is the Estonian official software platform for data exchange between public and private sector institutions and enterprises. X-Road members can act as data clients or data providers or both. Data service providers make their data accessible for other members or, alternatively, collect new data from others. All state registers are data service providers. There are no central servers or databases in X-Road: all X-Road members host their own databases and members interact directly with each other. As of October 2017, there are nearly 900 X-Road members who make a total of over 40 million data queries per month. There are over 1500 data services that can be used via the X-Road. The number of X-Road members is estimated to double and the number of data exchange events to increase tenfold in the coming 5 years. X-Road is managed by Estonian Information System Authority (Riigi Infosüsteemi Amet, RIA). RIA issues access to X-Road and monitors the data traffic between members. Based on the recent X-Road version 6 software, members’ information systems store logs of all data exchange events. These usage logs are collected by RIA forming a basis for further monitoring and analysis of data traffic patterns in X-Road. Before this project, there were no dedicated tools to manage and analyze the X-Road usage statistics. To fulfill this gap, the X-Road monitoring tools were produced by STACC in order to:
- conveniently store and manage X-Road usage statistics data;
- detect potential misuse and anomalies in the data exchange between X-Road members;
- report X-Road members about their data exchange patterns: data exchange partners, produced and consumed data services, statistics on counts, data size and duration of data exchange events, etc.;
- produce, manage, share, and visualize publicly available open data on the use of X-Road.
- Member reports: reports about the members’ and their subsystems’ X-Road usage patterns including the list and statistics of their data exchange partners, produced and consumed data services, statistics on counts, data size and duration of data exchange events;
- Open reports: monthly summary statistics of X-Road usage over all members including count of members, total count of queries, counts of services and producers, etc.
- Anonymizer removes usage statistics of security authorities and decreases the precision of X-Road usage logs’ timestamps and writes the data into Open data database;
- Graphical web interface enables a user to preview and download X-Road usage statistics. Date and data fields can be filtered and sorted before viewing and downloading. An API is also provided.
1.04.2020 | NEWS
STACC is looking for a data engineerAre you a terrific Data Engineer? If yes, you should work at STACC! The data science company STACC knows how…
19.02.2020 | NEWS
Estonian IT company is creating an application whereby EU countries can earn billions of euros in tax revenueWith the support of EU money, Aurora Solutions OÜ is creating a VAT and customs declaration service platform that enables…
4.02.2020 | NEWS