Improving data quality in the MANRS Observatory - input needed!

Dear MANRS participants, Following the presentation of data quality in the MANRS Observatory (MANRS readiness scores, attached) at the last Community meeting (October 20), please let me suggest some concrete steps and get your opinion. Background: MANRS readiness scores for individual networks are only accessible to MANRS participants. There have been several requests from network operators to make the scores public, instead of tick marks in the participants table (https://www.manrs.org/isps/participants/). Even if done on opt-in basis this will greatly improve the transparency and credibility of the initiative. To achieve this goal we need to improve quality of data used to calculate some of the scores, and specifically, the routing incidents data for the Filtering readiness score. The data is currently sourced from BGPStream (https://bgpstream.com/) and GRIP (https://dev.hicube.caida.org/feeds/hijacks/events). Unfortunately, limited knowledge of operators’ intent and relationships between the networks does not allow to eliminate false positives. To further improve quality of these data, a feedback feature is implemented now in the Observatory: in a detailed report for an individual network the operator can classify detected suspicious events as incidents, valid routing changes, etc. This feature is described in a blogpost: https://www.manrs.org/2021/07/new-data-source-feedback-loop-enhance-manrs-ob.... Unfortunately, since the introduction of this feature back in July, we have not got much of the feedback. Proposed solution: We propose that participants receive periodic (monthly) e-mail digests, containing their MANRS readiness scores for Filtering, Anti-Spoofing, Coordination and Global validation, number of incidents encountered and a link to the detailed report prompting them to validate/classify the detected events. Please share your thoughts and additional requirements or features you’d like to see in such service. We plan to implement this feature in January-February 2022. In the meantime, please use your own reminders to check your monthly reports and validate the events. Thank you for your support of MANRS and your cooperation, Regards, Andrei MANRS Secretariat
participants (1)
-
Andrei Robachevsky