Hi Kevin,
At first, my apologies for this (very) delayed reply.
Comments below.
Thanks in advance for your reply.
Best regards,
JMC.
De : Kevin Meynell <meynell@isoc.org>
Envoyé : jeudi 8 juin 2023 11:44
À : COMBES Jean-Michel INNOV/NET <jeanmichel.combes@orange.com>
Cc : Andrei Robachevsky <robachevsky@isoc.org>; Community MANRS <manrs-community@elists.manrs.org>; manrs-steering-committee@elists.manrs.org
Objet : Re: [manrs-community] MANRS Readiness Scores to be made public
Hi Jean-Michel,
Why only Network Operators program?
IMHO, CDN and IXP SHOULD be also considered if such a milestone is decided: these 2 programs have the “same maturity” as the Network Operator program.
The Network Operators programme has tangible and regularly updated readiness scores for each of its Actions, and the Observatory (from where this data is generated) is primarily based on this programme.
<JMC>
OK. Even if, I partially disagree with “tangible” (cf. below about the measurement framework).
</JMC>
The IXP and Vendors programmes have different Actions and do not currently have readiness scores to determine conformance because they’re largely about implementation of technical and organisational policy.
<JMC>
OK. I was not aware for IXPs.
</JMC>
On the CDN/Cloud programme this is a good suggestion and we can look at rolling this out next.
<JMC>
OK.
</JMC>
When?
No log of such a discussion … did I miss something?
If this is the MANRS meeting during RIPE meeting, it was not be possible to attend it remotely … and no report of this meeting too.
It has been discussed in various community meetings (e.g. at RIPE and APRICOT) and by the Steering Committee over the last year or so. There has been significant support for doing this and really no objections to publishing data that can
already be found the public domain.
<JMC>
IMO, such a decision should have been discussed/voted during a MANRS community meeting (cf.
https://www.manrs.org/about/governance/community-charter/).
Indeed, everyone is not able to attend physically side meetings during RIPE/APRICOT/etc. meeting and, as mentioned (cf. Andrei’s email), this publication
is an important step for the MANRS initiative.
BTW, “data that can already be found the public domain” is not correct from my point of view: this is a publication of a public data *interpretation*,
based on the measurement framework *specified by the MANRS initiative*. Unfortunately, this one is not perfect. Especially, for network operators having a large customers cone (e.g., Tier-1), as I raised during the specification of this framework. Maybe,
it should be wise/useful to provide a “warning” message on the WWW site (e.g., “MANRS readiness index is measured per Action using this measurement framework, which doesn’t take into account network operator’s customers cone – potential new version of this
framework could solve this issue”)?
</JMC>
Do you have any specific concerns with publishing this data?
<JMC>
Yes – based on the RIPE side meeting slides, about:
Generally, OPT-OUT is not well appreciated (i.e., looks like an “enforced” action) … I would have preferred a “OPT-IN” (i.e., OPT-OUT
by default) based process.
BTW, must an operator OPT-OUT each month if it wants to be OPT-OUTed?
IMO, 15-days review would be wiser.
Cf. previous comment on measurement framework and customers cone impacting the operator’s scores.
</JMC>
Seems there are still issues with MANRS initiative management before publishing data:
- A questionnaire regarding one of my company’s subsidiary has been sent a long time ago … but no reply
- A ticket has been submitted to get access to a subsidiary’s account … but no reply
Okay, apologies for this. We’re looking back at the tickets and will contact you off-list.
Regards,
Kevin
_______________________________________________ ______________________________ ______________________________ _ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you.