Thesaurus : Doctrine

► Full Reference: R. Sève, "Compliance Obligation and changes in Sovereignty and Citizenship", in M.-A. Frison-Roche (ed.), Compliance ObligationJournal of Regulation & Compliance (JoRC) and Bruylant, "Compliance & Regulation" Serie, to be published

____

📘read a general presentation of the book, Compliance Obligation, in which this article is published

____

 Summary of the article (done by the Journal of Regulation & Compliance - JoRC): 

The contribution describes "les changements de philosophie du droit que la notion de compliance peut impliquer par rapport à la représentation moderne de l’Etat assurant l’effectivité des lois issues de la volonté générale, dans le respect des libertés fondamentales qui constituent l’essence du sujet de droit." ("the changes in legal philosophy that the notion of Compliance may imply in relation to the modern representation of the State ensuring the effectiveness of laws resulting from the general will, while respecting the fundamental freedoms that constitute the essence of the subject of law").

The contributor believes that the definition of Compliance is due to authors who « jouer un rôle d’éclairage et de structuration d’un vaste ensemble d’idées et de phénomènes précédemment envisagés de manière disjointe.  Pour ce qui nous occupe, c’est sûrement le cas de la théorie de la compliance, développée en France par Marie-Anne Frison-Roche dans la lignée de grands économistes (Jean-Jacques Laffont, Jean Tirole) et dont la première forme résidait dans les travaux bien connus de la Professeure sur le droit de la régulation. » ( "play a role in illuminating and structuring a vast set of ideas and phenomena previously considered in a disjointed manner.  For our purposes, this is certainly the case with the theory of Compliance, developed in France by Marie-Anne Frison-Roche in the tradition of great economists (Jean-Jacques Laffont, Jean Tirole) and whose first form was in her well-known work on Regulatory Law").

Drawing on the Principles of the Law of the American Law Institute, which considers compliance to be a "set of rules, principles, controls, authorities, offices and practices designed to ensure that an organisation conforms to external and internal norms", he stresses that Compliance thus appears to be a neutral mechanism aimed at efficiency through a move towards Ex Ante. But he stresses that the novelty lies in the fact that it is aimed 'only' at future events, by 'refounding' and 'monumentalising' the matter through the notion of 'monumental goals' conceived by Marie-Anne Frison-Roche, giving rise to a new jus comune. Thus, "la compliance c’est l’idée permanente du droit appliquée à de nouveaux contextes et défis." ("Compliance is the permanent idea of Law applied to new contexts and challenges"). 

So it's not a question of making budget savings, but rather of continuing to apply the philosophy of the Social Contract to complex issues, particularly environmental issues. 

This renews the place occupied by the Citizen, who appears not only as an individual, as in the classical Greek concept and that of Rousseau, but also through entities such as NGOs, while large companies, because they alone have the means to pursue the Compliance Monumental Goals, would be like "super-citizens", something that the digital space is beginning to experience, at the risk of the individuals themselves disappearing as a result of "surveillance capitalism". But in the same way that thinking about the Social Contract is linked to thinking about capitalism, Compliance is part of a logical historical extension, without any fundamental break: "C’est le développement et la complexité du capitalisme qui forcent à introduire dans les entités privées des mécanismes procéduraux d’essence bureaucratique, pour discipliner les salariés, contenir les critiques internes et externes, soutenir les managers en place" ("It is the development and complexity of capitalism that forces us to introduce procedural mechanisms of a bureaucratic nature into private entities, in order to discipline employees, contain internal and external criticism, and support the managers in place") by forcing them to justify remuneration, benefits, and so on.

Furthermore, in the words of the author, "Avec les buts monumentaux, - la prise en compte des effets lointains, diffus, agrégés par delà les frontières, de l’intérêt des générations futures, de tous les êtres vivants - ,  on passe, pour ainsi dire, à une dimension industrielle de l’éthique, que seuls de vastes systèmes de traitement de l’information permettent d’envisager effectivement." ("With the Monumental Goals - taking into account the distant, diffuse effects, aggregated across borders, the interests of future generations, of all living beings - we move, so to speak, to an industrial dimension of ethics, which only vast information processing systems can effectively envisage").

This is how we can find a division between artificial intelligence and human beings in organisations, particularly companies, or in decision-making processes.

In the same way, individual freedom does not disappear with Compliance, because it is precisely one of its monumental goals to enable individuals to make choices in a complex environment, particularly in the digital space where the democratic system is now at stake, while technical mechanisms such as early warning will revive the right to civil disobedience, invalidating the complaint of "surveillance capitalism".

The author concludes that the stakes are so high that Compliance, which has already overcome the distinctions between Private and Public Law and between national and international law, must also overcome the distinction between Information and secrecy, particularly in view of cyber-risks, which requires the State to develop and implement non-public Compliance strategies to safeguard the future.

____

🦉This article is available in full text to those registered for Professor Marie-Anne Frison-Roche's courses

________

Editorial responsibilities : Direction de la collection "Droit et Économie", L.G.D.J. - Lextenso éditions (30)

🌐follow Marie-Anne Frison-Roche on LinkedIn

🌐subscribe to the Newsletter MAFR. Regulation, Compliance, Law

____

 Full ReferenceM.-A. Frison-Roche (ed.), Contentieux Systémique Émergent (Emerging Systemic Litigation), Paris, LGDJ, "Droit & Économie" Serie, to be published

____

📚Consult all the other books of the Serie in which this book is published

____

► General Presentation of the Book : 

____

 

TABLE OF CONTENTS

Thesaurus : Doctrine

 Full Reference: R. Sève, "L'Obligation de Compliance et les mutations de la souveraineté et de la citoyenneté" ("Compliance Obligation and changes in Sovereignty and Citizenship"), in M.-A. Frison-Roche (ed.), L'obligation de ComplianceJournal of Regulation & Compliance (JoRC) and Dalloz, coll. "Régulations & Compliance", 2024, forthcoming.

 

____

📕read the general presentation of the book, L'obligation de Compliance, in which this article is published.

____

► English Summary of this article (done by the Journal of Regulation & Compliance - JoRC) : The contribution describes "les changements de philosophie du droit que la notion de compliance peut impliquer par rapport à la représentation moderne de l’Etat assurant l’effectivité des lois issues de la volonté générale, dans le respect des libertés fondamentales qui constituent l’essence du sujet de droit." ("the changes in legal philosophy that the notion of Compliance may imply in relation to the modern representation of the State ensuring the effectiveness of laws resulting from the general will, while respecting the fundamental freedoms that constitute the essence of the subject of law").

The contributor believes that the definition of Compliance is due to authors who « jouer un rôle d’éclairage et de structuration d’un vaste ensemble d’idées et de phénomènes précédemment envisagés de manière disjointe.  Pour ce qui nous occupe, c’est sûrement le cas de la théorie de la compliance, développée en France par Marie-Anne Frison-Roche dans la lignée de grands économistes (Jean-Jacques Laffont, Jean Tirole) et dont la première forme résidait dans les travaux bien connus de la Professeure sur le droit de la régulation. » ( "play a role in illuminating and structuring a vast set of ideas and phenomena previously considered in a disjointed manner.  For our purposes, this is certainly the case with the theory of Compliance, developed in France by Marie-Anne Frison-Roche in the tradition of great economists (Jean-Jacques Laffont, Jean Tirole) and whose first form was in her well-known work on Regulatory Law").

Drawing on the Principles of the Law of the American Law Institute, which considers compliance to be a "set of rules, principles, controls, authorities, offices and practices designed to ensure that an organisation conforms to external and internal norms", he stresses that Compliance thus appears to be a neutral mechanism aimed at efficiency through a move towards Ex Ante. But he stresses that the novelty lies in the fact that it is aimed 'only' at future events, by 'refounding' and 'monumentalising' the matter through the notion of 'monumental goals' conceived by Marie-Anne Frison-Roche, giving rise to a new jus comune. Thus, "la compliance c’est l’idée permanente du droit appliquée à de nouveaux contextes et défis." ("Compliance is the permanent idea of Law applied to new contexts and challenges"). 

So it's not a question of making budget savings, but rather of continuing to apply the philosophy of the Social Contract to complex issues, particularly environmental issues. 

This renews the place occupied by the Citizen, who appears not only as an individual, as in the classical Greek concept and that of Rousseau, but also through entities such as NGOs, while large companies, because they alone have the means to pursue the Compliance Monumental Goals, would be like "super-citizens", something that the digital space is beginning to experience, at the risk of the individuals themselves disappearing as a result of "surveillance capitalism". But in the same way that thinking about the Social Contract is linked to thinking about capitalism, Compliance is part of a logical historical extension, without any fundamental break: "C’est le développement et la complexité du capitalisme qui forcent à introduire dans les entités privées des mécanismes procéduraux d’essence bureaucratique, pour discipliner les salariés, contenir les critiques internes et externes, soutenir les managers en place" ("It is the development and complexity of capitalism that forces us to introduce procedural mechanisms of a bureaucratic nature into private entities, in order to discipline employees, contain internal and external criticism, and support the managers in place") by forcing them to justify remuneration, benefits, and so on.

Furthermore, in the words of the author, "Avec les buts monumentaux, - la prise en compte des effets lointains, diffus, agrégés par delà les frontières, de l’intérêt des générations futures, de tous les êtres vivants - ,  on passe, pour ainsi dire, à une dimension industrielle de l’éthique, que seuls de vastes systèmes de traitement de l’information permettent d’envisager effectivement." ("With the Monumental Goals - taking into account the distant, diffuse effects, aggregated across borders, the interests of future generations, of all living beings - we move, so to speak, to an industrial dimension of ethics, which only vast information processing systems can effectively envisage").

This is how we can find a division between artificial intelligence and human beings in organisations, particularly companies, or in decision-making processes.

In the same way, individual freedom does not disappear with Compliance, because it is precisely one of its monumental goals to enable individuals to make choices in a complex environment, particularly in the digital space where the democratic system is now at stake, while technical mechanisms such as early warning will revive the right to civil disobedience, invalidating the complaint of "surveillance capitalism".

The author concludes that the stakes are so high that Compliance, which has already overcome the distinctions between Private and Public Law and between national and international law, must also overcome the distinction between Information and secrecy, particularly in view of cyber-risks, which requires the State to develop and implement non-public Compliance strategies to safeguard the future.

________

Oct. 1, 2024

MAFR TV : MAFR TV - Surplomb

🌐suivre Marie-Anne Frison-Roche sur LinkedIn

🌐s'abonner à la Newsletter MAFR. Regulation, Compliance, Law

🌐s'abonner à la Newsletter Surplomb, par MAFR

____

► Référence complète : M.-A. Frison-Roche, "Du Droit de la Compliance découle le Droit de l'Intelligence Artificielle", in série de vidéos Surplomb, 1er octobre 2024ré

____

🌐visionner sur LinkedIn cette vidéo de la série Surplomb

____

🌐visionner sur LinkedIn cette vidéo de la série Surplomb, publiée dans la Newsletter Surplomb, par MAFR

____

🎬visionner ci-dessous cette vidéo de la série Surplomb⤵️

____

Surplomp, par mafr

la série de vidéos dédiée à la Régulation, la Compliance et la Vigilance

                           

Updated: Sept. 15, 2024 (Initial publication: )

Law by Illustrations

► Référence complète : M.-A. Frison-Roche., "🎬𝑰'𝒎 𝒚𝒐𝒖𝒓 𝒎𝒂𝒏 -  une question à laquelle réponse est demandée : la loi doit-elle autoriser le mariage avec un robot humanoïde ?", billet 15 septembre 2024.

 

► voir le film-annonce 

___

Ce film allemand de 2021de Maria Schrader a reçu le Lion .. à la Nostra de Venise

Il est une fable sur l'intelligence artificielle dans notre société, maintenant et demain.

Dans une société du futur, d'un futur proche, une entreprise (on ne sait pas laquelle) propose à des humains de tester des robots humanoïdes pendant 3 semaines, comme "compagnon idéal", au terme duquel l'humain fournit un rapport pour formuler une opinion argumentée en répondant à la question suivante : Le législateur doit-il changer la loi pour admettre un mariage entre un humain et l'humanoïde.

La fable se déroule entre une femme, Alma, qui accepte de faire cette expérience. Elle n'est pas rémunérée et ne travaille pas dans l'I.A., elle travaille sur la culture perse et le déchiffrage de l'écriture cunéiforme. Son patron lui indique que si elle accepte l'expérience, des crédits seront sans doute débloqués pour permettre à son équipe de poursuivre ses recherches sur ce sujet-là. Il précise, en riant : "bien sûr, je ne cherche en rien à te corrompre".

Se présente donc le "compagnon idéal" réalisé selon ses goûts. Il a par exemple un accent britannique (elle est universitaire, elle apprécie la distinction d'un accent britannique, etc.)

Pendant 3 semaines, le robot parfait s'adapte, et elle a bien du mal mais trouve petit à petit qu'il est vraiment parfait, elle s'ouvre petit à petit.

Elle a beaucoup de soucis. Vit complètement seule. Son mari vient de la quitter pour une autre. Dont elle apprend qu'elle attend un enfant, tandis qu'elle a perdu un enfant jadis et n'en a jamais eu par la suite. Son père est atteint d'un Alzheimer en stade avancé et elle a bien du mal à l'aider.

Tandis que le robot, Tom, fait tout parfaitement, mais cela ne va jamais vraiment bien, puisqu'il ne sent pas, n'a pas froid, n'a pas faim, n'a pas peur. Il peut tout calculer, c'est commode. Elle se sent seule et veut arrêter car plus elle le voit et plus elle se sent à la fois seule et attirer par ce compagnon idéal qui lui appartient : I'm your man.

C'est vrai, c'est tentant.

A aucun moment, on ne voit ni ne parle de l'entreprise qui fabrique les algorithmes et les robots, qui sont manifestement au stade expérimental. 

Elle rencontre dans la rue un homme qu'elle avait rencontré précédemment : il est juriste et tient à son bras une jeune fille, souriante, jolie, qui le regarde avec affection. Il lui dit : vous en êtes où ? Moi, j'ai été sollicité parce que je suis juriste. Pour donner une opinion juridique. Mais je suis si heureux ! Avant personne ne voulait de moi. Peut-être pour une histoire de pheromones ou pour mon physique (il est un peu gros) ou parce que j'ai 62 ans. Et maintenant je suis si heureux avec elle ! Je suis en train de négocier pour la garder toujours ! Je crois que je vais arriver à obtenir cela !"

Alma rend son rapport qui tient en quelques lignes : il est le compagnon parfait, qui peut pallier notre solitude, s'ajuster à nos désirs, répondre à tout. Mais notre condition humain est d'avoir des désirs qui ne sont pas comblés, d'avoir des questions sans réponse, d'aller de l'avant. Avec de tels robots, l'humain n'ira plus de l'avant. Il ne faut exclure totalement la possibilité de mariage entre des humains et des algorithmes à forme humaine.

____

On peut mettre ce film dans la longue liste des films qui prennent ce thème essentiel.

Le film prophétique de Spielberg , Intelligence Artificiel où le robot joué par Jude Law est prostitué, où le robot principal est l'enfant tant désiré.

Le film Her où l'amour pour la suite algorithmique dont l'humain est amoureux choisit de s'ajuster plutôt à un autre algorithme.

____

Prenons cela du côté du Droit

1. La question est celle du Législateur. La réponse est claire : c'est Non.

2. L'industrie est invisible : que peut le Législateur à l'égard d'une industrie que l'on ne voit pas, que l'on entend pas, qui n'écrit pas, dont les représentants ne sont eux-mêmes que des androïdes ?

3. La question expressément posée portait aussi sur l'éthique. Après, l'on n'a plus aucune discussion et aucune réponse : quand on n'a pas d'interlocuteur, il est difficile de formuler.

4. Le lien entre les savants et l'industrie est clairement posé ; il n'est pas choquant en soi

5. Le juriste, sollicité sur la dimension juridique, est celui qui l'aborde le mieux, celui qui veut garder la "jeune fille idéale", celui qui ne se pose aucune question éthique. 

 

Juridiquement, c'est donc une très triste fable.

 

____

 

June 28, 2024

Thesaurus : Soft Law

► Référence complète : Autorité de la concurrence (ADLC), avis 24-A-05 du 28 juin 2024 relatif au fonctionnement concurrentiel du secteur de l’intelligence artificielle générative, juin 2024, 104 p.

____

📜lire l'avis

____

📰lire le communiqué de presse accompagnant la publication de l'avis

________

June 28, 2024

Thesaurus : Doctrine

► Référence complète : E. Netter, "Quand la force de conviction du scoring bancaire provoque sa chute. L'interprétation extensive, par la CJUE, de la prohibition des décisions entièrement automatisées", RTD com., 2024, chron., pp.342-348

____

🦉Cet article est accessible en texte intégral pour les personnes inscrites aux enseignements de la Professeure Marie-Anne Frison-Roche

________

June 24, 2024

Conferences

► Full ReferenceM.-A. Frison-Roche, "Les deux rencontres entre l'intelligence artificielle et le Contentieux Systémique" ("The two meetings between Artificial Intelligence and Systemic Litigation"), in L’intelligence artificielle, nouveau champ de Contentieux Systémique (Artificial intelligence, new field of Systemic Litigation), in cycle of conferences-debates "Contentieux Systémique Émergent" ("Emerging Systemic Litigation"), organised on the initiative of the Cour d'appel de Paris (Paris Cour of Appeal), with the Cour de cassation (French Court of cassation), the Cour d'appel de Versailles (Versailles Court of Appeal), the École nationale de la magistrature - ENM (French National School for the Judiciary) and the École de formation des barreaux du ressort de la Cour d'appel de Paris - EFB (Paris Bar School), under the scientific direction of Marie-Anne Frison-Roche, June 24, 2024, 11am-12.30pm, Cour d'appel de Paris, Cassin courtroom.

____

🧮see the full programme of this event

____

► English Summary of the conference: In the general presentation on the theme itself, I underlined "The two meetings between Artificial Intelligence and Systemic Litigation".

The focus of this conference is not the state of what is usually called Artificial Intelligence, but rather how to correlate AI and "Emerging Systemic Litigation" (ESL).

This involves recalling what "Systemic Litigation" is (1), then looking at the contribution of Artificial Intelligence to dealing with this type of litigation (2), before considering that the algorithmic system itself can be a subject of Systemic Litigation (3).

 

1. What is the Systemic Litigation that we see Emerging?

On the very notion of "Emerging Systemic Litigation" (ESL), proposed in 2021, read : M.-A. Frison-Roche, 🚧The Hypothesis of the category of Systemic Cases brought before the Judge, 2021

Emerging Systemic Litigation concerns situations that are brought before the Judge and in which a System is involved. This may involve the banking system, the financial system, the energy system, the digital system, the climate system or the algorithmic system.

In this type of litigation, the interests and future of the system itself are at stake, "in the case". The judge must therefore "take them into consideration"📎!footnote-3679.

In this respect, "Emerging Systemic Litigation" must be distinguished from "Mass Litigation". "Mass litigation" refers to a large number of similar disputes. The fact that they are often of "low importance" is not necessarily decisive, as these disputes are important for the people involved and the use of A.I. must not overpower the specificity of each one. The fact remains, however, that the criterion for Systemic Litigation is the presence of a system. It may happen that a mass litigation calls into question the very interest of a system (for example, value date litigation), but more often than not the Systemic Litigation we see emerging is, unlike mass litigation, a very specific case in which one party, for example, formulates a very specific claim (e.g., asking for considerable work to be stopped) against a multinational company, and will thus "call into question" an entire value chain and the obligations incumbent on the powerful company to safeguard the climate system, which is therefore present in the proceedings (which does not, however, entitle it to make claims, but which must be taken into consideration).

 

2. The contribution of Algorithmic Power in the conduct of a Systemic Litigation

In this respect, AI can be a useful, if not indispensable, tool for mastering such Systemic Litigation, the emergence of which corresponds to a novelty, and the knowledge of which is brought before the Ordinary Law Judge.

Indeed, this type of litigation is particularly complex and time-consuming, with evidentiary issues at the heart of the case, and with expert appraisal following on from expert appraisal. Expert appraisals are difficult to carry out. AI can therefore be a means for the judge to control the expert dimension of Systemic Litigation, in order to curb the increased risk of experts capturing the judge's decision-making power.

The choice of AI techniques presents the same difficulties as those that have always applied to experts. It is likely that certification mechanisms, analogous to registration on expert lists, will be put in place, if we move away from construction by the courts themselves (or by the government, which may pose a problem for the independence of the judiciary), or if we want control over tools provided by the parties themselves, with regard to the principle of equality of arms due to the cost of these tools.

 

3. When it is the Algorithmic System itself that is the subject of a Systemic Litigation: its place is then rather in defense

Moreover, the algorithmic system itself gives rise to Systemic Litigation, in that individuals may bring a case before the courts claiming to have suffered damage as a result of the algorithmic system's operation, or seeking enforcement of a contract drawn up by the system. It is in the realm of the Ordinary Contract and Tort Law that the system may find itself involved in the jurisdictional proceedings.

It is noteworthy that, compared with the hypotheses hitherto favored in previous conference-debates, notably those of April 26, 2024 on Emerging Systemic Litigation linked to the Duty of Vigilance📎!footnote-3681, the systems involved have been taken into consideration more behind the claims articulated by the plaintiffs, since they allege that a system has been attacked. It would then be "civil society" acting against the company. In the case of the algorithmic system, the initial litigation is made up of allegations that accuse the system of infringing rights (e.g. copyright, right to privacy, etc.).

However, the instance changes if the system is no longer presented as the potential "victim" but rather as the potential "culprit". In particular, it is much less clear what type of intervener in the proceedings, who is not necessarily a party to the dispute, should speak to explain the system's interest, particularly with regard to the sustainability and future of the AI system.

This is an area for further consideration by heads of courts.

________

1

🕴️Fr. Ancel, 📝Compliance Law, a new guiding principle for the Trial?in 🕴️M.-A. Frison-Roche (ed.), 📘Compliance Jurisdictionalisation, 2024.

2

🧮La vigilance, nouveau champ de contentieux systémique (Vigilance, new field of Systemic Litigation)in cycle of conference-debates "Contentieux Systémique Émergent" ("Emerging Systemic Litigation"), organised on the initiative of the Cour d'appel de Paris (Paris Cour of Appeal), with the Cour de cassation (French Court of cassation), the Cour d'appel de Versailles (Versailles Court of Appeal), the École nationale de la magistrature - ENM (French National School for the Judiciary) and the École de formation des barreaux du ressort de la Cour d'appel de Paris - EFB (Paris Bar School), under the scientific direction of Marie-Anne Frison-Roche, June 24, 2024.

June 24, 2024

Organization of scientific events

 Full Reference: L’intelligence artificielle, nouveau champ de Contentieux Systémique (Artificial intelligence, new field of Systemic Litigation), in cycle of conferences-debates "Contentieux Systémique Émergent" ("Emerging Systemic Litigation"), organised on the initiative of the Cour d'appel de Paris (Paris Cour of Appeal), with the Cour de cassation (French Court of cassation), the Cour d'appel de Versailles (Versailles Court of Appeal), the École nationale de la magistrature - ENM (French National School for the Judiciary) and the École de formation des barreaux du ressort de la Cour d'appel de Paris - EFB (Paris Bar School), under the scientific direction of Marie-Anne Frison-Roche, June 24, 2024, 11am-12.30pm, Cour d'appel de Paris, Cassin courtroom.

____

🌐see on LinkedIn the report made of this event

____

► Presentation of this conference-debate:  Artificial intelligence has enabled the creation of an algorithmic system. This develops its own logic, which is essentially technological in nature. It generates computing power based on the correlation of information to produce possible causalities and build probabilities that are sometimes likened to "predictions", with the mass processed eventually generating a qualitative change.

This change is linked to the digital space itself, which by its very nature gives rise to systemic disputes and litigation, to which the conference-debate on 27 May 2024 was devoted.

There are three ways in which this Emerging Systemic Litigation is involved, and it is important to anticipate these, as the litigation is either in its infancy or still to come, but will undoubtedly arise suddenly.

Firstly, it is possible that the technological tool will make it possible to deal with certain cases where the technical nature of either the concepts or the requests, or the multitude of requests, however simple, require this ability to deal with the mass, which leads to an increase in both the mechanical power of algorithms and the greater presence of human beings, in particular through the increase in adversarial proceedings, pre-trial proceedings, mediation, etc.

Secondly, in the face of this change linked to the digital environment, 'texts' have appeared to 'regulate' the use or the very invention of this or that algorithmic tool, texts of a very diverse nature, from the most soft to the hardest (this gradation between soft and hard law is the theme taken up in the conference-debate of 19 September 2024). These may be measures taken by the firms that produce the tools, those that use them, or those that disseminate them, with the people affected by the information being relatively active. This last point explains why systemic disputes are already underway, concerning the subjective rights that would be violated either by the very nature of artificial intelligence, in this case the rights of content producers, or the rights to privacy, or protection of other Monumental Goals. The systemic and extra-territorial dimension of these disputes has already been established.

The third point is the role of Politics, since the European Union, through the texts currently being adopted, has established that the Goal is not only the sustainability of the technical system, the innovation market and European sovereignty, but also the primacy of people and individuals, through a method that is the Ex Ante ranking of risks. This conception is also contested. This methodological issue also applies to judges.

This Emerging Systemic Litigation is and will be brought before various regulatory or supervisory Authorities, but also before the administrative and judiciary courts, in particular through Contract Law, Tort Law, Company Law, Labour Law, General Procedural Law, etc.

The aim here is to measure and anticipate the way in which the systemic dimension of these disputes will be incorporated into future litigation.

____

🧮Program of this manifestation

Fourth conference-debate

L’INTELLIGENCE ARTIFICIELLE, NOUVEAU CHAMP DE CONTENTIEUX SYSTÉMIQUE

(ARTIFICIAL INTELLIGENCE, NEW FIELD OF SYSTEMIC LITIGATION)

Paris Court of Appeal, Cassin courtroom

Presentation and moderation by 🕴️Marie-Anne Frison-Roche, Professor of Regulatory & Compliance Law, Director of the Journal of Regulation & Compliance (JoRC)

🕰️11am.-11.10am. 🎤Les deux rencontres entre l'intelligence artificielle et le Contentieux Systémique (The two meetings between Artificial Intelligence and Systemic Litigation), by 🕴️Marie-Anne Frison-Roche, Professor of Regulatory & Compliance Law, Director of the Journal of Regulation & Compliance (JoRC)

    🕰️11.10am-11.30am. 🎤Les premiers contentieux systémiques observables impliquant l’intelligence artificielle (The first observable Systemic Litigations involving artificial intelligence), by 🕴️Sonia Cissé, Partner, Linklaters Paris

    🕰️11.30am-11.50am. 🎤L’influence des nouveaux textes et des textes à venir sur les contentieux systémiques émergents impliquant l’intelligence artificielle (The influence of new and forthcoming legislation on Emerging Systemic Litigation involving artificial intelligence), by 🕴️Emmanuel Netter, Professor of Law at Strasbourg University 

    🕰️11.50am-12.30pm. Debate

    ____

    🔴Registrations and information requests can be sent to: inscriptionscse@gmail.com

    🔴For the attorneys, registrations have to be sent to the following address: https://evenium.events/cycle-de-conferences-contentieux-systemique-emergent/ 

    ⚠️The conference-debates are held in person only, in the Cour d’appel de Paris (Paris Court of Appeal).

    ____

    🧮Read below the report made of this event by Marie-Anne Frison-Roche⤵️

June 13, 2024

Thesaurus : 06.1. Textes de l'Union Européenne

► Full Reference: Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence and amending Regulations (EC) No 300/2008, (EU) No 167/2013, (EU) No 168/2013, (EU) 2018/858, (EU) 2018/1139 and (EU) 2019/2144 and Directives 2014/90/EU, (EU) 2016/797 and (EU) 2020/1828 (Artificial Intelligence Act - "IA Act")

____

► read the text

________

June 3, 2024

Thesaurus : Convention, contract, settlement, engagement

 

 Référence complète : N. Yax, H. Anlio & S. Palminteri, "Studying and improving reasoning in humans and machines",  Communications Psychology volume 2, Article number: 51 (2024)

____

May 30, 2024

Thesaurus : Doctrine

► Référence complète : Th. Douville, "De l'approche extensive de la prise de décision exclusivement automatisée (à propos du refus d'un prêt fondé sur une note de solvabilité communiquée par un tiers)", D. 2024, pp. 1000-1004

____

🦉Cet article est accessible en texte intégral pour les personnes inscrites aux enseignements de la Professeure Marie-Anne Frison-Roche

________

May 27, 2024

Organization of scientific events

 Full ReferenceLes contrôles techniques des risques présents sur les plateformes et les contentieux engendrés (Technical risks controls on platforms and disputes arising from them)in cycle of conference-debates "Contentieux Systémique Émergent" ("Emerging Systemic Litigation"), organised on the initiative of the Cour d'appel de Paris (Paris Cour of Appeal), with the Cour de cassation (French Court of cassation), the Cour d'appel de Versailles (Versailles Court of Appeal), the École nationale de la magistrature - ENM (French National School for the Judiciary) and the École de formation des barreaux du ressort de la Cour d'appel de Paris - EFB (Paris Bar School), under the scientific direction of Marie-Anne Frison-Roche, May 27, 2024, 9h-10h30, Cour d'appel de Paris, Cassin courtroom

____

🧮see the full programme of the cycle Contentieux Systémique Émergent (Emerging Systemic Litigation)

____

🌐see on LinkedIn the report of this event

____

🧱read below the report of this event⤵️

____

► Presentation of the conference: The digital space is full of risks. Some are naturally associated with it, because it is an area of freedom, while others must be countered because they are associated with generally prohibited behaviour, such as money laundering. But the digital space has developed risks which, because of their scale, have been transformed in their very nature: this is particularly true of the distortion permeating certain content and the insecurity that can threaten the entire system itself. Law has therefore entrusted operators themselves with vigilance over what have become ‘cyber-risks’, such as the risk of disinformation, the risk of destruction of communication infrastructures, and the risk of data theft, a systemic prospect that can lead to the collapse of societies themselves.  

New legislations has been drafted, in particular the Digital Services Act (DSA), to increase the burdens and powers of firms in this area, with digital companies in the front line, but also supervisory authorities such as the Autorité de régulation de la communication audiovisuelle et numérique - Arcom (French Regulatory Authority for Audiovisual and Digital Communication). The resulting disputes, in which firms and regulators may be allies or opponents, are systemic in nature.

 

The judge's handling of these "systemic cases", through the procedure and the solutions, must respond to this systemic dimension. The "pornographic websites" case, which is currently unfolding, provides an opportunity to observe in vivo the dialogue between judges when a "systemic case" imposes itself on them.

 

____

🧮Programme of this event

Third conference-debate

LES CONTRÔLES TECHNIQUES DES RISQUES PRÉSENTS SUR LES PLATEFORMES ET LES CONTENTIEUX ENGENDRÉS

(TECHNICAL RISKS CONTROLS ON PLATFORMS AND DISPUTES ARISING FROM THEM)

Paris Court of Appeal, Cassin courtroom

Moderated by 🕴️Marie-Anne Frison-Roche, Professor of Regulatory and Compliance Law, Director of the Journal of Regulation & Compliance (JoRC)

🕰️9h-9h10. 🎤Le contentieux Systémique Emergent du fait du système numériqué (Systemic Litigation Emerging from the Digital System), 🕴️Marie-Anne Frison-Roche

🕰️9h10-9h30. 🎤Les techniques de gestion du risque systémique pesant sur la cybersécurité  des plateformes (The Systemic Obligation of Security on Platforms and associated Litigation)🕴️Michel Séjean, Professor of Law at Sorbonne Paris Nord University

🕰️9h30-9h50. 🎤Un cas systémique in vivo : le cas dit des sites pornographiques (An in vivo Systemic Case: the so-called case of pornographic websites),🕴️Marie-Anne Frison-Roche

🕰️9h50-10h10. 🎤Les obligations systémiques des opérateurs numériques à travers le Règlement sur les Services Numériques (RSN/DSA) et le rôle des régulateurs (Systemic Obligations of Operators (DSA) and the role of Regulators)🕴️Roch-Olivier Maistre, Chair of the Autorité de régulation de la communication audiovisuelle et numérique - Arcom (French Regulatory Authority for Audiovisual and Digital Communication)

🕰️10h10-10h30. Debate

____

🔴Registrations and information requests can be sent to: inscriptionscse@gmail.com

🔴For the attorneys, registrations have to be sent to the following address: https://evenium.events/cycle-de-conferences-contentieux-systemique-emergent/ 

⚠️The conference-debates are held in person only, in the Cour d’appel de Paris (Paris Court of Appeal).

____

🧱read below a detailed presentation of this event⤵️

________

April 15, 2024

Thesaurus : Doctrine

► Référence complète : Commission de l'intelligence artificielle, présidée par Ph. Aghion et A. Bouverot, IA : notre ambition pour la France, Rapport remis au Premier ministre, mars 2024, 130 p.

____

📓lire le rapport

________

Jan. 17, 2024

Thesaurus : Doctrine

 Référence complète : U. Goldberg, "Collecte et traitement des informations dans les enquêtes internes à l'ère numérique : processus et enjeux", in M.-A. Frison-Roche et M. Boissavy (dir.), Compliance et droits de la défense. Enquête interne – CJIP – CRPCJournal of Regulation & Compliance (JoRC) et Dalloz, coll. "Régulations & Compliance" à paraître.

____

📕consulter une présentation générale de l'ouvrage, Compliance et droits de la défense - Enquête interne, CIIP, CRPC, dans lequel cet article est publié

____

► Résumé de l'article (fait par le Journal of Regulation & Compliance - JoRC) : L'objet de l'article est de décrire la technologie de l'enquête interne. C'est pourquoi la question des droits de la défense n'y est pas abordée en tant que telle mais plutôt la méthodologie requise par l'objet recherché, le traitement des informations requis pour l'atteindre et les contraintes engendrées par les outils utilisés. Il s'agit en effet d'obtenir une fiabilité et une efficience la plus grande possible dans la collecte des données et le maniement de celles-ci. 

L'auteur expose les méthodes pour obtenir les données. Cela est rendu difficile par la variété des systèmes juridiques simultanément applicables, par les obligations de confidentialité et le caractère personnel de certaines données, ce qui les rend juridiquement inexploitables. Il convient ensuite d'extraire dans la masse des données celles qui seront pertinentes.

La méthodologie utilisée par le professionnel consiste à indiquer clairement au départ le périmètre de la recherche d'informations et les spécificités de l'enquête, cadre à communiquer aux personnes et organisations impliquées. Plus précisément, il faut préciser l'étendue géographique de la recherche, la période couverte, les personnes impliquées dans l'enquête interne, le type de données recherchées, les systèmes informatiques impliqués, le niveau de confidentialité imposé, les procédures internes liées à la conservation des données et à leur accès. Les informations collectées sont soit structurées, soit non structurées, les deux types s'articulant, et la technologie évoluant sans cesse, tandis que les principes de l'enquête doivent demeurer stables.

____

🦉Cet article est accessible en texte intégral pour les personnes inscrites aux enseignements de la Professeure Marie-Anne Frison-Roche

________

Dec. 12, 2023

Thesaurus : Doctrine

► Référence complète : L. Pailler, "Haro de la Cour de justice sur les services d'aide à la décision !", Dalloz actualité, 12 décembre 2023

____

► Résumé de l'article (fait par l'auteur) : "L'établissement automatisé, par une société fournissant des informations commerciales, d'une valeur de probabilité fondée sur des données à caractère personnel relatives à une personne et concernant la capacité de celle-ci à honorer des engagements de paiement à l'avenir constitue une « décision individuelle automatisée », au sens de l'article 22, § 1er, du règlement général sur la protection des données (RGPD), lorsque dépend de manière déterminante de cette valeur de probabilité le fait qu'une tierce partie, à laquelle ladite valeur de probabilité est communiquée, établisse, exécute ou mette fin à une relation contractuelle avec cette personne.".

____

🦉Cet article est accessible en texte intégral pour les personnes inscrites aux enseignements de la Professeure Marie-Anne Frison-Roche

________

Dec. 7, 2023

Thesaurus : 05. CJCE - CJUE

► Full Reference: ECJ, First chamber, 7 December 2023, case C‑634/21, Schufa Holding AG

____

🏛️read the judgement

____

 

________

Updated: Feb. 2, 2023 (Initial publication: June 23, 2021)

Thesaurus : Doctrine

 Full Reference: L.-M. Augagneur, "La juridictionnalisation de la réputation par les plateformes" ("The jurisdictionalisation of reputation by platforms"), in M.-A. Frison-Roche (ed.), La juridictionnalisation de la Compliance, coll. "Régulations & Compliance", Journal of Regulation & Compliance (JoRC) and Dalloz, 2023, p. 97-113. 

____

📕read a general presentation of the book, La juridictionnalisation de la Compliancein which this article is published.

____

 Summary of the article (done by the author): The large platforms are in the position of arbiter of the reputation economy (referencing, notoriety) in which they themselves act. Although the stakes are usually low on a unit basis, the jurisdiction of reputation represents significant aggregate stakes. Platforms are thus led to detect and assess reputation manipulations (by users: SEO, fake reviews, fake followers; or by the platforms themselves as highlighted by the Google Shopping decision issued by the European Commission in 2017) that are implemented on a large scale with algorithmic tools.

The identification and treatment of manipulations is itself only possible by means of artificial intelligence tools. Google thus proceeds with an automated downgrading mechanism for sites that do not follow its guidelines, with the possibility of requesting a review through a very summary procedure entirely conducted by an algorithm. Tripadvisor, on the other hand, uses an algorithm to detect false reviews based on "fraud modeling to identify electronic patterns that cannot be detected by the human eye". It only conducts a human investigation in limited cases.

This jurisdictionality of reputation has little in common with that defined by the jurisprudence of the Court of Justice (legal origin, contradictory procedure, independence, application of the Rules of Law). It is characterized, on the one hand, by the absence of transparency of the rules and even of the existence of rules stated in predicative form and applied by deductive reasoning. It is replaced by an inductive probabilistic model by the identification of abnormal behaviors in relation to centroids. This approach of course raises the issue of statistical bias. More fundamentally, it reflects a transition from Rule of Law, not so much to "Code is Law" (Laurence Lessig), but to "Data is Law", that is, to a governance of numbers (rather than "by" numbers). It also comes back to a form of collective jurisdictionality, since the sanction comes from a computational apprehension of the phenomena of the multitude and not from an individual appreciation. Finally, it appears particularly consubstantial with compliance, since it is based on a teleological approach (the search for a finality rather than the application of principles).

On the other hand, this jurisdictionality is characterized by man-machine cooperation, whether in the decision-making process (which poses the problem of automaticity bias) or in the contradictory procedure (which poses, in particular, the problems of discussion with the machine and the explicability of the machine response).

Until now, the supervision of these processes has been based essentially on the mechanisms of transparency, a limited adversarial requirement and the accessibility of appeal channels. The French Law Loi pour une République Numérique ("Law for a Digital Republic"), the European Legislation Platform-to-Business Regulation and the Omnibus Directive, have thus set requirements on the ranking criteria on platforms. The Omnibus Directive also requires that professionals guarantee that reviews come from consumers through reasonable and proportionate measures. As for the European Digital Services Act, it provides for transparency on content moderation rules, procedures and algorithms. But this transparency is often a sham. In the same way and for the moment the requirements of sufficient human intervention and adversarial processes appear very limited in the draft text.

The most efficient forms of this jurisdictionality ultimately emerge from the role played by third parties in a form of participatory dispute resolution. Thus, for example, FakeSpot detects false Tripadvisor reviews, Sistrix establishes a ranking index that helped establish the manipulation of Google's algorithm in the Google Shopping case by detecting artifacts based on algorithm changes. Moreover, the draft Digital Services Act envisages recognizing a specific status for trusted flaggers who identify illegal content on platforms.

This singular jurisdictional configuration (judge and party platform, massive situations, algorithmic systems for handling manipulations) thus leads us to reconsider the grammar of the jurisdictional process and its characteristics. If Law is a language (Alain Sériaux), it offers a new grammatical form that would be that of the middle way (mesotès) described by Benevéniste. Between the active and the passive way, there is a way in which the subject carries out an action in which he includes himself. Now, it is the very nature of this jurisdictionality of compliance to make laws by including oneself in them (nomos tithestai). In this respect, the irruption of artificial intelligence in this jurisdictional treatment undoubtedly bears witness to the renewal of the language of Law.

________

July 1, 2022

Conferences

♾️follow Marie-Anne Frison-Roche on LinkedIn

♾️subscribe to the  Newsletter MAFR Regulation, Compliance, Law

____

 Full ReferenceM.-A. Frison-Roche, "Compliance, Artificial Intelligence and Business Management: the right measure" ("Compliance, Intelligence artificielle et gestion des entreprises : la juste mesure"), participation to the Conference coordinated by Mustapha Mekki, L'intelligence artificielle et la gestion des entreprises. July 1st, 2022. 

____

🎥 see the conference (in French)

____

 consult the slides having been used as brief notes for deliver the lecture (inf French)

____

🚧read the bilingual Working Paper having been used as basis for this conference

____

📝This work will be the basis for an article.

____

 Summary of the Lecture: Of the next European Regulation on artificial intelligence, the European Commission has a quite neutral conception of AI for obtaining a consensus between the Member States, while the Regulators and certain States have a more substantial conception of technology, wanting its power to be used to protect people, firstly from these new tools themselves, secondly from what is an amplification of the evils of the classic world, such as hate or misinformation. This is the reflection of two conceptions of Compliance.

Firstly, Compliance can be defined as neutral processes that increase the effectiveness of what would be the obligation for companies or their desire for efficient risk management (in particular the consideration of "legal risks") to prove being "conform" to all regulations that are applicable to itself and all persons to whom the firm is accountable. This is often referred to as the "compliance obligation" or "obligation of conformity".

This conception implies considerable practical consequences for the company which, in order to succeed in this "total exploit", would then have to resort to artificial intelligence tools constituting a "total and infallible solution", which mechanically generate for it the obligation to "know " all the "regulatory mass", to detect all "non-compliances", to conceive its relationship to the Law in terms of "risk of non-compliance", fully supported by Compliance by Design which could, without human intervention , eliminate legal risk and ensure "compliance total efficiency" in Ex Ante.

The "legal price" of this technological dream is extremely high because all the "regulatory" requirements will then be transformed into obligations of result, any failure generating liability. The Compliance probationary system will become overwhelming for the company, both in terms of burden of proof, means of proof, and transfers, without exemption from proof. Objective responsibilities for others will multiply. The "law of conformity" will multiply Ex Ante systemic penalties, the border with criminal law being less and less preserved.

It is essential to avoid this, both for businesses and for the Rule of Law. For this, we must use Artificial Intelligence to its proper extent: it may constitute a "massive aid", without ever claiming to be a total and infallible solution, because it is the human who must be at the center of the compliance system functioning thank to the firms and not the machinery.

For this, it is necessary to adopt a substantial conception of Compliance Law (and not a sort of Conformity Law or Obedience Law). It does not at all cover all the applicable regulations and it is not at all "neutral", being in no way a series of processes. This new branch of Law is substantially built on Monumental Goals. These are either of a negative nature (preventing a systemic crisis from happening, in many but specific perspectives: banking, financial, health, climate, etc.), or of a positive nature (building a better balance, in particular between human beings, in the company and beyond).

In this conception which appears more and more strongly, artificial intelligence finds its place, more modest. As Compliance Law is based on information, Artificial Intelligence is essential to capture it and make first connections, first stages for successive analyses, done by human beings, making what is essential: the commitment of the company, both by the leaders and by all those who are "embarked" by a "culture of Compliance" which is at both built and common.

This restores the required seal between Criminal Law and what can be asked of the mechanical use of Artificial Intelligence; this puts the obligation of means back as a principle. This restores the principal place to the lawyer and the compliance officer, so that the culture of compliance is articulated with the specificities of a sector and the identity of the company itself. Indeed, the culture of compliance being inseparable from a culture of values, Compliance by design requires a dual technique, both mathematical and legal culture. It is why European Compliance Law, because it is rooted in the European humanist tradition, is a model.

________

For further:

📘Frison-Roche, M.-A. (ed.), Compliance Monumental Goals, 2022

📘Frison-Roche, M.-A. (ed.), Compliance Jurisdictionalisation2022

📘Frison-Roche, M.-A. (ed.), Compliance Tools, 2021

📓Frison-Roche, M.-A., L'apport du Droit de la Compliance à la Gouvernance d'Internet, 2019 

📕Frison-Roche, M.-A. (ed.), Pour une Europe de la Compliance2019

📕Frison-Roche, M.-A. (ed.), Régulation, Supervision, Compliance2017

📕 Frison-Roche, M.-A. (ed.), Internet, espace d'interrégulation, 2016

📝 Frison-Roche, M.-A., Compliance Monumental Goals, beating heart of Compliance law,  2022,

📝 Frison-Roche, M.-A., Role and Place of Companies in the Creation and Effectiveness of Compliance Law in Crisis, 2022

📝 Frison-Roche, M.-A., Assessment of Whistleblowing, and the duty of Vigilance, 2022

📝Frison-Roche, M.-A., Drawing up Risk Maps as an obligation and the paradox of he "compliance risks", 2021

__________

June 21, 2022

Publications

♾️ follow Marie-Anne Frison-Roche on LinkedIn

♾️subscribe to the Newsletter MAFR Regulation, Compliance, Law 

____

 Full Reference: Frison-Roche, M.-ACompliance, Artificial Intelligence and Business Management: the right measure, Working Paper, June 2022. 

____

 Summary of the Working Paper: Of the next European Regulation on artificial intelligence, the European Commission has a quite neutral conception of AI for obtaining a consensus between the Member States, while the Regulators and certain States have a more substantial conception of technology, wanting its power to be used to protect people, firstly from these new tools themselves, secondly from what is an amplification of the evils of the classic world, such as hate or misinformation. This is the reflection of two conceptions of Compliance.

Firstly, Compliance can be defined as neutral processes that increase the effectiveness of what would be the obligation for companies or their desire for efficient risk management (in particular the consideration of "legal risks") to prove being "conform" to all regulations that are applicable to itself and all persons to whom the firm is accountable. This is often referred to as the "compliance obligation" or "obligation of conformity".

This conception implies considerable practical consequences for the company which, in order to succeed in this "total exploit", would then have to resort to artificial intelligence tools constituting a "total and infallible solution", which mechanically generate for it the obligation to "know " all the "regulatory mass", to detect all "non-compliances", to conceive its relationship to the Law in terms of "risk of non-compliance", fully supported by Compliance by Design which could, without human intervention , eliminate legal risk and ensure "compliance total efficiency" in Ex Ante.

The "legal price" of this technological dream is extremely high because all the "regulatory" requirements will then be transformed into obligations of result, any failure generating liability. The Compliance probationary system will become overwhelming for the company, both in terms of burden of proof, means of proof, and transfers, without exemption from proof. Objective responsibilities for others will multiply. The "law of conformity" will multiply Ex Ante systemic penalties, the border with criminal law being less and less preserved.

It is essential to avoid this, both for businesses and for the Rule of Law. For this, we must use Artificial Intelligence to its proper extent: it may constitute a "massive aid", without ever claiming to be a total and infallible solution, because it is the human who must be at the center of the compliance system functioning thank to the firms and not the machinery.

For this, it is necessary to adopt a substantial conception of Compliance Law (and not a sort of Conformity Law or Obedience Law). It does not at all cover all the applicable regulations and it is not at all "neutral", being in no way a series of processes. This new branch of Law is substantially built on Monumental Goals. These are either of a negative nature (preventing a systemic crisis from happening, in many but specific perspectives: banking, financial, health, climate, etc.), or of a positive nature (building a better balance, in particular between human beings, in the company and beyond).

In this conception which appears increasingly strongly, artificial intelligence finds its place, more modest. As Compliance Law is based on information, Artificial Intelligence is essential to capture it and make first connections, first stages for successive analyses, done by human beings, making what is essential: the commitment of the company, both by the leaders and by all those who are "embarked" by a "culture of Compliance" which is at both built and common.

This restores the required seal between Criminal Law and what can be asked of the mechanical use of Artificial Intelligence; this puts the obligation of means back as a principle. This restores the principal place to the lawyer and the compliance officer, so that the culture of compliance is articulated with the specificities of a sector and the identity of the company itself. Indeed, the culture of compliance being inseparable from a culture of values, Compliance by design requires a dual technique, both mathematical and legal culture. It is why European Compliance Law, because it is rooted in the European humanist tradition, is a model.

________

June 21, 2022

Thesaurus : Soft Law

Référence complète : Equinet : Pour une IA européenne protectrice et garante du principe de non-discrimination, Avis établissant des recommandations et des principes essentiels pour la future législation européenne portant sur l'intelligence artificielle, 21 juin 2022.

____

 

Lire l'avis. 

 

March 2, 2022

Thesaurus : Doctrine

Référence complète : Laroche, B. et Boullu-Chataigner, J., Brave New Planes ou la conformité juridique de grands groupes aéronautiques face aux défis de l'intelligence artificielle, D. IP/IT, 2022, p.83.

____  

Aug. 30, 2021

Compliance: at the moment

An article from March 3, 2021, Smile for the camera: the dark side of China's emotion-recognition tech, then an article from June 16, 2021, "Every smile you fake" - an AI emotion - recognition system can assess how "happy" China's workers are in the office describes how a new technology of emotional recognition is able, through what will soon be out of fashion to call "facial recognition", to distinguish a smile that reflects a mind state of real satisfaction from a smile which does not correspond to it. This allows the employer to measure the suitability of the human being for his or her work. It is promised that it will be used in an ethical way, to improve well-being at work. But isn't it in itself that this technology is incompatible with any compensation through ethical support?

The technology developed by a Chinese technology company and acquired by other Chinese companies with many employees, allows to have information on the actual state of mind of the person through and beyond his or her facial expressions and bodily behavior.

Previously, the technology of emotional recognition had been developed to ensure security, by fighting against people with hostile plans, public authorities using it for example in the controls at airports to detect the criminal plans which some passengers could have.

It is now affirmed that it is not about fighting against some evil people ("dangerousness") to protect the group before the act is committed ("social defense”) but that it is about helping all workers.

Indeed, the use that will be made of it will be ethical, because first the people who work for these Chinese companies with global activity, like Huawaï, do it freely and have accepted the operation of these artificial intelligence tools (which is not the case with people who travel, control being then a kind of necessary evil that they do not have to accept, which is imposed on them for the protection of the group), but even and above all, the purpose is itself ethical: if it turns out that the person does not feel well at work, that they are not happy there, even before they are perhaps aware, the company can assist.

Let’s take this practical case from the perspective of Law and let’s imagine that it is contested before a judge applying the principles of Western Law.

Would this be acceptable?

No, and for three reasons.

1. An "ethical use" cannot justify an unethical process in itself

2. The first freedoms are negative

3. "Consent" should not be the only principle governing the technological and digital space

 

I. AN "ETHICAL USE" CAN NEVER LEGITIMATE AN UNETHICAL PROCESS IN ITSELF

These unethical processes in themselves cannot be made "acceptable" by an "ethical use" which will be made of them.

This principle was especially reminded by Sylviane Agacinski in bioethics: if one cannot dispose of another through a disposition of his or her body which makes his or her very person available (see not. Agacinski, S., ➡️📗Le tiers-corps. Réflexions sur le don d’organes, 2018).

Except to make the person reduced to the thing that his or her body is, which is not ethically admissible in itself, that is excluded, and Law is there in order to this is not possible.

This is even why the legal notion of "person", which is not a notion that goes without saying, which is a notion built by Western thought, acts as a bulwark so that human beings cannot be fully available to others, for example by placing their bodies on the market (see Frison-Roche, M.-A., ➡️📝To protect human beings, the ethical imperative of the legal notion of person, 2018). This is why, for example, as Sylviane Agacinski emphasizes, there is no ethical slavery (a slave who cannot be beaten, who must be well fed, etc.).

That the human being agrees ("and what about if it pleases me to be beaten?") does not change anything.

 

II. THE FIRST FREEDOM IS THE ONE TO SAY NO, FOR EXAMPLE BY REFUSING TO REVEAL YOUR EMOTIONS: FOR EXAMPLE HIDING IF YOU ARE HAPPY OR NOT TO WORK

The first freedom is not positive (being free to say Yes); it is negative (being free to say No). For example, the freedom of marriage is having the freedom not to marry before having the freedom to marry: if one does not have the freedom not to marry, then the freedom to marry loses any value. Likewise, the freedom to contract implies the freedom not to contract, etc.

Thus, freedom in the company can take the form of freedom of speech, which allows people, according to procedures established by Law, to express their emotions, for example their anger or their disapproval, through the strike.

But this freedom of speech, which is a positive freedom, has no value unless the worker has the fundamental freedom not to express his or her emotions. For example if he or she is not happy with his or her job, because he or she does not appreciate what he or she does, or he or she does not like the place where he or she works, or he or she does not like people with whom he or she works, his or her freedom of speech demands that he or she have the right not to express it.

If the employer has a tool that allows him or her to obtain information about what the worker likes and dislikes, then the employee loses this first freedom.

In the Western legal order, we must be able to consider that it is at the constitutional level that the infringement is carried out through Law of Persons (on the intimacy between the Law of Persons and the Constitutional Law, see Marais , A., ➡️📕Le Droit des personnes, 2021).

 

III. CONSENT SHOULD NOT BE THE ONLY PRINCIPLE GOVERNING THE TECHNOLOGICAL AND DIGITAL SPACE

 

We could consider that the case of the company is different from the case of the controls operated by the State for the monitoring of airports, because in the first case observed people are consenting.

"Consent" is today the central notion, often presented as the future of what everyone wants: the "regulation" of technology, especially when it takes the form of algorithms ("artificial intelligence"), especially in digital space.

"Consent" would allow "ethical use" and could establish the whole (on these issues, see Frison-Roche, M.-A., ➡️📝Having a good behavior in the digital space, 2019).

"Consent" is a notion from which Law is today moving away in Law of Persons, in particular as regards the "consent" given by adolescents on the availability of their body, but not yet on digital.

No doubt because in Contract Law, "consent" is almost synonymous with "free will", whereas they must be distinguished (see Frison-Roche, M.-A., ➡️📝Remarques sur la distinction entre la volonté et le consentement en Droit des contrats, 1995).

But we see through this case, which precisely takes place in China, that "consent" is in Law as elsewhere a sign of submission. It is only in a probative way that it can constitute proof of a free will; this proof must not turn into an irrebuttable presumption.

The Data Regulatory Authorities (for example in France the CNIL) seek to reconstitute this probative link between "consent" and "freedom to say No" so that technology does not allow by "mechanical consents", cut off from any connection with the principle of freedom which protects human beings, from dispossessing themselves (see Frison-Roche, M.-A., Yes to the principle of will, No to pure consents, 2018).

The more the notion of consent will be peripheral, the more human beings will be able to be active and protected.

________

April 21, 2021

Thesaurus : Doctrine

► Full Reference: S. Merabet, "La morale by design" ("Morality by design"), in M.-A. Frison-Roche (ed.), Les outils de la Compliance, coll. "Régulations & Compliance", Journal of Regulation & Compliance (JoRC) and Dalloz, 2021, p. 287-298.

____

📕read a general presentation of the book, Les outils de la Compliance, in which this article is published

____

► Summary of the article (done by the Journal of Regulation & Compliance): After having wondered about the relationship between Law and Morality, for which it is difficult to find points of contact, the author advances the hypothesis that the latter could find a space of concretization in the technology of artificial intelligence, even though many are worried about the deleterious effects of it. The author considering that Compliance is only a method while ethics would be the way in which morality is incorporated in a relaxed way in Law, the technology known as Artificial Intelligence could therefore express the moral rule ("compliance by design could be the appropriate tool to ensure the effectiveness of moral rules without falling into the excesses envisaged").

The author draws on examples to estimate that thus technology for on the one hand expressing the moral rule and on the other hand making it effective. The moral rule can thus be drawn up in a balanced way since it is jointly developed between the State and the economic operators, this collaboration taking the form of general principles adopted by the State using the means chosen by the company. Its content would also be characterized by the search for a "right balance", which would be found by this distribution between the primary moral principles whose expression would be the act of the State and the secondary moral principles whose expression would be delegated to companies.

Taking therefore what would be the principles of Compliance, the author applies them to Artificial Intelligence, showing that these technologies include not only the principle of neutrality but also the ethical principles of non-maliciousness, even of benevolence. (first principles) that companies then decline into secondary principles. Therefore, "compliance can usefully be used to convert these fundamental moral principles into derived moral rules, a source of greater effectiveness.".

Thus resulting in a "moral by design", the overall system has an additional effectiveness tool. This supposes that the fundamental and derived rules are of an acquired moral quality because for the moment the technological tool can only ensure their effectiveness and not the moral quality of the implemented rules. In determining the "moral rules of application", the company has margins of freedom, used through technological tools.

________

Dec. 8, 2020

Thesaurus : Doctrine

► Référence complète : M. Teller, "L'intelligence artificielle", in J.-B. Racine (dir.), Le droit économique au XXIe siècle. Notions et enjeux, LGDJ, coll. "Droit & Économie", 2020, pp. 461-478

____

📕consulter une présentation générale de l'ouvrage, Le droit économique au XXIe siècle. Notions et enjeux, dans lequel cet article est publié 

____

► Résumé de l'article : 

____

🦉Cet article est accessible en texte intégral pour les personnes inscrites aux enseignements de la Professeure Marie-Anne Frison-Roche

________