{"id":57640,"date":"2026-07-06T10:50:58","date_gmt":"2026-07-06T10:50:58","guid":{"rendered":"https:\/\/my.legal500.com\/developments\/?post_type=legal_developments&p=57640"},"modified":"2026-07-06T10:50:58","modified_gmt":"2026-07-06T10:50:58","slug":"ai-deepfakes-and-the-discrediting-of-evidence-that-was-previously-indisputable","status":"publish","type":"legal_developments","link":"https:\/\/my.legal500.com\/developments\/thought-leadership\/ai-deepfakes-and-the-discrediting-of-evidence-that-was-previously-indisputable\/","title":{"rendered":"AI, deepfakes, and the discrediting of evidence that was previously indisputable"},"content":{"rendered":"

Authored by Noemi C\u0103dariu, Managing Associate<\/p>\n

Sure, ChatGPT writes our emails, drafts our LinkedIn posts, translates documents, and generates content that substantially reduces the time spent on a single task. The widespread adoption and normalization of artificial intelligence in our daily lives\u2014both at work and at home\u2014creates even more room for error, as we place blind trust in content generated without citing sources, in a format that\u2019s easy to take \u201cas is,\u201d instantly translated into any language, created by software capable of sensing or reading its audience (in the term \u201csentient<\/em>,\u201d which is difficult to translate).<\/strong><\/p>\n

Furthermore, we wish to highlight the ease with which the end user of a piece of material, document, result, or response can be misled<\/em>\u2014how do we distinguish between an AI-generated response and one provided by a competent person who knows their field? How do we distinguish between an author\u2019s manuscript and a text generated by AI that has learned their writing style? How do we distinguish a lawyer\u2019s legal opinion from one written by AI with access to legislation? After all, both come with a disclaimer.<\/p>\n

How do we manage, at the end of the day, to actually recognize the human factor?<\/p>\n

We are aware of the obvious downside to the daily benefits that artificial intelligence brings in automating and streamlining tasks: the laziness <\/em>of the human mind, both from an active perspective\u2014by shifting active components of a project onto the AI \u2014as well as from a passive perspective\u2014by easily and quickly obtaining information perceived as truth but never verified.<\/p>\n

But what are we doing about the neglected phenomenon of deepfakes<\/em>? We smile when artificial intelligence generates content favorable to us, losing sight of the fact that there are always two sides to every coin, and that AI content\u2014being in constant development\u2014can at any time generate content that is completely unfavorable to humans (individually or as a group).<\/p>\n

    \n
  1. What, exactly, is the deepfake phenomenon?<\/strong><\/li>\n<\/ol>\n

    A deepfake is an advanced form of digital manipulation of media content, involving the use of machine learning (i.e., <\/em>artificial intelligence) and image generation technologies to create fake audio, photo, or video material that appears authentic and credible. The term \u201cdeepfake\u201d combines the concepts of \u201cdeep <\/em>learning\u201d and \u201cfake<\/em>,\u201d reflecting the very complexity of its sophisticated nature.<\/p>\n

    The process of creating deepfake<\/em> visual content involves a deep learning algorithm (deep AI) trained on a significant amount of data (photos, video, or audio recordings) related to the target person of the desired content. The algorithm is trained to learn the target person\u2019s facial and vocal characteristics in order to recreate and manipulate any kind of media content\u2014ultimately with the goal of making that person appear to be in a certain place, saying certain words, or performing certain activities that, of course, did not actually happen and do not reflect reality.<\/p>\n

    There are various techniques used in the process of creating deepfakes, among which we note the generation of images using generative adversarial networks\u2014that is, a pair of neural networks with diametrically opposed objectives, one tasked with generating fake content and the other with detecting fakes. This system thus creates an iterative process through which the quality of the fakes improves via simultaneous positive and negative reinforcement.<\/p>\n

    Although it may seem like a form of creative entertainment when its purpose is harmless, the deepfake<\/em> phenomenon is overshadowed by a dark cloud of malicious intent, ranging from political manipulation and propaganda to pornographic content (with an alarming percentage of child pornography). According to an analysis by Deeptrace Labs, over 96% of the deepfake content identified online in 2019 was non-consensual pornographic content\u2014where the victims include both public figures and ordinary people, both adults and minors, predominantly women, thereby exacerbating the phenomenon of revenge porn<\/em>.<\/p>\n

    In the political sphere, the dissemination of visual and audio deepfake<\/em> content is capable of creating hysteria, inciting violence, and spreading propaganda more easily than through any other communication channel, particularly on social media platforms\u2014especially given that the tendency to verify the sources of content consumed on these platforms is steadily declining.<\/p>\n

    For example, deepfake<\/em> images and videos were widely circulated during two highly publicized armed conflicts of our time, namely the Russia-Ukraine and Israel-Hamas conflicts, generating false political statements attributed to the leaders of these countries (including (i) <\/strong>Volodymyr Zelensky\u2019s deepfake<\/em> speech in which he ordered Ukrainians to surrender to the Russian army[1]<\/a> , (ii) <\/strong>deepfake<\/em> content about victims of the Israel-Hamas conflict[2]<\/a> , (iii) <\/strong>Iranian hackers disrupting broadcasts in the UAE with deepfake<\/em> news[3]<\/strong><\/em><\/a> , and (iv) <\/strong>the deepfake<\/em> interview with President Vladimir Putin[4]<\/a> ).<\/p>\n

    Although efforts are currently underway to improve countermeasures against the negative effects of deepfake<\/em> content\u2014through the development of technologies to detect this type of content and by attempting to educate the general public in the critical evaluation of falsified media content\u2014such a result is unrealistic at this time.<\/p>\n

    Given the way information is consumed\u2014particularly the speed at which we actually consume the content we scroll through every day\u2014 on social media platforms designed to deliver dopamine through short, concentrated, and fast-paced content\u2014discerning and filtering the information we consume becomes a utopian concept, especially for Gen Z and subsequent generations, who have not been instilled with the principle of \u201ccheck first, then believe.\u201d<\/p>\n

    Furthermore, with the delayed identification of deepfake<\/em> content, this type of content has enough time to linger online, spreading false and misleading information, inciting violence, hatred, and racial segregation, as well as destroying the reputations of women who are victims of the wave of deepfake porn<\/em>. By the time such an image or recording is identified as machine-generated<\/em>, the damage has already been done, reputations have been tarnished, and the public has been influenced.<\/p>\n

      \n
    1. The European Approach to the Deepfake Phenomenon and National Regulation<\/strong><\/li>\n
    2. The European stance<\/strong><\/li>\n<\/ol>\n

      At the end of 2022, the European Commission proposed a new directive to combat violence and domestic violence against women in various forms. Currently, the European Council and the European Parliament support the proposal to criminalize, among other things, the non-consensual distribution of AI-generated pornographic content, with the aim of curbing the phenomenon of revenge porn<\/em>.<\/p>\n

      The EU\u2019s response comes in the wake of the most recent deepfake porn <\/em>scandal, in which Taylor Swift herself was the victim earlier this year, with the video garnering over 45 million views online. Since early February, the European Union has proposed criminalizing the distribution of such content within the EU (including revenge porn <\/em>and online harassment<\/em>)\u2014a measure expected to take effect in mid-2027.<\/p>\n

      European Commission Vice President V\u011bra Jourov\u00e1 told Politico[5]<\/a> that \u201cthe latest repugnant way to humiliate women involves distributing intimate images generated by artificial intelligence in less than a few minutes. Such images can cause serious harm, not just to pop stars, but to any woman who will then be forced to prove at work or at home that those images are the result of deepfakes<\/em>.\u201d<\/p>\n

      At the EU level, the European Parliament approved on Wednesday, March 13, 2024, the regulation on artificial intelligence, the EU AI Act<\/strong>, considered to be the world\u2019s first official regulation of artificial intelligence<\/u>. The European Parliament\u2019s priority is to ensure that AI systems used in the EU are safe, transparent, traceable, non-discriminatory, and environmentally friendly. In particular, the aim is for these systems to be supervised by humans\u2014rather than through automated processes themselves\u2014to prevent harmful outcomes resulting from their use. Within the scope of these regulations and future sanctions, the phenomenon of deepfakes<\/em> is also addressed as a component of generative artificial intelligence systems.<\/p>\n

      We emphasize that the adoption of such a regulation represents a global first, positioning the EU as a leader in establishing a legal framework for artificial intelligence systems, a regulation that will certainly serve as a source of inspiration for non-member countries, particularly the U.S.\u2014where the phenomenon is far more widespread than within the EU.<\/p>\n

      Final approval will be granted by the Council of the European Union\u2014expected by the end of 2024\u2014and the regulation will enter into force 20 days after its publication in the Official Journal, while the prohibitions and restrictions will take effect 6 months from that date. The application of certain restrictions and bans may be deferred for up to 12 months after the directive enters into force; however, all other obligations set forth in this directive will be enforced, without exception, no later than 36 months after its entry into force, i.e., by the end of 2027 (under current conditions).<\/p>\n

      The Act regulates different risk categories regarding various artificial intelligence systems, ranging from unacceptable risk<\/strong>\u2014considered a threat to people and therefore prohibited (i.e.<\/em>, the biometric identification and classification of individuals)\u2014to high risk<\/strong>\u2014which has a negative impact on people\u2019s safety and fundamental rights and must be assessed before being placed on the market (i.e., <\/em>software for managing migration, asylum, and border control; software that assists in the interpretation and application of the law), and limited risk<\/strong>\u2014a category that includes general and generative artificial intelligence (i.e., <\/em>ChatGPT; systems that generate and manipulate images, audio, and video content, such as deepfakes<\/em>)[6]<\/a> .<\/p>\n

      However, it is important to note that these rules and classifications were created and drafted three years ago, at a time when applications such as ChatGPT and OpenAI did not have the popularity and prevalence they have today\u2014nor did they possess such learning capabilities and such an extensive database. Given their prevalence, ease of access, and the potential factual and legal implications of this type of output, the classification of generative content systems as \u201clow-risk\u201d may be \u201cupgraded\u201d to a higher risk level over time.<\/p>\n

        \n
      1. National Legislative Framework<\/strong><\/li>\n<\/ol>\n

        At the national level, however, as early as April 2023, Bill No. 471\/2023 on the responsible use of technology in the context of the deepfake phenomenon was introduced; it is still under review\u2014sent for further report to two committees, with a deadline of March 1, 2024, a deadline that has already passed.<\/p>\n

        In the explanatory memorandum, the Romanian legislature takes into account the rapid development of technology, artificial intelligence, and techniques for creating artificial virtual reality, as well as the impressive advances in machine learning<\/em> tools, deeming it necessary to intervene to limit the malicious effects of the false content generated by these tools. The legislature also points out that experts in the field consider deepfakes to be far more dangerous and to have a much greater impact than the fake news disseminated in the media to which we are already accustomed, since deepfakes can generate both visual and audio content intrinsically linked to the victim being impersonated.<\/p>\n

        We therefore welcome the initiative of Representative Eugen Bejinariu and Senator Robert-Marius Cazanciuc, as the sponsors of this bill, and concur with the view expressed regarding the deepfake<\/em> phenomenon\u2014namely, that the creation and distribution of such materials (referred to as \u201csevere fakes<\/strong>\u201d) constitute\u2014each, in its own material form\u2014a deliberate act, carried out with discernment and direct intent, aimed at harming the victim\u2019s image, reputation, or dignity through the dissemination of misleading and falsified materials that create the appearance of originating directly from the victim or place the victim in scenarios that do not reflect factual, objective reality.<\/p>\n

        We include, by way of example, the use of deepfake <\/em>technology to portray the President of Romania in a derogatory video, the accuracy of which comes close to mimicking a real video and speech[7]<\/a> . We can easily dismiss such content when we assume it is fake and when its very title makes it clear that it was generated by AI software; however, without these assumptions and given the continuous development and refinement of such software, how much longer will we truly be able to distinguish it?<\/p>\n

        In the form adopted by the Senate, the law provides four articles, including the definition of its scope of application, the definition of the deepfake<\/em> phenomenon, the conditions under which AI-generated material must disclose its nature, and who is responsible for verifying compliance with these legal requirements.<\/p>\n

        The law defines the \u201cdeepfake\u201d<\/em> phenomenon as \u201cany falsified image, audio, and\/or video content created, as a rule, using artificial intelligence, virtual reality, augmented reality, or other means, such that it creates the appearance that a person has said or done things to which they have not given their consent, and which in reality were not said or done by that person<\/em>.\u201d<\/p>\n

        The distribution and broadcast of such deepfake<\/em> materials in the media are prohibited unless they are accompanied by a warning displayed on at least 10% of the screen area and throughout the entire duration of the broadcast of the visual content<\/u>, or by an audio message at the beginning and end of the audio content: \u201cThis material contains fictional scenes<\/em><\/u>.\u201d<\/p>\n

         <\/p>\n