Redrawing the Lines Against DisinformationHow AI Is Shaping the Present and Future of Fact-checking

  1. Beatriz Gutiérrez-Caneda 1
  2. Jorge Vázquez-Herrero 1
  1. 1 Universidade de Santiago de Compostela
    info

    Universidade de Santiago de Compostela

    Santiago de Compostela, España

    ROR https://ror.org/030eybx10

Zeitschrift:
Trípodos

ISSN: 1138-3305,  2340-5007

Datum der Publikation: 2024

Titel der Ausgabe: Artificial Intelligence and Communication. Opportunities and challenges

Nummer: 55

Seiten: 55-74

Art: Artikel

DOI: 10.51698/TRIPODOS.2024.55.04 DIALNET GOOGLE SCHOLAR lock_openOpen Access editor

Andere Publikationen in: Trípodos

Zusammenfassung

Artificial intelligence is changing the way our world works, and the journalism and communication field is no exception. The development of high technologies such as NLP or machine learning has modified professional routines, work profiles, and business models. Fact-checking initiatives, which have long battled disinformation, now face a complex context where misleading content grows faster than ever. In this situation, artificial intelligence, or AI, can be a double-edged sword. On the one side, AI-generated content can be created faster than regular content; therefore, there is a huge volume of data to be analysed by fact-checkers. Furthermore, NLP software is not always as reliable as it might be expected. It tends to ‘hallucinate’, creating more misleading content and hoaxes. On the other hand, AI can be a helpful tool in fighting disinformation. This paper analyses 10 independent international fact-checking initiatives through case analysis and questionnaires with fact-checkers. Results show that these sites use AI during different stages of their routines, accelerating processes, simplifying tasks and improving the accuracy of fact-checking results. AI integration shows some risks related to economic restrictions, platform limitations, media distrust, and inequity between countries. To conclude, this research also demonstrates that journalists are still in the loop about fact-checking sites, but more tech profiles and better skills are required.

Bibliographische Referenzen

  • Adair, Bill; Stencel, Mark; Clabby, Cathy, and Li, Chengkai (2019). The human touch in automated fact-checking: How people can help algorithms expand the production of accountability journalism. Presented at Computation + Journalism Symposium. Miami, 1-2 February.
  • Ali, Waleed and Hassoun, Mohamed (2019). Artificial intelligence and automated jour-nalism: Contemporary challenges and new opportunities. International Journal of Media, Journalism and Mass Communica-tions, 5(1), 40-49.
  • Allcott, Hunt; Gentzkow, Matthew, and Yu, Chuan (2019). Trends in the diffusion of misinformation on social media. Research & Politics, 6(2). https://doi.org/10.1177/2053168019848554
  • Amazeen, Michelle A. (2015). Revisiting the epistemology of fact-checking. Critical Review: A Journal of Politics and Society, 27(1), 1-22. https://doi.org/10.1080/08913811.2014.993890
  • Amazeen, Michelle A. (2020). Journalistic in-terventions: The structural factors affecting the global emergence of fact-checking. Journalism, 21(1), 95-111. https://doi.org/10.1177/1464884917730217
  • Anderson, Christopher W. (2012). Towards a sociology of computational and algorithmic journalism. New Media & Society, 15(7), 1005-1021. https://doi.org/10.1177/1461444812465137
  • Barbera, David L.; Roitero, Kevin, and Mizzaron, Stefano (2022). A hybrid human-in-the-loop framework for fact-checking. Presented at NL4AI 2022: Sixth Workshop on Natural Language for Artificial Intelli-gence. Udine, 30 November.
  • Beckett, Charlie and Yaseen, Mira (2023). Gen-erating change. A global survey of what news organisations are doing with AI. London School of Economics and Political Science, Google News Initiative. https://www.journalismai.info/research/2023-generating-change
  • Bhattacharya, Sumana (2021). Robot journalism: A new way of reporting breaking news. Analytics insight. https://www.analyticsinsight.net/robot-journalism-a-new-way-of-reporting-breaking-news/. Accessed 4 September 2023.
  • Blanco-Alfonso, Ignacio; Chaparro-Domínguez, María-Ángeles, and Repiso, Rafael (2021). El fact-checking como estrategia global para contener la desinformación. Estudios sobre el Mensaje Periodístico, 27(3), 779-791. https://doi.org/10.5209/esmp.76189
  • Brandtzaeg, Petter-Bae; Følstad, Asbjørn, and Chaparro-Domínguez, María-Ángeles (2018). How journalists and social media users perceive online fact-checking and verification services. Journalism Practice, 12(9), 1109-1129. https://doi.org/10.1080/17512786.2017.1363657
  • Caswell, David and Dörr, Konstantin (2018). Automated Journalism 2.0: Event-driven narratives. Journalism Practice, 12(4), 477-496. https://doi.org/10.1080/17512786.2017.1320773
  • Cohen, Sarah; Hamilton, James T., and Turner, Fred (2011). Computational Journalism. Communications of the ACM, 54(10), 66-71. https://doi.org/10.1145/2001269.2001288
  • Cuartielles, Roger; Ramon-Vegas, Xavier, and Pont-Sorribes, Carles (2023). Retraining fact-checkers: The emergence of Chat-GPT in information verification. Profesional de la Información, 32(5). https://doi.org/10.3145/epi.2023.sep.15
  • Dierickx, Laurence and Lindén, Carl-Gustav (2023). Journalism and fact-checking technologies: Understanding user Nneeds.Communication +1, 10(1). https://doi.org/10.7275/cpo.1879
  • Dierickx, Laurence; Lindén, Carl-Gustav, and Opdahl, Andreas Lothe (2023). Automated fact-checking to support professional practices: Systematic literature review and meta-analysis. International Journal of Com-munication, 17, 5170-5190.
  • Duke Reporters’ Lab (2023). Fact-checking. Duke University. https://reporterslab.org/fact-checking. Accessed 1 September 2023.
  • García Avilés, José A. (2019). El impacto de la inteligencia artificial en el periodismo. Revista de Innovación en Periodismo. https://mip.umh.es/blog/2019/11/02/el-impacto-de-la-inteligencia-artificial-en-el-periodis-mo/. Accessed 21 November 2023.
  • García-Avilés, José Alberto; Arias, Félix; Lara, Alicia de; Paisana, Miguel; Carvajal, Miguel; Foá, Caterina; García-Ortega, Alba; Margato, Dina; Crespo, Miguel; Quiles, Borja, and Valero, José María (2023). Análisis de las tendencias e innovaciones en el ecosistema mediático de España y Portu-gal (2025-2030). IBERIFIER. https://doi.org/10.15581/026.006
  • García-Marín, David (2022). Modelos algorítmicos y fact-checking automatizado. Revisión sistemática de la literatura. Documentación de Ciencias de la Información, 45(1), 7-16. https://doi.org/10.5209/dcin.77472
  • García-Marín, David; Elías, Carlos, and Soengas-Pérez, Xosé (2022). Big data and disinformation: Algorithm mapping for fact checking and artificial intelligence. In Jorge Vázquez-Herrero et al. (eds.), Total journalism. Studies in big data, 97. Cham: Springer. https://doi.org/10.1007/978-3-030-88028-6_10
  • García-Orosa, Berta; Pérez-Seijo, Sara, and Vizoso, Ángel (2022). Emerging practices in the age of automated digital journalism. Routledge.
  • Given, Lisa M. (2008). The SAGE Encyclopedia of qualitative research methods. SAGE.
  • Graves, Lucas (2016). Anatomy of a fact check: Objective practice and the contested epistemology of fact checking. Communica-tion, Culture & Critique, 10(3), 518-537. https://doi.org/10.1111/cccr.12163
  • Graves, Lucas (2018). Understanding the promise and limits of automated fact-checking. Reuters Institute for the Stu-dy of Journalism. https://ora.ox.ac.uk/objects/uuid:f321ff43-05f0-4430-b978-f5f517b73b9b. Accessed 1 September 2023.
  • Graves, Lucas and Cherubini, Federica (2016). The rise of fact-checking sites in Europe. Digital News Project. Reuters Institute for the Study of Journalism. https://reuter-sinstitute.politics.ox.ac.uk/our-research/rise-fact-checking-sites-europe. Accessed 1 September 2023.
  • Graves, Lucas and Lauer, Laurens (2020). From movement to institution: The “Glo-bal Fact” summit as a field-configuring event. Sociologica, 14(2), 157-174. https://doi.org/10.6092/issn.1971-8853/11154
  • Guarino, Stefano; Trino, Noemi; Chessa, Ales-sandro, and Riotta, Gianni (2020). Beyond fact-checking: Network analysis tools for monitoring disinformation in social media. In Hocine Cherifi et al. (eds.), Complex Networks and Their ApplicationsVIII. Studies in Computational Intelligence, 881. Springer. https://doi.org/10.1007/978-3-030-36687-2_36
  • Guo, Zhijiang; Schlichtkrull, Michael, and Vlachos, Andreas (2022). A survey on automated fact-checking. Transactions of the Association for Computational Linguistics, 10, 178-206. https://doi.org/10.1162/tacl_a_00454
  • Gutiérrez-Caneda, Beatriz; Vázquez-Herrero, Jorge, and López-García, Xosé (2023). AI application in journalism: ChatGPT and the uses and risks of an emergent techno-logy. Profesional de la Información,32(5). https://doi.org/10.3145/epi.2023.sep.14
  • Herrero, Esperanza and Herrera-Damas, Susana (2021). El fact-checking hispano-hablante: Competencias, dificultades y propuestas de mejora desde la perspectiva de sus profesionales. Profesional de la In-formación, 30(6). https://doi.org/10.3145/epi.2021.nov.12
  • Herrero-Diz, Paula; Pérez-Escolar, Marta, and Varona Aramburu, David (2022). Competencias de verificación de contenidos: Una propuesta para los estudios de Comunicación. Revista de Comunicación, 21(1), 231-249. https://doi.org/10.26441/RC21.1-2022-A12
  • Humprecht, Edda (2020). How do they debunk “fake news”? A cross-national comparison of transparency in fact checks. Digital Journalism, 8(3), 310-327. https://doi.org/10.1080/21670811.2019.1691031
  • IFCN (2022). #UkraineFacts. https://ukrain-efacts.org. Accessed 1 September 2023.IFCN (2020). #CoronaVirusFacts Alliance. https://www.poynter.org/coronavirus-factsalliance. Accessed 1 September 2023.
  • Karlsen, Joakim and Stavelin, Eirik (2014). Computational Journalism in Norwegian Newsrooms. Journalism Practice, 8(1), 34-48. https://doi.org/10.1080/17512786.2013.813190
  • Kim, Daewon and Kim, Seongcheol (2018). Newspaper journalists’ attitudes towards robot journalism. Telematics and In-formatics, 35(2), 340-357. https://doi.org/10.1016/j.tele.2017.12.009
  • Kovach, Bill and Rosenstiel, Tom (2001). The elements of journalism: What newspeople should know and the public. Crown Publis-hers.
  • Lamprou, Evangelos and Antonopoulos, Nikos (2023). Ranked by truth metrics: A new communication method approach, on crowd-sourced fact-checking platforms for journalistic and social media content. Studies in Media and Communication, 11(6), 231-243. https://doi.org/10.11114/smc.v11i6.6166
  • Larraz, Irene; Míguez, Rubén, and Sallicati, Francesca (2023). Semantic similarity models for automated fact-checking: Claim-Check as a claim matching tool. Profesional de la Información, 32(3). https://doi.org/10.3145/epi.2023.may.21
  • Lelo, Thales (2022). The rise of the Brazilian fact-checking movement: Between economic sustainability and editorial independence. Journalism Studies, 23(9), 1077-1095. https://doi.org/10.1080/1461670X.2022.2069588
  • Lim, Chloe (2018). Checking how fact-checkers check. Research & Politics, 5(3). https://doi.org/10.1177/2053168018786848
  • López-García, Xosé; Rodríguez-Vázquez, Ana-Isabel, and Pereira-Fariña, Xosé (2017). Competencias tecnológicas y nuevos perfi-les profesionales: Desafíos del periodismo actual. Comunicar, 53(25), 81-90. https://doi.org/10.3916/C53-2017-08
  • Ma, Olivia and Feldman, Brandon (2022). How Google and YouTube are investing in fact-checking. The keyword. https://blog.google/outreach-initiatives/google-news-initiative/how-google-and-youtube-are-investing-in-fact-checking/ Accessed 15/11/2023.
  • Manfredi Sánchez, Juan Luis and Ufarte-Ruiz, María José (2020). Inteligencia artificial y periodismo: Una herramienta contra la desinformación. Revista CIDOB d’Afers Internacionals, 124, 49-72. https://doi.org/10.24241/rcai.2020.124.1.49
  • Mantzarlis, Alexios (2018). Fact-checking 101. In Cherilyn Ireton and Julie Posetti (eds.), Journalism, Fake News & Disinformation. Unesco, 85-100. https://unesdoc.unesco.org/ark:/48223/pf0000265552. Accessed 1 September 2023.
  • Meta (2021). How Meta’s third-party fact-checking program works. Meta. https://www.facebook.com/formedia/blog/third-party-fact-checking-how-it-works. Accessed 16 November 2023.
  • Montoro-Montarroso, Andrés; Cantón-Correa, Javier; Rosso, Paolo; Chulvi, Berta; Panizo-Lledot, Ángel; Huertas-Tato, Javier; Calvo-Figueras, Blanca; Rementeria, María J., and Gómez-Romero, Juan (2023). Fighting disinformation with artificial intelligence: Fundamentals, advances and challenges. Profesional de la Información, 32(3). https://doi.org/10.3145/epi.2023.may.22
  • Moreno-Gil, Victoria; Ramon, Xavier, and Ro-dríguez-Martínez, Ruth (2021). Fact-checking interventions as counteroffensives to disinformation growth: Standards, values, and practices in Latin America and Spain. Media and Communication, 9(1), 251-263. https://doi.org/10.17645/mac.v9i1.3443”h
  • Moreno-Gil, Victoria and Salgado-de-Dios, Francesc (2023). El cumplimiento del código de principios de la International Fact-Checking Network en las plataformas de verificación españolas. Un análisis cualitativo. Revista de Comunicación, 22(1), 293-307. https://doi.org/10.26441/rc22.1-2023-2971
  • Murcia-Verdú, Francisco-José and Ufarte-Ruiz, María-José (2019). Mapa de riesgos del periodismo hi-tech. Hipertext.net, 18, 47-55. https://doi.org/10.31009/hipertext.net.2019.i18.05
  • Noain-Sánchez, Amaya (2020). Collaborative journalism versus disinformation. An approach to fact-checking projects in Mexico, Argentina, Colombia, Brazil, and Spain. In David Ramírez Plascencia, Barbara Carvalho Gurgel, and Avery Plaw (eds.), The politics of technology in Latin America(Vol. 2). Routledge.
  • Noain-Sánchez, Amaya (2022). Addressing the impact of artificial intelligence on journalism: The perception of experts, journalists and academics. Communication & Society, 35(3), 105-121. https://doi.org/10.15581/003.35.3.105-121
  • Ogbebor, Binakuromo and Carter, Cynthia (2021). Introduction: Innovations, transi-tions and transformations in digital jour-nalism: Algorithmic, Symbolic, and New Forms of Journalism. Digital Journalism, 9(6), 687-693. https://doi.org/10.1080/21670811.2021.1964854
  • Ortega, J. (2023). Por qué la inteligencia artificial es un aliado de los verificadores y pue-de ayudar en la lucha contra la desinformación. Newtral. https://www.newtral.es/periodismo-inteligencia-artificial-avances-newtral/20220624/. Accessed 17 November 2023.
  • Palau-Sampio, Dolors (2018). Fact-checking and scrutiny of power: Supervision of public discourses in new media platforms from Latin America. Communication & Society, 31(3), 347-365. https://doi.org/10.15581/003.31.3.347-363
  • Pavlik, John (2000). The impact of technology on journalism. Journalism Studies, 1(2), 229-237. https://doi.org/10.1080/14616700050028226
  • Pérez-Seijo, Sara; Gutiérrez-Caneda, Beatriz, and López-García, Xosé (2020). Periodismo digital y alta tecnología: De la conso-lidación a los renovados desafíos. INDEX COMUNICACION, 10(3), 129-151. https://doi.org/10.33732/ixc/10/03Period
  • Porlezza, Colin and Ferri, Giulia (2022). The missing piece: Ethics and the ontologi-cal boundaries of automated journalism. #ISOJJournal, 12(1), 71-98. https://isoj.org/research/the-missing-piece-ethics-and-the-ontological-boundaries-of-automated-journalism/
  • Ramonet, Ignacio (2011). La explosión del periodismo. De los medios de masas a la masa de medios. Clave intelectual.
  • Rodríguez-Pérez, Carlos; Paniagua-Rojano, Francisco J., and Magallón-Rosa, Raúl (2021). Debunking political disinformation through journalists’ perceptions: An analysis of Colombia’s fact-checking news practices. Media and Communication, 9(1), 264-275. https://doi.org/10.17645/mac.v9i1.3374
  • Román-San-Miguel, Aránzazu; Sánchez-Gey Valenzuela, Nuria, and Elías Zambrano, Rodrigo (2022). Los profesionales de la in-formación y las fake news durante la pan-demia del covid-19. Vivat Academia. Revis-ta de Comunicación, 155, 131-149. http://doi.org/10.15178/va.2022.155.e1312
  • Salaverría, Ramón (2015). Periodismo en 2014: Balance y tendencias. Cuadernos de Periodistas, 29, 9-22. http://www.cua-dernosdeperiodistas.com/periodismo-en-2014-balance-y-tendencias/
  • Salazar García, Idoia Ana (2018). Los robots y la inteligencia artificial. Nuevos retos del periodismo. Doxa Comunicación. Revista Interdisciplinar de Estudios de Comunicación y Ciencias Sociales, 27, 295-315. https://doi.org/10.31921/doxacom.n27a15
  • Sanahuja-Sanahuja, Rosana and López-Raba-dán, Pablo (2022a). Ámbitos de aplicación periodística de la inteligencia artificial. Mapa conceptual, funciones profesionales y tendencias en desarrollo en el contexto de la pandemia global de la Covid-19. Razón y Palabra, 25(112). https://doi.org/10.26807/rp.v25i112.1827
  • Sanahuja-Sanahuja, Rosana and López-Rabadán, Pablo (2022b). Ética y uso periodístico de la inteligencia artificial. Los medios públicos y las plataformas de verificación como precursores de la rendición de cuentas en España. Estudios sobre el Mensaje Periodístico, 28(4), 959-970. https://dx.doi.org/10.5209/esmp.82385
  • Sánchez-García, Pilar; Merayo-Álvarez, Noemí; Calvo-Barbero, Carla, and Díez-Gracia, Alba (2023). Spanish technological development of artificial intelligence applied to journalism: Companies and tools for documentation, production and distribution of information. Profesional de la Información, 32(2). https://doi.org/10.3145/epi.2023.mar.08
  • Serrano-Puche, Javier; Rodríguez-Salcedo, Natalia, and Martínez-Costa, María-Pilar (2023). Trust, disinformation, and digi-tal media: Perceptions and expectations about news in a polarized environment. Profesional de la Información, 32(5). https://doi.org/10.3145/epi.2023.sep.18
  • Spyridou, Lia-Paschalia; Matsiola, Maria; Veglis, Andreas; Kalliris, George, and Di-moulas, Charalambos (2013). Journalism in a state of flux: Journalists as agents of technology innovation and emerging news practices. International Communication Gazette, 75(1), 76-98. https://doi.org/10.1177/1748048512461763
  • Steensen, Steen; Kalsnes, Bente, and Westlund, Oscar (2023). The limits of live fact-checking: Epistemological consequences of introducing a breaking news logic to political fact-checking. New Media & Society. https://doi.org/10.1177/14614448231151436
  • Túñez-López, Miguel; Fieiras Ceide, César, and Vaz-Álvarez, Martín (2021). Impacto de la inteligencia artificial en el periodismo: Transformaciones en la em-presa, los productos, los contenidos y el perfil profesional. Communication & Society, 34(1), 177-193. https://www.doi.org/10.15581/003.34.1.177-193
  • Túñez-López, Miguel; Toural-Bran, Carlos, and Valdiviezo-Abad, Cesibel (2019). Automatización, bots y algoritmos en la redacción de noticias. Impacto y calidad del periodismo artificial. Revista Latina de Comunicación Social, 74, 1411-1433. https://doi.org/10.4185/RLCS-2019-1391
  • Ufarte-Ruiz, María-José; Anzera, Giusseppe, and Murcia-Verdú, Francisco-José (2020). Plataformas independientes de fact-checking en España e Italia. Características, organización y método. Revista Mediterránea de Comunicación/Mediterranean Journal of Communication, 11(2), 23-39. https://doi.org/10.14198/MEDCOM2020.11.2.3
  • Ufarte-Ruiz, María-José; Calvo Rubio, Luis Mauricio, and Murcia Verdú, Francisco José (2022). Combatir las noticias falsas. El perfil profesional del verificador de la información en España. Vivat Academia, 155, 265-295. http://doi.org/10.15178/va.2022.155.e1365
  • Ufarte-Ruiz, María-José; Peralta-García, Lidia, and Murcia-Verdú, Francisco-José (2018). Fact checking: Un nuevo desafío del periodismo. Profesional de la Información, 27(4), 733-741. https://doi.org/10.3145/epi.2018.jul.02
  • Ufarte-Ruiz, María-José; Murcia-Verdú, Francisco-José, and Túñez-López, José-Miguel (2023). Use of artificial intelligen-ce in synthetic media: First newsrooms without journalists. Profesional de la In-formación, 32(2). https://doi.org/10.3145/epi.2023.mar.03
  • Vaccari, Cristian and Chadwick, Andrew (2020). Deepfakes and disinformation: Exploring the impact of synthetic political video on deception, uncertainty, and trust in news. Social Media + Society, 6(1). https://doi.org/10.1177/2056305120903408
  • Vázquez-Herrero, Jorge; Negreira-Rey, María-Cruz, and López-García, Xosé (2023). Misinformation on trial: Media coverage of a murder, public conversation and fact-checking. Journalism Practice. https://doi.org/10.1080/17512786.2022.2164328
  • Vázquez-Herrero, Jorge; Vizoso, Ángel, and López-García, Xose (2019). Innovación tecnológica y comunicativa para combatir la desinformación: 135 experiencias para un cambio de rumbo. Profesional de la Información, 28(3), e280301. https://doi.org/10.3145/epi.2019.may.01
  • Vizoso, Ángel and Vázquez-Herrero, Jorge (2019). Fact-checking platforms in Spanish. Features, organization and method. Communication & Society, 32(1), 127-142. https://doi.org/10.15581/003.32.37819
  • Weise, Karen and Metz, Cade (2023). When AI chatbots hallucinate. The New York Times. https://www.nytimes.com/2023/05/01/business/ai-chatbots-hallucination.html. Accessed 16 November 2023.
  • Yin, Robert K. (1993). Applications of case study research. SAGE
Fuente de los datos: Dialnet