#CartoonAbstract | Blog de Juan A. Marin-Garcia

Optimizing the screening of scientific literature: Artificial or Human Intelligence?

El 14 de marzo 2025, presentaremos nuestro trabajo Optimizing the screening of scientific literature: Artificial or Human Intelligence? en el XVI Workshop in Operations Management and Technology en Melilla.
This paper analyses the use of artificial intelligence (AI) in scientific literature screening, comparing its performance with the consensus of human researchers. The objective is to evaluate three methods: 1) generative AI using chatbots such as ChatGPT and Claude; 2) supervised learning with the Rayaan algorithm; and 3) similarity ranking based on sentence Transformers embeddings, proposed by Marin-Garcia et al. (2024). The study aims to determine whether any of these methods reduce manual effort and improve efficiency metrics such as accuracy, repeatability and time spent. It will also investigate the generalisability of these models to different scientific areas and whether the integration of multiple models improves the consistency of results in complex texts.

Alfalla- Luque, R., Luján García, D. E., & Marin- Garcia, J. A. (2023). Supply chain agility and performance: evidence from a meta- analysis. International Journal of Operations & Production Management, 43(10), 1587-1633. https://doi.org/10.1108/ijopm- 05- 2022- 0316
Marin- Garcia, J. A., Martinez- Tomas, J., Juarez- Tarraga, A., & Santandreu-Mascarell, C. (2024). Protocol paper: From Chaos to Order. Augmenting Manual Article Screening with Sentence Transformers in Management Systematic Reviews. WPOM- Working Papers on Operations Management, 15, 172-208. https://doi.org/10.4995/wpom.22282

Rafaela Alfalla-Luque Alina Díaz Curbelo Juan A. Marin-Garcia Juan Martínez cartoonabstract

Publicado-Marin-Garcia & EtAl (2016) Proposal of a Framework for Innovation Competencies Development and Assessment (FINCODA)

Marin-Garcia, J., Andreu Andres, M., Atares-Huerta, L., Aznar-Mas, L., Garcia-Carbonell, A., González-Ladrón-de-Gevara, F., Montero Fleta, B., Perez-Peñalver, M., & Watts, F. (2016). Proposal of a Framework for Innovation Competencies Development and Assessment (FINCODA). WPOM-Working Papers on Operations Management, 7(2), 119-126. doi:http://dx.doi.org/10.4995/wpom.v7i2.6472

In this article we propose an innovation competence model of the people which is based on the existing literature to integrate and complement existing models. The main contribution of this work consists in demonstrating the differences and similarities of current models and in providing a conceptual definition for each model element. In this way, both researchers and people in charge of human resources in companies obtain a framework with which to design measuring instruments to assess innovation competence, which can fulfill the twofold demand of validity and reliability.

This work has been conducted as part of a European project financed by the European Union [“FINCODA” Project 554493-EPP-1-2014-1-FI-EPPKA2-KA] (http://bit.ly/FINCODA-EUsite01). (The European Commission support for the production of this publication does not constitute an endorsement of the contents which reflects the views only of the authors, and the Commission cannot be held responsible for any use which may be made of the information contained therein); and by the Universitat Politénica de Valencia PIME/2015/A/009/A “Evaluation of innovative behavior indicators in university students”.

Keywords

competence assessment; innovation; model; literature review

Publicado-MARIN-GARCIA, Juan A.(2015) Publishing in two phases for focused research by means of “research collaborations”

MARIN-GARCIA, Juan A.. Publishing in two phases for focused research by means of “research collaborations”. WPOM-Working Papers on Operations Management, [S.l.], v. 6, n. 2, p. 76-80, dec. 2015. ISSN 1989-9068. Available at: <http://polipapers.upv.es/index.php/WPOM/article/view/4459>. Date accessed: 27 dec. 2015. doi:http://dx.doi.org/10.4995/wpom.v6i2.4459.

We present and justify a new way to research and publish. This proposal is not intended to substitute or replace traditional ways of doing science, but rather complement, filling a gap and providing an efficient way to achieve scientific advances. The process begins with the sending a proposal of protocol to WPOM. Proposals are evaluated in each of the collaborations, depending on the potential to fill a research niche in the area. In the case of accepted protocols, WPOM guarantees commitment to publish the article if the protocol and deadlines are met. Thus, researchers can develop their projects focusing on meeting the protocol that has been approved without the question of whether, once completed, research is relevant or if the methodology is correct.

—-

En este artículo presentamos y justificamos una nueva forma de investigar y publicar. Esta propuesta no pretende sustituir o reemplazar a los modos tradicionales de hacer ciencias, sino complementarlos, rellenando una laguna y ofreciendo un camino eficiente para lograr los avances científicos. El proceso se inicia con el envío de la propuesta de protocolo WPOM. Las propuestas se evalúan, en cada una de las collaborations, en función del potencial para cubrir un nicho de investigación en el área. En el caso de ser aceptados los protocolos, WPOM garantiza un compromiso de publicación del artículo si se cumple el protocolo y plazos prometidos en el proyecto. De este modo, los investigadores pueden desarrollar proyectos de escritura centrándose en cumplir el protocolo que ha sido aprobado, sin la incógnita de si, una vez terminada, la investigación es relevante o si la metodología es la correcta.

Keywords

focused research; protocol; collaboration;Investigación enfocada; protocolos