Publicação
Protocol for evaluating ChatGPT in biomedical association generation and verification using a RAG enabled, cross-model majority voting workflow
| dc.contributor.author | Hamed, Ahmed Abdeen | |
| dc.contributor.author | Rocha, Luis M. | |
| dc.date.accessioned | 2026-06-01T17:11:00Z | |
| dc.date.available | 2026-06-01T17:11:00Z | |
| dc.date.issued | 2026-06-19 | |
| dc.description.abstract | We present a protocol to evaluate ChatGPT’s ability to generate disease-centric biomedical associations. It outlines how we generate the associations, validate the biological entities using biomedical ontologies, and verify associations using literature. The protocol includes a self-consistency strategy to assess generative reliability across ChatGPT models. To address ontology exact-match limitations, we provide a use case performing semantic verification through a workflow enabled by Retrieval-Augmented Generation (RAG) powered by open-source large language models (LLMs). This enables LLMs to establish truth over content generated by other LLMs and expose hallucination. | eng |
| dc.identifier.doi | 10.1016/j.xpro.2026.104533 | |
| dc.identifier.other | 86b79572-383d-4002-9814-6a03816ee030 | |
| dc.identifier.pmid | 42133493 | |
| dc.identifier.uri | http://hdl.handle.net/10400.14/57885 | |
| dc.identifier.wos | 001770377700001 | |
| dc.language.iso | eng | |
| dc.peerreviewed | yes | |
| dc.publisher | Cell Press | |
| dc.rights.uri | http://creativecommons.org/licenses/by-nc-nd/4.0/ | |
| dc.title | Protocol for evaluating ChatGPT in biomedical association generation and verification using a RAG enabled, cross-model majority voting workflow | |
| dc.type | research article | |
| dspace.entity.type | Publication | |
| oaire.citation.issue | 2 | |
| oaire.citation.volume | 7 | |
| oaire.version | http://purl.org/coar/version/c_970fb48d4fbd8a85 |
Ficheiros
Principais
1 - 1 de 1
