Development of a Pilot Chatbot to Detect Interactions Between Monotherapy and Combination Therapy with Captopril Using a Local (LLM) in Cardiovascular Therapy
DOI:
https://doi.org/10.59247/jahir.v4i1.422Keywords:
captopril, cardiovascular, drug interaction, Large Language Models, Artificial IntelligenceAbstract
Cardiovascular diseases (CVDs), including hypertension and heart failure, remain major contributors to global morbidity and mortality and frequently require long-term polypharmacy. The concurrent use of multiple medications increases the risk of drug–drug interactions (DDIs), which may reduce therapeutic effectiveness, increase toxicity, and contribute to adverse drug reactions. This study aimed to develop and validate a locally deployed large language model (LLM)-based chatbot for detecting drug–drug interactions involving captopril in both monotherapy and combination therapy settings. A development and validation study was conducted using DDI data obtained from DrugBank and Drugs.com. The chatbot was developed using the LLaMA-3 model integrated with LangChain, Ollama, and FastAPI and was evaluated through iterative testing and 5-fold cross-validation. System performance was assessed using accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV), while usability was evaluated using the System Usability Scale (SUS) and Single Ease Question (SEQ) questionnaires completed by pharmacists. The chatbot demonstrated progressive performance improvement throughout development and achieved excellent performance during final validation involving 300 drug pairs, with an accuracy of 99.0%, sensitivity of 100.0%, specificity of 98.0%, PPV of 100.0%, and NPV of 92.0%, exceeding all predefined acceptance thresholds. Usability testing indicated only fair to moderate usability, with a mean SUS score of 65.0 and a mean SEQ score of 5.0, suggesting that further refinement of the user interface and workflow may be required. The locally deployed LLM-based chatbot demonstrated satisfactory diagnostic performance and preliminary feasibility for captopril-related DDI screening. Although the system showed promising classification performance, additional usability optimization and evaluation in real-world clinical workflows are needed before broader implementation can be considered as a pharmacist-supportive screening system.
References
WHO, World health statistics 2024. World Health Organization, 2024. Accessed: Jun. 21, 2026. [Online]. Available: https://www.who.int/publications/b/74273
Kemenkes, “Survei Kesehatan Indonesia (SKI) 2023,” Badan Kebijakan Pembangunan Kesehatan | BKPK Kemenkes. Accessed: Oct. 24, 2025. [Online]. Available: https://www.badankebijakan.kemkes.go.id/hasil-ski-2023/
Elishba Khan, Ayesha Ijaz, Dr. Fauzia Jan, Samia Rashid, and Gilberto Mercado Mercado, “INVestigating Specific Drug-Drug Interactions And Their Clinical Implications In Polypharmacy, Particularly In Elderly Patients,” JMHSR, vol. 2, no. 2, Apr. 2025, doi: 10.62019/cn4rwa95.
R. W. Hoel, R. M. Giddings Connolly, and P. Y. Takahashi, “Polypharmacy Management in Older Patients,” Mayo Clinic Proceedings, vol. 96, no. 1, pp. 242–256, Jan. 2021, doi: 10.1016/j.mayocp.2020.06.012.
M. Molokhia and A. Majeed, “Current and future perspectives on the management of polypharmacy,” BMC Fam Pract, vol. 18, no. 1, p. 70, Dec. 2017, doi: 10.1186/s12875-017-0642-0.
L. Margusino-Framiñán et al., “Influence of drug–drug interactions on effectiveness and safety of direct-acting antivirals against hepatitis C virus,” Eur J Hosp Pharm, vol. 28, no. 1, pp. 16–21, Jan. 2021, doi: 10.1136/ejhpharm-2019-001889.
N. Aksoy and N. Ozturk, “A meta‐analysis assessing the prevalence of drug–drug interactions among hospitalized patients,” Pharmacoepidemiology and Drug, vol. 32, no. 12, pp. 1319–1330, Dec. 2023, doi: 10.1002/pds.5691.
A. G. Roberts and M. E. Gibbs, “Mechanisms and the clinical relevance of complex drug–drug interactions,” CPAA, vol. Volume 10, pp. 123–134, Sep. 2018, doi: 10.2147/CPAA.S146115.
W. T. Kim et al., “Medication Extraction and Drug Interaction Chatbot: Generative Pretrained Transformer-Powered Chatbot for Drug-Drug Interaction,” Mayo Clinic Proceedings: Digital Health, vol. 2, no. 4, pp. 611–619, 2024.
I. Y. Kusuma, P. O. D. Megasari, and L. Sukiatno, “Identifikasi potensi interaksi obat pada pasien hipertensi: studi retrospektif resep polifarmasi di Apotek Karya Sehat Purwokerto,” Viva Medika: Jurnal Kesehatan, Kebidanan dan Keperawatan, vol. 12, no. 1, pp. 72–80, 2018.
H. Ahmad, H. Khan, S. Haque, S. Ahmad, N. Srivastava, and A. Khan, “Angiotensin-Converting Enzyme and Hypertension: A Systemic Analysis of Various ACE Inhibitors, Their Side Effects, and Bioactive Peptides as a Putative Therapy for Hypertension,” J Renin Angiotensin Aldosterone Syst, vol. 2023, p. 7890188, Jan. 2023, doi: 10.1155/2023/7890188.
S. Bhullar, A. Shah, and N. Dhalla, “Mechanisms for the development of heart failure and improvement of cardiac function by angiotensin-converting enzyme inhibitors,” Scripta Medica, vol. 53, no. 1, pp. 51–76, 2022, doi: 10.5937/scriptamed53-36256.
Y.-H. Du, C.-J. Guan, L.-Y. Li, and P. Gan, “Efficacy and safety of angiotensin converting enzyme inhibitors and angiotensin II receptor blockers in diabetic nephropathy: a systematic review and meta-analysis,” Ann Palliat Med, vol. 11, no. 3, pp. 1093–1101, Mar. 2022, doi: 10.21037/apm-22-212.
N. Swekwi, “The effects of co-prescription of warfarin and cardiovascular medicines among atrial fibrillation patients and/or deep vein thrombosis patients in Queensland, Australia,” Oct. 01, 2020, Griffith University. doi: 10.25904/1912/3978.
E. Eschmann, P. E. Beeler, M. Schneemann, and J. Blaser, “Developing strategies for predicting hyperkalemia in potassium-increasing drug-drug interactions,” Journal of the American Medical Informatics Association, vol. 24, no. 1, pp. 60–66, Jan. 2017, doi: 10.1093/jamia/ocw050.
R. De Silva et al., “Anemia, Renal Dysfunction, and Their Interaction in Patients With Chronic Heart Failure,” The American Journal of Cardiology, vol. 98, no. 3, pp. 391–398, Aug. 2006, doi: 10.1016/j.amjcard.2006.01.107.
K. M. Sink et al., “Syncope, Hypotension, and Falls in the Treatment of Hypertension: Results from the Randomized Clinical Systolic Blood Pressure Intervention Trial,” J American Geriatrics Society, vol. 66, no. 4, pp. 679–686, Apr. 2018, doi: 10.1111/jgs.15236.
M. A. Fravel and M. Ernst, “Drug Interactions with Antihypertensives,” Curr Hypertens Rep, vol. 23, no. 3, p. 14, Mar. 2021, doi: 10.1007/s11906-021-01131-y.
F. A. Berger, H. Van Der Sijs, T. Van Gelder, and P. M. L. A. Van Den Bemt, “The use of a clinical decision support tool to assess the risk of QT drug–drug interactions in community pharmacies,” Therapeutic Advances in Drug Safety, vol. 12, p. 2042098621996098, Jan. 2021, doi: 10.1177/2042098621996098.
A. Cesaro, S. C. Hoffman, P. Das, and C. de la Fuente-Nunez, “Challenges and applications of artificial intelligence in infectious diseases and antimicrobial resistance,” npj Antimicrobials and Resistance, vol. 3, no. 1, p. 2, 2025.
Putra and S. Pramana, “Imam Machdi^1, Alfatihah Reno MNSPM^2, Arie Wahyu Wijayanto^3,” Prosiding Use Cases Artificial Intelligence Indonesia: Embracing Collaboration for Research and Industrial Innovation in Artificial Intelligence, vol. 47, 2023.
I. B. K. Manuaba et al., Teknologi Chatgpt: Pengetahuan Dasar Dan Pemanfaatan Kombinasi Keahlian Dengan Chatgpt Di Berbagai Bidang. PT. Sonpedia Publishing Indonesia, 2024.
R. Qardafil, “Peningkatan Efektivitas Kualitas Chatbot Jala Tech Melalui Implementasi Chat GPT, Auto-GPT, Dan Langchain,” PhD Thesis, Universitas Islam Indonesia, 2023.
Y. N. Pratiwi, Z. Shafa, T. Nike, and P. Perawati, “Mengolah Kata, Menyembuhkan Luka:: Pentingnya Bahasa Indonesia dalam hal Komunikasi Praktik Kedokteran,” Indonesian Research Journal on Education, vol. 5, no. 1, pp. 757–764, 2025.
S. Yessy Asri et al., A Large Language Model (Llm) Penerapan Large Language Model (Llm) Dalam Chatbot. Uwais Inspirasi Indonesia, 2025.
K. Ponnukamu and S. P. Sasirekha, “Python-Integrated Quantum–Classical Computing Framework for Intelligent Time-Series Prediction,” in 2025 4th International Conference on Automation, Computing and Renewable Systems (ICACRS), Pudukkottai, India: IEEE, Dec. 2025, pp. 1453–1457. doi: 10.1109/ICACRS67045.2025.11324310.
E. M. Tosca, L. Aiello, A. De Carlo, and P. Magni, “Pharmacometrics in the Age of Large Language Models: A Vision of the Future,” Pharmaceutics, vol. 17, no. 10, p. 1274, Sep. 2025, doi: 10.3390/pharmaceutics17101274.
K. I. Roumeliotis and R. Sapkota, “OpenClaw and Ollama in Agentic AI: Toward Fully Autonomous and Scalable AI Agent Systems,” SSRN Journal, 2026, doi: 10.2139/ssrn.6584998.
A. Osheba, A. Abou-El-Ela, O. Adel, Y. Maaod, T. Abuhmed, and S. El-Sappagh, “Leveraging Large Language Models for Smart Pharmacy Systems: Enhancing Drug Safety and Operational Efficiency,” in 2025 19th International Conference on Ubiquitous Information Management and Communication (IMCOM), Bangkok, Thailand: IEEE, Jan. 2025, pp. 1–8. doi: 10.1109/IMCOM64595.2025.10857582.
P. K. Narayanan, “Engineering Machine Learning and Data REST APIs using FastAPI,” in Data Engineering for Machine Learning Pipelines, Berkeley, CA: Apress, 2024, pp. 323–359. doi: 10.1007/979-8-8688-0602-510.
B. K. Kalita, K. A. Singh, and M. Kalita, “Fivefold Cross-Validation Approach in Evaluating the Robustness of Machine Learning Models for Prediction of Esophageal Cancer,” Indian Journal of Community Medicine, vol. 51, no. Suppl 1, pp. S180–S188, Feb. 2026, doi: 10.4103/ijcm.ijcm_454_24.
H. Khude and P. Shende, “AI-driven clinical decision support systems: Revolutionizing medication selection and personalized drug therapy,” Advances in Integrative Medicine, vol. 12, no. 4, p. 100529, Dec. 2025, doi: 10.1016/j.aimed.2025.100529.
D. C. Wynn and C. M. Eckert, “Perspectives on iteration in design and development,” Research in Engineering Design, vol. 28, no. 2, pp. 153–184, 2017.
J. Vamathevan et al., “Applications of machine learning in drug discovery and development,” Nature reviews Drug discovery, vol. 18, no. 6, pp. 463–477, 2019.
H. Zhou et al., “A collaborative large language model for drug analysis,” Nature Biomedical Engineering, vol. 10, no. 5, pp. 870–881, 2026.
J. M. Bos et al., “Prediction of clinically relevant adverse drug events in surgical patients,” PloS one, vol. 13, no. 8, p. e0201645, 2018.
K. Singh, “Artificial intelligence & cloud in healthcare: Analyzing challenges and solutions within regulatory boundaries,” SSRG Int J Comput Sci Eng, vol. 10, no. 9, pp. 1–9, 2023.
W. Bani Issa et al., “Privacy, confidentiality, security and patient safety concerns about electronic health records,” International nursing review, vol. 67, no. 2, pp. 218–230, 2020.
J. Beavers et al., “Evaluation of inpatient medication guidance from an artificial intelligence chatbot,” American Journal of Health-System Pharmacy, vol. 80, no. 24, pp. 1822–1829, 2023.
I. B. Lima, Y. Jeong, C. Lee, G. Suh, and W. Hwang, “Severity of usability problems and system usability scale (Sus) scores on augmented reality (ar) user interfaces,” ICIC Express Letters, Part B: Applications, vol. 12, no. 2, pp. 175–183, 2021.
G. Kyle, A. C. Landon, D. Pilgreen, and E. Golebie, “Measurement instruments,” in Understanding recreational fishers: disciplinary and interdisciplinary approaches for fisheries management, Springer, 2025, pp. 355–385.
J. R. Lewis, B. S. Utesch, and D. E. Maher, “Measuring perceived usability: The SUS, UMUX-LITE, and AltUsability,” International Journal of Human-Computer Interaction, vol. 31, no. 8, pp. 496–505, 2015.
A. Alam, S. S. Shah, S. A. Rabbani, and M. El-Tanani, “The role of artificial intelligence in pharmacy practice and patient care: Innovations and implications,” BioMedInformatics, vol. 5, no. 4, p. 65, 2025
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Ikhwan Yuda Kusuma, Afriza Pujiati, Khamdiyah Indah Kurniasih, Siti Setianingsih, Bizhar Ahmed Tayeb, Nur Arifin Akbar, Muhammad Syaiful Aliim
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All articles published in the JAHIR Journal are licensed under the Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) license. This license grants the following permissions and obligations:
1. Permitted Uses:
- Sharing – You may copy and redistribute the material in any medium or format.
- Adaptation – You may remix, transform, and build upon the material for any purpose, including commercial use.
2. Conditions of Use:
- Attribution – You must give appropriate credit to the original author(s), provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in a way that suggests the licensor endorses you or your use.
- ShareAlike – If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original (CC BY-SA 4.0).
- No Additional Restrictions – You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
3. Disclaimer:
- The JAHIR Journal and the authors are not responsible for any modifications, interpretations, or derivative works made by third parties using the published content.
- This license does not affect the ownership of copyrights, and authors retain full rights to their work.
For further details, please refer to the official Creative Commons Attribution-ShareAlike 4.0 International License.
