📞 +91-7667918914 | ✉️ ijarcce@gmail.com
International Journal of Advanced Research in Computer and Communication Engineering
International Journal of Advanced Research in Computer and Communication Engineering A monthly Peer-reviewed & Refereed journal
ISSN Online 2278-1021ISSN Print 2319-5940Since 2012
IJARCCE adheres to the suggestive parameters outlined by the University Grants Commission (UGC) for peer-reviewed journals, upholding high standards of research quality, ethical publishing, and academic excellence.
← Back to VOLUME 15, ISSUE 11, NOVEMBER 2026

InsightAI: An AI-Powered Multi-Modal Document Summarization and Question Answering System Using Large Language Models and NLP Analytics

Bhavesh Kishor Patil, Pranav Ravindra Patil, Mayur Pankaj Patil, Yogesh Dnyaneshwar Patil, Prof. Kaminee Subhash Patil

👁 4 views📥 1 download
Share: 𝕏 f in ✈ ✉
Abstract: The exponential growth of digital content in multiple formats — text documents, audio recordings, and video lectures — has created significant challenges for efficient information extraction and knowledge synthesis. This paper presents InsightAI, a comprehensive web-based application that leverages Large Language Models (LLMs) and Natural Language Processing (NLP) techniques to provide intelligent multi-modal document summarization, interactive question answering, and analytical insights. The proposed system accepts inputs in seven formats including PDF, DOCX, TXT, MP3, WAV, MP4, and YouTube URLs, and utilizes the Google Gemini 2.5 Flash API for text processing and the Groq Whisper Large-V3 API for audio transcription. InsightAI offers six distinct summarization modes, a Retrieval- Augmented Generation (RAG) based QA chatbot, sentiment analysis, keyword and Named Entity Recognition (NER) extraction, automated quiz generation, flashcard creation, mind map visualization, and multi-language translation across ten languages. Summary quality is scored by a reference-free, LLM-based judge for coherence, consistency, fluency and relevance. A multi-user layer provides email-verified registration with one-time passwords (OTPs) sent through Nodemailer, bcrypt-protected passwords, signed session tokens, password recovery, and a relational database (SQLite for development, PostgreSQL for production) that stores each user’s summaries and chat history privately. The system is built using a Python FastAPI backend and a React.js frontend, providing a scalable and user-friendly platform for students, researchers, and professionals.

Keywords: Large Language Models, Natural Language Processing, Document Summarization, Question Answering, Retrieval-Augmented Generation, Multi-Modal Processing, LLM-as-a-Judge Evaluation, User Authentication, One- Time Password, Sentiment Analysis, Google Gemini, Groq Whisper

How to Cite:

[1] Bhavesh Kishor Patil, Pranav Ravindra Patil, Mayur Pankaj Patil, Yogesh Dnyaneshwar Patil, Prof. Kaminee Subhash Patil, “InsightAI: An AI-Powered Multi-Modal Document Summarization and Question Answering System Using Large Language Models and NLP Analytics,” International Journal of Advanced Research in Computer and Communication Engineering (IJARCCE), DOI: 10.17148/IJARCCE.2026.151131

Creative Commons License This work is licensed under a Creative Commons Attribution 4.0 International License.