← Back to VOLUME 15, ISSUE 11, NOVEMBER 2026
This work is licensed under a Creative Commons Attribution 4.0 International License.
InsightAI: An AI-Powered Multi-Modal Document Summarization and Question Answering System Using Large Language Models and NLP Analytics
Bhavesh Kishor Patil, Pranav Ravindra Patil, Mayur Pankaj Patil, Yogesh Dnyaneshwar Patil, Prof. Kaminee Subhash Patil
👁 4 views📥 1 download
Abstract: The exponential growth of digital content in multiple formats — text documents, audio recordings, and video lectures — has created significant challenges for efficient information extraction and knowledge synthesis. This paper presents InsightAI, a comprehensive web-based application that leverages Large Language Models (LLMs) and Natural Language Processing (NLP) techniques to provide intelligent multi-modal document summarization, interactive question answering, and analytical insights. The proposed system accepts inputs in seven formats including PDF, DOCX, TXT, MP3, WAV, MP4, and YouTube URLs, and utilizes the Google Gemini 2.5 Flash API for text processing and the Groq Whisper Large-V3 API for audio transcription. InsightAI offers six distinct summarization modes, a Retrieval- Augmented Generation (RAG) based QA chatbot, sentiment analysis, keyword and Named Entity Recognition (NER) extraction, automated quiz generation, flashcard creation, mind map visualization, and multi-language translation across ten languages. Summary quality is scored by a reference-free, LLM-based judge for coherence, consistency, fluency and relevance. A multi-user layer provides email-verified registration with one-time passwords (OTPs) sent through Nodemailer, bcrypt-protected passwords, signed session tokens, password recovery, and a relational database (SQLite for development, PostgreSQL for production) that stores each user’s summaries and chat history privately. The system is built using a Python FastAPI backend and a React.js frontend, providing a scalable and user-friendly platform for students, researchers, and professionals.
Keywords: Large Language Models, Natural Language Processing, Document Summarization, Question Answering, Retrieval-Augmented Generation, Multi-Modal Processing, LLM-as-a-Judge Evaluation, User Authentication, One- Time Password, Sentiment Analysis, Google Gemini, Groq Whisper
Keywords: Large Language Models, Natural Language Processing, Document Summarization, Question Answering, Retrieval-Augmented Generation, Multi-Modal Processing, LLM-as-a-Judge Evaluation, User Authentication, One- Time Password, Sentiment Analysis, Google Gemini, Groq Whisper
How to Cite:
[1] Bhavesh Kishor Patil, Pranav Ravindra Patil, Mayur Pankaj Patil, Yogesh Dnyaneshwar Patil, Prof. Kaminee Subhash Patil, “InsightAI: An AI-Powered Multi-Modal Document Summarization and Question Answering System Using Large Language Models and NLP Analytics,” International Journal of Advanced Research in Computer and Communication Engineering (IJARCCE), DOI: 10.17148/IJARCCE.2026.151131
