AI paper index
TopoMAS Evaluation Datasets and Results for Materials Science Question-Answering System
One-line summary
An AI research paper on TopoMAS Evaluation Datasets and Results for Materials Science Question-Answering System.
Engineering notes
Engineering notes will be added by the aipentium editorial team.
Chinese explanation / 中文解读
中文解读待补充：本站会优先为大语言模型、生成式AI、ChatGPT相关技术、计算机视觉、深度学习等高价值论文补充中文说明。
Original abstract
This repository contains the evaluation datasets and experimental results for TopoMAS, a knowledge-enhanced question-answering framework for topological materials science. The specific contents include: 📊 Evaluation Datasets: - LLM4Mat-Bench Benchmark Dataset: Contains 85790 questions with standard answers - TopoQA Specialized Dataset: Covers 110 domain-specific questions and answers in materials science (developed by our research team and continuously updated) - TopoOQ Specialized Dataset: Includes 95 open-ended questions in materials science (developed by our research team and continuously updated) 📈 Experimental Results: - Performance metrics on LLM4Mat-Bench (Wtd. Avg. (MAD:MAE) = 14.421, Wtd. Avg. AUC = 0.891) - Performance metrics on TopoQA (Accuracy: 91.21%±5.55%) - Performance metrics on TopoOQ (Composite Score: 8.75±0.01/10) - Comparative results with multiple models in the framework (Qwen3, Qwen2.5, DeepSeek-V3) This dataset supports the research presented in the paper "TopoMAS: Large Language Model Driven Topological Materials Multi-Agent System"and can be used to reproduce experimental findings or serve as benchmark data for materials science QA systems. We sincerely welcome contributions and suggestions from the academic community to further improve dataset quality.
Links and sources
Need this topic turned into a technical roadmap?
aipentium can prepare a custom AI literature review, code map, dataset map, and B2B technology assessment.
Request B2B AI research
Comments