Evaluating Large Language Models for Scientific Paper Search: Retrieval Success and Inference Latency on Mac Studio and NVIDIA A100
Summary
This study compares locally deployed LLMs on scientific paper search, measuring retrieval success and latency on Mac Studio and NVIDIA A100.
Why this matters
Covers model and LLM · Relevant to this topic
Source: arXiv cs.AI · arxiv.org