Abstract:

Traditional source search algorithms are prone to local optimization, and source search methods combining crowdsourcing and human-AI collaboration suffer from low cost-efficiency due to human intervention. In this study, we proposed a lightweight human-AI collaboration framework that utilized multi-modal large language models (MLLMs) to achieve visual-language conversion, combined chain-of-thought (CoT) reasoning to optimize decision-making, and constructed a heuristic strategy that incorporated probability distribution filtering and a balance between exploitation and exploration. The effectiveness of the framework was verified by experiments. The human-AI alignment heuristic strategy with large language model adaptation design provides a new idea to reduce manual dependency for source search task in complex scenes.

Key words: source search, human-AI collaboration, large language model, heuristic strategy, human-AI alignment