Large Language Models (LLMs) have emerged as promising recommendation systems, offering novel ways to model user preferences through generative approaches. However, many existing methods often rely solely on text semantics or incorporate collaborative signals in a limited manner, typically using only user or item embeddings. These methods struggle to handle multiple item embeddings representing user history, reverting to textual semantics and neglecting richer collaborative information. In this work, we propose a simple yet effective solution that projects user and item embeddings, learned from collaborative filtering, into the LLM token space via separate lightweight projector modules. A finetuned LLM then conditions on these projected embeddings alongside textual tokens to generate recommendations. Preliminary results show that this design effectively leverages structured user-item interaction data, improves recommendation performance over text-only LLM baselines, and offers a practical path for bridging traditional recommendation systems with modern LLMs.
Bibtex
@misc{hossain2026llmsbenefituseritem,
title={Do LLMs Benefit from User and Item Embeddings in Recommendation Tasks?},
author={Mir Rayat Imtiaz Hossain and Leo Feng and Leonid Sigal and Mohamed Osama Ahmed},
year={2026},
eprint={2601.04690},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2601.04690},
}
Related Research
-
Score-based Outlier Generation via Controlling the Radon-Nikodym Derivative
Score-based Outlier Generation via Controlling the Radon-Nikodym Derivative
A. Mukherjee, T. Milne, K. Y. C. Lui, S. Hazlewood, and J. Liu. IEEE Conference on Decision and Control
Publications
-
Investigating Action Embeddings for More Efficient Off-Policy Evaluation
Investigating Action Embeddings for More Efficient Off-Policy Evaluation
M. Wabartha, K. Wilson, R. David Evans, H. Sharifi, and T. Sylvain. RecSys CONSEQUENCES Workshop
Publications
-
FACTS: Fast, Accurate, and Privacy-Compliant TableSummarization via Offline Template Generation
FACTS: Fast, Accurate, and Privacy-Compliant TableSummarization via Offline Template Generation
Y. Yuan, M. Amin Shabani, and S. Liu. Workshop on Generative AI in Finance at NeurIPS
Publications