Paper Detail

Comparative Analysis of Low-Rank Adaptation in Large Language Models versus Dense Embedding Regression for Headline Click-Through Rate Prediction

Samarth Sirsat, Anirudha Shinde, Amit Sethi, Aman Verma

Browse

Workflow Queues

arxiv Score 7.8

Published 2026-08-12 · First seen 2026-08-13

General AI

Open paper source

Abstract

Optimizing digital content headlines for click-through rate (CTR) is an important problem in online media and recommendation systems. While large language models (LLMs) have demonstrated strong generative capabilities, their effectiveness for discriminative ranking tasks, such as selecting the highest-performing headline from a set of candidates, remains less well understood. In this work, we compare a LoRA-fine-tuned causal language model, LOLAQwen (0.6B), with a dense embedding regression model for headline selection. We formulate headline selection as a winner-take-all classification problem and evaluate both approaches using a dataset of 3,263 A/B-tested headline groups. Performance is measured using Top-1 accuracy, defined as the proportion of groups for which the model correctly identifies the highest-performing headline. The embedding regression model achieves a Top-1 accuracy of 42.79%, compared with 35.70% for the LoRA-fine-tuned language model. These results indicate that, for this headline selection task, a lightweight discriminative approach can outperform a small generative language model fine-tuned using parameter-efficient adaptation. The findings highlight the potential of embedding-based regression models as efficient alternatives to generative models for high-throughput content ranking applications.

Workflow Status

Review status
pending
Role
unreviewed
Read priority
soon
Vote
Not set.
Saved
no
Collections
Not filed yet.
Next action
Not filled yet.

Reading Brief

No structured notes yet. Add `summary_sections`, `why_relevant`, `claim_impact`, or `next_action` in `papers.jsonl` to enrich this view.

Why It Surfaced

No ranking explanation is available yet.

Tags

No tags.

Similar Papers

TalkLoRA: Communication-Aware Mixture of Low-Rank Adaptation for Large Language Models 2026-04-07 · Score 5.3 General AI TLoRA: Task-aware Low Rank Adaptation of Large Language Models 2026-04-20 · Score 9.3 General AI Low-Rank Adaptation Redux for Large Models 2026-04-23 · Score 3.3 General AI Bayesian Adaptation Gym: A Benchmark for the Bayesian Low-Rank Adaptation of Multi-Modal Language Models 2026-06-20 · Score 7.8 General AI Bayesian Sparse Low-Rank Adaptation for Large Language Model Uncertainty Estimation 2026-07-02 · Score 9.8 General AI

BibTeX

@article{sirsat2026comparative,
  title = {Comparative Analysis of Low-Rank Adaptation in Large Language Models versus Dense Embedding Regression for Headline Click-Through Rate Prediction},
  author = {Samarth Sirsat and Anirudha Shinde and Amit Sethi and Aman Verma},
  year = {2026},
  abstract = {Optimizing digital content headlines for click-through rate (CTR) is an important problem in online media and recommendation systems. While large language models (LLMs) have demonstrated strong generative capabilities, their effectiveness for discriminative ranking tasks, such as selecting the highest-performing headline from a set of candidates, remains less well understood. In this work, we compare a LoRA-fine-tuned causal language model, LOLAQwen (0.6B), with a dense embedding regression mode},
  url = {https://arxiv.org/abs/2608.11912},
  keywords = {cs.CE},
  eprint = {2608.11912},
  archiveprefix = {arXiv},
}

Metadata

{}