Paper Detail

RA-FinBERT: Rule-aware LoRA adaptation for low-resource financial sentiment classification

Fan Zhang, Jiaming Li

Browse

Workflow Queues

arxiv Score 5.2

Published 2026-08-10 · First seen 2026-08-11

General AI

Open paper source

Abstract

Financial sentiment analysis converts unstructured financial news into quantitative signals that can support market analysis and decision-making. Existing work on resource-efficient financial NLP has largely focused on compressing or adapting pretrained language models, with less attention to combining contextual representations with lightweight rule-derived features. This study develops Rule-Aware FinBERT (RA-FinBERT), a parameter-efficient framework that integrates low-rank adaptation (LoRA) with three continuous VADER-derived sentiment proportions (positive, negative, and neutral) and a source-level metadata feature. The standardized four-dimensional feature vector is directly concatenated with the 768-dimensional final-layer FinBERT [CLS] representation and passed through a lightweight classification head. This design introduces only 1,024 additional trainable weights relative to a structurally matched text-only FinBERT model. RA-FinBERT was evaluated against text-only FinBERT and a lightweight DistilBERT baseline for three-class sentiment classification of financial-news titles and descriptions. On the held-out test set, RA-FinBERT achieved 69.89% accuracy and a macro F1 score of 0.634, compared with 63.44% and 0.526 for text-only FinBERT. Neutral-class recall increased from 18.18% to 45.45%. The framework supports both CPU and GPU execution, offering a lightweight and practical approach to financial sentiment classification under constrained computational resources. These findings indicate that rule-derived sentiment information and source metadata can provide complementary signals to contextual FinBERT representations and improve performance with minimal additional model complexity.

Workflow Status

Review status
pending
Role
unreviewed
Read priority
later
Vote
Not set.
Saved
no
Collections
Not filed yet.
Next action
Not filled yet.

Reading Brief

No structured notes yet. Add `summary_sections`, `why_relevant`, `claim_impact`, or `next_action` in `papers.jsonl` to enrich this view.

Why It Surfaced

No ranking explanation is available yet.

Tags

No tags.

Similar Papers

Janus-LoRA: A Balanced Low-Rank Adaptation for Continual Learning 2026-05-27 · Score 21.5 Research Track A · General AI Nonlinearity-Aware LoRA: Structured Gate Adaptation under Low-Rank Constraints 2026-06-30 · Score 3.8 General AI Cross-Modal Bayesian Low-Rank Adaptation for Uncertainty-Aware Multimodal Learning 2026-04-17 · Score 5.3 General AI Low Rank Adaptation for Adversarial Perturbation 2026-04-30 · Score 9.3 General AI TalkLoRA: Communication-Aware Mixture of Low-Rank Adaptation for Large Language Models 2026-04-07 · Score 5.3 General AI

BibTeX

@article{zhang2026ra,
  title = {RA-FinBERT: Rule-aware LoRA adaptation for low-resource financial sentiment classification},
  author = {Fan Zhang and Jiaming Li},
  year = {2026},
  abstract = {Financial sentiment analysis converts unstructured financial news into quantitative signals that can support market analysis and decision-making. Existing work on resource-efficient financial NLP has largely focused on compressing or adapting pretrained language models, with less attention to combining contextual representations with lightweight rule-derived features. This study develops Rule-Aware FinBERT (RA-FinBERT), a parameter-efficient framework that integrates low-rank adaptation (LoRA) w},
  url = {https://arxiv.org/abs/2608.09834},
  keywords = {cs.CL, cs.LG},
  eprint = {2608.09834},
  archiveprefix = {arXiv},
}

Metadata

{}