·
DataBubble
  • Home
  • Models
  • News
  • Compare
  • Boards
  • Pricing
  • About
  • Newsletter
  • Methodology
  • Contact
Latest
Bringing Value Models Back: Generative Critics for Value Modeling in LLM Reinforcement Learning8h◆Subagents vs Agent Skills: Executing Reusable Knowledge for Long-Horizon Agentic Tasks8h◆Distribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts8h◆In RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning8h◆FrontierChallenge: Evaluating Scientific Workflow Completion8h◆IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier8h◆AgenticGen: Reward-Guided Agentic Video Generation for Advertising8h◆Strangers to Themselves: What Language Models Say About Themselves Is Generic8h◆Omni Interaction Agent Technical Report8h◆CoGReV: A Confidence-Gated Post-Hoc Non-Monotonic Belief Revision Framework for Phishing Website Classification8h◆Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerability8h◆Can Foundation Models Moderate Online Content? Evaluating Instruction- vs. Example-Driven Policy Operationalization8h◆RiLM: Parameter-Efficient Language Modeling via Geodesic Decoding8h◆Tracing Computation Density in LLMs8h◆Cultural Binding Heads in Language Models8h◆Direct Diversity Optimization for Diverse Successful Trajectories in Preference Post-Training8h◆Left-Branching Transformers Excel at Right-Branching Languages: Data Shapes Word Order Preferences in Language Models8h◆Palmyra x6 Technical Report: An Agentic, Tool-Use Model Post-Trained via Anchored Supervised Fine-Tuning8h◆'Ghaib in Translation' aka Unseen Harm: Measuring Cross-Script Safety Inconsistency with 'Missed-in-Urdu' Scores in LLM Hate Speech Detection8h◆DexterSQL: Deep Schema Exploration and Rule-based Correction for Text-to-SQL Generation8h◆Bringing Value Models Back: Generative Critics for Value Modeling in LLM Reinforcement Learning8h◆Subagents vs Agent Skills: Executing Reusable Knowledge for Long-Horizon Agentic Tasks8h◆Distribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts8h◆In RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning8h◆FrontierChallenge: Evaluating Scientific Workflow Completion8h◆IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier8h◆AgenticGen: Reward-Guided Agentic Video Generation for Advertising8h◆Strangers to Themselves: What Language Models Say About Themselves Is Generic8h◆Omni Interaction Agent Technical Report8h◆CoGReV: A Confidence-Gated Post-Hoc Non-Monotonic Belief Revision Framework for Phishing Website Classification8h◆Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerability8h◆Can Foundation Models Moderate Online Content? Evaluating Instruction- vs. Example-Driven Policy Operationalization8h◆RiLM: Parameter-Efficient Language Modeling via Geodesic Decoding8h◆Tracing Computation Density in LLMs8h◆Cultural Binding Heads in Language Models8h◆Direct Diversity Optimization for Diverse Successful Trajectories in Preference Post-Training8h◆Left-Branching Transformers Excel at Right-Branching Languages: Data Shapes Word Order Preferences in Language Models8h◆Palmyra x6 Technical Report: An Agentic, Tool-Use Model Post-Trained via Anchored Supervised Fine-Tuning8h◆'Ghaib in Translation' aka Unseen Harm: Measuring Cross-Script Safety Inconsistency with 'Missed-in-Urdu' Scores in LLM Hate Speech Detection8h◆DexterSQL: Deep Schema Exploration and Rule-based Correction for Text-to-SQL Generation8h◆
Tag

#fine-tuning

22 articles tagged #fine-tuning

arxivJul 30bullish

ScaleResfusion: Residual Rectified Flow based on Residual Vector Field

arXiv:2607.25275v1 Announce Type: cross Abstract: Real-world Image Restoration (Real-IR) aims to recover high-quality (HQ) images from complex and unknown degradations. Although recent diffusion-based methods have substantially improved perceptual quality, their current designs leave two key challen

SCRE2 models#image-restoration#diffusion-models#pre-training
HomeModelsNews
Read on arxiv →
arxivJul 21bullish

TRACE: Trajectory-Based Safety Patch Learning for LLM Post-Training Realignment

arXiv:2607.16242v1 Announce Type: cross Abstract: Fine-Tuning-as-a-Service (FTaaS) platforms let users train large language models (LLMs) on customized tasks, but this pipeline could erode models' safety alignment. In practice, service providers need to recover models' safety without re-running full

#safety#fine-tuning#language-modelsRead on arxiv →
arxivJul 18

Inoculation Adapters: Improved Selective Generalization of Capabilities with Fewer Surprising Backdoors

arXiv:2606.30252v2 Announce Type: replace Abstract: Inoculation prompting is a selective-generalization technique used against Emergent Misalignment. We introduce inoculation adapters (IA), a family of methods that similarly reduce the optimization pressure to learn undesired traits by strengthening

#selective-generalization#emergent-misalignment#regularizationRead on arxiv →
arxivJul 16

REDDIT: Correcting Model-Generated Timestamp Drift in ASR without Forgetting via Replay-Based Distribution Editing

arXiv:2607.05364v2 Announce Type: replace-cross Abstract: Modern autoregressive ASR systems can emit timestamps as decoded tokens, enabling timestamped transcription without frame-level aligners or inference-time post-processing. We show that these generated timestamps can drift across long non-spee

OP1 model#asr#timestamping#fine-tuningRead on arxiv →
arxivJul 14bullish

Active Offline-to-Online Reinforcement Learning

arXiv:2607.11720v1 Announce Type: cross Abstract: Background: Offline reinforcement learning (RL) enables effective policies to be trained from large, previously collected datasets and subsequently improved through limited online interaction. This offline-to-online RL (O2O-RL) paradigm is particular

#reinforcement-learning#offline-learning#fine-tuningRead on arxiv →
arxivJun 29

Low-Agreeableness Persona Conditioning for Safe LLM Fine-Tuning

arXiv:2606.27709v1 Announce Type: cross Abstract: Recent work has shown that fine-tuning large language models (LLMs) for social warmth degrades factual reliability and increases sycophancy. We investigate a related but distinct failure mode: warmth fine-tuning also weakens adversarial safety, makin

#safety#fine-tuning#language-modelsRead on arxiv →
arxivJun 27bullish

Semantic Generative Tuning for Unified Multimodal Models

arXiv:2605.18714v2 Announce Type: replace-cross Abstract: Unified multimodal models (UMMs) strive to consolidate visual understanding and visual generation within a single architecture. However, prevailing training paradigms independently optimize understanding via sparse text signals and generation

#multimodal#computer-vision#generative-modelsRead on arxiv →
arxivJun 25bullish

Riazi-8B: An Urdu Large Language Model for Mathematical Reasoning

arXiv:2606.25568v1 Announce Type: new Abstract: Recent LLMs demonstrate strong mathematical reasoning capabilities, but existing gains rely heavily on English-centric training resources and benchmarks. As a result, reasoning performance degrades substantially in low-resource languages such as Urdu,

RI1 model#low-resource-languages#mathematical-reasoning#language-adaptationRead on arxiv →
arxivJun 24bullish

Not All Invariants Are Equal: Curating Training Data to Accelerate Program Verification with SLMs

arXiv:2603.15510v2 Announce Type: replace Abstract: The synthesis of inductive loop invariants remains a critical bottleneck in automated program verification. While Large Language Models (LLMs) show promise in mitigating this issue, they often fail on complex programs, producing invariants that are

QWMEMI5 models · +2#program-verification#large-language-models#fine-tuningRead on arxiv →
arxivJun 18

Trade-offs in Medical LLM Adaptation: An Empirical Study in French QA

arXiv:2606.19266v1 Announce Type: cross Abstract: The development of large language models (LLMs) has led to an increased focus on their adaptation to specialized domains and languages, yet the effectiveness of domain adaptation strategies remains unclear. We present a study of medical domain adapta

#domain-adaptation#language-models#medical-qaRead on arxiv →
arxivJun 10bullish

Two to Tango: Coupled Task-Reference Selection for Safe LLM Fine-tuning

arXiv:2606.09866v1 Announce Type: cross Abstract: Fine-tuning safety aligned large language models (LLMs) on downstream data improves adaptation but may erode learned safety behavior. Existing methods use fixed safety examples, global constraints, or one-sided task filtering. Our diagnostics show ta

LL1 model#safety#fine-tuning#language-modelsRead on arxiv →
arxivJun 4bullish

RL Excursions during Pre-Training: Re-examining Policy Optimization for LLM training

arXiv:2606.04272v1 Announce Type: new Abstract: The standard LLM training pipeline applies reinforcement learning (RL) only after pre-training and supervised fine-tuning (SFT). We question this status quo by training a LLM from scratch and applying RL, SFT, and SFT followed by RL directly to interme

#reinforcement-learning#pre-training#fine-tuningRead on arxiv →
arxivMay 25bullish

AGZO: Activation-Guided Zeroth-Order Optimization for LLM Fine-Tuning

arXiv:2601.17261v4 Announce Type: replace Abstract: Zeroth-Order (ZO) optimization has emerged as a promising solution for fine-tuning LLMs under strict memory constraints, as it avoids the prohibitive memory cost of storing activations for backpropagation. However, existing ZO methods typically emp

QWPA2 models#optimization#llms#fine-tuningRead on arxiv →
arxivMay 22bullish

FlowLM: Few-Step Language Modeling via Diffusion-to-Flow Adaptation

arXiv:2605.20199v1 Announce Type: cross Abstract: We present FlowLM, a flow matching language model transformed from pre-trained diffusion language models via efficient fine-tuning. By re-aligning the curved sampling trajectories of diffusion models into straight-line flows, FlowLM enables high qual

FL1 model#language-models#diffusion#fine-tuningRead on arxiv →
arxivMay 1

Dynamic Adversarial Fine-Tuning Reorganizes Refusal Geometry

arXiv:2604.27019v1 Announce Type: cross Abstract: Safety-aligned language models must refuse harmful requests without collapsing into broad over-refusal, but the training-time mechanisms behind this tradeoff remain unclear. Prior work characterizes refusal directions and jailbreak robustness, yet do

#safety#language-models#adversarial-trainingRead on arxiv →
arxivApr 23bullish

LoRA-FA: Efficient and Effective Low Rank Representation Fine-tuning

arXiv:2308.03303v2 Announce Type: replace Abstract: Fine-tuning large language models (LLMs) is crucial for improving their performance on downstream tasks, but full-parameter fine-tuning (Full-FT) is computationally expensive and memory-intensive. Parameter-efficient fine-tuning (PEFT) methods, suc

LOLO2 models#fine-tuning#language-models#optimizationRead on arxiv →
arxivApr 21

Self-Distillation as a Performance Recovery Mechanism for LLMs: Counteracting Compression and Catastrophic Forgetting

arXiv:2604.15794v1 Announce Type: cross Abstract: Large Language Models (LLMs) have achieved remarkable success, underpinning diverse AI applications. However, they often suffer from performance degradation due to factors such as catastrophic forgetting during Supervised Fine-Tuning (SFT), quantizat

#self-distillation#fine-tuning#large-language-modelsRead on arxiv →
arxivApr 18

GFT: From Imitation to Reward Fine-Tuning with Unbiased Group Advantages and Dynamic Coefficient Rectification

arXiv:2604.14258v1 Announce Type: cross Abstract: Large language models are typically post-trained using supervised fine-tuning (SFT) and reinforcement learning (RL), yet effectively unifying efficient knowledge injection with robust generalization remains challenging. In this work, we provide a tra

#language-models#fine-tuning#reinforcement-learningRead on arxiv →
arxivApr 17bullish

Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public Opinions

arXiv:2502.16761v2 Announce Type: replace Abstract: Large language models (LLMs) present novel opportunities in public opinion research by predicting survey responses in advance during the early stages of survey design. Prior methods steer LLMs via descriptions of subpopulations as LLMs' input promp

#survey-research#language-models#fine-tuningRead on arxiv →
arxivApr 13

Demystifying Mergeability: Interpretable Properties to Predict Model Merging Success

arXiv:2601.22285v4 Announce Type: replace Abstract: Model merging combines knowledge from separately fine-tuned models, yet success factors remain poorly understood. While recent work treats mergeability as an intrinsic property, we show with an architecture-agnostic framework that it fundamentally

#machine-learning#model-merging#fine-tuningRead on arxiv →
arxivApr 9bullish

Visual prompting reimagined: The power of the Activation Prompts

arXiv:2604.06440v1 Announce Type: cross Abstract: Visual prompting (VP) has emerged as a popular method to repurpose pretrained vision models for adaptation to downstream tasks. Unlike conventional model fine-tuning techniques, VP introduces a universal perturbation directly into the input data to f

#computer-vision#fine-tuning#machine-learningRead on arxiv →
arxivApr 1

The Last Fingerprint: How Markdown Training Shapes LLM Prose

arXiv:2603.27006v1 Announce Type: cross Abstract: Large language models produce em dashes at varying rates, and the observation that some models "overuse" them has become one of the most widely discussed markers of AI-generated text. Yet no mechanistic account of this pattern exists, and the paralle

MEOP2 models#language models#training data#fine-tuningRead on arxiv →