Multi-Modal DPO
Artificial Intelligence
Direct Preference Optimization: A Complete Guide
import torch
import torch.nn.functional as F
class DPOTrainer:
def __init__(self, model, ref_model, beta=0.1, lr=1e-5):
self.model = model
self.ref_model =...
Recent posts
