Sign in Subscribe

PyTorch

AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts - Summary

The paper introduces AUTOPROMPT, an automated method to create prompts for a diverse set of tasks based on a gradient-guided search. The prompts elicit more accurate factual knowledge from masked language models (MLMs) than manually created prompts on the LAMA benchmark. MLMs can perform sentiment

Expressive Text-to-Image Generation with Rich Text - Summary

The paper proposes a method for text-to-image generation using rich text prompts that support various text attributes such as font family, size, color, and footnote. The method enables precise control of text-to-image synthesis regarding colors, styles, and object details compared to plain text. Th

LoRA: Low-Rank Adaptation of Large Language Models - Summary

The paper proposes Low-Rank Adaptation (LoRA) as an approach to reduce the number of trainable parameters for downstream tasks in natural language processing. LoRA injects trainable rank decomposition matrices into each layer of the Transformer architecture, greatly reducing the number of trainable