TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/FireFlow: Fast Inversion of Rectified Flow for Image Seman...

FireFlow: Fast Inversion of Rectified Flow for Image Semantic Editing

Yingying Deng, Xiangyu He, Changwang Mei, Peisong Wang, Fan Tang

2024-12-10Text-based Image Editing
PaperPDFCode(official)

Abstract

Though Rectified Flows (ReFlows) with distillation offers a promising way for fast sampling, its fast inversion transforms images back to structured noise for recovery and following editing remains unsolved. This paper introduces FireFlow, a simple yet effective zero-shot approach that inherits the startling capacity of ReFlow-based models (such as FLUX) in generation while extending its capabilities to accurate inversion and editing in $8$ steps. We first demonstrate that a carefully designed numerical solver is pivotal for ReFlow inversion, enabling accurate inversion and reconstruction with the precision of a second-order solver while maintaining the practical efficiency of a first-order Euler method. This solver achieves a $3\times$ runtime speedup compared to state-of-the-art ReFlow inversion and editing techniques, while delivering smaller reconstruction errors and superior editing results in a training-free mode. The code is available at $\href{https://github.com/HolmesShuan/FireFlow}{this URL}$.

Results

TaskDatasetMetricValueModel
Image GenerationPIE-BenchBackground LPIPS123.6FireFlow
Image GenerationPIE-BenchBackground PSNR23.03FireFlow
Image GenerationPIE-BenchCLIPSIM26.02FireFlow
Image GenerationPIE-BenchStructure Distance27.1FireFlow
Image GenerationPIE-BenchBackground LPIPS239.4FireFlow (Add Q)
Image GenerationPIE-BenchBackground PSNR16.49FireFlow (Add Q)
Image GenerationPIE-BenchCLIPSIM27.33FireFlow (Add Q)
Image GenerationPIE-BenchStructure Distance70.9FireFlow (Add Q)
Text-to-Image GenerationPIE-BenchBackground LPIPS123.6FireFlow
Text-to-Image GenerationPIE-BenchBackground PSNR23.03FireFlow
Text-to-Image GenerationPIE-BenchCLIPSIM26.02FireFlow
Text-to-Image GenerationPIE-BenchStructure Distance27.1FireFlow
Text-to-Image GenerationPIE-BenchBackground LPIPS239.4FireFlow (Add Q)
Text-to-Image GenerationPIE-BenchBackground PSNR16.49FireFlow (Add Q)
Text-to-Image GenerationPIE-BenchCLIPSIM27.33FireFlow (Add Q)
Text-to-Image GenerationPIE-BenchStructure Distance70.9FireFlow (Add Q)
10-shot image generationPIE-BenchBackground LPIPS123.6FireFlow
10-shot image generationPIE-BenchBackground PSNR23.03FireFlow
10-shot image generationPIE-BenchCLIPSIM26.02FireFlow
10-shot image generationPIE-BenchStructure Distance27.1FireFlow
10-shot image generationPIE-BenchBackground LPIPS239.4FireFlow (Add Q)
10-shot image generationPIE-BenchBackground PSNR16.49FireFlow (Add Q)
10-shot image generationPIE-BenchCLIPSIM27.33FireFlow (Add Q)
10-shot image generationPIE-BenchStructure Distance70.9FireFlow (Add Q)
1 Image, 2*2 StitchiPIE-BenchBackground LPIPS123.6FireFlow
1 Image, 2*2 StitchiPIE-BenchBackground PSNR23.03FireFlow
1 Image, 2*2 StitchiPIE-BenchCLIPSIM26.02FireFlow
1 Image, 2*2 StitchiPIE-BenchStructure Distance27.1FireFlow
1 Image, 2*2 StitchiPIE-BenchBackground LPIPS239.4FireFlow (Add Q)
1 Image, 2*2 StitchiPIE-BenchBackground PSNR16.49FireFlow (Add Q)
1 Image, 2*2 StitchiPIE-BenchCLIPSIM27.33FireFlow (Add Q)
1 Image, 2*2 StitchiPIE-BenchStructure Distance70.9FireFlow (Add Q)

Related Papers

NoHumansRequired: Autonomous High-Quality Image Editing Triplet Mining2025-07-18Cora: Correspondence-aware image editing using few step diffusion2025-05-29POEM: Precise Object-level Editing via MLLM control2025-04-10ILLUME+: Illuminating Unified MLLM with Dual Visual Tokenization and Diffusion Refinement2025-04-02KV-Edit: Training-Free Image Editing for Precise Background Preservation2025-02-24PartEdit: Fine-Grained Image Editing using Pre-Trained Diffusion Models2025-02-06FeedEdit: Text-Based Image Editing with Dynamic Feedback Regulation2025-01-01Action-based image editing guided by human instructions2024-12-05