FreeDrag: Feature Dragging for Reliable Point-based Image Editing

TL;DR

FreeDrag introduces a feature dragging method that enhances the stability and reliability of point-based image editing by addressing tracking issues through adaptive feature updating and constrained search strategies.

Contribution

The paper presents a novel feature dragging approach that reduces tracking errors and improves editing accuracy compared to existing point dragging methods.

Findings

Outperforms previous methods in complex scenarios

Achieves higher stability and efficiency in point tracking

Provides reliable editing results across diverse images

Abstract

To serve the intricate and varied demands of image editing, precise and flexible manipulation in image content is indispensable. Recently, Drag-based editing methods have gained impressive performance. However, these methods predominantly center on point dragging, resulting in two noteworthy drawbacks, namely "miss tracking", where difficulties arise in accurately tracking the predetermined handle points, and "ambiguous tracking", where tracked points are potentially positioned in wrong regions that closely resemble the handle points. To address the above issues, we propose FreeDrag, a feature dragging methodology designed to free the burden on point tracking. The FreeDrag incorporates two key designs, i.e., template feature via adaptive updating and line search with backtracking, the former improves the stability against drastic content change by elaborately controls feature updating scale after each dragging, while the latter alleviates the misguidance from similar points by actively restricting the search area in a line. These two technologies together contribute to a more stable semantic dragging with higher efficiency. Comprehensive experimental results substantiate that our approach significantly outperforms pre-existing methodologies, offering reliable point-based editing even in various complex scenarios.