Beyond the Brush: Fully-automated Crafting of Realistic Inpainted Images

Abstract

The generation of partially manipulated images is rapidly becoming a significant threat to the public’s trust in online content. The proliferation of diffusion model-based tools that enable easy inpainting operations has significantly lowered the barrier to accessing these techniques. In this context, the multimedia forensics community finds itself at a disadvantage compared to attackers, as developing new localization techniques often requires the creation of large datasets, a resource-intensive process due to the necessary human effort. In this paper, we introduce BtB, a technique that automates the generation of large datasets containing convincing inpainted images. Moreover, we provide a collection of 22,167 high-quality inpainted pictures obtained by manipulating images from state-of-the-art datasets. In addition to the generation pipeline, which can be executed without any human intervention, we also present an evaluation of the quality of produced images from both quantitative and qualitative perspectives. Our results demonstrate that our technique yields higher quality images compared to simpler automated generation mechanisms.

BibTeX

@inproceedings{bertazziniWIFS2024,
  title={Beyond the Brush: Fully-automated Crafting of Realistic Inpainted Images},
  author={Bertazzini, Giulia and Albisani, Chiara and Baracchi, Daniele and Shullani, Dasara and Piva, Alessandro},
  booktitle={2024 IEEE International Workshop on Information Forensics and Security (WIFS)},
  pages={},
  year={2024},
  organization={IEEE},
  doi={}
}

Acknowledgments

This work was supported in part by the Italian Ministry of Universities and Research (MUR) under Grant 2017Z595XS, and in part by the Defense Advanced Research Projects Agency (DARPA) under Agreement No. HR00112090136.