Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: \n\n@librarian-bot\n\t recommend

\n","updatedAt":"2024-03-29T01:22:17.179Z","author":{"_id":"63d3e0e8ff1384ce6c5dd17d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg","fullname":"Librarian Bot (Bot)","name":"librarian-bot","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":264}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.760755181312561},"editors":["librarian-bot"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg"],"reactions":[],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2403.18605","authors":[{"_id":"6604e02369c47cd78fde0c3a","user":{"_id":"640052b2f4ff62c2616af567","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/640052b2f4ff62c2616af567/PmMNDQtSgdJ_74IFoYdpp.jpeg","isPro":false,"fullname":"NGUYEN TRONG TUNG","user":"Tung11","type":"user"},"name":"Trong-Tung Nguyen","status":"claimed_verified","statusLastChangedAt":"2024-03-28T16:39:43.587Z","hidden":false},{"_id":"6604e02369c47cd78fde0c3b","name":"Duc-Anh Nguyen","hidden":false},{"_id":"6604e02369c47cd78fde0c3c","user":{"_id":"63e9fc6174f940d171e4c5e9","avatarUrl":"/avatars/0c34fdaecd7bd8aaffb3d68e83c0eeaf.svg","isPro":false,"fullname":"Anh Tran","user":"anhttran1111","type":"user"},"name":"Anh Tran","status":"claimed_verified","statusLastChangedAt":"2024-12-05T09:30:06.052Z","hidden":false},{"_id":"6604e02369c47cd78fde0c3d","name":"Cuong Pham","hidden":false}],"publishedAt":"2024-03-27T14:24:30.000Z","submittedOnDailyAt":"2024-03-28T01:42:40.740Z","title":"FlexEdit: Flexible and Controllable Diffusion-based Object-centric Image\n Editing","submittedOnDailyBy":{"_id":"60f1abe7544c2adfd699860c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674929746905-60f1abe7544c2adfd699860c.jpeg","isPro":false,"fullname":"AK","user":"akhaliq","type":"user"},"summary":"Our work addresses limitations seen in previous approaches for object-centric\nediting problems, such as unrealistic results due to shape discrepancies and\nlimited control in object replacement or insertion. To this end, we introduce\nFlexEdit, a flexible and controllable editing framework for objects where we\niteratively adjust latents at each denoising step using our FlexEdit block.\nInitially, we optimize latents at test time to align with specified object\nconstraints. Then, our framework employs an adaptive mask, automatically\nextracted during denoising, to protect the background while seamlessly blending\nnew content into the target image. We demonstrate the versatility of FlexEdit\nin various object editing tasks and curate an evaluation test suite with\nsamples from both real and synthetic images, along with novel evaluation\nmetrics designed for object-centric editing. We conduct extensive experiments\non different editing scenarios, demonstrating the superiority of our editing\nframework over recent advanced text-guided image editing methods. Our project\npage is published at https://flex-edit.github.io/.","upvotes":11,"discussionId":"6604e02869c47cd78fde0d0a","ai_summary":"FlexEdit is a flexible and controllable object-centric editing framework that uses iterative latent adjustment and adaptive masking to improve realism and control in object replacement and insertion.","ai_keywords":["FlexEdit","object-centric editing","latents","denoising steps","adaptive mask","text-guided image editing"]},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"620783f24e28382272337ba4","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/620783f24e28382272337ba4/zkUveQPNiDfYjgGhuFErj.jpeg","isPro":false,"fullname":"GuoLiangTang","user":"Tommy930","type":"user"},{"_id":"6538119803519fddb4a17e10","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6538119803519fddb4a17e10/ffJMkdx-rM7VvLTCM6ri_.jpeg","isPro":false,"fullname":"samusenps","user":"samusenps","type":"user"},{"_id":"655ac762cb17ec19ef82719b","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/655ac762cb17ec19ef82719b/1kDncYrGLYS_2SR8cNdAL.png","isPro":false,"fullname":"Welcome to matlok","user":"matlok","type":"user"},{"_id":"643b19f8a856622f978df30f","avatarUrl":"/avatars/c82779fdf94f80cdb5020504f83c818b.svg","isPro":false,"fullname":"Yatharth Sharma","user":"YaTharThShaRma999","type":"user"},{"_id":"63855d851769b7c4b10e1f76","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63855d851769b7c4b10e1f76/WnYyg4YivoUmK4QNic0QX.png","isPro":false,"fullname":"Aleks Kamko","user":"aykamko","type":"user"},{"_id":"66898509377ee64785add814","avatarUrl":"/avatars/b7d9563c0dada2ffb3d1cc300753e004.svg","isPro":false,"fullname":"John Leon","user":"1john","type":"user"},{"_id":"641b754d1911d3be6745cce9","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/641b754d1911d3be6745cce9/DxjZG1XT4H3ZHF7qHxWxk.jpeg","isPro":true,"fullname":"atayloraerospace","user":"Taylor658","type":"user"},{"_id":"63e9fc6174f940d171e4c5e9","avatarUrl":"/avatars/0c34fdaecd7bd8aaffb3d68e83c0eeaf.svg","isPro":false,"fullname":"Anh Tran","user":"anhttran1111","type":"user"},{"_id":"640052b2f4ff62c2616af567","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/640052b2f4ff62c2616af567/PmMNDQtSgdJ_74IFoYdpp.jpeg","isPro":false,"fullname":"NGUYEN TRONG TUNG","user":"Tung11","type":"user"},{"_id":"663ccbff3a74a20189d4aa2e","avatarUrl":"/avatars/83a54455e0157480f65c498cd9057cf2.svg","isPro":false,"fullname":"Nguyen Van Thanh","user":"NguyenVanThanhHust","type":"user"},{"_id":"679902c159cc4767b602421d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/679902c159cc4767b602421d/0bRndyA6kmPE4uYdDu_Ul.jpeg","isPro":false,"fullname":"HJU","user":"ZhyYuuu","type":"user"}],"acceptLanguages":["*"],"dailyPaperRank":0}">

Papers

arxiv:2403.18605

FlexEdit: Flexible and Controllable Diffusion-based Object-centric Image Editing

Published on Mar 27, 2024

· Submitted by

AK on Mar 28, 2024

Upvote

Authors:

Trong-Tung Nguyen ,

Anh Tran ,

Abstract

FlexEdit is a flexible and controllable object-centric editing framework that uses iterative latent adjustment and adaptive masking to improve realism and control in object replacement and insertion.

AI-generated summary

Our work addresses limitations seen in previous approaches for object-centric editing problems, such as unrealistic results due to shape discrepancies and limited control in object replacement or insertion. To this end, we introduce FlexEdit, a flexible and controllable editing framework for objects where we iteratively adjust latents at each denoising step using our FlexEdit block. Initially, we optimize latents at test time to align with specified object constraints. Then, our framework employs an adaptive mask, automatically extracted during denoising, to protect the background while seamlessly blending new content into the target image. We demonstrate the versatility of FlexEdit in various object editing tasks and curate an evaluation test suite with samples from both real and synthetic images, along with novel evaluation metrics designed for object-centric editing. We conduct extensive experiments on different editing scenarios, demonstrating the superiority of our editing framework over recent advanced text-guided image editing methods. Our project page is published at https://flex-edit.github.io/.