Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ImagenHub Integration #4

Closed
vinesmsuic opened this issue Jul 11, 2024 · 3 comments
Closed

ImagenHub Integration #4

vinesmsuic opened this issue Jul 11, 2024 · 3 comments

Comments

@vinesmsuic
Copy link

vinesmsuic commented Jul 11, 2024

Very cool work!

We added the implementation of UltraEdit on ImagenHub (ICLR 2024). Feel free to checkout the results on our ImagenHub benchmark and verify the code implementation :)

Best,
Max

@chenllliang
Copy link
Contributor

It seems awesome!

@HaozheZhao
Copy link
Owner

Hi Max,

Thanks for your message and the opportunity to work on ImagenHub!

We noticed a minor issue with the model inference for the free-form image editing setting in the ImageHub. After training with the region-based image editing data, the model has become quite sensitive to the mask input. Hence, when using the model for free-form image editing, we recommend setting a higher SFG scale, such as 10.5 or above, for better results when providing the model with a blank mask.

Alternatively, you can use this model that has been trained specifically with only free-form image editing dataset which does not support the mask input. During the inference of this model, you can just set the mask_img to be None.

@vinesmsuic
Copy link
Author

Now its changed to the free-form model!
TIGER-AI-Lab/ImagenHub#33

We also re-run the experiment on Visualization: https://chromaica.github.io/Museum/ImagenHub_Text-Guided_IE/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants