【】

Apple is dabbling in AI image-editing with an open-source multimodal AI model.
Earlier this week, researchers from Apple and the University of California, Santa Barbara released MLLM-Guided Image Editing, or "MGIE;" a multimodal AI model that can edit images like Photoshop, based on simple text commands.
On the AI development front, Apple has been characteristically cautious about its plans. It was also one of the few companies that didn't announce any big AI plans in the wake of last year's ChatGPT hype. However, Apple reportedly has an in-house version of a ChatGPT-esque chatbot dubbed "Apple GPT" and Tim Cook said Apple will be making some major AI announcements later this year.
SEE ALSO:Tim Cook says big Apple AI announcement is coming later this yearWhether this announcement includes an AI image editing tool remains to be seen, but based on this model, Apple is definitely doing some research and development.
While there are already AI image editing tools out there, "human instructions are sometimes too brief for current methods to capture and follow," said the research paper. This often leads to lackluster or failed results. MGIE is a different approach that uses MLLMs, or multimodal large language models, to understand the text prompts or "expressive instruction," as well as image training data. Effectively, learning from MLLMs helps MGIE understand natural language commands without the need for heavy description.
In examples from the research, MGIE can take an input image of a pepperoni pizza and using the prompt, "make this more healthy" infer that "this" is referring to the pepperoni pizza and "more healthy" can be interpreted as adding vegetables. Thus, the output image is a pepperoni pizza with some green vegetables scattered on top.
Related Stories
- Apple Vision Pro teardown: What's inside the $3,500 headset
- Apple is working on a foldable clamshell iPhone, report says
- Apple Car may be coming much, much later than we hoped
In another example comparing MGIE to other models, the input image is a forested shoreline and a tranquil body of water. With the prompt "add lightning and make the water reflect the lightning," other models omit the lightning reflection, but MGIE successfully captures it.
MGIE is available as an open-source model on GitHub and as a demo version hosted on Hugging Face.
TopicsAppleArtificial Intelligence
相关文章
Katy Perry talks 'Rise,' her next batch of songs, and how to survive Twitter
Katy Perry recently surpassed 90 million followers on Twitter, making her the person with the most f2025-04-04“球王”貝利不幸罹患結直腸癌!癌細胞已擴散,6個月內多次入院治療...(格蕾醫生貝利的結局)
“球王”貝利不幸罹患結直腸癌 !癌細胞已擴散,6個月內多次入院治療...格蕾醫生貝利的結局)_足球 ( 腺瘤,結直腸癌 )www.ty42.com 日期:2022-12-24 00:00:00| 評論2025-04-042億歐年收入!多家媒體證實:C羅團隊已與利雅得勝利達成加盟協議(c羅同意加盟巴黎)
2億歐年收入 !多家媒體證實:C羅團隊已與利雅得勝利達成加盟協議c羅同意加盟巴黎)_世界杯 ( 利雅得,沙特 )www.ty42.com 日期:2022-12-23 00:00:00| 評論(已有352025-04-04西媒曝重磅內幕!C羅加盟曼聯前被推薦至巴薩但被拒絕(c羅加盟巴黎聖日耳曼)
西媒曝重磅內幕 !C羅加盟曼聯前被推薦至巴薩但被拒絕c羅加盟巴黎聖日耳曼)_世界杯 ( 曼聯,巴薩 )www.ty42.com 日期:2022-12-24 00:00:00| 評論(已有357914條2025-04-04WhatsApp announces plans to share user data with Facebook
Big changes are coming to WhatsApp. 。On Thursday, WhatsApp announced in a blog post it will begin sha2025-04-04- 點球戰勝法國 阿根廷36年後再捧大力神杯阿根廷男足冠軍)_世界杯 ( 世界杯,點球 )www.ty42.com 日期:2022-12-21 00:00:00| 評論(已有357761條評論)2025-04-04
最新评论