الثلاثاء، 23 مايو 2023

All I learned was testing Photoshop’s new generative AI tool


Adobe is building generative AI capabilities into its flagship image-editing software with a new beta version of Photoshop on Tuesday. The move promises to unleash a new torrent of creativity even as it gives us all a new reason to stop and wonder if that sexy, scary, or inspiring photo you’re seeing online is actually real.

In my tests, detailed below, I found the tool impressive but imperfect. Adding it directly into Photoshop is important, as it allows creators to experiment within a software tool they’re likely to already use without making excursions MedjourneyAnd Stability Stable deployment of artificial intelligence or other external generative AI tools.

With the arrival of Adobe Firefly’s family of generative AI technologies in Photoshop, you’ll be able to let the AI ​​fill in a selected portion of an image with whatever it sees fit—for example, replacing road cracks with smooth pavement. You can also mark the images you want with a text prompt, such as adding a double yellow line to the road.

Firefly in Photoshop can also expand an image, adding a new scene outside the frame based on what’s already in the frame or what you suggest with text. Want more sky and mountains in your landscape photo? Bigger crowd at a rock concert? Photoshop will oblige, without today’s difficulties finding and splitting the source material.

Photoshop’s Firefly, which is scheduled to come out of beta testing in the second half of 2023, could be powerful. In a live demo from Adobe, the tool was often able to match image tones, blend into AI-generated images seamlessly, infer geometric details of perspective even in reflections and extrapolate the sun’s position from shadows and sky haze.

These technologies have appeared over the past year eg stable spreadAnd Medjourney Dall-E was acquired by OpenAI The imagination of professional artists and creators. Now it’s integrated directly into the software they’re most likely already using, simplifying what can be a cumbersome editing process.

“It really puts the power and control of AI in the hands of the creator,” said Maria Yap, vice president of digital imaging at Adobe. “You can really have some fun. You can explore some ideas. You can think. You can create without having to get into the deep tools of the product too quickly.”

Now you better prepare for that future.

Firefly AI in Photoshop is imperfect, but useful

In my testing, I’ve repeatedly encountered issues, many of which are likely caused by the limited range of training images. When I tried to insert a fish on a bike into a photo, Firefly just added the bike. I couldn’t get Firefly to add kraken out of San Francisco Bay. The musk ox looked like a panda-moose hybrid.

Less fanciful materials also present problems. The script sounds like an alien sex scenario. Shadows, lighting, perspective, and geometry weren’t always right.

People are tough too. Upon closer examination, their faces were distorted in strange ways. People added to shots can be placed too high in the frame or blend in unconvincingly.

With that said, Firefly is great for what it can accomplish, particularly with landscape shots. I can add mountains, oceans, sky and hills to the landscape. A white delivery truck in a night scene was appropriately yellowish to match the sodium vapor street lights in the scene. If you don’t like the trio results offered by Firefly, you can click the “Create” button to get another batch.

Given the pace of AI developments, I expect Firefly to improve in Photoshop.

It is difficult and expensive to retrain large AI models, requiring a data center full of expensive hardware to transfer data, sometimes taking weeks for the largest models. But Adobe plans to make relatively frequent updates for Firefly. “Expect [about] Monthly updates for general improvements And retraining probably every few months,” Scott Belsky, Adobe’s chief product officer, tweeted on Tuesday.

Image processing automation

For years, “Photoshop” didn’t just refer to Adobe software. It is also used as a verb to refer to photo manipulation such as slimming models’ waists or Hide missile launch failures. Not only do AI tools automate fun and flights of fancy, but work Fake pictures like an alleged explosion at the Pentagon Or a convincingly real photo of Pope in a puffy jacketto choose two recent examples.

With artificial intelligence, expect editing techniques to be much more accurate than easily recognizable additional smoke Digitally added to the pictures of the Israeli attack on Lebanon in 2006.

It is a reflection of the double-edged sword that is generative artificial intelligence. There is no denying that technology is useful in many situations but it also blurs the line between what is real and what is merely plausible.

For its part, Adobe is trying to minimize the problems. It doesn’t allow prompts to create images of many political figures and prevents you from having “safety issues” if you try to create an image of black smoke in front of the White House. And her Guidelines for the use of artificial intelligence Ban images that contain violence, pornography, or content that is “misleading, fraudulent, or deceptive and may lead to real-world harm,” among other categories. We disable accounts that engage in deceptive or malicious behavior.

Firefly is also designed to bypass design claims like the one that prompted serious complaints from artists unhappy at seeing their genre of art reproduced by the datacenter. It supports files Content Originality InitiativeContent credential technology that can be used to label an image as AI-generated.

Image-generative artificial intelligence

The Adobe Firefly family of generative AI tools It started with a website that converts a text message like “Modern chair made from old tiresIn Image. Two more options have since been added, and Creative Cloud subscribers will also be able to try out a lightweight version of the Photoshop interface on the Firefly website.

When OpenAI’s Dall-E brought this technology to anyone who signed up for it in 2022, it helped propel generative AI from a technological curiosity into mainstream consciousness. Now there is a lot of anxiety in addition to excitement The creators of artificial intelligence are concerned about what the technology is Will bring now and in the distant future.

Generative AI is a relatively new form of AI technology. AI models can be trained to recognize patterns in massive amounts of data — in this case labeled images from Adobe stock artwork and other licensed sources — and then create new images based on the source data.

Generative AI leapt to mainstream awareness of language models used in tools such as OpenAI’s ChatGPT, Gmail, Google Docs, and Microsoft’s Bing search engine. When it comes to creating images, Adobe uses a The AI ​​image generation technology is called diffusion This is also behind Dall-E, Stable Diffusion, Midjourney, and Google Images.

Adobe calls Firefly for Photoshop a “co-pilot” technology, making it a creative aid rather than a replacement for humans. Yap acknowledges that some creators worry about being replaced by AI. Adobe prefers to see it as a technology that can amplify and accelerate the creative process, spreading creative tools to a larger population.

“I think the democratization we’re going through, and having more creativity, is a positive thing for all of us,” Yap said. “This is the future of Photoshop.”

Editors’ note: CNET uses an artificial intelligence engine to create some personal finance explanations that are edited and verified by our editors. For more see This post.



Source link

ليست هناك تعليقات:

إرسال تعليق

AI Deepfake Ads: Tom Hanks, Gayle King Sound Warning

Tom Hanks is pretty recognizable, whether he’s holding a box of chocolates in Forrest Gump or wearing a space suit in Apollo 13. But should...