Facebook Twitter Instagram
    Trending
    • Suorin Fero Box Pro Pod System Kit Review: Compact Powerhouse Meets Stylish Simplicity
    • VOOPOO VINCI E80 Pod Mod Kit Review: Versatility & Power Meet Intelligent Simplicity
    • Finding Your Perfect Puff: Choosing Vape Kits Based on Your Smoking Style
    • iGaming Marketing Trends for 2025: The Future of Innovation and Engagement
    • What is IT Support and How it Works for your Business
    • Winorama Casino Online Review: A Fresh Spin on Online Gaming
    • “Revealing the Plot” before the World Vape Show in Dubai: Which products are major brands betting on?
    • Understanding of the Android application components
    Facebook YouTube
    Login Register
    IGeeKphone China Phone, Tablet PC, VR, RC Drone News, Reviews
    • HOME
      • NEWS
        • DeepSeek
        • ChatGPT
        • Minecraft
    • Amazon
    • PHONE
      • Top Phones For Your First Choice
      • Phone Comparison
      • Xiaomi
      • Blackview
      • Unihertz
      • Doogee
      • Black Shark
      • Geekbuying
      • Banggood
      • TEMU
      • TikTok
      • Aliexpress
      • Walmart
      • Newegg
      • MercadoLibre
      • Lazada
    • TOP VAPE Awards for 2025
    • VAPES
      • E-CIGAR Upcoming
      • Vape News
      • Vape Market Trend
      • Vape Deals
      • Expo News
      • Vape Comparison
      • Vape Guide
        • Guide For Beginners
        • Guide for Best Users
      • Giveaway
    • BEST VAPE
      • Best Vape Stores
      • Best Starter Vape Kits
      • Best Vapes for Beginners
      • Best Disposable Vapes
      • Best Pod Systems
      • Best Pod Mod Vapes
      • Best Mods
      • Best Nicotine Pouches
      • Best Clearomizers/Tanks
      • Best E-Liquid
      • Best EGO/Pens
      • Best Vapes for Nic Salt E-Juice
      • Best Vapes to Quit Smoking
      • RDA vs. RDTA vs. RTA
    • Best Vape Brand 2025
      • VAPORESSO
      • VOOPOO
      • OXVA
      • NEXA BAR
      • ORIONBARTECH
      • MASKKING VAPE
      • VEIIK
      • MEMERS
      • YOCAN
      • MOREVAPING
      • ELEAF
      • JOYETECH
      • MRFOG
      • TODOO
    • REVIEW
      • E-cigar Review
      • Phones
      • Tablet PC
      • TV Box
      • RC Drone
      • Wearables
      • Camera
      • Accessories
      • VR Headset
    • MORE
      • 3D PRINTER
        • 3D Printer Review
        • Anycubic
        • FLSUN
        • Xtool
        • LONGER
        • Top 3D printer to Choose First
      • TREND
      • CLOTHES
      • AUTO CAR
      • POWER STATION
        • Oukitel
        • FOSSIBOT
      • GAMING
        • Top Gaming Products
      • E-BIKE
        • Samebike
        • Happyrun
        • ENGWE
      • TABLET
        • Chuwi
        • INNOCN
        • Teclast
        • Top Tablet for Your First Choice
        • Tablet/Laptop Comparison
      • WEARABLES
        • OneOdio
        • BlitzWolf
        • Top Smartwatch for First Choice
      • SMART HOME
      • TV BOX
        • Chuwi mini pc
        • Beelink
        • GMKTEC
        • MOREFINE
      • RC DRONE
        • DJI
        • MJX
        • JJRC
        • Hubsan
        • Top RC Drone
      • CAMERA
        • Gopro
        • Insta360
        • Andoer
      • ACCESSORIES
      • VR HEADSET
      • ROM
        • SAMSUNG
        • XIAOMI
        • ASUS
        • MEIZU
        • LENOVO
        • HUAWEI
        • ONEPLUS
        • ZTE
        • UMIDIGI
        • DOOGEE
        • HOMTOM
        • ELEPHONE
        • ULEFONE
        • BLACKVIEW
        • VERNEE
        • LEAGOO
        • CHUWI
        • TECLAST
        • PIPO
        • TV BOX ROM
    • DEAL
    • COUPON
    • Shop
    IGeeKphone China Phone, Tablet PC, VR, RC Drone News, Reviews
    You are at:Home»ChatGPT»Visual ChatGPT: It Absorb All the AI Drawing Skills
    ChatGPT

    Visual ChatGPT: It Absorb All the AI Drawing Skills

    Farrukh AhmadBy Farrukh AhmadMarch 11, 2023
    Facebook Twitter Pinterest LinkedIn Tumblr Email

    ChatGPT Visual version connects ChatGPT and a series of Visual Foundation Models to enable sending and receiving images during chatting. For example,  Ask it: Can you generate a cat slice for me? As we can see, Immediately there are all the text and pictures.

    Besides, it can also adjust the picture according to the new text command: replace the cat with a dog.

    At the same time, I can understand pictures and have the ability to understand. For example, send a picture to it, and then ask what color is the motorcycle? It answers black.

    As mentioned above, it is the visual version of ChatGPT proposed by senior researchers of MSRA. By combining multiple visual models for ChatGPT and utilizing a prompt manager (Prompt Manager), they successfully enabled ChatGPT to handle various visual tasks.

    This work became popular as soon as it was released, and the number of stars on GitHub has exceeded 1.5k. A brief summary is the feeling of merging GPT and Dall-E~

    Knowing words and drawing pictures… Someone said:

    Isn’t this the ultimate meme maker?

    The trick is that the prompt works?

    Visual ChatGPT, in fact, enables ChatGPT to handle multimodal information. But training a multimodal model from scratch is a lot of work. The researchers thought that some visual models could be combined on the basis of ChatGPT.

    To achieve this goal, the key needs an intermediate station. As a result, they proposed the concept of a Prompt Manager.

    It has three main functions:

    First, clearly tell ChatGPT the role of each visual model, and specify the input and output formats.

    Second, convert different visual information, such as converting PNG images, depth images, mask matrices, etc. into language formats, which is convenient for ChatGPT to understand.

    Third, process the historical generation results of the visual model, as well as the call priority of different models, avoid conflicts, etc., so that ChatGPT can receive the generated content of the visual model in an iterative manner until the output is satisfactory to the user.

    In this way, the workflow of Visual ChatGPT looks like this:

    If the user enters a picture, the model will first send the content to the prompt manager, and then convert it into language for ChatGPT to judge. When it finds that the question does not need to call the visual model, it will directly give the output (the first answer).

    For the second question, ChatGPT needs to use a visual model to analyze the content of the question, so the visual model will start to execute, and then iterate until ChatGPT judges that it no longer needs to call the visual model, and then the result will be output.

    According to the paper, Visual ChatGPT contains 22 different visual models. Including Stable Diffusion, BLIP, pix2pix, etc. In order to verify the ability of Visual ChatGPT, they also conducted a large number of zero-shot experiments (zero-shot experiments).

    Results As shown at the beginning, Visual ChatGPT has a strong ability to understand images. The pictures can be continuously generated and modified according to the needs of people.

    Of course, the researchers also mentioned that there are still some limitations in this work. For example, the quality of generated results mainly depends on the performance of the visual model. And the use of a large number of hint projects will affect the speed of generating results to a certain extent.

    And it is also possible to call multiple models simultaneously, which will also affect real-time performance. Finally, in terms of the privacy and security of input images, further upgrade protection is needed.

    MSRA Veteran Goes Out

    The results of this research come from the team of Microsoft Research Asia. The corresponding author is Duan Nan.

    He is the chief researcher of MSRA, the research manager of the Natural Language Computing Group, a part-time doctoral supervisor of the University of Science and Technology of China, a part-time professor of Tianjin University, and an outstanding member of CCF.

    Mainly engaged in research on natural language processing, code intelligence, multimodal intelligence, machine reasoning, etc. He joined MSRA in 2006 and has served for more than 16 years.

    The first author, Chenfei Wu, is also a senior researcher. According to LinkedIn information, he joined Microsoft in 2012 and has worked for 11 years. He is currently a software engineer.

    Read Also: OnePlus Ace 2V Launched With Dimensity 9000, Starts at $330

    Do not forget to follow us on our Facebook group and page to keep you always aware of the latest advances, News, Updates, review, and giveaway on smartphones, tablets, gadgets, and more from the technology world of the future.

    Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

    Related Posts

    Samsung Galaxy F36 mobile phone exposed: Exynos 1380 chip, pre-installed Android 15

    How AI is Changing the Way We Live Our Lives

    Huawei Pura 80 Ultra telephoto unrivaled: Clearly capturing large aircraft

    Leave A Reply Cancel Reply

    You must be logged in to post a comment.

    Top Brand
    Top Brand
    cfb 25 coins
    • Popular
    • 3D Printer REVIEW
    • XIAOMI
    May 25, 2025

    VOOPOO Argus G3 Mini Review: Compact Design Meets Impressive Performance

    April 27, 2025

    SMPO DL02 Review: Compact Disposable for a Perfect RDL (or MTL) Vape (Review & Video)

    April 5, 2025

    ZOOY Blaze 25000 Review: A Customizable Cloud Machine Built for Endurance (Review & Video)

    April 5, 2025

    ANYX Iron: A Premium Pod System with All-Day Performance (Review & Video)

    June 23, 2024

    ACMER P2 20W Laser Engraver Fixed Focus Engraving: Hands on Review

    May 30, 2024

    xTool F1 Ultra Review: World’s First 20W Fiber & 20W Diode Laser Engraver

    May 30, 2024

    Anycubic Kobra 3 Combo Review: The Multicolor Masterpiece?

    May 15, 2024

    SCULPFUN SF-A9 40W Laser Engraver Cutting Machine: Hands On Review

    June 13, 2025

    REDMI K Pad is here with multiple new technologies

    June 13, 2025

    Xiaomi REDMI K80 Ultra Mobile phone and K Pad tablet have been officially announced

    June 11, 2025

    Xiaomi 16 is sure to debut in September: It will be the world’s first to feature Qualcomm Snapdragon 8 Elite 2

    June 10, 2025

    The official promotional materials of Xiaomi Band 10 have been exposed: 1.72-inch screen + 21-day battery life

    New Arrivals
    • Dojo Pixel 25000 Disposable Vape Kit Dojo Pixel 25000 Disposable Vape Kit
    • Dojo Sphere X Disposable Vape Kit Dojo Sphere X Disposable Vape Kit
    • Suorin Fero Box Pro Pod System Kit Suorin Fero Box Pro Pod System Kit
    • VOOPOO VINCI E80 Pod Mod Kit VOOPOO VINCI E80 Pod Mod Kit
    • VOOPOO Vmate Mini Pod System Kit VOOPOO Vmate Mini Pod System Kit
    • Rincoe Neso ET Pod System Kit Rincoe Neso ET Pod System Kit
    • IJOY BAR VENUS 25K DISPOSABLE IJOY BAR VENUS 25K DISPOSABLE
    • Eleaf iVeni Duo Pod System Kit Eleaf iVeni Duo Pod System Kit
    • HORIZONTECH 100K DISPOSABLE HORIZONTECH 100K DISPOSABLE
    About
  • Igeekphone.com provides the first global tech news and reviews about smartphone, vapes, e-cigar, smart home, 3D printers, e-bike,tablets, RC drones, VR headset, and other accessories. It's the best platform to improve your brand and product.
  • Contact us: info@igeekphone.com
  • Check Our Privacy Policy Here.
  • Note: *Right now we have US editor and EU editors for review, especially for Amazon US and EU.
  • *Shop and Compare Price Here*
  • Facebook
  • Youtube
  • OUR BEST VAPE PARTNERS
  • Vape Online Store
  • VAPORESSO
  • VOOPOO
  • OXVA
  • NEXA
  • MASKKING
  • LOSTVAPE ORIONBAR
  • VEIIK
  • MEMERS
  • YOCAN
  • ELEAF
  • JOYETECH
  • TODOO
  • OTHER BEST PARTNERS
  • Chuwi
  • Blackview
  • Fossibot
  • Unihertz
  • Flsun
  • Anycubic
  • Xtool
  • Oukitel
  • Mukkpet Ebike
  • Ugreen
  • Copyright © 2025 igeekphone

    Type above and press Enter to search. Press Esc to cancel.