Image generation

This Markdown file can be "evaluated" with the Raku package "Text::CodeProcessing", [AAp2]. Here is a shell command:

file-code-chunks-eval Image-generation.md 

Remark: For doing image variations using image files see the document Image-variation-and-edition.md (and its woven version, Image-variation-and-edition_woven.md.)

Here we load the Raku package "WWW::OpenAI", [AAp1]:

use WWW::OpenAI;

# (Any)

Images can be generated with the function openai-create-image -- see the section "Images" of [OAI2].

Here is an example that returns "whole images" in Base64 format:

my @imgResB64 = |openai-create-image(
        "raccoon with a sliced onion in the style of Raphael",
        model => 'dall-e-3',
        n => 1,
        size => 'square',
        response-format => 'b64_json',
        format => 'values',
        method => 'tiny');

@imgResB64.map({ '![](data:image/png;base64,' ~ $_ ~ ')' }).join("\n\n")        

Remark: The obtained images are put into the woven document via the output of the code cell, which has the setting results=asis.

The first argument is a prompt used to generate the image(s).

Here are the descriptions of the named arguments (options):

• model takes Whatever, or one of 'dall-e-2' or 'dall-e-3'

• n takes a positive integer, for the number of images to be generated

• size takes the values according to the model value:

  • 'dall-e-2' : '1024x1024', '512x512', '256x256', 'large', 'medium', 'small'

  • 'dall-e-3' : '1024x1024', '1792x1024', '1024x1792', 'square', 'portrait', 'landscape'

• response-format takes the values "url" and "b64_json"

• method takes the values "tiny" and "curl"

Remark: See the model-parameter breakdown in the section below.

Here we generate a few images, get their URLs, and place (embed) the image links using a table:

my @imgRes = |openai-create-image(
        "painting of a racoon and onion in the style of Rene Magritte",
        response-format => 'url',
        n => 2,
        size => 'small',
        format => 'values',
        method => 'tiny');

@imgRes.map({ '![](' ~ $_ ~ ')' }).join("\n\n")       

Parameters

As it was mentioned above, the argument "model" can be Whatever of one of "dall-e-2" or "dall-e-3".

Not all parameters that are valid for one of the models are valid or respected by the other -- see the subsection "Create image" of OpenAI's documentation.

Here is a table that shows a breakdown of the model-parameter relationships:

References

Articles

[AA1] Anton Antonov, "Connecting Mathematica and Raku", (2021), RakuForPrediction at WordPress.

Packages

[AAp1] Anton Antonov, WWW::OpenAI Raku package, (2023), GitHub/antononcube.

[AAp2] Anton Antonov, Text::CodeProcessing, (2021), GitHub/antononcube.

[OAI1] OpenAI Platform, OpenAI platform.

[OAI2] OpenAI Platform, OpenAI documentation.

[OAIp1] OpenAI, OpenAI Python Library, (2020), GitHub/openai.