Pull Imagen feature

[junyanxu]

I messed up the old branch after doing a merge. Create this new branch for us to keep reviewing.

I have resolved all comments except one from @hsubox76

The ...request will cause testing error like this, because original request has more parameters than parameters could accept. And in new predict api the parameters are not typed.

      AssertionError: expected { model: 'test_model', …(2) } to deeply equal { …(3) }
      + expected - actual

         "parameters": {
           "aspectRatio": "1:1"
           "compressionQuality": 12
           "guidanceScale": 5
      -    "height": 1024
           "language": "ko"
           "negativePrompt": "Not a dog"
      -    "numberOfImages": 1
           "outputMimeType": "image/png"
      -    "prompt": "Create a cat"
           "safetyFilterLevel": "block_medium_and_above"
           "sampleCount": 1
           "sampleImageSize": 1024
      -    "width": 512
         }
       }
      

Related to #276

[hsubox76]

Check this file for comments telling you what's still missing in the exported types.

[junyanxu]

Thanks for pointing out. I removed the field from GeneratedImage.

[jony89]

btw while this works for me :

    const genAI = new GoogleGenerativeAI("AIza****2bE");
    const model = genAI.getGenerativeModel({
        model: "gemini-1.5-flash"
    });
    const result = await model.generateContent("what is a cat");

While using this branch and following the sample:

    const genAI = new GoogleGenerativeAI("AIza****2bE");
    const model = genAI.getImageGenerationModel({
        model: "imagen-3.0-generate-001",
    });

    const result = await model.generateImages(prompt);

I am getting :

Error fetching from https://generativelanguage.googleapis.com/v1beta/models/imagen-3.0-generate-001:predict: [404 Not Found] models/imagen-3.0-generate-001 is not found for API version v1beta, or is not supported for predict. Call ListModels to see the list of available models and their supported methods.

And with:

    const genAI = new GoogleGenerativeAI("AIza****2bE");
    const model = genAI.getImageGenerationModel({
        model: "imagen-3.0-generate-001",
    }, { apiVersion: "v1" });

    const result = await model.generateImages(prompt);

I just get 404. any idea @junyanxu ?

[junyanxu]

@jony89 Are you in the tester list? Your project need to be in trusted project list. Otherwise the you cannot use the API. Target GA date should be in mid Nov. After that this branch will be merged.

[jony89]

Yes @junyanxu I do have access. I also was able to use OAuth to access that API and generate images. but with the code here I got that error.