Skip to content

Ces evaluation golden#17289

Draft
zli82016 wants to merge 18 commits intoGoogleCloudPlatform:mainfrom
zli82016:ces-evaluation-golden
Draft

Ces evaluation golden#17289
zli82016 wants to merge 18 commits intoGoogleCloudPlatform:mainfrom
zli82016:ces-evaluation-golden

Conversation

@zli82016
Copy link
Copy Markdown
Member

Release Note Template for Downstream PRs (will be copied)

See Write release notes for guidance.

`google_ces_evaluation`

@modular-magician
Copy link
Copy Markdown
Collaborator

Hi there, I'm the Modular magician. I've detected the following information about your changes:

Diff report

Your PR generated some diffs in downstreams - here they are.

google provider: Diff ( 4 files changed, 4749 insertions(+))
google-beta provider: Diff ( 15 files changed, 4761 insertions(+), 12 deletions(-))
terraform-google-conversion: Diff ( 9 files changed, 1623 insertions(+), 16 deletions(-))
Open in Cloud Shell: Diff ( 8 files changed, 313 insertions(+))

Missing test report

Your PR includes resource fields which are not covered by any test.

Resource: google_ces_evaluation (2 total tests)
Please add an acceptance test which includes these fields. The test should include the following:

resource "google_ces_evaluation" "primary" {
  description = # value needed
  golden {
    evaluation_expectations = # value needed
    turns {
      steps {
        agent_transfer {
          target_agent = # value needed
        }
        expectation {
          agent_response {
            chunks {
              agent_transfer {
                target_agent = # value needed
              }
              blob {
                data      = # value needed
                mime_type = # value needed
              }
              default_variables = # value needed
              image {
                data      = # value needed
                mime_type = # value needed
              }
              payload = # value needed
              text    = # value needed
              tool_call {
                args = # value needed
                id   = # value needed
                tool = # value needed
                toolset_tool {
                  tool_id = # value needed
                  toolset = # value needed
                }
              }
              tool_response {
                id       = # value needed
                response = # value needed
                tool     = # value needed
                toolset_tool {
                  tool_id = # value needed
                  toolset = # value needed
                }
              }
              transcript        = # value needed
              updated_variables = # value needed
            }
            event_time = # value needed
          }
          agent_transfer {
            display_name = # value needed
            target_agent = # value needed
          }
          mock_tool_response {
            id       = # value needed
            response = # value needed
            tool     = # value needed
            toolset_tool {
              tool_id = # value needed
              toolset = # value needed
            }
          }
          tool_response {
            id       = # value needed
            response = # value needed
            tool     = # value needed
            toolset_tool {
              tool_id = # value needed
              toolset = # value needed
            }
          }
          updated_variables {
            notes = # value needed
          }
        }
        user_input {
          audio = # value needed
          blob {
            data      = # value needed
            mime_type = # value needed
          }
          image {
            data      = # value needed
            mime_type = # value needed
          }
          tool_responses {
            id       = # value needed
            response = # value needed
            tool     = # value needed
            toolset_tool {
              tool_id = # value needed
              toolset = # value needed
            }
          }
        }
      }
    }
  }
  tags = # value needed
}

@modular-magician
Copy link
Copy Markdown
Collaborator

Hi there, I'm the Modular magician. I've detected the following information about your changes:

Diff report

Your PR generated some diffs in downstreams - here they are.

google provider: Diff ( 4 files changed, 4747 insertions(+))
google-beta provider: Diff ( 15 files changed, 4759 insertions(+), 12 deletions(-))
terraform-google-conversion: Diff ( 9 files changed, 1634 insertions(+), 16 deletions(-))
Open in Cloud Shell: Diff ( 8 files changed, 313 insertions(+))

Missing test report

Your PR includes resource fields which are not covered by any test.

Resource: google_ces_evaluation (2 total tests)
Please add an acceptance test which includes these fields. The test should include the following:

resource "google_ces_evaluation" "primary" {
  description = # value needed
  golden {
    evaluation_expectations = # value needed
    turns {
      steps {
        agent_transfer {
          target_agent = # value needed
        }
        expectation {
          agent_response {
            chunks {
              agent_transfer {
                target_agent = # value needed
              }
              blob {
                data      = # value needed
                mime_type = # value needed
              }
              default_variables = # value needed
              image {
                data      = # value needed
                mime_type = # value needed
              }
              text = # value needed
              tool_call {
                args = # value needed
                id   = # value needed
                tool = # value needed
                toolset_tool {
                  tool_id = # value needed
                  toolset = # value needed
                }
              }
              tool_response {
                id       = # value needed
                response = # value needed
                tool     = # value needed
                toolset_tool {
                  tool_id = # value needed
                  toolset = # value needed
                }
              }
              transcript        = # value needed
              updated_variables = # value needed
            }
            event_time = # value needed
          }
          agent_transfer {
            display_name = # value needed
            target_agent = # value needed
          }
          mock_tool_response {
            id       = # value needed
            response = # value needed
            tool     = # value needed
            toolset_tool {
              tool_id = # value needed
              toolset = # value needed
            }
          }
          tool_response {
            id       = # value needed
            response = # value needed
            tool     = # value needed
            toolset_tool {
              tool_id = # value needed
              toolset = # value needed
            }
          }
          updated_variables {
            notes = # value needed
          }
        }
        user_input {
          audio = # value needed
          blob {
            data      = # value needed
            mime_type = # value needed
          }
          image {
            data      = # value needed
            mime_type = # value needed
          }
          tool_responses {
            id       = # value needed
            response = # value needed
            tool     = # value needed
            toolset_tool {
              tool_id = # value needed
              toolset = # value needed
            }
          }
        }
      }
    }
  }
  tags = # value needed
}

@zli82016 zli82016 force-pushed the ces-evaluation-golden branch from 31ffeaa to 9016c13 Compare April 24, 2026 19:06
@modular-magician
Copy link
Copy Markdown
Collaborator

Hi there, I'm the Modular magician. I've detected the following information about your changes:

Diff report

Your PR generated some diffs in downstreams - here they are.

google provider: Diff ( 4 files changed, 5061 insertions(+))
google-beta provider: Diff ( 15 files changed, 5073 insertions(+), 12 deletions(-))
terraform-google-conversion: Diff ( 9 files changed, 1670 insertions(+), 16 deletions(-))
Open in Cloud Shell: Diff ( 8 files changed, 399 insertions(+))

Missing test report

Your PR includes resource fields which are not covered by any test.

Resource: google_ces_evaluation (2 total tests)
Please add an acceptance test which includes these fields. The test should include the following:

resource "google_ces_evaluation" "primary" {
  golden {
    turns {
      steps {
        agent_transfer {
          target_agent = # value needed
        }
        expectation {
          agent_response {
            chunks {
              agent_transfer {
                target_agent = # value needed
              }
              default_variables = # value needed
              tool_call {
                toolset_tool {
                  tool_id = # value needed
                  toolset = # value needed
                }
              }
              tool_response {
                id       = # value needed
                response = # value needed
                tool     = # value needed
                toolset_tool {
                  tool_id = # value needed
                  toolset = # value needed
                }
              }
              transcript        = # value needed
              updated_variables = # value needed
            }
            event_time = # value needed
          }
          agent_transfer {
            display_name = # value needed
            target_agent = # value needed
          }
          mock_tool_response {
            id       = # value needed
            response = # value needed
            tool     = # value needed
            toolset_tool {
              tool_id = # value needed
              toolset = # value needed
            }
          }
          tool_response {
            toolset_tool {
              tool_id = # value needed
              toolset = # value needed
            }
          }
          updated_variables {
            notes = # value needed
          }
        }
        user_input {
          tool_responses {
            tool_responses {
              toolset_tool {
                tool_id = # value needed
                toolset = # value needed
              }
            }
          }
        }
      }
    }
  }
}

@modular-magician
Copy link
Copy Markdown
Collaborator

Hi there, I'm the Modular magician. I've detected the following information about your changes:

Diff report

Your PR generated some diffs in downstreams - here they are.

google provider: Diff ( 4 files changed, 5235 insertions(+))
google-beta provider: Diff ( 15 files changed, 5247 insertions(+), 12 deletions(-))
terraform-google-conversion: Diff ( 9 files changed, 1670 insertions(+), 16 deletions(-))
Open in Cloud Shell: Diff ( 8 files changed, 486 insertions(+))

@modular-magician
Copy link
Copy Markdown
Collaborator

Tests analytics

Total tests: 6351
Passed tests: 5632
Skipped tests: 652
Affected tests: 67

Click here to see the affected service packages

All service packages are affected

Action taken

Found 67 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit. Click here to see the affected tests
  • TestAccApigeeOrganization_apigeeOrganizationCloudBasicDisableVpcPeeringTestExample
  • TestAccApigeeOrganization_apigeeOrganizationCloudFullDisableVpcPeeringTestExample
  • TestAccBeyondcorpAppConnection_beyondcorpAppConnectionBasicExample
  • TestAccCESAgent_cesAgentBasicExample
  • TestAccCESAgent_cesAgentBasicExample_update
  • TestAccCESAgent_cesAgentRemoteDialogflowAgentExample
  • TestAccCESAgent_cesAgentRemoteDialogflowAgentExample_update
  • TestAccCESAgent_cesAgentRemoteDialogflowAgentInterruptionExample
  • TestAccCESAppVersion_cesAppVersionBasicExample
  • TestAccCESApp_cesAppAmbientSoundGcsUriExample
  • TestAccCESApp_cesAppBasicExample
  • TestAccCESApp_update
  • TestAccCESDeployment_cesDeploymentBasicExample
  • TestAccCESDeployment_update
  • TestAccCESEvaluation_cesEvaluationBasicExample
  • TestAccCESEvaluation_cesEvaluationFullExample
  • TestAccCESExample_cesExampleBasicExample
  • TestAccCESExample_update
  • TestAccCESGuardrail_cesGuardrailBasicExample
  • TestAccCESGuardrail_cesGuardrailBasicExample_update
  • TestAccCESGuardrail_cesGuardrailCodeCallbackExample
  • TestAccCESGuardrail_cesGuardrailCodeCallbackExample_update
  • TestAccCESGuardrail_cesGuardrailGenerativeAnswerLlmPromptSecurityExample
  • TestAccCESGuardrail_cesGuardrailGenerativeAnswerLlmPromptSecurityExample_update
  • TestAccCESGuardrail_cesGuardrailLlmPolicyExample
  • TestAccCESGuardrail_cesGuardrailLlmPolicyExample_update
  • TestAccCESGuardrail_cesGuardrailTransferAgentContentFilterExample
  • TestAccCESGuardrail_cesGuardrailTransferAgentContentFilterExample_update
  • TestAccCESTool_cesToolClientFunctionBasicExample
  • TestAccCESTool_cesToolClientFunctionBasicExample_update
  • TestAccCESTool_cesToolDataStoreToolEngineSourceBasicExample
  • TestAccCESTool_cesToolDataStoreToolEngineSourceBasicExample_update
  • TestAccCESTool_cesToolGoogleSearchToolBasicExample
  • TestAccCESTool_cesToolGoogleSearchToolBasicExample_update
  • TestAccCESTool_cesToolPythonFunctionBasicExample
  • TestAccCESTool_cesToolPythonFunctionBasicExample_update
  • TestAccCESToolset_cesToolsetBearerTokenConfigExample
  • TestAccCESToolset_cesToolsetBearerTokenConfigExample_update
  • TestAccCESToolset_cesToolsetMcpApiKeyConfigExample
  • TestAccCESToolset_cesToolsetMcpApiKeyConfigExample_update
  • TestAccCESToolset_cesToolsetMcpBearerTokenConfigExample
  • TestAccCESToolset_cesToolsetMcpBearerTokenConfigExample_update
  • TestAccCESToolset_cesToolsetMcpOauthConfigExample
  • TestAccCESToolset_cesToolsetMcpOauthConfigExample_update
  • TestAccCESToolset_cesToolsetMcpServiceAccountAuthConfigExample
  • TestAccCESToolset_cesToolsetMcpServiceAccountAuthConfigExample_update
  • TestAccCESToolset_cesToolsetMcpServiceAgentIdTokenAuthConfigExample
  • TestAccCESToolset_cesToolsetMcpServiceAgentIdTokenExample_update
  • TestAccCESToolset_cesToolsetOpenapiApiKeyConfigExample
  • TestAccCESToolset_cesToolsetOpenapiApiKeyConfigExample_update
  • TestAccCESToolset_cesToolsetOpenapiOauthConfigExample
  • TestAccCESToolset_cesToolsetOpenapiOauthConfigExample_update
  • TestAccCESToolset_cesToolsetOpenapiServiceAccountAuthConfigExample
  • TestAccCESToolset_cesToolsetOpenapiServiceAccountAuthConfigExample_update
  • TestAccCESToolset_cesToolsetOpenapiServiceAgentIdTokenAuthConfigExample
  • TestAccCESToolset_cesToolsetOpenapiServiceAgentIdTokenAuthConfigExample_update
  • TestAccCloudRunService_cloudRunServiceGpuExample
  • TestAccContainerCluster_updateVersion
  • TestAccContainerCluster_withAutopilotResourceManagerTags
  • TestAccContainerNodePool_withHostMaintenancePolicy
  • TestAccDataformRepository_dataformRepositoryWithCloudsourceRepoAndSshExample
  • TestAccDataprocMetastoreService_dataprocMetastoreServicePrivateServiceConnectExample
  • TestAccDialogflowConversationProfile_dialogflowConversationProfileBetaBidiExample
  • TestAccDiscoveryEngineDataStore_discoveryengineDatastoreKmsKeyNameExample
  • TestAccManagedKafkaConnector_managedkafkaConnectorBasicExample
  • TestAccProjectIamMemberRemove_memberInMultipleBindings
  • TestAccPubsubSubscription_pubsubSubscriptionTagsExample

Get to know how VCR tests work

@modular-magician
Copy link
Copy Markdown
Collaborator

Tests analytics

Total tests: 6351
Passed tests: 5633
Skipped tests: 652
Affected tests: 66

Click here to see the affected service packages

All service packages are affected

Action taken

Found 66 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit. Click here to see the affected tests
  • TestAccApigeeOrganization_apigeeOrganizationCloudBasicDisableVpcPeeringTestExample
  • TestAccApigeeOrganization_apigeeOrganizationCloudFullDisableVpcPeeringTestExample
  • TestAccBeyondcorpAppConnection_beyondcorpAppConnectionBasicExample
  • TestAccCESAgent_cesAgentBasicExample
  • TestAccCESAgent_cesAgentBasicExample_update
  • TestAccCESAgent_cesAgentRemoteDialogflowAgentExample
  • TestAccCESAgent_cesAgentRemoteDialogflowAgentExample_update
  • TestAccCESAgent_cesAgentRemoteDialogflowAgentInterruptionExample
  • TestAccCESAppVersion_cesAppVersionBasicExample
  • TestAccCESApp_cesAppAmbientSoundGcsUriExample
  • TestAccCESApp_cesAppBasicExample
  • TestAccCESApp_update
  • TestAccCESDeployment_cesDeploymentBasicExample
  • TestAccCESDeployment_update
  • TestAccCESEvaluation_cesEvaluationBasicExample
  • TestAccCESEvaluation_cesEvaluationFullExample
  • TestAccCESExample_cesExampleBasicExample
  • TestAccCESExample_update
  • TestAccCESGuardrail_cesGuardrailBasicExample
  • TestAccCESGuardrail_cesGuardrailBasicExample_update
  • TestAccCESGuardrail_cesGuardrailCodeCallbackExample
  • TestAccCESGuardrail_cesGuardrailCodeCallbackExample_update
  • TestAccCESGuardrail_cesGuardrailGenerativeAnswerLlmPromptSecurityExample
  • TestAccCESGuardrail_cesGuardrailGenerativeAnswerLlmPromptSecurityExample_update
  • TestAccCESGuardrail_cesGuardrailLlmPolicyExample
  • TestAccCESGuardrail_cesGuardrailLlmPolicyExample_update
  • TestAccCESGuardrail_cesGuardrailTransferAgentContentFilterExample
  • TestAccCESGuardrail_cesGuardrailTransferAgentContentFilterExample_update
  • TestAccCESTool_cesToolClientFunctionBasicExample
  • TestAccCESTool_cesToolClientFunctionBasicExample_update
  • TestAccCESTool_cesToolDataStoreToolEngineSourceBasicExample
  • TestAccCESTool_cesToolDataStoreToolEngineSourceBasicExample_update
  • TestAccCESTool_cesToolGoogleSearchToolBasicExample
  • TestAccCESTool_cesToolGoogleSearchToolBasicExample_update
  • TestAccCESTool_cesToolPythonFunctionBasicExample
  • TestAccCESTool_cesToolPythonFunctionBasicExample_update
  • TestAccCESToolset_cesToolsetBearerTokenConfigExample
  • TestAccCESToolset_cesToolsetBearerTokenConfigExample_update
  • TestAccCESToolset_cesToolsetMcpApiKeyConfigExample
  • TestAccCESToolset_cesToolsetMcpApiKeyConfigExample_update
  • TestAccCESToolset_cesToolsetMcpBearerTokenConfigExample
  • TestAccCESToolset_cesToolsetMcpBearerTokenConfigExample_update
  • TestAccCESToolset_cesToolsetMcpOauthConfigExample
  • TestAccCESToolset_cesToolsetMcpOauthConfigExample_update
  • TestAccCESToolset_cesToolsetMcpServiceAccountAuthConfigExample
  • TestAccCESToolset_cesToolsetMcpServiceAccountAuthConfigExample_update
  • TestAccCESToolset_cesToolsetMcpServiceAgentIdTokenAuthConfigExample
  • TestAccCESToolset_cesToolsetMcpServiceAgentIdTokenExample_update
  • TestAccCESToolset_cesToolsetOpenapiApiKeyConfigExample
  • TestAccCESToolset_cesToolsetOpenapiApiKeyConfigExample_update
  • TestAccCESToolset_cesToolsetOpenapiOauthConfigExample
  • TestAccCESToolset_cesToolsetOpenapiOauthConfigExample_update
  • TestAccCESToolset_cesToolsetOpenapiServiceAccountAuthConfigExample
  • TestAccCESToolset_cesToolsetOpenapiServiceAccountAuthConfigExample_update
  • TestAccCESToolset_cesToolsetOpenapiServiceAgentIdTokenAuthConfigExample
  • TestAccCESToolset_cesToolsetOpenapiServiceAgentIdTokenAuthConfigExample_update
  • TestAccCloudRunService_cloudRunServiceGpuExample
  • TestAccContainerCluster_updateVersion
  • TestAccContainerCluster_withAutopilotResourceManagerTags
  • TestAccContainerNodePool_withHostMaintenancePolicy
  • TestAccDataformRepository_dataformRepositoryWithCloudsourceRepoAndSshExample
  • TestAccDataprocMetastoreService_dataprocMetastoreServicePrivateServiceConnectExample
  • TestAccDialogflowConversationProfile_dialogflowConversationProfileBetaBidiExample
  • TestAccDiscoveryEngineDataStore_discoveryengineDatastoreKmsKeyNameExample
  • TestAccManagedKafkaConnector_managedkafkaConnectorBasicExample
  • TestAccPubsubSubscription_pubsubSubscriptionTagsExample

Get to know how VCR tests work

@modular-magician
Copy link
Copy Markdown
Collaborator

🟢 Tests passed during RECORDING mode:
TestAccCESAgent_cesAgentBasicExample [Debug log]
TestAccCESAgent_cesAgentBasicExample_update [Debug log]
TestAccCESAgent_cesAgentRemoteDialogflowAgentExample [Debug log]
TestAccCESAgent_cesAgentRemoteDialogflowAgentExample_update [Debug log]
TestAccCESAgent_cesAgentRemoteDialogflowAgentInterruptionExample [Debug log]
TestAccCESAppVersion_cesAppVersionBasicExample [Debug log]
TestAccCESApp_cesAppAmbientSoundGcsUriExample [Debug log]
TestAccCESApp_cesAppBasicExample [Debug log]
TestAccCESApp_update [Debug log]
TestAccCESDeployment_cesDeploymentBasicExample [Debug log]
TestAccCESDeployment_update [Debug log]
TestAccCESEvaluation_cesEvaluationBasicExample [Debug log]
TestAccCESExample_cesExampleBasicExample [Debug log]
TestAccCESExample_update [Debug log]
TestAccCESGuardrail_cesGuardrailBasicExample [Debug log]
TestAccCESGuardrail_cesGuardrailBasicExample_update [Debug log]
TestAccCESGuardrail_cesGuardrailCodeCallbackExample [Debug log]
TestAccCESGuardrail_cesGuardrailCodeCallbackExample_update [Debug log]
TestAccCESGuardrail_cesGuardrailGenerativeAnswerLlmPromptSecurityExample [Debug log]
TestAccCESGuardrail_cesGuardrailGenerativeAnswerLlmPromptSecurityExample_update [Debug log]
TestAccCESGuardrail_cesGuardrailLlmPolicyExample [Debug log]
TestAccCESGuardrail_cesGuardrailLlmPolicyExample_update [Debug log]
TestAccCESGuardrail_cesGuardrailTransferAgentContentFilterExample [Debug log]
TestAccCESGuardrail_cesGuardrailTransferAgentContentFilterExample_update [Debug log]
TestAccCESTool_cesToolClientFunctionBasicExample [Debug log]
TestAccCESTool_cesToolClientFunctionBasicExample_update [Debug log]
TestAccCESTool_cesToolDataStoreToolEngineSourceBasicExample [Debug log]
TestAccCESTool_cesToolDataStoreToolEngineSourceBasicExample_update [Debug log]
TestAccCESTool_cesToolGoogleSearchToolBasicExample [Debug log]
TestAccCESTool_cesToolGoogleSearchToolBasicExample_update [Debug log]
TestAccCESTool_cesToolPythonFunctionBasicExample [Debug log]
TestAccCESTool_cesToolPythonFunctionBasicExample_update [Debug log]
TestAccCESToolset_cesToolsetBearerTokenConfigExample [Debug log]
TestAccCESToolset_cesToolsetBearerTokenConfigExample_update [Debug log]
TestAccCESToolset_cesToolsetMcpApiKeyConfigExample [Debug log]
TestAccCESToolset_cesToolsetMcpApiKeyConfigExample_update [Debug log]
TestAccCESToolset_cesToolsetMcpBearerTokenConfigExample [Debug log]
TestAccCESToolset_cesToolsetMcpBearerTokenConfigExample_update [Debug log]
TestAccCESToolset_cesToolsetMcpOauthConfigExample [Debug log]
TestAccCESToolset_cesToolsetMcpOauthConfigExample_update [Debug log]
TestAccCESToolset_cesToolsetMcpServiceAccountAuthConfigExample [Debug log]
TestAccCESToolset_cesToolsetMcpServiceAccountAuthConfigExample_update [Debug log]
TestAccCESToolset_cesToolsetMcpServiceAgentIdTokenAuthConfigExample [Debug log]
TestAccCESToolset_cesToolsetMcpServiceAgentIdTokenExample_update [Debug log]
TestAccCESToolset_cesToolsetOpenapiApiKeyConfigExample [Debug log]
TestAccCESToolset_cesToolsetOpenapiApiKeyConfigExample_update [Debug log]
TestAccCESToolset_cesToolsetOpenapiOauthConfigExample [Debug log]
TestAccCESToolset_cesToolsetOpenapiOauthConfigExample_update [Debug log]
TestAccCESToolset_cesToolsetOpenapiServiceAccountAuthConfigExample [Debug log]
TestAccCESToolset_cesToolsetOpenapiServiceAccountAuthConfigExample_update [Debug log]
TestAccCESToolset_cesToolsetOpenapiServiceAgentIdTokenAuthConfigExample [Debug log]
TestAccCESToolset_cesToolsetOpenapiServiceAgentIdTokenAuthConfigExample_update [Debug log]
TestAccDialogflowConversationProfile_dialogflowConversationProfileBetaBidiExample [Debug log]

🟢 No issues found for passed tests after REPLAYING rerun.


🔴 Tests failed during RECORDING mode:
TestAccApigeeOrganization_apigeeOrganizationCloudBasicDisableVpcPeeringTestExample [Error message] [Debug log]
TestAccApigeeOrganization_apigeeOrganizationCloudFullDisableVpcPeeringTestExample [Error message] [Debug log]
TestAccBeyondcorpAppConnection_beyondcorpAppConnectionBasicExample [Error message] [Debug log]
TestAccCESEvaluation_cesEvaluationFullExample [Error message] [Debug log]
TestAccCloudRunService_cloudRunServiceGpuExample [Error message] [Debug log]
TestAccContainerCluster_updateVersion [Error message] [Debug log]
TestAccContainerCluster_withAutopilotResourceManagerTags [Error message] [Debug log]
TestAccContainerNodePool_withHostMaintenancePolicy [Error message] [Debug log]
TestAccDataformRepository_dataformRepositoryWithCloudsourceRepoAndSshExample [Error message] [Debug log]
TestAccDataprocMetastoreService_dataprocMetastoreServicePrivateServiceConnectExample [Error message] [Debug log]
TestAccDiscoveryEngineDataStore_discoveryengineDatastoreKmsKeyNameExample [Error message] [Debug log]
TestAccManagedKafkaConnector_managedkafkaConnectorBasicExample [Error message] [Debug log]
TestAccPubsubSubscription_pubsubSubscriptionTagsExample [Error message] [Debug log]

🔴 Errors occurred during RECORDING mode. Please fix them to complete your PR.

View the build log or the debug log for each test

This reverts commit e186cfdb3874404f4625a9f99b4dad6d99749ffb.
This reverts commit 04626b4701583a35ba4c9d02f1d3996fe8fea141.
@modular-magician
Copy link
Copy Markdown
Collaborator

Hi there, I'm the Modular magician. I've detected the following information about your changes:

Diff report

Your PR generated some diffs in downstreams - here they are.

google provider: Diff ( 4 files changed, 5235 insertions(+))
google-beta provider: Diff ( 15 files changed, 5247 insertions(+), 12 deletions(-))
terraform-google-conversion: Diff ( 9 files changed, 1670 insertions(+), 16 deletions(-))
Open in Cloud Shell: Diff ( 8 files changed, 486 insertions(+))

@modular-magician
Copy link
Copy Markdown
Collaborator

Tests analytics

Total tests: 6354
Passed tests: 5688
Skipped tests: 652
Affected tests: 14

Click here to see the affected service packages

All service packages are affected

Action taken

Found 14 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit. Click here to see the affected tests
  • TestAccApigeeOrganization_apigeeOrganizationCloudBasicDisableVpcPeeringTestExample
  • TestAccApigeeOrganization_apigeeOrganizationCloudFullDisableVpcPeeringTestExample
  • TestAccBeyondcorpAppConnection_beyondcorpAppConnectionBasicExample
  • TestAccCESEvaluation_cesEvaluationFullExample
  • TestAccCloudRunService_cloudRunServiceGpuExample
  • TestAccContainerCluster_updateVersion
  • TestAccContainerCluster_withAutopilotResourceManagerTags
  • TestAccContainerNodePool_withHostMaintenancePolicy
  • TestAccDataformConfig_update
  • TestAccDataformRepository_dataformRepositoryWithCloudsourceRepoAndSshExample
  • TestAccDataprocMetastoreService_dataprocMetastoreServicePrivateServiceConnectExample
  • TestAccDiscoveryEngineDataStore_discoveryengineDatastoreKmsKeyNameExample
  • TestAccManagedKafkaConnector_managedkafkaConnectorBasicExample
  • TestAccPubsubSubscription_pubsubSubscriptionTagsExample

Get to know how VCR tests work

@modular-magician
Copy link
Copy Markdown
Collaborator

🟢 Tests passed during RECORDING mode:
TestAccDataformConfig_update [Debug log]

🔴 Tests failed when rerunning REPLAYING mode:
TestAccDataformConfig_update [Error message] [Debug log]

Tests failed due to non-determinism or randomness when the VCR replayed the response after the HTTP request was made.

Please fix these to complete your PR. If you believe these test failures to be incorrect or unrelated to your change, or if you have any questions, please raise the concern with your reviewer.


🔴 Tests failed during RECORDING mode:
TestAccApigeeOrganization_apigeeOrganizationCloudBasicDisableVpcPeeringTestExample [Error message] [Debug log]
TestAccApigeeOrganization_apigeeOrganizationCloudFullDisableVpcPeeringTestExample [Error message] [Debug log]
TestAccBeyondcorpAppConnection_beyondcorpAppConnectionBasicExample [Error message] [Debug log]
TestAccCESEvaluation_cesEvaluationFullExample [Error message] [Debug log]
TestAccCloudRunService_cloudRunServiceGpuExample [Error message] [Debug log]
TestAccContainerCluster_updateVersion [Error message] [Debug log]
TestAccContainerCluster_withAutopilotResourceManagerTags [Error message] [Debug log]
TestAccContainerNodePool_withHostMaintenancePolicy [Error message] [Debug log]
TestAccDataformRepository_dataformRepositoryWithCloudsourceRepoAndSshExample [Error message] [Debug log]
TestAccDataprocMetastoreService_dataprocMetastoreServicePrivateServiceConnectExample [Error message] [Debug log]
TestAccDiscoveryEngineDataStore_discoveryengineDatastoreKmsKeyNameExample [Error message] [Debug log]
TestAccManagedKafkaConnector_managedkafkaConnectorBasicExample [Error message] [Debug log]
TestAccPubsubSubscription_pubsubSubscriptionTagsExample [Error message] [Debug log]

🔴 Errors occurred during RECORDING mode. Please fix them to complete your PR.

View the build log or the debug log for each test

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants