Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DPR2-1576] Update table expiry lambda #9303

Merged
merged 1 commit into from
Jan 10, 2025
Merged

[DPR2-1576] Update table expiry lambda #9303

merged 1 commit into from
Jan 10, 2025

Conversation

stalwartstu
Copy link
Contributor

No description provided.

@stalwartstu stalwartstu requested review from a team as code owners January 10, 2025 09:08
@github-actions github-actions bot added the environments-repository Used to exclude PRs from this repo in our Slack PR update label Jan 10, 2025
@github-actions GitHub Actions
Copy link
Contributor

Trivy Scan Success

Show Output ```hcl

Trivy will check the following folders:
terraform/environments/digital-prison-reporting

Running Trivy in terraform/environments/digital-prison-reporting
2025-01-10T09:10:25Z INFO [vulndb] Need to update DB
2025-01-10T09:10:25Z INFO [vulndb] Downloading vulnerability DB...
2025-01-10T09:10:25Z INFO [vulndb] Downloading artifact... repo="public.ecr.aws/aquasecurity/trivy-db:2"
2025-01-10T09:10:27Z INFO [vulndb] Artifact successfully downloaded repo="public.ecr.aws/aquasecurity/trivy-db:2"
2025-01-10T09:10:27Z INFO [vuln] Vulnerability scanning is enabled
2025-01-10T09:10:27Z INFO [misconfig] Misconfiguration scanning is enabled
2025-01-10T09:10:27Z INFO [misconfig] Need to update the built-in checks
2025-01-10T09:10:27Z INFO [misconfig] Downloading the built-in checks...
160.80 KiB / 160.80 KiB [---------------------------------------------------------] 100.00% ? p/s 0s2025-01-10T09:10:28Z INFO [secret] Secret scanning is enabled
2025-01-10T09:10:28Z INFO [secret] If your scanning is slow, please try '--scanners vuln' to disable secret scanning
2025-01-10T09:10:28Z INFO [secret] Please see also https://aquasecurity.github.io/trivy/v0.57/docs/scanner/secret#recommendation for faster secret detection
2025-01-10T09:10:29Z INFO [terraform scanner] Scanning root module file_path="."
2025-01-10T09:10:29Z WARN [terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly. module="root" variables="networking"
2025-01-10T09:10:30Z ERROR [terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable. block="aws_glue_connection.glue_dps_connection" value="cty.NilVal"
2025-01-10T09:10:30Z ERROR [terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable. block="aws_iam_role_policy_attachment.redshift_spectrum" value="cty.NilVal"
2025-01-10T09:10:30Z ERROR [terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable. block="aws_secretsmanager_secret.dps" value="cty.NilVal"
2025-01-10T09:10:30Z ERROR [terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable. block="aws_secretsmanager_secret_version.dps" value="cty.NilVal"
2025-01-10T09:10:30Z ERROR [terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable. block="data.aws_secretsmanager_secret.dps" value="cty.NilVal"
2025-01-10T09:10:30Z ERROR [terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable. block="data.aws_secretsmanager_secret_version.dps" value="cty.NilVal"
2025-01-10T09:10:31Z ERROR [terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable. block="module.aws_s3_data_migrate.aws_iam_role_policy_attachment.this" value="cty.NilVal"
2025-01-10T09:10:31Z ERROR [terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable. block="module.datamart.aws_redshift_authentication_profile.this" value="cty.NilVal"
2025-01-10T09:10:31Z ERROR [terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable. block="module.datamart.aws_redshift_scheduled_action.this" value="cty.NilVal"
2025-01-10T09:10:31Z ERROR [terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable. block="module.datamart.aws_redshift_usage_limit.this" value="cty.NilVal"
2025-01-10T09:10:31Z ERROR [terraform evaluator] Failed to expand dynamic block. block="module.datamart.aws_redshift_cluster.this[0]" err="1 error occurred:\n\t* invalid for-each in aws_redshift_cluster.this[0].dynamic.logging block: cannot use a cty.NilVal value in for_each. An iterable collection is required\n\n"
2025-01-10T09:10:31Z ERROR [terraform evaluator] Failed to expand dynamic block. block="module.datamart.aws_redshift_cluster.this[0]" err="1 error occurred:\n\t* invalid for-each in aws_redshift_cluster.this[0].dynamic.logging block: cannot use a cty.NilVal value in for_each. An iterable collection is required\n\n"
2025-01-10T09:10:31Z ERROR [terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable. block="module.domain_builder_backend_Lambda.aws_iam_role_policy_attachment.this" value="cty.NilVal"
2025-01-10T09:10:31Z ERROR [terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable. block="module.domain_builder_cli_agent.aws_iam_role_policy_attachment.this" value="cty.NilVal"
2025-01-10T09:10:31Z ERROR [terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable. block="module.domain_builder_cli_agent.aws_security_group_rule.ingress_traffic" value="cty.NilVal"
2025-01-10T09:10:31Z ERROR [terraform evaluator] Failed to expand dynamic block. block="module.domain_builder_cli_agent.aws_autoscaling_group.bastion_linux_daily[0]" err="1 error occurred:\n\t* invalid for-each in aws_autoscaling_group.bastion_linux_daily[0].dynamic.tag block: cannot use a cty.NilVal value in for_each. An iterable collection is required\n\n"
2025-01-10T09:10:31Z ERROR [terraform evaluator] Failed to expand dynamic block. block="module.domain_builder_cli_agent.aws_autoscaling_group.bastion_linux_daily[0]" err="1 error occurred:\n\t* invalid for-each in aws_autoscaling_group.bastion_linux_daily[0].dynamic.tag block: cannot use a cty.NilVal value in for_each. An iterable collection is required\n\n"
2025-01-10T09:10:31Z ERROR [terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable. block="module.domain_builder_flyway_Lambda.aws_iam_role_policy_attachment.this" value="cty.NilVal"
2025-01-10T09:10:32Z ERROR [terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable. block="module.ec2_kinesis_agent.aws_security_group_rule.ingress_traffic_from_security_groups" value="cty.NilVal"
2025-01-10T09:10:32Z ERROR [terraform evaluator] Failed to expand dynamic block. block="module.ec2_kinesis_agent.aws_autoscaling_group.bastion_linux_daily" err="1 error occurred:\n\t* invalid for-each in aws_autoscaling_group.bastion_linux_daily.dynamic.tag block: cannot use a cty.NilVal value in for_each. An iterable collection is required\n\n"
2025-01-10T09:10:32Z ERROR [terraform evaluator] Failed to expand dynamic block. block="module.ec2_kinesis_agent.aws_autoscaling_group.bastion_linux_daily" err="1 error occurred:\n\t* invalid for-each in aws_autoscaling_group.bastion_linux_daily.dynamic.tag block: cannot use a cty.NilVal value in for_each. An iterable collection is required\n\n"
2025-01-10T09:10:32Z INFO [terraform scanner] Scanning root module file_path="modules/domains/dms-endpoints"
2025-01-10T09:10:32Z WARN [terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly. module="root" variables="bucket_name, env, project_id, source_app_password, source_app_username"
2025-01-10T09:10:32Z INFO [terraform scanner] Scanning root module file_path="modules/domains/dms-instance"
2025-01-10T09:10:32Z WARN [terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly. module="root" variables="env, name, project_id"
2025-01-10T09:10:32Z INFO [terraform scanner] Scanning root module file_path="modules/domains/dms-task"
2025-01-10T09:10:32Z WARN [terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly. module="root" variables="env, project_id"
2025-01-10T09:10:32Z INFO [terraform scanner] Scanning root module file_path="modules/domains/ingestion-jobs"
2025-01-10T09:10:32Z WARN [terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly. module="root" variables="env, glue_cdc_maintenance_window, jar_version, project_id, script_version"
2025-01-10T09:10:32Z INFO [terraform scanner] Scanning root module file_path="modules/domains/ingestion-pipeline"
2025-01-10T09:10:32Z WARN [terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly. module="root" variables="archive_job_trigger_name, data_ingestion_pipeline, dms_replication_task_arn, domain, glue_archive_job, glue_hive_table_creation_jobname, glue_maintenance_compaction_job, glue_maintenance_retention_job, glue_reporting_hub_batch_jobname, glue_reporting_hub_cdc_jobname, glue_s3_data_deletion_job, glue_s3_file_transfer_job, glue_s3_max_attempts, glue_s3_retry_max_wait_millis, glue_s3_retry_min_wait_millis, glue_stop_glue_instance_job, glue_switch_prisons_hive_data_location_job, glue_trigger_activation_job, pipeline_notification_lambda_function, replication_task_id, s3_curated_bucket_id, s3_curated_path, s3_glue_bucket_id, s3_raw_archive_bucket_id, s3_raw_bucket_id, s3_structured_bucket_id, s3_structured_path, s3_temp_reload_bucket_id, step_function_execution_role_arn, stop_dms_task_job"
2025-01-10T09:10:32Z INFO [terraform scanner] Scanning root module file_path="modules/domains/maintenance-pipeline"
2025-01-10T09:10:32Z WARN [terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly. module="root" variables="dms_replication_task_arn, domain, glue_maintenance_compaction_job, glue_maintenance_retention_job, glue_reporting_hub_cdc_jobname, glue_s3_max_attempts, glue_s3_retry_max_wait_millis, glue_s3_retry_min_wait_millis, glue_stop_glue_instance_job, glue_unprocessed_raw_files_check_job, maintenance_pipeline_name, processed_files_check_max_attempts, processed_files_check_wait_interval_seconds, replication_task_id, s3_curated_path, s3_glue_bucket_id, s3_structured_path, step_function_execution_role_arn, stop_dms_task_job"
2025-01-10T09:10:32Z INFO [terraform scanner] Scanning root module file_path="modules/domains/pipeline-lambda"
2025-01-10T09:10:32Z INFO [terraform scanner] Scanning root module file_path="modules/domains/reload-pipeline"
2025-01-10T09:10:32Z WARN [terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly. module="root" variables="archive_job_trigger_name, dms_replication_task_arn, domain, glue_archive_job, glue_create_reload_diff_job, glue_hive_table_creation_jobname, glue_maintenance_compaction_job, glue_maintenance_retention_job, glue_reporting_hub_batch_jobname, glue_reporting_hub_cdc_jobname, glue_s3_data_deletion_job, glue_s3_file_transfer_job, glue_s3_max_attempts, glue_s3_retry_max_wait_millis, glue_s3_retry_min_wait_millis, glue_stop_glue_instance_job, glue_switch_prisons_hive_data_location_job, glue_trigger_activation_job, glue_unprocessed_raw_files_check_job, pipeline_notification_lambda_function, processed_files_check_max_attempts, processed_files_check_wait_interval_seconds, reload_pipeline, replication_task_id, s3_curated_bucket_id, s3_curated_path, s3_glue_bucket_id, s3_raw_archive_bucket_id, s3_raw_bucket_id, s3_structured_bucket_id, s3_structured_path, s3_temp_reload_bucket_id, step_function_execution_role_arn, stop_dms_task_job"
2025-01-10T09:10:32Z INFO [terraform scanner] Scanning root module file_path="modules/domains/replay-pipeline"
2025-01-10T09:10:32Z WARN [terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly. module="root" variables="dms_replication_task_arn, glue_maintenance_compaction_job, glue_maintenance_retention_job, glue_s3_max_attempts, glue_s3_retry_max_wait_millis, glue_s3_retry_min_wait_millis, processed_files_check_max_attempts, processed_files_check_wait_interval_seconds, replication_task_id, s3_curated_path, s3_structured_path, step_function_execution_role_arn"
2025-01-10T09:10:32Z INFO [terraform scanner] Scanning root module file_path="modules/domains/start-cdc-pipeline"
2025-01-10T09:10:32Z WARN [terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly. module="root" variables="dms_replication_task_arn, domain, glue_reporting_hub_cdc_jobname, glue_stop_glue_instance_job, replication_task_id, s3_glue_bucket_id, start_cdc_pipeline, step_function_execution_role_arn, stop_dms_task_job"
2025-01-10T09:10:32Z INFO [terraform scanner] Scanning root module file_path="modules/domains/stop-cdc-pipeline"
2025-01-10T09:10:32Z WARN [terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly. module="root" variables="glue_reporting_hub_cdc_jobname, glue_stop_glue_instance_job, glue_unprocessed_raw_files_check_job, processed_files_check_max_attempts, processed_files_check_wait_interval_seconds, replication_task_id, step_function_execution_role_arn, stop_cdc_pipeline, stop_dms_task_job"
2025-01-10T09:10:32Z INFO [terraform scanner] Scanning root module file_path="modules/glue_connection"
2025-01-10T09:10:32Z WARN [terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly. module="root" variables="availability_zone, connection_url, description, name, password, security_groups, subnet, username"
2025-01-10T09:10:32Z INFO [terraform scanner] Scanning root module file_path="modules/pipeline_trigger"
2025-01-10T09:10:32Z WARN [terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly. module="root" variables="description, pipeline_name, schedule_expression, state_machine_arn, step_function_execution_role_arn"
2025-01-10T09:10:34Z INFO [terraform executor] Ignore finding rule="aws-ec2-no-public-egress-sgr" range="modules/ec2/main.tf:72"
2025-01-10T09:10:35Z INFO Number of language-specific files num=0
2025-01-10T09:10:35Z INFO Detected config files num=32
trivy_exitcode=0

</details> #### `Checkov Scan` Success
<details><summary>Show Output</summary>

```hcl

*****************************

Checkov will check the following folders:
terraform/environments/digital-prison-reporting

*****************************

Running Checkov in terraform/environments/digital-prison-reporting
Excluding the following checks: CKV_GIT_1,CKV_AWS_126,CKV2_AWS_38,CKV2_AWS_39
2025-01-10 09:10:38,283 [MainThread  ] [WARNI]  Failed to download module ministryofjustice/observability-platform-tenant/aws:1.2.0 (for external modules, the --download-external-modules flag is required)
2025-01-10 09:10:38,283 [MainThread  ] [WARNI]  Failed to download module github.com/ministryofjustice/modernisation-platform-terraform-pagerduty-integration?ref=v2.0.0:None (for external modules, the --download-external-modules flag is required)
2025-01-10 09:11:09,419 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,430 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,442 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,454 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,466 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,477 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,487 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,498 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,508 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,519 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,530 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,541 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,552 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,563 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,589 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,601 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,613 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,625 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:09,637 [MainThread  ] [WARNI]  Error in evaluate_try of argument arn:aws:iam::var.account:policy/aws_iam_policy.additional-policy[0].name - invalid syntax (<string>, line 1)
2025-01-10 09:11:12,382 [MainThread  ] [WARNI]  Failed to find context for resource.aws_iam_role_policy_attachment.redshift_spectrum["arn:aws:iam::${data.aws_caller_identity.current.account_id}:policy/${aws_iam_policy.s3_read_write_policy.name}"]
2025-01-10 09:11:12,382 [MainThread  ] [WARNI]  Failed to find context for resource.aws_iam_role_policy_attachment.redshift_spectrum["arn:aws:iam::${data.aws_caller_identity.current.account_id}:policy/${aws_iam_policy.kms_read_access_policy.name}"]
2025-01-10 09:11:12,382 [MainThread  ] [WARNI]  Failed to find context for resource.aws_iam_role_policy_attachment.redshift_spectrum["arn:aws:iam::${data.aws_caller_identity.current.account_id}:policy/${aws_iam_policy.redshift_spectrum_policy.name}"]
terraform scan results:

Passed checks: 1581, Failed checks: 0, Skipped checks: 650


checkov_exitcode=0

CTFLint Scan Success

Show Output 
*****************************

Setting default tflint config...
Running tflint --init...
Installing "terraform" plugin...
Installed "terraform" (source: github.com/terraform-linters/tflint-ruleset-terraform, version: 0.9.1)
tflint will check the following folders:
terraform/environments/digital-prison-reporting

*****************************

Running tflint in terraform/environments/digital-prison-reporting
Excluding the following checks: terraform_unused_declarations
tflint_exitcode=0

Trivy Scan Success

Show Output 
*****************************

Trivy will check the following folders:
terraform/environments/digital-prison-reporting

*****************************

Running Trivy in terraform/environments/digital-prison-reporting
2025-01-10T09:10:25Z	INFO	[vulndb] Need to update DB
2025-01-10T09:10:25Z	INFO	[vulndb] Downloading vulnerability DB...
2025-01-10T09:10:25Z	INFO	[vulndb] Downloading artifact...	repo="public.ecr.aws/aquasecurity/trivy-db:2"
2025-01-10T09:10:27Z	INFO	[vulndb] Artifact successfully downloaded	repo="public.ecr.aws/aquasecurity/trivy-db:2"
2025-01-10T09:10:27Z	INFO	[vuln] Vulnerability scanning is enabled
2025-01-10T09:10:27Z	INFO	[misconfig] Misconfiguration scanning is enabled
2025-01-10T09:10:27Z	INFO	[misconfig] Need to update the built-in checks
2025-01-10T09:10:27Z	INFO	[misconfig] Downloading the built-in checks...
160.80 KiB / 160.80 KiB [---------------------------------------------------------] 100.00% ? p/s 0s2025-01-10T09:10:28Z	INFO	[secret] Secret scanning is enabled
2025-01-10T09:10:28Z	INFO	[secret] If your scanning is slow, please try '--scanners vuln' to disable secret scanning
2025-01-10T09:10:28Z	INFO	[secret] Please see also https://aquasecurity.github.io/trivy/v0.57/docs/scanner/secret#recommendation for faster secret detection
2025-01-10T09:10:29Z	INFO	[terraform scanner] Scanning root module	file_path="."
2025-01-10T09:10:29Z	WARN	[terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly.	module="root" variables="networking"
2025-01-10T09:10:30Z	ERROR	[terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable.	block="aws_glue_connection.glue_dps_connection" value="cty.NilVal"
2025-01-10T09:10:30Z	ERROR	[terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable.	block="aws_iam_role_policy_attachment.redshift_spectrum" value="cty.NilVal"
2025-01-10T09:10:30Z	ERROR	[terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable.	block="aws_secretsmanager_secret.dps" value="cty.NilVal"
2025-01-10T09:10:30Z	ERROR	[terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable.	block="aws_secretsmanager_secret_version.dps" value="cty.NilVal"
2025-01-10T09:10:30Z	ERROR	[terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable.	block="data.aws_secretsmanager_secret.dps" value="cty.NilVal"
2025-01-10T09:10:30Z	ERROR	[terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable.	block="data.aws_secretsmanager_secret_version.dps" value="cty.NilVal"
2025-01-10T09:10:31Z	ERROR	[terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable.	block="module.aws_s3_data_migrate.aws_iam_role_policy_attachment.this" value="cty.NilVal"
2025-01-10T09:10:31Z	ERROR	[terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable.	block="module.datamart.aws_redshift_authentication_profile.this" value="cty.NilVal"
2025-01-10T09:10:31Z	ERROR	[terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable.	block="module.datamart.aws_redshift_scheduled_action.this" value="cty.NilVal"
2025-01-10T09:10:31Z	ERROR	[terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable.	block="module.datamart.aws_redshift_usage_limit.this" value="cty.NilVal"
2025-01-10T09:10:31Z	ERROR	[terraform evaluator] Failed to expand dynamic block.	block="module.datamart.aws_redshift_cluster.this[0]" err="1 error occurred:\n\t* invalid for-each in aws_redshift_cluster.this[0].dynamic.logging block: cannot use a cty.NilVal value in for_each. An iterable collection is required\n\n"
2025-01-10T09:10:31Z	ERROR	[terraform evaluator] Failed to expand dynamic block.	block="module.datamart.aws_redshift_cluster.this[0]" err="1 error occurred:\n\t* invalid for-each in aws_redshift_cluster.this[0].dynamic.logging block: cannot use a cty.NilVal value in for_each. An iterable collection is required\n\n"
2025-01-10T09:10:31Z	ERROR	[terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable.	block="module.domain_builder_backend_Lambda.aws_iam_role_policy_attachment.this" value="cty.NilVal"
2025-01-10T09:10:31Z	ERROR	[terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable.	block="module.domain_builder_cli_agent.aws_iam_role_policy_attachment.this" value="cty.NilVal"
2025-01-10T09:10:31Z	ERROR	[terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable.	block="module.domain_builder_cli_agent.aws_security_group_rule.ingress_traffic" value="cty.NilVal"
2025-01-10T09:10:31Z	ERROR	[terraform evaluator] Failed to expand dynamic block.	block="module.domain_builder_cli_agent.aws_autoscaling_group.bastion_linux_daily[0]" err="1 error occurred:\n\t* invalid for-each in aws_autoscaling_group.bastion_linux_daily[0].dynamic.tag block: cannot use a cty.NilVal value in for_each. An iterable collection is required\n\n"
2025-01-10T09:10:31Z	ERROR	[terraform evaluator] Failed to expand dynamic block.	block="module.domain_builder_cli_agent.aws_autoscaling_group.bastion_linux_daily[0]" err="1 error occurred:\n\t* invalid for-each in aws_autoscaling_group.bastion_linux_daily[0].dynamic.tag block: cannot use a cty.NilVal value in for_each. An iterable collection is required\n\n"
2025-01-10T09:10:31Z	ERROR	[terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable.	block="module.domain_builder_flyway_Lambda.aws_iam_role_policy_attachment.this" value="cty.NilVal"
2025-01-10T09:10:32Z	ERROR	[terraform evaluator] Failed to expand block. Invalid "for-each" argument. Must be known and iterable.	block="module.ec2_kinesis_agent.aws_security_group_rule.ingress_traffic_from_security_groups" value="cty.NilVal"
2025-01-10T09:10:32Z	ERROR	[terraform evaluator] Failed to expand dynamic block.	block="module.ec2_kinesis_agent.aws_autoscaling_group.bastion_linux_daily" err="1 error occurred:\n\t* invalid for-each in aws_autoscaling_group.bastion_linux_daily.dynamic.tag block: cannot use a cty.NilVal value in for_each. An iterable collection is required\n\n"
2025-01-10T09:10:32Z	ERROR	[terraform evaluator] Failed to expand dynamic block.	block="module.ec2_kinesis_agent.aws_autoscaling_group.bastion_linux_daily" err="1 error occurred:\n\t* invalid for-each in aws_autoscaling_group.bastion_linux_daily.dynamic.tag block: cannot use a cty.NilVal value in for_each. An iterable collection is required\n\n"
2025-01-10T09:10:32Z	INFO	[terraform scanner] Scanning root module	file_path="modules/domains/dms-endpoints"
2025-01-10T09:10:32Z	WARN	[terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly.	module="root" variables="bucket_name, env, project_id, source_app_password, source_app_username"
2025-01-10T09:10:32Z	INFO	[terraform scanner] Scanning root module	file_path="modules/domains/dms-instance"
2025-01-10T09:10:32Z	WARN	[terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly.	module="root" variables="env, name, project_id"
2025-01-10T09:10:32Z	INFO	[terraform scanner] Scanning root module	file_path="modules/domains/dms-task"
2025-01-10T09:10:32Z	WARN	[terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly.	module="root" variables="env, project_id"
2025-01-10T09:10:32Z	INFO	[terraform scanner] Scanning root module	file_path="modules/domains/ingestion-jobs"
2025-01-10T09:10:32Z	WARN	[terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly.	module="root" variables="env, glue_cdc_maintenance_window, jar_version, project_id, script_version"
2025-01-10T09:10:32Z	INFO	[terraform scanner] Scanning root module	file_path="modules/domains/ingestion-pipeline"
2025-01-10T09:10:32Z	WARN	[terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly.	module="root" variables="archive_job_trigger_name, data_ingestion_pipeline, dms_replication_task_arn, domain, glue_archive_job, glue_hive_table_creation_jobname, glue_maintenance_compaction_job, glue_maintenance_retention_job, glue_reporting_hub_batch_jobname, glue_reporting_hub_cdc_jobname, glue_s3_data_deletion_job, glue_s3_file_transfer_job, glue_s3_max_attempts, glue_s3_retry_max_wait_millis, glue_s3_retry_min_wait_millis, glue_stop_glue_instance_job, glue_switch_prisons_hive_data_location_job, glue_trigger_activation_job, pipeline_notification_lambda_function, replication_task_id, s3_curated_bucket_id, s3_curated_path, s3_glue_bucket_id, s3_raw_archive_bucket_id, s3_raw_bucket_id, s3_structured_bucket_id, s3_structured_path, s3_temp_reload_bucket_id, step_function_execution_role_arn, stop_dms_task_job"
2025-01-10T09:10:32Z	INFO	[terraform scanner] Scanning root module	file_path="modules/domains/maintenance-pipeline"
2025-01-10T09:10:32Z	WARN	[terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly.	module="root" variables="dms_replication_task_arn, domain, glue_maintenance_compaction_job, glue_maintenance_retention_job, glue_reporting_hub_cdc_jobname, glue_s3_max_attempts, glue_s3_retry_max_wait_millis, glue_s3_retry_min_wait_millis, glue_stop_glue_instance_job, glue_unprocessed_raw_files_check_job, maintenance_pipeline_name, processed_files_check_max_attempts, processed_files_check_wait_interval_seconds, replication_task_id, s3_curated_path, s3_glue_bucket_id, s3_structured_path, step_function_execution_role_arn, stop_dms_task_job"
2025-01-10T09:10:32Z	INFO	[terraform scanner] Scanning root module	file_path="modules/domains/pipeline-lambda"
2025-01-10T09:10:32Z	INFO	[terraform scanner] Scanning root module	file_path="modules/domains/reload-pipeline"
2025-01-10T09:10:32Z	WARN	[terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly.	module="root" variables="archive_job_trigger_name, dms_replication_task_arn, domain, glue_archive_job, glue_create_reload_diff_job, glue_hive_table_creation_jobname, glue_maintenance_compaction_job, glue_maintenance_retention_job, glue_reporting_hub_batch_jobname, glue_reporting_hub_cdc_jobname, glue_s3_data_deletion_job, glue_s3_file_transfer_job, glue_s3_max_attempts, glue_s3_retry_max_wait_millis, glue_s3_retry_min_wait_millis, glue_stop_glue_instance_job, glue_switch_prisons_hive_data_location_job, glue_trigger_activation_job, glue_unprocessed_raw_files_check_job, pipeline_notification_lambda_function, processed_files_check_max_attempts, processed_files_check_wait_interval_seconds, reload_pipeline, replication_task_id, s3_curated_bucket_id, s3_curated_path, s3_glue_bucket_id, s3_raw_archive_bucket_id, s3_raw_bucket_id, s3_structured_bucket_id, s3_structured_path, s3_temp_reload_bucket_id, step_function_execution_role_arn, stop_dms_task_job"
2025-01-10T09:10:32Z	INFO	[terraform scanner] Scanning root module	file_path="modules/domains/replay-pipeline"
2025-01-10T09:10:32Z	WARN	[terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly.	module="root" variables="dms_replication_task_arn, glue_maintenance_compaction_job, glue_maintenance_retention_job, glue_s3_max_attempts, glue_s3_retry_max_wait_millis, glue_s3_retry_min_wait_millis, processed_files_check_max_attempts, processed_files_check_wait_interval_seconds, replication_task_id, s3_curated_path, s3_structured_path, step_function_execution_role_arn"
2025-01-10T09:10:32Z	INFO	[terraform scanner] Scanning root module	file_path="modules/domains/start-cdc-pipeline"
2025-01-10T09:10:32Z	WARN	[terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly.	module="root" variables="dms_replication_task_arn, domain, glue_reporting_hub_cdc_jobname, glue_stop_glue_instance_job, replication_task_id, s3_glue_bucket_id, start_cdc_pipeline, step_function_execution_role_arn, stop_dms_task_job"
2025-01-10T09:10:32Z	INFO	[terraform scanner] Scanning root module	file_path="modules/domains/stop-cdc-pipeline"
2025-01-10T09:10:32Z	WARN	[terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly.	module="root" variables="glue_reporting_hub_cdc_jobname, glue_stop_glue_instance_job, glue_unprocessed_raw_files_check_job, processed_files_check_max_attempts, processed_files_check_wait_interval_seconds, replication_task_id, step_function_execution_role_arn, stop_cdc_pipeline, stop_dms_task_job"
2025-01-10T09:10:32Z	INFO	[terraform scanner] Scanning root module	file_path="modules/glue_connection"
2025-01-10T09:10:32Z	WARN	[terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly.	module="root" variables="availability_zone, connection_url, description, name, password, security_groups, subnet, username"
2025-01-10T09:10:32Z	INFO	[terraform scanner] Scanning root module	file_path="modules/pipeline_trigger"
2025-01-10T09:10:32Z	WARN	[terraform parser] Variable values was not found in the environment or variable files. Evaluating may not work correctly.	module="root" variables="description, pipeline_name, schedule_expression, state_machine_arn, step_function_execution_role_arn"
2025-01-10T09:10:34Z	INFO	[terraform executor] Ignore finding	rule="aws-ec2-no-public-egress-sgr" range="modules/ec2/main.tf:72"
2025-01-10T09:10:35Z	INFO	Number of language-specific files	num=0
2025-01-10T09:10:35Z	INFO	Detected config files	num=32
trivy_exitcode=0

@stalwartstu stalwartstu merged commit 123b8b0 into main Jan 10, 2025
10 of 13 checks passed
@stalwartstu stalwartstu deleted the feature/DPR2-1576-update-expiry-lambda branch January 10, 2025 09:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@gavriil-g-moj gavriil-g-moj gavriil-g-moj approved these changes

Assignees
No one assigned
Labels
environments-repository Used to exclude PRs from this repo in our Slack PR update
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@stalwartstu @gavriil-g-moj