Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spurious, repeated postDeploymentTask executions #3880

Open
wosc opened this issue Dec 17, 2024 · 5 comments
Open

Spurious, repeated postDeploymentTask executions #3880

wosc opened this issue Dec 17, 2024 · 5 comments

Comments

@wosc
Copy link

wosc commented Dec 17, 2024

We're trying to set up keptn to implement post deployment notifications to a slack channel, currently trying this in two namespaces (content-storage-api and www-gone), starting on 2024-12-11.
Since then, every day, once or sometimes twice per day, even though there have been no further changes to the namespace, these keptn tasks trigger again and again, resulting in bursts of slack messages, like this:

2024-12-17 02:09 Deployment: www-gone staging
2024-12-17 02:09 Deployment: content-storage-api staging
2024-12-17 02:09 Deployment: content-storage-api staging
2024-12-17 02:09 Deployment: content-storage-api staging

What's going on here? How can we debug this? Thanks for your help!

k8s manifest KeptnTaskDefinition
apiVersion: lifecycle.keptn.sh/v1
kind: KeptnAppContext
metadata:
  name: content-storage-api  # must match app.kubernetes.io/part-of
spec:
  postDeploymentTasks:
  - notify
---
apiVersion: lifecycle.keptn.sh/v1
kind: KeptnTaskDefinition
metadata:
  name: notify
spec:
  container:
    name: task
    # source code is available at https://github.com/ZeitOnline/deployment-notify if that's at all relevant
    image: europe-west3-docker.pkg.dev/zeitonline-engineering/docker-zon/deploynotify:1.8.1
    envFrom:
    - secretRef:
        name: notify
    args:
    - "--environment=staging"
    - "slack"
    - "--emoji=lower_left_fountain_pen"
    - "--channel-name=team-content-alerts"
Resulting KeptnTask resource

(There are 3 of these in the content-storage-api namespace, and one in www-gone)

apiVersion: lifecycle.keptn.sh/v1
kind: KeptnTask
metadata:
  annotations:
    kubectl.kubernetes.io/last-applied-configuration: |
      {"apiVersion":"lifecycle.keptn.sh/v1","kind":"KeptnTaskDefinition","metadata":{"annotations":{},"name":"notify","namespace":"content-storage-api"},"spec":{"container":{"args":["--environment=staging","slack","--emoji=lower_left_fountain_pen","--channel-name=team-content-alerts"],"envFrom":[{"secretRef":{"name":"notify"}}],"image":"europe-west3-docker.pkg.dev/zeitonline-engineering/docker-zon/deploynotify:1.8.1@sha256:929af84b755be7753c5aa55a221af9a288095e1964fc5ff2cdcef1bf54d91993","name":"task"}}}
  creationTimestamp: "2024-12-13T10:18:20Z"
  generation: 1
  managedFields:
  - apiVersion: lifecycle.keptn.sh/v1
    fieldsType: FieldsV1
    fieldsV1:
      f:metadata:
        f:annotations:
          .: {}
          f:kubectl.kubernetes.io/last-applied-configuration: {}
        f:ownerReferences:
          .: {}
          k:{"uid":"d6319536-58b6-4693-9a8a-2aa75c32016a"}: {}
      f:spec:
        .: {}
        f:checkType: {}
        f:context:
          .: {}
          f:appName: {}
          f:appVersion: {}
          f:objectType: {}
          f:taskType: {}
          f:workloadName: {}
          f:workloadVersion: {}
        f:parameters: {}
        f:retries: {}
        f:secureParameters: {}
        f:taskDefinition: {}
        f:timeout: {}
    manager: manager
    operation: Update
    time: "2024-12-13T10:18:20Z"
  - apiVersion: lifecycle.keptn.sh/v1
    fieldsType: FieldsV1
    fieldsV1:
      f:status:
        .: {}
        f:endTime: {}
        f:jobName: {}
        f:startTime: {}
        f:status: {}
    manager: manager
    operation: Update
    subresource: status
    time: "2024-12-17T05:21:54Z"
  name: post-notify-23191
  namespace: content-storage-api
  ownerReferences:
  - apiVersion: lifecycle.keptn.sh/v1
    blockOwnerDeletion: true
    controller: true
    kind: KeptnAppVersion
    name: content-storage-api-74335cda64-4e074085
    uid: d6319536-58b6-4693-9a8a-2aa75c32016a
  resourceVersion: "2032869636"
  uid: dc1d349f-2f8f-4f7f-8c6d-d80080b8c900
spec:
  checkType: post
  context:
    appName: content-storage-api
    appVersion: 74335cda64
    objectType: App
    taskType: post
    workloadName: ""
    workloadVersion: ""
  parameters: {}
  retries: 10
  secureParameters: {}
  taskDefinition: notify
  timeout: 5m0s
status:
  endTime: "2024-12-13T10:18:40Z"
  jobName: post-notify-23191-32582
  startTime: "2024-12-13T10:18:20Z"
  status: Succeeded
keptn lifecycle-controller logs
2024-12-17T02:01:17Z	INFO	Mutating Webhook	webhook for pod called
2024-12-17T02:01:17Z	INFO	Mutating Webhook	namespace is not enabled for lifecycle operator	{"namespace": "vivi"}
E1217 02:01:37.457941       1 leaderelection.go:429] Failed to update lock optimitically: Put "https://172.17.0.1:443/apis/coordination.k8s.io/v1/namespaces/keptn/leases/6b866dd9.keptn.sh": unexpected EOF, falling back to slow path
E1217 02:01:49.816683       1 leaderelection.go:429] Failed to update lock optimitically: Put "https://172.17.0.1:443/apis/coordination.k8s.io/v1/namespaces/keptn/leases/6b866dd9.keptn.sh": context deadline exceeded, falling back to slow path
E1217 02:01:49.817867       1 leaderelection.go:436] error retrieving resource lock keptn/6b866dd9.keptn.sh: client rate limiter Wait returned an error: context deadline exceeded
I1217 02:01:49.819307       1 leaderelection.go:297] failed to renew lease keptn/6b866dd9.keptn.sh: timed out waiting for the condition
2024-12-17T02:01:49Z	INFO	Stopping and waiting for non leader election runnables
2024-12-17T02:01:49Z	INFO	controller-runtime.webhook	Shutting down webhook server with timeout of 1 minute
2024-12-17T02:01:49Z	INFO	Stopping and waiting for leader election runnables
2024-12-17T02:01:49Z	INFO	Stopping and waiting for caches
2024-12-17T02:01:49Z	INFO	Stopping and waiting for webhooks
2024-12-17T02:01:49Z	INFO	Stopping and waiting for HTTP servers
2024-12-17T02:01:49Z	INFO	Wait completed, proceeding to shutdown the manager
2024-12-17T02:01:49Z	INFO	controller-runtime.metrics	Shutting down metrics server with timeout of 1 minute
2024-12-17T02:01:49Z	INFO	shutting down server	{"name": "health probe", "addr": "[::]:8081"}
2024-12-17T02:01:49Z	INFO	Shutdown signal received, waiting for all workers to finish	{"controller": "keptnworkload", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnWorkload"}
2024-12-17T02:01:49Z	INFO	Shutdown signal received, waiting for all workers to finish	{"controller": "keptnevaluation", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnEvaluation"}
2024-12-17T02:01:49Z	INFO	All workers finished	{"controller": "keptnevaluation", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnEvaluation"}
2024-12-17T02:01:49Z	INFO	Shutdown signal received, waiting for all workers to finish	{"controller": "keptnconfig", "controllerGroup": "options.keptn.sh", "controllerKind": "KeptnConfig"}
2024-12-17T02:01:49Z	INFO	Shutdown signal received, waiting for all workers to finish	{"controller": "keptnappversion", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnAppVersion"}
2024-12-17T02:01:49Z	INFO	Shutdown signal received, waiting for all workers to finish	{"controller": "pod", "controllerGroup": "", "controllerKind": "Pod"}
2024-12-17T02:01:49Z	INFO	Shutdown signal received, waiting for all workers to finish	{"controller": "keptnworkloadversion", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnWorkloadVersion"}
2024-12-17T02:01:49Z	INFO	All workers finished	{"controller": "keptnworkloadversion", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnWorkloadVersion"}
2024-12-17T02:01:49Z	INFO	All workers finished	{"controller": "keptntaskdefinition", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnTaskDefinition"}
2024-12-17T02:01:49Z	INFO	Shutdown signal received, waiting for all workers to finish	{"controller": "keptnappcreationrequest", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnAppCreationRequest"}
2024-12-17T02:01:49Z	INFO	Shutdown signal received, waiting for all workers to finish	{"controller": "keptnapp", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnApp"}
2024-12-17T02:01:49Z	INFO	All workers finished	{"controller": "keptnconfig", "controllerGroup": "options.keptn.sh", "controllerKind": "KeptnConfig"}
2024-12-17T02:01:49Z	INFO	Shutdown signal received, waiting for all workers to finish	{"controller": "keptntask", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnTask"}
2024-12-17T02:01:49Z	INFO	Shutdown signal received, waiting for all workers to finish	{"controller": "keptntaskdefinition", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnTaskDefinition"}
2024-12-17T02:01:49Z	INFO	All workers finished	{"controller": "keptnappcreationrequest", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnAppCreationRequest"}
2024-12-17T02:01:49Z	INFO	All workers finished	{"controller": "pod", "controllerGroup": "", "controllerKind": "Pod"}
2024-12-17T02:01:49Z	DEBUG	events	lifecycle-operator-849c8d74cf-h2ff8_4a08a565-e5f2-41e4-abf2-5ea54c57e880 stopped leading	{"type": "Normal", "object": {"kind":"Lease","namespace":"keptn","name":"6b866dd9.keptn.sh","uid":"3a0f4ec9-5459-445e-8371-e56780b1a423","apiVersion":"coordination.k8s.io/v1","resourceVersion":"2032651386"}, "reason": "LeaderElection"}
2024-12-17T02:01:49Z	ERROR	setup	problem running manager	{"error": "leader election lost"}
	/workspace/main.go:434
runtime.main
2024-12-17T02:01:49Z	INFO	All workers finished	{"controller": "keptnworkload", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnWorkload"}
main.main
	/usr/local/go/src/runtime/proc.go:272
2024-12-17T02:01:49Z	INFO	All workers finished	{"controller": "keptnapp", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnApp"}
2024-12-17T02:01:49Z	INFO	All workers finished	{"controller": "keptnappversion", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnAppVersion"}
2024/12/17 02:01:51 serving metrics at localhost:2222/metrics
2024-12-17T02:02:21Z	ERROR	setup	unable to create controller	{"controller": "KeptnWorkload", "error": "failed to get API group resources: unable to retrieve the complete list of server APIs: lifecycle.keptn.sh/v1: Get \"https://172.17.0.1:443/apis/lifecycle.keptn.sh/v1\": dial tcp 172.17.0.1:443: i/o timeout"}
main.main
	/usr/local/go/src/runtime/proc.go:272
	/workspace/main.go:275
runtime.main
2024/12/17 02:02:37 serving metrics at localhost:2222/metrics
2024-12-17T02:03:07Z	ERROR	setup	unable to create controller	{"controller": "KeptnWorkload", "error": "failed to get API group resources: unable to retrieve the complete list of server APIs: lifecycle.keptn.sh/v1: Get \"https://172.17.0.1:443/apis/lifecycle.keptn.sh/v1\": dial tcp 172.17.0.1:443: i/o timeout"}
main.main
	/workspace/main.go:275
runtime.main
	/usr/local/go/src/runtime/proc.go:272
2024/12/17 02:03:33 serving metrics at localhost:2222/metrics
2024/12/17 02:04:01 serving metrics at localhost:2222/metrics
2024-12-17T02:04:31Z	ERROR	setup	unable to create controller	{"controller": "KeptnWorkload", "error": "failed to get API group resources: unable to retrieve the complete list of server APIs: lifecycle.keptn.sh/v1: Get \"https://172.17.0.1:443/apis/lifecycle.keptn.sh/v1\": dial tcp 172.17.0.1:443: i/o timeout"}
main.main
	/workspace/main.go:275
runtime.main
	/usr/local/go/src/runtime/proc.go:272
2024/12/17 02:05:52 serving metrics at localhost:2222/metrics
2024-12-17T02:05:52Z	INFO	controller-runtime.builder	skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called	{"GVK": "lifecycle.keptn.sh/v1, Kind=KeptnApp"}
2024-12-17T02:05:52Z	INFO	controller-runtime.builder	skip registering a validating webhook, object does not implement admission.Validator or WithValidator wasn't called	{"GVK": "lifecycle.keptn.sh/v1, Kind=KeptnApp"}
2024-12-17T02:05:52Z	INFO	controller-runtime.webhook	Registering webhook	{"path": "/convert"}
2024-12-17T02:05:52Z	INFO	controller-runtime.builder	Conversion webhook enabled	{"GVK": "lifecycle.keptn.sh/v1, Kind=KeptnApp"}
2024-12-17T02:05:52Z	INFO	controller-runtime.builder	skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called	{"GVK": "lifecycle.keptn.sh/v1, Kind=KeptnAppVersion"}
2024-12-17T02:05:52Z	INFO	controller-runtime.builder	skip registering a validating webhook, object does not implement admission.Validator or WithValidator wasn't called	{"GVK": "lifecycle.keptn.sh/v1, Kind=KeptnAppVersion"}
2024-12-17T02:05:52Z	INFO	controller-runtime.builder	Conversion webhook enabled	{"GVK": "lifecycle.keptn.sh/v1, Kind=KeptnAppVersion"}
2024-12-17T02:05:52Z	INFO	controller-runtime.builder	skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called	{"GVK": "lifecycle.keptn.sh/v1, Kind=KeptnTaskDefinition"}
2024-12-17T02:05:52Z	INFO	controller-runtime.builder	Registering a validating webhook	{"GVK": "lifecycle.keptn.sh/v1, Kind=KeptnTaskDefinition", "path": "/validate-lifecycle-keptn-sh-v1-keptntaskdefinition"}
2024-12-17T02:05:52Z	INFO	controller-runtime.webhook	Registering webhook	{"path": "/validate-lifecycle-keptn-sh-v1-keptntaskdefinition"}
2024-12-17T02:05:52Z	INFO	setup	Keptn lifecycle-operator is alive
2024-12-17T02:05:52Z	INFO	setup	{keptn lifecycle-operator-849c8d74cf-h2ff8 0xc000322300 { 9443 /tmp/webhook/certs tls.crt tls.key  [] <nil>}}
2024-12-17T02:05:52Z	INFO	setup	checking dir	{"watcher.certificateDirectory ": "/tmp/webhook/certs"}
2024-12-17T02:05:52Z	ERROR	setup	failed to update certificates	{"error": "open /tmp/webhook/certs/tls.crt: read-only file system"}
github.com/keptn/lifecycle-toolkit/keptn-cert-manager/pkg/certificates.(*CertificateWatcher).WaitForCertificates
	/go/pkg/mod/github.com/keptn/lifecycle-toolkit/[email protected]/pkg/certificates/watcher.go:115
github.com/keptn/lifecycle-toolkit/keptn-cert-manager/pkg/webhook.Builder.Register
	/go/pkg/mod/github.com/keptn/lifecycle-toolkit/[email protected]/pkg/webhook/builder.go:72
main.main
	/workspace/main.go:416
runtime.main
	/usr/local/go/src/runtime/proc.go:272
2024-12-17T02:06:02Z	INFO	setup	checking dir	{"watcher.certificateDirectory ": "/tmp/webhook/certs"}
2024-12-17T02:06:02Z	INFO	setup	starting webhook
2024-12-17T02:06:02Z	INFO	setup	starting manager
2024-12-17T02:06:02Z	INFO	setup	Keptn lifecycle-operator is alive
2024-12-17T02:06:02Z	INFO	controller-runtime.webhook	Registering webhook	{"path": "/mutate-v1-pod"}
2024-12-17T02:06:02Z	INFO	controller-runtime.metrics	Starting metrics server
2024-12-17T02:06:02Z	INFO	starting server	{"name": "health probe", "addr": "[::]:8081"}
2024-12-17T02:06:02Z	INFO	controller-runtime.metrics	Serving metrics server	{"bindAddress": ":8080", "secure": false}
2024-12-17T02:06:02Z	INFO	controller-runtime.webhook	Starting webhook server
2024-12-17T02:06:02Z	INFO	controller-runtime.certwatcher	Updated current TLS certificate
2024-12-17T02:06:02Z	INFO	controller-runtime.webhook	Serving webhook server	{"host": "", "port": 9443}
2024-12-17T02:06:02Z	INFO	controller-runtime.certwatcher	Starting certificate watcher
I1217 02:06:02.761095       1 leaderelection.go:254] attempting to acquire leader lease keptn/6b866dd9.keptn.sh...
I1217 02:06:19.555790       1 leaderelection.go:268] successfully acquired lease keptn/6b866dd9.keptn.sh
2024-12-17T02:06:19Z	DEBUG	events	lifecycle-operator-849c8d74cf-h2ff8_65a96503-5e70-4e45-8af0-4bff5125ba48 became leader	{"type": "Normal", "object": {"kind":"Lease","namespace":"keptn","name":"6b866dd9.keptn.sh","uid":"3a0f4ec9-5459-445e-8371-e56780b1a423","apiVersion":"coordination.k8s.io/v1","resourceVersion":"2032652170"}, "reason": "LeaderElection"}
2024-12-17T02:06:19Z	INFO	Starting EventSource	{"controller": "keptnapp", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnApp", "source": "kind source: *v1.KeptnApp"}
2024-12-17T02:06:19Z	INFO	Starting Controller	{"controller": "keptnapp", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnApp"}
2024-12-17T02:06:19Z	INFO	Starting EventSource	{"controller": "keptntask", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnTask", "source": "kind source: *v1.KeptnTask"}
2024-12-17T02:06:19Z	INFO	Starting Controller	{"controller": "keptntask", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnTask"}
2024-12-17T02:06:19Z	INFO	Starting EventSource	{"controller": "keptnworkload", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnWorkload", "source": "kind source: *v1.KeptnWorkload"}
2024-12-17T02:06:19Z	INFO	Starting Controller	{"controller": "keptnworkload", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnWorkload"}
2024-12-17T02:06:19Z	INFO	Starting EventSource	{"controller": "keptntaskdefinition", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnTaskDefinition", "source": "kind source: *v1.KeptnTaskDefinition"}
2024-12-17T02:06:19Z	INFO	Starting EventSource	{"controller": "keptntaskdefinition", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnTaskDefinition", "source": "kind source: *v1.ConfigMap"}
2024-12-17T02:06:19Z	INFO	Starting EventSource	{"controller": "keptnappcreationrequest", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnAppCreationRequest", "source": "kind source: *v1.KeptnAppCreationRequest"}
2024-12-17T02:06:19Z	INFO	Starting EventSource	{"controller": "keptnconfig", "controllerGroup": "options.keptn.sh", "controllerKind": "KeptnConfig", "source": "kind source: *v1alpha1.KeptnConfig"}
2024-12-17T02:06:19Z	INFO	Starting EventSource	{"controller": "keptnworkloadversion", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnWorkloadVersion", "source": "kind source: *v1.KeptnWorkloadVersion"}
2024-12-17T02:06:19Z	INFO	Starting Controller	{"controller": "keptnappcreationrequest", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnAppCreationRequest"}
2024-12-17T02:06:19Z	INFO	Starting Controller	{"controller": "keptntaskdefinition", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnTaskDefinition"}
2024-12-17T02:06:19Z	INFO	Starting Controller	{"controller": "keptnworkloadversion", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnWorkloadVersion"}
2024-12-17T02:06:19Z	INFO	Starting Controller	{"controller": "keptnconfig", "controllerGroup": "options.keptn.sh", "controllerKind": "KeptnConfig"}
2024-12-17T02:06:19Z	INFO	Starting EventSource	{"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "source": "kind source: *v1.Pod"}
2024-12-17T02:06:19Z	INFO	Starting Controller	{"controller": "pod", "controllerGroup": "", "controllerKind": "Pod"}
2024-12-17T02:06:19Z	INFO	Starting EventSource	{"controller": "keptnappversion", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnAppVersion", "source": "kind source: *v1.KeptnAppVersion"}
2024-12-17T02:06:19Z	INFO	Starting Controller	{"controller": "keptnappversion", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnAppVersion"}
2024-12-17T02:06:19Z	INFO	Starting EventSource	{"controller": "keptnevaluation", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnEvaluation", "source": "kind source: *v1.KeptnEvaluation"}
2024-12-17T02:06:19Z	INFO	Starting Controller	{"controller": "keptnevaluation", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnEvaluation"}
2024-12-17T02:06:19Z	INFO	Starting workers	{"controller": "keptnworkload", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnWorkload", "worker count": 1}
2024-12-17T02:06:19Z	INFO	KeptnWorkload Controller	Searching for workload	{"requestInfo": {"name":"content-storage-api-internal","namespace":"content-storage-api"}}
2024-12-17T02:06:19Z	INFO	KeptnWorkload Controller	Reconciling Keptn Workload	{"workload": "content-storage-api-internal", "requestInfo": {"name":"content-storage-api-internal","namespace":"content-storage-api"}}
2024-12-17T02:06:19Z	INFO	KeptnWorkload Controller	Searching for workload	{"requestInfo": {"name":"content-storage-api-public","namespace":"content-storage-api"}}
2024-12-17T02:06:19Z	INFO	KeptnWorkload Controller	Reconciling Keptn Workload	{"workload": "content-storage-api-public", "requestInfo": {"name":"content-storage-api-public","namespace":"content-storage-api"}}
2024-12-17T02:06:19Z	INFO	KeptnWorkload Controller	Searching for workload	{"requestInfo": {"name":"www-gone-www-gone","namespace":"www-gone"}}
2024-12-17T02:06:19Z	INFO	KeptnWorkload Controller	Reconciling Keptn Workload	{"workload": "www-gone-www-gone", "requestInfo": {"name":"www-gone-www-gone","namespace":"www-gone"}}
2024/12/17 02:06:19 http: TLS handshake error from 172.19.0.20:45996: EOF
2024/12/17 02:06:19 http: TLS handshake error from 172.19.3.16:49854: EOF
2024-12-17T02:06:20Z	INFO	Starting workers	{"controller": "keptnappcreationrequest", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnAppCreationRequest", "worker count": 1}
2024-12-17T02:06:20Z	INFO	Starting workers	{"controller": "keptnapp", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnApp", "worker count": 1}
2024-12-17T02:06:20Z	INFO	KeptnApp Controller	Searching for App	{"requestInfo": {"name":"content-storage-api","namespace":"content-storage-api"}}
2024-12-17T02:06:20Z	INFO	KeptnApp Controller	Reconciling Keptn App	{"app": "content-storage-api"}
2024-12-17T02:06:20Z	INFO	KeptnApp Controller	Searching for App	{"requestInfo": {"name":"www-gone","namespace":"www-gone"}}
2024-12-17T02:06:20Z	INFO	KeptnApp Controller	Reconciling Keptn App	{"app": "www-gone"}
2024-12-17T02:06:20Z	INFO	Starting workers	{"controller": "keptntask", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnTask", "worker count": 1}
2024-12-17T02:06:20Z	INFO	Starting workers	{"controller": "pod", "controllerGroup": "", "controllerKind": "Pod", "worker count": 1}
2024-12-17T02:06:20Z	INFO	Starting workers	{"controller": "keptntaskdefinition", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnTaskDefinition", "worker count": 1}
2024-12-17T02:06:20Z	INFO	KeptnTaskDefinition Controller	Reconciling KeptnTaskDefinition	{"requestInfo": {"name":"notify","namespace":"www-gone"}}
2024-12-17T02:06:20Z	INFO	KeptnTaskDefinition Controller	Finished Reconciling KeptnTaskDefinition	{"requestInfo": {"name":"notify","namespace":"www-gone"}}
2024-12-17T02:06:20Z	INFO	KeptnTaskDefinition Controller	Reconciling KeptnTaskDefinition	{"requestInfo": {"name":"notify","namespace":"content-storage-api"}}
2024-12-17T02:06:20Z	INFO	KeptnTaskDefinition Controller	Finished Reconciling KeptnTaskDefinition	{"requestInfo": {"name":"notify","namespace":"content-storage-api"}}
2024-12-17T02:06:20Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:06:20Z	INFO	Starting workers	{"controller": "keptnworkloadversion", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnWorkloadVersion", "worker count": 1}
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Searching for KeptnWorkloadVersion	{"requestInfo": {"name":"content-storage-api-public-1.87.0","namespace":"content-storage-api"}}
2024-12-17T02:06:20Z	INFO	Starting workers	{"controller": "keptnevaluation", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnEvaluation", "worker count": 1}
2024-12-17T02:06:20Z	INFO	Starting workers	{"controller": "keptnappversion", "controllerGroup": "lifecycle.keptn.sh", "controllerKind": "KeptnAppVersion", "worker count": 1}
2024-12-17T02:06:20Z	INFO	KeptnAppVersion Controller	Searching for Keptn App Version	{"requestInfo": {"name":"content-storage-api-74335cda64-4e074085","namespace":"content-storage-api"}}
2024-12-17T02:06:20Z	INFO	KeptnAppVersion Controller	Emitting event using *eventsender.cloudEvent
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Emitting event using *eventsender.cloudEvent
2024-12-17T02:06:20Z	INFO	KeptnAppVersion Controller	Emitting event using *eventsender.k8sEvent
2024-12-17T02:06:20Z	INFO	KeptnAppVersion Controller	Increasing app count
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Emitting event using *eventsender.k8sEvent
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Increasing deployment count
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Searching for KeptnWorkloadVersion	{"requestInfo": {"name":"content-storage-api-public-1.88.0","namespace":"content-storage-api"}}
2024-12-17T02:06:20Z	DEBUG	events	App Completed: has finished / Namespace: content-storage-api, Name: content-storage-api-74335cda64-4e074085, Version: 74335cda64	{"type": "Normal", "object": {"kind":"KeptnAppVersion","namespace":"content-storage-api","name":"content-storage-api-74335cda64-4e074085","uid":"d6319536-58b6-4693-9a8a-2aa75c32016a","apiVersion":"lifecycle.keptn.sh/v1","resourceVersion":"2027090182"}, "reason": "AppCompletedFinished"}
2024-12-17T02:06:20Z	DEBUG	events	Workload Completed: has finished / Namespace: content-storage-api, Name: content-storage-api-public-1.87.0, Version: 1.87.0	{"type": "Normal", "object": {"kind":"KeptnWorkloadVersion","namespace":"content-storage-api","name":"content-storage-api-public-1.87.0","uid":"277cb892-6351-4fd5-b4e2-d32479851d57","apiVersion":"lifecycle.keptn.sh/v1","resourceVersion":"2024328091"}, "reason": "WorkloadCompletedFinished"}
2024-12-17T02:06:20Z	INFO	KeptnAppVersion Controller	Searching for Keptn App Version	{"requestInfo": {"name":"www-gone-1.46.0-6b86b273","namespace":"www-gone"}}
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Emitting event using *eventsender.cloudEvent
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Emitting event using *eventsender.k8sEvent
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Increasing deployment count
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Searching for KeptnWorkloadVersion	{"requestInfo": {"name":"content-storage-api-public-1.89.0","namespace":"content-storage-api"}}
2024-12-17T02:06:20Z	DEBUG	events	Workload Completed: has finished / Namespace: content-storage-api, Name: content-storage-api-public-1.88.0, Version: 1.88.0	{"type": "Normal", "object": {"kind":"KeptnWorkloadVersion","namespace":"content-storage-api","name":"content-storage-api-public-1.88.0","uid":"f78c5ef1-ea4c-4aff-90e4-736f4cab4e8b","apiVersion":"lifecycle.keptn.sh/v1","resourceVersion":"2024351673"}, "reason": "WorkloadCompletedFinished"}
2024-12-17T02:06:20Z	INFO	KeptnAppVersion Controller	Emitting event using *eventsender.cloudEvent
2024-12-17T02:06:20Z	INFO	KeptnAppVersion Controller	Emitting event using *eventsender.k8sEvent
2024-12-17T02:06:20Z	INFO	KeptnAppVersion Controller	Increasing app count
2024-12-17T02:06:20Z	DEBUG	events	App Completed: has finished / Namespace: www-gone, Name: www-gone-1.46.0-6b86b273, Version: 1.46.0	{"type": "Normal", "object": {"kind":"KeptnAppVersion","namespace":"www-gone","name":"www-gone-1.46.0-6b86b273","uid":"026d2120-99dd-4781-8df1-752095eed20e","apiVersion":"lifecycle.keptn.sh/v1","resourceVersion":"2024239802"}, "reason": "AppCompletedFinished"}
2024-12-17T02:06:20Z	INFO	KeptnAppVersion Controller	Searching for Keptn App Version	{"requestInfo": {"name":"content-storage-api-084f8bb817-d4735e3a","namespace":"content-storage-api"}}
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Emitting event using *eventsender.cloudEvent
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Emitting event using *eventsender.k8sEvent
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Increasing deployment count
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Searching for KeptnWorkloadVersion	{"requestInfo": {"name":"www-gone-www-gone-1.46.0","namespace":"www-gone"}}
2024-12-17T02:06:20Z	DEBUG	events	Workload Completed: has finished / Namespace: content-storage-api, Name: content-storage-api-public-1.89.0, Version: 1.89.0	{"type": "Normal", "object": {"kind":"KeptnWorkloadVersion","namespace":"content-storage-api","name":"content-storage-api-public-1.89.0","uid":"d9c8d838-8fda-479b-ae7b-76acd43ae88b","apiVersion":"lifecycle.keptn.sh/v1","resourceVersion":"2027089845"}, "reason": "WorkloadCompletedFinished"}
2024-12-17T02:06:20Z	INFO	KeptnAppVersion Controller	Emitting event using *eventsender.cloudEvent
2024-12-17T02:06:20Z	INFO	KeptnAppVersion Controller	Emitting event using *eventsender.k8sEvent
2024-12-17T02:06:20Z	INFO	KeptnAppVersion Controller	Increasing app count
2024-12-17T02:06:20Z	INFO	KeptnAppVersion Controller	Searching for Keptn App Version	{"requestInfo": {"name":"content-storage-api-0a417fbc81-6b86b273","namespace":"content-storage-api"}}
2024-12-17T02:06:20Z	DEBUG	events	App Completed: has finished / Namespace: content-storage-api, Name: content-storage-api-084f8bb817-d4735e3a, Version: 084f8bb817	{"type": "Normal", "object": {"kind":"KeptnAppVersion","namespace":"content-storage-api","name":"content-storage-api-084f8bb817-d4735e3a","uid":"b515f2a1-a481-40c9-9b46-c6107ebaa1d9","apiVersion":"lifecycle.keptn.sh/v1","resourceVersion":"2024352082"}, "reason": "AppCompletedFinished"}
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Emitting event using *eventsender.cloudEvent
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Emitting event using *eventsender.k8sEvent
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Increasing deployment count
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Searching for KeptnWorkloadVersion	{"requestInfo": {"name":"content-storage-api-internal-1.87.0","namespace":"content-storage-api"}}
2024-12-17T02:06:20Z	DEBUG	events	Workload Completed: has finished / Namespace: www-gone, Name: www-gone-www-gone-1.46.0, Version: 1.46.0	{"type": "Normal", "object": {"kind":"KeptnWorkloadVersion","namespace":"www-gone","name":"www-gone-www-gone-1.46.0","uid":"cc8eb3cc-3af3-45ff-a7bd-dbfad8c2ab73","apiVersion":"lifecycle.keptn.sh/v1","resourceVersion":"2032170514"}, "reason": "WorkloadCompletedFinished"}
2024-12-17T02:06:20Z	INFO	KeptnAppVersion Controller	Emitting event using *eventsender.cloudEvent
2024-12-17T02:06:20Z	INFO	KeptnAppVersion Controller	Emitting event using *eventsender.k8sEvent
2024-12-17T02:06:20Z	INFO	KeptnAppVersion Controller	Increasing app count
2024-12-17T02:06:20Z	DEBUG	events	App Completed: has finished / Namespace: content-storage-api, Name: content-storage-api-0a417fbc81-6b86b273, Version: 0a417fbc81	{"type": "Normal", "object": {"kind":"KeptnAppVersion","namespace":"content-storage-api","name":"content-storage-api-0a417fbc81-6b86b273","uid":"05d9131a-80a3-4245-b0a7-7a7b1d9a49b3","apiVersion":"lifecycle.keptn.sh/v1","resourceVersion":"2024328441"}, "reason": "AppCompletedFinished"}
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Emitting event using *eventsender.cloudEvent
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Emitting event using *eventsender.k8sEvent
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Increasing deployment count
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Searching for KeptnWorkloadVersion	{"requestInfo": {"name":"content-storage-api-internal-1.88.0","namespace":"content-storage-api"}}
2024-12-17T02:06:20Z	DEBUG	events	Workload Completed: has finished / Namespace: content-storage-api, Name: content-storage-api-internal-1.87.0, Version: 1.87.0	{"type": "Normal", "object": {"kind":"KeptnWorkloadVersion","namespace":"content-storage-api","name":"content-storage-api-internal-1.87.0","uid":"ca5adc3b-9bc7-436b-be3a-56ef3ad6bb4a","apiVersion":"lifecycle.keptn.sh/v1","resourceVersion":"2024328095"}, "reason": "WorkloadCompletedFinished"}
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Emitting event using *eventsender.cloudEvent
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Emitting event using *eventsender.k8sEvent
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Increasing deployment count
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Searching for KeptnWorkloadVersion	{"requestInfo": {"name":"content-storage-api-internal-1.89.0","namespace":"content-storage-api"}}
2024-12-17T02:06:20Z	DEBUG	events	Workload Completed: has finished / Namespace: content-storage-api, Name: content-storage-api-internal-1.88.0, Version: 1.88.0	{"type": "Normal", "object": {"kind":"KeptnWorkloadVersion","namespace":"content-storage-api","name":"content-storage-api-internal-1.88.0","uid":"f2b69500-2266-4c2c-83e4-fda62b745938","apiVersion":"lifecycle.keptn.sh/v1","resourceVersion":"2024351668"}, "reason": "WorkloadCompletedFinished"}
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Emitting event using *eventsender.cloudEvent
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Emitting event using *eventsender.k8sEvent
2024-12-17T02:06:20Z	INFO	KeptnWorkloadVersion Controller	Increasing deployment count
2024-12-17T02:06:20Z	DEBUG	events	Workload Completed: has finished / Namespace: content-storage-api, Name: content-storage-api-internal-1.89.0, Version: 1.89.0	{"type": "Normal", "object": {"kind":"KeptnWorkloadVersion","namespace":"content-storage-api","name":"content-storage-api-internal-1.89.0","uid":"82e7253e-6a2b-48c3-bc1a-c78367c76875","apiVersion":"lifecycle.keptn.sh/v1","resourceVersion":"2027089639"}, "reason": "WorkloadCompletedFinished"}
2024-12-17T02:06:20Z	INFO	Starting workers	{"controller": "keptnconfig", "controllerGroup": "options.keptn.sh", "controllerKind": "KeptnConfig", "worker count": 1}
2024-12-17T02:06:20Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:06:20Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:06:20Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:06:30Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:06:30Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:06:30Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:06:30Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:06:40Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:06:40Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:06:40Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:06:40Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:06:50Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:06:50Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:06:50Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:06:50Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:07:00Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:07:00Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:07:00Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:07:00Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:07:10Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:07:10Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:07:10Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:07:10Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:07:20Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:07:20Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:07:20Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:07:20Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:07:30Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:07:30Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:07:30Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:07:30Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:07:40Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:07:40Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:07:40Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:07:40Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:07:50Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:07:50Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:07:50Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:07:50Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:08:00Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:08:00Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:08:00Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:08:00Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:08:10Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:08:10Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:08:10Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:08:10Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:08:20Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:08:20Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:08:20Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:08:20Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:08:30Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:08:30Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:08:30Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:08:30Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:08:40Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:08:40Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:08:40Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:08:41Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:08:50Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:08:50Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:08:51Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:08:51Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:09:00Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:09:00Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:09:01Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:09:01Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:09:10Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:09:10Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:09:11Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:09:11Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:09:20Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:09:20Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:09:21Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:09:21Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:09:30Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:09:30Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:09:31Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:09:31Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:09:40Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:09:40Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:09:41Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:09:41Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:09:44Z	INFO	Mutating Webhook	webhook for pod called
2024-12-17T02:09:44Z	INFO	Mutating Webhook	webhook for pod called
2024-12-17T02:09:44Z	INFO	Mutating Webhook	webhook for pod called
2024-12-17T02:09:44Z	INFO	Mutating Webhook	owner of pod is not supported by lifecycle operator	{"namespace": "content-storage-api", "pod": ""}
2024-12-17T02:09:44Z	INFO	Mutating Webhook	owner of pod is not supported by lifecycle operator	{"namespace": "content-storage-api", "pod": ""}
2024-12-17T02:09:44Z	INFO	Mutating Webhook	owner of pod is not supported by lifecycle operator	{"namespace": "content-storage-api", "pod": ""}
2024-12-17T02:09:44Z	INFO	Mutating Webhook	webhook for pod called
2024-12-17T02:09:46Z	INFO	Mutating Webhook	owner of pod is not supported by lifecycle operator	{"namespace": "www-gone", "pod": ""}
2024-12-17T02:09:50Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-23191","namespace":"content-storage-api"}}
2024-12-17T02:09:50Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-87673","namespace":"content-storage-api"}}
2024-12-17T02:09:51Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-96002","namespace":"content-storage-api"}}
2024-12-17T02:09:51Z	INFO	KeptnTask Controller	Reconciling KeptnTask	{"requestInfo": {"name":"post-notify-81860","namespace":"www-gone"}}
2024-12-17T02:09:52Z	INFO	Mutating Webhook	webhook for pod called
2024-12-17T02:09:52Z	INFO	Mutating Webhook	owner of pod is not supported by lifecycle operator	{"namespace": "www-gone", "pod": "post-notify-81860-36408-b6chf"}
2024-12-17T02:09:52Z	INFO	Mutating Webhook	webhook for pod called
2024-12-17T02:09:52Z	INFO	Mutating Webhook	owner of pod is not supported by lifecycle operator	{"namespace": "content-storage-api", "pod": "post-notify-23191-42765-l8pzx"}
2024-12-17T02:09:52Z	INFO	Mutating Webhook	webhook for pod called
2024-12-17T02:09:52Z	INFO	Mutating Webhook	owner of pod is not supported by lifecycle operator	{"namespace": "content-storage-api", "pod": "post-notify-96002-78169-zmfgz"}
2024-12-17T02:09:52Z	INFO	Mutating Webhook	webhook for pod called
2024-12-17T02:09:52Z	INFO	Mutating Webhook	owner of pod is not supported by lifecycle operator	{"namespace": "content-storage-api", "pod": "post-notify-87673-49339-pm642"}
@odubajDT
Copy link
Contributor

Thank you for submitting the issue, can you please share which version of Keptn and K8s are you using?

@wosc
Copy link
Author

wosc commented Dec 18, 2024

Yes, sorry, I should have noted that immediately:

  • keptn 2.0.0
  • kubernetes 1.30.6 (on Google Cloud)

@odubajDT
Copy link
Contributor

Thank you, We had a similar issue with K8s 1.30 recently, but it was fixed in the latest version (2.4.0). Can you please try to update tot he latest version to see if the problem still persists?

Thank you!

@odubajDT
Copy link
Contributor

Hi, any updates ?

@wosc
Copy link
Author

wosc commented Dec 20, 2024

Sorry, there has been a misunderstanding on my part: we are in fact running keptn-2.4 (I was confused because the lifecycle-operator image announces its version as 2.0.0)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants