Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Gauge metrics are not extracted in metrics result. #33448

Open
1 of 17 tasks
rohitsinha54 opened this issue Dec 25, 2024 · 3 comments
Open
1 of 17 tasks

[Bug]: Gauge metrics are not extracted in metrics result. #33448

rohitsinha54 opened this issue Dec 25, 2024 · 3 comments
Assignees

Comments

@rohitsinha54
Copy link
Contributor

What happened?

Specifically they are missing from addMetricResult here

This would mean that customer cannot query back gauge metrics in their job programatically.

Issue Priority

Priority: 2 (default / most bugs should be filed as P2)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Infrastructure
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner
@kavyakapoor420
Copy link

Hey @rohitsinha54

i am working on a fix for this issue .
the problem seems to be the missing logic for processing Gauge metrics in the "addMetricResult" method .

i will add a conditional Block to handle gauge metrics .

could u please assign this issue to me ?

@rohitsinha54
Copy link
Contributor Author

I believe you can assignee the issue to yourself by comment .take-issue.

kavyakapoor420 added a commit to kavyakapoor420/AacheBugFix that referenced this issue Jan 3, 2025
…esult

This commit adds the necessary logic in the `addMetricResult` method to properly handle and extract gauge metrics from the committed and attempted updates. Previously, gauge metrics were missing from the metrics result, which prevented customers from querying them programmatically in Dataflow jobs.

The fix includes:
- Adding a conditional block to check for `getGauge()` in the MetricUpdate.
- Ensuring that gauge metrics are added to the `gaugeResults` collection.

This change should resolve issue apache#33448.
kavyakapoor420 added a commit to kavyakapoor420/AacheBugFix that referenced this issue Jan 3, 2025
@kavyakapoor420 kavyakapoor420 removed their assignment Jan 3, 2025
@kavyakapoor420
Copy link

.take-issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants