Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handle stream operations #20

Open
9 tasks
vertexclique opened this issue Mar 29, 2022 · 4 comments
Open
9 tasks

Handle stream operations #20

vertexclique opened this issue Mar 29, 2022 · 4 comments
Labels
enhancement New feature or request Nightmare Hardcore features or bugs to deal with.

Comments

@vertexclique
Copy link
Collaborator

  • group_by
  • items: iterate over both key and value at the same time
  • events: access raw events
  • take: buffer up specific amount of values from a stream
  • enumerate: count values
  • through: forward through yet another topic/stream.
  • filter: filter values to omit from stream
  • echo: repeat to one or more topics.
  • and other ordinary iterators that can be inherited from Iterators/futures::Stream.
@vertexclique vertexclique added enhancement New feature or request Nightmare Hardcore features or bugs to deal with. labels Mar 29, 2022
@nicor88
Copy link

nicor88 commented Apr 11, 2022

For take operations will be nice to handle both amount of record and within timeout, to avoid to stale processing when the amount of values is not reached.

@vertexclique
Copy link
Collaborator Author

I didn't quite get it. What do you mean by stale processing when values aren't raced?

@nicor88
Copy link

nicor88 commented Apr 26, 2022

@vertexclique check the implementation of take on faust. It supports an amount of records, in combination with a parameter called within.

Imaging to have a stream.take(100).

The problem with the above code is that it will block forever if there are 99 messages and the last hundredth message is never received.
To solve this add a within timeout so that up to 100 values will be processed within 10 seconds.

cit.

So it will be nice to have such feature in callysto too.

@vertexclique
Copy link
Collaborator Author

ok makes sense.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Nightmare Hardcore features or bugs to deal with.
Projects
None yet
Development

No branches or pull requests

2 participants