alecodes/synchronizator
2
0
Fork 0
Code Issues 2 Pull requests Projects Releases Packages Wiki Activity Actions

[Feature]: Implement concurrent task execution #4

New issue
Open
opened 2025-05-15 10:00:36 -04:00 by anavarro · 0 comments
anavarro commented 2025-05-15 10:00:36 -04:00
Member
Copy link

Type of Feature

✨ New Feature

Description

The tasks should be executed in concurrency matter to improve performance

Completion criteria

  • Execute tasks
  • Accept a concurrency limit, should be implemented in a struct with a "limiter" trait
    • Buffer limit (no more than N tasks at maximum)
    • Rate limit (no more than N tasks per time interval)
    • Ticket bucket (one task per N time, with possible M buffered tasks)
  • Handle tasks failure
    • Retries from recoverable failure
    • Timeout for retry
    • Skip unrecoverable failures
    • Stop execution after N consecutives failures

Additional Information

  • An actor system could be useful here but also increase complexity unnecessary
  • The simplest way would be to just process a Stream but that leaves little control over the rate at which tasks are processed
### Type of Feature ✨ New Feature ### Description The tasks should be executed in concurrency matter to improve performance ### Completion criteria - [ ] Execute tasks - [ ] Accept a concurrency limit, should be implemented in a struct with a _"limiter"_ trait - [ ] Buffer limit (no more than N tasks at maximum) - [ ] Rate limit (no more than N tasks per time interval) - [ ] Ticket bucket (one task per N time, with possible M buffered tasks) - [ ] Handle tasks failure - [ ] Retries from recoverable failure - [ ] Timeout for retry - [ ] Skip unrecoverable failures - [ ] Stop execution after N consecutives failures ### Additional Information - An actor system could be useful here but also increase complexity unnecessary - The simplest way would be to just process a Stream but that leaves little control over the rate at which tasks are processed
anavarro added the
Priority
Low
Severity
Low
Type
Feature
Status
Pending
 labels 2025-05-15 10:00:36 -04:00
anavarro added this to the v0.0.1 milestone 2025-05-15 10:01:06 -04:00
Sign in to join this conversation.
development
Branches Tags
Clear current reference
main
refactor/module-and-structs-patterns
development
refactor/re-structure-project
Clear current reference
No results found.
Labels
Clear labels
  
Outtakes/Blog Post

This can be used as a blog post content

  
Outtakes/Research

This can be further investigated

  
Outtakes/Resource

This can be used as a wiki resource

  
Priority
Critical
Do it now

  
Priority
High
Do it next

  
Priority
Low
It may be done

  
Priority
Medium
Do it when posible

  
Severity
Critical
Is provocking harmfull behavior

  
Severity
High
Is blocking or un-usable

  
Severity
Low
Is inconvinient

  
Severity
Medium
Is Broken with a workarround

  
Status
Abandoned
Work has been done but later abandoned

  
Status
Accepted
This has been reviwed and accepted

  
Status
Blocked
Something is blocking this

  
Status
Need More Info
Research or feedback is required to continue

  
Status
Out Of Scope
This is out of the [current] scope

  
Status
Pending
In waiting of evaluation

  
Status
Won't do
This will not be implemented

  
Type
Bug
Something is not working

  
Type
Documentation
Documentation changes

  
Type
Feature
New functionality

  
Type
Idea
Just an idea for now

  
Type
Testing
Needs testing

No labels
Outtakes/Blog Post
Outtakes/Research
Outtakes/Resource
Priority
Critical
Priority
High
Priority
Low
Priority
Medium
Severity
Critical
Severity
High
Severity
Low
Severity
Medium
Status
Abandoned
Status
Accepted
Status
Blocked
Status
Need More Info
Status
Out Of Scope
Status
Pending
Status
Won't do
Type
Bug
Type
Documentation
Type
Feature
Type
Idea
Type
Testing
Milestone
Clear milestone
No items
No milestone
v0.0.1
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: alecodes/synchronizator#4
No description provided.
Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?