Repository navigation
Evaluation: Separate queue for jobs #1261
Description
Is your feature request related to a problem?
The current setup combines eval jobs in the main Celery queue, which limits kaapi's capacity to handle concurrent eval jobs. This affects performance and increases wait times.
Describe the solution you'd like
- Implement a separate Celery queue for eval jobs.
- Utilize a 12/4 fork split to improve concurrent handling.
Original issue
Describe the current behavior
Separate Celery queue for eval jobs (12/4 fork split). This will improve the capacity of kaapi to handle concurrent eval jobs
Activity
[-]Celery: Separate Celery queue for eval jobs[/-][+]Evaluation: Separate queue for jobs[/+]