Commit f111503d authored by Nirbheek Chauhan's avatar Nirbheek Chauhan 🐜
Browse files

cerbero: Allocate two jobs for fetching when we have lots of jobs

Same as fetch-{package,bootstrap} and it's good to assume that we will
be bottlenecked on network I/O or single-threaded CPU in this case.

Part-of: <!616>
parent fec066af
......@@ -352,7 +352,10 @@ class Oven (object):
job_allocation[BuildSteps.EXTRACT[1]] = 1
queues[BuildSteps.EXTRACT[1]] = asyncio.PriorityQueue(loop=loop)
if self.jobs > 9:
job_allocation[BuildSteps.FETCH[1]] = 1
# Two jobs is the same allocation as fetch-package/bootstrap, which
# is a good idea to avoid getting bottlenecked if one of the
# download mirrors is slow.
job_allocation[BuildSteps.FETCH[1]] = 2
queues[BuildSteps.FETCH[1]] = asyncio.PriorityQueue(loop=loop)
# async locks used to synchronize step execution
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment