Skip to content

Commit 09854a1

Browse files
committed
improve comment
1 parent 0d708f6 commit 09854a1

File tree

1 file changed

+6
-1
lines changed

1 file changed

+6
-1
lines changed

shub_workflow/crawl.py

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -89,7 +89,12 @@ class CrawlManager(SpiderStatsAggregatorMixin, WorkFlowManager, CrawlManagerProt
8989

9090
spider: Optional[SpiderName] = None
9191

92-
# If False, don't check running jobs state in reverse order
92+
# If False, check running jobs from older to newer
93+
# If True, check running jobs from newer to older.
94+
# The check order may have some implications on some applications
95+
# (for example, when analyzing running jobs for implementing
96+
# throttling algorithms based on concurrency, we may want always
97+
# the data from the most recent job)
9398
running_jobs_reverse_check = False
9499

95100
def __init__(self):

0 commit comments

Comments
 (0)