爬虫Larbin解析(二)——sequencer()

分析的函数: void sequencer() 

//位置：larbin-2.6.3/src/fetch/sequencer.cc
void sequencer() 
{
    bool testPriority = true;
    if (space == 0)                //unit space = 0
    {
        space = global::inter->putAll();
    }
    int still = space;
    if (still > maxPerCall)        //#define maxPerCall 100
        still = maxPerCall;
    while (still) 
    {
        if (canGetUrl(&testPriority)) 
        {
            --space; 
            --still; 
        } 
        else 
        { 
            still = 0; 
        } 
    }
}

所在的文件

larbin-2.6.3/src/fetch/sequencer.h、larbin-2.6.3/src/fetch/sequencer.cc

// Larbin
// Sebastien Ailleret
// 15-11-99 -> 15-11-99

#ifndef SEQUENCER_H
#define SEQUENCER_H

/** only for debugging, handle with care */
extern uint space;

/** Call the sequencer */
void sequencer ();

#endif

View Code