<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> <HTML ><HEAD ><TITLE >URLSelectCacheSize</TITLE ><META NAME="GENERATOR" CONTENT="Modular DocBook HTML Stylesheet Version 1.79"><LINK REL="HOME" TITLE="mnoGoSearch 3.3.9 reference manual" HREF="index.html"><LINK REL="UP" TITLE="mnoGoSearch command reference" HREF="msearch-cmdref.html"><LINK REL="PREVIOUS" TITLE="URLDataThreshold" HREF="msearch-cmdref-urldatathreshold.html"><LINK REL="NEXT" TITLE="URLSelectSkipLock" HREF="msearch-cmdref-urlselectskiplock.html"><LINK REL="STYLESHEET" TYPE="text/css" HREF="mnogo.css"><META NAME="Description" CONTENT="mnoGoSearch - Full Featured Web site Open Source Search Engine Software over the Internet and Intranet Web Sites Based on SQL Database. It is a Free search software covered by GNU license."><META NAME="Keywords" CONTENT="shareware, freeware, download, internet, unix, utilities, search engine, text retrieval, knowledge retrieval, text search, information retrieval, database search, mining, intranet, webserver, index, spider, filesearch, meta, free, open source, full-text, udmsearch, website, find, opensource, search, searching, software, udmsearch, engine, indexing, system, web, ftp, http, cgi, php, SQL, MySQL, database, php3, FreeBSD, Linux, Unix, mnoGoSearch, MacOS X, Mac OS X, Windows, 2000, NT, 95, 98, GNU, GPL, url, grabbing"></HEAD ><BODY CLASS="refentry" BGCOLOR="#EEEEEE" TEXT="#000000" LINK="#000080" VLINK="#800080" ALINK="#FF0000" ><!--#include virtual="body-before.html"--><DIV CLASS="NAVHEADER" ><TABLE SUMMARY="Header navigation table" WIDTH="100%" BORDER="0" CELLPADDING="0" CELLSPACING="0" ><TR ><TH COLSPAN="3" ALIGN="center" ><SPAN CLASS="application" >mnoGoSearch</SPAN > 3.3.9 reference manual: Full-featured search engine software</TH ></TR ><TR ><TD WIDTH="10%" ALIGN="left" VALIGN="bottom" ><A HREF="msearch-cmdref-urldatathreshold.html" ACCESSKEY="P" >Prev</A ></TD ><TD WIDTH="80%" ALIGN="center" VALIGN="bottom" ></TD ><TD WIDTH="10%" ALIGN="right" VALIGN="bottom" ><A HREF="msearch-cmdref-urlselectskiplock.html" ACCESSKEY="N" >Next</A ></TD ></TR ></TABLE ><HR ALIGN="LEFT" WIDTH="100%"></DIV ><H1 ><A NAME="cmdref-urlselectcachesize" ></A >URLSelectCacheSize</H1 ><DIV CLASS="refnamediv" ><A NAME="AEN13233" ></A ><H2 >Name</H2 ><B CLASS="command" >URLSelectCacheSize</B > -- sets <ACRONYM CLASS="acronym" >URL</ACRONYM > cache size for <SPAN CLASS="application" >indexer</SPAN ><P ><B ></B ><TT CLASS="filename" >indexer.conf</TT ></P ></DIV ><DIV CLASS="refsynopsisdiv" ><A NAME="AEN13241" ></A ><H2 >Synopsis</H2 ><P ><B CLASS="command" >URLSelectCacheSize</B > {number}</P ></DIV ><DIV CLASS="refsect1" ><A NAME="AEN13245" ></A ><H2 >Description</H2 ><P ><B CLASS="command" >URLSelectCacheSize</B > defines the number of <ACRONYM CLASS="acronym" >URL</ACRONYM >s to load from the database as crawler targets in a single portion. The bigger number makes crawling performance better, however in case when <SPAN CLASS="application" >indexer</SPAN > crashes or is killed or is terminated using <TT CLASS="literal" >Ctrl-Break</TT >, some documents will get stuck in crawling queue and won't be available for crawling for <TT CLASS="literal" >4 hours</TT >. </P ><DIV CLASS="note" ><BLOCKQUOTE CLASS="note" ><P ><B >Note: </B > To make stuck documents available for crawling use <B CLASS="command" >indexer -a</B > flag, in combination with suitable <A HREF="msearch-indexing.html#general-subsect" >subsection control</A > option, like <TT CLASS="literal" >-s</TT >, <TT CLASS="literal" >-u</TT >, etc. </P ></BLOCKQUOTE ></DIV ><P > The default value is <TT CLASS="literal" >128</TT >. </P ></DIV ><DIV CLASS="refsect1" ><A NAME="AEN13261" ></A ><H2 >Examples</H2 ><DIV CLASS="informalexample" ><P ></P ><A NAME="AEN13263" ></A ><PRE CLASS="programlisting" > URLSelectCacheSize 1024 </PRE ><P ></P ></DIV ></DIV ><DIV CLASS="refsect1" ><A NAME="AEN13265" ></A ><H2 >See also</H2 ><P > <A HREF="msearch-cmdref-urlselectskiplock.html" >URLSelectSkipLock</A >. </P ></DIV ><DIV CLASS="NAVFOOTER" ><HR ALIGN="LEFT" WIDTH="100%"><TABLE SUMMARY="Footer navigation table" WIDTH="100%" BORDER="0" CELLPADDING="0" CELLSPACING="0" ><TR ><TD WIDTH="33%" ALIGN="left" VALIGN="top" ><A HREF="msearch-cmdref-urldatathreshold.html" ACCESSKEY="P" >Prev</A ></TD ><TD WIDTH="34%" ALIGN="center" VALIGN="top" ><A HREF="index.html" ACCESSKEY="H" >Home</A ></TD ><TD WIDTH="33%" ALIGN="right" VALIGN="top" ><A HREF="msearch-cmdref-urlselectskiplock.html" ACCESSKEY="N" >Next</A ></TD ></TR ><TR ><TD WIDTH="33%" ALIGN="left" VALIGN="top" >URLDataThreshold</TD ><TD WIDTH="34%" ALIGN="center" VALIGN="top" ><A HREF="msearch-cmdref.html" ACCESSKEY="U" >Up</A ></TD ><TD WIDTH="33%" ALIGN="right" VALIGN="top" >URLSelectSkipLock</TD ></TR ></TABLE ></DIV ><!--#include virtual="body-after.html"--></BODY ></HTML >