<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> <HTML ><HEAD ><TITLE > HTTP response codes mnoGoSearch understands </TITLE ><META NAME="GENERATOR" CONTENT="Modular DocBook HTML Stylesheet Version 1.79"><LINK REL="HOME" TITLE="mnoGoSearch 3.3.9 reference manual" HREF="index.html"><LINK REL="UP" TITLE="Indexing" HREF="msearch-indexing.html"><LINK REL="PREVIOUS" TITLE="Indexing" HREF="msearch-indexing.html"><LINK REL="NEXT" TITLE="Content-Encoding support " HREF="msearch-content-enc.html"><LINK REL="STYLESHEET" TYPE="text/css" HREF="mnogo.css"><META NAME="Description" CONTENT="mnoGoSearch - Full Featured Web site Open Source Search Engine Software over the Internet and Intranet Web Sites Based on SQL Database. It is a Free search software covered by GNU license."><META NAME="Keywords" CONTENT="shareware, freeware, download, internet, unix, utilities, search engine, text retrieval, knowledge retrieval, text search, information retrieval, database search, mining, intranet, webserver, index, spider, filesearch, meta, free, open source, full-text, udmsearch, website, find, opensource, search, searching, software, udmsearch, engine, indexing, system, web, ftp, http, cgi, php, SQL, MySQL, database, php3, FreeBSD, Linux, Unix, mnoGoSearch, MacOS X, Mac OS X, Windows, 2000, NT, 95, 98, GNU, GPL, url, grabbing"></HEAD ><BODY CLASS="sect1" BGCOLOR="#EEEEEE" TEXT="#000000" LINK="#000080" VLINK="#800080" ALINK="#FF0000" ><!--#include virtual="body-before.html"--><DIV CLASS="NAVHEADER" ><TABLE SUMMARY="Header navigation table" WIDTH="100%" BORDER="0" CELLPADDING="0" CELLSPACING="0" ><TR ><TH COLSPAN="3" ALIGN="center" ><SPAN CLASS="application" >mnoGoSearch</SPAN > 3.3.9 reference manual: Full-featured search engine software</TH ></TR ><TR ><TD WIDTH="10%" ALIGN="left" VALIGN="bottom" ><A HREF="msearch-indexing.html" ACCESSKEY="P" >Prev</A ></TD ><TD WIDTH="80%" ALIGN="center" VALIGN="bottom" >Chapter 3. Indexing</TD ><TD WIDTH="10%" ALIGN="right" VALIGN="bottom" ><A HREF="msearch-content-enc.html" ACCESSKEY="N" >Next</A ></TD ></TR ></TABLE ><HR ALIGN="LEFT" WIDTH="100%"></DIV ><DIV CLASS="sect1" ><H1 CLASS="sect1" ><A NAME="http-codes" >HTTP response codes <SPAN CLASS="application" >mnoGoSearch</SPAN > understands</A ></H1 ><P >This sections describes how <SPAN CLASS="application" >mnoGoSearch</SPAN > processes various HTTP codes at crawling time. </P ><P ></P ><UL ><LI ><P ><TT CLASS="literal" >200 OK</TT ></P ><P ></P ><OL TYPE="1" ><LI ><P >If the <CODE CLASS="option" >-m</CODE > command line argument ("force reindex") specified, GOTO 4. </P ></LI ><LI ><P > Comparing the new checksum with the old one stored in database </P ></LI ><LI ><P >If the checksum are the equal, <CODE CLASS="varname" >next_index_time</CODE >= <TT CLASS="literal" >Now()</TT > + <B CLASS="command" ><A HREF="msearch-cmdref-period.html" >Period</A ></B >, GOTO 7. </P ></LI ><LI ><P > Parsing the document, creating word list and adding all found links into the <TT CLASS="literal" >url</TT > table. </P ></LI ><LI ><P > Updating all information about the document in the database. </P ></LI ><LI ><P >Done</P ></LI ></OL ></LI ><LI ><P ><TT CLASS="literal" >304 Not Modified</TT ></P ><P ></P ><OL TYPE="1" ><LI ><P > <CODE CLASS="varname" >next_index_time</CODE >=<TT CLASS="literal" >now()</TT > + <B CLASS="command" ><A HREF="msearch-cmdref-period.html" >Period</A ></B >. </P ></LI ><LI ><P >Done</P ></LI ></OL ></LI ><LI ><P CLASS="literallayout" ><br> <TT CLASS="literal" >301 Moved Permanently</TT ><br> <TT CLASS="literal" >302 Moved Temporarily</TT ><br> <TT CLASS="literal" >303 See Other</TT ><br> </P ><P ></P ><OL TYPE="1" ><LI ><P > Deleting word and section information about the document. </P ></LI ><LI ><P > <CODE CLASS="varname" >next_index_time</CODE > = <TT CLASS="literal" >Now()</TT > + <B CLASS="command" ><A HREF="msearch-cmdref-period.html" >Period</A ></B > </P ></LI ><LI ><P > Adding the URL from the <TT CLASS="literal" >Location: </TT > header into the database. </P ></LI ><LI ><P >Done</P ></LI ></OL ></LI ><LI ><P CLASS="literallayout" ><br> <TT CLASS="literal" >300 Multiple Choices</TT ><br> <TT CLASS="literal" >305 Use Proxy (proxy redirect)</TT ><br> <TT CLASS="literal" >400 Bad Request</TT ><br> <TT CLASS="literal" >401 Unauthorized</TT ><br> <TT CLASS="literal" >402 Payment Required</TT ><br> <TT CLASS="literal" >403 Forbidden</TT ><br> <TT CLASS="literal" >404 Not found</TT ><br> <TT CLASS="literal" >405 Method Not Allowed</TT ><br> <TT CLASS="literal" >406 Not Acceptable</TT ><br> <TT CLASS="literal" >407 Proxy Authentication Required</TT ><br> <TT CLASS="literal" >408 Request Timeout</TT ><br> <TT CLASS="literal" >409 Conflict</TT ><br> <TT CLASS="literal" >410 Gone</TT ><br> <TT CLASS="literal" >411 Length Required</TT ><br> <TT CLASS="literal" >412 Precondition Failed</TT ><br> <TT CLASS="literal" >413 Request Entity Too Large</TT ><br> <TT CLASS="literal" >414 Request-URI Too Long</TT ><br> <TT CLASS="literal" >415 Unsupported Media Type</TT ><br> <TT CLASS="literal" >500 Internal Server Error</TT ><br> <TT CLASS="literal" >501 Not Implemented</TT ><br> <TT CLASS="literal" >502 Bad Gateway</TT ><br> <TT CLASS="literal" >505 Protocol Version Not Supported</TT ><br> </P ><P ></P ><OL TYPE="1" ><LI ><P > Deleting all word and section information about this document. </P ></LI ><LI ><P > <CODE CLASS="varname" >next_index_time</CODE >= <TT CLASS="literal" >Now()</TT > + <B CLASS="command" ><A HREF="msearch-cmdref-period.html" >Period</A ></B > </P ></LI ><LI ><P >Done</P ></LI ></OL ></LI ><LI ><P CLASS="literallayout" ><br> <TT CLASS="literal" >503 Service Unavailable</TT ><br> <TT CLASS="literal" >504 Gateway Timeout</TT ><br> </P ><P ></P ><OL TYPE="1" ><LI ><P > <CODE CLASS="varname" >next_index_time</CODE >= <TT CLASS="literal" >Now()</TT > + <B CLASS="command" ><A HREF="msearch-cmdref-neterrordelaytime.html" >NetErrorDelayTime</A ></B > </P ></LI ><LI ><P >Done</P ></LI ></OL ></LI ></UL ></DIV ><DIV CLASS="NAVFOOTER" ><HR ALIGN="LEFT" WIDTH="100%"><TABLE SUMMARY="Footer navigation table" WIDTH="100%" BORDER="0" CELLPADDING="0" CELLSPACING="0" ><TR ><TD WIDTH="33%" ALIGN="left" VALIGN="top" ><A HREF="msearch-indexing.html" ACCESSKEY="P" >Prev</A ></TD ><TD WIDTH="34%" ALIGN="center" VALIGN="top" ><A HREF="index.html" ACCESSKEY="H" >Home</A ></TD ><TD WIDTH="33%" ALIGN="right" VALIGN="top" ><A HREF="msearch-content-enc.html" ACCESSKEY="N" >Next</A ></TD ></TR ><TR ><TD WIDTH="33%" ALIGN="left" VALIGN="top" >Indexing</TD ><TD WIDTH="34%" ALIGN="center" VALIGN="top" ><A HREF="msearch-indexing.html" ACCESSKEY="U" >Up</A ></TD ><TD WIDTH="33%" ALIGN="right" VALIGN="top" >Content-Encoding support <A NAME="AEN1434" ></A ></TD ></TR ></TABLE ></DIV ><!--#include virtual="body-after.html"--></BODY ></HTML >