<HTML ><HEAD ><TITLE >Storing compressed document copies </TITLE ><META NAME="GENERATOR" CONTENT="Modular DocBook HTML Stylesheet Version 1.73 "><LINK REL="HOME" TITLE="mnoGoSearch 3.2 reference manual" HREF="index.html"><LINK REL="UP" TITLE="Indexing" HREF="msearch-indexing.html"><LINK REL="PREVIOUS" TITLE="Using syslog " HREF="msearch-syslog.html"><LINK REL="NEXT" TITLE="mnoGoSearch HTML parser " HREF="msearch-htmlparser.html"><LINK REL="STYLESHEET" TYPE="text/css" HREF="mnogo.css"><META NAME="Description" CONTENT="mnoGoSearch - Full Featured Web site Open Source Search Engine Software over the Internet and Intranet Web Sites Based on SQL Database. It is a Free search software covered by GNU license."><META NAME="Keywords" CONTENT="shareware, freeware, download, internet, unix, utilities, search engine, text retrieval, knowledge retrieval, text search, information retrieval, database search, mining, intranet, webserver, index, spider, filesearch, meta, free, open source, full-text, udmsearch, website, find, opensource, search, searching, software, udmsearch, engine, indexing, system, web, ftp, http, cgi, php, SQL, MySQL, database, php3, FreeBSD, Linux, Unix, mnoGoSearch, MacOS X, Mac OS X, Windows, 2000, NT, 95, 98, GNU, GPL, url, grabbing"></HEAD ><BODY CLASS="sect1" BGCOLOR="#EEEEEE" TEXT="#000000" LINK="#000080" VLINK="#800080" ALINK="#FF0000" ><DIV CLASS="NAVHEADER" ><TABLE SUMMARY="Header navigation table" WIDTH="100%" BORDER="0" CELLPADDING="0" CELLSPACING="0" ><TR ><TH COLSPAN="3" ALIGN="center" >mnoGoSearch 3.2 reference manual: Full-featured search engine software</TH ></TR ><TR ><TD WIDTH="10%" ALIGN="left" VALIGN="bottom" ><A HREF="msearch-syslog.html" ACCESSKEY="P" >Prev</A ></TD ><TD WIDTH="80%" ALIGN="center" VALIGN="bottom" >Chapter 3. Indexing</TD ><TD WIDTH="10%" ALIGN="right" VALIGN="bottom" ><A HREF="msearch-htmlparser.html" ACCESSKEY="N" >Next</A ></TD ></TR ></TABLE ><HR ALIGN="LEFT" WIDTH="100%"></DIV ><DIV CLASS="sect1" ><H1 CLASS="sect1" ><A NAME="stored" >Storing compressed document copies <A NAME="AEN1713" ></A ></A ></H1 ><P >Since <SPAN CLASS="application" >mnoGoSearch</SPAN > version 3.2.2 it is possible to store compressed copies of indexed documents. Copies are stored and retrieved by the new deamon - <B CLASS="command" >stored</B >, that is installed into <TT CLASS="filename" >sbin</TT > directory of <SPAN CLASS="application" >mnoGoSearch</SPAN > installation (default: <TT CLASS="filename" >/usr/local/mnogosearch/sbin</TT >).</P ><P ><A NAME="AEN1722" ></A > Since <SPAN CLASS="application" >mnoGoSearch</SPAN > version 3.2.4 <B CLASS="command" >stored</B > is also used to make documents excerpts for search results. </P ><P >Stored document copies are retrieved by means of <TT CLASS="filename" >storedoc.cgi</TT > CGI script. It requests a saved copy of a documents from <B CLASS="command" >stored</B >, then a copy is displayed with user's web browser with search keywords highlighted. To support <B CLASS="command" >stored</B >, compile <SPAN CLASS="application" >mnoGoSearch</SPAN > with <TT CLASS="literal" >zlib</TT > support: <PRE CLASS="programlisting" > ./configure --with-zlib <other arguments> </PRE > </P ><DIV CLASS="sect2" ><H2 CLASS="sect2" ><A NAME="stored-start" >Configure stored</A ></H2 ><P >To start using <B CLASS="command" >stored</B >, please do the following:</P ><P ></P ><UL ><LI ><P >Copy <TT CLASS="filename" >/usr/local/mnogosearch/etc/stored.conf-dist</TT > to <TT CLASS="filename" >/usr/local/mnogosearch/etc/stored.conf</TT >.</P ><P >Edit <TT CLASS="filename" >/usr/local/mnogosearch/etc/stored.conf</TT > </P ><P >There are several commands available for using with <B CLASS="command" >stored</B >: </P ><P ></P ><UL ><LI ><P > <B CLASS="command" ><A NAME="AEN1751" ></A >Listen</B > tells <B CLASS="command" >stored</B > which address and/or port to bind to. By default <B CLASS="command" >stored</B > listens to port 7004 and any address. It is possible to specify port only:</P ><P > <TT CLASS="userinput" ><B >Listen 7004 </B ></TT > </P ><P >Or address only:</P ><P > <TT CLASS="userinput" ><B >Listen 127.0.0.2</B ></TT > </P ><P >Or both address and port:</P ><P > <TT CLASS="userinput" ><B >Listen 127.0.0.2:7004</B ></TT > </P ></LI ><LI ><P > <B CLASS="command" ><A NAME="AEN1767" ></A >VarDir</B > command specifies an alternate <TT CLASS="filename" >var/</TT > working directory, e.g.</P ><P > <TT CLASS="userinput" ><B >VarDir /mnt/d/mnogosearch/var/ </B ></TT > </P ></LI ><LI ><P ><B CLASS="command" ><A NAME="AEN1776" ></A >StoredFiles</B > command specifies number of stored datafiles created in <TT CLASS="filename" >var/stored/</TT > directory, e.g.</P ><P > <TT CLASS="userinput" ><B >StoredFiles 256</B ></TT > </P ></LI ><LI ><P ><B CLASS="command" ><A NAME="AEN1785" ></A >OptimizeInterval</B > command specifies interval in seconds between atempts to optimize a stored datafile, e.g.</P ><P > <TT CLASS="userinput" ><B >OptimizeInterval 300</B ></TT > </P ></LI ><LI ><P ><B CLASS="command" ><A NAME="AEN1793" ></A >OptimizeRatio</B > command specifies defragmentation threshold for a stored datafile optimization. </P ><P > <TT CLASS="userinput" ><B >OptimizeRatio 3</B ></TT > </P ></LI ></UL ></LI ><LI ><P >Run <B CLASS="command" >stored</B >:</P ><P > <TT CLASS="userinput" ><B >/usr/local/mnogosearch/sbin/stored & </B ></TT > </P ></LI ><LI ><P >Configure <TT CLASS="filename" >indexer.conf</TT > and <TT CLASS="filename" >search.htm</TT > (or <TT CLASS="filename" >searchd.conf</TT >, if <B CLASS="command" >searchd</B > is used). Specify address and port that <TT CLASS="literal" >indexer</TT > will use to connect to <B CLASS="command" >stored</B >. Use <B CLASS="command" ><A NAME="AEN1812" ></A >StoredAddr</B > command, e.g.:</P ><P > <TT CLASS="userinput" ><B >StoredAddr localhost:7004</B ></TT > </P ></LI ></UL ></DIV ><DIV CLASS="sect2" ><H2 CLASS="sect2" ><A NAME="stored-how" >How stored works</A ></H2 ><P >After you have successfully configured <B CLASS="command" >stored</B >, the <TT CLASS="filename" >indexer</TT > pass downloaded documents to <B CLASS="command" >stored</B > deamon. After that, <B CLASS="command" >stored</B > will compress the received documents and save them.</P ></DIV ><DIV CLASS="sect2" ><H2 CLASS="sect2" ><A NAME="stored-search" >Using stored during search</A ></H2 ><P >To enable displaying stored documents during search, do the following: </P ><P ></P ><UL ><LI ><P >Configure <TT CLASS="filename" >storedoc.htm</TT > (<TT CLASS="filename" >storedoc.cgi</TT > template) if necessary.</P ></LI ><LI ><P >Add a <TT CLASS="filename" >storedoc.cgi</TT > link to <TT CLASS="filename" >search.htm</TT > <TT CLASS="literal" ><!--res--></TT > section: e.g. <TT CLASS="literal" ><A HREF="$(stored_href)">Cached copy</A> </TT > </P ></LI ><LI ><P >Specify <TT CLASS="filename" >storedoc.cgi</TT > CGI script URL in <TT CLASS="filename" >search.htm</TT > (by default <TT CLASS="literal" >$(stored_href)</TT > will return <TT CLASS="filename" >/cgi-bin/storedoc.cgi</TT >). In case you have to specify other URL, add to <TT CLASS="filename" >search.htm</TT > <TT CLASS="literal" >variables</TT > section the following line:</P ><P > <TT CLASS="userinput" ><B >StoredocURL /path/to/storedoc.cgi</B ></TT > </P ><P >Or an absolute path:</P ><P > <TT CLASS="userinput" ><B >StoredocURL http://servername/path/to/storedoc.cgi</B ></TT > </P ></LI ></UL ><P >This is how <B CLASS="command" >stored</B > works during search, if everything configured correctly:</P ><P ></P ><OL TYPE="1" ><LI ><P > <TT CLASS="filename" >search.htm</TT > displays a link to <TT CLASS="filename" >storedoc.cgi</TT >;</P ></LI ><LI ><P >When user clicks the link, <TT CLASS="filename" >storedoc.cgi</TT > sends a query to <B CLASS="command" >stored</B > deamon to the address, specified in <TT CLASS="filename" >storedoc.htm</TT > with the <B CLASS="command" >StoredAddr</B >;</P ></LI ><LI ><P >After the query, <B CLASS="command" >stored</B > will decompress the requested saved copy and send it to <TT CLASS="filename" >storedoc.cgi</TT >;</P ></LI ><LI ><P > <TT CLASS="filename" >storedoc.cgi</TT > parses the received document and apply highlighting of search keywords. Highlighting method is specified with <TT CLASS="filename" >storedoc.htm</TT > <B CLASS="command" ><A NAME="AEN1873" ></A >HlBeg</B > and <B CLASS="command" ><A NAME="AEN1877" ></A >HlEnd</B > commands;</P ></LI ></OL ></DIV ></DIV ><DIV CLASS="NAVFOOTER" ><HR ALIGN="LEFT" WIDTH="100%"><TABLE SUMMARY="Footer navigation table" WIDTH="100%" BORDER="0" CELLPADDING="0" CELLSPACING="0" ><TR ><TD WIDTH="33%" ALIGN="left" VALIGN="top" ><A HREF="msearch-syslog.html" ACCESSKEY="P" >Prev</A ></TD ><TD WIDTH="34%" ALIGN="center" VALIGN="top" ><A HREF="index.html" ACCESSKEY="H" >Home</A ></TD ><TD WIDTH="33%" ALIGN="right" VALIGN="top" ><A HREF="msearch-htmlparser.html" ACCESSKEY="N" >Next</A ></TD ></TR ><TR ><TD WIDTH="33%" ALIGN="left" VALIGN="top" >Using syslog <A NAME="AEN1665" ></A ></TD ><TD WIDTH="34%" ALIGN="center" VALIGN="top" ><A HREF="msearch-indexing.html" ACCESSKEY="U" >Up</A ></TD ><TD WIDTH="33%" ALIGN="right" VALIGN="top" >mnoGoSearch HTML parser</TD ></TR ></TABLE ></DIV ></BODY ></HTML >
