<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<title>8.12. Indexing — groonga v3.0.5 documentation</title>
<link rel="stylesheet" href="../_static/groonga.css" type="text/css" />
<link rel="stylesheet" href="../_static/pygments.css" type="text/css" />
<script type="text/javascript">
var DOCUMENTATION_OPTIONS = {
URL_ROOT: '../',
VERSION: '3.0.5',
COLLAPSE_INDEX: false,
FILE_SUFFIX: '.html',
HAS_SOURCE: true
};
</script>
<script type="text/javascript" src="../_static/jquery.js"></script>
<script type="text/javascript" src="../_static/underscore.js"></script>
<script type="text/javascript" src="../_static/doctools.js"></script>
<link rel="shortcut icon" href="../_static/favicon.ico"/>
<link rel="top" title="groonga v3.0.5 documentation" href="../index.html" />
<link rel="up" title="8. リファレンスマニュアル" href="../reference.html" />
<link rel="next" title="8.13. Log" href="log.html" />
<link rel="prev" title="8.11.10. sub_filter" href="functions/sub_filter.html" />
</head>
<body>
<div class="header">
<h1 class="title">
<a id="top-link" href="../index.html">
<span class="project">groonga</span>
<span class="separator">-</span>
<span class="description">An open-source fulltext search engine and column store.</span>
</a>
</h1>
<div class="other-language-links">
<ul>
<li><a href="../../../ja/html/reference/indexing.html"><img src="../_static/jp.png" alt="日本語">日本語版はこちら</a></li>
</ul>
</div>
</div>
<div class="related">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="../genindex.html" title="General Index"
accesskey="I">index</a></li>
<li class="right" >
<a href="log.html" title="8.13. Log"
accesskey="N">next</a> |</li>
<li class="right" >
<a href="functions/sub_filter.html" title="8.11.10. sub_filter"
accesskey="P">previous</a> |</li>
<li><a href="../index.html">groonga v3.0.5 documentation</a> »</li>
<li><a href="../reference.html" accesskey="U">8. リファレンスマニュアル</a> »</li>
</ul>
</div>
<div class="document">
<div class="documentwrapper">
<div class="bodywrapper">
<div class="body">
<div class="section" id="indexing">
<h1>8.12. Indexing<a class="headerlink" href="#indexing" title="Permalink to this headline">¶</a></h1>
<p>Groonga supports both online index construction and offline
index construction since 2.0.0.</p>
<div class="section" id="online-index-construction">
<h2>8.12.1. Online index construction<a class="headerlink" href="#online-index-construction" title="Permalink to this headline">¶</a></h2>
<p>In online index construction, registered documents can be
searchable quickly while indexing. But indexing requires
more cost rather than indexing by offline index
construction.</p>
<p>Online index construction is suitable for a search system
that values freshness. For example, a search system for
tweets, news, blog posts and so on will value
freshness. Online index construction can make fresh
documents searchable and keep searchable while indexing.</p>
</div>
<div class="section" id="offline-index-construction">
<span id="id1"></span><h2>8.12.2. Offline index construction<a class="headerlink" href="#offline-index-construction" title="Permalink to this headline">¶</a></h2>
<p>In offline index construction, indexing cost is less than
indexing cost by online index construction. Indexing time
will be shorter. Index will be smaller. Resources required
for indexing will be smaller. But a registering document
cannot be searchable until all registered documents are
indexed.</p>
<p>Offline index construction is suitable for a search system
that values less required resources. If a search system
doesn't value freshness, offline index construction will be
suitable. For example, a reference manual search system
doesn't value freshness because a reference manual will be
updated only at a release.</p>
</div>
<div class="section" id="how-to-use">
<h2>8.12.3. How to use<a class="headerlink" href="#how-to-use" title="Permalink to this headline">¶</a></h2>
<p>Groonga uses online index construction by default. We
register a document, we can search it quickly.</p>
<p>Groonga uses offline index construction by adding an index
to a column that already has data.</p>
<p>We define a schema:</p>
<p>Execution example:</p>
<div class="highlight-none"><div class="highlight"><pre>table_create Tweets TABLE_NO_KEY
# [[0, 1337566253.89858, 0.000355720520019531], true]
column_create Tweets content COLUMN_SCALAR ShortText
# [[0, 1337566253.89858, 0.000355720520019531], true]
table_create Lexicon TABLE_HASH_KEY|KEY_NORMALIZE ShortText --default_tokenizer TokenBigram
# [[0, 1337566253.89858, 0.000355720520019531], true]
</pre></div>
</div>
<p>We register data:</p>
<p>Execution example:</p>
<div class="highlight-none"><div class="highlight"><pre>load --table Tweets
[
{"content":"Hello!"},
{"content":"I just start it!"},
{"content":"I'm sleepy... Have a nice day... Good night..."}
]
# [[0, 1337566253.89858, 0.000355720520019531], 3]
</pre></div>
</div>
<p>We search without index. We get no result:</p>
<p>Execution example:</p>
<div class="highlight-none"><div class="highlight"><pre>select Tweets --match_columns content --query 'good nice'
# [
# [
# 0,
# 1337566253.89858,
# 0.000355720520019531
# ],
# [
# [
# [
# 0
# ],
# [
# [
# "_id",
# "UInt32"
# ],
# [
# "content",
# "ShortText"
# ]
# ]
# ]
# ]
# ]
</pre></div>
</div>
<p>We create index for <tt class="docutils literal"><span class="pre">Tweets.content</span></tt>. Already registered
data in <tt class="docutils literal"><span class="pre">Tweets.content</span></tt> are indexed by offline index
construction:</p>
<p>Execution example:</p>
<div class="highlight-none"><div class="highlight"><pre>column_create Lexicon tweet COLUMN_INDEX|WITH_POSITION Tweets content
# [[0, 1337566253.89858, 0.000355720520019531], true]
</pre></div>
</div>
<p>We search with index. We get a matched record:</p>
<p>Execution example:</p>
<div class="highlight-none"><div class="highlight"><pre>select Tweets --match_columns content --query 'good nice'
# [
# [
# 0,
# 1337566253.89858,
# 0.000355720520019531
# ],
# [
# [
# [
# 1
# ],
# [
# [
# "_id",
# "UInt32"
# ],
# [
# "content",
# "ShortText"
# ]
# ],
# [
# 3,
# "I'm sleepy... Have a nice day... Good night..."
# ]
# ]
# ]
# ]
</pre></div>
</div>
<p>We register data again. They are indexed by online index
construction:</p>
<p>Execution example:</p>
<div class="highlight-none"><div class="highlight"><pre>load --table Tweets
[
{"content":"Good morning! Nice day."},
{"content":"Let's go shopping."}
]
# [[0, 1337566253.89858, 0.000355720520019531], 2]
</pre></div>
</div>
<p>We can also get newly registered records by searching:</p>
<p>Execution example:</p>
<div class="highlight-none"><div class="highlight"><pre>select Tweets --match_columns content --query 'good nice'
# [
# [
# 0,
# 1337566253.89858,
# 0.000355720520019531
# ],
# [
# [
# [
# 2
# ],
# [
# [
# "_id",
# "UInt32"
# ],
# [
# "content",
# "ShortText"
# ]
# ],
# [
# 3,
# "I'm sleepy... Have a nice day... Good night..."
# ],
# [
# 4,
# "Good morning! Nice day."
# ]
# ]
# ]
# ]
</pre></div>
</div>
</div>
</div>
</div>
</div>
</div>
<div class="sphinxsidebar">
<div class="sphinxsidebarwrapper">
<h3><a href="../index.html">Table Of Contents</a></h3>
<ul>
<li><a class="reference internal" href="#">8.12. Indexing</a><ul>
<li><a class="reference internal" href="#online-index-construction">8.12.1. Online index construction</a></li>
<li><a class="reference internal" href="#offline-index-construction">8.12.2. Offline index construction</a></li>
<li><a class="reference internal" href="#how-to-use">8.12.3. How to use</a></li>
</ul>
</li>
</ul>
<h4>Previous topic</h4>
<p class="topless"><a href="functions/sub_filter.html"
title="previous chapter">8.11.10. sub_filter</a></p>
<h4>Next topic</h4>
<p class="topless"><a href="log.html"
title="next chapter">8.13. Log</a></p>
<h3>This Page</h3>
<ul class="this-page-menu">
<li><a href="../_sources/reference/indexing.txt"
rel="nofollow">Show Source</a></li>
</ul>
<div id="searchbox" style="display: none">
<h3>Quick search</h3>
<form class="search" action="../search.html" method="get">
<input type="text" name="q" />
<input type="submit" value="Go" />
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
</form>
<p class="searchtip" style="font-size: 90%">
Enter search terms or a module, class or function name.
</p>
</div>
<script type="text/javascript">$('#searchbox').show(0);</script>
</div>
</div>
<div class="clearer"></div>
</div>
<div class="related">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="../genindex.html" title="General Index"
>index</a></li>
<li class="right" >
<a href="log.html" title="8.13. Log"
>next</a> |</li>
<li class="right" >
<a href="functions/sub_filter.html" title="8.11.10. sub_filter"
>previous</a> |</li>
<li><a href="../index.html">groonga v3.0.5 documentation</a> »</li>
<li><a href="../reference.html" >8. リファレンスマニュアル</a> »</li>
</ul>
</div>
<div class="footer">
© Copyright 2009-2013, Brazil, Inc.
</div>
</body>
</html>
distrib
>
Fedora
>
18
>
x86_64
>
media
>
updates
>
by-pkgid
>
e450e7f3d6075c4a54de19e68d38177f
>
files
>
302
