<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> <html xmlns="http://www.w3.org/1999/xhtml" lang=""> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <title>Aggregation — Django 1.8.19 documentation</title> <link rel="stylesheet" href="../../_static/default.css" type="text/css" /> <link rel="stylesheet" href="../../_static/pygments.css" type="text/css" /> <script type="text/javascript"> var DOCUMENTATION_OPTIONS = { URL_ROOT: '../../', VERSION: '1.8.19', COLLAPSE_INDEX: false, FILE_SUFFIX: '.html', HAS_SOURCE: true }; </script> <script type="text/javascript" src="../../_static/jquery.js"></script> <script type="text/javascript" src="../../_static/underscore.js"></script> <script type="text/javascript" src="../../_static/doctools.js"></script> <link rel="index" title="Index" href="../../genindex.html" /> <link rel="search" title="Search" href="../../search.html" /> <link rel="top" title="Django 1.8.19 documentation" href="../../contents.html" /> <link rel="up" title="Models and databases" href="index.html" /> <link rel="next" title="Managers" href="managers.html" /> <link rel="prev" title="Making queries" href="queries.html" /> <script type="text/javascript" src="../../templatebuiltins.js"></script> <script type="text/javascript"> (function($) { if (!django_template_builtins) { // templatebuiltins.js missing, do nothing. return; } $(document).ready(function() { // Hyperlink Django template tags and filters var base = "../../ref/templates/builtins.html"; if (base == "#") { // Special case for builtins.html itself base = ""; } // Tags are keywords, class '.k' $("div.highlight\\-html\\+django span.k").each(function(i, elem) { var tagname = $(elem).text(); if ($.inArray(tagname, django_template_builtins.ttags) != -1) { var fragment = tagname.replace(/_/, '-'); $(elem).html("<a href='" + base + "#" + fragment + "'>" + tagname + "</a>"); } }); // Filters are functions, class '.nf' $("div.highlight\\-html\\+django span.nf").each(function(i, elem) { var filtername = $(elem).text(); if ($.inArray(filtername, django_template_builtins.tfilters) != -1) { var fragment = filtername.replace(/_/, '-'); $(elem).html("<a href='" + base + "#" + fragment + "'>" + filtername + "</a>"); } }); }); })(jQuery); </script> </head> <body role="document"> <div class="document"> <div id="custom-doc" class="yui-t6"> <div id="hd"> <h1><a href="../../index.html">Django 1.8.19 documentation</a></h1> <div id="global-nav"> <a title="Home page" href="../../index.html">Home</a> | <a title="Table of contents" href="../../contents.html">Table of contents</a> | <a title="Global index" href="../../genindex.html">Index</a> | <a title="Module index" href="../../py-modindex.html">Modules</a> </div> <div class="nav"> « <a href="queries.html" title="Making queries">previous</a> | <a href="../index.html" title="Using Django" accesskey="U">up</a> | <a href="managers.html" title="Managers">next</a> »</div> </div> <div id="bd"> <div id="yui-main"> <div class="yui-b"> <div class="yui-g" id="topics-db-aggregation"> <div class="section" id="s-aggregation"> <span id="aggregation"></span><h1>Aggregation<a class="headerlink" href="#aggregation" title="Permalink to this headline">¶</a></h1> <p>The topic guide on <a class="reference internal" href="queries.html"><span class="doc">Django’s database-abstraction API</span></a> described the way that you can use Django queries that create, retrieve, update and delete individual objects. However, sometimes you will need to retrieve values that are derived by summarizing or <em>aggregating</em> a collection of objects. This topic guide describes the ways that aggregate values can be generated and returned using Django queries.</p> <p>Throughout this guide, we’ll refer to the following models. These models are used to track the inventory for a series of online bookstores:</p> <div class="highlight-python" id="queryset-model-example"><div class="highlight"><pre><span></span><span class="kn">from</span> <span class="nn">django.db</span> <span class="kn">import</span> <span class="n">models</span> <span class="k">class</span> <span class="nc">Author</span><span class="p">(</span><span class="n">models</span><span class="o">.</span><span class="n">Model</span><span class="p">):</span> <span class="n">name</span> <span class="o">=</span> <span class="n">models</span><span class="o">.</span><span class="n">CharField</span><span class="p">(</span><span class="n">max_length</span><span class="o">=</span><span class="mi">100</span><span class="p">)</span> <span class="n">age</span> <span class="o">=</span> <span class="n">models</span><span class="o">.</span><span class="n">IntegerField</span><span class="p">()</span> <span class="k">class</span> <span class="nc">Publisher</span><span class="p">(</span><span class="n">models</span><span class="o">.</span><span class="n">Model</span><span class="p">):</span> <span class="n">name</span> <span class="o">=</span> <span class="n">models</span><span class="o">.</span><span class="n">CharField</span><span class="p">(</span><span class="n">max_length</span><span class="o">=</span><span class="mi">300</span><span class="p">)</span> <span class="n">num_awards</span> <span class="o">=</span> <span class="n">models</span><span class="o">.</span><span class="n">IntegerField</span><span class="p">()</span> <span class="k">class</span> <span class="nc">Book</span><span class="p">(</span><span class="n">models</span><span class="o">.</span><span class="n">Model</span><span class="p">):</span> <span class="n">name</span> <span class="o">=</span> <span class="n">models</span><span class="o">.</span><span class="n">CharField</span><span class="p">(</span><span class="n">max_length</span><span class="o">=</span><span class="mi">300</span><span class="p">)</span> <span class="n">pages</span> <span class="o">=</span> <span class="n">models</span><span class="o">.</span><span class="n">IntegerField</span><span class="p">()</span> <span class="n">price</span> <span class="o">=</span> <span class="n">models</span><span class="o">.</span><span class="n">DecimalField</span><span class="p">(</span><span class="n">max_digits</span><span class="o">=</span><span class="mi">10</span><span class="p">,</span> <span class="n">decimal_places</span><span class="o">=</span><span class="mi">2</span><span class="p">)</span> <span class="n">rating</span> <span class="o">=</span> <span class="n">models</span><span class="o">.</span><span class="n">FloatField</span><span class="p">()</span> <span class="n">authors</span> <span class="o">=</span> <span class="n">models</span><span class="o">.</span><span class="n">ManyToManyField</span><span class="p">(</span><span class="n">Author</span><span class="p">)</span> <span class="n">publisher</span> <span class="o">=</span> <span class="n">models</span><span class="o">.</span><span class="n">ForeignKey</span><span class="p">(</span><span class="n">Publisher</span><span class="p">)</span> <span class="n">pubdate</span> <span class="o">=</span> <span class="n">models</span><span class="o">.</span><span class="n">DateField</span><span class="p">()</span> <span class="k">class</span> <span class="nc">Store</span><span class="p">(</span><span class="n">models</span><span class="o">.</span><span class="n">Model</span><span class="p">):</span> <span class="n">name</span> <span class="o">=</span> <span class="n">models</span><span class="o">.</span><span class="n">CharField</span><span class="p">(</span><span class="n">max_length</span><span class="o">=</span><span class="mi">300</span><span class="p">)</span> <span class="n">books</span> <span class="o">=</span> <span class="n">models</span><span class="o">.</span><span class="n">ManyToManyField</span><span class="p">(</span><span class="n">Book</span><span class="p">)</span> <span class="n">registered_users</span> <span class="o">=</span> <span class="n">models</span><span class="o">.</span><span class="n">PositiveIntegerField</span><span class="p">()</span> </pre></div> </div> <div class="section" id="s-cheat-sheet"> <span id="cheat-sheet"></span><h2>Cheat sheet<a class="headerlink" href="#cheat-sheet" title="Permalink to this headline">¶</a></h2> <p>In a hurry? Here’s how to do common aggregate queries, assuming the models above:</p> <div class="highlight-python"><div class="highlight"><pre><span></span><span class="c1"># Total number of books.</span> <span class="o">>>></span> <span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">count</span><span class="p">()</span> <span class="mi">2452</span> <span class="c1"># Total number of books with publisher=BaloneyPress</span> <span class="o">>>></span> <span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">filter</span><span class="p">(</span><span class="n">publisher__name</span><span class="o">=</span><span class="s1">'BaloneyPress'</span><span class="p">)</span><span class="o">.</span><span class="n">count</span><span class="p">()</span> <span class="mi">73</span> <span class="c1"># Average price across all books.</span> <span class="o">>>></span> <span class="kn">from</span> <span class="nn">django.db.models</span> <span class="kn">import</span> <span class="n">Avg</span> <span class="o">>>></span> <span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">all</span><span class="p">()</span><span class="o">.</span><span class="n">aggregate</span><span class="p">(</span><span class="n">Avg</span><span class="p">(</span><span class="s1">'price'</span><span class="p">))</span> <span class="p">{</span><span class="s1">'price__avg'</span><span class="p">:</span> <span class="mf">34.35</span><span class="p">}</span> <span class="c1"># Max price across all books.</span> <span class="o">>>></span> <span class="kn">from</span> <span class="nn">django.db.models</span> <span class="kn">import</span> <span class="n">Max</span> <span class="o">>>></span> <span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">all</span><span class="p">()</span><span class="o">.</span><span class="n">aggregate</span><span class="p">(</span><span class="n">Max</span><span class="p">(</span><span class="s1">'price'</span><span class="p">))</span> <span class="p">{</span><span class="s1">'price__max'</span><span class="p">:</span> <span class="n">Decimal</span><span class="p">(</span><span class="s1">'81.20'</span><span class="p">)}</span> <span class="c1"># Cost per page</span> <span class="o">>>></span> <span class="kn">from</span> <span class="nn">django.db.models</span> <span class="kn">import</span> <span class="n">F</span><span class="p">,</span> <span class="n">FloatField</span><span class="p">,</span> <span class="n">Sum</span> <span class="o">>>></span> <span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">all</span><span class="p">()</span><span class="o">.</span><span class="n">aggregate</span><span class="p">(</span> <span class="o">...</span> <span class="n">price_per_page</span><span class="o">=</span><span class="n">Sum</span><span class="p">(</span><span class="n">F</span><span class="p">(</span><span class="s1">'price'</span><span class="p">)</span><span class="o">/</span><span class="n">F</span><span class="p">(</span><span class="s1">'pages'</span><span class="p">),</span> <span class="n">output_field</span><span class="o">=</span><span class="n">FloatField</span><span class="p">()))</span> <span class="p">{</span><span class="s1">'price_per_page'</span><span class="p">:</span> <span class="mf">0.4470664529184653</span><span class="p">}</span> <span class="c1"># All the following queries involve traversing the Book<->Publisher</span> <span class="c1"># foreign key relationship backwards.</span> <span class="c1"># Each publisher, each with a count of books as a "num_books" attribute.</span> <span class="o">>>></span> <span class="kn">from</span> <span class="nn">django.db.models</span> <span class="kn">import</span> <span class="n">Count</span> <span class="o">>>></span> <span class="n">pubs</span> <span class="o">=</span> <span class="n">Publisher</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">num_books</span><span class="o">=</span><span class="n">Count</span><span class="p">(</span><span class="s1">'book'</span><span class="p">))</span> <span class="o">>>></span> <span class="n">pubs</span> <span class="p">[</span><span class="o"><</span><span class="n">Publisher</span> <span class="n">BaloneyPress</span><span class="o">></span><span class="p">,</span> <span class="o"><</span><span class="n">Publisher</span> <span class="n">SalamiPress</span><span class="o">></span><span class="p">,</span> <span class="o">...</span><span class="p">]</span> <span class="o">>>></span> <span class="n">pubs</span><span class="p">[</span><span class="mi">0</span><span class="p">]</span><span class="o">.</span><span class="n">num_books</span> <span class="mi">73</span> <span class="c1"># The top 5 publishers, in order by number of books.</span> <span class="o">>>></span> <span class="n">pubs</span> <span class="o">=</span> <span class="n">Publisher</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">num_books</span><span class="o">=</span><span class="n">Count</span><span class="p">(</span><span class="s1">'book'</span><span class="p">))</span><span class="o">.</span><span class="n">order_by</span><span class="p">(</span><span class="s1">'-num_books'</span><span class="p">)[:</span><span class="mi">5</span><span class="p">]</span> <span class="o">>>></span> <span class="n">pubs</span><span class="p">[</span><span class="mi">0</span><span class="p">]</span><span class="o">.</span><span class="n">num_books</span> <span class="mi">1323</span> </pre></div> </div> </div> <div class="section" id="s-generating-aggregates-over-a-queryset"> <span id="generating-aggregates-over-a-queryset"></span><h2>Generating aggregates over a QuerySet<a class="headerlink" href="#generating-aggregates-over-a-queryset" title="Permalink to this headline">¶</a></h2> <p>Django provides two ways to generate aggregates. The first way is to generate summary values over an entire <code class="docutils literal"><span class="pre">QuerySet</span></code>. For example, say you wanted to calculate the average price of all books available for sale. Django’s query syntax provides a means for describing the set of all books:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">all</span><span class="p">()</span> </pre></div> </div> <p>What we need is a way to calculate summary values over the objects that belong to this <code class="docutils literal"><span class="pre">QuerySet</span></code>. This is done by appending an <code class="docutils literal"><span class="pre">aggregate()</span></code> clause onto the <code class="docutils literal"><span class="pre">QuerySet</span></code>:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="kn">from</span> <span class="nn">django.db.models</span> <span class="k">import</span> <span class="n">Avg</span> <span class="gp">>>> </span><span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">all</span><span class="p">()</span><span class="o">.</span><span class="n">aggregate</span><span class="p">(</span><span class="n">Avg</span><span class="p">(</span><span class="s1">'price'</span><span class="p">))</span> <span class="go">{'price__avg': 34.35}</span> </pre></div> </div> <p>The <code class="docutils literal"><span class="pre">all()</span></code> is redundant in this example, so this could be simplified to:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">aggregate</span><span class="p">(</span><span class="n">Avg</span><span class="p">(</span><span class="s1">'price'</span><span class="p">))</span> <span class="go">{'price__avg': 34.35}</span> </pre></div> </div> <p>The argument to the <code class="docutils literal"><span class="pre">aggregate()</span></code> clause describes the aggregate value that we want to compute - in this case, the average of the <code class="docutils literal"><span class="pre">price</span></code> field on the <code class="docutils literal"><span class="pre">Book</span></code> model. A list of the aggregate functions that are available can be found in the <a class="reference internal" href="../../ref/models/querysets.html#aggregation-functions"><span class="std std-ref">QuerySet reference</span></a>.</p> <p><code class="docutils literal"><span class="pre">aggregate()</span></code> is a terminal clause for a <code class="docutils literal"><span class="pre">QuerySet</span></code> that, when invoked, returns a dictionary of name-value pairs. The name is an identifier for the aggregate value; the value is the computed aggregate. The name is automatically generated from the name of the field and the aggregate function. If you want to manually specify a name for the aggregate value, you can do so by providing that name when you specify the aggregate clause:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">aggregate</span><span class="p">(</span><span class="n">average_price</span><span class="o">=</span><span class="n">Avg</span><span class="p">(</span><span class="s1">'price'</span><span class="p">))</span> <span class="go">{'average_price': 34.35}</span> </pre></div> </div> <p>If you want to generate more than one aggregate, you just add another argument to the <code class="docutils literal"><span class="pre">aggregate()</span></code> clause. So, if we also wanted to know the maximum and minimum price of all books, we would issue the query:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="kn">from</span> <span class="nn">django.db.models</span> <span class="k">import</span> <span class="n">Avg</span><span class="p">,</span> <span class="n">Max</span><span class="p">,</span> <span class="n">Min</span> <span class="gp">>>> </span><span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">aggregate</span><span class="p">(</span><span class="n">Avg</span><span class="p">(</span><span class="s1">'price'</span><span class="p">),</span> <span class="n">Max</span><span class="p">(</span><span class="s1">'price'</span><span class="p">),</span> <span class="n">Min</span><span class="p">(</span><span class="s1">'price'</span><span class="p">))</span> <span class="go">{'price__avg': 34.35, 'price__max': Decimal('81.20'), 'price__min': Decimal('12.99')}</span> </pre></div> </div> </div> <div class="section" id="s-generating-aggregates-for-each-item-in-a-queryset"> <span id="generating-aggregates-for-each-item-in-a-queryset"></span><h2>Generating aggregates for each item in a QuerySet<a class="headerlink" href="#generating-aggregates-for-each-item-in-a-queryset" title="Permalink to this headline">¶</a></h2> <p>The second way to generate summary values is to generate an independent summary for each object in a <code class="docutils literal"><span class="pre">QuerySet</span></code>. For example, if you are retrieving a list of books, you may want to know how many authors contributed to each book. Each Book has a many-to-many relationship with the Author; we want to summarize this relationship for each book in the <code class="docutils literal"><span class="pre">QuerySet</span></code>.</p> <p>Per-object summaries can be generated using the <code class="docutils literal"><span class="pre">annotate()</span></code> clause. When an <code class="docutils literal"><span class="pre">annotate()</span></code> clause is specified, each object in the <code class="docutils literal"><span class="pre">QuerySet</span></code> will be annotated with the specified values.</p> <p>The syntax for these annotations is identical to that used for the <code class="docutils literal"><span class="pre">aggregate()</span></code> clause. Each argument to <code class="docutils literal"><span class="pre">annotate()</span></code> describes an aggregate that is to be calculated. For example, to annotate books with the number of authors:</p> <div class="highlight-python"><div class="highlight"><pre><span></span><span class="c1"># Build an annotated queryset</span> <span class="o">>>></span> <span class="kn">from</span> <span class="nn">django.db.models</span> <span class="kn">import</span> <span class="n">Count</span> <span class="o">>>></span> <span class="n">q</span> <span class="o">=</span> <span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">Count</span><span class="p">(</span><span class="s1">'authors'</span><span class="p">))</span> <span class="c1"># Interrogate the first object in the queryset</span> <span class="o">>>></span> <span class="n">q</span><span class="p">[</span><span class="mi">0</span><span class="p">]</span> <span class="o"><</span><span class="n">Book</span><span class="p">:</span> <span class="n">The</span> <span class="n">Definitive</span> <span class="n">Guide</span> <span class="n">to</span> <span class="n">Django</span><span class="o">></span> <span class="o">>>></span> <span class="n">q</span><span class="p">[</span><span class="mi">0</span><span class="p">]</span><span class="o">.</span><span class="n">authors__count</span> <span class="mi">2</span> <span class="c1"># Interrogate the second object in the queryset</span> <span class="o">>>></span> <span class="n">q</span><span class="p">[</span><span class="mi">1</span><span class="p">]</span> <span class="o"><</span><span class="n">Book</span><span class="p">:</span> <span class="n">Practical</span> <span class="n">Django</span> <span class="n">Projects</span><span class="o">></span> <span class="o">>>></span> <span class="n">q</span><span class="p">[</span><span class="mi">1</span><span class="p">]</span><span class="o">.</span><span class="n">authors__count</span> <span class="mi">1</span> </pre></div> </div> <p>As with <code class="docutils literal"><span class="pre">aggregate()</span></code>, the name for the annotation is automatically derived from the name of the aggregate function and the name of the field being aggregated. You can override this default name by providing an alias when you specify the annotation:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">q</span> <span class="o">=</span> <span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">num_authors</span><span class="o">=</span><span class="n">Count</span><span class="p">(</span><span class="s1">'authors'</span><span class="p">))</span> <span class="gp">>>> </span><span class="n">q</span><span class="p">[</span><span class="mi">0</span><span class="p">]</span><span class="o">.</span><span class="n">num_authors</span> <span class="go">2</span> <span class="gp">>>> </span><span class="n">q</span><span class="p">[</span><span class="mi">1</span><span class="p">]</span><span class="o">.</span><span class="n">num_authors</span> <span class="go">1</span> </pre></div> </div> <p>Unlike <code class="docutils literal"><span class="pre">aggregate()</span></code>, <code class="docutils literal"><span class="pre">annotate()</span></code> is <em>not</em> a terminal clause. The output of the <code class="docutils literal"><span class="pre">annotate()</span></code> clause is a <code class="docutils literal"><span class="pre">QuerySet</span></code>; this <code class="docutils literal"><span class="pre">QuerySet</span></code> can be modified using any other <code class="docutils literal"><span class="pre">QuerySet</span></code> operation, including <code class="docutils literal"><span class="pre">filter()</span></code>, <code class="docutils literal"><span class="pre">order_by()</span></code>, or even additional calls to <code class="docutils literal"><span class="pre">annotate()</span></code>.</p> <div class="section" id="s-combining-multiple-aggregations"> <span id="s-id1"></span><span id="combining-multiple-aggregations"></span><span id="id1"></span><h3>Combining multiple aggregations<a class="headerlink" href="#combining-multiple-aggregations" title="Permalink to this headline">¶</a></h3> <p>Combining multiple aggregations with <code class="docutils literal"><span class="pre">annotate()</span></code> will <a class="reference external" href="https://code.djangoproject.com/ticket/10060">yield the wrong results</a>, as multiple tables are cross joined. Due to the use of <code class="docutils literal"><span class="pre">LEFT</span> <span class="pre">OUTER</span> <span class="pre">JOIN</span></code>, duplicate records will be generated if some of the joined tables contain more records than the others:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">book</span> <span class="o">=</span> <span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">first</span><span class="p">()</span> <span class="gp">>>> </span><span class="n">book</span><span class="o">.</span><span class="n">authors</span><span class="o">.</span><span class="n">count</span><span class="p">()</span> <span class="go">2</span> <span class="gp">>>> </span><span class="n">book</span><span class="o">.</span><span class="n">store_set</span><span class="o">.</span><span class="n">count</span><span class="p">()</span> <span class="go">3</span> <span class="gp">>>> </span><span class="n">q</span> <span class="o">=</span> <span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">Count</span><span class="p">(</span><span class="s1">'authors'</span><span class="p">),</span> <span class="n">Count</span><span class="p">(</span><span class="s1">'store'</span><span class="p">))</span> <span class="gp">>>> </span><span class="n">q</span><span class="p">[</span><span class="mi">0</span><span class="p">]</span><span class="o">.</span><span class="n">authors__count</span> <span class="go">6</span> <span class="gp">>>> </span><span class="n">q</span><span class="p">[</span><span class="mi">0</span><span class="p">]</span><span class="o">.</span><span class="n">store__count</span> <span class="go">6</span> </pre></div> </div> <p>For most aggregates, there is no way to avoid this problem, however, the <a class="reference internal" href="../../ref/models/querysets.html#django.db.models.Count" title="django.db.models.Count"><code class="xref py py-class docutils literal"><span class="pre">Count</span></code></a> aggregate has a <code class="docutils literal"><span class="pre">distinct</span></code> parameter that may help:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">q</span> <span class="o">=</span> <span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">Count</span><span class="p">(</span><span class="s1">'authors'</span><span class="p">,</span> <span class="n">distinct</span><span class="o">=</span><span class="kc">True</span><span class="p">),</span> <span class="n">Count</span><span class="p">(</span><span class="s1">'store'</span><span class="p">,</span> <span class="n">distinct</span><span class="o">=</span><span class="kc">True</span><span class="p">))</span> <span class="gp">>>> </span><span class="n">q</span><span class="p">[</span><span class="mi">0</span><span class="p">]</span><span class="o">.</span><span class="n">authors__count</span> <span class="go">2</span> <span class="gp">>>> </span><span class="n">q</span><span class="p">[</span><span class="mi">0</span><span class="p">]</span><span class="o">.</span><span class="n">store__count</span> <span class="go">3</span> </pre></div> </div> <div class="admonition-if-in-doubt-inspect-the-sql-query admonition"> <p class="first admonition-title">If in doubt, inspect the SQL query!</p> <p class="last">In order to understand what happens in your query, consider inspecting the <code class="docutils literal"><span class="pre">query</span></code> property of your <code class="docutils literal"><span class="pre">QuerySet</span></code>.</p> </div> </div> </div> <div class="section" id="s-joins-and-aggregates"> <span id="joins-and-aggregates"></span><h2>Joins and aggregates<a class="headerlink" href="#joins-and-aggregates" title="Permalink to this headline">¶</a></h2> <p>So far, we have dealt with aggregates over fields that belong to the model being queried. However, sometimes the value you want to aggregate will belong to a model that is related to the model you are querying.</p> <p>When specifying the field to be aggregated in an aggregate function, Django will allow you to use the same <a class="reference internal" href="queries.html#field-lookups-intro"><span class="std std-ref">double underscore notation</span></a> that is used when referring to related fields in filters. Django will then handle any table joins that are required to retrieve and aggregate the related value.</p> <p>For example, to find the price range of books offered in each store, you could use the annotation:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="kn">from</span> <span class="nn">django.db.models</span> <span class="k">import</span> <span class="n">Max</span><span class="p">,</span> <span class="n">Min</span> <span class="gp">>>> </span><span class="n">Store</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">min_price</span><span class="o">=</span><span class="n">Min</span><span class="p">(</span><span class="s1">'books__price'</span><span class="p">),</span> <span class="n">max_price</span><span class="o">=</span><span class="n">Max</span><span class="p">(</span><span class="s1">'books__price'</span><span class="p">))</span> </pre></div> </div> <p>This tells Django to retrieve the <code class="docutils literal"><span class="pre">Store</span></code> model, join (through the many-to-many relationship) with the <code class="docutils literal"><span class="pre">Book</span></code> model, and aggregate on the price field of the book model to produce a minimum and maximum value.</p> <p>The same rules apply to the <code class="docutils literal"><span class="pre">aggregate()</span></code> clause. If you wanted to know the lowest and highest price of any book that is available for sale in any of the stores, you could use the aggregate:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">Store</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">aggregate</span><span class="p">(</span><span class="n">min_price</span><span class="o">=</span><span class="n">Min</span><span class="p">(</span><span class="s1">'books__price'</span><span class="p">),</span> <span class="n">max_price</span><span class="o">=</span><span class="n">Max</span><span class="p">(</span><span class="s1">'books__price'</span><span class="p">))</span> </pre></div> </div> <p>Join chains can be as deep as you require. For example, to extract the age of the youngest author of any book available for sale, you could issue the query:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">Store</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">aggregate</span><span class="p">(</span><span class="n">youngest_age</span><span class="o">=</span><span class="n">Min</span><span class="p">(</span><span class="s1">'books__authors__age'</span><span class="p">))</span> </pre></div> </div> <div class="section" id="s-following-relationships-backwards"> <span id="following-relationships-backwards"></span><h3>Following relationships backwards<a class="headerlink" href="#following-relationships-backwards" title="Permalink to this headline">¶</a></h3> <p>In a way similar to <a class="reference internal" href="queries.html#lookups-that-span-relationships"><span class="std std-ref">Lookups that span relationships</span></a>, aggregations and annotations on fields of models or models that are related to the one you are querying can include traversing “reverse” relationships. The lowercase name of related models and double-underscores are used here too.</p> <p>For example, we can ask for all publishers, annotated with their respective total book stock counters (note how we use <code class="docutils literal"><span class="pre">'book'</span></code> to specify the <code class="docutils literal"><span class="pre">Publisher</span></code> -> <code class="docutils literal"><span class="pre">Book</span></code> reverse foreign key hop):</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="kn">from</span> <span class="nn">django.db.models</span> <span class="k">import</span> <span class="n">Count</span><span class="p">,</span> <span class="n">Min</span><span class="p">,</span> <span class="n">Sum</span><span class="p">,</span> <span class="n">Avg</span> <span class="gp">>>> </span><span class="n">Publisher</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">Count</span><span class="p">(</span><span class="s1">'book'</span><span class="p">))</span> </pre></div> </div> <p>(Every <code class="docutils literal"><span class="pre">Publisher</span></code> in the resulting <code class="docutils literal"><span class="pre">QuerySet</span></code> will have an extra attribute called <code class="docutils literal"><span class="pre">book__count</span></code>.)</p> <p>We can also ask for the oldest book of any of those managed by every publisher:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">Publisher</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">aggregate</span><span class="p">(</span><span class="n">oldest_pubdate</span><span class="o">=</span><span class="n">Min</span><span class="p">(</span><span class="s1">'book__pubdate'</span><span class="p">))</span> </pre></div> </div> <p>(The resulting dictionary will have a key called <code class="docutils literal"><span class="pre">'oldest_pubdate'</span></code>. If no such alias were specified, it would be the rather long <code class="docutils literal"><span class="pre">'book__pubdate__min'</span></code>.)</p> <p>This doesn’t apply just to foreign keys. It also works with many-to-many relations. For example, we can ask for every author, annotated with the total number of pages considering all the books the author has (co-)authored (note how we use <code class="docutils literal"><span class="pre">'book'</span></code> to specify the <code class="docutils literal"><span class="pre">Author</span></code> -> <code class="docutils literal"><span class="pre">Book</span></code> reverse many-to-many hop):</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">Author</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">total_pages</span><span class="o">=</span><span class="n">Sum</span><span class="p">(</span><span class="s1">'book__pages'</span><span class="p">))</span> </pre></div> </div> <p>(Every <code class="docutils literal"><span class="pre">Author</span></code> in the resulting <code class="docutils literal"><span class="pre">QuerySet</span></code> will have an extra attribute called <code class="docutils literal"><span class="pre">total_pages</span></code>. If no such alias were specified, it would be the rather long <code class="docutils literal"><span class="pre">book__pages__sum</span></code>.)</p> <p>Or ask for the average rating of all the books written by author(s) we have on file:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">Author</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">aggregate</span><span class="p">(</span><span class="n">average_rating</span><span class="o">=</span><span class="n">Avg</span><span class="p">(</span><span class="s1">'book__rating'</span><span class="p">))</span> </pre></div> </div> <p>(The resulting dictionary will have a key called <code class="docutils literal"><span class="pre">'average_rating'</span></code>. If no such alias were specified, it would be the rather long <code class="docutils literal"><span class="pre">'book__rating__avg'</span></code>.)</p> </div> </div> <div class="section" id="s-aggregations-and-other-queryset-clauses"> <span id="aggregations-and-other-queryset-clauses"></span><h2>Aggregations and other QuerySet clauses<a class="headerlink" href="#aggregations-and-other-queryset-clauses" title="Permalink to this headline">¶</a></h2> <div class="section" id="s-filter-and-exclude"> <span id="filter-and-exclude"></span><h3><code class="docutils literal"><span class="pre">filter()</span></code> and <code class="docutils literal"><span class="pre">exclude()</span></code><a class="headerlink" href="#filter-and-exclude" title="Permalink to this headline">¶</a></h3> <p>Aggregates can also participate in filters. Any <code class="docutils literal"><span class="pre">filter()</span></code> (or <code class="docutils literal"><span class="pre">exclude()</span></code>) applied to normal model fields will have the effect of constraining the objects that are considered for aggregation.</p> <p>When used with an <code class="docutils literal"><span class="pre">annotate()</span></code> clause, a filter has the effect of constraining the objects for which an annotation is calculated. For example, you can generate an annotated list of all books that have a title starting with “Django” using the query:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="kn">from</span> <span class="nn">django.db.models</span> <span class="k">import</span> <span class="n">Count</span><span class="p">,</span> <span class="n">Avg</span> <span class="gp">>>> </span><span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">filter</span><span class="p">(</span><span class="n">name__startswith</span><span class="o">=</span><span class="s2">"Django"</span><span class="p">)</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">num_authors</span><span class="o">=</span><span class="n">Count</span><span class="p">(</span><span class="s1">'authors'</span><span class="p">))</span> </pre></div> </div> <p>When used with an <code class="docutils literal"><span class="pre">aggregate()</span></code> clause, a filter has the effect of constraining the objects over which the aggregate is calculated. For example, you can generate the average price of all books with a title that starts with “Django” using the query:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">filter</span><span class="p">(</span><span class="n">name__startswith</span><span class="o">=</span><span class="s2">"Django"</span><span class="p">)</span><span class="o">.</span><span class="n">aggregate</span><span class="p">(</span><span class="n">Avg</span><span class="p">(</span><span class="s1">'price'</span><span class="p">))</span> </pre></div> </div> <div class="section" id="s-filtering-on-annotations"> <span id="filtering-on-annotations"></span><h4>Filtering on annotations<a class="headerlink" href="#filtering-on-annotations" title="Permalink to this headline">¶</a></h4> <p>Annotated values can also be filtered. The alias for the annotation can be used in <code class="docutils literal"><span class="pre">filter()</span></code> and <code class="docutils literal"><span class="pre">exclude()</span></code> clauses in the same way as any other model field.</p> <p>For example, to generate a list of books that have more than one author, you can issue the query:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">num_authors</span><span class="o">=</span><span class="n">Count</span><span class="p">(</span><span class="s1">'authors'</span><span class="p">))</span><span class="o">.</span><span class="n">filter</span><span class="p">(</span><span class="n">num_authors__gt</span><span class="o">=</span><span class="mi">1</span><span class="p">)</span> </pre></div> </div> <p>This query generates an annotated result set, and then generates a filter based upon that annotation.</p> </div> <div class="section" id="s-order-of-annotate-and-filter-clauses"> <span id="order-of-annotate-and-filter-clauses"></span><h4>Order of <code class="docutils literal"><span class="pre">annotate()</span></code> and <code class="docutils literal"><span class="pre">filter()</span></code> clauses<a class="headerlink" href="#order-of-annotate-and-filter-clauses" title="Permalink to this headline">¶</a></h4> <p>When developing a complex query that involves both <code class="docutils literal"><span class="pre">annotate()</span></code> and <code class="docutils literal"><span class="pre">filter()</span></code> clauses, pay particular attention to the order in which the clauses are applied to the <code class="docutils literal"><span class="pre">QuerySet</span></code>.</p> <p>When an <code class="docutils literal"><span class="pre">annotate()</span></code> clause is applied to a query, the annotation is computed over the state of the query up to the point where the annotation is requested. The practical implication of this is that <code class="docutils literal"><span class="pre">filter()</span></code> and <code class="docutils literal"><span class="pre">annotate()</span></code> are not commutative operations.</p> <p>Given:</p> <ul class="simple"> <li>Publisher A has two books with ratings 4 and 5.</li> <li>Publisher B has two books with ratings 1 and 4.</li> <li>Publisher C has one book with rating 1.</li> </ul> <p>Here’s an example with the <code class="docutils literal"><span class="pre">Count</span></code> aggregate:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">a</span><span class="p">,</span> <span class="n">b</span> <span class="o">=</span> <span class="n">Publisher</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">num_books</span><span class="o">=</span><span class="n">Count</span><span class="p">(</span><span class="s1">'book'</span><span class="p">,</span> <span class="n">distinct</span><span class="o">=</span><span class="kc">True</span><span class="p">))</span><span class="o">.</span><span class="n">filter</span><span class="p">(</span><span class="n">book__rating__gt</span><span class="o">=</span><span class="mf">3.0</span><span class="p">)</span> <span class="gp">>>> </span><span class="n">a</span><span class="p">,</span> <span class="n">a</span><span class="o">.</span><span class="n">num_books</span> <span class="go">(<Publisher: A>, 2)</span> <span class="gp">>>> </span><span class="n">b</span><span class="p">,</span> <span class="n">b</span><span class="o">.</span><span class="n">num_books</span> <span class="go">(<Publisher: B>, 2)</span> <span class="gp">>>> </span><span class="n">a</span><span class="p">,</span> <span class="n">b</span> <span class="o">=</span> <span class="n">Publisher</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">filter</span><span class="p">(</span><span class="n">book__rating__gt</span><span class="o">=</span><span class="mf">3.0</span><span class="p">)</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">num_books</span><span class="o">=</span><span class="n">Count</span><span class="p">(</span><span class="s1">'book'</span><span class="p">))</span> <span class="gp">>>> </span><span class="n">a</span><span class="p">,</span> <span class="n">a</span><span class="o">.</span><span class="n">num_books</span> <span class="go">(<Publisher: A>, 2)</span> <span class="gp">>>> </span><span class="n">b</span><span class="p">,</span> <span class="n">b</span><span class="o">.</span><span class="n">num_books</span> <span class="go">(<Publisher: B>, 1)</span> </pre></div> </div> <p>Both queries return a list of publishers that have at least one book with a rating exceeding 3.0, hence publisher C is excluded.</p> <p>In the first query, the annotation precedes the filter, so the filter has no effect on the annotation. <code class="docutils literal"><span class="pre">distinct=True</span></code> is required to avoid a <a class="reference internal" href="#combining-multiple-aggregations"><span class="std std-ref">cross-join bug</span></a>.</p> <p>The second query counts the number of books that have a rating exceeding 3.0 for each publisher. The filter precedes the annotation, so the filter constrains the objects considered when calculating the annotation.</p> <p>Here’s another example with the <code class="docutils literal"><span class="pre">Avg</span></code> aggregate:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">a</span><span class="p">,</span> <span class="n">b</span> <span class="o">=</span> <span class="n">Publisher</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">avg_rating</span><span class="o">=</span><span class="n">Avg</span><span class="p">(</span><span class="s1">'book__rating'</span><span class="p">))</span><span class="o">.</span><span class="n">filter</span><span class="p">(</span><span class="n">book__rating__gt</span><span class="o">=</span><span class="mf">3.0</span><span class="p">)</span> <span class="gp">>>> </span><span class="n">a</span><span class="p">,</span> <span class="n">a</span><span class="o">.</span><span class="n">avg_rating</span> <span class="go">(<Publisher: A>, 4.5) # (5+4)/2</span> <span class="gp">>>> </span><span class="n">b</span><span class="p">,</span> <span class="n">b</span><span class="o">.</span><span class="n">avg_rating</span> <span class="go">(<Publisher: B>, 2.5) # (1+4)/2</span> <span class="gp">>>> </span><span class="n">a</span><span class="p">,</span> <span class="n">b</span> <span class="o">=</span> <span class="n">Publisher</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">filter</span><span class="p">(</span><span class="n">book__rating__gt</span><span class="o">=</span><span class="mf">3.0</span><span class="p">)</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">avg_rating</span><span class="o">=</span><span class="n">Avg</span><span class="p">(</span><span class="s1">'book__rating'</span><span class="p">))</span> <span class="gp">>>> </span><span class="n">a</span><span class="p">,</span> <span class="n">a</span><span class="o">.</span><span class="n">avg_rating</span> <span class="go">(<Publisher: A>, 4.5) # (5+4)/2</span> <span class="gp">>>> </span><span class="n">b</span><span class="p">,</span> <span class="n">b</span><span class="o">.</span><span class="n">avg_rating</span> <span class="go">(<Publisher: B>, 4.0) # 4/1 (book with rating 1 excluded)</span> </pre></div> </div> <p>The first query asks for the average rating of all a publisher’s books for publisher’s that have at least one book with a rating exceeding 3.0. The second query asks for the average of a publisher’s book’s ratings for only those ratings exceeding 3.0.</p> <p>It’s difficult to intuit how the ORM will translate complex querysets into SQL queries so when in doubt, inspect the SQL with <code class="docutils literal"><span class="pre">str(queryset.query)</span></code> and write plenty of tests.</p> </div> </div> <div class="section" id="s-order-by"> <span id="order-by"></span><h3><code class="docutils literal"><span class="pre">order_by()</span></code><a class="headerlink" href="#order-by" title="Permalink to this headline">¶</a></h3> <p>Annotations can be used as a basis for ordering. When you define an <code class="docutils literal"><span class="pre">order_by()</span></code> clause, the aggregates you provide can reference any alias defined as part of an <code class="docutils literal"><span class="pre">annotate()</span></code> clause in the query.</p> <p>For example, to order a <code class="docutils literal"><span class="pre">QuerySet</span></code> of books by the number of authors that have contributed to the book, you could use the following query:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">num_authors</span><span class="o">=</span><span class="n">Count</span><span class="p">(</span><span class="s1">'authors'</span><span class="p">))</span><span class="o">.</span><span class="n">order_by</span><span class="p">(</span><span class="s1">'num_authors'</span><span class="p">)</span> </pre></div> </div> </div> <div class="section" id="s-values"> <span id="values"></span><h3><code class="docutils literal"><span class="pre">values()</span></code><a class="headerlink" href="#values" title="Permalink to this headline">¶</a></h3> <p>Ordinarily, annotations are generated on a per-object basis - an annotated <code class="docutils literal"><span class="pre">QuerySet</span></code> will return one result for each object in the original <code class="docutils literal"><span class="pre">QuerySet</span></code>. However, when a <code class="docutils literal"><span class="pre">values()</span></code> clause is used to constrain the columns that are returned in the result set, the method for evaluating annotations is slightly different. Instead of returning an annotated result for each result in the original <code class="docutils literal"><span class="pre">QuerySet</span></code>, the original results are grouped according to the unique combinations of the fields specified in the <code class="docutils literal"><span class="pre">values()</span></code> clause. An annotation is then provided for each unique group; the annotation is computed over all members of the group.</p> <p>For example, consider an author query that attempts to find out the average rating of books written by each author:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">Author</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">average_rating</span><span class="o">=</span><span class="n">Avg</span><span class="p">(</span><span class="s1">'book__rating'</span><span class="p">))</span> </pre></div> </div> <p>This will return one result for each author in the database, annotated with their average book rating.</p> <p>However, the result will be slightly different if you use a <code class="docutils literal"><span class="pre">values()</span></code> clause:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">Author</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">values</span><span class="p">(</span><span class="s1">'name'</span><span class="p">)</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">average_rating</span><span class="o">=</span><span class="n">Avg</span><span class="p">(</span><span class="s1">'book__rating'</span><span class="p">))</span> </pre></div> </div> <p>In this example, the authors will be grouped by name, so you will only get an annotated result for each <em>unique</em> author name. This means if you have two authors with the same name, their results will be merged into a single result in the output of the query; the average will be computed as the average over the books written by both authors.</p> <div class="section" id="s-order-of-annotate-and-values-clauses"> <span id="order-of-annotate-and-values-clauses"></span><h4>Order of <code class="docutils literal"><span class="pre">annotate()</span></code> and <code class="docutils literal"><span class="pre">values()</span></code> clauses<a class="headerlink" href="#order-of-annotate-and-values-clauses" title="Permalink to this headline">¶</a></h4> <p>As with the <code class="docutils literal"><span class="pre">filter()</span></code> clause, the order in which <code class="docutils literal"><span class="pre">annotate()</span></code> and <code class="docutils literal"><span class="pre">values()</span></code> clauses are applied to a query is significant. If the <code class="docutils literal"><span class="pre">values()</span></code> clause precedes the <code class="docutils literal"><span class="pre">annotate()</span></code>, the annotation will be computed using the grouping described by the <code class="docutils literal"><span class="pre">values()</span></code> clause.</p> <p>However, if the <code class="docutils literal"><span class="pre">annotate()</span></code> clause precedes the <code class="docutils literal"><span class="pre">values()</span></code> clause, the annotations will be generated over the entire query set. In this case, the <code class="docutils literal"><span class="pre">values()</span></code> clause only constrains the fields that are generated on output.</p> <p>For example, if we reverse the order of the <code class="docutils literal"><span class="pre">values()</span></code> and <code class="docutils literal"><span class="pre">annotate()</span></code> clause from our previous example:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">Author</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">average_rating</span><span class="o">=</span><span class="n">Avg</span><span class="p">(</span><span class="s1">'book__rating'</span><span class="p">))</span><span class="o">.</span><span class="n">values</span><span class="p">(</span><span class="s1">'name'</span><span class="p">,</span> <span class="s1">'average_rating'</span><span class="p">)</span> </pre></div> </div> <p>This will now yield one unique result for each author; however, only the author’s name and the <code class="docutils literal"><span class="pre">average_rating</span></code> annotation will be returned in the output data.</p> <p>You should also note that <code class="docutils literal"><span class="pre">average_rating</span></code> has been explicitly included in the list of values to be returned. This is required because of the ordering of the <code class="docutils literal"><span class="pre">values()</span></code> and <code class="docutils literal"><span class="pre">annotate()</span></code> clause.</p> <p>If the <code class="docutils literal"><span class="pre">values()</span></code> clause precedes the <code class="docutils literal"><span class="pre">annotate()</span></code> clause, any annotations will be automatically added to the result set. However, if the <code class="docutils literal"><span class="pre">values()</span></code> clause is applied after the <code class="docutils literal"><span class="pre">annotate()</span></code> clause, you need to explicitly include the aggregate column.</p> </div> <div class="section" id="s-interaction-with-default-ordering-or-order-by"> <span id="interaction-with-default-ordering-or-order-by"></span><h4>Interaction with default ordering or <code class="docutils literal"><span class="pre">order_by()</span></code><a class="headerlink" href="#interaction-with-default-ordering-or-order-by" title="Permalink to this headline">¶</a></h4> <p>Fields that are mentioned in the <code class="docutils literal"><span class="pre">order_by()</span></code> part of a queryset (or which are used in the default ordering on a model) are used when selecting the output data, even if they are not otherwise specified in the <code class="docutils literal"><span class="pre">values()</span></code> call. These extra fields are used to group “like” results together and they can make otherwise identical result rows appear to be separate. This shows up, particularly, when counting things.</p> <p>By way of example, suppose you have a model like this:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="kn">from</span> <span class="nn">django.db</span> <span class="k">import</span> <span class="n">models</span> <span class="k">class</span> <span class="nc">Item</span><span class="p">(</span><span class="n">models</span><span class="o">.</span><span class="n">Model</span><span class="p">):</span> <span class="n">name</span> <span class="o">=</span> <span class="n">models</span><span class="o">.</span><span class="n">CharField</span><span class="p">(</span><span class="n">max_length</span><span class="o">=</span><span class="mi">10</span><span class="p">)</span> <span class="n">data</span> <span class="o">=</span> <span class="n">models</span><span class="o">.</span><span class="n">IntegerField</span><span class="p">()</span> <span class="k">class</span> <span class="nc">Meta</span><span class="p">:</span> <span class="n">ordering</span> <span class="o">=</span> <span class="p">[</span><span class="s2">"name"</span><span class="p">]</span> </pre></div> </div> <p>The important part here is the default ordering on the <code class="docutils literal"><span class="pre">name</span></code> field. If you want to count how many times each distinct <code class="docutils literal"><span class="pre">data</span></code> value appears, you might try this:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="c1"># Warning: not quite correct!</span> <span class="n">Item</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">values</span><span class="p">(</span><span class="s2">"data"</span><span class="p">)</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">Count</span><span class="p">(</span><span class="s2">"id"</span><span class="p">))</span> </pre></div> </div> <p>...which will group the <code class="docutils literal"><span class="pre">Item</span></code> objects by their common <code class="docutils literal"><span class="pre">data</span></code> values and then count the number of <code class="docutils literal"><span class="pre">id</span></code> values in each group. Except that it won’t quite work. The default ordering by <code class="docutils literal"><span class="pre">name</span></code> will also play a part in the grouping, so this query will group by distinct <code class="docutils literal"><span class="pre">(data,</span> <span class="pre">name)</span></code> pairs, which isn’t what you want. Instead, you should construct this queryset:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="n">Item</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">values</span><span class="p">(</span><span class="s2">"data"</span><span class="p">)</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">Count</span><span class="p">(</span><span class="s2">"id"</span><span class="p">))</span><span class="o">.</span><span class="n">order_by</span><span class="p">()</span> </pre></div> </div> <p>...clearing any ordering in the query. You could also order by, say, <code class="docutils literal"><span class="pre">data</span></code> without any harmful effects, since that is already playing a role in the query.</p> <p>This behavior is the same as that noted in the queryset documentation for <a class="reference internal" href="../../ref/models/querysets.html#django.db.models.query.QuerySet.distinct" title="django.db.models.query.QuerySet.distinct"><code class="xref py py-meth docutils literal"><span class="pre">distinct()</span></code></a> and the general rule is the same: normally you won’t want extra columns playing a part in the result, so clear out the ordering, or at least make sure it’s restricted only to those fields you also select in a <code class="docutils literal"><span class="pre">values()</span></code> call.</p> <div class="admonition note"> <p class="first admonition-title">Note</p> <p class="last">You might reasonably ask why Django doesn’t remove the extraneous columns for you. The main reason is consistency with <code class="docutils literal"><span class="pre">distinct()</span></code> and other places: Django <strong>never</strong> removes ordering constraints that you have specified (and we can’t change those other methods’ behavior, as that would violate our <a class="reference internal" href="../../misc/api-stability.html"><span class="doc">API stability</span></a> policy).</p> </div> </div> </div> <div class="section" id="s-aggregating-annotations"> <span id="aggregating-annotations"></span><h3>Aggregating annotations<a class="headerlink" href="#aggregating-annotations" title="Permalink to this headline">¶</a></h3> <p>You can also generate an aggregate on the result of an annotation. When you define an <code class="docutils literal"><span class="pre">aggregate()</span></code> clause, the aggregates you provide can reference any alias defined as part of an <code class="docutils literal"><span class="pre">annotate()</span></code> clause in the query.</p> <p>For example, if you wanted to calculate the average number of authors per book you first annotate the set of books with the author count, then aggregate that author count, referencing the annotation field:</p> <div class="highlight-default"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="kn">from</span> <span class="nn">django.db.models</span> <span class="k">import</span> <span class="n">Count</span><span class="p">,</span> <span class="n">Avg</span> <span class="gp">>>> </span><span class="n">Book</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">annotate</span><span class="p">(</span><span class="n">num_authors</span><span class="o">=</span><span class="n">Count</span><span class="p">(</span><span class="s1">'authors'</span><span class="p">))</span><span class="o">.</span><span class="n">aggregate</span><span class="p">(</span><span class="n">Avg</span><span class="p">(</span><span class="s1">'num_authors'</span><span class="p">))</span> <span class="go">{'num_authors__avg': 1.66}</span> </pre></div> </div> </div> </div> </div> </div> </div> </div> <div class="yui-b" id="sidebar"> <div class="sphinxsidebar" role="navigation" aria-label="main navigation"> <div class="sphinxsidebarwrapper"> <h3><a href="../../contents.html">Table Of Contents</a></h3> <ul> <li><a class="reference internal" href="#">Aggregation</a><ul> <li><a class="reference internal" href="#cheat-sheet">Cheat sheet</a></li> <li><a class="reference internal" href="#generating-aggregates-over-a-queryset">Generating aggregates over a QuerySet</a></li> <li><a class="reference internal" href="#generating-aggregates-for-each-item-in-a-queryset">Generating aggregates for each item in a QuerySet</a><ul> <li><a class="reference internal" href="#combining-multiple-aggregations">Combining multiple aggregations</a></li> </ul> </li> <li><a class="reference internal" href="#joins-and-aggregates">Joins and aggregates</a><ul> <li><a class="reference internal" href="#following-relationships-backwards">Following relationships backwards</a></li> </ul> </li> <li><a class="reference internal" href="#aggregations-and-other-queryset-clauses">Aggregations and other QuerySet clauses</a><ul> <li><a class="reference internal" href="#filter-and-exclude"><code class="docutils literal"><span class="pre">filter()</span></code> and <code class="docutils literal"><span class="pre">exclude()</span></code></a><ul> <li><a class="reference internal" href="#filtering-on-annotations">Filtering on annotations</a></li> <li><a class="reference internal" href="#order-of-annotate-and-filter-clauses">Order of <code class="docutils literal"><span class="pre">annotate()</span></code> and <code class="docutils literal"><span class="pre">filter()</span></code> clauses</a></li> </ul> </li> <li><a class="reference internal" href="#order-by"><code class="docutils literal"><span class="pre">order_by()</span></code></a></li> <li><a class="reference internal" href="#values"><code class="docutils literal"><span class="pre">values()</span></code></a><ul> <li><a class="reference internal" href="#order-of-annotate-and-values-clauses">Order of <code class="docutils literal"><span class="pre">annotate()</span></code> and <code class="docutils literal"><span class="pre">values()</span></code> clauses</a></li> <li><a class="reference internal" href="#interaction-with-default-ordering-or-order-by">Interaction with default ordering or <code class="docutils literal"><span class="pre">order_by()</span></code></a></li> </ul> </li> <li><a class="reference internal" href="#aggregating-annotations">Aggregating annotations</a></li> </ul> </li> </ul> </li> </ul> <h3>Browse</h3> <ul> <li>Prev: <a href="queries.html">Making queries</a></li> <li>Next: <a href="managers.html">Managers</a></li> </ul> <h3>You are here:</h3> <ul> <li> <a href="../../index.html">Django 1.8.19 documentation</a> <ul><li><a href="../index.html">Using Django</a> <ul><li><a href="index.html">Models and databases</a> <ul><li>Aggregation</li></ul> </li></ul></li></ul> </li> </ul> <div role="note" aria-label="source link"> <h3>This Page</h3> <ul class="this-page-menu"> <li><a href="../../_sources/topics/db/aggregation.txt" rel="nofollow">Show Source</a></li> </ul> </div> <div id="searchbox" style="display: none" role="search"> <h3>Quick search</h3> <form class="search" action="../../search.html" method="get"> <div><input type="text" name="q" /></div> <div><input type="submit" value="Go" /></div> <input type="hidden" name="check_keywords" value="yes" /> <input type="hidden" name="area" value="default" /> </form> </div> <script type="text/javascript">$('#searchbox').show(0);</script> </div> </div> <h3>Last update:</h3> <p class="topless">Mar 10, 2018</p> </div> </div> <div id="ft"> <div class="nav"> « <a href="queries.html" title="Making queries">previous</a> | <a href="../index.html" title="Using Django" accesskey="U">up</a> | <a href="managers.html" title="Managers">next</a> »</div> </div> </div> <div class="clearer"></div> </div> </body> </html>