Sophie

Sophie

distrib > Fedora > 18 > i386 > by-pkgid > 7e03e96dde1cbbdbc7cc96424cd9e059 > files > 167

python-feedparser-doc-5.1.3-3.fc18.noarch.rpm

User-Agent and Referer Headers
==============================

:program:`Universal Feed Parser` sends a default User-Agent string when it
requests a feed from a web server.


The default User-Agent string looks like this:

::

    UniversalFeedParser/5.0.1 +http://feedparser.org/

If you are embedding :program:`Universal Feed Parser` in a larger application,
you should change the User-Agent to your application name and
:abbr:`URL (Uniform Resource Locator)`.


Customizing the User-Agent
--------------------------

::

    >>> import feedparser
    >>> d = feedparser.parse('http://feedparser.org/docs/examples/atom10.xml',
    agent='MyApp/1.0 +http://example.com/')

You can also set the User-Agent once, globally, and then call the ``parse``
function normally.


Customizing the User-Agent permanently
--------------------------------------

::

    >>> import feedparser
    >>> feedparser.USER_AGENT = "MyApp/1.0 +http://example.com/"
    >>> d = feedparser.parse('http://feedparser.org/docs/examples/atom10.xml')


:program:`Universal Feed Parser` also lets you set the referrer when you
download a feed from a web server.  This is discouraged, because it is a
violation of `RFC 2616 <http://www.w3.org/Protocols/rfc2616/rfc2616-sec14.html#sec14.36>`_.
The default behavior is to send a blank referrer, and you should never need to
override this.


Customizing the referrer
------------------------

::

    >>> import feedparser
    >>> d = feedparser.parse('http://feedparser.org/docs/examples/atom10.xml',
    referrer='http://example.com/')