monitoring.html

<!DOCTYPE html>
<html lang="en"><head><meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
    <meta charset="utf-8">
    <meta http-equiv="X-UA-Compatible" content="IE=edge">
    <meta name="viewport" content="width=device-width, initial-scale=1.0">
    <meta name="description" content="Full Stack Python shows how an entire Python web application is built and deployed. Each section of the guide explains a different key concept, from the server through the Python WSGI web framework to the front end JavaScript.">
    <meta name="author" content="Matt Makai">
    <link rel="shortcut icon" href="theme/img/full-stack-python-logo-bw.png">
    <title>Full Stack Python</title>
    <!-- Bootstrap core CSS -->
    <link href="theme/css/fsp.css" rel="stylesheet">
    <!--[if lt IE 9]>
      <script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
      <script src="https://oss.maxcdn.com/libs/respond.js/1.3.0/respond.min.js"></script>
    <![endif]-->
    <style>
    html,
    body {
      font-size: 18px;
      color: #222;
      background: #fefefe;
    }
    body {
      padding-top: 30px;
    }
    .footer {
      padding: 20px 0 30px 0;
    }
    a, a:hover {border-bottom: 1px dotted; color: #444;}
    a:hover {text-decoration: none; color: #000;}
   .logo-title {font-size: 56px; color: #403072; padding-top: 80px;
                font-family: "News Cycle", "Arial Narrow Bold", sans-serif;
                font-weight: bold; line-height: 30px; margin-left: 5px;}
    .logo-title a, .logo-title a:hover {color: #000; text-decoration: none;
                                        border-bottom: none;}
    .logo-title a:hover {color: gray;}
    .logo-image {vertical-align: top; border: none;}
    a.list-group-item.active {background: #444; border: 1px solid #222;}
    a.list-group-item.active:hover {background: #444; border: 1px solid #222;}
    #sidebar {margin-top: 30px;}

    @media (max-width: 600px) {
        .logo-header-section {
          margin: 20px 32px 0 0;
        }
    }
    </style>
        
    <script type="text/javascript">
      var _gaq = _gaq || [];
      _gaq.push(['_setAccount', 'UA-19910497-7']);
  _gaq.push(['_trackPageview']);

  (function() {
    var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
    ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
    var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
  })();
    </script>
  </head>

<body>
    <a href="https://github.com/makaimc/fullstackpython.github.com" class="github">
        <img style="position: absolute; top: 0; right: 0; border: 0;" src="http://s3.amazonaws.com/github/ribbons/forkme_right_darkblue_121621.png" alt="Fork me on GitHub" />
    </a>
    <div class="container">
        <div class="row">
    <div class="col-md-12">
        <div class="logo-header-section">
            <a href="/" style="text-decoration: none; border: none;"><img src="theme/img/full-stack-python-logo-bw.png" height="42" width="42" class="logo-image" /></a>
            <span class="logo-title"><a href="/">Full Stack Python</a></span>
        </div>
    </div>
</div>
        <div class="row">
    <div class="col-md-8">
      <h1>Monitoring</h1>
<p>Capturing and analyzing data about your production environment is critical
to proactively deal with stability, performance, and errors in a web 
application.</p>
<p>There are several important resources to monitor on the operating system 
and network level of a web stack.</p>
<ol>
<li>CPU utilization</li>
<li>Memory utilization</li>
<li>Persistence storage consumed versus free</li>
<li>Network bandwidth and latency</li>
</ol>
<p>Application level monitoring encompasses several aspects. The amount of time
and resources dedicated to each aspect will vary based on whether an 
application is read-heavy, write-heavy, or subject to rapid swings in traffic.</p>
<ol>
<li>Application warnings and errors (500-level HTTP errors)</li>
<li>Application code performance</li>
<li>Template rendering time</li>
<li>Browser rendering time for the application</li>
<li>Database querying performance</li>
</ol>
<h2>Monitoring Third Party Services</h2>
<p><a href="http://newrelic.com/">New Relic</a>. Application and database monitoring as
well as plug ins for capturing and analyzing additional data about tools in
your stack.</p>
<p><a href="http://copperegg.com/">CopperEgg</a> is lower-level monitoring on server and 
infrastructure. It's popular with DevOps shops that are making changes to
their production environments and want immediate feedback on the results
of those modifications.</p>
<p><a href="http://status.io/">Status.io</a> focuses on uptime and response metrics 
transparency for your users.</p>
<p><a href="http://www.pagerduty.com/">PagerDuty</a> alerts a designated person or group
if there are stability, performance, or uptime issues with an application.</p>
<h2>Open Source Monitoring Projects</h2>
<p><a href="https://github.com/etsy/statsd/">statsd</a> is a node.js network daemon that
listens for metrics and aggregates them for transfer into another service
such as Graphite.</p>
<p><a href="https://graphite.readthedocs.org/en/latest/overview.html">Graphite</a> stores
time-series data and displays them in graphs through a Django web application.</p>
<p><a href="http://github.hubspot.com/bucky/">Bucky</a> measures the performance of a
web application from end user's browsers and sends that data back to the
server for collection.</p>
<p><a href="http://sensuapp.org/">Sensu</a> is an open source monitoring framework
written in Ruby but applicable to any programming language web application.</p>
<p><a href="http://vimeo.github.io/graph-explorer/">Graph Explorer</a> by Vimeo is a
Graphite-based dashboard with added features and a slick design.</p>
<h2>Monitoring Resources</h2>
<p><a href="http://www.paperplanes.de/2011/1/5/the_virtues_of_monitoring.html">The Virtues of Monitoring</a></p>
<p><a href="http://blog.docker.io/2013/07/effortless-monitoring-with-collectd-graphite-and-docker/">Effortless Monitoring with collectd, Graphite, and Docker</a></p>
<p>Bit.ly describes the 
"<a href="http://word.bitly.com/post/74839060954/ten-things-to-monitor">10 Things They Forgot to Monitor</a>"
beyond the standard metrics such as disk &amp; memory usage.</p>
<p><a href="http://aarvik.dk/four-linux-server-monitoring-and-management-tools/">Four Linux server monitoring tools</a></p>
<p><a href="https://blog.serverdensity.com/how-to-design-useful-monitoring-graphs-and-visualizations/">How to design useful monitoring and graphing visualizations</a></p>
                                                                                                                                                                                                                                                                                                                                                                                                                                                          <br/>
            Next read the 
            <a href="/configuration-management.html">configuration management</a> section.
                
                                                                                            </div>
    <div class="col-md-offset-1 col-md-3" id="sidebar">
  <div class="list-group">
          <a href="/introduction.html" class="list-group-item ">Introduction</a>
          <a href="/servers.html" class="list-group-item ">Servers</a>
          <a href="/operating-systems.html" class="list-group-item ">Operating Systems</a>
          <a href="/web-servers.html" class="list-group-item ">Web Servers</a>
          <a href="/platform-as-a-service.html" class="list-group-item ">Platform-as-a-service</a>
          <a href="/databases.html" class="list-group-item ">Databases</a>
          <a href="/wsgi-servers.html" class="list-group-item ">WSGI Servers</a>
          <a href="/web-frameworks.html" class="list-group-item ">Web Frameworks</a>
          <a href="/application-dependencies.html" class="list-group-item ">Application Dependencies</a>
          <a href="/static-content.html" class="list-group-item ">Static Content</a>
          <a href="/source-control.html" class="list-group-item ">Source Control</a>
          <a href="/caching.html" class="list-group-item ">Caching</a>
          <a href="/task-queues.html" class="list-group-item ">Task Queues</a>
          <a href="/api-integration.html" class="list-group-item ">API Integration</a>
          <a href="/no-sql-datastore.html" class="list-group-item ">NoSQL Data Stores</a>
          <a href="/web-application-security.html" class="list-group-item ">Web Security</a>
          <a href="/logging.html" class="list-group-item ">Logging</a>
          <a href="/monitoring.html" class="list-group-item active">Monitoring</a>
          <a href="/configuration-management.html" class="list-group-item ">Configuration Management</a>
          <a href="/web-analytics.html" class="list-group-item ">Web Analytics</a>
          <a href="/about-author.html" class="list-group-item ">About the Author</a>
          <a href="/change-log.html" class="list-group-item ">Change Log</a>
      </div>
</div></div>
        <hr/>
        <div class="footer pull-right">
            <a href="http://www.mattmakai.com/" class="underline">Matt Makai</a> 2014
        </div>
    </div>

    <script src="http://code.jquery.com/jquery-2.1.0.min.js"></script>
    <script src="theme/js/bootstrap.min.js"></script>
    </body>
</html>