Python Coverage

Coverage.py is a tool for measuring code coverage of Python programs. It monitors your program, noting which parts of the code have been executed, then analyzes the source to identify code that could have been executed but was not.

Coverage measurement is typically used to gauge the effectiveness of tests. It can show which parts of your code are being exercised by tests, and which are not.

Getting started is easy:

  1. Install coverage.py:

    $ pip install coverage

    For more details, see Installation.

  2. Use coverage run to run your test suite and gather data. However you normally run your test suite, you can run your test runner under coverage. If your test runner command starts with “python”, just replace the initial “python” with “coverage run”.

    Instructions for specific test runners:pytestunittestnosetes

Nose has been unmaintained for a long time. You should seriously consider adopting a different test runner.

Change this:

$ pytest arg1 arg2 arg3

to:

$ coverage run -m pytest arg1 arg2 arg3

To limit coverage measurement to code in the current directory, and also find files that weren’t executed at all, add the --source=. argument to your coverage command line.

  1. Use coverage report to report on the results:

    $ coverage report -m
    Name                      Stmts   Miss  Cover   Missing
    -------------------------------------------------------
    my_program.py                20      4    80%   33-35, 39
    my_other_module.py           56      6    89%   17-23
    -------------------------------------------------------
    TOTAL                        76     10    87%
  2. For a nicer presentation, use coverage html to get annotated HTML listings detailing missed lines:

    $ coverage html

    Then open htmlcov/index.html in your browser, to see a report like this.

Using coverage.py

There are a few different ways to use coverage.py. The simplest is the command line, which lets you run your program and see the results. If you need more control over how your project is measured, you can use the API.

Some test runners provide coverage integration to make it easy to use coverage.py while running tests. For example, pytest has the pytest-cov plugin.

You can fine-tune coverage.py’s view of your code by directing it to ignore parts that you know aren’t interesting. See Specifying source files and Excluding code from coverage.py for details.

Last updated