You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
Selwin Ong e00ff97867
Fix heroku worker (#993)
* Attempt to fix HerokuWorker test.

* Fixed test_shutdown_double_sigrtmin

* Another attempt to fix test

* Another attempt to fix test

* Another attempt to fix test

* When work horse runs into an exception, raise that exception before calling os._exit()
6 years ago
docs added logging formatting options (#979) 6 years ago
examples fix print in example 11 years ago
rq Fix heroku worker (#993) 6 years ago
tests add is_async property to queue (#982) 6 years ago
.coveragerc Ignore local.py (it's tested in werkzeug instead). 11 years ago
.gitignore horse should always call os._exit(0) 6 years ago
.mailmap Add .mailmap 9 years ago
.travis.yml Replace 'async' keyword with 'is_async' for Queue objects (#977) 7 years ago
CHANGES.md Bump version to 0.12.0 7 years ago
LICENSE Fix year. 13 years ago
MANIFEST.in Added a MANIFEST excluding tests from distribution 12 years ago
Makefile Clean dist+build folders before releasing 10 years ago
README.md Added codecov badge 7 years ago
dev-requirements.txt Added pytest to dev-dependencies (#923) 7 years ago
requirements.txt Reverted click requirement back to >= 3.0 9 years ago
run_tests correct SLOW env var, run slow tests on ci 9 years ago
setup.cfg Smoke tests 7 years ago
setup.py Replace 'async' keyword with 'is_async' for Queue objects (#977) 7 years ago
tox.ini Replace 'async' keyword with 'is_async' for Queue objects (#977) 7 years ago

README.md

RQ (Redis Queue) is a simple Python library for queueing jobs and processing them in the background with workers. It is backed by Redis and it is designed to have a low barrier to entry. It should be integrated in your web stack easily.

RQ requires Redis >= 2.7.0.

Build status PyPI Coverage

Full documentation can be found here.

Getting started

First, run a Redis server, of course:

$ redis-server

To put jobs on queues, you don't have to do anything special, just define your typically lengthy or blocking function:

import requests

def count_words_at_url(url):
    """Just an example function that's called async."""
    resp = requests.get(url)
    return len(resp.text.split())

You do use the excellent requests package, don't you?

Then, create an RQ queue:

from redis import Redis
from rq import Queue

q = Queue(connection=Redis())

And enqueue the function call:

from my_module import count_words_at_url
job = q.enqueue(count_words_at_url, 'http://nvie.com')

For a more complete example, refer to the docs. But this is the essence.

The worker

To start executing enqueued function calls in the background, start a worker from your project's directory:

$ rq worker
*** Listening for work on default
Got count_words_at_url('http://nvie.com') from default
Job result = 818
*** Listening for work on default

That's about it.

Installation

Simply use the following command to install the latest released version:

pip install rq

If you want the cutting edge version (that may well be broken), use this:

pip install -e git+https://github.com/nvie/rq.git@master#egg=rq

Project history

This project has been inspired by the good parts of Celery, Resque and this snippet, and has been created as a lightweight alternative to the heaviness of Celery or other AMQP-based queueing implementations.