util
/
rq
mirror of https://github.com/peter4431/rq.git
4
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,134 Commits
2 Branches
0 Tags
3.3 MiB
main
master
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'c00d3681f9'
${ noResults }
Commit Graph

737 Commits (c00d3681f95ce04af5342a4b68cb6f9239fe701d)

Author SHA1 Message Date
glaslos 646f1cda22 Merge branch 'master' into ttl_tests_fixes 
Conflicts:
	rq/queue.py
 10 years ago
glaslos 5b5ab4860f passing on the ttl 10 years ago
Bradley Young f05d77b92b changing "default" for exception_handlers to None; same exact logic can be implemented, but cleaner 10 years ago
Bradley Young d3e4fb567b merge && updates to add multiple exception handlers. 10 years ago
Bradley Young f575137612 updating worker to have exception_handlers 10 years ago
Selwin Ong dac0be6cc7 Added DeferredJobsRegistry to keep track of deferred jobs. 10 years ago
Selwin Ong 3e674fbe6a queue.enqueue() should set job.origin. 10 years ago
Selwin Ong 9320496402 Simplify FailedQueue.quarantine and ensure that a deferred job's status is set to Queued when enqueued. 10 years ago
Selwin Ong 7fd2ac8ca6 Added "DEFERRED" Job status for jobs that have unsatisfied dependencies. 10 years ago
Vincent Driessen dc5cd514ee Explicitly cast map() result to a list, for Python 3 compat. 10 years ago
Selwin Ong dc09676ee0 Minor copywriting fixes. 10 years ago
Selwin Ong 01ab2f20dd Minor copywriting fixes. 10 years ago
Vincent Driessen 543bcbc60b Explicitly cast map() result to a list, for Python 3 compat. 10 years ago
Selwin Ong eae2c40ea0 Merge pull request #457 from jlopex/block_until_horse_finishes 
Make parent worker process wait until horse process finishes
 10 years ago
Selwin Ong 0a0a81da6d Merge pull request #463 from conslo/skip-queue 
Skip queue
 10 years ago
Mark LaPerriere e6c32edad9 add birth_date and death_date properties to Worker 10 years ago
Jonathan Tushman 1ae5a12a81 merging master 10 years ago
Jonathan Tushman ccd41396f6 adding suspend with duration test 10 years ago
Travis Johnson add4d625b6 Merge branch 'nvie' into skip-queue 
Conflicts:
	rq/queue.py
 10 years ago
Vincent Driessen cd0c3c9c1e Merge pull request #462 from conslo/worker-hash 
Worker hash
 10 years ago
Jonathan Tushman 82333d2ad5 triggering shutdown by setting a redis flag 10 years ago
Travis Johnson db75958ad2 use 'at_front' instead of 'skip_queue' 10 years ago
Selwin Ong e1801c5c44 Merge pull request #453 from glaslos/job_ttl 
TTL for jobs
 10 years ago
Travis Johnson ac61f502a1 skip_queue functionality 10 years ago
Travis Johnson f60e4884df a comment typo 10 years ago
Travis Johnson 0ad4cb3410 comments 10 years ago
Travis Johnson c301369c2e implement __eq__ and __hash__ for workers 10 years ago
Nic Cope 09cab7a90d Allow maximum job age to be specified when cleaning up or getting expired jobs from a registry. 
This ensures that all jobs cleaned from a started registry end up in the failed queue.
 10 years ago
Javier Lopez fc5295edfc Set busy state on parent while waiting for horse 10 years ago
Nic Cope 6ab7070a92 Rename registry timeout to registry ttl 
This matches job.cleanup() better and (I think) makes the purpose slightly clearer.
 10 years ago
Nic Cope 9f699d758d Any negative number should cause a job to live forever in a registry. 
While the documentation explicitly mentions ttl=-1, this matches better the behaviour of the job.cleanup() method.
 10 years ago
glaslos c6a83eaa82 calling self.cleanup to set job expiration 10 years ago
glaslos 8a3fd91e2e renaming job.job_ttl to job.ttl 10 years ago
Selwin Ong 2091c601b1 Merge pull request #451 from conslo/depend-on-unsaved-job-ids 
Depend on unsaved job ids
 10 years ago
Nic Cope 8fa184b86b Ensure the FinishedJobRegistry honors an 'infinite' result_ttl of -1 10 years ago
glaslos 55c541bc59 added job ttl to queue.enqueue() 10 years ago
Travis Johnson af4b0436c1 instantiate a job instead of fetch 
this removes the need for the depended on job.id already being saved
 10 years ago
Travis Johnson 14d1186241 use internal job_class for check 10 years ago
Bradley Young 5caccaabfe Adding optional list handling to the exc_handler option in Worker. 
Adding command line --exception_handler option (with multiple entries allowed) to `rq worker`
Added tests for command line options.
 10 years ago
Travis Johnson 3467868f1f allow depends_on to be a job id or a job itself 
Other parts of the code (i.e.: the `.create()` method) allow the `depends_on` kwarg to be a `Job` object *or* a job id. This is an attempt to allow that same idea within the `.enqueue_call()` method for a queue. Since this part of the code requires actually knowing the precise redis key for the job that's depended on, my intuition is that a `.fetch()` is the only way to solve this.
 10 years ago
Selwin Ong 0dbe68527c Merge pull request #431 from negz/worker-redis-bug 
Pass the default worker connection into the started and finished registries
 10 years ago
Adam Wen f5001a0e36 fix decode error in py3. 10 years ago
Adam Wen 1795e1ee53 fix decode 10 years ago
Adam Wen cd0230cae3 make job description unicode friendly 10 years ago
Nic Cope de0b501823 Pass the default worker connection into the started and finished registries 
In practice all the registry methods are called with pipelines, but if no
connection is passed in when instantiating the registry and the connection
stack is empty resolve_connection will raise NoRedisConnectionException.
 10 years ago
zhangliyong 6621105bde Use type instead of default to specify interval option type 10 years ago
zhangliyong 3d49784bcc Merge branch 'master' of github.com:nvie/rq into cli-rq-worker 10 years ago
Selwin Ong 2307bc8253 Added FinishedJobRegistry to monitor finished jobs. 10 years ago
Selwin Ong 74a9982ecb Fixed a bug where expired jobs aren't deleted from JobStartedRegistry. 10 years ago
Selwin Ong 18c6ea64ef Merge pull request #419 from selwin/registry-len 
Added JobStartedRegistry.count
 10 years ago
zhangliyong f9511664c8 Make flake8 happy :) 10 years ago
zhangliyong 1b39996bf7 Make pep8 10 years ago
zhangliyong c6033b312e Cleanup 10 years ago
zhangliyong 6510bb46f3 Fix interval type bug, it should be float 10 years ago
zhangliyong 21c14c0e21 Cleanup 10 years ago
zhangliyong 4d91f136f8 Move redis url default value to connect function 
So worker subcommand can retrieve redis url from config file if url
option value is None, otherwise url option value will never be None.
 10 years ago
zhangliyong 4df076f3aa Retrieve url from config file 10 years ago
zhangliyong 229a00fee5 Cleanup 10 years ago
zhangliyong 88fe5124d8 Make pythonic 10 years ago
zhangliyong 907e71dc86 Make pythonic 10 years ago
zhangliyong f10c749b7c Use click's evvar to retrieve SENTRY_DSN environment value 10 years ago
zhangliyong 842f27294a Convert rqworker to 'rq worker' subcommand 10 years ago
zhangliyong 7b434a32eb Let cleanup_ghosts accept conn argument 10 years ago
Selwin Ong 202be75b21 Merge pull request #415 from foxx/feature/custom-job-ids 
Allow job ID to be set on enqueue/enqueue_call() - fixes #412
 10 years ago
Selwin Ong c1dc30eae3 Added __len__ method to Queue. 10 years ago
Selwin Ong fae7df5aa7 Renamed StartedJobRegistry.get_job_count to StartedJobRegistry.count for consistency. 10 years ago
Selwin Ong 41ae1ce8a7 Added a registry.get_job_count(). 10 years ago
foxx 30ea76ddd6 Fixed silly typo 10 years ago
foxx 0466562a13 Fixes from comments in #415 
Added tox/vagrant tmp dir to gitignore
Removed unused import
Renamed id to job_id in enqueue_call() as per comments in #415
 10 years ago
Vincent Driessen 783b6f9ec7 Fix PEP8 complaint. 10 years ago
Vincent Driessen 7686785d61 Merge branch 'selwin-working-queue' 
Conflicts:
	tests/test_worker.py
 10 years ago
Vincent Driessen 4b7c59d68d Fix PEP8 complaints. 10 years ago
Selwin Ong 6d79082b62 Call move_expired_jobs_to_failed_queue before returning job_ids. 10 years ago
Selwin Ong 9341a4a33d Renamed WorkingQueue to StartedJobRegistry. 10 years ago
Selwin Ong 2e96148b31 Fixed Python 3 tests for "WorkingQueue". 10 years ago
Selwin Ong 60c7a3cc6e working_queue.remove call should be pipelined. 10 years ago
Selwin Ong 4d90cc062e Add job to WorkingQueue before execution and remove from WorkingQueue after. 10 years ago
Selwin Ong b0c0a84ab0 Moved some logic into worker.prepare_job_execution to make things testable. 10 years ago
Selwin Ong a28575088b Implemented WorkingQueue.cleanup(). 10 years ago
Selwin Ong 3dc008d090 Added WorkingQueue class. 10 years ago
foxx b6499ce71c Fixed another py3 bug - my bad. Also moved type checking further down 10 years ago
foxx f5779c194f Renamed job_id to id, and fixed py3 bug, per #415 10 years ago
Vincent Driessen 9ab46804c6 Merge pull request #417 from foxx/feature/testworker 
Added test worker for unit tests - fixes #413
 10 years ago
foxx 52c3ad0fbf Renamed to SimpleWorker 10 years ago
foxx 16ee71f26d Use class for test worker, and performs PID check in unit tests, #412 10 years ago
Vincent Driessen b5fbc3992b Restructure new CLI modules. 
A few things have changed.  First of all, there is no separate copy of
the argparse-based `rqinfo` anymore.  It now fully utilizes the new
Click subcommand.  In other words: `rqinfo` and `rq info` both invoke
the same function under the hood.

In order to support this, the main command group now does NOT take
a `url` option and initializes the connection.  Besides supporting this
alias pattern, this change was useful for two more reasons: (1) it
allows us to add subcommands that don't need the Redis server running in
the future, and (2) it makes the `--url` option an option underneath
each subcommand.  This avoids command invocations that look like this:

    $ rq --url <url> info --more --flags

And instead allows us to pass the URL to each subcommand where it's
deemed necessary:

    $ rq info --url <url> --more --flags

Which is much friendlier to use/remember.
 10 years ago
Vincent Driessen 652cd71d2b Merge branch 'zhangliyong-cli-rq' 10 years ago
Vincent Driessen 5c96c61255 Change `rq requeue` subtly, mostly docs and vars. 10 years ago
Vincent Driessen 07dda74710 Change options of the `rq empty` command. 
* Does not ask confirmation
* Does not need `--yes` option anymore
* Added --all, to clear all queues
* No implicit emptying of the failed queue.  If you want to empty the
  failed queue, just use `$ rq empty failed`
 10 years ago
Vincent Driessen 8f1e066f15 Various little style fixes. 10 years ago
Vincent Driessen fc803f5d0d Fix various flake8 complaints. 10 years ago
foxx 2753f17e8e Fixed bug with format() in py3 10 years ago
foxx 72bc9e37b7 Forced job_id to only allow str/unicode 10 years ago
foxx 6bb8b26114 Allow job ID to be set on enqueue/enqueue_call() - fixes #412 10 years ago
Selwin Ong 21620e98ca Merge pull request #411 from selwin/fix-exception-handler 
Don't pass "args" into logging call
 10 years ago
zhangliyong 3eabe76690 Move back rqinfo command for backward compatibility 10 years ago
zhangliyong 4248c934ab Remove unused function 'gettersize' 10 years ago
Selwin Ong 7cf8ef42d1 Don't pass "args" into logging call. 10 years ago
zhangliyong ae1681e7a0 Change doc of rq cli 10 years ago
zhangliyong de471b70b6 Merge branch 'master' of github.com:nvie/rq into cli-rq 10 years ago
zhangliyong f734708ad4 Make pythonic 10 years ago
zhangliyong 5670f251d8 Add '--all' option and [JOB_IDS] argument to specify what to requeue 10 years ago
Dave Bonner 6eea986012 allow queue class to be overriden from command line 
use the same mechanism as the override for worker class.
 10 years ago
zhangliyong 37748e5ace Make pep8 10 years ago
zhangliyong 1c97a55064 compat str.format syntax with py26 10 years ago
zhangliyong 0c4e28bd62 Use 'with Connection' instead of 'use_connection' 10 years ago
zhangliyong 1e5a8b58a1 Use -y option to confirm emptying failed queue by default 10 years ago
zhangliyong c90da5336e Avoid using use_connection, initial queues directly using redis connection 10 years ago
zhangliyong adc24b6fe0 Fix import error 10 years ago
zhangliyong 551483b477 Add rq info command 10 years ago
zhangliyong 81febc6dc5 Format empty help message 11 years ago
zhangliyong f845ae25a2 Make command empty help message friendly 11 years ago
zhangliyong 36880db872 Show progressbar when requeuing 11 years ago
zhangliyong e1d236ec02 Use click.echo instead of print to output 11 years ago
zhangliyong 7f3cb8e785 Merge branch 'master' into cli-rq 11 years ago
zhangliyong 07aea5e5c1 Add CLI `rq` to empty queues and requeue failed jobs 11 years ago
INADA Naoki 4fb2914c6f Easy refactoring on decorators.py 11 years ago
Selwin Ong b05c2052e1 Capture more data when logging errors. 11 years ago
Vincent Driessen 3de8a47f06 Merge pull request #390 from selwin/pipeline-dependency-registration 
job.register_dependency() should support pipelining
 11 years ago
Selwin Ong fc19a64670 job.register_dependency() should support pipelining. 11 years ago
Vincent Driessen b91b89a183 Use highest pickle protocol version to serialize job data. 11 years ago
Vincent Driessen 79db282879 Support enqueueing callable classes. 
Fixes #388.
 11 years ago
Vincent Driessen 865efd6e8c Leave setting the state to the worker, not the Job itself. 
Should fix #389.
 11 years ago
Vincent Driessen eb6fb27281 Change confusing method name. 11 years ago
Vincent Driessen 6299af15fc Merge branch 'master' of github.com:nvie/rq 11 years ago
Vincent Driessen d37f49f643 Merge branch 'andrewsg-warnings' 11 years ago
Vincent Driessen 12932a433b Merge pull request #382 from selwin/cancel-should-remove-from-queue 
job.cancel() should remove itself from queue
 11 years ago
Selwin Ong 2ab7276230 Merge pull request #377 from selwin/logging-fix 
Only add logging handler if nothing is configured
 11 years ago
Selwin Ong 638211df20 job.cancel() should remove itself from queue. 11 years ago
Selwin Ong b828078dde Fixed default logging level in setup_loghandlers. 11 years ago
Selwin Ong 92fb787a69 Only add logging handler if nothing is configured. 11 years ago
Scott Vitale b464c37468 Use as_text to fix syntax error discovered in Python 3.2 (raspberry pi) 11 years ago
David Bonner e2f398be80 fix --worker-ttl command line arg 
Make sure it's converted to an int, since the rest of the code expects it to be.  Without this patch, trying to use that argument gets you something like this:

(cogo)[dbonner@bonnervm18 syseng]$ rqworker --worker-ttl 86400
21:52:07 RQ worker started, version 0.4.6
Traceback (most recent call last):
  File "/opt/cogo/bin/rqworker", line 9, in <module>
    load_entry_point('rq==0.4.6', 'console_scripts', 'rqworker')()
  File "/home/dbonner/src/github/rq/rq/scripts/rqworker.py", line 102, in main
    w.work(burst=args.burst)
  File "/home/dbonner/src/github/rq/rq/worker.py", line 354, in work
    timeout = None if burst else max(1, self.default_worker_ttl - 60)
TypeError: unsupported operand type(s) for -: 'str' and 'int'
 11 years ago
Selwin Ong 8095a565ac rqworker script should accept "--job-class" parameter. 11 years ago
Selwin Ong 7ac1c3500a Worker.__init__ should accept custom job class. 11 years ago
Selwin Ong 141278bb42 Queue.__init__ supports job_class argument. 11 years ago
Andrew Gorcester 17a4ed056d use warnings.warn() instead of raise for DeprecationWarning 11 years ago
Vincent Driessen 6644872273 Raise warning when using async Sentry transport. 11 years ago
Vincent Driessen 2314b62d8c Start release 0.4.6. 11 years ago
Vincent Driessen f0e02996bc Use single quotes for string literals. 11 years ago
Vincent Driessen 0fbc9e4851 Release 0.4.5. 11 years ago
Marko Mrdjenovic 78b8d2a6ef kwargs must be strings, unicode fails with "keywords must be strings" 11 years ago
Vincent Driessen 972b367af4 Release 0.4.4. 11 years ago
Vincent Driessen 83382f51d0 PEP8ify. 11 years ago
Vincent Driessen c263f8f600 Fix regression introduced in 0.4.3. 11 years ago
Vincent Driessen c0567be69a Release 0.4.3. 11 years ago
Vincent Driessen fba11aac91 Merge branch 'SanyerMyasoedov-master' 11 years ago
Vincent Driessen c5939479b5 Merge remote-tracking branch 'origin/master' into SanyerMyasoedov-master 
Conflicts:
	rq/decorators.py
	tests/__init__.py
	tests/test_decorator.py
 11 years ago
Vincent Driessen b048e23875 Merge pull request #342 from friedcell/master 
make job class dynamic
 11 years ago
Vincent Driessen ab9e6b852e Fix PEP8 complaints. 11 years ago
Vincent Driessen 38ec259b6e Enable the most modern Python syntax. 11 years ago
Vincent Driessen 4746602c57 Explicit string check in Job constructor. 11 years ago
Vincent Driessen 9def988a85 Flip conditional sides of helper definitions (no semantic change). 11 years ago
Marko Mrdjenovic 5cba260cca Job and Queue classes as variables (compatible with existing naming) 11 years ago
msoedov e76020d894 Removed @resolve_connection from job decorator. 
-- resolve_connection already presence inside Queue __init__.
 11 years ago
msoedov b4bccb2d31 Moved @resolve_connection call into @delay wrapper 11 years ago
Marko Mrdjenovic 67dd1cbf34 make job class dynamic for more hackability 11 years ago
Vincent Driessen ef9456ddbd Bump version to 0.4.2. 11 years ago
Vincent Driessen 5fe82bd543 Merge pull request #341 from SanyerMyasoedov/master 
Added depends_on to job decorator
 11 years ago
msoedov 46c96f9481 Added depends_on to job decorator 11 years ago
Vincent Driessen 415662d42c Bump version. 11 years ago
Vincent Driessen e60584ef76 Use single quotes for string literals. 11 years ago
Vincent Driessen dfd23d6fb8 Fix bug where RQ 0.4 could not unpickle jobs from RQ 0.3.x. 11 years ago
Vincent Driessen 39258e2c15 Release 0.4.0. 11 years ago
Vincent Driessen aef7af9c77 Merge pull request #334 from nvie/emptying-failed-queue 
Emptying failed queue
 11 years ago
Vincent Driessen 7ea106e50e Merge pull request #333 from selwin/explicit-args 
Rearranged how explicit kwargs are passed into queue.enqueue(). Fixes #322
 11 years ago
Vincent Driessen cb34acc279 Add rqinfo -X command. 
This can be used to empty the failed queue right from the command line.
 11 years ago
Vincent Driessen 4d9c20d5d9 Reimplement Queue.empty() in a Lua script. 
This makes the .empty() function perform all the computing in Redis
itself, rather than in Python.  This is both atomic, and faster.
 11 years ago
Vincent Driessen 057c4657ef Fix whitespace. 11 years ago
Vincent Driessen fdf4abcf69 Fix pipeline call. 11 years ago
Selwin Ong 4f918041e3 Rearranged how explicit kwargs are passed into queue.enqueue(). Fixes #322 11 years ago
Tomas Hanacek 6494233058 rqworker default arguments of socket, worker_ttl, results_ttl bugfix 11 years ago
Vincent Driessen 35d839f4e2 Merge pull request #330 from selwin/death-penalty 
Job timeouts are now handled by "worker.death_penalty_class"
 11 years ago
Vincent Driessen 3649ff863b Don't rely on external package `first`. 11 years ago
Selwin Ong 7eb6c2ab9f Job timeouts are now handled by "worker.death_penalty_class". 11 years ago
Vincent Driessen a55be12864 Merge branch 'malthe-default-to-environment-args' 11 years ago
Vincent Driessen 3667e37ed3 Don't expose the envvar values through `rqinfo -h`. 11 years ago
Vincent Driessen 1ada3462dd Merge pull request #329 from olingerc/workonrqinfo 
Use get_state() instead of .state in rqinfo
 11 years ago
Christophe Olinger e16b89de3b Use get_state() instead of .state in rqinfo 11 years ago
Malthe Borch e77b3e8a21 Pull argument parser defaults from environment variables. 11 years ago
Selwin Ong 835c353380 Job status should be updated during job.perform(). 11 years ago
Selwin Ong 57990fa052 Simplify worker.work() by moving some functionalities to relevant methods. 11 years ago
Selwin Ong f5c3c9a6dd Deprecate job.status. 11 years ago
Selwin Ong 72457d2286 Added DeprecationWarning to worker.state. 11 years ago
Selwin Ong 2fe5d9e25e Python 3 compatibility with worker.get_current_job(). 11 years ago
Selwin Ong 802ecb5ccb Renamed worker.set_job_id() and worker.get_job_id() for consistency. 11 years ago
Selwin Ong 93bb9ec5f4 Added tests for worker.get_current_job(). 11 years ago
Selwin Ong 1b3832adb5 Merge branch 'master' of https://github.com/mbr/rq into worker-get_job_id 
Conflicts:
	rq/worker.py
 11 years ago
Selwin Ong 37376cfe42 Deprecate worker.state. 11 years ago
Vincent Driessen 383ffa464f Merge branch 'rdooley-master' 11 years ago
Vincent Driessen d2bbd31c59 Fix some flake8 complaints. 11 years ago
Vincent Driessen f7e2375b36 Remove two-char short args. 
In UNIX, this would mean the shorthand notation for `-w -t`, which is
confusing and conflicts with the existing `-w` and `-t` flags.  Instead,
if you need this, you'll have to spell the flag name out because we've
run out of chars that make sense.
 11 years ago
Vincent Driessen c7498b2066 Merge pull request #312 from selwin/rename-fork_and_perform 
Renamed Worker.fork_and_perform_job to Worker.execute_job.
 11 years ago
Malthe Borch ad529e2609 Add repr for (showing id and enqueue time). 11 years ago
Selwin Ong 2044e790f5 Renamed Worker.fork_and_perform_job to Worker.execute_job. 11 years ago
Rees Dooley fb65e321ed Changed timeout to results_ttl. Added similar worker_ttl param 11 years ago
Rees Dooley f8e775a784 Results timeout arg added to rqworker 11 years ago
Marc Brinkmann e81ee5b672 Update worker.py 
Use docstring instead of comment. Sorry.
 11 years ago
Vincent Driessen 9ad7da684c Merge branch 'KanbanSolutions-use-pipeline-context' 11 years ago
Vincent Driessen d0381e98ee Fix .pipeline -> ._pipeline. 
This makes sure it's compatible with both Redis and StrictRedis back
ends.
 11 years ago