Samuel Colvin
6fc34dc6a6
moving started_at to prepare_job_execution
9 years ago
Cal Leeming
d80f9f8ba0
Fixes #613
...
This has been discussed in #514 , #282 and #88 .
Using an explicit type check via `isinstance`, rather than duck typing, is typically considered unpythonic and breaks compatibility with mock objects such as FakeRedis. This patches removes the type check, and instead looks for a common method that should be present on the object as a hint on whether it's compatible or not.
9 years ago
Selwin Ong
8bbd833855
Merge pull request #600 from glaslos/cancel_remove
...
Cancel and Delete differences
9 years ago
Selwin Ong
702dfd2c31
Merge pull request #611 from ahxxm/delay-task
...
depreciation fixes
9 years ago
Michael Keirnan
14723ecc1f
Merge remote-tracking branch 'upstream/master'
9 years ago
ahxxm
b06f112cb0
fix tests
...
syntax: assertEquals -> assertEqual, assertNotEquals -> assertNotEqual
usage: status of worker and job now will use get/set method instead of property method
9 years ago
Selwin Ong
91177b7317
Merge pull request #601 from glaslos/registry_cleanup_log_msg
...
log.info added when cleaning registries
9 years ago
glaslos
a424d320a8
log.info added when cleaning registries
9 years ago
Karoly Frendrich
ca069e5112
rqinfo config parameter
9 years ago
glaslos
0a6df13d9d
delete dependents and delete in cleanup. Fixed tests.
9 years ago
glaslos
d2eeb3b3db
job.cancel before delete and doc string fixes
9 years ago
glaslos
02844034d7
Merge branch 'master' into cancel_remove
9 years ago
glaslos
5a3bebf85b
only remove from queue on job.cancel
9 years ago
horida
04987a80da
mark as busy before forking horse
9 years ago
Selwin Ong
95f740299a
Merge pull request #588 from samuelcolvin/logging-extras
...
more info in 'Job OK' log entry
9 years ago
Samuel Colvin
082e61a212
add job.started_at
9 years ago
Samuel Colvin
30c29614c6
more info in 'Job OK' log entry
9 years ago
Samuel Colvin
e750134e8a
move request_(force_)stop out of _install_signal_handlers
9 years ago
Vincent Driessen
ca235aee19
This is 0.5.6
9 years ago
Selwin Ong
544f2e6fb2
Fixed result logging call .
9 years ago
Selwin Ong
2140cc4fab
Job result should be converted to text before being logged.
9 years ago
Selwin Ong
bb4336f612
Merge pull request #578 from tbaugis/master
...
log job result in DEBUG level and truncate to 2k symbols
9 years ago
Toms Bauģis
5a4f297134
do not truncate result output as that can be done in the log formatter
9 years ago
Michael Keirnan
da7d59e1a9
Merge remote-tracking branch 'upstream/master'
...
* upstream/master:
Modified patch_connection to allow Redis connection to be easily mocked.
9 years ago
Michael Keirnan
bad054989d
export worker id and job id to env of work horse
...
For tracing job execution in a distributed system it is useful to tag log
entries with the worker id and job id. The current job is accessible
via get_current_job(), but that requires an extra redis connection. And
the current worker id (the worker id of the parent process) does not appear
to be available.
Rather than introducing an `rqworker` alternative or subclassing Worker, it
feels simple and efficient to make these contextual ids available as
environment variables. This should have no performance cost and no
API compatibility issues.
Some useful things to do with these values in the worker horse process:
+ include them in log messages
+ include them as 'x-' headers in HTTP requests made by workers
9 years ago
Selwin Ong
e538512c79
Merge branch 'master' of github.com:nvie/rq
...
Conflicts:
tests/test_job.py
9 years ago
Selwin Ong
0e4112da7a
Modified patch_connection to allow Redis connection to be easily mocked.
9 years ago
Toms Bauģis
ade154575e
fix travis error - python 2.6 or whatevs wants positions spelled out for .format
9 years ago
Selwin Ong
1a089887c0
Merge pull request #564 from jlopex/javi/fix_dependent_jobs_on_different_queues
...
support multiple queues on dependent jobs
9 years ago
Toms Bauģis
682d4adb40
log result in DEBUG level and truncate to 2k symbols
9 years ago
Javier Lopez
d3d9a20680
Do not call pipeline.execute() if pipeline is given as argument
9 years ago
Selwin Ong
cf20f1d9b2
Merge pull request #576 from jlopex/ensure_custom_handlers_are_called
...
Ensure custom exception handlers call when Redis is down
9 years ago
Vincent Driessen
02c6df6a45
This is 0.5.5
9 years ago
Vincent Driessen
c1a4780d10
Fix PEP8 complaints
9 years ago
Javier Lopez
4fb59a4ceb
Ensure custom exception handlers calls when Redis is down
9 years ago
Javier Lopez
8a6bc08e47
Added pipeline named argument to enqueue_job
9 years ago
Javier Lopez
b4f157516e
enqueue_dependents now uses origin queue to enqueue
...
Current implementation is using the first job queue
to insert the dependent jobs. This makes RQ to ignore
the original queue where the jobs were enqueued.
With this change, we will use job origin attribute to
fetch the original queue, then insert the dependent
job to the fetched queue.
fixes issue #512
9 years ago
Selwin Ong
e6a15c57b3
Disable click >= 5.0's unicode_literals warnings.
9 years ago
Selwin Ong
f09be523dd
Merge pull request #573 from jcsaaddupuy/feature/dequeue_any_not_recursive
...
dequeue_any not recursive
9 years ago
Jean-Christophe SAAD-DUPUY
8fbf5452fa
fix: return (None, None) for dequeue_any if no result
10 years ago
Jean-Christophe SAAD-DUPUY
59d193590c
fix: remove recursive call to dequeue_any
10 years ago
Damnever
43616ea696
_Colorizer().notty is more clear
10 years ago
Dustin Falgout
91a3aa7493
make args and kwargs explicit for enqueue_call function
...
closes #466
10 years ago
likeon
fc4124e39c
Fixes Job.__eq__ crash when other object doesn't have id attribute
10 years ago
Selwin Ong
e6a499ada8
Merge pull request #561 from selwin/async-bug
...
Sync jobs should be cleaned up after execution.
10 years ago
Selwin Ong
edd139d86f
Sync jobs should be cleaned up after execution.
10 years ago
Selwin Ong
cdcea84105
Merge pull request #557 from selwin/exception_handling
...
Exception handling
10 years ago
Vincent Driessen
e88525a649
This is 0.5.4
10 years ago
Vincent Driessen
28a19ee717
Remove warning that's now breaking since the Raven API changed
10 years ago
Selwin Ong
3c3646cf91
Merge branch 'master' into exception_handling
...
Conflicts:
tests/fixtures.py
10 years ago
Selwin Ong
8bfbeac67d
Running rqworker without specifiying --exception-handler shouldn't override default behavior.
10 years ago
mozillazg
7198b4568a
Fixed a format error
10 years ago
Vincent Driessen
0de225ec62
Emphasize private nature of `stopped` property
10 years ago
Vincent Driessen
ec0e04727b
Rename `maintenance_date` -> `last_cleaned_at`
10 years ago
Vincent Driessen
891be55b87
Clean up Worker.__init__ logic a little
10 years ago
Vincent Driessen
4d0ae5da98
Clean up type checking of Worker constructor
10 years ago
Vincent Driessen
94258761ae
Make string formatting consistent
10 years ago
Selwin Ong
8f9c507f12
Bump version to 0.5.3.
10 years ago
Marcus Martins
513f6310d2
Change default TTL to None insted of -1
10 years ago
Marcus Martins
5b8726ad2d
Fixes #502
...
Fixes some broken tests and misbehaviour with ttls. There was a temporal
coupling between saving the job and setting its expires parameter.
10 years ago
Selwin Ong
f370f79819
Merge pull request #534 from selwin/registry-maintenance
...
Worker automatically cleans job registries every hour
10 years ago
Neal Todd
bac6699ea4
Allow non-ASCII characters in keyword arguments.
10 years ago
Selwin Ong
c3767e28e2
Worker now runs maintenance tasks every hour and on startup.
10 years ago
Selwin Ong
5782ac10c4
Added worker.clean_registries().
10 years ago
Selwin Ong
faf9d3e668
Added clean_registries(queue) function to clean job registries related to that queue.
10 years ago
RyanMTB
9a00b0eca6
Updated Worker API
10 years ago
Selwin Ong
d51f0200d7
Merge pull request #513 from trevorprater/master
...
Improving logging.
10 years ago
Selwin Ong
70d5f971bd
Jobs from FinishedJobRegistry that are moved to FailedQueue should have "failed" as status.
10 years ago
Cosmin Stefan
260f7caf66
Enable proper setup of signale handlers for SimpleWorker as well. fixes #523
...
This allows a SIGTERM to make the worker perform a warm shutdown and cleanly break out of the loop and finish the current job, if any.
10 years ago
Vincent Driessen
8f7322ed10
This is 0.5.2
10 years ago
Trevor Prater
5674edad61
Changed rqworker shutdown message.
...
- As requested by @nvie and @selwin.
10 years ago
Trevor Prater
fd1dca40b9
Improving logging.
...
- Include worker key in worker startup log statement.
- Added a notification to make it more clear when a 'burst' worker dies.
10 years ago
Selwin Ong
cff6fbff41
Merge pull request #477 from glaslos/ttl_tests_fixes
...
TTL tests and fixes
10 years ago
glaslos
071c47dacb
hard-coded TTL to -1 on job.perform()
...
Removed merge artifacts
10 years ago
Serhii Maltsev
91f263d8e0
change try/except in python2/3 compatibility to to_text()
10 years ago
Tamir Duberstein
985a2664a4
Prevent `Queue#dequeue` from blowing the stack
...
In the case of many sequential jobs having been deleted, a recursive
implementation of `Queue#dequeue` is prone to blowing the stack in the
absence of tail-recursion support. Change the implementation from
recursive to iterative to work around this issue in CPython.
10 years ago
Vincent Driessen
5cb873b438
Fix PEP8 complaint.
10 years ago
Vincent Driessen
cd155299a4
Fix PEP8 complaint.
10 years ago
Vincent Driessen
6c6e53542f
Don't require redis-py 2.10 just for the SSL option.
10 years ago
Vincent Driessen
8505198298
Bump to 0.5.1.
10 years ago
Vincent Driessen
5990fa9d73
Merge pull request #499 from vladkens/issue/498
...
ZADD bugfix
10 years ago
Eric Bustarret
9fba806662
Add REDIS_SSL option
...
Allow the worker to connect to a Redis instance through SSL (ex: Azure
Redis Cache use SSL only by default)
10 years ago
Vlad Pronsky
933e6697cd
Fixed redis drivers bug
10 years ago
glaslos
3d4d6a86d5
persist the job right before execution
10 years ago
glaslos
24d5e08992
Merge branch 'master' into ttl_tests_fixes
...
Conflicts:
tests/test_job.py
10 years ago
Selwin Ong
30b21ef06e
Merge pull request #465 from marklap/workerbirthdeath
...
add birth_date and death_date properties to Worker
10 years ago
Mark LaPerriere
636a537fa7
updates addressing @selwin comments for PR #465
10 years ago
Taras Semenenko
3dfd044767
Add missed `multi` command after `watch`
...
`watch` command should be used in conjunction with `multi` command
which was missed in enqueuing of job with dependencies.
Fix #487
10 years ago
Bradley Young
04e403e1a3
dread comma, I adjure thee.
10 years ago
Bradley Young
d56b5424c8
merging master and fixing conflicts
10 years ago
Bradley Young
c428f955e4
per @selwin, adding a deprecated handler for exc_handler
10 years ago
alternativshik
219f21b637
Allow non-ASCII characters in arguments
...
get_call_string() failed if any arguments contained non-ASCII strings.
Fixes #406
10 years ago
Selwin Ong
1005222371
Restored the ability to specify connection params in config
10 years ago
glaslos
c155918d6d
lrem only first occurrence of the job id (we expect only one)
10 years ago
Mark LaPerriere
a4ca4704ac
convert redis returned bytes into text/string
10 years ago
Mark LaPerriere
cfe3da287a
updated branch to latest
10 years ago
Vincent Driessen
b8d425b318
Various PEP8 fixes.
10 years ago
Vincent Driessen
fac2b10309
Auto-sort imports using isort.
10 years ago
Vincent Driessen
e8c3b96a5a
Bump to 0.5.0.
10 years ago
glaslos
703ab0e355
removed merged comment
10 years ago