util
/
rq
mirror of https://github.com/peter4431/rq.git
4
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,548 Commits
2 Branches
0 Tags
3.3 MiB
main
master
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '11c8631921'
${ noResults }
Commit Graph

1548 Commits (11c8631921cd9738b94c17937315ec9dba0041b7)
 

Author SHA1 Message Date
Adda Satya Ram 11c8631921
Add exception to catch redis connection failure to retry after wait time (#1387) 
* add exception catch for redis connection failure

* Add test for connection recovery

* add exponential backoff

* limit worker max connection wait time to 60 seconds

* fix undefined class variable

* fix string formatting issue while printing error log

* cap max connection wait time:better code style

Co-authored-by: corynezin <cory.nezin@gmail.com>
 4 years ago
AxeOfMen 709043989a
clean_worker_registry cleans in batches to prevent submitting too muc… (#1390) 
* clean_worker_registry cleans in batches to prevent submitting too much data to redis at once when there are a large number of invalid keys

* Address code review comments

Rename MAX_REMOVABLE_KEYS to MAX_KEYS

* Fix tests

Co-authored-by: Joel Harris <combolations@gmail.com>
 4 years ago
Selwin Ong d3b07fba47 Bump version to 1.7.0 4 years ago
Selwin Ong ab19ad9798 Improve docs 4 years ago
JackBoreczky 016da14723
Fix custom serializer in job fetches (#1381) 
* Ensure that the custom serializer defined is passed into the job fetch calls

* add serializer as argument to fetch_many and dequeue_any methods

* add worker test for custom serializer

* move json serializer to serializers.py
 4 years ago
C. Mangla 8b9e2188e4
Add `job.refresh()` to docs (#1384) 4 years ago
Selwin Ong 81ea1d26d1
Add link to Github Actions badge in README 4 years ago
BobReid 75a610bd4d
Fix RQScheduler when run with SSL connection (#1383) 
* Quick and dirty set up of SSL

* copy connection kwargs in scheduler

* fix

* chmod the cert

* Skip SSL tests in CI
 4 years ago
Kyle Verhoog 3aaa1c1209
fix snippet link in docs (#1380) 
The former link is broken since http://flask.pocoo.org/snippets has been
taken down. See https://github.com/pallets/website/issues/41 for more
info.
 4 years ago
Arturo Bracero 2ece5d0fba
fixed typo in send_kill_horse_command() example (#1378) 4 years ago
Selwin Ong 492e77d86d
send_stop_job_command (#1376) 
* Added send_stop_job_command().

* send_stop_job_command now accepts just connection and job_id

* Document send_job_job_command

* Updated test coverage
 4 years ago
Selwin Ong f3e924cdd1
Added job.worker_name (#1375) 
* Added job.worker_name

* Fix compatibility with Redis server 3.x

* Document job.worker_name

* Removed some Python 2 compatibility stuff.

* Remove unused codes
 4 years ago
Selwin Ong 3ead30a34e Bump version to 1.6.1 4 years ago
Selwin Ong 6fab48845f Merge branch 'master' of github.com:rq/rq 4 years ago
Selwin Ong b3703b5357 Bump to version 1.6.0 4 years ago
Selwin Ong d1528d776d
Release scheduler lock when running in burst mode (#1374) 
* Fixed an issue where scheduler lock is not release when running worker in burst mode

* Remove unused import
 4 years ago
Selwin Ong b50f1e2121
Redis does not accept `parser_class` argument (#1373) 4 years ago
Chris de Graaf 5988889e57
Propagate logging settings from worker to scheduler (#1366) 4 years ago
Ruslan Mullakhmetov 676ec9b0ea
tests: updated github worklow for tests to use requirements.txt and d… (#1364) 
* tests: updated github worklow for tests to use requirements.txt and dev-requirements.txt

* build: updated dev-requirements.txt

Co-authored-by: Ruslan Mullakhmetov <ruslan@twentythree.net>
 4 years ago
Ruslan Mullakhmetov ed264f08bb
feat: added job heartbeat to track whether job is actually executing (#1349) 
* feat: added job heartbeat to track whether job is actually executing

heartbeat might be needed in cases when worker was hardkilled or the whole VM/docker was forcibly rebooted.

* fixed tests

* fixed test coverage issue

* chore: renamed job.heartbeat stuff according to review feedback

* chore: pipelined worker heartbeat and job heartbeat

* docs: documented job.heartbeat property

* fixes after review

* docs: updated last_heartbeat description

* chore: review

Co-authored-by: Ruslan Mullakhmetov <ruslan@twentythree.net>
 4 years ago
Selwin Ong a721db34b1
Workers can listen to external commands via pubsub (#1363) 
* Added a way to send shutdown command via pubsub

* Added kill-horse command

* Added kill horse command

* Added send_kill_horse_command() and send_shutdown_command()

* Document worker commands
 4 years ago
Ruslan Mullakhmetov 0e65bab10b
tests: added ability to run tests in Docker (#1361) 
* tests: added ability to run tests in Docker

useful to run full test suit on Mac

* tests: minor improvement in dockerfile for tests

* tests: typo in Dockerfile

* tests: updated dev requirements

Co-authored-by: Ruslan Mullakhmetov <ruslan@twentythree.net>
 4 years ago
Selwin Ong f5ce159b60 Remove alpha warning from scheduler docs 4 years ago
Selwin Ong df14acaf02
Increase scheduler lock TTL to 60 (#1362) 4 years ago
Nikita Romaniuk 2da957a68d
scheduler: now operates with chunks of jobs (#1355) 
* scheduler: now operates with chunks of jobs

* scheduler: set default chunk_size for ScheduledJobRegistry.get_jobs_to_schedule

* scheduler: fixed missing indent

* scheduler: added test for get_jobs_to_schedule() with chunk_size parameter

* scheduler: fixed test for passing python 3.5 (no f-strings)

* scheduler: fixed chunk_size in test make it lighter to run
 4 years ago
Ruslan Mullakhmetov 9adcd7e50c
feat: avoided "zombie" processes after killing work horse (#1348) 
* feat: avoided "zombie" processes after killing work horse by setting work horse process group and killing this group

* fixed tests

* tests: added test to check that all workhorse subprocesses are killed

* tests: updated guthub run tests dependencies since they are not using (dev-)requirements.txt

Co-authored-by: Ruslan Mullakhmetov <ruslan@twentythree.net>
 4 years ago
Orkhan 55dce19a95
Fix #1340 (#1341) 
* docker folder along with Dockerfile has been added

* fix #1340

Co-authored-by: orkhan.mamedov <orkhan.mamedov@sravni.ru>
 4 years ago
Qiming Sun 4e4afefd18
Add entry ssl_ca_certs in worker config settings (#1347) 4 years ago
Vladimir Ulupov 237e69123a
pass retry param to enqueue_at func (#1343) 4 years ago
Selwin Ong a31d37f1ea Exclude tests directory from wheel builds 4 years ago
Selwin Ong e6f153ee86 Bump version to 1.5.2 4 years ago
Selwin Ong 01d71c8984
Fixes an issue where retried jobs should not be put in FailedJobRegistry (#1336) 4 years ago
Evgeni Golov 99f7dc8722
include requirements.txt in sdist (#1335) 
Fixes: #1328
 4 years ago
Ahmed Elmaghallawy 0779605173
fix deprecated Iterable import (#1329) 4 years ago
maces 48f5a68013
fixed minor import error in jobs docs (#1334) 4 years ago
Sergei Zherevchuk 56e756f512
fix(scheduler): correctly restore ssl connection after forking (#1327) 
* fix(scheduler): restore ssl connection after forking

* fix(scheduler): custom redis client support
 4 years ago
Selwin Ong 08379fc571
Codecov (#1326) 
* Try codecov

* Modify codecov steps

* Strip out unused actions variables

* Remove coverage.yml

* Renamed test.yml to workflow.yml

* Minor styling fix
 4 years ago
Selwin Ong a09a2ab3b4 Merge branch 'master' of github.com:rq/rq 4 years ago
Selwin Ong 20248cf268 Bump version to 1.5.1 4 years ago
Selwin Ong 6028a63607
Restores compatibility with fakeredis (#1324) 4 years ago
Selwin Ong f0afcd3cb3
Create coverage.yml 4 years ago
Selwin Ong 39fb709c10
get_redis_server_version() should handle 4 digit version numbers (#1322) 4 years ago
nerok 7bf100ebe7
Allow retries to be set through decorator (#1319) 
Co-authored-by: Didrik Koren <didrik.koren@uninett.no>
 4 years ago
Ruslan Mullakhmetov c2931b45b6
handled unhandled exceptions in horse (#1303) 
* handled unhandled exceptions in horse to prevent a job from being silently dropped without going into FailedRegistry

* changes after review

* made sure that work_horse always terminates in a proper way with tests

* minor refactoring

* fix for failing test

* fixes for the other tests

- removed exception handling (done in monitor_work_horse)
- adjusted some tests for the checks that are not relevant anymore

* review suggested changes

* cleanup

Co-authored-by: Ruslan Mullakhmetov <ruslan@twentythree.net>
 4 years ago
Selwin Ong 57f286eac4 Minor doc fix 4 years ago
Selwin Ong 265e4b76ab
log messages < error is now output to stdout instead of stderr (#1312) 4 years ago
Aaron Tainter 5cee02d83f
Use correct logger name for scheduler and lower level for heartbeat logs (#1311) 4 years ago
Selwin Ong 167ab96070 Slightly tweaked docs CSS 4 years ago
Selwin Ong dff7a09a1d Fixed Github Pages build 4 years ago
Selwin Ong f3c86c02c6 Bump version to 1.5.0 4 years ago