Commit Graph
82 Commits
Author SHA1 Message Date
Hardirc 3e19e3d0db Improve PEP8 gluon/scheduler.py 2015-03-06 22:22:00 -05:00
Leonel Câmara a9f834c2e8 Fix - Scheduler - Convert task args back to utf-8
See this thread for more details:
https://groups.google.com/forum/#!topic/web2py-developers/0OPEm9WELoM
2015-02-24 23:13:01 +00:00
gi0baro 4b337c3e2c Merge branch 'master' into pydal-pip
Conflicts:
	gluon/__init__.py
	gluon/dal/_load.py
	gluon/dal/adapters/base.py
	gluon/dal/adapters/google.py
	gluon/dal/adapters/postgres.py
	gluon/dal/adapters/teradata.py
	gluon/dal/base.py
	gluon/dal/objects.py
	gluon/tests/__init__.py
	gluon/tests/test_dal_nosql.py
2015-01-17 13:32:06 +01:00
niphlod 9132343820 better assignment (tasks go to not running workers only). Thanks @PengfeiYu
- pep8 adjustments
- tasks were assigned to all ACTIVE workers... if a worker is busy processing a task, 
  there's no point on assigning tasks to it
2014-12-18 23:48:10 +01:00
gi0baro f60c1dff93 Fixing imports for new pydal 2014-12-15 22:24:04 +01:00
gi0baro dcadcf0ffb Added pyDAL from repository, adapted web2py code 2014-12-15 20:13:40 +01:00
niphlod dafe900629 timeout = 0 leads to erratic behaviour. Allowing timeout = 0 is considered unsafe 2014-11-25 21:17:53 +01:00
niphlod c071bc964b update dependencies only if COMPLETED, allow to set status on a specific worker 2014-10-30 21:54:36 +01:00
Henry Nguyen 7aa51fcbb0 Fixed missing update for new DAL structure
Other values were updated in 5e5e649c28 but this was missing from that commit.
2014-10-24 12:18:17 -07:00
gi0baro 5c07c511fa Merge branch 'master' into DAL-modular
* master: (58 commits)
  changed version number
  better types by default, given that we're on 2005 at least
  fix for StorageList and tests added
  improved coverage, fix bug with IS_LIST_OF and items not being strings
  fix cache.increment, added tests
  R-2.9.11
  reverted simplejson
  R-2.9.10
  upgraded memcache and markdown2
  upgraded pypyodbc.py
  upgraded simplejson
  no more split in contains, thanks Niphlod
  fixed wording and bug on contains(), made smart_query use ilike instead of like
  ilike, thanks Niphlod
  CROSS JOIN, thanks jotbe
  added custom represent to GoogleDatastoreAdapter, thanks Alan
  postgresql: identifies what adapter auto-loads json values
  added more tests for json Field
  fixed typo in driver_auto_json
  Improve the graphing to show the name of the application.
  ...

Conflicts:
	gluon/dal.py
	gluon/globals.py
	gluon/tests/test_dal.py
2014-09-25 12:49:16 +02:00
niphlod 1456c0da1e references can be long too 2014-09-03 21:23:24 +02:00
niphlod fa5100cb2a avoid multiple cascade paths 2014-09-03 21:09:09 +02:00
gi0baro 5e5e649c28 Added modular DAL, updated gluon imports to new structure 2014-09-03 12:48:03 +02:00
niphlod 7e73faf619 doc fixes 2014-08-21 22:49:26 +02:00
Leonel Câmara 0f55d43a11 Removed unecessary dict call in get_workers 2014-08-05 15:37:10 +01:00
niphlod cb6f2ca302 task dependencies, a little bit of refactoring 2014-08-04 21:42:11 +02:00
mdipierro 21bdf114b4 Merge pull request #462 from niphlod/fix/scheduler_disabled
a DISABLED worker shouldn't resume after completing a task
2014-06-15 22:20:17 -05:00
niphlod d2c9f510bc if a worker is DISABLED while processing a task, it shouldn't resume after finishing it 2014-06-15 17:40:08 +02:00
niphlod 84cf736b63 removed leftover print 2014-06-15 15:15:33 +02:00
niphlod da49391134 - refactored internals
- pep8
- worker stats
- kill(), terminate(), resume(), disable() have a new "limit" parameter
- first steps towards autoscaling
- needs an additional column (easiest migration possible)
2014-06-08 22:51:26 +02:00
niphlod 3597833bac sphinx-compatible docstrings (7 modules remaining...) 2014-03-23 21:46:25 +01:00
niphlod 9434baba11 added the prevent_drift parameter 2014-01-20 22:43:53 +01:00
Jeremie Dokime 3f200c245c Fix concurrency handling in order to avoid that some workers get the same task at the same time. 2014-01-13 15:17:58 +01:00
niphlod d30098d646 inject W2P_TASK in current, so you can use current.W2P_TASK in imported modules. Thanks @Xiaonuo for the feature request 2013-10-23 00:03:04 +02:00
niphlod cbddfb5cdf fix issue with scheduler namespace. Thanks @limedrop for spotting this. 2013-08-24 14:05:08 +02:00
niphlod ae567462d3 fixed issue 1611 (scheduler's migrate should follow Auth's migrate behaviour) 2013-08-04 20:56:52 +02:00
niphlod 6cb91ab60d fix issue with sys.path. Now the path looks like 'root/gluon', 'root/site-packages', 'root' like in a normal web request 2013-08-03 02:46:59 +02:00
niphlod 8666d3520e fixed issue 1567 with scheduler and Mysql 2013-06-29 22:49:05 +02:00
Massimo 6eea834777 fixed bug in scheduler context switch, thanks Niphlod 2013-04-05 16:01:13 -05:00
mdipierro 38fff6fb91 better reporting in scheduler, thanks Niphlod 2013-04-03 16:42:27 -05:00
Massimo ba0a143717 scheduler patch allows termination of tasks, thanks niphlod 2013-03-12 10:40:57 -05:00
Massimo 9c970632c5 scheduler patch, thanks Niphlod 2013-02-21 10:16:30 -06:00
Massimo c121589499 fixed bug in latest commit, thanks Niphlod 2013-02-14 14:41:52 -06:00
Massimo 50193471d6 better IS_NOT_IN_DB, new scheduler API, after_connection dal callback, thanks Niphlod 2013-02-14 14:15:27 -06:00
Massimo 92cef0b811 scheduler patch, thanks Niphlod 2013-01-15 15:54:29 -06:00
mdipierro 41f5dfaffc gluon/scheduler.py 2013-01-14 15:26:46 -06:00
mdipierro ee2c4f339a fixed possible scheduler problem, thanks Mike Dickun and Niphlod 2012-12-23 15:07:43 -06:00
mdipierro af85a2cf25 changed of scheduler column names, this breaks scheduler backard compatibility 2012-12-19 11:24:55 -06:00
mdipierro 54dabd979b fixed 2.5 issues with scheduler 2012-11-13 16:27:26 -06:00
mdipierro ad2b332fa0 improved scheduler, thanks Niphlod 2012-11-05 12:39:17 -06:00
mdipierro 755a860011 many scheduler improvements, thanks Niphlod 2012-11-01 21:35:53 -05:00
mdipierro 8fe14215e1 fixed scheduler bug, thanks Niphlod 2012-10-26 15:49:47 -05:00
mdipierro cdaf4f651b assign_task takes better care for group_names, thanks Niphlod 2012-10-21 09:23:26 -05:00
mdipierro 5aa27fc562 assign_task takes better care for group_names, thanks Niphlod 2012-10-20 15:27:13 -05:00
mdipierro 3f4330d9b1 removed print statements from scheduler, thanks Niphlod 2012-10-20 10:03:57 -05:00
mdipierro 6aa5edc7ff many pep8 improvements 2012-10-19 12:33:53 -05:00
mdipierro 71ec15190b some pep8 changes (fixed spacing at end) 2012-10-19 10:37:07 -05:00
mdipierro 3a66f5e330 fixed some pep8 stuff 2012-10-19 09:40:17 -05:00
mdipierro ea9ae52e10 scheduler.queue_task, thank Niphlod 2012-10-18 18:20:51 -05:00
mdipierro 8d5c82c531 scheduler.queue_task(...), thanks Niphlod 2012-10-18 13:02:19 -05:00