76 Commits

Author SHA1 Message Date
868c808db7 missing indices need to return an array 2016-05-13 14:56:50 -07:00
c51ea64bdd [worker] swollow missing index errors 2016-05-13 14:35:39 -07:00
df9508808b use jobtype in worker, update query
also simplify the query a bit and use constant_score
2016-05-12 14:08:43 -07:00
609e81fdef distiguish the doctype from the jobtype
update tests and mock elasticsearch client
2016-05-12 12:20:49 -07:00
3375335d24 add type field, switch to string types
should allow elasticsearch 2.x use
2016-05-12 11:49:54 -07:00
0020050f3f use contants for defaults, use a common doctype
add tests, update readme
2016-05-12 11:48:54 -07:00
a4323433f2 remove use of var 2016-05-11 10:58:21 -07:00
38532a6296 fix scoping issue, add debugging on worker register 2016-05-10 17:28:27 -07:00
aa5ea72e3b swollow errors saving job output, include error in debugging output 2016-05-10 17:24:05 -07:00
e077442340 add debugging on job timeout 2016-05-10 16:57:40 -07:00
82506a74e8 set process_expiration by default
without this, the job query fails with field='process_expiration' is unrecognized
2016-05-10 16:01:24 -07:00
f5bf40cf71 prefix all the debugger namespaces 2016-05-05 11:41:57 -07:00
4318bd672f slim down the lodash dependencies 2016-05-04 13:28:07 -07:00
902f1aeb60 remove bluebird dependency 2016-05-04 12:44:16 -07:00
ecfd0e1d4a use reduce to serialize claimJob attempts 2016-05-04 12:43:10 -07:00
1357810191 ease up on the debugging output 2016-05-04 12:41:37 -07:00
6ce08acd26 worker functions use promises for async 2016-05-04 11:41:49 -07:00
5efccc4435 rename project to esqueue 2016-05-03 16:30:54 -07:00
133564fd9b slightly less debugging when adding jobs 2016-05-03 12:01:32 -07:00
f725824c5f emit job fail events, don't throw 2016-05-03 11:35:09 -07:00
14ea4617e2 change the default content body 2016-05-03 09:58:08 -07:00
696cf78464 handle worker timeouts 2016-05-02 17:51:06 -07:00
7dadeeb111 refactoring failures 2016-05-02 14:42:27 -07:00
60d486b804 add check for failed status and complete time 2016-05-02 14:31:14 -07:00
a143092e64 add completed time and status to failed jobs
with tests
2016-05-02 12:59:23 -07:00
b12aa87ad3 add completed_at time, add update tests 2016-05-02 12:57:11 -07:00
f0b0e10b84 remove debugging output 2016-05-02 12:45:32 -07:00
3b8127874b only send attempt message if no output
always append failure message if one exists
2016-04-29 17:15:29 -07:00
d4d38255f6 switch job running to callback style 2016-04-29 16:44:30 -07:00
21830c9eb0 add job add debugging 2016-04-29 16:44:18 -07:00
54d3be6929 don't clobber error output, append worker output 2016-04-28 17:21:03 -07:00
d3094375dd stop and start job polling when trying to claim jobs
also return claiming and execution Promise
2016-04-28 16:25:45 -07:00
379a8f096c simplify failed job update error handler 2016-04-28 16:24:28 -07:00
03eca43bbf move job polling into another method, add stop method 2016-04-28 16:15:09 -07:00
c32d806886 make the size limit configurable 2016-04-28 15:14:44 -07:00
019d9f98a2 query for, claim and process jobs
process step is still a WIP
2016-04-28 15:13:19 -07:00
2c9746654d create debugging output wrapper 2016-04-28 15:12:57 -07:00
6ea711da87 amend the schema - single output object, add cerated_by 2016-04-26 17:40:57 -07:00
9e501ace93 add cancelled status 2016-04-26 17:40:26 -07:00
0f3b21f1e8 add worker query for outstanding jobs 2016-04-26 17:40:14 -07:00
f1dc6e60dc make workers private, add getter, add destroy test 2016-04-25 17:00:37 -07:00
eb033d9676 queue should track and tear down workers, with tests 2016-04-25 16:36:21 -07:00
5c4340adfc start on the worker logic 2016-04-25 16:28:30 -07:00
7f554014a0 tweak the schema, status is a keyword 2016-04-25 16:27:07 -07:00
6ff2f2cb99 rename add to addJob 2016-04-25 15:30:17 -07:00
662d8a177c assign job ids internally, update tests
useful for making toJSON fully sync and work without the elasticsearch document
2016-04-25 15:28:12 -07:00
58a0cf328f update toJSON, add tests, remove unused var 2016-04-25 15:16:00 -07:00
c819171393 add get and toJSON methods to jobs 2016-04-25 14:31:35 -07:00
a46d8621cc make constants more explicitly accessible 2016-04-25 14:21:28 -07:00
c79da26f2d fix bug on new job - return the promise 2016-04-25 13:43:48 -07:00