Commit Graph

83 Commits

Author SHA1 Message Date
a1a7b9e213 add tests for passing client on job create
also fix issue where the wrong client was being used to create the index
2016-06-06 14:48:01 -07:00
dcecd4020b allow new client instant to be passed on job creation 2016-06-06 14:47:04 -07:00
ca0da61a69 default created_by to false 2016-05-19 14:11:52 -07:00
89c08068dd use filter instead of must in query
faster, and the score does not matter here
2016-05-17 13:37:22 -07:00
8d21dc6967 add optional created_by record to the doc 2016-05-16 15:02:34 -07:00
49b982db99 change priority field to byte 2016-05-16 14:09:42 -07:00
9aa8eed297 filter output when searching for jobs 2016-05-16 14:09:24 -07:00
868c808db7 missing indices need to return an array 2016-05-13 14:56:50 -07:00
c51ea64bdd [worker] swollow missing index errors 2016-05-13 14:35:39 -07:00
df9508808b use jobtype in worker, update query
also simplify the query a bit and use constant_score
2016-05-12 14:08:43 -07:00
609e81fdef distiguish the doctype from the jobtype
update tests and mock elasticsearch client
2016-05-12 12:20:49 -07:00
3375335d24 add type field, switch to string types
should allow elasticsearch 2.x use
2016-05-12 11:49:54 -07:00
0020050f3f use contants for defaults, use a common doctype
add tests, update readme
2016-05-12 11:48:54 -07:00
a4323433f2 remove use of var 2016-05-11 10:58:21 -07:00
38532a6296 fix scoping issue, add debugging on worker register 2016-05-10 17:28:27 -07:00
aa5ea72e3b swollow errors saving job output, include error in debugging output 2016-05-10 17:24:05 -07:00
e077442340 add debugging on job timeout 2016-05-10 16:57:40 -07:00
82506a74e8 set process_expiration by default
without this, the job query fails with field='process_expiration' is unrecognized
2016-05-10 16:01:24 -07:00
f5bf40cf71 prefix all the debugger namespaces 2016-05-05 11:41:57 -07:00
4318bd672f slim down the lodash dependencies 2016-05-04 13:28:07 -07:00
902f1aeb60 remove bluebird dependency 2016-05-04 12:44:16 -07:00
ecfd0e1d4a use reduce to serialize claimJob attempts 2016-05-04 12:43:10 -07:00
1357810191 ease up on the debugging output 2016-05-04 12:41:37 -07:00
6ce08acd26 worker functions use promises for async 2016-05-04 11:41:49 -07:00
5efccc4435 rename project to esqueue 2016-05-03 16:30:54 -07:00
133564fd9b slightly less debugging when adding jobs 2016-05-03 12:01:32 -07:00
f725824c5f emit job fail events, don't throw 2016-05-03 11:35:09 -07:00
14ea4617e2 change the default content body 2016-05-03 09:58:08 -07:00
696cf78464 handle worker timeouts 2016-05-02 17:51:06 -07:00
7dadeeb111 refactoring failures 2016-05-02 14:42:27 -07:00
60d486b804 add check for failed status and complete time 2016-05-02 14:31:14 -07:00
a143092e64 add completed time and status to failed jobs
with tests
2016-05-02 12:59:23 -07:00
b12aa87ad3 add completed_at time, add update tests 2016-05-02 12:57:11 -07:00
f0b0e10b84 remove debugging output 2016-05-02 12:45:32 -07:00
3b8127874b only send attempt message if no output
always append failure message if one exists
2016-04-29 17:15:29 -07:00
d4d38255f6 switch job running to callback style 2016-04-29 16:44:30 -07:00
21830c9eb0 add job add debugging 2016-04-29 16:44:18 -07:00
54d3be6929 don't clobber error output, append worker output 2016-04-28 17:21:03 -07:00
d3094375dd stop and start job polling when trying to claim jobs
also return claiming and execution Promise
2016-04-28 16:25:45 -07:00
379a8f096c simplify failed job update error handler 2016-04-28 16:24:28 -07:00
03eca43bbf move job polling into another method, add stop method 2016-04-28 16:15:09 -07:00
c32d806886 make the size limit configurable 2016-04-28 15:14:44 -07:00
019d9f98a2 query for, claim and process jobs
process step is still a WIP
2016-04-28 15:13:19 -07:00
2c9746654d create debugging output wrapper 2016-04-28 15:12:57 -07:00
6ea711da87 amend the schema - single output object, add cerated_by 2016-04-26 17:40:57 -07:00
9e501ace93 add cancelled status 2016-04-26 17:40:26 -07:00
0f3b21f1e8 add worker query for outstanding jobs 2016-04-26 17:40:14 -07:00
f1dc6e60dc make workers private, add getter, add destroy test 2016-04-25 17:00:37 -07:00
eb033d9676 queue should track and tear down workers, with tests 2016-04-25 16:36:21 -07:00
5c4340adfc start on the worker logic 2016-04-25 16:28:30 -07:00