14 Commits

Author	SHA1	Message	Date
Claudio Atzori	1abe6d1ad7	WIP: collectorWorker error reporting, added report messages	2021-02-15 15:08:59 +01:00
Claudio Atzori	29c6f7e255	classes related to the collection workflow moved into common package; implemented MongoDB collection plugins	2021-02-12 12:31:02 +01:00
Claudio Atzori	bae029f828	collection_java_xmx allows to declare the heap size allocated for the java actions involved in the metadata collectionw workflow	2021-02-08 18:07:23 +01:00
Claudio Atzori	50add4c61b	added requestDelay to HttpConnector2 configuration; Aggregation workflow constants moved in dhp-common	2021-02-08 12:19:38 +01:00
Claudio Atzori	a8a758925e	better logging, WIP: collectorWorker error reporting	2021-02-05 19:18:05 +01:00
Sandro La Bruzzo	4dae5e605d	implemented messaging btween collection worker and Dnet	2021-02-04 15:51:15 +01:00
Claudio Atzori	e04045089f	better logging, WIP: collectorWorker error reporting	2021-02-03 17:58:22 +01:00
Claudio Atzori	53884d12c2	code formatting	2021-02-02 14:38:03 +01:00
Sandro La Bruzzo	6ff234d81b	Implemented a first prototype of incremental harvesting and trasformation using readlock	2021-02-01 13:56:05 +01:00
Sandro La Bruzzo	e423634cb6	RollBack in case of error WORKS!!!	2021-01-29 17:21:42 +01:00
Sandro La Bruzzo	0276180039	WIP mdstore ... transaction implemented on hadoop side	2021-01-29 16:42:41 +01:00
Sandro La Bruzzo	98b9498b57	Removed old messaging system not quite used from collection and Transformation workflow ... code refactor	2021-01-28 09:51:17 +01:00
Sandro La Bruzzo	5a8a323f2a	dhp-collection-worker integrated in dhp-workflows	2019-10-24 11:36:59 +02:00
Claudio Atzori	c7654b6fe3	renamed collection & transformation oozie workflow files	2019-10-18 09:42:20 +02:00