 Michele Artini
|
c4fce785ab
|
fixed a compilation problem of a unit test
|
2021-10-19 16:18:26 +02:00 |
 Claudio Atzori
|
172363e7f1
|
[broker] integrating PR#147, notification record creation phase separated from indexing on ES
|
2021-10-19 15:56:27 +02:00 |
|
Claudio Atzori
|
bdffa86c2f
|
undo last commit
|
2021-10-19 15:39:38 +02:00 |
|
Michele Artini
|
d6e1f22408
|
max numbers of workers for indexing
|
2021-10-05 15:09:18 +02:00 |
|
Michele Artini
|
210d6c0e6d
|
generateNotificationsJob and indexNotificationsJob
|
2021-10-05 13:57:46 +02:00 |
|
Michele Artini
|
69008e20c2
|
log and tests
|
2021-10-05 11:58:20 +02:00 |
|
Michele Artini
|
8bbaa17335
|
reimplemented of conditions cache as a non static variable
|
2021-10-05 09:20:37 +02:00 |
|
Michele Artini
|
31a6ad1d79
|
optimization of verifySubsriptions()
|
2021-10-04 12:01:56 +02:00 |
|
Claudio Atzori
|
b01cd521b0
|
removed configuration specifying the limit to 8 for spark.dynamicAllocation.maxExecutors
|
2021-10-01 11:26:33 +02:00 |
|
Claudio Atzori
|
ec94cc9b93
|
IndexNotificationsJob test: persist contents on HDFS instead of passing them to ES
|
2021-10-01 09:41:27 +02:00 |
|
Claudio Atzori
|
2ee21da43b
|
suggestions from SonarLint
|
2021-08-11 12:13:22 +02:00 |
|
Claudio Atzori
|
908f57a475
|
code formatting
|
2021-07-29 10:49:39 +02:00 |
|
Claudio Atzori
|
4c5a71ba2f
|
[broker] updated relation descriptors, making use of constant values
|
2021-07-28 17:11:18 +02:00 |
|
Claudio Atzori
|
ae2b47b29d
|
[broker] added coalesce(1) on the stats dataset before storing it on postgres
|
2021-07-09 15:47:51 +02:00 |
|
Claudio Atzori
|
5e4b91d9ef
|
more pervasive use of constants from ModelConstants, especially for ORCID
|
2021-05-26 18:20:23 +02:00 |
|
Claudio Atzori
|
23b8883ab1
|
applied intellij code cleanup
|
2021-05-14 10:58:12 +02:00 |
|
Claudio Atzori
|
7941d7be29
|
WIP: using common definitions from ModelConstants
|
2021-03-31 18:33:57 +02:00 |
|
Michele Artini
|
83d815d0bc
|
only stats
|
2021-02-11 10:57:23 +01:00 |
|
Michele Artini
|
8c1600398a
|
added resumeFrom parameter
|
2021-02-11 10:54:16 +01:00 |
|
Michele Artini
|
7249cceb53
|
switch of 2 nodes
|
2021-02-11 09:27:08 +01:00 |
|
Michele Artini
|
cfbcdc95bc
|
fixed a wf param
|
2021-01-14 14:45:23 +01:00 |
|
Michele Artini
|
69ba3203c0
|
fixed a conflict
|
2021-01-14 14:43:25 +01:00 |
|
Michele Artini
|
b230d44411
|
fixed conflict
|
2021-01-14 14:32:31 +01:00 |
|
Michele Artini
|
b9d90e95b8
|
Added eventId to ShortEventMessage
|
2021-01-14 14:32:31 +01:00 |
|
Michele Artini
|
64b0b0bfb3
|
fixed a bug with invalid subject topic
|
2021-01-14 14:32:31 +01:00 |
|
Michele Artini
|
e3e0ab1de1
|
fixed a problem with join
|
2021-01-14 14:32:31 +01:00 |
|
Michele Artini
|
26a941315a
|
openaireId
|
2021-01-14 14:32:31 +01:00 |
|
Michele Artini
|
6f4d1a37f0
|
ES wf properties
|
2021-01-14 14:32:31 +01:00 |
|
Michele Artini
|
1391341d06
|
mkdir of output dir
|
2021-01-14 14:32:31 +01:00 |
|
Michele Artini
|
3c9cbd19f3
|
whitelist of topics
|
2021-01-14 14:32:31 +01:00 |
|
Michele Artini
|
467aa77279
|
workingDir and outputDir
|
2021-01-14 14:32:31 +01:00 |
|
Michele Artini
|
10f3f7eca7
|
workingDir and outputDir
|
2021-01-14 14:32:31 +01:00 |
|
Michele Artini
|
ff41a7b3a4
|
gzipped output
|
2021-01-14 14:32:31 +01:00 |
|
Claudio Atzori
|
80cf55ef2e
|
[Broker] fixed partitionEventsByOpendoarIds workflow parameter names
|
2021-01-13 16:24:30 +01:00 |
|
Michele Artini
|
f9dc1e45fd
|
fixed a bug with invalid subject topic
|
2020-12-15 14:54:11 +01:00 |
|
Michele Artini
|
12fa5d122a
|
fixed a problem with join
|
2020-12-15 08:30:26 +01:00 |
|
Michele Artini
|
3e19cf7b4a
|
openaireId
|
2020-12-14 15:24:33 +01:00 |
|
Michele Artini
|
a203aee32a
|
ES wf properties
|
2020-12-14 12:02:33 +01:00 |
|
Michele Artini
|
d03756c962
|
mkdir of output dir
|
2020-12-14 11:11:41 +01:00 |
|
Michele Artini
|
399548f221
|
whitelist of topics
|
2020-12-14 11:03:55 +01:00 |
|
Michele Artini
|
933b4c1ada
|
workingDir and outputDir
|
2020-12-10 14:47:51 +01:00 |
|
Michele Artini
|
2e7df07328
|
workingDir and outputDir
|
2020-12-10 14:47:22 +01:00 |
|
Michele Artini
|
94bfed1c84
|
gzipped output
|
2020-12-10 11:59:28 +01:00 |
|
Claudio Atzori
|
fba11eef2a
|
cleanup
|
2020-12-07 21:53:13 +01:00 |
|
Michele Artini
|
5de8a7276f
|
wf to partition opendoar events
|
2020-12-07 14:56:06 +01:00 |
|
Michele Artini
|
293da47ad9
|
Merge branch 'master' of code-repo.d4science.org:D-Net/dnet-hadoop
|
2020-11-19 10:42:31 +01:00 |
|
Michele Artini
|
ab08d12c46
|
considering abstract > MIN_LENGTH in ENRICH_MISSING_ABSTRACT
|
2020-11-19 10:42:10 +01:00 |
|
Claudio Atzori
|
e503271abe
|
fixed notification workflow name
|
2020-11-19 10:41:38 +01:00 |
|
Michele Artini
|
c96598aaa4
|
opendoar partition
|
2020-09-25 09:02:58 +02:00 |
|
Michele Artini
|
9e681609fd
|
stats to sql file
|
2020-09-17 15:51:22 +02:00 |