[ENRICHMENT][BETA] Use of community API in enrichment process AND addition to tagging result for communities through projects #359

Merged
claudio.atzori merged 22 commits from propagationapi into beta 2023-11-30 14:20:34 +01:00

In this PR the use of the IS is replaced by the community APIs in the bulktagging and resulttocommunityfromorganization modules. The code is also refactored.

There is also the addition of a new module resulttocommunityfromproject that associated the result to the community if the result is linked to a project relevant for the community. This will replace the IIS document_referencedProjects in the graph processing. We need to add a new step to the workflow (it could be added at any point in the enrichment pipeline) The parameters are:

sourcePath = the source path
outputPath = the output path
production = true/false If true it will query the communityapis for production, if false the ones for beta

Note: the production parameter has to be added also to the bulktag and resulttocommunityfromorganization steps with the same semantics.

In this PR the use of the IS is replaced by the community APIs in the bulktagging and resulttocommunityfromorganization modules. The code is also refactored. There is also the addition of a new module resulttocommunityfromproject that associated the result to the community if the result is linked to a project relevant for the community. This will replace the IIS document_referencedProjects in the graph processing. We need to add a new step to the workflow (it could be added at any point in the enrichment pipeline) The parameters are: sourcePath = the source path outputPath = the output path production = true/false If true it will query the communityapis for production, if false the ones for beta Note: the production parameter has to be added also to the bulktag and resulttocommunityfromorganization steps with the same semantics.
claudio.atzori was assigned by miriam.baglioni 2023-11-03 15:30:21 +01:00
miriam.baglioni added 16 commits 2023-11-03 15:30:22 +01:00
miriam.baglioni added 1 commit 2023-11-03 15:35:15 +01:00
alessia.bardi was assigned by miriam.baglioni 2023-11-03 15:38:24 +01:00
claudio.atzori requested changes 2023-11-03 15:55:04 +01:00
@ -0,0 +14,4 @@
* @Date 06/10/23
*/
public class QueryCommunityAPI {
private static final String PRODUCTION_BASE_URL = "https://services.openaire.eu/openaire/";

It is not a good idea to hardcode the service base urls. Please consider to factor it out as an input parameter: having the possibility to define the API base URL fits well with the definition of a test case where the API server application is mocked locally.

It is not a good idea to hardcode the service base urls. Please consider to factor it out as an input parameter: having the possibility to define the API base URL fits well with the definition of a test case where the API server application is mocked locally.
Author
Member

I have changed this. Now we have a parameter baseURL where to specify the URL for production or beta.
It is expected to be "https://services.openaire.eu/openaire/communities/" and the equivalent one for beta "https://beta.services.openaire.eu/openaire/communities/"

I have changed this. Now we have a parameter baseURL where to specify the URL for production or beta. It is expected to be "https://services.openaire.eu/openaire/communities/" and the equivalent one for beta "https://beta.services.openaire.eu/openaire/communities/"

Thanks!

Thanks!
claudio.atzori marked this conversation as resolved
claudio.atzori changed title from [ENRICHMENT]Use of community API in enrichment process AND addition to tagging result for communities through projects to [ENRICHMENT][BETA] Use of community API in enrichment process AND addition to tagging result for communities through projects 2023-11-14 12:37:24 +01:00
miriam.baglioni added 4 commits 2023-11-27 15:13:20 +01:00
claudio.atzori added 1 commit 2023-11-30 14:20:22 +01:00
claudio.atzori merged commit 4cbabc9fbc into beta 2023-11-30 14:20:34 +01:00
claudio.atzori deleted branch propagationapi 2023-11-30 14:20:34 +01:00
Sign in to join this conversation.
No description provided.