tolerant parsing of OAF-store-graph mdstores #180

claudio.atzori · 2022-01-04T11:32:18+01:00

claudio.atzori commented

2022-01-04 11:32:18 +01:00

This PR introduces a change in the serialisation of the records stored in the OAF-store-graph mdstores. They were stored in Kryo (binary) format, therefore any slight change in the schema version would made them unreadable, forcing us to recreate them quite frequently. Instead, we're going to store them in as a json serialization, so that reading them again in the graph construction phase with a parser (com.fasterxml.jackson.databind.ObjectMapper) we have better changes to support backward compatible changes in the evolution of the schema.

val mapper = new ObjectMapper().configure(DeserializationFeature.FAIL_ON_UNKNOWN_PROPERTIES, false)

This PR introduces a change in the serialisation of the records stored in the `OAF-store-graph` mdstores. They were stored in Kryo (binary) format, therefore any slight change in the schema version would made them unreadable, forcing us to recreate them quite frequently. Instead, we're going to store them in as a json serialization, so that reading them again in the graph construction phase with a parser (`com.fasterxml.jackson.databind.ObjectMapper`) we have better changes to support backward compatible changes in the evolution of the schema. ``` val mapper = new ObjectMapper().configure(DeserializationFeature.FAIL_ON_UNKNOWN_PROPERTIES, false) ```

claudio.atzori added the

enhancement

label 2022-01-04 11:32:18 +01:00

claudio.atzori added 2 commits 2022-01-04 11:32:18 +01:00

a6977197b3 serialise records in the OAF-store-graph mdstores in json format. Read them again in the graph construction phase using a tolerant parser to support backward compatible changes in the evolution of the schema

bd59b58efb test for the tolerant deserialisation utility method

claudio.atzori merged commit cb30770a0b into beta

2022-01-04 11:32:29 +01:00

claudio.atzori referenced this issue from a commit

2022-01-04 11:32:30 +01:00

Merge pull request 'tolerant parsing of OAF-store-graph mdstores' (#180) from graph_interpretation_mdstores into beta

claudio.atzori referenced this pull request