Loredana Liccardo
885a219fe1
Samplings and SubmitQuery changed in order to return as a result a map with column values truncated to 255 characters and a file with the whole columns values in order to manage so to manage big data properly and the conversion of a geometry data type in a multipolygon representation applying the function st_astext() for a database postgres.
...
Sampler and DatabaseManagement classes changed. The file is stored on the statistical manager side and recovered through an ulr.
pom file changed in 1.3.0
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@101766 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-11-28 11:54:54 +00:00
Loredana Liccardo
72b8e87e81
- method submitQuery modified in class DatabaseManagement in order to return a file and a map as output. The map is truncated to 1000 rows if the result has more than 1000 rows.
...
method writeTableIntoFile reintroduced that performs the file writing and the map generation.
- Version in pom file changed in 1.3.0
- method submitQuery modified in class DatabaseManagement adding the UUID string to the submitQuery result file QueryResult file.
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@101653 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-11-19 14:38:18 +00:00
Loredana Liccardo
4e18e1cd99
- bug fixed in class Analyzing the query for keyword delete and update. space removed.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@101545 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-11-10 15:50:26 +00:00
Loredana Liccardo
0410564abd
- bug fixed in class parseRegularExpressions. Change applied to parseRegularExpressions method replacing the \n character with a space.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@101542 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-11-10 14:22:34 +00:00
Loredana Liccardo
630d4beadc
bug fixed for adb Postgres and related the explain function in order to compute the estimated rows of a table. Added a treshold with value 100000. If the rows computed with the explain function is < 100000 the counter function is used otherwise the explain result. DatabaseOperations class modified.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@101427 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-11-04 13:25:13 +00:00
Loredana Liccardo
8a06b5373b
bug fixed for the submitQuery and sampling operation and related to column value truncated to 255 characters. If the final quote has been truncated the parsecvsstring method in the servlet does not work fine. Bug fixed adding the final quote. convertToJavaType method in DatabaseManagement class modified.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@101170 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-10-29 16:10:02 +00:00
Loredana Liccardo
17dfef9f1e
- bug fixed in Sampler class in computeSmartSampleWithThreshold method. table name formatted as schema."table" in order to recover the rows
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@101088 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-10-28 16:07:36 +00:00
Loredana Liccardo
81c8975e6a
changelog file modified for release 3.5.0
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@101055 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-10-28 10:48:27 +00:00
Loredana Liccardo
52a940e840
changelog file modified for release 3.5.0
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@101054 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-10-28 10:48:03 +00:00
Loredana Liccardo
530a00d536
- bug fixed in class ConnectionManager for the submitquery operation modified in order to manage the data geometry recovering the related value as a sequence of hexadecimal characters and not as a parsed multipolygon value. executeQueryJDBC method modified.
...
- bug fixed in class DatabaseManagement for the submitquery operation in order to truncate column values of the result to 255 character in convertToJavaType method
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@101053 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-10-28 10:00:50 +00:00
Loredana Liccardo
b7eba1b58f
- for show create table statement column names returned with uppercase names. PostgresTableStructure class modified in order to remove toLowerCase() function applied on the column name.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@101048 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-10-27 16:29:04 +00:00
Loredana Liccardo
850c0072b9
- bug fixed and related to samplings operation to manage column uppercase names with a postgres database. Sampler class modified adding "" for a column for database postgres.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@101046 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-10-27 16:13:43 +00:00
Loredana Liccardo
cba62f48f0
- method closeconnection in class DatabaseManager modified in order to close the SessionFactory.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@100987 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-10-24 16:44:30 +00:00
Loredana Liccardo
71cafbc5df
some files updated in previous operations committed
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@100743 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-10-16 09:09:52 +00:00
Loredana Liccardo
2f313cbbea
- bug fixed and founded with the TabularData Database resource that has 2 access points with the same endpoint, username and password values.
...
getAccessPoints method in DBResource class modified and equals method defined in AccessPoint class. DBResource, Normalizer, Decider e Guesser classes modified in order manage the exception generated in equals method. Exceptio managed also in algorithms (except ListNames) in database-rm-algorithms components.
- tag version changed in pom file from 1.1.0 to 1.2.0
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@100742 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-10-16 09:06:28 +00:00
Loredana Liccardo
2986079369
e.printStackTrace added for debug purpose statement for an exception in executeQuery method
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@100708 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-10-15 11:08:41 +00:00
Loredana Liccardo
9c42affe76
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99785 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-09-12 13:42:13 +00:00
Loredana Liccardo
6728db3c04
modification applied to the smartSampleOnTable method of class Sampler. If a table has o row return the exception with message "The table has 0 rows"
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99778 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-09-12 12:07:29 +00:00
Loredana Liccardo
77082fa4ad
File DestinationDBHibernate.cfg.xml in "cfg" folder of the project renamed in DestinationDBHibernateDBManager.cfg.xml and correction in method initDBSession of the ConectionMannaager class in order to specify this file name.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99649 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-09-10 07:57:17 +00:00
Loredana Liccardo
b72e647ea8
bug fixed for the smart smapling (with table col2oct2010-> scientific_names). Corrections in computeSmartSampleWithThreshold method.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99565 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-09-05 15:36:52 +00:00
Loredana Liccardo
5af78b2871
print result's size added in the executeQueryJDBC method in ConnectionManager class.
...
pom file version modified from 1.0.0 to 1.1.0(for deploy)
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99522 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-09-05 10:02:23 +00:00
Loredana Liccardo
5be390fde8
parameters updated in the SubmitQuery method of DatabaseManagement class.(parameter on path file removed because unusable)
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99410 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-09-03 08:11:42 +00:00
Loredana Liccardo
1e191ee9f3
hibernate bug fixed and related to a join tables that have some columns with identical name. Bug resolved using JDBC. ConnectionManager and DatabaseManagement classes modified adding the method "executeQueryJDBC" in ConnectionManager, used only for the submitquery operation
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99393 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-09-02 13:14:58 +00:00
Loredana Liccardo
ecee3f5fdf
timeout for hibernate database connection changed to value 5 seconds.(corrections in ConnectionManager class and printfs added and commented in DatabaseFactory and DatabaseManagement classes)
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99376 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-09-01 14:45:00 +00:00
Loredana Liccardo
10488ac084
some printf commented in computeSmartSample and computeSmartSampleWithThreshold for Sampler class
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99371 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-09-01 11:00:32 +00:00
Loredana Liccardo
5d77f12fc9
bug fixed in calculation of table's details for a database postgres through the GetTableDetails algorithm. The calculateElements method in DatabaseOperations class has been modified adding "" for a table name.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99349 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-08-29 12:37:42 +00:00
Loredana Liccardo
6942920792
bug fixed in sampling operations and resolved truncating each table'a attribute to 255 characters
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99348 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-08-29 11:51:09 +00:00
Loredana Liccardo
6ce1e4d44b
bug fixed for sampling in class Sampler for a database mysql about an attribute of a table that could be a keyword.Quotes `` added for all attributes before submitting a query.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99335 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-08-28 15:36:38 +00:00
Loredana Liccardo
fe5b1c211b
bug fixed in smart e random sampling for a database mysql
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99333 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-08-28 13:57:57 +00:00
Loredana Liccardo
a2ea87687d
- exception management for SQLGrammarException adding a cause message
...
- method removeQueryExecution implemented and commented in class ConnectionManager
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99191 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-08-01 15:21:17 +00:00
Loredana Liccardo
f790f715b7
bug fixed in Sampler and DatabaseOPerations classes to manage tables case sensitive for database Postgres
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99145 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-07-31 09:02:47 +00:00
Loredana Liccardo
ab97ee8304
bug fixed in class DatabaseManagement: method writeSampleTableIntoFile replaced with method buildMapResult.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99060 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-07-29 10:09:49 +00:00
Loredana Liccardo
78e9c6e288
Methods writeSampleTableIntoFile, writeQueryResultIntoFile, isHexadecimal removed because being commented were not used.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99059 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-07-29 09:30:18 +00:00
Loredana Liccardo
c202c94220
methods getFileQueryResult and getFileSampleTableResult commented.
...
Methods writeSampleTableIntoFile and writeQueryResultIntoFile removed because being commented were not used.
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99055 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-07-29 09:26:38 +00:00
Loredana Liccardo
21d1bb5a27
class DatabaseManagement modified in order to not make available the result in a file csv for submitquery and samplings operations.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@99051 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-07-29 08:30:42 +00:00
Loredana Liccardo
6769c97a2d
- the connection timeout of about 30 seconds has been managed with a GenericJDBCException.
...
- exceptions managed in a different way in method executeQuery of Class ConnectionManager
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@98992 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-07-25 13:49:09 +00:00
Loredana Liccardo
5f795e85d0
added a timeout about 25-20 seconds.To add the timeout the following classes are been modified:
...
- class DatabaseFactory modified adding the initDBConnection method that overrides the properties contained in the hibernate.cfg.xml file.
- method initDBSession in class ConnectionManager modified in order to use the DatabaseFactory (in package utils)
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@98967 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-07-25 08:13:25 +00:00
Loredana Liccardo
229f351f7d
bugs fixed in showcreatetable and samplings operations. In these operation it is useful to insert the table name in a query as "schema.table" for postgres and "db.table" for mysql.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@98907 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-07-23 15:11:58 +00:00
Loredana Liccardo
aa3fbea54b
bug fixed (updated the output result displayed from the statistical) in DatabaseManagement class related to the bug fixed yesterday.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@98872 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-07-22 12:58:20 +00:00
Loredana Liccardo
83df040993
bug fixed to retrieve columns names in a correct order (defined in the database schema) for the sampling operations, for the getTableDetails. Updates in Sampler, DatabasesManager and PostgresTableStructure classes.
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@98845 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-07-21 15:19:55 +00:00
Loredana Liccardo
7762f7a162
bug corrected in "showCreateTable" method of MySQLTableStructure class (result managed in a correct way using aliasToEntityOrderedMapResultTransformer class).
...
Bug fixed in "DatabaseManagement" class in "writeTableIntoFile" method to manage for SubmitQuery e sampling operations tables with one column.
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@98835 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-07-21 10:57:49 +00:00
Loredana Liccardo
ba20c2730e
artifactid in pom file modified (for etics component)
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@97257 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-06-10 17:16:03 +00:00
Loredana Liccardo
f5068528fc
files profile and changelog modified for etics configuration
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@97214 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-06-10 13:21:07 +00:00
Loredana Liccardo
c3da5a8a55
groupid changed in pom file for the project
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@97167 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-06-10 08:55:44 +00:00
Loredana Liccardo
00f1af0de8
file pom modified to copy the file profile.xml from folder distro to target
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@97145 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-06-09 15:02:35 +00:00
Loredana Liccardo
932f2390bb
Folder "distro" added
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@97132 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-06-09 13:22:06 +00:00
Loredana Liccardo
80435cf7e7
package org.gcube.dataanalysis.test removed
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@96727 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-06-05 09:20:45 +00:00
Loredana Liccardo
ce0e91da4a
package org.gcube.dataanalysis.test renamed in org.gcube.dataaccess.test in src/test/java
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@96726 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-06-05 09:16:28 +00:00
Loredana Liccardo
fe61b11c54
some bug fixed in DatabasesResourcesManager class to recover a correct result from the submit query (in order to comply with AliasToEntityOrderedMapResultTransformer)
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@96724 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-06-05 09:03:12 +00:00
Loredana Liccardo
a655d2dabb
deleted dataanalysis package
...
git-svn-id: https://svn.d4science.research-infrastructures.eu/gcube/trunk/data-access/DatabasesResourcesManager@96627 82a268e6-3cf1-43bd-a215-b396298e98cf
2014-06-04 14:41:00 +00:00