forked from D-Net/dnet-hadoop
Lampros Smyrnaios
49af2e5740
- Update the algorithm for creating views that depend on other views; overcome some bash-instabilities. - Upon any error, fail the whole process, not just the current DB-creation, as those errors usually indicate a bug in the initial DB-creation, that should be fixed immediately. - Enhance parallel-copy of large files by "hadoop distcp" command. - Reduce the "invalidate metadata" commands to just the current DB's tables, in order to eliminate the general overhead on Impala. - Show the number of tables and views in the logs. - Fix some log-messages. |
||
|---|---|---|
| .. | ||
| scripts | ||
| config-default.xml | ||
| copyDataToImpalaCluster.sh | ||
| finalizeImpalaCluster.sh | ||
| hist_snaps.sh | ||
| workflow.xml | ||