Netezza

Connecting Netezza using Python pyodbc – Working Example

In this modern era, data plays very important role in every decision making. Most of applications that is written in various programming languages require access to relational databases to get required data for its process. Before you can run SQL statements to create, update, delete, or retrieve data, you must connect to a database. In this article, we will check process and working example on connecting Netezza using Python pyodbc driver. Netezza also supports JDBC driver: How to Connect Netezza using JDBC Driver and working Examples Netezza ODBC drivers Before attempting…

Continue ReadingConnecting Netezza using Python pyodbc – Working Example
Comments Off on Connecting Netezza using Python pyodbc – Working Example
March 28, 2018
BigData

Apache Hive Table Update using ACID Transactions and Examples

Apache Hive and Cloudera Impala supports SQL on Hadoop and provides better way to manage data on Hadoop ecosystem. There are many frameworks to support SQL on Hadoop are available, but Hive and Cloudera are widely used and popular frameworks. Until recently, Apache Hive did not support Update tables. Version 0.14 onwards, Hive supports ACID transactions. You must define the table as transaction to use ACID transactions such as UPDATE and DELETE. In this article, we will check Apache Hive table update using ACID Transactions and Examples. Apache Hive Table…

Continue ReadingApache Hive Table Update using ACID Transactions and Examples
Comments Off on Apache Hive Table Update using ACID Transactions and Examples
March 26, 2018
Greenplum

Greenplum Computed Column Support and Alternative

Derived or computed columns in Greenplum are columns that are derived from the previously computed columns in same table. These computed columns are virtual columns that are not physically stored in the Greenplum table. Their values are re-calculated every time they are referenced in a query. Many relational databases such as Netezza supports derived or computed columns but Greenplum does not support as of now. Development work is going on to include this feature in upcoming ProsgreSQL release. In this article, we will check Greenplum Computed Column Support and alternative…

Continue ReadingGreenplum Computed Column Support and Alternative
Comments Off on Greenplum Computed Column Support and Alternative
March 22, 2018
BigData

Apache Hive Derived Column Support and Alternative

Derived columns are columns that are derived from the previously derived or computed columns in same table. Derived columns or computed columns are virtual columns that are not physically stored in the table. Their values are re-calculated every time they are referenced in a query. Many relational databases such as Netezza supports derived columns but Apache Hive does not support derived columns. In this article, we will check Apache Hive Derived Column Support and Alternative method that you can use to derive columns. What are derived columns? Before going in…

Continue ReadingApache Hive Derived Column Support and Alternative
Comments Off on Apache Hive Derived Column Support and Alternative
March 22, 2018
BigData

How to update Hive Table without Setting Table Properties?

Apache Hive and Cloudera Impala provides better way to manage data on Hadoop ecosystem. There are many frameworks to support SQL on Hadoop are available, but Hive and Cloudera are widely used and popular frameworks. Until recently, Apache Hive did not support Update tables. You must set up TBLPROPERTIES to use transaction on the Hive table. These are relatively new features and should be used with caution. In this article, we will discuss how to update Hive table without setting table properties. You should not think Apache Hive as a…

Continue ReadingHow to update Hive Table without Setting Table Properties?
Comments Off on How to update Hive Table without Setting Table Properties?
March 21, 2018
Netezza

Export Netezza Table Data to Linux Local File System

In my other post ‘Netezza Export Table Data to CSV format’, we have seen how to export table to CSV format on a Netezza host machine. In this article, we will check how to export Netezza table data to Linux local file system. We will discuss below topics in this post How to install and configure Netezza ODBC drivers in remote machie Export Netezza table data to Linux local file system using External Tables How to export Netezza table using nzsql command line interface Install Netezza ODBC Drivers In other…

Continue ReadingExport Netezza Table Data to Linux Local File System
Comments Off on Export Netezza Table Data to Linux Local File System
March 6, 2018
BigData

Automatically Delete HBase row – Time to Live (TTL) Settings

One of the HBase features is that it can delete the rows in the table automatically. This feature reduces lot of time that is required to maintain rows if you are handling sensitive data.  In this article, we will check automatically delete HBase row using time to live (TTL) setting. HBase Time to Live (TTL) Option -  Automatically Delete HBase Row You can set ColumnFamilies a TTL length in seconds, and HBase will automatically delete rows or automatically expires the row once the expiration time is reached. This setting applies…

Continue ReadingAutomatically Delete HBase row – Time to Live (TTL) Settings
Comments Off on Automatically Delete HBase row – Time to Live (TTL) Settings
March 2, 2018
BigData

HBase Auto Sharding Concept and Explanation

HBase is the Hadoop storage manager on the top of Hadoop HDFS that provides low-latency random reads and writes, and it can handle petabytes of data without any issue. One of the interesting capabilities in HBase is auto sharding, which simply means that tables are dynamically distributed by the system to different region servers when they become too large. In other word, Splitting and serving regions can be thought of as auto sharding, as offered by other systems. Regions and Region Servers In Hbase, the scalability and load balancing is…

Continue ReadingHBase Auto Sharding Concept and Explanation
Comments Off on HBase Auto Sharding Concept and Explanation
March 2, 2018
Data Mining

Methods to Measure Data Dispersion

Data processing to be successful, it is essential to have an overall picture of the data. Descriptive data summarization techniques can be used to identify the typical properties of your data and highlight which data values should be treated as noise or outliers. Therefore, it’s very important to learn about the data characteristics and measure for the same. In this article, we will check Methods to Measure Data Dispersion. Methods to Measure Data Dispersion Let’s know how can we disperse the numeric data or spread the numeric data. Below are five…

Continue ReadingMethods to Measure Data Dispersion
Comments Off on Methods to Measure Data Dispersion
March 1, 2018
General

How Column Oriented Database Stores Data? – Details

Column-oriented databases save their data grouped by columns. Subsequent column values are stored contiguously on disk. Columnar storage for database tables is one of an important factor in optimizing analytic query performance in the database.In this article, we will check how column oriented database stores data. Also we will check the difference between row oriented database and columnar database - columnar database vs document database What is Column Oriented Database? The column-oriented databases save their data grouped by columns. This differs from the usual row-oriented approach of traditional databases, which…

Continue ReadingHow Column Oriented Database Stores Data? – Details
Comments Off on How Column Oriented Database Stores Data? – Details
February 15, 2018