Netezza

Netezza Fixed-Width File Loading and Examples

Fixed width text files are special cases of text files where the format is specified by column widths, pad character and left or right alignment. In this format column width are in terms of units of characters. In this post we will learn about Netezza Fixed-Width file loading. Fixed-Width File Overview All data is a series of byte-sequences and has an associated data type, used here as a conceptual or abstract attribute of the data. Fixed-length format files use ordinal positions, which are offsets to identify where fields are within…

Continue ReadingNetezza Fixed-Width File Loading and Examples
Comments Off on Netezza Fixed-Width File Loading and Examples
October 3, 2016
Netezza

Netezza Best Practices to Improve Performance

Today there is a increased demand in advanced analytics on big data. Netezza is designed with built in functionalities to perform advanced analytics on really big data sets. To improve the performance, you should follow some Netezza best practices. Best practice should not mean hundreds of rules and regulations to follow. Recommended that basic principles are followed on following features of Netezza: Distribution Data types Statistics Zone maps Clustered base tables Groom table command Netezza Best Practices on Distributions In a Netezza data warehouse appliance good distribution is fundamental element…

Continue ReadingNetezza Best Practices to Improve Performance
Comments Off on Netezza Best Practices to Improve Performance
October 2, 2016
Netezza

Netezza Cross Database Access and its Restrictions

Netezza cross database access does allows you to execute the objects such as tables, view, synonyms that are available on the same Netezza server. You can can INSERT, UPDATE or DELETE data from current database by referring objects in other database on same server. For example, TRAINING1.ADMIN(ADMIN)=>SELECT * FROM TRAINING1..TEST1; Read: Access Netezza Database, Tools and Examples Netezza nzsql Command and its Usage Netezza Synonym Best Practices and Examples Referencing Database Object from other Database To access objects in other databases on the same Netezza system, you must use three-level…

Continue ReadingNetezza Cross Database Access and its Restrictions
Comments Off on Netezza Cross Database Access and its Restrictions
September 28, 2016
BigData

Migrating Netezza to Impala SQL Best Practices

Now a days everybody wants to migrate to Hadoop environment for their analytics that includes real-time or near real-time. In this post i will explain some best practices in Migrating Netezza to Impala SQL. Impala uses the standard SQL but still you might need to modify the source SQL when bringing specific application to Hadoop Impala due to variations in data types, built-in function and obviously Hadoop specific syntax. Even if the SQL is working correctly in Impala, you might consider rewriting it to improve performance. Read: Netezza Hadoop Connector…

Continue ReadingMigrating Netezza to Impala SQL Best Practices
2 Comments
September 24, 2016
Netezza

Netezza Date Format and Conversions

Date data types are used to store the date and time fraction values. Netezza Date format includes four data types, and are used to store the date with time details: DATE = for year, month, day storage. TIME = for hour, minute, second, fraction with (includes 6 decimal positions). TIME WITH TIME ZONE / TIMETZ = same as TIME, also includes time zone information. TIMESTAMP = for year, month, day, hour, minute, second, fraction ( includes 6 decimal positions). Netezza Date Format Conversion Netezza can convert quoted date strings values…

Continue ReadingNetezza Date Format and Conversions
Comments Off on Netezza Date Format and Conversions
September 22, 2016
Netezza

Netezza Hadoop Integration and different types of Ingestion

Big Data and Netezza are two terms you hear lot about when you are working with loads of data. You want to process bunch of data and perform analytics on same. Sometimes it comes to raw data as well; you may get requirement to perform the analytics on the semi-structured data or unstructured data. Netezza Hadoop Integration comes into picture. So now question is how can you perform low latency data analytics on above mentioned data sets?Answer is Netezza Hadoop integration. Process the semi-structured or unstructured data in Hadoop and ingest…

Continue ReadingNetezza Hadoop Integration and different types of Ingestion
Comments Off on Netezza Hadoop Integration and different types of Ingestion
September 19, 2016
Netezza

Netezza Hadoop Connector and its Usage

Netezza Hadoop connector for Sqoop is an implementation of the Sqoop connector interfaces for accessing a Netezza data warehouse appliance from Hadoop cluster. Yom can export and import he data to a Hadoop cluster from various Netezza data warehouse environment. Netezza Hadoop connector is designed to use Netezza high-throughput data-transfer mechanisms to import and export data to Hadoop HDFS. This Connector for Netezza is a standard Sqoop extension that allows Sqoop to inter operate with Netezza Data warehouse appliance through Netezza JDBC drivers. This connector is already Cloudera Hadoop distribution…

Continue ReadingNetezza Hadoop Connector and its Usage
Comments Off on Netezza Hadoop Connector and its Usage
September 19, 2016
Netezza

Explicit and implicit Netezza Type Casting With Examples

Netezza type casting is converting the value with one data type to other. There are two type of type casting: Implicit and Explicit type casting. Implicit Netezza Type Casting In an implicit type casting Netezza uses internal rules and try to evaluate the process statements that contain the mixed data types. This will be very helpful when using a function that expects a particular data type, or when issuing a query that compares values that are similar but of different data types. For example, Consider the below query that compare…

Continue ReadingExplicit and implicit Netezza Type Casting With Examples
1 Comment
September 17, 2016
Netezza

Netezza Hash Function Usage and Examples

You can use Netezza hash function to encode the data by transforming the input into a hash code or hash values. If you use the hash function, no two inputs have same hash values. The hash algorithm is designed to minimise the collision (two inputs having same hash value). You can use the hash function to speed up the data record retrieval by using simple one way lookup. Hash code is used as an index into a hash table which has a pointer to data records. Netezza hash function also…

Continue ReadingNetezza Hash Function Usage and Examples
Comments Off on Netezza Hash Function Usage and Examples
September 14, 2016
Netezza

Download and Install Netezza SQL Extensions Toolkit

The Netezza SQL Extensions toolkit is an optional package that contains additional SQL functions for IBM Netezza data warehouse appliances. The Netezza SQL Extensions toolkit contains various functions and regular expressions that are useful in day to day computations. You can download this package from the IBM site and install to particular database. Read: Netezza Advanced Date Functions and Examples dasdas Download the Netezza SQL Extensions Toolkit Login to IBM fix central site given below and download sql-ext-version.tar.gz file. Download Extension toolkit here Once the software is downloaded copy that…

Continue ReadingDownload and Install Netezza SQL Extensions Toolkit
Comments Off on Download and Install Netezza SQL Extensions Toolkit
September 9, 2016