General

How to Create your own Custom Python Distribution Package?

Python programming language is one of the commonly used programming language in industry. With growing AI/ML, Python popularity is also growing. You may have to use many Python packages to build your application. Ever wondered how to create a Python distribution like Anaconda?. In this article, we will explain how to create your own Python package. You can later install package on the target machine. How to Create your own Python Distribution Package? There are many ways to package your Python application and create a setup.py to install the application…

Continue ReadingHow to Create your own Custom Python Distribution Package?
Comments Off on How to Create your own Custom Python Distribution Package?
December 14, 2019
Snowflake

How to use Snowflake Python Connector and Example

Snowflake is a cloud data warehouse environment and provides support for many major programming languages that uses JDBC or ODBC drivers. You can use Snowflake provided connector to connect your application. In this article, we will check one of the such connectors. i.e Python connector for Snowflake. Snowflake Python Connector The Snowflake Connector for Python provides an interface for developing Python applications that can connect to cloud data warehouse and perform all standard operations.  The connector is a pure python package that can be used to connect your application to…

Continue ReadingHow to use Snowflake Python Connector and Example
Comments Off on How to use Snowflake Python Connector and Example
December 14, 2019
Snowflake

Execute SQL Script File using Snowflake Snowsql Variable Substitution

Snowflake allows variable substitution using -D or --variable options. The variable substitution is one of the nice feature that allows you to pass values to the script dynamically. For example, pass month value to the SQL script. Many modern day databases support the variable substitution. In this article, we will check how to a execute SQL script file using Snowflake Snowsql variable substitution with an example. Snowflake Snowsql Variable Substitution Snowsql supports the variable substitution with the help of -D or --variable option. You can use that defined variable inside…

Continue ReadingExecute SQL Script File using Snowflake Snowsql Variable Substitution
Comments Off on Execute SQL Script File using Snowflake Snowsql Variable Substitution
December 13, 2019
Snowflake

Access Snowflake using Snowsql without Password Prompt – Snowsql Environment Variables

There are many ways you can connect to Snowflake cloud data warehouse server. The options include Snowsql, JDBC and ODBC drivers, python connector, Spark connectors, etc. In this article, we will discuss how to access Snowflake using Snowsql without password prompt. We will also check Snowsql environment variables. Access Snowflake using Snowsql without Password Prompt Password less access is useful when your application requires to connect to Snowflake frequently. There are multiple options that you can use to achieve password less communication to Snowflake server. Export Snowflake Database Server Environmental…

Continue ReadingAccess Snowflake using Snowsql without Password Prompt – Snowsql Environment Variables
Comments Off on Access Snowflake using Snowsql without Password Prompt – Snowsql Environment Variables
December 13, 2019
Snowflake

Snowsql Command Line Options and Examples

SnowSQL is a Python based command line interface to connect Snowflake from Windows, Linux, and Mac OS. The SnowSQL is an interactive terminal for Snowflake. You can use it to execute queries, create database objects and perform some of the admin tasks. In this article, we will check how to use Snowsql, what are the SnowSQL command line options. Snowsql Command Usage You can use following command to connect to Snowflake using Snowsql. snowsql -a accountName -u userName -d databaseName -s schemaName For example, consider following command to connect Snowflake…

Continue ReadingSnowsql Command Line Options and Examples
Comments Off on Snowsql Command Line Options and Examples
December 12, 2019
Snowflake

What is Snowflake Lateral Join and How to use it?

The lateral join in Snowflakes is similar to that of Hive lateral views. Lateral joins in snowflake behaves more like a correlated sub queries than normal snowflake joins. In this article, we will check what is Snowflake lateral join and how to use it. We will also check the lateral view with FLATTEN keyword and an example. What is Snowflake Lateral Join? In Snowflake, lateral keyword allows an in-line view to reference columns from a table expression that precedes that in-line view, but in some cases it may not refer…

Continue ReadingWhat is Snowflake Lateral Join and How to use it?
Comments Off on What is Snowflake Lateral Join and How to use it?
December 12, 2019
Snowflake

Different Snowflake Join Types and Examples

SQL Join is a clause in your query that is used for combining specific fields from two or more tables based on the common columns available. Snowflake joins are different from the set operators. Joins are used to combine rows from multiple tables. In this article, we will learn about different Snowflake join types with some examples. Test Data Following tables will be used to demonstrate different join types available in Snowflake cloud data warehouse system. S_STUDENTS +----+------+-----------+ | ID | NAME | CITY | |----+------+-----------| | 1 | AAA…

Continue ReadingDifferent Snowflake Join Types and Examples
Comments Off on Different Snowflake Join Types and Examples
December 11, 2019
Snowflake

Connect Snowflake using Python Pyodbc – ODBC Driver Example

Snowflake provides many connectors, you can use those to interact with Snowflake cloud data warehouse. There are many different options to connect to Snowflake. Many applications use jdbc or odbc drivers. In my other article, we have discussed how to connect Snowflake using Python and jdbc driver. In this article, we will check method on connect Snowflake using Python pyodbc and odbc driver with a working example. Snowflake ODBC Driver Snowflake data warehouse server comes with ODBC support. Before attempting to connect Snowflake from either Windows or Linux, you must…

Continue ReadingConnect Snowflake using Python Pyodbc – ODBC Driver Example
2 Comments
December 8, 2019
Snowflake

How to Access Snowflake using Aginity Pro? – Steps

There are many free and paid SQL editor tools available for Snowflake. In my other article, we have introduced best SQL editor available for Snowflake. In this article, we will check how to access Snowflake using Aginity pro. We have explained step by step process to install Aginity pro for Snowflake. About Aginity Pro Aginity Pro is relatively new SQL analysis tool. Aginity pro comes in both free and paid versions. Free version is a packed with many features and makes data engineer's life easier. Aginity Pro is an easy-to-use…

Continue ReadingHow to Access Snowflake using Aginity Pro? – Steps
Comments Off on How to Access Snowflake using Aginity Pro? – Steps
December 8, 2019
Snowflake

Best SQL Editor Available for Snowflake

Snowflake supports JDBC and ODBC connectors. There are many best, free and paid query editor tools available in the market. The widely used and popular query tool includes Aginity pro, SQuirrel SQL Client tool, SQL Workbench, etc. In this article, we will check SQL Editor Available for Snowflake. All the tools discussed in this articles are free and paid version. You can choose any tools based on your work nature and organization policies. SQL Editor Available for Snowflake Following are the list of commonly used Snowflake SQL editor tools. Aginity…

Continue ReadingBest SQL Editor Available for Snowflake
Comments Off on Best SQL Editor Available for Snowflake
December 8, 2019