GCP BigQuery

How to Call BigQuery Stored Procedure from Cloud Composer?

Automating your data warehouse workflows in Google Cloud is critical for scaling your analytics. If you want to orchestrate complex SQL logic seamlessly, knowing how to call a BigQuery stored procedure from Cloud Composer is an essential skill for any data engineer. Here is a complete, step-by-step guide and Airflow DAG example to get your pipelines running smoothly. Page Content Introduction Step 1: Create the BigQuery Stored Procedure Step 2: Write the Cloud Composer (Airflow) DAG Best Practices for Orchestrating BigQuery Conclusion Introduction Google Cloud offers several ways to orchestrate…

Continue ReadingHow to Call BigQuery Stored Procedure from Cloud Composer?
0 Comments
July 7, 2026
GCP BigQuery

Reuse Column Aliases in BigQuery – Lateral Column alias

BigQuery lateral Column alias are columns that are derived from the previously computed columns in same SELECT statement. Derived columns or lateral Column alias are virtual columns that are not physically stored in the table. Their values are re-calculated every time they are referenced in a query. Many PostgreSQL relational databases such as Netezza supports reuse of the column aliases within the same SELECT statement but GCP BigQuery does not support reuse of calculated derived columns. In this article, we will identify the alternate methods reuse column aliases in Google…

Continue ReadingReuse Column Aliases in BigQuery – Lateral Column alias
Comments Off on Reuse Column Aliases in BigQuery – Lateral Column alias
April 18, 2023
GCP BigQuery

Google BigQuery GROUP BY CUBE: Native Example and Alternative

If you are looking to perform multi-dimensional data analysis, the Google BigQuery GROUP BY CUBE function is exactly what you need. While developers previously had to rely on a complex UNION ALL alternative, BigQuery now natively supports this advanced aggregation feature. In this post, we will look at how to use the new native CUBE function and also review the legacy alternative for older codebases. Google BigQuery GROUP BY CUBE Page Content Introduction SQL GROUP BY CUBE in Google BigQuery GROUP BY CUBE BigQuery Alternative Using UNION ALL Conclusion Introduction…

Continue ReadingGoogle BigQuery GROUP BY CUBE: Native Example and Alternative
Comments Off on Google BigQuery GROUP BY CUBE: Native Example and Alternative
September 15, 2022
GCP BigQuery

NVL and NVL2 Functions in BigQuery and Alternatives

Like many relational databases, GCP BigQuery supports many useful built-in functions. Not all the functions those are available in other relational databases are supported in BigQuery. But, BigQuery provides alternative built-in functions that you can use. In this article, we will check NVL and NVL2 functions in BigQuery database. NVL and NVL2 Functions in BigQuery The databases such as Redshift, Teradata, Vertica, Netezza, Oracle, etc. supports standard NULL handling functions such as NVL and NVL2. But as of now, BigQuery supports alternative functions in place of NVL and NVL2. NVL…

Continue ReadingNVL and NVL2 Functions in BigQuery and Alternatives
Comments Off on NVL and NVL2 Functions in BigQuery and Alternatives
January 13, 2022
GCP BigQuery

BigQuery Control Flow Statements – IF, LOOP, WHILE

Similar to relational databases such as SQL Server, BigQuery supports scripting. BigQuery scripting allows you to send multiple statements to BigQuery in one request. You can also set variables, and use it in any supported control flow statements such as IF and WHILE. For example, you can declare a variable, assign a value to it, and then reference it in a loop statement. In this article, we will check what are BigQuery Control Flow Statements with some examples. In BigQuery, a script is a SQL statement list to be executed in sequence. A…

Continue ReadingBigQuery Control Flow Statements – IF, LOOP, WHILE
Comments Off on BigQuery Control Flow Statements – IF, LOOP, WHILE
October 15, 2020