Google BigQuery Archives

How to Call BigQuery Stored Procedure from Cloud Composer?

Automating your data warehouse workflows in Google Cloud is critical for scaling your analytics. If you want to orchestrate complex SQL logic seamlessly, knowing how to call a BigQuery stored procedure from Cloud Composer is an essential skill for any data engineer. Here is a complete, step-by-step guide and Airflow DAG example to get your pipelines running smoothly. Page Content Introduction Step 1: Create the BigQuery Stored Procedure Step 2: Write the Cloud Composer (Airflow) DAG Best Practices for Orchestrating BigQuery Conclusion Introduction Google Cloud offers several ways to orchestrate…

0 Comments

July 7, 2026

GCP BigQuery

Reuse Column Aliases in BigQuery – Lateral Column alias

BigQuery lateral Column alias are columns that are derived from the previously computed columns in same SELECT statement. Derived columns or lateral Column alias are virtual columns that are not physically stored in the table. Their values are re-calculated every time they are referenced in a query. Many PostgreSQL relational databases such as Netezza supports reuse of the column aliases within the same SELECT statement but GCP BigQuery does not support reuse of calculated derived columns. In this article, we will identify the alternate methods reuse column aliases in Google…

Comments Off

April 18, 2023

GCP BigQuery

Google BigQuery GROUPING SETS: Native Example and Alternative

If you are looking to perform multi-dimensional data analysis, the Google BigQuery GROUPING SETS function is exactly what you need. While developers previously had to rely on a complex UNION ALL workaround, BigQuery now natively supports this advanced aggregation feature. In this post, we will look at how to use the new native GROUPING SETS function and also review the legacy alternative for older codebases. Google BigQuery Grouping Sets Page Content Introduction SQL GROUPING SETS in Google BigQuery GROUPING SETS BigQuery Alternative Using UNION ALL Conclusion Introduction In my other…

Comments Off

September 15, 2022

GCP BigQuery

What is SQL Cursor Alternative in BigQuery?

SQL Cursor is a database object to retrieve data from a result set one row at a time. The cursor are useful in many scenarios such as updating records using loops, inserting only required records, etc. You can think cursor as a temporary workspace provisioned in database system memory when a SQL query is executed. SQL Cursor always returns one row at a time, you can perform your calculation on returned values. In this article, we will check what is SQL cursor alternative in Google BigQuery with an example. Cursors…

Comments Off

October 28, 2020

GCP BigQuery

Google BigQuery Recursive CTE: Native Query and Alternative Example

If you need to query hierarchical data like an organizational chart, employee-manager relationships, or a bill of materials a recursive query is the standard approach. While developers previously had to rely on scripting workarounds, Google BigQuery now fully supports native recursive CTEs. In this guide, we will look at how to write a native BigQuery recursive query, as well as a legacy alternative using a WHILE loop. Page Content Introduction Native BigQuery Recursive CTE (WITH RECURSIVE) BigQuery Recursive Query Alternative Using WHILE Loop Conclusion Introduction Identifying hierarchies of data used…

Comments Off

October 16, 2020