Databricks Temporary Tables Support

Starting with Databricks Runtime 16.4, Databricks now supports temporary tables—just like other databases such as Netezza, Snowflake, and Oracle. You can use these tables for storing data that you only need for a short time. They exist only during your current session and are automatically deleted when the session ends. You can’t access them from any other session. In this blog post, we’ll walk through how to create temporary tables in Databricks, look at the syntax, explore common use cases, and go over some limitations—with some easy-to-follow examples. Page Contents Introduction What…

Continue ReadingDatabricks Temporary Tables Support
Comments Off on Databricks Temporary Tables Support

Lateral Column Alias in Databricks – Example

The lateral column alias in Databricks allows users to reuse an expression specified earlier in the same SELECT list, eliminating the need to use nested subqueries and Common Table Expressions (CTEs) in many cases. This blog post discusses the use cases of the feature and the benefits it brings to Spark and Databricks users. Page Contents Introduction What is Lateral Column Alias Support? Benefits of using Lateral Column Alias in Databricks SQL Alternative Methods to Lateral Column Alias in Databricks SQL Conclusion Introduction Databricks has introduced a much needed lateral…

Continue ReadingLateral Column Alias in Databricks – Example
Comments Off on Lateral Column Alias in Databricks – Example