Skip to content
  • Home
  • About Us
  • Contact Us
DWgeek.com
  • Apache Spark
  • Databricks
  • Hive
  • Data Warehouse
    • Data Mining
  • Netezza
  • Redshift
  • Snowflake
  • More
    • Synapse
    • GCP BigQuery
    • General
    • Greenplum
    • Vertica
  • Toggle website search
Menu Close
  • Apache Spark
  • Databricks
  • Hive
  • Data Warehouse
    • Data Mining
  • Netezza
  • Redshift
  • Snowflake
  • More
    • Synapse
    • GCP BigQuery
    • General
    • Greenplum
    • Vertica
  • Toggle website search
  • Home
  • About Us
  • Contact Us
Apache Spark

PySpark – Search Table in Spark Database

In a real world scenario, you will be dealing with petabytes of data and thousands of tables in a hundred of databases within Spark or Hive catalog. It is practically, time consuming to identify the particular table in a database, hence it is always good idea to develop reusable code that you can use to search table(s) in a given database. The usability includes safely dropping table(s) and identify table structure. In this article, we will learn how to search table in a database using PySpark. Search Table in Database…

Continue ReadingPySpark – Search Table in Spark Database
Comments Off on PySpark – Search Table in Spark Database
June 8, 2021

Recent Posts

  • Lateral Column Alias in Databricks – Example
  • Database Migration to Snowflake: Best Practices and Tips
  • Reuse Column Aliases in BigQuery – Lateral Column alias
  • How to use Amazon Redshift Replace Function?
  • How to Optimize Query Performance on Redshift?
  • Redshift RSQL Control Statements – IF-ELSE-GOTO-LABEL
  • How to Connect to Databricks SQL Endpoint from Azure Data Factory?
  • How to Export SQL Server Table to S3 using Spark?
  • Connect to SQL Server From Spark – PySpark
  • How to Create Synonym in Snowflake?
  • Spark SQL Count Distinct Window Function
  • Rows Affected by Last Snowflake SQL Query – Example

About Founder

About Founder
I'm Vithal, a techie by profession, passionate blogger, frequent traveler, Beer lover and many more.. I write about Big Data, Data Warehouse technologies, Databases, and other general software related stuffs.
  • Opens in a new tab
  • Opens in a new tab
  • Opens in a new tab
Copyright @ 2025 · DWgeek.com · Privacy Policy · Disclaimer · Sitemap

This website uses cookies to ensure you get the best experience on our website. By clicking Accept, you are agreeing to our cookie policy

Accept