Posts

How to perform fast S3 copy from one folder to other folder

Drop table in a database using drop statement.

Rename column name of a table using Alter statement.

Update data in table using update statement.

Create Table, insert data and query data from table

How to Perform RowNumber on SQL query

How to Perform Rank on SQL query

Perform Dense Rank on SQL Query.

How to create Table a table in oracle or MSSQL or SQLServer.

Different data structures and data pipelines

Sparksession vs hivecontext vs sqlcontext vs sparkcontext

How to create egg file using setup.py in python project

How to create setup.py file in python project

How to read multiline JSON in spark

How to read single line JSON in spark

Optimizations in spark pipeline

AWS Glue 3.0 version

Spark vs MapReduce

How to execute multiple lines of spark scala code at a time

How to create Spark session in scala spark and pyspark

Writing data to database using spark.

JDBC connection using spark

How to drop multiple column in spark passing a list

How to replace string in a column with some value