Posts

How to rename column in spark

How to check if a string is palindrome

How to check if a two numbers are Anagram or not

How to reverse a string in python

How to create a temporary table in spark

Converting python list to Dataframe in spark

How to load partitions for a table in Athena or Hive

Group by in SQL query

How to find 2nd or Nth highest salary using SQL query window functions

How to read csv or txt file using pandas

How to read and write to file using python.

AWS Glue crawler

What is AWS Athena and how we can use it.

What is Spark, how to work with and setup spark.

Difference between RDD, DataFrame, Dataset in spark

Broadcast in Spark

Table joins in spark

How to read parquet files in spark

Group by aggregation in spark to sum marks

Writing to CSV, parquet, avro files from spark dataframe

Apply filters on dataframe in spark

Spark Window functions using parititionby and order by on department dataset

Window functions in spark using order by

Reading a CSV file in spark

Process file in AWS Lambda local and upload the same file to S3 bucket