Window functions in spark using order by

 Window functions in spark: 

In the below dataset we  have students data and we want to get rank for each student based on his marks.

Input:

id,name,marks

1,Shiva,90

2,Ram,85

3,Mohan,95

4,Raju,96


Code:

Let suppose my dataframe name is df then perform below operations to work with window operations.

ranks = Window.orderBy(df["marks"].desc())

result_df = df.withColumn("ranks",row_number().over(ranks))

result_df.show()




Comments