Скачать или смотреть Question 1: Interview questions on pyspark

#Interview Question
Consider a PySpark DataFrame with a column named nested_data containing nested structures (StructType) in the following format:

root
|-- id: integer
|-- details: struct
| |-- name: string
| |-- age: integer
| |-- address: struct
| | |-- city: string
| | |-- country: string
Your task is to perform the following operations:

1)Extract the name and age fields from the details struct.
2)Create a new column named full_address by concatenating the city and country fields from the nested address struct.
Write PySpark code to achieve these tasks and provide the resulting DataFrame schema.

#pyspark #interview #bigdata