How to create dataframe of tuples out of dataframe of lists in pyspark?

Question

Here is my dataframe:

my_df.show()

+----------+
|  features|
+----------+
| [0,'a']  |
| [1,'b']  |
| [0,'c']  |
| [1,'d']  |
| [2,'e']  |
| [0,'f']  |
+----------+

how to convert it into a dataframe of tuples (with single column 'features')?

Answer 1

Try

my_df.map(lambda x: (x[0],x[1]))