Converting dyf to df and vice versa maybe expensive since the process involves reading the data , schema all over again. The expensiveness get defined by the size and type of data etc.

The reason I am using Glue notebook here is only because I had one up and running at the time. The sole reason for this article was to outline AWS Glue builtin transformations