How Spark SQL evaluate our Expressions

There are different evaluation paths in Spark SQL:

  • Interpreted. Expressions are evaluated using an eval(…) method. Plans are evaluated using iterators (volcano model). 
  • Expression Codegenerated. This means that all expressions are evaluated using a code generated function. Plans are evaluated using iterators.
  • Wholestafe Codegenerated. All expressions and most plans are evaluated using code generation.

For more information:

9 Mart 2017

Posted In: apache, apache spark, apache spark sql, dataframe, scala, spark, spark sql, sql

Twitter Auto Publish Powered By :