How Spark SQL evaluate our Expressions

There are different evaluation paths in Spark SQL:

  • Interpreted. Expressions are evaluated using an eval(…) method. Plans are evaluated using iterators (volcano model). 
  • Expression Codegenerated. This means that all expressions are evaluated using a code generated function. Plans are evaluated using iterators.
  • Wholestafe Codegenerated. All expressions and most plans are evaluated using code generation.

For more information: https://issues.apache.org/jira/browse/SPARK-17728

9 Mart 2017

Posted In: apache, apache spark, apache spark sql, dataframe, scala, spark, spark sql, sql

Twitter Auto Publish Powered By : XYZScripts.com