Letting Acero do the work for you
There are three basic concepts to think about when working with Acero before we get to execution plans:
- Input shaping: Describing the shape of your input when calling a function
- Value casting: Ensuring compatible data types between arguments when calling a function
- Types of functions: What kind of function are you looking for: scalar, aggregation, or vector
Let’s quickly dig into each of these so you can see how they affect writing the code to use the computations.
Important!
Not all language implementations of the Arrow libraries currently provide a Compute API. The primary libraries that expose it are the C++, Python, and R libraries, while the level of support for the compute library varies in the other language implementations. For instance, the Go implementation contains a compute package but doesn’t have all the same functions that exist in Acero for the C++, Python, and R libraries. Consider the possibility...