Analytics using Presto, Trino, and Hive on Amazon EMR
If you recall from Chapter 5, we introduced Amazon EMR as one of the services for processing big data. EMR has over 25 open source projects, and we went through a use case where Apache Spark in EMR was leveraged to solve a data processing problem. EMR also has a few projects that assist in ad hoc query execution and allow users to interactively executive SQL queries to get the data stored in the S3 data lake. Let’s shed some light on these projects.
Presto/Trino
Presto is an open source project that provides a fast analytics query execution engine for data stored in many types of storage, most commonly used with data stored in data lakes. Presto, also known as PrestoDB, was first created on Facebook. In 2019, Presto development eventually forked into two, with PrestoDB and PrestoSQL. To keep the name confusion at a minimum, PrestoSQL was renamed Trino in 2020.
Amazon EMR supports both PrestoDB and Trino. Organizations...