Understanding Arrow Database Connectivity (ADBC)
In several of the previous chapters, we covered a bunch of different ways to use Apache Arrow for processing and interacting with data. We even covered how you can utilize some of the Arrow libraries (such as the Dataset library) to fetch and analyze that data. But if you work with data in your day-to-day job, there’s something we haven’t been able to get away from: Structured Query Language (SQL).
SQL is still the go-to standard way that most people interact with databases, but what about connecting to those databases? With an ever-changing ecosystem of new database systems popping up all over the place, engineers constantly need to manage a multitude of connectors for these various systems. If this is something you’ve dealt with before, then you understand the chaos and headaches this can cause.
A few standards are commonly used to make this easier, with various pros and cons for each of them. This chapter...
