Imagining the future – a look at emerging trends
Technology seems to progress at an increasing velocity. For decades, relational databases from vendors such as Oracle were the primary technology for managing all data. Today, there is a wide range of different database types that can be used, depending on the use case (such as graph databases for highly connected datasets, or NoSQL databases for low-latency reading and writing for very large tables).
It was also not all that long ago that Hadoop MapReduce was the state-of-the-art technology for processing very large datasets, but today, most new projects would choose Apache Spark over a MapReduce implementation. And even Apache Spark itself has progressed from its initial release, with Spark 3.0 being released in June 2020. We have also seen the introduction of Spark Streaming, Spark ML, and Spark GraphX for different use cases.
No one can tell for certain what the next big thing will be, but in this section, we will...
