The usual Qlik in-memory approach does a really good job of handling usual datasets (millions of records). Obtaining the answer in a sub-second upon user selection is a regular experience.
Qlik Indexing Engine (QIX) is Qlik's patented in-memory data-indexing technology. This approach loads and keeps the user dataset (databases, files, and data lakes extracts) in server memory. It does this using a compression algorithm that can compress data down to 10% of original data. Let's understand how this works; while the data is being loaded by your script or data manager internally, Qlik engine creates some tables to accommodate your data. First, Qlik creates a symbol table for each field with two fields (pointer and value); then the engine loads only distinct values to this table and creates a pointer with the smallest bit representation...
