Exploring data loading techniques

There are various ways to ingest data into BigQuery. Data loading can be broken up into a few approaches: batch, streaming, and scheduled. Data load jobs can be executed via the console, the bq command-line interface, the API, other Google Cloud service integrations, and scheduled jobs. In this section, we will discuss each approach to help you understand the best data loading technique to get started and establish a data loading strategy for one-time or regular ingestion and analysis.

Batch loading data

Batch loading or bounded data is a process of loading data into BigQuery in a single operation. This can be done from a variety of sources, including files located in Google Cloud Storage or Google Drive, and local files. Acceptable file types include CSV, JSON, Apache Avro, ORC, and Apache Parquet formats. Batch loading is typically driven through the console UI, automated via API, or via scheduled jobs.

When loading data from a source, you...