Google Data Engineer Sample Questions:

1. Which of these is not a supported method of putting data into a partitioned table?

A) Use ORDER BY to put a table's rows into chronological order and then change the table's type to "Partitioned".
B) If you have existing data in a separate file for each day, then create a partitioned table and upload each file into the appropriate partition.
C) Create a partitioned table and stream new records to it every day.
D) Run a query to get the records for a specific day from an existing table and for the destination table, specify a partitioned table ending with the day in the format "$YYYYMMDD".

2. Your company produces 20,000 files every hour. Each data file is formatted as a comma separated values (CSV) file that is less than 4 KB. All files must be ingested on Google Cloud Platform before they can be processed. Your company site has a 200 ms latency to Google Cloud, and your Internet connection bandwidth is limited as 50 Mbps. You currently deploy a secure FTP (SFTP) server on a virtual machine in Google Compute Engine as the data ingestion point. A local SFTP client runs on a dedicated machine to transmit the CSV files as is. The goal is to make reports with data from the previous day available to the executives by 10:00 a.m. each day. This design is barely able to keep up with the current volume, even though the bandwidth utilization is rather low.
You are told that due to seasonality, your company expects the number of files to double for the next three months. Which two actions should you take? (choose two.)

A) Redesign the data ingestion process to use gsutil tool to send the CSV files to a storage bucket in parallel.
B) Introduce data compression for each file to increase the rate file of file transfer.
C) Transmit the TAR files instead, and disassemble the CSV files in the cloud upon receiving them.
D) Create an S3-compatible storage endpoint in your network, and use Google Cloud Storage Transfer Service to transfer on-premices data to the designated storage bucket.
E) Contact your internet service provider (ISP) to increase your maximum bandwidth to at least 100 Mbps.
F) Assemble 1,000 files into a tape archive (TAR) fil

3. You have enabled the free integration between Firebase Analytics and Google BigQuery. Firebase now automatically creates a new table daily in BigQuery in the format app_events_YYYYMMDD. You want to query all of the tables for the past 30 days in legacy SQL. What should you do?

A) Use the WHERE_PARTITIONTIME pseudo column
B) Use WHERE date BETWEEN YYYY-MM-DD AND YYYY-MM-DD
C) Use the TABLE_DATE_RANGE function
D) Use SELECT IF.(date >= YYYY-MM-DD AND date <= YYYY-MM-DD

4. You are designing storage for two relational tables that are part of a 10-TB database on Google Cloud. You want to support transactions that scale horizontally. You also want to optimize data for range queries on nonkey columns. What should you do?

A) Add secondary indexes to support query patterns.
B) Use Cloud SQL for storag
C) Use Cloud Dataflow to transform data to support query patterns.
D) Use Cloud Dataflow to transform data to support query patterns.
E) Use Cloud Spanner for storag
F) Use Cloud SQL for storag
G) Add secondary indexes to support query patterns.
H) Use Cloud Spanner for storag

5. When using Cloud Dataproc clusters, you can access the YARN web interface by configuring a browser to connect through a proxy.

A) HTTP
B) HTTPS
C) VPN
D) SOCKS

Solutions: