You are designing an Apache Beam pipeline to enrich data from Cloud Pub/Sub with static reference data from BigQuery. The reference data is small enough to fit in memory on a single worker. The pipeline should write enriched results to BigQuery for analysis. Which job type and transforms should this pipeline use?
A. Batch job, PubSubIO, side-inputs B. Streaming job, PubSubIO, JdbcIO, side-outputs C. Streaming job, PubSubIO, BigQueryIO, side-inputs D. Streaming job, PubSubIO, BigQueryIO, side-outputs
This is a question from a mock test I tried for GCP data engineering. I feel the answer is C. But as per the portal the right answer is A. Can some one please give me a clarification on this. Thanks
