AIRBNB DATA INFRA Airflow...

AIRBNB DATA INFRA Airflow Scheduling ? Kafka Event Logs Gold Hive Cluster Replication Silver Hive Cluster Spark Cluster Sooop MySQL Dumps HDFS HDFS S3 ?? ?? Presto Cluster Figure 1: Airbnb's data infrastructure in 2016. A Airpal Panoramix Tableau

Thanks for your feedback!

Consider Airbnb's data infrastructure in Figure 1. Figure 1: Airbnb's data infrastructure in 2016. 1. Identify which technology provides large-scale storage in these architectures? All that apply. (1) 1. MySQL 2. Spark Cluster 3. S3 4. HDFS 2. Which technology could be used for ETL and ML tasks? Select one. (1) 1. Presto 2. Spark 3. Hive 4. Tableau 3. Which technology is used for ad hoc queries? Select one. (1) 1. Presto 2. Spark 3. Hive 4. MySQL 4. Suppose you were to migrate this infrastructure to Google Cloud and used managed services to underpin your existing pipelines and data. What would you choose to replace the DAG scheduler? (1) 1. Dataproc 2. Google Compute Engine 3. Google PubSub 4. Cloud Composer 5. How do data that are migrated from HDFS to S3 remain accessible for queries from Spark and Presto? (1) 1. Hive metastore and external tables 2. Airflow metadata with data lineage graph 3. An always-on Spark cluster maintains temp tables AIRBNBDATAINFRA Airflow Scheduling Event Logs Kafka Gold Silver Hive Cluster Hive Cluster Replicator Spark Cluster MySQL Dumps Socop HDFS HDFS S3 A Airpal Panoramix Tableau Presto Cluster Figure 1: Airbnb's data infrastructure in 2016.

Play audio

Feedback

Question

AIRBNB DATA INFRA Airflow Scheduling ? Kafka Event Logs Gold Hive Cluster Replication Silver Hive Cluster Spark Cluster Sooop MySQL Dumps HDFS HDFS S3 ?? ?? Presto Cluster Figure 1: Airbnb's data infrastructure in 2016. A Airpal Panoramix Tableau

Please give Ace some feedback