Question 1

Which of the following is a viable way to improve Spark's performance when dealing with large amounts of data, given that there is only a single application running on the cluster?

Options :

A : Increase values for the properties spark.default.parallelism and spark.sql.shuffle.partitions

B : Decrease values for the properties spark.default.parallelism and spark.sql.partitions

C : Increase values for the properties spark.sql.parallelism and spark.sql.partitions

D : Increase values for the properties spark.sql.parallelism and spark.sql.shuffle.partitions

E : Increase values for the properties spark.dynamicAllocation.maxExecutors, spark.default.parallelism, and spark.sql.shuffle.partitions

Answer: A

Question 2

Which of the following code blocks creates a new DataFrame with two columns season and wind_speed_ms where column season is of data type string and column wind_speed_ms is of data type double?

Options :

A : spark.DataFrame({"season": ["winter","summer"], "wind_speed_ms": [4.5, 7.5]})

B : spark.createDataFrame([("summer", 4.5), ("winter", 7.5)], ["season", "wind_speed_ms"])

C :

1. from pyspark.sql import types as T

2. spark.createDataFrame((("summer", 4.5), ("winter", 7.5)), T.StructType([T.StructField("season",

T.CharType()), T.StructField("season", T.DoubleType())]))

D : spark.newDataFrame([("summer", 4.5), ("winter", 7.5)], ["season", "wind_speed_ms"])

E : spark.createDataFrame({"season": ["winter","summer"], "wind_speed_ms": [4.5, 7.5]})

Answer: B

Question 3

Which property is used to to allocates jobs to different resource pools to achieve resources scheduling within an application ?

Options :

A : Fair Scheduler

B : Dynamic allocation

C : There is no need to set a property since spark is by default capable of resizing

Answer: A

Question 4

Which of the following code blocks efficiently converts DataFrame transactionsDf from 12 into 24 partitions?

Options :

A : transactionsDf.repartition(24, boost=True)

B : transactionsDf.repartition()

C : transactionsDf.repartition("itemId", 24)

D : transactionsDf.coalesce(24)

E : transactionsDf.repartition(24)

Answer: A

Question 5

Which of the following is correct for the cluster manager ?

Options :

A : Executes code assigned to it.

B : Keeps track of the resources available.

C :

It is interchangeable with job.

D : Reports the state of the computation back to the driver.

E : All of the answers are correct.

Answer: B

Higher Test Marks with Free Online Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 Exam Practice

Buying Options: