Question 1

A distributed team of data analysts share computing resources on an interactive cluster with autoscaling configured. In order to better manage costs and query throughput, the workspace administrator is hoping to evaluate whether cluster upscaling is caused by many concurrent users or resource-intensive queries. In which location can one review the timeline for cluster resizing events?

Options :

A : Workspace audit logs

B : Driver-s log file

C : Ganglia

D : Cluster Event Log

E : Executor-s log file

Answer: D

Question 2

Which statement describes Delta Lake optimized writes?

Options :

A : Before a Jobs cluster terminates, OPTIMIZE is executed on all tables modified during the most recent job.

B : An asynchronous job runs after the write completes to detect if files could be further compacted; if yes, an OPTIMIZE job is executed toward a default of 1 GB.

C : Data is queued in a messaging bus instead of committing data directly to memory; all data is committed from the messaging bus in one batch once the job is complete.

D : Optimized writes use logical partitions instead of directory partitions; because partition boundaries are only represented in metadata, fewer small files are written.

E : A shuffle occurs prior to writing to try to group similar data together resulting in fewer files instead of each executor writing multiple files based on directory partitions.

Answer: E

Question 3

Which of the following statements regarding the retention policy of Delta lake CDF is correct ?

Options :

A : Running the VACUUM command on the table deletes CDF data as well

B : Running the VACUUM command on the table does not deletes CDF data

C : Running the VACUUM command on the table does not deletes CDF data unless CASCADE clause is set to true

D : CDF data files can be purged by running VACUUM CHANGES command

E : CDF data files can never be permanently purged from Delta Lake

Answer: A

Question 4

A user new to Databricks is trying to troubleshoot long execution times for some pipeline logic they are working on. Presently, the user is executing code cell-by-cell, using display() calls to confirm code is producing the logically correct results as new transformations are added to an operation. To get a measure of average time to execute, the user is running each cell multiple times interactively. Which of the following adjustments will get a more accurate measure of how code is likely to perform in production?

Options :

A : Scala is the only language that can be accurately tested using interactive notebooks; because the best performance is achieved by using Scala code compiled to JARs, all PySpark and Spark SQL logic should be refactored.

B : The only way to meaningfully troubleshoot code execution times in development notebooks Is to use production-sized data and production-sized clusters with Run All execution.

C : Production code development should only be done using an IDE; executing code against a local build of open source Spark and Delta Lake will provide the most accurate benchmarks for how code will perform in production.

D : Calling display() forces a job to trigger, while many transformations will only add to the logical query plan; because of caching, repeated execution of the same logic does not provide meaningful results.

E : The Jobs UI should be leveraged to occasionally run the notebook as a job and track execution time during incremental code development because Photon can only be enabled on clusters launched for scheduled jobs.

Answer: D

Question 5

The data engineering team is using the LOCATION keyword for every new Delta Lake table created in the Lakehouse.

Which of the following describes the purpose of using the LOCATION keyword in this case ?

Options :

A : The LOCATION keyword is used to configure the created Delta Lake tables as managed tables.

B : The LOCATION keyword is used to configure the created Delta Lake tables as external tables.

C : The LOCATION keyword is used to define the created Delta Lake tables in an external database.

D : The LOCATION keyword is used to define the created Delta Lake tables in a database over a JDBC connection.

E : The LOCATION keyword is used to set a default schema and checkpoint location for the created Delta Lake tables.

Answer: B

Higher Test Marks with Free Online Databricks-Certified-Professional-Data-Engineer Exam Practice

Buying Options: