Databricks Databricks-Certified-Professional-Data-Engineer Exam Syllabus Topics:
| Topic | Details |
|---|---|
| Topic 1 |
|
| Topic 2 |
|
| Topic 3 |
|
| Topic 4 |
|
| Topic 5 |
|
Reference: https://www.databricks.com/learn/certification/data-engineer-professional
Databricks Certified Professional Data Engineer Sample Questions:
Question #1
A table named user_ltv is being used to create a view that will be used by data analysts on various teams. Users in the workspace are configured into groups, which are used for setting up data access using ACLs.
The user_ltv table has the following schema:
email STRING, age INT, ltv INT
The following view definition is executed:
An analyst who is not a member of the marketing group executes the following query:
SELECT * FROM email_ltv
Which statement describes the results returned by this query?
A. The email and ltv columns will be returned with the values in user itv.
B. Only the email and ltv columns will be returned; the email column will contain the string "REDACTED" in each row.
C. Three columns will be returned, but one column will be named "redacted" and contain only null values.
D. Only the email and itv columns will be returned; the email column will contain all null values.
E. The email, age. and ltv columns will be returned with the values in user ltv.
Question #2
Which approach demonstrates a modular and testable way to use DataFrame transform for ETL code in PySpark?
A. class Pipeline:
def transform(self, df):
return df.withColumn("value_upper", upper(col("value")))
pipeline = Pipeline()
assertDataFrameEqual(pipeline.transform(test_input), expected)
B. def upper_transform(df):
return df.withColumn("value_upper", upper(col("value")))
actual = test_input.transform(upper_transform)
assertDataFrameEqual(actual, expected)
C. def transform_data(input_df):
# transformation logic here
return output_df
test_input = spark.createDataFrame([(1, "a")], ["id", "value"])
assertDataFrameEqual(transform_data(test_input), expected)
D. def upper_value(df):
return df.withColumn("value_upper", upper(col("value")))
def filter_positive(df):
return df.filter(df["id"] > 0)
pipeline_df = df.transform(upper_value).transform(filter_positive)
Question #3
When monitoring a complex workload, the ability to view the query plan is critical for understanding what the workload is doing.
Where is the query-plan visualization located?
A. In the Spark UI, under the SQL/DataFrame tab.
B. In the Spark UI, under the Jobs tab.
C. In the Query Profiler, under Query Source.
D. In the Query Profiler, under the Stages tab.
Question #4
The data engineering team has configured a job to process customer requests to be forgotten (have their data deleted). All user data that needs to be deleted is stored in Delta Lake tables using default table settings.
The team has decided to process all deletions from the previous week as a batch job at 1am each Sunday. The total duration of this job is less than one hour. Every Monday at 3am, a batch job executes a series of VACUUM commands on all Delta Lake tables throughout the organization.
The compliance officer has recently learned about Delta Lake's time travel functionality. They are concerned that this might allow continued access to deleted data.
Assuming all delete logic is correctly implemented, which statement correctly addresses this concern?
A. Because the default data retention threshold is 24 hours, data files containing deleted records will be retained until the vacuum job is run the following day.
B. Because Delta Lake time travel provides full access to the entire history of a table, deleted records can always be recreated by users with full admin privileges.
C. Because the default data retention threshold is 7 days, data files containing deleted records will be retained until the vacuum job is run 8 days later.
D. Because the vacuum command permanently deletes all files containing deleted records, deleted records may be accessible with time travel for around 24 hours.
E. Because Delta Lake's delete statements have ACID guarantees, deleted records will be permanently purged from all storage systems as soon as a delete job completes.
Question #5
A data engineer is designing an append-only pipeline that needs to handle both batch and streaming data in Delta Lake. The team wants to ensure that the streaming component can efficiently track which data has already been processed.
Which configuration should be set to enable this?
A. mergeSchema
B. checkpointLocation
C. overwriteSchema
D. partitionBy
Solutions:
| Question #1 Correct Answer: B | Question #2 Correct Answer: D | Question #3 Correct Answer: A | Question #4 Correct Answer: C | Question #5 Correct Answer: B |














1201 Customer Reviews
Quality and ValueITCertKing Practice Exams are written to the highest standards of technical accuracy, using only certified subject matter experts and published authors for development - no all study materials.
Tested and ApprovedWe are committed to the process of vendor and third party approvals. We believe professionals and executives alike deserve the confidence of quality coverage these authorizations provide.
Easy to PassIf you prepare for the exams using our ITCertKing testing engine, It is easy to succeed for all certifications in the first attempt. You don't have to deal with all dumps or any free torrent / rapidshare all stuff.
Try Before BuyITCertKing offers free demo of each product. You can check out the interface, question quality and usability of our practice exams before you decide to buy.
