== Physical Plan ==
Union (8)
:- * Project (4)
: +- * Filter (3)
: +- * ColumnarToRow (2)
: +- Scan parquet (1)
+- * Project (7)
+- * Filter (6)
+- Scan json (5)
(1) Scan parquet
Output [4]: [metaData#1101220, protocol#1101221, commitInfo#1101222, version#1101223L]
Batched: true
Location: DeltaLogFileIndex [hdlfs://ced12e6d-bca7-47af-9525-449cba9023d7.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit/_delta_log/00000000000000000300.checkpoint.parquet]
PushedFilters: [Or(IsNotNull(protocol.minReaderVersion),IsNotNull(metaData.id))]
ReadSchema: struct<metaData:struct<id:string,name:string,description:string,format:struct<provider:string,options:map<string,string>>,schemaString:string,partitionColumns:array<string>,configuration:map<string,string>,createdTime:bigint>,protocol:struct<minReaderVersion:int,minWriterVersion:int,readerFeatures:array<string>,writerFeatures:array<string>>,commitInfo:struct<inCommitTimestamp:bigint>>
(2) ColumnarToRow [codegen id : 1]
Input [4]: [metaData#1101220, protocol#1101221, commitInfo#1101222, version#1101223L]
(3) Filter [codegen id : 1]
Input [4]: [metaData#1101220, protocol#1101221, commitInfo#1101222, version#1101223L]
Condition : (isnotnull(protocol#1101221.minReaderVersion) OR isnotnull(metaData#1101220.id))
(4) Project [codegen id : 1]
Output [4]: [protocol#1101221, metaData#1101220, commitInfo#1101222.inCommitTimestamp AS inCommitTimestamp#1101247L, 300 AS version#1101236L]
Input [4]: [metaData#1101220, protocol#1101221, commitInfo#1101222, version#1101223L]
(5) Scan json
Output [4]: [metaData#1101238, protocol#1101239, commitInfo#1101240, version#1101241L]
Batched: false
Location: DeltaLogFileIndex [hdlfs://ced12e6d-bca7-47af-9525-449cba9023d7.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit/_delta_log/00000000000000000301.json, ... 7 entries]
ReadSchema: struct<metaData:struct<id:string,name:string,description:string,format:struct<provider:string,options:map<string,string>>,schemaString:string,partitionColumns:array<string>,configuration:map<string,string>,createdTime:bigint>,protocol:struct<minReaderVersion:int,minWriterVersion:int,readerFeatures:array<string>,writerFeatures:array<string>>,commitInfo:struct<version:bigint,inCommitTimestamp:bigint,timestamp:timestamp,userId:string,userName:string,operation:string,operationParameters:map<string,string>,job:struct<jobId:string,jobName:string,jobRunId:string,runId:string,jobOwnerId:string,triggerType:string>,notebook:struct<notebookId:string>,clusterId:string,readVersion:bigint,isolationLevel:string,isBlindAppend:boolean,operationMetrics:map<string,string>,userMetadata:string,tags:map<string,string>,engineInfo:string,txnId:string>>
(6) Filter [codegen id : 2]
Input [4]: [metaData#1101238, protocol#1101239, commitInfo#1101240, version#1101241L]
Condition : ((isnotnull(protocol#1101239.minReaderVersion) OR isnotnull(metaData#1101238.id)) OR (isnotnull(commitInfo#1101240.inCommitTimestamp) AND (version#1101241L = 308)))
(7) Project [codegen id : 2]
Output [4]: [protocol#1101239, metaData#1101238, commitInfo#1101240.inCommitTimestamp AS inCommitTimestamp#1101262L, version#1101241L]
Input [4]: [metaData#1101238, protocol#1101239, commitInfo#1101240, version#1101241L]
(8) Union