[flink] Delta Join additional IT tests and docs improvement #2268
+709
−9
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Purpose
Linked issue: close #2231
Add comprehensive test coverage for Delta Join feature in Flink 2.2 and improve documentation.
Brief change log
table.delete.behavior=IGNORE(not justfirst_rowmerge engine)Tests
testDeltaJoinWithPrimaryKeyTableNoDeletes- normal PK table withdelete.behavior=IGNOREtestDeltaJoinOnBucketKey- join on bucket key onlytestDeltaJoinFailsWhenFilterOnNonUpsertKeys- filter on non-upsert-key columns failstestDeltaJoinOnBucketKey- join on bucket key only (not full PK)testDeltaJoinFailsWhenSourceHasDelete- source with DELETE records failstestDeltaJoinFailsWhenJoinKeyNotContainIndex- join key not containing index failtestDeltaJoinFailsWithLeftJoin- LEFT JOIN wouldn't be converted to DeltaJointestDeltaJoinFailsWithRightJoin- RIGHT JOIN wouldn't be converted to DeltaJointestDeltaJoinFailsWithFullOuterJoin- FULL OUTER JOIN wouldn't be converted to DeltaJointestDeltaJoinFailsWithCascadeJoin- cascade join wouldn't be converted to DeltaJoinAPI and Format
No
Documentation
Yes - updated
docs/engine-flink/delta-joins.mdin Flink 2.2 part.