-
Notifications
You must be signed in to change notification settings - Fork 2.2k
[Feature][elasticsearch-connector] support elasticsearch sql source #8895
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature][elasticsearch-connector] support elasticsearch sql source #8895
Conversation
| ``` | ||
|
|
||
| 案例六 : sql 方式查询 | ||
| notes: sql does not support map and array types |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please use chinese here.
| public static final Option<String> SEARCH_TYPE = | ||
| Options.key("search_type") | ||
| .stringType() | ||
| .defaultValue("dsl") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
use enum?
| * See the License for the specific language governing permissions and | ||
| * limitations under the License. | ||
| */ | ||
| package org.apache.seatunnel.connectors.seatunnel.elasticsearch.dto.source; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| package org.apache.seatunnel.connectors.seatunnel.elasticsearch.dto.source; | |
| package org.apache.seatunnel.connectors.seatunnel.elasticsearch.client; |
| cursorSearchResult(seaTunnelRowType, sourceIndexInfo, output); | ||
| } else { | ||
| scrollSearchResult(seaTunnelRowType, sourceIndexInfo, output); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
what's different between cursorSearchResult and scrollSearchResult? Can we merge it?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
…' into feature-elasticsearch-sql-search
Hisoka-X
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @CosmosNi . LGTM except one minior problem.
| Deque<ElasticsearchSourceSplit> splits = new LinkedList<>(); | ||
| boolean noMoreSplit; | ||
|
|
||
| private final String SQL_TYPE = "sql"; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
useless?
close #8894
Purpose of this pull request
Does this PR introduce any user-facing change?
How was this patch tested?
Check list
New License Guide
release-note.