Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] add text_similarity task support #486

Merged
merged 4 commits into from
Aug 1, 2022

Conversation

benwtrent
Copy link
Member

@benwtrent benwtrent commented Jul 11, 2022

Adds text_similarity task support. This is a cross-encoder transformer task where both sequences are given to the transformer at once.

According to 🤗 (or at least how the cross-encoder models are concerned) this is a sequence classification task with just one classification "label". But really, it isn't labeled at all and is more akin to a regression model.

related: elastic/elasticsearch#88439

@benwtrent benwtrent added enhancement New feature or request topic:NLP Issue or PR about NLP model support and eland_import_hub_model labels Jul 11, 2022
@benwtrent benwtrent changed the title [ML] add re_ranking task support [ML] add text_similarity task support Jul 14, 2022
@benwtrent benwtrent marked this pull request as ready for review July 14, 2022 19:21
Copy link

@dimitris-athanasiou dimitris-athanasiou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@benwtrent benwtrent merged commit a8c8726 into elastic:main Aug 1, 2022
@benwtrent benwtrent deleted the feature/ml-nlp-re-ranking branch August 1, 2022 13:04
@dzlab
Copy link

dzlab commented Aug 25, 2022

@benwtrent how is this can be used in eland directly? can you point to examples the same way with elasticsearch API here elastic/elasticsearch#88439

@dimitris-athanasiou
Copy link

@dzlab This is just about being able to upload a text_similarity model to elasticsearch. After that is done then you can interact with the model like in elastic/elasticsearch#88439.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request topic:NLP Issue or PR about NLP model support and eland_import_hub_model
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants