Is there any text similarity databse available for phrases?
$begingroup$
I want to train my application for phrase similarity. I want my model to predict similarity score for phrases as shown in below examples.
ex-
International Business Machines = I.B.M
Synergy Telecom = SynTel
Beam inc = Beam Incorporate
Sir J J Smith = Johnson Smith
Alex, Julia = J Alex
James B. D. Joshi = James Joshi
James Beaty, Jr. = Beaty
Is there any dataset available to train this type of model?
machine-learning deep-learning nlp natural-language-process
asked 11 hours ago
Mohit SainiMohit Saini
11
New contributor
Mohit Saini is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
add a comment |
$begingroup$
I want to train my application for phrase similarity. I want my model to predict similarity score for phrases as shown in below examples.
ex-
International Business Machines = I.B.M
Synergy Telecom = SynTel
Beam inc = Beam Incorporate
Sir J J Smith = Johnson Smith
Alex, Julia = J Alex
James B. D. Joshi = James Joshi
James Beaty, Jr. = Beaty
Is there any dataset available to train this type of model?
machine-learning deep-learning nlp natural-language-process
asked 11 hours ago
Mohit SainiMohit Saini
11
New contributor
Mohit Saini is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
$begingroup$
Can you please elaborate with an example of the prediction score you would want your model to predict? Is it going to be binary decision like similar(1) and not similar(0) OR you want percentage of similarity between given phrases?
$endgroup$
– Preet
10 hours ago
add a comment |
$begingroup$
I want to train my application for phrase similarity. I want my model to predict similarity score for phrases as shown in below examples.
ex-
International Business Machines = I.B.M
Synergy Telecom = SynTel
Beam inc = Beam Incorporate
Sir J J Smith = Johnson Smith
Alex, Julia = J Alex
James B. D. Joshi = James Joshi
James Beaty, Jr. = Beaty
Is there any dataset available to train this type of model?
machine-learning deep-learning nlp natural-language-process
asked 11 hours ago
Mohit SainiMohit Saini
11
New contributor
Mohit Saini is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
I want to train my application for phrase similarity. I want my model to predict similarity score for phrases as shown in below examples.
ex-
International Business Machines = I.B.M
Synergy Telecom = SynTel
Beam inc = Beam Incorporate
Sir J J Smith = Johnson Smith
Alex, Julia = J Alex
James B. D. Joshi = James Joshi
James Beaty, Jr. = Beaty
Is there any dataset available to train this type of model?
machine-learning deep-learning nlp natural-language-process
machine-learning deep-learning nlp natural-language-process
asked 11 hours ago
Mohit SainiMohit Saini
11
New contributor
Mohit Saini is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked 11 hours ago
Mohit SainiMohit Saini
11
New contributor
Mohit Saini is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked 11 hours ago
Mohit SainiMohit Saini
11
New contributor
Mohit Saini is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked 11 hours ago
Mohit SainiMohit Saini
11
asked 11 hours ago
Mohit SainiMohit Saini
11
11
New contributor
Mohit Saini is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
Mohit Saini is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
Mohit Saini is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$begingroup$
Can you please elaborate with an example of the prediction score you would want your model to predict? Is it going to be binary decision like similar(1) and not similar(0) OR you want percentage of similarity between given phrases?
$endgroup$
– Preet
10 hours ago
add a comment |
$begingroup$
Can you please elaborate with an example of the prediction score you would want your model to predict? Is it going to be binary decision like similar(1) and not similar(0) OR you want percentage of similarity between given phrases?
$endgroup$
– Preet
10 hours ago
$begingroup$
Can you please elaborate with an example of the prediction score you would want your model to predict? Is it going to be binary decision like similar(1) and not similar(0) OR you want percentage of similarity between given phrases?
$endgroup$
– Preet
10 hours ago
$begingroup$
Can you please elaborate with an example of the prediction score you would want your model to predict? Is it going to be binary decision like similar(1) and not similar(0) OR you want percentage of similarity between given phrases?
$endgroup$
– Preet
10 hours ago
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
This is a difficult problem, but definitely worth exploring.
An interesting resource to look into is DBpedia. It aims to extract structured information from the Wikipedia project. It is available under a free license (CC-BY-SA).
You can conveniently explore the project online, e.g.:
http://dbpedia.org/page/IBM- http://dbpedia.org/page/Beam_Suntory
Note that you are restricted to the extensive but ending knowledge on Wikipedia, for example Synergy Telecom/SynTel seems not to have an entry. Your creativity would be required to overcome this limitation.
answered 9 hours ago
SimonSimon
1464
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "557"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Mohit Saini is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f45335%2fis-there-any-text-similarity-databse-available-for-phrases%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
This is a difficult problem, but definitely worth exploring.
An interesting resource to look into is DBpedia. It aims to extract structured information from the Wikipedia project. It is available under a free license (CC-BY-SA).
You can conveniently explore the project online, e.g.:
http://dbpedia.org/page/IBM- http://dbpedia.org/page/Beam_Suntory
Note that you are restricted to the extensive but ending knowledge on Wikipedia, for example Synergy Telecom/SynTel seems not to have an entry. Your creativity would be required to overcome this limitation.
answered 9 hours ago
SimonSimon
1464
$endgroup$
add a comment |
$begingroup$
This is a difficult problem, but definitely worth exploring.
An interesting resource to look into is DBpedia. It aims to extract structured information from the Wikipedia project. It is available under a free license (CC-BY-SA).
You can conveniently explore the project online, e.g.:
http://dbpedia.org/page/IBM- http://dbpedia.org/page/Beam_Suntory
Note that you are restricted to the extensive but ending knowledge on Wikipedia, for example Synergy Telecom/SynTel seems not to have an entry. Your creativity would be required to overcome this limitation.
answered 9 hours ago
SimonSimon
1464
$endgroup$
add a comment |
$begingroup$
This is a difficult problem, but definitely worth exploring.
An interesting resource to look into is DBpedia. It aims to extract structured information from the Wikipedia project. It is available under a free license (CC-BY-SA).
You can conveniently explore the project online, e.g.:
http://dbpedia.org/page/IBM- http://dbpedia.org/page/Beam_Suntory
Note that you are restricted to the extensive but ending knowledge on Wikipedia, for example Synergy Telecom/SynTel seems not to have an entry. Your creativity would be required to overcome this limitation.
answered 9 hours ago
SimonSimon
1464
$endgroup$
This is a difficult problem, but definitely worth exploring.
An interesting resource to look into is DBpedia. It aims to extract structured information from the Wikipedia project. It is available under a free license (CC-BY-SA).
You can conveniently explore the project online, e.g.:
http://dbpedia.org/page/IBM- http://dbpedia.org/page/Beam_Suntory
Note that you are restricted to the extensive but ending knowledge on Wikipedia, for example Synergy Telecom/SynTel seems not to have an entry. Your creativity would be required to overcome this limitation.
answered 9 hours ago
SimonSimon
1464
answered 9 hours ago
SimonSimon
1464
answered 9 hours ago
SimonSimon
1464
answered 9 hours ago
SimonSimon
1464
1464
add a comment |
add a comment |
Mohit Saini is a new contributor. Be nice, and check out our Code of Conduct.
Mohit Saini is a new contributor. Be nice, and check out our Code of Conduct.
Mohit Saini is a new contributor. Be nice, and check out our Code of Conduct.
Mohit Saini is a new contributor. Be nice, and check out our Code of Conduct.
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f45335%2fis-there-any-text-similarity-databse-available-for-phrases%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
Can you please elaborate with an example of the prediction score you would want your model to predict? Is it going to be binary decision like similar(1) and not similar(0) OR you want percentage of similarity between given phrases?
$endgroup$
– Preet
10 hours ago