Using Vowpal Wabbit for NER
$begingroup$
The Vowpal Wabbit (VW) apparently supports sequence tagging functionality via SEARN. The problem is that I cannot find anywhere detailed parameter list with explanations and with some examples. The best I could find is Zinkov's blog entry with a very short example. The main wiki page barely mentions SEARN.
In the checked out source code I found demo folder with some NER sample data. Unfortunately, the script running all the tests does not show how to run on this data. At least it was informative enough to see what is the expected format: almost the same as standard VW data format, except that entries are separated by blank lines (this is important).
My current understanding is to run the following command:
cat train.txt | vw -c --passes 10 --searn 25 --searn_task sequence
--searn_passes_per_policy 2 -b 30 -f twpos.vw
where
--searn 25 - the total number of NER labels (?)
--searn_task sequence - sequence tagging task (?)
--searn_passes_per_policy 2 - not clear what it does
Other parameters are standard to VW and need no additional explanation. Perhaps there are more parameters specific to SEARN? What is their importance and impact? How to tune them? Any rules of thumb?
Any pointers to examples will be appreciated.
machine-learning nlp
edited Nov 26 '17 at 3:05
Brian Spiering
4,2881129
asked Jun 6 '15 at 7:00
Vladislavs DovgalecsVladislavs Dovgalecs
35127
$endgroup$
bumped to the homepage by Community♦ 24 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
$begingroup$
The Vowpal Wabbit (VW) apparently supports sequence tagging functionality via SEARN. The problem is that I cannot find anywhere detailed parameter list with explanations and with some examples. The best I could find is Zinkov's blog entry with a very short example. The main wiki page barely mentions SEARN.
In the checked out source code I found demo folder with some NER sample data. Unfortunately, the script running all the tests does not show how to run on this data. At least it was informative enough to see what is the expected format: almost the same as standard VW data format, except that entries are separated by blank lines (this is important).
My current understanding is to run the following command:
cat train.txt | vw -c --passes 10 --searn 25 --searn_task sequence
--searn_passes_per_policy 2 -b 30 -f twpos.vw
where
--searn 25 - the total number of NER labels (?)
--searn_task sequence - sequence tagging task (?)
--searn_passes_per_policy 2 - not clear what it does
Other parameters are standard to VW and need no additional explanation. Perhaps there are more parameters specific to SEARN? What is their importance and impact? How to tune them? Any rules of thumb?
Any pointers to examples will be appreciated.
machine-learning nlp
edited Nov 26 '17 at 3:05
Brian Spiering
4,2881129
asked Jun 6 '15 at 7:00
Vladislavs DovgalecsVladislavs Dovgalecs
35127
$endgroup$
bumped to the homepage by Community♦ 24 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
$begingroup$
The Vowpal Wabbit (VW) apparently supports sequence tagging functionality via SEARN. The problem is that I cannot find anywhere detailed parameter list with explanations and with some examples. The best I could find is Zinkov's blog entry with a very short example. The main wiki page barely mentions SEARN.
In the checked out source code I found demo folder with some NER sample data. Unfortunately, the script running all the tests does not show how to run on this data. At least it was informative enough to see what is the expected format: almost the same as standard VW data format, except that entries are separated by blank lines (this is important).
My current understanding is to run the following command:
cat train.txt | vw -c --passes 10 --searn 25 --searn_task sequence
--searn_passes_per_policy 2 -b 30 -f twpos.vw
where
--searn 25 - the total number of NER labels (?)
--searn_task sequence - sequence tagging task (?)
--searn_passes_per_policy 2 - not clear what it does
Other parameters are standard to VW and need no additional explanation. Perhaps there are more parameters specific to SEARN? What is their importance and impact? How to tune them? Any rules of thumb?
Any pointers to examples will be appreciated.
machine-learning nlp
edited Nov 26 '17 at 3:05
Brian Spiering
4,2881129
asked Jun 6 '15 at 7:00
Vladislavs DovgalecsVladislavs Dovgalecs
35127
$endgroup$
The Vowpal Wabbit (VW) apparently supports sequence tagging functionality via SEARN. The problem is that I cannot find anywhere detailed parameter list with explanations and with some examples. The best I could find is Zinkov's blog entry with a very short example. The main wiki page barely mentions SEARN.
In the checked out source code I found demo folder with some NER sample data. Unfortunately, the script running all the tests does not show how to run on this data. At least it was informative enough to see what is the expected format: almost the same as standard VW data format, except that entries are separated by blank lines (this is important).
My current understanding is to run the following command:
cat train.txt | vw -c --passes 10 --searn 25 --searn_task sequence
--searn_passes_per_policy 2 -b 30 -f twpos.vw
where
--searn 25 - the total number of NER labels (?)
--searn_task sequence - sequence tagging task (?)
--searn_passes_per_policy 2 - not clear what it does
Other parameters are standard to VW and need no additional explanation. Perhaps there are more parameters specific to SEARN? What is their importance and impact? How to tune them? Any rules of thumb?
Any pointers to examples will be appreciated.
machine-learning nlp
machine-learning nlp
edited Nov 26 '17 at 3:05
Brian Spiering
4,2881129
asked Jun 6 '15 at 7:00
Vladislavs DovgalecsVladislavs Dovgalecs
35127
edited Nov 26 '17 at 3:05
Brian Spiering
4,2881129
asked Jun 6 '15 at 7:00
Vladislavs DovgalecsVladislavs Dovgalecs
35127
edited Nov 26 '17 at 3:05
Brian Spiering
4,2881129
edited Nov 26 '17 at 3:05
Brian Spiering
4,2881129
edited Nov 26 '17 at 3:05
Brian Spiering
4,2881129
4,2881129
asked Jun 6 '15 at 7:00
Vladislavs DovgalecsVladislavs Dovgalecs
35127
asked Jun 6 '15 at 7:00
Vladislavs DovgalecsVladislavs Dovgalecs
35127
asked Jun 6 '15 at 7:00
Vladislavs DovgalecsVladislavs Dovgalecs
35127
35127
bumped to the homepage by Community♦ 24 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
bumped to the homepage by Community♦ 24 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
John Langford's documentation on GitHub could help. You can find something on the Learning to Search Sub System page.
answered Nov 26 '17 at 3:07
Brian SpieringBrian Spiering
4,2881129
$endgroup$
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "557"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f6030%2fusing-vowpal-wabbit-for-ner%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
John Langford's documentation on GitHub could help. You can find something on the Learning to Search Sub System page.
answered Nov 26 '17 at 3:07
Brian SpieringBrian Spiering
4,2881129
$endgroup$
add a comment |
$begingroup$
John Langford's documentation on GitHub could help. You can find something on the Learning to Search Sub System page.
answered Nov 26 '17 at 3:07
Brian SpieringBrian Spiering
4,2881129
$endgroup$
add a comment |
$begingroup$
John Langford's documentation on GitHub could help. You can find something on the Learning to Search Sub System page.
answered Nov 26 '17 at 3:07
Brian SpieringBrian Spiering
4,2881129
$endgroup$
John Langford's documentation on GitHub could help. You can find something on the Learning to Search Sub System page.
answered Nov 26 '17 at 3:07
Brian SpieringBrian Spiering
4,2881129
answered Nov 26 '17 at 3:07
Brian SpieringBrian Spiering
4,2881129
answered Nov 26 '17 at 3:07
Brian SpieringBrian Spiering
4,2881129
answered Nov 26 '17 at 3:07
Brian SpieringBrian Spiering
4,2881129
4,2881129
add a comment |
add a comment |
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f6030%2fusing-vowpal-wabbit-for-ner%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
