Supervised learning for a turn-based game?
$begingroup$
So I have 4GB of turn-by-turn data for many games of a particular strategy game. It appears that most people interested in using ML to build an AI for turn-based games use reinforcement learning to build a model on the fly.
Since I already have really good data, can I use supervised learning to solve this task?
EDIT: I was considering using regression to assign a score to a given action based on its likelihood of eventually resulting in a win; is this the right way to think about it?
supervised-learning game
asked yesterday
user6118986user6118986
111
New contributor
user6118986 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
add a comment |
$begingroup$
So I have 4GB of turn-by-turn data for many games of a particular strategy game. It appears that most people interested in using ML to build an AI for turn-based games use reinforcement learning to build a model on the fly.
Since I already have really good data, can I use supervised learning to solve this task?
EDIT: I was considering using regression to assign a score to a given action based on its likelihood of eventually resulting in a win; is this the right way to think about it?
supervised-learning game
asked yesterday
user6118986user6118986
111
New contributor
user6118986 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
add a comment |
$begingroup$
So I have 4GB of turn-by-turn data for many games of a particular strategy game. It appears that most people interested in using ML to build an AI for turn-based games use reinforcement learning to build a model on the fly.
Since I already have really good data, can I use supervised learning to solve this task?
EDIT: I was considering using regression to assign a score to a given action based on its likelihood of eventually resulting in a win; is this the right way to think about it?
supervised-learning game
asked yesterday
user6118986user6118986
111
New contributor
user6118986 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
So I have 4GB of turn-by-turn data for many games of a particular strategy game. It appears that most people interested in using ML to build an AI for turn-based games use reinforcement learning to build a model on the fly.
Since I already have really good data, can I use supervised learning to solve this task?
EDIT: I was considering using regression to assign a score to a given action based on its likelihood of eventually resulting in a win; is this the right way to think about it?
supervised-learning game
supervised-learning game
asked yesterday
user6118986user6118986
111
New contributor
user6118986 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked yesterday
user6118986user6118986
111
New contributor
user6118986 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked yesterday
user6118986user6118986
111
New contributor
user6118986 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked yesterday
user6118986user6118986
111
asked yesterday
user6118986user6118986
111
111
New contributor
user6118986 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
user6118986 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
user6118986 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
Maybe the correct way of addressing this is by making sub optimizations of every step, even though it could be done by regression, I would suggest decision trees.
You have and advantage: A game is made of discrete steps, so in every moment you can "stop" and decide the best move based on your (possibly comprehensive) history of moves.
Supervised learning vs reinforcement learning for a simple self driving rc car
answered yesterday
Juan Esteban de la CalleJuan Esteban de la Calle
687
New contributor
Juan Esteban de la Calle is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
$begingroup$
Could both regression and decision trees be used? I feel like the output of the prediction of a given turn needs to be a continuous value.
$endgroup$
– user6118986
yesterday
$begingroup$
Yes, you could use both of them. I don't know which game your AI is playing but is difficult to think in a game which has a continuos output of a move. Think in Chess (for example), the queen moves n blocks and every block has its own output. Regression is not enough to get the no-linear scoring schemas of most turn-based games.
$endgroup$
– Juan Esteban de la Calle
yesterday
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "557"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
user6118986 is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f49144%2fsupervised-learning-for-a-turn-based-game%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
Maybe the correct way of addressing this is by making sub optimizations of every step, even though it could be done by regression, I would suggest decision trees.
You have and advantage: A game is made of discrete steps, so in every moment you can "stop" and decide the best move based on your (possibly comprehensive) history of moves.
Supervised learning vs reinforcement learning for a simple self driving rc car
answered yesterday
Juan Esteban de la CalleJuan Esteban de la Calle
687
New contributor
Juan Esteban de la Calle is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
$begingroup$
Could both regression and decision trees be used? I feel like the output of the prediction of a given turn needs to be a continuous value.
$endgroup$
– user6118986
yesterday
$begingroup$
Yes, you could use both of them. I don't know which game your AI is playing but is difficult to think in a game which has a continuos output of a move. Think in Chess (for example), the queen moves n blocks and every block has its own output. Regression is not enough to get the no-linear scoring schemas of most turn-based games.
$endgroup$
– Juan Esteban de la Calle
yesterday
add a comment |
$begingroup$
Maybe the correct way of addressing this is by making sub optimizations of every step, even though it could be done by regression, I would suggest decision trees.
You have and advantage: A game is made of discrete steps, so in every moment you can "stop" and decide the best move based on your (possibly comprehensive) history of moves.
Supervised learning vs reinforcement learning for a simple self driving rc car
answered yesterday
Juan Esteban de la CalleJuan Esteban de la Calle
687
New contributor
Juan Esteban de la Calle is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
$begingroup$
Could both regression and decision trees be used? I feel like the output of the prediction of a given turn needs to be a continuous value.
$endgroup$
– user6118986
yesterday
$begingroup$
Yes, you could use both of them. I don't know which game your AI is playing but is difficult to think in a game which has a continuos output of a move. Think in Chess (for example), the queen moves n blocks and every block has its own output. Regression is not enough to get the no-linear scoring schemas of most turn-based games.
$endgroup$
– Juan Esteban de la Calle
yesterday
add a comment |
$begingroup$
Maybe the correct way of addressing this is by making sub optimizations of every step, even though it could be done by regression, I would suggest decision trees.
You have and advantage: A game is made of discrete steps, so in every moment you can "stop" and decide the best move based on your (possibly comprehensive) history of moves.
Supervised learning vs reinforcement learning for a simple self driving rc car
answered yesterday
Juan Esteban de la CalleJuan Esteban de la Calle
687
New contributor
Juan Esteban de la Calle is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
Maybe the correct way of addressing this is by making sub optimizations of every step, even though it could be done by regression, I would suggest decision trees.
You have and advantage: A game is made of discrete steps, so in every moment you can "stop" and decide the best move based on your (possibly comprehensive) history of moves.
Supervised learning vs reinforcement learning for a simple self driving rc car
answered yesterday
Juan Esteban de la CalleJuan Esteban de la Calle
687
New contributor
Juan Esteban de la Calle is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
answered yesterday
Juan Esteban de la CalleJuan Esteban de la Calle
687
New contributor
Juan Esteban de la Calle is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
answered yesterday
Juan Esteban de la CalleJuan Esteban de la Calle
687
answered yesterday
Juan Esteban de la CalleJuan Esteban de la Calle
687
687
New contributor
Juan Esteban de la Calle is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
Juan Esteban de la Calle is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
Juan Esteban de la Calle is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$begingroup$
Could both regression and decision trees be used? I feel like the output of the prediction of a given turn needs to be a continuous value.
$endgroup$
– user6118986
yesterday
$begingroup$
Yes, you could use both of them. I don't know which game your AI is playing but is difficult to think in a game which has a continuos output of a move. Think in Chess (for example), the queen moves n blocks and every block has its own output. Regression is not enough to get the no-linear scoring schemas of most turn-based games.
$endgroup$
– Juan Esteban de la Calle
yesterday
add a comment |
$begingroup$
Could both regression and decision trees be used? I feel like the output of the prediction of a given turn needs to be a continuous value.
$endgroup$
– user6118986
yesterday
$begingroup$
Yes, you could use both of them. I don't know which game your AI is playing but is difficult to think in a game which has a continuos output of a move. Think in Chess (for example), the queen moves n blocks and every block has its own output. Regression is not enough to get the no-linear scoring schemas of most turn-based games.
$endgroup$
– Juan Esteban de la Calle
yesterday
$begingroup$
Could both regression and decision trees be used? I feel like the output of the prediction of a given turn needs to be a continuous value.
$endgroup$
– user6118986
yesterday
$begingroup$
Could both regression and decision trees be used? I feel like the output of the prediction of a given turn needs to be a continuous value.
$endgroup$
– user6118986
yesterday
$begingroup$
Yes, you could use both of them. I don't know which game your AI is playing but is difficult to think in a game which has a continuos output of a move. Think in Chess (for example), the queen moves n blocks and every block has its own output. Regression is not enough to get the no-linear scoring schemas of most turn-based games.
$endgroup$
– Juan Esteban de la Calle
yesterday
$begingroup$
Yes, you could use both of them. I don't know which game your AI is playing but is difficult to think in a game which has a continuos output of a move. Think in Chess (for example), the queen moves n blocks and every block has its own output. Regression is not enough to get the no-linear scoring schemas of most turn-based games.
$endgroup$
– Juan Esteban de la Calle
yesterday
add a comment |
user6118986 is a new contributor. Be nice, and check out our Code of Conduct.
user6118986 is a new contributor. Be nice, and check out our Code of Conduct.
user6118986 is a new contributor. Be nice, and check out our Code of Conduct.
user6118986 is a new contributor. Be nice, and check out our Code of Conduct.
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f49144%2fsupervised-learning-for-a-turn-based-game%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
