How to build Non Linear Vector auto regression using Neural Nets
$begingroup$
I have worked on VAR ( vector Auto regression), which forecasts multiple output values(continuous) when there is linear relationship between all variables. I want to use Neural nets to do so,sothat I can include non linear relation among variables also.
Is there any specific type of NN available?
If not how can I implement it using NN?
neural-network regression lstm
asked Jun 14 '18 at 10:01
Arpit SisodiaArpit Sisodia
27718
$endgroup$
bumped to the homepage by Community♦ 21 hours ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
$begingroup$
I have worked on VAR ( vector Auto regression), which forecasts multiple output values(continuous) when there is linear relationship between all variables. I want to use Neural nets to do so,sothat I can include non linear relation among variables also.
Is there any specific type of NN available?
If not how can I implement it using NN?
neural-network regression lstm
asked Jun 14 '18 at 10:01
Arpit SisodiaArpit Sisodia
27718
$endgroup$
bumped to the homepage by Community♦ 21 hours ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
$begingroup$
I have worked on VAR ( vector Auto regression), which forecasts multiple output values(continuous) when there is linear relationship between all variables. I want to use Neural nets to do so,sothat I can include non linear relation among variables also.
Is there any specific type of NN available?
If not how can I implement it using NN?
neural-network regression lstm
asked Jun 14 '18 at 10:01
Arpit SisodiaArpit Sisodia
27718
$endgroup$
I have worked on VAR ( vector Auto regression), which forecasts multiple output values(continuous) when there is linear relationship between all variables. I want to use Neural nets to do so,sothat I can include non linear relation among variables also.
Is there any specific type of NN available?
If not how can I implement it using NN?
neural-network regression lstm
neural-network regression lstm
asked Jun 14 '18 at 10:01
Arpit SisodiaArpit Sisodia
27718
asked Jun 14 '18 at 10:01
Arpit SisodiaArpit Sisodia
27718
asked Jun 14 '18 at 10:01
Arpit SisodiaArpit Sisodia
27718
asked Jun 14 '18 at 10:01
Arpit SisodiaArpit Sisodia
27718
asked Jun 14 '18 at 10:01
Arpit SisodiaArpit Sisodia
27718
27718
bumped to the homepage by Community♦ 21 hours ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
bumped to the homepage by Community♦ 21 hours ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
The type of artificial neural nets (ANN) you are looking for is ANN with cycles which is widely known as recurrent neural networks(RNN). As you have mentioned Vector Auto regression (VAR) I would recommend you to check out this paper which compares VAR to RNN on two different tasks pertaining to two different real world datasets.
One specific type of RNN is Long short term memory (LSTM). It is particularly good at learning over long sequences. Although RNN is also perfectly capable of that theoretically, but with little empirical success. So, in recent years LSTM has gained huge popularity and has been very successful over sequence learning tasks. I would recommend this book which provides a fair bit of understanding of ANN with cycles and the tasks they are being applied to.
For implementation of RNN there are many APIs available. Keras provides a high level API for the same.
For modelling multivariate time series with LSTM check out this tutorial.
You can also have a look at this question that I answered on cross validated.
answered Jun 16 '18 at 5:58
naivenaive
2817
$endgroup$
$begingroup$
I know different tools and API( not the deep understanding). My concern is -having multiple output in output layer. How would common loss function look like.( As now NN has to minimize multiple loss functions.. Will this be possible also?
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 6:15
$begingroup$
@ArpitSisodia Edit you question accordingly. It doesn't exactly reflect what you are asking.
$endgroup$
– naive
Jun 18 '18 at 6:46
$begingroup$
sure @Naive. anyway R2N2 is useful, I need to read this paper.
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 7:45
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "557"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f33143%2fhow-to-build-non-linear-vector-auto-regression-using-neural-nets%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
The type of artificial neural nets (ANN) you are looking for is ANN with cycles which is widely known as recurrent neural networks(RNN). As you have mentioned Vector Auto regression (VAR) I would recommend you to check out this paper which compares VAR to RNN on two different tasks pertaining to two different real world datasets.
One specific type of RNN is Long short term memory (LSTM). It is particularly good at learning over long sequences. Although RNN is also perfectly capable of that theoretically, but with little empirical success. So, in recent years LSTM has gained huge popularity and has been very successful over sequence learning tasks. I would recommend this book which provides a fair bit of understanding of ANN with cycles and the tasks they are being applied to.
For implementation of RNN there are many APIs available. Keras provides a high level API for the same.
For modelling multivariate time series with LSTM check out this tutorial.
You can also have a look at this question that I answered on cross validated.
answered Jun 16 '18 at 5:58
naivenaive
2817
$endgroup$
$begingroup$
I know different tools and API( not the deep understanding). My concern is -having multiple output in output layer. How would common loss function look like.( As now NN has to minimize multiple loss functions.. Will this be possible also?
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 6:15
$begingroup$
@ArpitSisodia Edit you question accordingly. It doesn't exactly reflect what you are asking.
$endgroup$
– naive
Jun 18 '18 at 6:46
$begingroup$
sure @Naive. anyway R2N2 is useful, I need to read this paper.
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 7:45
add a comment |
$begingroup$
The type of artificial neural nets (ANN) you are looking for is ANN with cycles which is widely known as recurrent neural networks(RNN). As you have mentioned Vector Auto regression (VAR) I would recommend you to check out this paper which compares VAR to RNN on two different tasks pertaining to two different real world datasets.
One specific type of RNN is Long short term memory (LSTM). It is particularly good at learning over long sequences. Although RNN is also perfectly capable of that theoretically, but with little empirical success. So, in recent years LSTM has gained huge popularity and has been very successful over sequence learning tasks. I would recommend this book which provides a fair bit of understanding of ANN with cycles and the tasks they are being applied to.
For implementation of RNN there are many APIs available. Keras provides a high level API for the same.
For modelling multivariate time series with LSTM check out this tutorial.
You can also have a look at this question that I answered on cross validated.
answered Jun 16 '18 at 5:58
naivenaive
2817
$endgroup$
$begingroup$
I know different tools and API( not the deep understanding). My concern is -having multiple output in output layer. How would common loss function look like.( As now NN has to minimize multiple loss functions.. Will this be possible also?
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 6:15
$begingroup$
@ArpitSisodia Edit you question accordingly. It doesn't exactly reflect what you are asking.
$endgroup$
– naive
Jun 18 '18 at 6:46
$begingroup$
sure @Naive. anyway R2N2 is useful, I need to read this paper.
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 7:45
add a comment |
$begingroup$
The type of artificial neural nets (ANN) you are looking for is ANN with cycles which is widely known as recurrent neural networks(RNN). As you have mentioned Vector Auto regression (VAR) I would recommend you to check out this paper which compares VAR to RNN on two different tasks pertaining to two different real world datasets.
One specific type of RNN is Long short term memory (LSTM). It is particularly good at learning over long sequences. Although RNN is also perfectly capable of that theoretically, but with little empirical success. So, in recent years LSTM has gained huge popularity and has been very successful over sequence learning tasks. I would recommend this book which provides a fair bit of understanding of ANN with cycles and the tasks they are being applied to.
For implementation of RNN there are many APIs available. Keras provides a high level API for the same.
For modelling multivariate time series with LSTM check out this tutorial.
You can also have a look at this question that I answered on cross validated.
answered Jun 16 '18 at 5:58
naivenaive
2817
$endgroup$
The type of artificial neural nets (ANN) you are looking for is ANN with cycles which is widely known as recurrent neural networks(RNN). As you have mentioned Vector Auto regression (VAR) I would recommend you to check out this paper which compares VAR to RNN on two different tasks pertaining to two different real world datasets.
One specific type of RNN is Long short term memory (LSTM). It is particularly good at learning over long sequences. Although RNN is also perfectly capable of that theoretically, but with little empirical success. So, in recent years LSTM has gained huge popularity and has been very successful over sequence learning tasks. I would recommend this book which provides a fair bit of understanding of ANN with cycles and the tasks they are being applied to.
For implementation of RNN there are many APIs available. Keras provides a high level API for the same.
For modelling multivariate time series with LSTM check out this tutorial.
You can also have a look at this question that I answered on cross validated.
answered Jun 16 '18 at 5:58
naivenaive
2817
edited Jun 17 '18 at 7:45
answered Jun 16 '18 at 5:58
naivenaive
2817
answered Jun 16 '18 at 5:58
naivenaive
2817
answered Jun 16 '18 at 5:58
naivenaive
2817
2817
$begingroup$
I know different tools and API( not the deep understanding). My concern is -having multiple output in output layer. How would common loss function look like.( As now NN has to minimize multiple loss functions.. Will this be possible also?
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 6:15
$begingroup$
@ArpitSisodia Edit you question accordingly. It doesn't exactly reflect what you are asking.
$endgroup$
– naive
Jun 18 '18 at 6:46
$begingroup$
sure @Naive. anyway R2N2 is useful, I need to read this paper.
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 7:45
add a comment |
$begingroup$
I know different tools and API( not the deep understanding). My concern is -having multiple output in output layer. How would common loss function look like.( As now NN has to minimize multiple loss functions.. Will this be possible also?
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 6:15
$begingroup$
@ArpitSisodia Edit you question accordingly. It doesn't exactly reflect what you are asking.
$endgroup$
– naive
Jun 18 '18 at 6:46
$begingroup$
sure @Naive. anyway R2N2 is useful, I need to read this paper.
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 7:45
$begingroup$
I know different tools and API( not the deep understanding). My concern is -having multiple output in output layer. How would common loss function look like.( As now NN has to minimize multiple loss functions.. Will this be possible also?
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 6:15
$begingroup$
I know different tools and API( not the deep understanding). My concern is -having multiple output in output layer. How would common loss function look like.( As now NN has to minimize multiple loss functions.. Will this be possible also?
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 6:15
$begingroup$
@ArpitSisodia Edit you question accordingly. It doesn't exactly reflect what you are asking.
$endgroup$
– naive
Jun 18 '18 at 6:46
$begingroup$
@ArpitSisodia Edit you question accordingly. It doesn't exactly reflect what you are asking.
$endgroup$
– naive
Jun 18 '18 at 6:46
$begingroup$
sure @Naive. anyway R2N2 is useful, I need to read this paper.
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 7:45
$begingroup$
sure @Naive. anyway R2N2 is useful, I need to read this paper.
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 7:45
add a comment |
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f33143%2fhow-to-build-non-linear-vector-auto-regression-using-neural-nets%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
