How to manage missing data in meteorological time series?
$begingroup$
How to know the type of missing data is what it is: MCAR, MAR or NMAR, knowing that I'm working on time series multivariate, and is that going to help me deal with the missing data, and what is the best techniques of processing missing data in time series, knowing that I work on meteorological data?
time-series
edited 7 mins ago
Stephen Rauch
1,52551330
asked Mar 2 at 14:33
Boughrara Boughrara
61
$endgroup$
add a comment |
$begingroup$
How to know the type of missing data is what it is: MCAR, MAR or NMAR, knowing that I'm working on time series multivariate, and is that going to help me deal with the missing data, and what is the best techniques of processing missing data in time series, knowing that I work on meteorological data?
time-series
edited 7 mins ago
Stephen Rauch
1,52551330
asked Mar 2 at 14:33
Boughrara Boughrara
61
$endgroup$
add a comment |
$begingroup$
How to know the type of missing data is what it is: MCAR, MAR or NMAR, knowing that I'm working on time series multivariate, and is that going to help me deal with the missing data, and what is the best techniques of processing missing data in time series, knowing that I work on meteorological data?
time-series
edited 7 mins ago
Stephen Rauch
1,52551330
asked Mar 2 at 14:33
Boughrara Boughrara
61
$endgroup$
How to know the type of missing data is what it is: MCAR, MAR or NMAR, knowing that I'm working on time series multivariate, and is that going to help me deal with the missing data, and what is the best techniques of processing missing data in time series, knowing that I work on meteorological data?
time-series
time-series
edited 7 mins ago
Stephen Rauch
1,52551330
asked Mar 2 at 14:33
Boughrara Boughrara
61
edited 7 mins ago
Stephen Rauch
1,52551330
asked Mar 2 at 14:33
Boughrara Boughrara
61
edited 7 mins ago
Stephen Rauch
1,52551330
edited 7 mins ago
Stephen Rauch
1,52551330
edited 7 mins ago
Stephen Rauch
1,52551330
1,52551330
asked Mar 2 at 14:33
Boughrara Boughrara
61
asked Mar 2 at 14:33
Boughrara Boughrara
61
asked Mar 2 at 14:33
Boughrara Boughrara
61
61
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
It is a question related to the domain of your project. You should know the cause of the missingness.
If some values are missing, because there is no applicable measure then this values are a special case, therefore they're missing not at random. In such case you can impute missing values with the mean value of the non-missing data and add another feature, which indicates special cases.
On the other hand, if the value is missing, because some sensor temporarily stopped working, then it is missing at random, so the measured value is just not known. In this situation you can perform linear regression (or any other regression, but you should start with the linear one) between non-missing data.
In case your problem has mixed types of missingness you should also perform some regression.
answered Mar 2 at 16:29
Michał KardachMichał Kardach
716
$endgroup$
add a comment |
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "557"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f46527%2fhow-to-manage-missing-data-in-meteorological-time-series%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
It is a question related to the domain of your project. You should know the cause of the missingness.
If some values are missing, because there is no applicable measure then this values are a special case, therefore they're missing not at random. In such case you can impute missing values with the mean value of the non-missing data and add another feature, which indicates special cases.
On the other hand, if the value is missing, because some sensor temporarily stopped working, then it is missing at random, so the measured value is just not known. In this situation you can perform linear regression (or any other regression, but you should start with the linear one) between non-missing data.
In case your problem has mixed types of missingness you should also perform some regression.
answered Mar 2 at 16:29
Michał KardachMichał Kardach
716
$endgroup$
add a comment |
$begingroup$
It is a question related to the domain of your project. You should know the cause of the missingness.
If some values are missing, because there is no applicable measure then this values are a special case, therefore they're missing not at random. In such case you can impute missing values with the mean value of the non-missing data and add another feature, which indicates special cases.
On the other hand, if the value is missing, because some sensor temporarily stopped working, then it is missing at random, so the measured value is just not known. In this situation you can perform linear regression (or any other regression, but you should start with the linear one) between non-missing data.
In case your problem has mixed types of missingness you should also perform some regression.
answered Mar 2 at 16:29
Michał KardachMichał Kardach
716
$endgroup$
add a comment |
$begingroup$
It is a question related to the domain of your project. You should know the cause of the missingness.
If some values are missing, because there is no applicable measure then this values are a special case, therefore they're missing not at random. In such case you can impute missing values with the mean value of the non-missing data and add another feature, which indicates special cases.
On the other hand, if the value is missing, because some sensor temporarily stopped working, then it is missing at random, so the measured value is just not known. In this situation you can perform linear regression (or any other regression, but you should start with the linear one) between non-missing data.
In case your problem has mixed types of missingness you should also perform some regression.
answered Mar 2 at 16:29
Michał KardachMichał Kardach
716
$endgroup$
It is a question related to the domain of your project. You should know the cause of the missingness.
If some values are missing, because there is no applicable measure then this values are a special case, therefore they're missing not at random. In such case you can impute missing values with the mean value of the non-missing data and add another feature, which indicates special cases.
On the other hand, if the value is missing, because some sensor temporarily stopped working, then it is missing at random, so the measured value is just not known. In this situation you can perform linear regression (or any other regression, but you should start with the linear one) between non-missing data.
In case your problem has mixed types of missingness you should also perform some regression.
answered Mar 2 at 16:29
Michał KardachMichał Kardach
716
edited Mar 2 at 16:45
answered Mar 2 at 16:29
Michał KardachMichał Kardach
716
answered Mar 2 at 16:29
Michał KardachMichał Kardach
716
answered Mar 2 at 16:29
Michał KardachMichał Kardach
716
716
add a comment |
add a comment |
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f46527%2fhow-to-manage-missing-data-in-meteorological-time-series%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
