how to export the tables into a csv file pandas
$begingroup$
The following is a piece of code I wrote to create a pivot table for categorical vs continuous variable.
for row in categorical:
for col in numeric:
ptable = pd.pivot_table(df, values = col, index = row, aggfunc = ['min','max','median','mean','std',lambda x: 100*x.count()/df.shape[0]])
print(ptable)
writer = pd.ExcelWriter('report.xlsx')
ptable.to_excel(writer, 'Sheet1')
writer.save()
It displays the output as in the image:
but this is not a data frame and when writing into an excel file it displays only the last iteration values.
how do I get all the iterated tables into the excel file or separate excel files?
python pandas ipython
edited Jun 19 '18 at 14:59
Harpal
2661310
asked Jun 19 '18 at 11:22
Abraham WilsonAbraham Wilson
63
$endgroup$
bumped to the homepage by Community♦ 15 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
$begingroup$
The following is a piece of code I wrote to create a pivot table for categorical vs continuous variable.
for row in categorical:
for col in numeric:
ptable = pd.pivot_table(df, values = col, index = row, aggfunc = ['min','max','median','mean','std',lambda x: 100*x.count()/df.shape[0]])
print(ptable)
writer = pd.ExcelWriter('report.xlsx')
ptable.to_excel(writer, 'Sheet1')
writer.save()
It displays the output as in the image:
but this is not a data frame and when writing into an excel file it displays only the last iteration values.
how do I get all the iterated tables into the excel file or separate excel files?
python pandas ipython
edited Jun 19 '18 at 14:59
Harpal
2661310
asked Jun 19 '18 at 11:22
Abraham WilsonAbraham Wilson
63
$endgroup$
bumped to the homepage by Community♦ 15 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
$begingroup$
The following is a piece of code I wrote to create a pivot table for categorical vs continuous variable.
for row in categorical:
for col in numeric:
ptable = pd.pivot_table(df, values = col, index = row, aggfunc = ['min','max','median','mean','std',lambda x: 100*x.count()/df.shape[0]])
print(ptable)
writer = pd.ExcelWriter('report.xlsx')
ptable.to_excel(writer, 'Sheet1')
writer.save()
It displays the output as in the image:
but this is not a data frame and when writing into an excel file it displays only the last iteration values.
how do I get all the iterated tables into the excel file or separate excel files?
python pandas ipython
edited Jun 19 '18 at 14:59
Harpal
2661310
asked Jun 19 '18 at 11:22
Abraham WilsonAbraham Wilson
63
$endgroup$
The following is a piece of code I wrote to create a pivot table for categorical vs continuous variable.
for row in categorical:
for col in numeric:
ptable = pd.pivot_table(df, values = col, index = row, aggfunc = ['min','max','median','mean','std',lambda x: 100*x.count()/df.shape[0]])
print(ptable)
writer = pd.ExcelWriter('report.xlsx')
ptable.to_excel(writer, 'Sheet1')
writer.save()
It displays the output as in the image:
but this is not a data frame and when writing into an excel file it displays only the last iteration values.
how do I get all the iterated tables into the excel file or separate excel files?
python pandas ipython
python pandas ipython
edited Jun 19 '18 at 14:59
Harpal
2661310
asked Jun 19 '18 at 11:22
Abraham WilsonAbraham Wilson
63
edited Jun 19 '18 at 14:59
Harpal
2661310
asked Jun 19 '18 at 11:22
Abraham WilsonAbraham Wilson
63
edited Jun 19 '18 at 14:59
Harpal
2661310
edited Jun 19 '18 at 14:59
Harpal
2661310
edited Jun 19 '18 at 14:59
Harpal
2661310
2661310
asked Jun 19 '18 at 11:22
Abraham WilsonAbraham Wilson
63
asked Jun 19 '18 at 11:22
Abraham WilsonAbraham Wilson
63
asked Jun 19 '18 at 11:22
Abraham WilsonAbraham Wilson
63
63
bumped to the homepage by Community♦ 15 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
bumped to the homepage by Community♦ 15 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
Your current code overwrites the previous sheet, which is why only the last iteration is present. Setting each sheet to the same name (Sheet1) will overwrite the sheet. This name will need to be changed for each interation.
Try this:
for row_index, row in enumerate(categorical):
for col_index, col in enumerate(numeric):
ptable = pd.pivot_table(df, values = col, index = row, aggfunc = ['min','max','median','mean','std',lambda x: 100*x.count()/df.shape[0]])
print(ptable)
writer = pd.ExcelWriter('report.xlsx')
ptable.to_excel(writer, 'Sheet1_{}_{}'.format(row_index, col_index))
writer.save()
This should save each iteration as an individual sheet
answered Jun 19 '18 at 12:17
HarpalHarpal
2661310
$endgroup$
$begingroup$
i ran into the following error: Exception: Excel worksheet name 'Sheet1_Runners-Up_QualifiedTeams' must be <= 31 chars.
$endgroup$
– Abraham Wilson
Jun 19 '18 at 14:00
$begingroup$
Instead of writing it into different CSV, is it possible to convert the ptable into dataframes??
$endgroup$
– Abraham Wilson
Jun 20 '18 at 11:52
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "557"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f33370%2fhow-to-export-the-tables-into-a-csv-file-pandas%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
Your current code overwrites the previous sheet, which is why only the last iteration is present. Setting each sheet to the same name (Sheet1) will overwrite the sheet. This name will need to be changed for each interation.
Try this:
for row_index, row in enumerate(categorical):
for col_index, col in enumerate(numeric):
ptable = pd.pivot_table(df, values = col, index = row, aggfunc = ['min','max','median','mean','std',lambda x: 100*x.count()/df.shape[0]])
print(ptable)
writer = pd.ExcelWriter('report.xlsx')
ptable.to_excel(writer, 'Sheet1_{}_{}'.format(row_index, col_index))
writer.save()
This should save each iteration as an individual sheet
answered Jun 19 '18 at 12:17
HarpalHarpal
2661310
$endgroup$
$begingroup$
i ran into the following error: Exception: Excel worksheet name 'Sheet1_Runners-Up_QualifiedTeams' must be <= 31 chars.
$endgroup$
– Abraham Wilson
Jun 19 '18 at 14:00
$begingroup$
Instead of writing it into different CSV, is it possible to convert the ptable into dataframes??
$endgroup$
– Abraham Wilson
Jun 20 '18 at 11:52
add a comment |
$begingroup$
Your current code overwrites the previous sheet, which is why only the last iteration is present. Setting each sheet to the same name (Sheet1) will overwrite the sheet. This name will need to be changed for each interation.
Try this:
for row_index, row in enumerate(categorical):
for col_index, col in enumerate(numeric):
ptable = pd.pivot_table(df, values = col, index = row, aggfunc = ['min','max','median','mean','std',lambda x: 100*x.count()/df.shape[0]])
print(ptable)
writer = pd.ExcelWriter('report.xlsx')
ptable.to_excel(writer, 'Sheet1_{}_{}'.format(row_index, col_index))
writer.save()
This should save each iteration as an individual sheet
answered Jun 19 '18 at 12:17
HarpalHarpal
2661310
$endgroup$
$begingroup$
i ran into the following error: Exception: Excel worksheet name 'Sheet1_Runners-Up_QualifiedTeams' must be <= 31 chars.
$endgroup$
– Abraham Wilson
Jun 19 '18 at 14:00
$begingroup$
Instead of writing it into different CSV, is it possible to convert the ptable into dataframes??
$endgroup$
– Abraham Wilson
Jun 20 '18 at 11:52
add a comment |
$begingroup$
Your current code overwrites the previous sheet, which is why only the last iteration is present. Setting each sheet to the same name (Sheet1) will overwrite the sheet. This name will need to be changed for each interation.
Try this:
for row_index, row in enumerate(categorical):
for col_index, col in enumerate(numeric):
ptable = pd.pivot_table(df, values = col, index = row, aggfunc = ['min','max','median','mean','std',lambda x: 100*x.count()/df.shape[0]])
print(ptable)
writer = pd.ExcelWriter('report.xlsx')
ptable.to_excel(writer, 'Sheet1_{}_{}'.format(row_index, col_index))
writer.save()
This should save each iteration as an individual sheet
answered Jun 19 '18 at 12:17
HarpalHarpal
2661310
$endgroup$
Your current code overwrites the previous sheet, which is why only the last iteration is present. Setting each sheet to the same name (Sheet1) will overwrite the sheet. This name will need to be changed for each interation.
Try this:
for row_index, row in enumerate(categorical):
for col_index, col in enumerate(numeric):
ptable = pd.pivot_table(df, values = col, index = row, aggfunc = ['min','max','median','mean','std',lambda x: 100*x.count()/df.shape[0]])
print(ptable)
writer = pd.ExcelWriter('report.xlsx')
ptable.to_excel(writer, 'Sheet1_{}_{}'.format(row_index, col_index))
writer.save()
This should save each iteration as an individual sheet
answered Jun 19 '18 at 12:17
HarpalHarpal
2661310
answered Jun 19 '18 at 12:17
HarpalHarpal
2661310
answered Jun 19 '18 at 12:17
HarpalHarpal
2661310
answered Jun 19 '18 at 12:17
HarpalHarpal
2661310
2661310
$begingroup$
i ran into the following error: Exception: Excel worksheet name 'Sheet1_Runners-Up_QualifiedTeams' must be <= 31 chars.
$endgroup$
– Abraham Wilson
Jun 19 '18 at 14:00
$begingroup$
Instead of writing it into different CSV, is it possible to convert the ptable into dataframes??
$endgroup$
– Abraham Wilson
Jun 20 '18 at 11:52
add a comment |
$begingroup$
i ran into the following error: Exception: Excel worksheet name 'Sheet1_Runners-Up_QualifiedTeams' must be <= 31 chars.
$endgroup$
– Abraham Wilson
Jun 19 '18 at 14:00
$begingroup$
Instead of writing it into different CSV, is it possible to convert the ptable into dataframes??
$endgroup$
– Abraham Wilson
Jun 20 '18 at 11:52
$begingroup$
i ran into the following error: Exception: Excel worksheet name 'Sheet1_Runners-Up_QualifiedTeams' must be <= 31 chars.
$endgroup$
– Abraham Wilson
Jun 19 '18 at 14:00
$begingroup$
i ran into the following error: Exception: Excel worksheet name 'Sheet1_Runners-Up_QualifiedTeams' must be <= 31 chars.
$endgroup$
– Abraham Wilson
Jun 19 '18 at 14:00
$begingroup$
Instead of writing it into different CSV, is it possible to convert the ptable into dataframes??
$endgroup$
– Abraham Wilson
Jun 20 '18 at 11:52
$begingroup$
Instead of writing it into different CSV, is it possible to convert the ptable into dataframes??
$endgroup$
– Abraham Wilson
Jun 20 '18 at 11:52
add a comment |
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f33370%2fhow-to-export-the-tables-into-a-csv-file-pandas%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
