首页
学习
活动
专区
圈层
工具
发布
社区首页 >问答首页 >Pandas保存到新文件时出现内存和值错误

Pandas保存到新文件时出现内存和值错误
EN

Stack Overflow用户
提问于 2020-07-16 13:27:22
回答 2查看 403关注 0票数 0

脚本的几行简单代码。它是从Excel文件中删除一些列,并将其保存到新文件中。

代码语言:javascript
复制
import pandas as pd
import numpy as np

work_file = "C:\\My Documents\\the_file.xlsx"
df = pd.read_excel(work_file, sheet_name = "Sheet1", index_col = 0)

column_list_to_remove = ["Name","Gender","Register"]

results1 = df.drop(column_list_to_remove, axis=1)

writer = pd.ExcelWriter("C:\\My Documents\\new-file.xlsx")
results1.to_excel(writer,'Sheet1')

writer.save()

它在一台旧电脑上运行得很好,包括大小(1000行)的Excel文件。

我现在已经升级到了一台内存更大(16 GB)的新电脑。当我运行这个脚本时,它在一个小文件(几千行)上运行得很好。但是当它在更大的文件(10万行Excel)上运行时,它给出了下面的错误消息。

我怎样才能纠正这个错误呢?谢谢。

错误消息:

代码语言:javascript
复制
Traceback (most recent call last):
  File "C:\Python38\lib\xml\etree\ElementTree.py", line 832, in _get_writer
    yield file.write
  File "C:\Python38\lib\xml\etree\ElementTree.py", line 772, in write
    serialize(write, self._root, qnames, namespaces,
  File "C:\Python38\lib\xml\etree\ElementTree.py", line 937, in _serialize_xml
    _serialize_xml(write, e, qnames, None,
  File "C:\Python38\lib\xml\etree\ElementTree.py", line 937, in _serialize_xml
    _serialize_xml(write, e, qnames, None,
  File "C:\Python38\lib\xml\etree\ElementTree.py", line 937, in _serialize_xml
    _serialize_xml(write, e, qnames, None,
  File "C:\Python38\lib\xml\etree\ElementTree.py", line 931, in _serialize_xml
    write(" %s=\"%s\"" % (qnames[k], v))
MemoryError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\My Documents\my_script.py", line 9, in <module>
    writer.save()
  File "C:\Python38\lib\site-packages\pandas\io\excel\_openpyxl.py", line 43, in save
    return self.book.save(self.path)
  File "C:\Python38\lib\site-packages\openpyxl\workbook\workbook.py", line 392, in save
    save_workbook(self, filename)
  File "C:\Python38\lib\site-packages\openpyxl\writer\excel.py", line 293, in save_workbook
    writer.save()
  File "C:\Python38\lib\site-packages\openpyxl\writer\excel.py", line 275, in save
    self.write_data()
  File "C:\Python38\lib\site-packages\openpyxl\writer\excel.py", line 75, in write_data
    self._write_worksheets()
  File "C:\Python38\lib\site-packages\openpyxl\writer\excel.py", line 215, in _write_worksheets
    self.write_worksheet(ws)
  File "C:\Python38\lib\site-packages\openpyxl\writer\excel.py", line 200, in write_worksheet
    writer.write()
  File "C:\Python38\lib\site-packages\openpyxl\worksheet\_writer.py", line 360, in write
    self.close()
  File "C:\Python38\lib\site-packages\openpyxl\worksheet\_writer.py", line 368, in close
    self.xf.close()
  File "C:\Python38\lib\site-packages\openpyxl\worksheet\_writer.py", line 299, in get_stream
    pass
  File "C:\Python38\lib\contextlib.py", line 120, in __exit__
    next(self.gen)
  File "C:\Python38\lib\site-packages\et_xmlfile\xmlfile.py", line 50, in element
    self._write_element(el)
  File "C:\Python38\lib\site-packages\et_xmlfile\xmlfile.py", line 77, in _write_element
    xml = tostring(element)
  File "C:\Python38\lib\xml\etree\ElementTree.py", line 1133, in tostring
    ElementTree(element).write(stream, encoding,
  File "C:\Python38\lib\xml\etree\ElementTree.py", line 772, in write
    serialize(write, self._root, qnames, namespaces,
  File "C:\Python38\lib\contextlib.py", line 131, in __exit__
    self.gen.throw(type, value, traceback)
  File "C:\Python38\lib\xml\etree\ElementTree.py", line 832, in _get_writer
    yield file.write
  File "C:\Python38\lib\contextlib.py", line 525, in __exit__
    raise exc_details[1]
  File "C:\Python38\lib\contextlib.py", line 510, in __exit__
    if cb(*exc_details):
  File "C:\Python38\lib\contextlib.py", line 382, in _exit_wrapper
    callback(*args, **kwds)
ValueError: I/O operation on closed file.
EN

回答 2

Stack Overflow用户

回答已采纳

发布于 2020-07-16 15:06:02

将最后三行代码替换为以下代码:

代码语言:javascript
复制
with pd.ExcelWriter("C:\\My Documents\\new-file.xlsx") as writer:
    results1.to_excel(writer)
票数 1
EN

Stack Overflow用户

发布于 2020-07-16 15:07:27

通过重新安装64位Python版本解决了此问题。未对代码进行任何更改。

票数 0
EN
页面原文内容由Stack Overflow提供。腾讯云小微IT领域专用引擎提供翻译支持
原文链接:

https://stackoverflow.com/questions/62928009

复制
相关文章

相似问题

领券
问题归档专栏文章快讯文章归档关键词归档开发者手册归档开发者手册 Section 归档