Issue #301: Cloning large git repository fails in Kallithea with MemoryError (conservancy/kallithea)

[Geoff Bache]

New issue 301: Cloning large git repository fails in Kallithea with MemoryError
https://bitbucket.org/conservancy/kallithea/issues/301/cloning-large-git-repository-fails-in

Geoff Bache:

I just converted a ~2GB repository to Git and uploaded it to Kallithea. It turns out it cannot be cloned via Kallithea. Cloning it outside Kallithea works fine. Any attempts write the following to the Kallithea log:

2017-12-06 14:17:23.789 ERROR [waitress] Exception when serving /Documentation/doc/git-upload-pack
Traceback (most recent call last):
  File "c:\kallithea\env\lib\site-packages\waitress\channel.py", line 337, in service
    task.service()
  File "c:\kallithea\env\lib\site-packages\waitress\task.py", line 173, in service
    self.execute()
  File "c:\kallithea\env\lib\site-packages\waitress\task.py", line 392, in execute
    app_iter = self.channel.server.application(env, start_response)
  File "c:\python27\lib\site-packages\paste\gzipper.py", line 38, in __call__
    return response.write()
  File "c:\python27\lib\site-packages\paste\gzipper.py", line 68, in write
    out.seek(0)
  File "c:\python27\lib\StringIO.py", line 106, in seek
    self.buf += ''.join(self.buflist)
MemoryError

The machine isn't short of physical memory. We can see that the memory used by the Kallithea process increases by about 1GB before it throws this exception.