Issue #361: FullTextSearch index creation error (conservancy/kallithea)

[vyom]

New issue 361: FullTextSearch index creation error
https://bitbucket.org/conservancy/kallithea/issues/361/fulltextsearch-index-creation-error

vyom:

When I try to create a FullTextSearch index with build from scratch.

![](https://bitbucket.org/repo/EaGrMn/images/2900161151-image.png)
I get following error in my celery task related to .gitmodules \(I have few git repositories in it\).

‌

```plaintext
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]: [2020-02-17 10:57:08,049: ERROR/MainProcess] Task kallithea.lib.celerylib.whoosh_index[a4
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]: Traceback (most recent call last):
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:   File "/home/kallithea/projects/kallithea/venv3/lib/python3.6/site-packages/celery/app/trace.
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:     R = retval = fun(*args, **kwargs)
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:   File "/home/kallithea/projects/kallithea/venv3/lib/python3.6/site-packages/celery/app/trace.
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:     return self.run(*args, **kwargs)
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:   File "/home/kallithea/projects/hg/kallithea/kallithea/lib/celerylib/__init__.py", line 67, i
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:     f_org(*args, **kwargs)
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:   File "</home/kallithea/projects/kallithea/venv3/lib/python3.6/site-packages/decorator.py:dec
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:   File "/home/kallithea/projects/hg/kallithea/kallithea/lib/celerylib/__init__.py", line 109,
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:     ret = func(*fargs, **fkwargs)
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:   File "</home/kallithea/projects/kallithea/venv3/lib/python3.6/site-packages/decorator.py:dec
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:   File "/home/kallithea/projects/hg/kallithea/kallithea/lib/celerylib/__init__.py", line 127,
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:     ret = func(*fargs, **fkwargs)
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:   File "/home/kallithea/projects/hg/kallithea/kallithea/lib/celerylib/tasks.py", line 66, in w
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:     .run(full_index=full_index)
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:   File "/home/kallithea/projects/hg/kallithea/kallithea/lib/indexers/daemon.py", line 451, in
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:     self.build_indexes()
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:   File "/home/kallithea/projects/hg/kallithea/kallithea/lib/indexers/daemon.py", line 437, in
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:     self.index_changesets(chgset_idx_writer, repo_name, repo)
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:   File "/home/kallithea/projects/hg/kallithea/kallithea/lib/indexers/daemon.py", line 244, in
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:     added=' '.join(node.path for node in cs.added).lower(),
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:   File "/home/kallithea/projects/hg/kallithea/kallithea/lib/indexers/daemon.py", line 244, in
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:     added=' '.join(node.path for node in cs.added).lower(),
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:   File "/home/kallithea/projects/hg/kallithea/kallithea/lib/vcs/nodes.py", line 58, in __iter_
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:     yield self.cs.get_node(p)
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:   File "/home/kallithea/projects/hg/kallithea/kallithea/lib/vcs/backends/git/changeset.py", li
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:     cf = ConfigFile.from_file(BytesIO(self.repository._repo.get_object(tree[b'.gitmodules
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:   File "/home/kallithea/projects/kallithea/venv3/lib/python3.6/site-packages/dulwich/objects.p
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]:     return self._entries[name]
Feb 17 10:57:08 kallithea-5-2 kallithea-cli[15779]: KeyError: b'.gitmodules'
```

In order to use Kallithea effectively wanted to introduce code search functionality to my team, but the index creation through Whoosh is not always ok.

‌