Issue #175: search indexer crashes on files with special characters (conservancy/kallithea)

[Silas De Munck]

New issue 175: search indexer crashes on files with special characters
https://bitbucket.org/conservancy/kallithea/issues/175/search-indexer-crashes-on-files-with

Silas De Munck:

There are some files in my repository with special charachters (windows filename encoding).

The indexer crashes with the following exception:

2015-11-23 10:15:03.198 INFO  [kallithea.model] initializing db for sqlite:////srv/kallithea/kallithea.db?timeout=60
2015-11-23 10:15:03.347 INFO  [kallithea.model.scm] scanning for repositories in /srv/repos
Traceback (most recent call last):
  File "/srv/kallithea/venv/bin/paster", line 11, in <module>
    sys.exit(run())
  File "/srv/kallithea/venv/local/lib/python2.7/site-packages/paste/script/command.py", line 102, in run
    invoke(command, command_name, options, args[1:])
  File "/srv/kallithea/venv/local/lib/python2.7/site-packages/paste/script/command.py", line 141, in invoke
    exit_code = runner.run(args)
  File "/srv/kallithea/venv/local/lib/python2.7/site-packages/kallithea/lib/utils.py", line 752, in run
    return super(BasePasterCommand, self).run(args[1:])
  File "/srv/kallithea/venv/local/lib/python2.7/site-packages/paste/script/command.py", line 236, in run
    result = self.command()
  File "/srv/kallithea/venv/local/lib/python2.7/site-packages/kallithea/lib/paster_commands/make_index.py", line 83, in command
    .run(full_index=self.options.full_index)
  File "/srv/kallithea/venv/local/lib/python2.7/site-packages/kallithea/lib/indexers/daemon.py", line 450, in run
    self.update_indexes()
  File "/srv/kallithea/venv/local/lib/python2.7/site-packages/kallithea/lib/indexers/daemon.py", line 442, in update_indexes
    self.update_file_index()
  File "/srv/kallithea/venv/local/lib/python2.7/site-packages/kallithea/lib/indexers/daemon.py", line 389, in update_file_index
    i, iwc = self.add_doc(writer, path, repo, repo_name)
  File "/srv/kallithea/venv/local/lib/python2.7/site-packages/kallithea/lib/indexers/daemon.py", line 174, in add_doc
    node = self.get_node(repo, path, index_rev)
  File "/srv/kallithea/venv/local/lib/python2.7/site-packages/kallithea/lib/indexers/daemon.py", line 162, in get_node
    node = cs.get_node(node_path)
  File "/srv/kallithea/venv/local/lib/python2.7/site-packages/kallithea/lib/vcs/backends/hg/changeset.py", line 365, in get_node
    % (path, self.short_id))
kallithea.lib.vcs.exceptions.NodeDoesNotExistError: There is no file nor directory at the given path: 'apps/ems/1_4_benchmark_ιξ.fex' at revision 2df50cf445e6