Packaging python scripts

[tulinkry]

fixes #2251

This includes:

• renaming tools to opengrok-tools
• packaging the python scripts as opengrok-tools python package
• running tests in maven for the package
• using virtual env
• including the python package in final distribution in tools/opengrok-tools.tar.gz

[tulinkry]

There's more to go as I'm not really skilled with maven.

• the python package should be generated to target directory (now is generated to dist and build directories)
• maven clean should clean the generated python files
• think about something what to do with the python package version (replace with the current opengrok version?)

[tulinkry]

If anyone can examined these it'd be nice. I didn't write the original scripts so I'm not sure if that was just a copy paste mistake.

opengrok_tools/sync.py:61:5: F821 undefined name 'logger'
opengrok_tools/sync.py:69:5: F841 local variable 'output' is assigned to but never used
opengrok_tools/mirror.py:57:5: F841 local variable 'output' is assigned to but never used
opengrok_tools/mirror.py:58:5: F841 local variable 'dirs_to_process' is assigned to but never used

[coveralls]

Pull Request Test Coverage Report for Build 3207

• 0 of 0 changed or added relevant lines in 0 files are covered.
• 334 unchanged lines in 15 files lost coverage.
• Overall coverage decreased (-0.8%) to 72.749%

---

Files with Coverage Reduction	New Missed Lines	%
opengrok-indexer/src/main/java/org/opengrok/indexer/web/PageConfig.java	1	34.26%
opengrok-indexer/src/main/java/org/opengrok/indexer/index/IndexDatabase.java	1	55.81%
opengrok-indexer/src/main/java/org/opengrok/indexer/configuration/IndexTimestamp.java	2	42.86%
opengrok-indexer/src/main/java/org/opengrok/indexer/history/BazaarHistoryParser.java	9	71.62%
opengrok-indexer/src/main/java/org/opengrok/indexer/history/SCCSget.java	12	0.0%
opengrok-indexer/src/main/java/org/opengrok/indexer/history/RCSAnnotationParser.java	13	34.78%
opengrok-indexer/src/main/java/org/opengrok/indexer/history/BitKeeperAnnotationParser.java	14	0.0%
opengrok-indexer/src/main/java/org/opengrok/indexer/history/Annotation.java	14	64.18%
opengrok-indexer/src/main/java/org/opengrok/indexer/history/SCCSRepositoryAuthorParser.java	16	0.0%
opengrok-indexer/src/main/java/org/opengrok/indexer/history/BazaarAnnotationParser.java	20	0.0%

Totals
Change from base Build 3205:	-0.8%
Covered Lines:	31669
Relevant Lines:	43532

---

💛 - Coveralls

[vladak]

think about something what to do with the python package version (replace with the current opengrok version?)

yes please. That said, each major script has its own version.

[vladak]

The fixes to the lint errors look okay.

[tulinkry]

Name: opengrok-tools
Version: 1.1rc48
Summary: Tools for managing OpenGrok instance
Home-page: https://github.com/OpenGrok/OpenGrok
Author: Oracle
Author-email: [email protected]
License: CDDL
Location: /Users/ktulinger/OpenGrok/opengrok-tools/env/lib/python3.6/site-packages/opengrok_tools-1.1rc48-py3.6.egg
Requires: jsonschema, pyyaml, requests, resource
Y

[vladak]

is there a way how to avoid hardcoding the version ? Should we be using OpenGrok version at all here actually ?

[tulinkry]

I think maven can do it, I hope someone how is with better experience with maven can handle this

[tulinkry]

think about something what to do with the python package version (replace with the current opengrok version?)

yes please. That said, each major script has its own version.

You've already said that we should use the opengrok version, that's why I changed it.

[vladak]

Pls file a new issue to get the version number resolved.