Skip to content

Latest commit

 

History

History
61 lines (48 loc) · 3.36 KB

README.md

File metadata and controls

61 lines (48 loc) · 3.36 KB
Raw

Mathosphere

About

Mathosphere consists of the following components:

  • A baseX ad hock formula search system
  • A flink batch processing system
  • A rest interface

The baseX backend manages the data used for ad hock retrieval for MathSearch on Wikipedia or DRMF. The rest interface provides an interface for ad hock retrieval. The MediaWiki MathSearch extension serves as a frontend. The flink batch processing component is used for long running data analysis and batch queries.

Releases and old versions

Currently, there is no Mathosphere release available. Version 3.0.0 is the first version that is going to be released to the public MavenCentral

However, the MathML query generator is available from maven central MavenCentral Note we are using a development version of MathML query generator for this project, under a submodule.

Version 1.0.0-SNAPSHOT is tightly coupled to Stratosphere 0.2.x and was focused on batch formula search. The code is available from (TU-Berlin/mathosphere-history). The research prototype was build explicitly for the NTCIR-10. We demonstrate the principle of separating the challenges of handing huge dadaists from principal question in MIR. See our Querying large Collections of Mathematical Publications paper.

Version 2.0.0-SNAPSHOT is based on Apache Flink. This research prototype analysing fundamental factors of formula similarity is build for the NTCIR-11 conference. See our paper

We are using the NTCIR-11 Wikipedia dataset (specifically the augmentedWikiDump.xml from this host) for as additional training dataset.

Checkout

  • if tests fail on windows make sure to checkout the files with unix-style line endings. This is most easily done by git config --global core.autocrlf false

  • in the git for windows installation process this would be the option #2 Checkout as-is, commit Unix-style line endings Git will not perform any conversion when checking out text files.

Master branch tests

Build Status Coverage Status

Building this project

Run the following to initialize submodules after cloning this project:

git submodule init
git submodule update

Run the following to pull latest changes from each submodules' repo

git submodule update --remote --merge

Troubleshooting

If test fail due to encoding problems in windows, set the environment variable

JAVA_TOOL_OPTIONS = -Dfile.encoding=UTF8

as suggested on stackoverflow.